Skip to content

him6794/hivemind

HiveMind

Distributed Computing Platform

Transform idle computing resources into a powerful distributed network

Project Status License Python Version Docker Contributions Welcome


What is HiveMind?

HiveMind is an open-source distributed computing platform that revolutionizes how we utilize computing resources. By connecting idle machines across the globe, HiveMind creates a powerful, decentralized computing network capable of handling complex computational tasks, AI model training, and large-scale data processing.

Key Highlights

  • Decentralized Network: No single point of failure, truly distributed architecture
  • High Performance: Optimized task scheduling and resource allocation
  • Secure by Design: End-to-end encryption with WireGuard VPN
  • AI-Powered: Intelligent task distribution and resource optimization
  • Container-Native: Full Docker integration for seamless deployment
  • Cross-Platform: Windows, Linux, and macOS support

Quick Navigation

🌐 新增:Web 文檔系統

我們全新打造了現代化的 Web 文檔系統,提供更好的閱讀體驗:

  • 🎯 文檔中心: 啟動 Web 服務 後訪問 http://localhost:5000/docs/zh/
  • 📥 安裝指南: 完整的安裝教程和故障排除
  • 🚀 快速開始: 5分鐘體驗 HiveMind 核心功能
  • 🔧 API 文檔: 完整的 gRPC API 參考和代碼示例
  • ❓ 常見問題: 智能搜索的 FAQ 系統
# 啟動 Web 文檔系統
cd web
python app.py
# 然後訪問 http://localhost:5000/docs/zh/

System Architecture

HiveMind employs a sophisticated multi-layered architecture designed for scalability, reliability, and performance:

┌─────────────────────────────────────────────────────────────┐
│                    HiveMind Platform                         │
├─────────────────────────────────────────────────────────────┤
│  Web Dashboard    │  Master Node   │  Task Manager         │
├─────────────────────────────────────────────────────────────┤
│                    Node Pool Service                         │
│             (Resource Scheduling & Management)               │
├─────────────────────────────────────────────────────────────┤
│  Worker Node 1  │  Worker Node 2  │  Worker Node N        │
├─────────────────────────────────────────────────────────────┤
│  Container Layer │  VPN Network   │  Monitoring           │
└─────────────────────────────────────────────────────────────┘

Core Components

Component Purpose Technology Stack
Node Pool Central resource management, task scheduling, and multi-level trust system Python, gRPC, Redis, SQLite
Worker Nodes Distributed task execution with containerization support Docker, Python, Resource Monitoring
Master Node System orchestration and web interface Flask, WireGuard VPN
TaskWorker Lightweight task execution framework gRPC, Protocol Buffers
AI Module Intelligent resource optimization Q-Learning, Model Analysis
BT Module P2P file transfer and distribution BitTorrent Protocol

Quick Start

Prerequisites

  • Python 3.8+ - Core runtime environment
  • Docker 20.10+ - Container orchestration
  • Git - Version control
  • 4GB+ RAM - Recommended for optimal performance

Installation

Option 1: Quick Setup (Recommended)

# Clone the repository
git clone https://github.com/him6794/hivemind.git
cd hivemind

# Install Python dependencies
pip install -r requirements.txt

# Quick health check
python -c "import sys; print(f'Python {sys.version} ready')"

Option 2: Development Setup

# Clone with full development tools
git clone --recurse-submodules https://github.com/him6794/hivemind.git
cd hivemind

# Setup virtual environment
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

# Install with development dependencies
pip install -r requirements.txt

Deployment Options

Component Launch Command Description
Node Pool cd node_pool && python node_pool_server.py Central management with trust-based scheduling
Worker Node cd worker && python worker_node.py Computational worker with resource monitoring
Master Node cd master && python master_node.py Web interface & orchestration
TaskWorker cd taskworker && python worker.py Lightweight task executor

Docker Deployment

# Build HiveMind containers
docker-compose build

# Launch complete platform
docker-compose up -d

# View system status
docker-compose ps

Feature Status

Feature Description Status Tech Stack
Node Pool Multi-level trust system, resource scheduling & dynamic allocation Production gRPC, Redis, SQLite, JWT
Worker Nodes Multi-task execution with Docker containerization Production Docker, Python, Flask, VPN
Master Node Web interface & system orchestration Production Flask, WireGuard VPN
TaskWorker Lightweight task execution framework Production gRPC, Protocol Buffers
AI Module Intelligent resource optimization Development Q-Learning, TensorFlow
BT Module P2P file transfer & distribution Beta BitTorrent Protocol
Web Dashboard Real-time monitoring & management Development React, Chart.js
Security Layer End-to-end encryption & authentication Production JWT, WireGuard

Use Cases

Application Use Case Benefits
AI/ML Training Distributed model training Faster convergence, cost reduction
Scientific Computing Climate modeling, simulations Massive parallel processing
Media Processing Video encoding, rendering Resource pooling, faster output
Data Analytics Data processing pipelines Scalable distributed computing

Getting Started in 3 Steps

# Step 1: Download & Install
git clone https://github.com/him6794/hivemind.git
cd hivemind && pip install -r requirements.txt

# Step 2: Choose Your Role
# Resource Provider: cd worker && python worker_node.py
# Task Creator: cd master && python master_node.py
# Network Admin: cd node_pool && python node_pool_server.py

# Step 3: Access the Dashboard
# Open your browser to http://localhost:5000

Congratulations! You're now part of the HiveMind distributed computing network!

Connect & Contribute

Join the Community

Channel Purpose Link
Star the Project Show your support GitHub Repository
Report Issues Help us improve Issue Tracker
Feature Requests Shape the future Discussions
Contribute Code Build together Contributing Guide
Documentation Improve docs Documentation Hub

What's Next?

Roadmap 2025

Quarter Major Features Impact
Q1 2025 Enhanced Web Dashboard, Mobile App Better user experience
Q2 2025 Blockchain Integration, Token Economy Decentralized incentives
Q3 2025 GPU Computing Support, AI Workloads Advanced computation
Q4 2025 Enterprise Features, SLA Guarantees Commercial adoption

License & Legal

HiveMind is open-source software licensed under the GPL v3 License.

License: GPL v3

Contributing

We welcome contributions from developers worldwide! Please read our Contributing Guidelines before submitting pull requests.

Acknowledgments

Special thanks to all contributors, early adopters, and the open-source community that makes projects like HiveMind possible.


Ready to revolutionize computing? Join HiveMind today!

⭐ Star🍴 Fork🐛 Report Bug💬 Discussion

About

A centralized distributed computing platform

Resources

License

Contributing

Security policy

Stars

Watchers

Forks

Packages

No packages published