General Settings
Configure core behavioral defaults and execution limits.
Hybrid Routing
Limits & Context
Diagnostics & Auto-Fix
LLM Providers
Configure API keys, model parameters, and provider backends.
Ollama Settings
Custom OpenAI Compatible API
Quick Presets
Instantly configure parameters for popular local clusters or tools.
AgentRouter API
Groq API
Swarm Settings
Downloaded Models (Local Cache)
Models cached on this machine via Hugging Face. Click on any model to copy its ID.
No models found in local cache (or worker not connected)
Downloading model files...
0%
Python & Library Setup Guide
1. Recommended Python Versions
Python 3.9 to 3.12 are highly recommended for optimal PyTorch and CUDA support. Python 3.13 is supported in PyTorch 2.5.1+. Make sure to install a 64-bit version of Python.
2. Install Required Packages
Run this command in your terminal to install the necessary libraries:
pip install torch transformers huggingface_hub psutil
3. Locate Your Python Executables
Run these commands in your shell to find the exact paths to your installed Python executables:
Windows (PowerShell)
where.exe python
macOS / Linux (Terminal)
which -a python3
Swarm Groups
Pool CPU/GPU compute power across multiple network devices to run large LLMs collaboratively.
Broker Connection
Connect this device to the Swarm broker, then create or join a group below. Broker URL, device name, compute contribution and model settings are configured under LLM Providers → Swarm Settings.
Starting local computation worker...
0%
Active Swarm Group
You are connected to the broker but not in a group yet.
--
--
Invite Code
--
Downloading/Loading assigned layers...
0%
Members & Layer Assignments