Open Source Tools & Projects
Curated collection of the best open source tools for local AI, agent frameworks, RAG, monitoring and automation. All tools are self-hostable and available on GitHub.
67 tools in 9 categories | Last updated: March 2026
LLM Runtimes & Interfaces
Local LLM execution, inference engines and chat interfaces for self-hosted AI.
Ollama
Get up and running with large language models — local LLM runtime.
Ollama Python
Python library for the Ollama API.
Open WebUI
User-friendly WebUI for LLMs — supports Ollama and OpenAI-compatible APIs.
LocalAI
Free, open source OpenAI alternative — self-hosted, no GPU required.
exo
Run AI models on your own hardware — cluster across multiple devices.
BitNet
Official inference framework for 1-bit LLMs by Microsoft.
vLLM
High-throughput and memory-efficient inference and serving engine for LLMs.
LibreChat
Enhanced ChatGPT clone with MCP support, multi-provider and multi-user auth.
Agent Frameworks
Frameworks and platforms for autonomous AI agents, multi-agent systems and orchestration.
CrewAI
Framework for orchestrating role-playing, autonomous AI agents.
CrewAI Examples
Collection of CrewAI example workflows and use cases.
AutoGen
An open-source framework for building AI agent systems by Microsoft.
DeepAgents
LangChain/LangGraph agent with planning and subagents.
mem0
The memory layer for AI apps — persistent memory for AI agents.
Hindsight
Agent memory that learns.
Eliza
Autonomous agents for everyone.
Agent Squad
Multi-agent management framework by AWS Labs.
Hermes Agent
An agent that grows with you — by NousResearch.
LobeHub
Multi-agent collaboration platform.
Maestro
Agent orchestration command center.
ChatDev
Communicative agents for software development.
ruflo
Multi-agent swarm orchestration for Claude.
OpenViking
Context database for AI agents — memory, resources and skills.
12-Factor Agents
Principles for building production-grade LLM software.
Awesome AI Agents
Curated list of autonomous AI agents and agent frameworks.
Workflow Automation
Workflow engines and automation platforms with native AI integration.
n8n
Fair-code workflow automation platform with native AI capabilities.
n8n Workflows (Community)
Large collection of n8n community workflows.
Kestra
Event-driven orchestration platform to build workflows in code or from UI.
RAG & Knowledge
Vector databases, RAG frameworks and knowledge management for AI applications.
open-notebook
Open source NotebookLM alternative — knowledge management with AI.
Qdrant
High-performance, massive-scale vector search engine written in Rust.
Quivr
Opinionated RAG for generative AI applications.
OpenRAG
RAG platform built on Langflow, Docling and OpenSearch.
PageIndex
Document indexing for vectorless RAG — RAG without a vector database.
LEANN
RAG with 97% storage reduction, 100% local and private.
OpenDataLoader PDF
PDF parser for AI-ready data.
Claude Code & OpenClaw Ecosystem
Skills, plugins, hooks and resources for Claude Code and the OpenClaw ecosystem.
Anthropic Skills
Official agent skills repository by Anthropic.
Claude Cookbooks
Official Claude notebooks and recipes by Anthropic.
Claude Plugins Official
Official Claude Code plugins.
Knowledge Work Plugins
Knowledge worker plugins for Claude.
Superpowers
Agentic skills framework and methodology for Claude Code.
Claude Code Hooks Mastery
Comprehensive guide for Claude Code hooks.
Claude Code Hooks Multi-Agent Observability
Multi-agent monitoring and observability via Claude Code hooks.
Awesome Claude Code Toolkit
Comprehensive Claude Code toolkit by the community.
Awesome OpenClaw Use Cases
Community-curated OpenClaw use cases.
Context Hub
Andrew Ng's context hub for AI agents.
Infrastructure & DevOps
Reverse proxies, document management, server security and observability.
Traefik
The cloud native application proxy — modern reverse proxy and load balancer.
Paperless-ngx
Document management system — scan, index, archive your physical documents.
How To Secure A Linux Server
Comprehensive guide to securing a Linux server.
Awesome Sysadmin
Curated list of open source sysadmin tools and resources.
Playwright
Framework for web testing and automation by Microsoft.
Langfuse
Open source LLM engineering platform — traces, evals, prompt management, metrics.
Security & Compliance
AI security testing, red teaming and vulnerability scanning for AI systems.
Other Tools
Web scraping, voice AI, API development and other useful open source tools.
Firecrawl
Turn websites into LLM-ready markdown or structured data.
Handy
Open source offline speech-to-text.
LiveKit Agents
Build real-time multimodal AI applications — framework for voice AI agents.
NocoDB
Open source Airtable alternative — self-hostable no-code database.
Lightpanda Browser
Headless browser for AI and automation.
LLM Server Docs
Complete documentation for building your own LLM server on Debian.
Hoppscotch
Open source API development ecosystem.
Remotion
Make videos programmatically with React.
HA LLM Vision
Home Assistant integration for LLM Vision — image analysis with local models.
HA Ollama Addon
Home Assistant addon for Ollama — local LLMs in your smart home.
Learning Resources
Books, courses and collections for learning AI engineering, ML and LLMs.
LLMs from Scratch
Build a Large Language Model (From Scratch) — LLM implementation in PyTorch.
Awesome LLM Apps
Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini.
ML Engineering Open Book
Machine Learning Engineering Open Book — comprehensive ML reference.
AI Engineering Hub
Tutorials on LLMs, RAGs and AI agent applications.
CS249r ML Systems (Harvard)
Machine Learning Systems — textbook by Harvard.
This list is based on a systematic analysis of 239 GitHub starred repos. Only projects with a relevance score of at least 7/10 for local AI infrastructure and self-hosted setups were included. Descriptions are sourced from the official GitHub repositories.
Related articles
Was this article helpful?
Continue the learning path
The learning path puts these articles in order, and the Hub carries the building blocks we have checked in our own operations.
- Local and self-hosted
- Documented and verifiable
- From our own operations
- Made in Austria