Zum Inhalt springen
>_<
AI EngineeringWiki

AI Tools Database

Curated collection of 67 tools for local AI infrastructure. Categorized, searchable, with real ratings. 15 tools are actively used in our production stack.

🦙

LLM Runtimes

Local LLM execution and inference engines for self-hosted AI.

Ollama

In UseSelf-Hosted

Local LLM execution. One command, model running.

120k+ \u2B50
MIT
llmlocalinference

vLLM

Self-Hosted

High-throughput inference engine with PagedAttention and continuous batching.

50k+ \u2B50
Apache 2.0
llminferencegpu

llama.cpp

Self-Hosted

LLM inference in C/C++. Runs on CPU and GPU, extremely optimized.

75k+ \u2B50
MIT
llmcpugguf

LM Studio

Self-Hosted

Desktop app for local LLMs. Download models and use them instantly.

Proprietary
llmdesktopgui

GPT4All

Self-Hosted

Open-source LLM chatbot for desktop. Private, offline, no API needed.

72k+ \u2B50
MIT
llmdesktopoffline

LocalAI

Self-Hosted

Self-hosted OpenAI alternative. Drop-in replacement for the OpenAI API.

30k+ \u2B50
MIT
llmopenai-compatibleapi

Jan

Self-Hosted

Open-source ChatGPT alternative. 100% offline, runs on any computer.

25k+ \u2B50
AGPL-3.0
llmdesktopoffline
💬

Chat Interfaces

Web-based chat interfaces for LLMs with multi-user, RAG and plugin support.

Open WebUI

In UseSelf-Hosted

Feature-rich WebUI for Ollama and OpenAI-compatible APIs. RAG, multi-user, plugins.

60k+ \u2B50
MIT
chatwebuirag

LibreChat

Self-Hosted

ChatGPT clone with MCP support, multi-provider and multi-user auth.

22k+ \u2B50
MIT
chatmcpmulti-provider

Lobe Chat

Self-Hosted

Modern chat framework with plugin system and vision support.

55k+ \u2B50
MIT
chatpluginsvision

Chatbot UI

Self-Hosted

Open-source ChatGPT interface. Clean, fast, extensible.

29k+ \u2B50
MIT
chatminimalnextjs

Big-AGI

Self-Hosted

AI suite for professionals: multi-model chat, personas, branching, code interpreter.

6k+ \u2B50
MIT
chatmulti-modelpower-user

Workflow Automation

Workflow engines and automation platforms with native AI integration.

n8n

In UseSelf-Hosted

Fair-code workflow automation with 400+ nodes and native AI integration.

55k+ \u2B50
Fair-Code
automationworkflowsai-nodes

Dify

Self-Hosted

LLM app development platform. Visual workflow builder, RAG, agent orchestration.

70k+ \u2B50
Apache 2.0
automationllm-appsrag

Flowise

Self-Hosted

Drag & drop LLM flow builder. LangChain-based, no-code.

35k+ \u2B50
Apache 2.0
automationno-codelangchain

Activepieces

Self-Hosted

Open-source Zapier alternative with AI pieces and self-hosting.

12k+ \u2B50
MIT
automationno-codezapier-alternative

Kestra

Self-Hosted

Event-driven orchestration platform. Workflows in code or UI.

15k+ \u2B50
Apache 2.0
orchestrationevent-drivendata

Langflow

Self-Hosted

Visual framework for multi-agent and RAG applications.

45k+ \u2B50
MIT
automationvisualrag
🔍

RAG & Search

Vector databases, search engines and RAG frameworks for AI applications.

ChromaDB

Self-Hosted

AI-native open-source embedding database. Easy to start, scales with you.

18k+ \u2B50
Apache 2.0
vector-dbembeddingspython

Weaviate

Self-Hosted

Cloud-native vector database with hybrid search and multi-tenancy.

12k+ \u2B50
BSD-3
vector-dbhybrid-searchgraphql

Meilisearch

Self-Hosted

Lightning-fast search engine with typo tolerance. Instant search in milliseconds.

50k+ \u2B50
MIT
searchfull-textinstant

Qdrant

Self-Hosted

High-performance vector search engine in Rust. Filtering, payload, gRPC.

22k+ \u2B50
Apache 2.0
vector-dbrustperformance

LanceDB

Self-Hosted

Serverless vector database for AI. No server needed, embedded.

5k+ \u2B50
Apache 2.0
vector-dbserverlessembedded

open-notebook

In UseSelf-Hosted

Open-source NotebookLM alternative. Knowledge management with AI.

1k+ \u2B50
MIT
knowledgenotebookrag
🤖

Agent Frameworks

Frameworks for autonomous AI agents, multi-agent systems and orchestration.

LangChain

Self-Hosted

Framework for LLM applications. Chains, agents, tools, memory.

100k+ \u2B50
MIT
agentschainstools

LlamaIndex

Self-Hosted

Data framework for LLM applications. Indexing, retrieval, query engines.

38k+ \u2B50
MIT
agentsdataindexing

AutoGen

Self-Hosted

Multi-agent conversation framework by Microsoft. Agents discuss and solve tasks.

40k+ \u2B50
CC-BY-4.0
agentsmulti-agentmicrosoft

CrewAI

Self-Hosted

Framework for role-based autonomous AI agents. Teams of specialized agents.

25k+ \u2B50
MIT
agentsrolesorchestration

Semantic Kernel

Self-Hosted

Microsoft SDK for AI integration in apps. Planner, plugins, memory.

23k+ \u2B50
MIT
agentssdkmicrosoft

Haystack

Self-Hosted

End-to-end NLP framework. Pipelines for search, QA and RAG.

18k+ \u2B50
Apache 2.0
agentspipelinesnlp
🔧

MCP Servers

Model Context Protocol servers for tool integration and AI connectivity.

MCP Servers (Anthropic)

In UseSelf-Hosted

Official MCP server collection by Anthropic. Filesystem, Git, Postgres, Slack, and more.

18k+ \u2B50
MIT
mcptoolsofficial

Awesome MCP Servers

Community-curated list of MCP servers for every use case.

40k+ \u2B50
CC0
mcpawesome-listcommunity

Playwright MCP

In UseSelf-Hosted

Browser automation via MCP. Control websites, screenshots, testing.

8k+ \u2B50
Apache 2.0
mcpbrowsertesting

Notion MCP

In UseSelf-Hosted

MCP server for Notion. Read, create, and search pages.

2k+ \u2B50
MIT
mcpnotionproductivity

Docker MCP

Self-Hosted

MCP server for Docker. Manage containers via AI agent.

1k+ \u2B50
Apache 2.0
mcpdockerinfrastructure
📊

Monitoring

Observability, metrics, alerting and uptime monitoring for AI infrastructure.

Grafana

In UseSelf-Hosted

Dashboards and observability. Visualization for Prometheus, Loki and more.

66k+ \u2B50
AGPL-3.0
dashboardsvisualizationalerting

Prometheus

In UseSelf-Hosted

Monitoring and alerting toolkit. Time-series database, PromQL.

57k+ \u2B50
Apache 2.0
metricstime-seriesalerting

Uptime Kuma

In UseSelf-Hosted

Self-hosted monitoring. Status pages, notifications, clean UI.

65k+ \u2B50
MIT
uptimestatus-pagenotifications

Netdata

Self-Hosted

Real-time infrastructure monitoring. Auto-discovery, zero config.

73k+ \u2B50
GPL-3.0
real-timeauto-discoveryinfrastructure

Langfuse

Self-Hosted

LLM engineering platform. Traces, evals, prompt management, cost tracking.

8k+ \u2B50
MIT
llm-monitoringtracingevals
🛡

Security & Compliance

Secrets management, container security, intrusion prevention and vulnerability scanning.

Vault

Self-Hosted

Secrets management by HashiCorp. API keys, certificates, encryption.

32k+ \u2B50
BUSL-1.1
secretsencryptioncertificates

Trivy

Self-Hosted

All-in-one security scanner. Containers, filesystem, git repos, Kubernetes.

25k+ \u2B50
Apache 2.0
scannercontainervulnerabilities

CrowdSec

Self-Hosted

Open-source intrusion prevention. Community-based IP blocklists.

9k+ \u2B50
MIT
idsintrusion-preventioncommunity

Fail2ban

In UseSelf-Hosted

Brute-force protection. Monitors logs and bans suspicious IPs.

12k+ \u2B50
GPL-2.0
brute-forcelogsbanning

promptfoo

Self-Hosted

AI red teaming and prompt testing. Validate LLM security.

5k+ \u2B50
MIT
ai-securityred-teamtesting
🎨

Image Generation

Local image generation with Stable Diffusion, Flux and other models.

ComfyUI

Self-Hosted

Node-based UI for Stable Diffusion. Visual workflow builder for image generation.

70k+ \u2B50
GPL-3.0
image-gennodesworkflows

Stable Diffusion WebUI

Self-Hosted

AUTOMATIC1111 WebUI. The classic for local image generation.

145k+ \u2B50
AGPL-3.0
image-genwebuiclassic

Fooocus

Self-Hosted

Minimal UI for image generation. Midjourney quality, local, no config needed.

42k+ \u2B50
GPL-3.0
image-gensimplequality

InvokeAI

Self-Hosted

Professional image generation with canvas, ControlNet and workflows.

24k+ \u2B50
Apache 2.0
image-gencanvasprofessional

Stable Diffusion WebUI Forge

Self-Hosted

Optimized fork of A1111. Faster, less VRAM, more features.

10k+ \u2B50
AGPL-3.0
image-genoptimizedfork
🎙

Speech & Audio

Speech-to-text, text-to-speech and audio processing with local models.

Whisper

Self-Hosted

OpenAI speech-to-text model. Robust, multilingual, locally deployable.

75k+ \u2B50
MIT
sttmultilingualopenai

Whisper.cpp

Self-Hosted

C/C++ port of Whisper. Extremely fast, runs on CPU.

38k+ \u2B50
MIT
sttcppfast

Piper TTS

Self-Hosted

Fast local text-to-speech engine. Many voices, many languages.

8k+ \u2B50
MIT
ttslocalmultilingual

Coqui TTS

Self-Hosted

Deep learning text-to-speech. Voice cloning, multi-speaker, multi-language.

37k+ \u2B50
MPL-2.0
ttsvoice-cloningdeep-learning

Faster Whisper

Self-Hosted

CTranslate2-based Whisper. 4x faster, same quality.

14k+ \u2B50
MIT
sttoptimizedfast
📝

Coding Assistants

AI-powered coding tools, code completion and terminal integration.

Claude Code

In Use

Anthropic's agentic coding tool. Terminal-based, understands entire codebases.

Proprietary
codingterminalagentic

GitHub Copilot

AI pair programmer by GitHub/OpenAI. Code suggestions directly in editor.

Proprietary
codingeditorsuggestions

Cursor

AI-first code editor. VS Code fork with integrated AI chat and editing.

Proprietary
codingeditorai-first

Cody

Sourcegraph's AI coding assistant. Understands your entire codebase.

3k+ \u2B50
Apache 2.0
codingcodebasesearch

Continue

Self-Hosted

Open-source AI code assistant. VS Code and JetBrains, local models supported.

22k+ \u2B50
Apache 2.0
codingopen-sourcelocal

Aider

Self-Hosted

AI pair programming in the terminal. Git-aware, edits files directly.

25k+ \u2B50
Apache 2.0
codingterminalgit
🏗

Infrastructure

Containers, virtualization, reverse proxies and management tools for the AI stack.

Docker

In UseSelf-Hosted

Container runtime. Foundation of every self-hosted AI stack.

70k+ \u2B50
Apache 2.0
containerruntimefoundation

Proxmox VE

In UseSelf-Hosted

Open-source virtualization platform. VMs, LXC, clustering, GPU passthrough.

AGPL-3.0
virtualizationhypervisorcluster

Caddy

Self-Hosted

Modern web server with automatic HTTPS. Zero-config TLS.

62k+ \u2B50
Apache 2.0
webserverhttpsreverse-proxy

Traefik

In UseSelf-Hosted

Cloud-native reverse proxy. Auto-discovery, Let's Encrypt, Docker integration.

53k+ \u2B50
MIT
reverse-proxydockerauto-discovery

Portainer

Self-Hosted

Container management UI. Manage Docker and Kubernetes via web interface.

32k+ \u2B50
Zlib
containermanagementui

Coolify

Self-Hosted

Self-hostable Heroku/Netlify alternative. One-click deployments.

38k+ \u2B50
Apache 2.0
paasdeploymentone-click

67 tools in 12 categories. Star counts are approximate values (as of March 2026). Tools with the "In Use" badge are actively used in our production AI infrastructure. All information without guarantee.

War dieser Artikel hilfreich?

Next step: ship workflows that stay operable

Use proven n8n patterns, templates and integrations for workflows that stay local, documented, and auditable.

Why AI Engineering
  • Local and self-hosted by default
  • Documented and auditable
  • Built from our own runtime
  • Made in Austria
Not legal advice.