Skip to content
>_<
AI EngineeringWiki
DEEN

Proxmox Setup

Tools · 6 min

Proxmox VE is an open-source virtualization platform. Perfect for running your AI stack.

Why Proxmox?

  • Open Source - free
  • KVM + LXC virtualization
  • Web-based management
  • Cluster support
  • Backup & snapshot features

Installation

# Download ISO from proxmox.com
# Boot from USB
# Follow installation wizard
# Access via https://your-ip:8006

AI Stack Resources

VMCPURAMDisk
Ollama (GPU)8 cores32GB100GB
n8n4 cores8GB50GB
PostgreSQL4 cores16GB100GB
Monitoring2 cores4GB50GB

GPU Passthrough

# /etc/modprobe.d/blacklist.conf
blacklist nvidia
blacklist nvidia_uvm

# /etc/modules
nvidia
nvidia_uvm

# In VM config:
hostpci0: 01:00,pcie=1

Cluster Setup

  • Minimum 3 nodes for quorum
  • Shared storage (NFS or Ceph)
  • Network: 10Gbps recommended
  • Use Proxmox VE Cluster

Related articles

Tools

Docker vs Docker Swarm for AI

Which is right for AI? Compose for development, Swarm for production.

Security

Backup Strategy

3-2-1 rule, automated backups for Ollama, n8n, PostgreSQL.

Tools

Grafana Monitoring

Monitoring with Prometheus + Grafana. Dashboards, alerts.

Was this article helpful?

Continue the learning path

The learning path puts these articles in order, and the Hub carries the building blocks we have checked in our own operations.

Open the learning pathOpen the Hub
Why AI Engineering
  • Local and self-hosted
  • Documented and verifiable
  • From our own operations
  • Made in Austria
Not legal advice.