Building a Local AI Agent Stack with Hermes Agent v0.14 on Debian

I set up a fully local AI-agent environment on Debian using v0.14.0 together with and Qwen models.

The stack now includes:

The final runtime ended up using:

The installation initially failed because of:

Errors looked like:

Failed to inspect Python interpreter
Permission denied (os error 13)

I fixed this by:

I removed broken caches:

sudo rm -rf ~/.cache/uv
sudo rm -rf ~/.local/share/uv

Then repaired ownership:

sudo chown -R $USER:$USER ~/.cache ~/.local/share/uv

And updated Hermes manually:

uv pip install --system --upgrade hermes-agent

Eventually Hermes launched successfully with:

hermes

The TUI confirmed:

Hermes gateway was installed as a persistent user service:

systemctl --user status hermes-gateway

This allowed Hermes to:

Hermes automatically detected the local Ollama server:

Local (127.0.0.1:11434) — qwen2.5:32b

This created a fully local inference stack with no cloud dependency required.

The completed setup now supports:

The v0.14 “Foundation Release” significantly improved:

Combined with Ollama, it creates a strong self-hosted AI-agent platform for developers experimenting with local-first AI workflows.