What Alveraign is built on today: FastAPI as the backend framework, Streamlit for the current interfaces and llama.cpp (optionally Ollama, OpenRouter) with locally hosted models — currently Mistral Small 4 (🇫🇷), a mixture-of-experts model with 119 billion parameters, 6 billion of them active per token, a 256k context window (currently operated at 131k in our setup), under Apache 2.0. ZITADEL (🇨🇭) as a self-hosted identity provider, oauth2-proxy with OIDC for application-specific session separation, Cloudflare Tunnel for edge access (being reviewed against EU-native alternatives), PostgreSQL for persistence, Redis for cache and session state (planned move to Valkey), Chroma as the vector store (the successor is undecided; Weaviate, 🇳🇱, and Qdrant, 🇩🇪, are being evaluated).
Both planned moves are themselves an example of the section above: Valkey is under BSD-3-Clause and is stewarded by the Linux Foundation — it came into being as a fork at exactly the moment the original project restricted its licence. Qdrant is under Apache 2.0, Weaviate under BSD-3-Clause. Licences without fine print.
Two applications are live: app.alveraign.ai (chat) and admin.alveraign.ai (administration). Session separation is enforced per application. Current authorization runs through an e-mail allowlist — a provisional security boundary that will be replaced by ZITADEL-based role-based permissions.
Why this model: the second number is the one that matters for hardware planning. The model carries the knowledge of 119 billion parameters but computes at runtime in the order of a 6-billion model — that is the difference between “runs in a data centre” and “runs at your place”. On top of that, since March 2026 it unites three previously separate models in one: reasoning, multimodality and agentic coding. For us that means one installation instead of three, no routing layer in between, fewer parts that can break. And the licence is Apache 2.0 — no user thresholds, no territorial restrictions.
One architectural decision that matters to us: the model layer is exchangeable. We are not betting on one model but on the replaceability of models — locally operated open weights for everyday work, European providers for the heavy cases. That decision rests with you, not with us.