Enterprise AI Building Blocks

Sovereign FOSS stack. Every component battle-tested in production across 89 layers, 65 agents, and 332 IP claims.

10
Components
89
OS Layers
65
Agents
332
IP Claims
Core Infrastructure Stack (9 components)

LiteLLM

LLM Routing

Universal LLM proxy โ€” 100+ models, unified API, cost tracking. OrchestrAI uses it for 26-model routing across Ollama (free) โ†’ DeepSeek (free) โ†’ Claude (paid) tiers.

OpenFGA

Governance

Google Zanzibar ReBAC โ€” fine-grained authorization at scale. Powers C-256 MCP-Auth federation gateway. Store ID: 01KWVSB8KPK6DKPMJK94397KAX. 8 surfaces wired.

Qdrant

Vector DB

High-performance vector search engine. Memory Director Tier 4 โ€” semantic search and RAG context for all 65 agents. Collection: orchestrai_memory, 1536-dim.

NATS

Message Bus

Cloud-native messaging. OrchestrAI A2A bus โ€” 5-plane subject hierarchy: control / data / events / heartbeat / bus. ORCHESTRAI_EVENTS JetStream stream.

SearXNG

Search

Privacy-respecting metasearch engine. AGT-RSCAN Research Scanner uses it for sovereign web search without external API keys or data leakage.

Keycloak

Auth

Enterprise identity & access management. OIDC/SAML provider for all OrchestrAI surfaces. SSO for enterprise customers. Realm: orchestrai.

DeepEval

Evaluation

LLM evaluation framework. EV-1 in OrchestrAI 7-tier eval stack โ€” Constitutional Agent Tests, 33+ test cases, CI-gated on every push to integrate.

Garak

Red Team

LLM red-teaming tool. EV-2 in OrchestrAI eval stack โ€” adversarial probing of all 65 agents. Non-blocking CI gate, informational output.

LangGraph

Orchestration

Agent workflow orchestration as directed graphs. Powers AGT-ACELF01 โ€” the ACE LangGraph Loop: OBSERVE โ†’ DIAGNOSE โ†’ DECIDE โ†’ ACT โ†’ VERIFY โ†’ EVOLVE.