Self-hosted infrastructure to deploy, test, govern, and run AI agents in production.
Zelkor wraps battle-tested open-source components — Aegra, Envoy AI Gateway, Langfuse, NeMo Guardrails, and Qdrant — into a unified Kubernetes deployment. It is an open-source alternative to LangGraph Platform and LangSmith for teams that need to run agents on their own infrastructure.
Get a local instance running on your laptop in under 5 minutes using Docker and kind.
Prerequisites: Docker, kind, helm, kubectl, and one LLM provider key (e.g., OpenAI).
git clone https://github.com/devopssquaddev/zelkor-platform.git
cd zelkor-platform
OPENAI_API_KEY="sk-..." ./install.shFor full details, see the Local Quickstart Guide.
Zelkor Community Edition can be deployed in three ways:
- Local Quickstart: Laptop
kindvia./install.sh. See docs/quickstart.md. - Existing Cluster: Evaluate CE in a namespace with
./scripts/install-quickstart.sh. See docs/helm-install.md. - Production Deployment: HA operators via
./scripts/install-production.sh. See docs/production.md.
Gateway setup depends on your cluster — greenfield, layered behind existing ingress, or shared Envoy infrastructure. See docs/envoy-gateway-topologies.md.
Zelkor provides all the core pillars needed for an agentic runtime:
| Component | Role |
|---|---|
| Aegra | Stateful agent orchestrator (LangGraph alternative) |
| Envoy AI Gateway | LLM API gateway, MCP router, and OTel GenAI telemetry |
| NeMo Guardrails | CPU-native conversational boundaries and dialog rails |
| Langfuse | Observability, tracing, and evaluations |
| Qdrant | Semantic memory and vector search |
| PostgreSQL / Valkey / ClickHouse | Databases for state, cache, and analytics |
Baseline sandboxing is provided via gVisor (runsc) for untrusted code execution workloads.
graph TD
subgraph k8s [Kubernetes Cluster]
Aegra[Aegra Runtime]
Envoy[Envoy AI Gateway]
Langfuse[Langfuse Observability]
Aegra --- DBs
Envoy --- DBs
Langfuse --- DBs
subgraph DBs [Datastores]
PG[(PostgreSQL)]
Valkey[(Valkey)]
CH[(ClickHouse)]
Qdrant[(Qdrant)]
end
end
Need SSO/SAML, hardware sandboxing (Kata Containers), mTLS, audit logging, or HIPAA/PCI DSS compliance packs?
Contact us for Zelkor Enterprise — self-hosted Helm charts with operational SLAs and dedicated support.
Apache License 2.0 — see LICENSE.
See AGENTS.md and docs/quickstart.md.