EgoXDocs

Introduction

What EgoX is, the surfaces it exposes, and where to go next.

EgoX is a multi-tenant LLM Orchestrator. Instead of wiring an LLM, a vector store, a tool runner, and conversation memory together yourself, you call one endpoint — POST /egox/ask — and EgoX handles model selection, RAG retrieval, tool calls, conversation memory, and safety rails, scoped to your project.

There are three surfaces, split by who uses them:

  • The /ask API is the product. Your systems integrate with it — directly or via the Client SDK.
  • The Console is the control plane. Project owners configure models, tools, knowledge, and prompts, then monitor traffic — see Console.
  • MCP is the agent plane. AI coding agents build and review your tools and knowledge in natural language — see MCP.

How it fits together

External systemsyour apps · bots · CRMsPOST /egox/askEgoX OrchestratorLLM · RAG · Tools · ThreadsEgoX DBConsole — control planeconfigure & monitorMCP server — agent planeagents manage tools & knowledge

Vocabulary

The Console speaks product language; the backend speaks domain language. Both are correct — don't let one leak into the other.

Console (user-facing)Backend (domain)What it is
ProjectTenantIsolation unit; owns everything below it
AI ConfigurationTenant ConfigModel, temperature, response format
EndpointsToolsExternal APIs the LLM can call
Knowledge BaseRAG Documents / ChunksEmbedded content the LLM retrieves
ThreadsThreads + MessagesTurn history for one user session

Where to go next

On this page