Reference: Enterprise-Scale Knowledge Agent
referencerag-over-docs
framework
Agent Framework
retrieval
Retrieval / Vector Store
memory
Memory
eval
Eval
observability
Observability / Tracing
prompt_management
Prompt Management
deployment
Deployment Target
mcp_servers
MCP Servers
guardrails
Guardrails / Safety
Architectural notes
Reference architecture for a knowledge agent at enterprise scale — millions of documents across Confluence, SharePoint, code repos, with per-user access enforcement and audit logging. Why these picks: - LangGraph for explicit access-check + retrieval + synthesis flow. - Pinecone over turbopuffer for mature enterprise features (BYOC, RBAC). - Self-hosted Langfuse for data sovereignty over query logs. - Per-user ACL filter applied at retrieval time — never rely on the LLM. Common gotchas: - ACL leakage via embedding mixing is the existential risk; separate indexes per security boundary. - Confluence/SharePoint sync lag causes "agent says the wrong thing" incidents; surface freshness explicitly.
Embed this stack
Show off your stack on your engineering blog or company page.
<iframe src="http://testserver/embed/stacks/rag-over-docs-enterprise" width="100%" height="380" frameborder="0" style="border: 1px solid #334155; border-radius: 8px;"></iframe>