Welcome to Arch!

Build fast, observable, and personalized GenAI apps

Arch is an intelligent gateway for agents - an infrastructure primitive for GenAI (built by the contributors of Envoy ). The project was born out of the belief that:

Prompts are nuanced and opaque user requests, which require the same capabilities as traditional HTTP requests including secure handling, intelligent routing, robust observability, and integration with backend (API) systems for personalization - all outside business logic.

Get Started

Get Started

• Overview
• Intro to Arch
• Quickstart
• Next Steps

Concepts

Concepts

• Tech Overview
  • Terminology
  • Threading Model
  • Listener
  • Prompts
  • Model Serving
  • Request Lifecycle
  • Error Target
• LLM Provider
• Prompt Target

Guides

Guides

• Prompt Guard
• Function Calling
• Observability
  • Tracing
  • Monitoring
  • Access Logging

Build with Arch

Build with Arch

• Agentic Apps
• RAG Apps
• Multi-Turn

Resources

Resources

• Configuration Reference