Welcome to Arch!

Build fast, observable, and personalized GenAI apps

Arch is an intelligent infrastructure primitive for GenAI (built by the contributors of Envoy ) that born out of the belief that:

Prompts are nuanced and opaque user requests, which require the same capabilities as traditional HTTP requests including secure handling, intelligent routing, robust observability, and integration with backend (API) systems for personalization - all outside business logic.

Get Started

Get Started

• Overview
• Intro to Arch
• Quickstart

Concepts

Concepts

• Tech Overview
  • Terminology
  • Threading Model
  • Listener
  • Prompts
  • Model Serving
  • Request Lifecycle
  • Error Target
• LLM Provider
• Prompt Target

Guides

Guides

• Prompt Guard
• Function Calling
• Observability
  • Tracing
  • Monitoring
  • Access Logging

Build with Arch

Build with Arch

• Agentic Workflow
• RAG Application

Resources

Resources

• Configuration Reference