Welcome to Arch!

Build fast, observable, and personalized GenAI apps

Arch is an intelligent (edge and LLM) proxy, exclusively designed for prompts and agents - and built by the contributors of the widely adopted and loved Envoy ).

Move faster by letting Arch handle the pesky heavy lifting in building agents: fast input clarification, agent routing, seamless integration of prompts with tools for common tasks, and unified access and observability of LLMs - all outside business logic.

Get Started

Get Started

• Overview
• Intro to Arch
• Quickstart
• Next Steps

Concepts

Concepts

• Tech Overview
  • Terminology
  • Threading Model
  • Listener
  • Prompts
  • Model Serving
  • Request Lifecycle
  • Error Target
• LLM Provider
• Prompt Target

Guides

Guides

• Prompt Guard
• Agent Routing and Hand Off
• Function Calling
• Observability
  • Tracing
  • Monitoring
  • Access Logging

Build with Arch

Build with Arch

• Agentic Apps
• RAG Apps
• Multi-Turn

Resources

Resources

• Configuration Reference