relay.app
A self-hostable, hackable LLM web environment built on llm.rb.
About
relay.app is a full-featured web application that puts the llm.rb AI runtime behind a clean web interface. Built with Roda, Sequel, and HTMX, it is designed to be self-hosted and extended with your own tools and skills.
relay.app demonstrates what a real production application built on llm.rb looks like — context management across requests, tool composition, concurrent workflows, cost tracking, and all the patterns you need to ship an LLM-powered product.
Features
- Multi-turn conversations with context persistence
- MCP server integration for external tools
- Custom tools and skills via the llm.rb runtime
- Real-time response streaming
- Inline audio playback for generated audio
- Self-hostable — full control over your data
- Built with Roda, Sequel, and HTMX
Getting Started
git clone https://github.com/llmrb/relay.git
cd relay
bundle install
cp .env.example .env
# Edit .env with your API keys
bundle exec rackup