Case Study - Infrastructure
Rockport: A Self-Hosted LLM Proxy
I built a self-hosted LiteLLM proxy on EC2 behind a Cloudflare Tunnel. It routes Claude Code traffic to AWS Bedrock with per-key budgets, idle auto-stop, image generation, video generation, and image editing. The repo is public and I'd welcome feedback from anyone who works with this sort of infrastructure.
Read more