Tool & Platform
Intermediate
Groq · Tools & API Platforms
Groq's inference cloud runs open models at extreme speed, with free credits on signup.
Tool & Platform
Intermediate
OpenRouter · Tools & API Platforms
A unified LLM API gateway — one key for hundreds of models, some of them free.
Tool & Platform
Intermediate
Together · Tools & API Platforms
A cloud platform for serving open models, with serverless and dedicated endpoints plus trial credits on signup.
Official Docs
Intermediate
Cloudflare · Tools & API Platforms
Docs for running models on Cloudflare's edge, deeply integrated with the Workers ecosystem, with a free tier.
Open Source Project
Intermediate
BerriAI · Tools & API Platforms
A proxy SDK that calls 100+ LLMs in the OpenAI format, with built-in retries, budgets, and logging.
Open Source Project
Intermediate
Jason Liu · Tools & API Platforms
A Pydantic-based structured output library with solid retry and validation — a great companion for function calling.