Groq

Overview

Groq uses custom Language Processing Unit (LPU) hardware to deliver inference speeds 10x faster than GPU alternatives. Run Llama, Mistral, Gemma, and more models. Free tier with rate limits; paid plans for production use. The speed difference is dramatic.