Ollama

Overview

Ollama makes it easy to run open-source LLMs locally. One-command install, supports 100+ models (Llama, Mistral, Gemma, Phi, etc.). REST API for integration. No GPU required for smaller models. The standard way to run LLMs locally on Mac, Linux, and Windows.