WebLLM

Overview

A browser-native inference engine from MLC AI that enables local model execution without sending data to a server. Developers should care because it supports privacy-preserving AI features, web apps, and extension workflows with no backend inference layer.