FreeToken

Overview

FreeToken is an Apache‑2.0‑licensed mixture‑of‑experts inference engine from UC Berkeley and UT Austin, designed to run across personal computers as a unified elastic inference cluster.[44] It targets edge‑native deployments where many heterogeneous machines contribute capacity, and has been open‑sourced with a PyPI package for easy installation.[44] Developers should care because it offers a research‑grade, distributed MoE runtime suitable for experiments and innovative edge deployments that avoid centralized GPU clusters.