Inference engine that runs LLMs on almost any hardware
Stars126.6K
Commit8h ago
LicenseMIT
llama.cpp is the layer most local model tooling is built on. It is a C and C++ inference engine with no Python runtime, aggressive quantisation support, and hand-tuned kernels for a remarkably wide range of hardware.
Godot ships a complete engine, editor, and export pipeline under the MIT licence, which means no royalties, no revenue thresholds, and no licensing conversation before a project starts.
Speech recognition that runs anywhere, with no runtime
Stars43.2K
Commit1d ago
LicenseMIT
whisper.cpp is a C and C++ port of the Whisper speech recognition model with no Python dependency, quantised weights, and hardware acceleration across Apple Silicon, CUDA, and plain CPU.