Packages for keyword “on-device-llm”
These packages are available as a package collection, usable in Xcode or SwiftPM.
LiteRTLM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
PrivateFoundationModels
Apple FoundationModels API on iOS 18+. Same call site, native passthrough on iOS 26 (Apple Intelligence), CoreML / MLX backends on older OSes. Drop-in source compatible.
2 packages.