Community runtime

Laya MPS on macOS

A memory-conscious local runtime and HTTP server for Apple GPU / MPS, with multiple memory modes and benchmark tooling.

macOSApple GPU / MPSHTTP servingMemory tuning

Quickstart

git clone https://github.com/afshinm/laya-mps.git
cd laya-mps
./scripts/serve.sh

Source

Requires Apple Silicon and a recent macOS. Memory and latency numbers are hardware-specific.