Serving layer

Laya Local Serving with Arbiter

Serve Laya behind a Jev-compatible HTTP API with checkpoint routing, batching, metrics, a Playground, and NVIDIA / Apple Silicon recipes.

Local APIJev-compatible clientsNVIDIA GPUApple SiliconAgent integrations
Quickstart
git clone https://github.com/0xBakeer/arbiter.git
cd arbiter
./run.sh setup
./run.sh serve
Source
0xBakeer/arbiter

This is a community serving layer rather than the upstream Laya package. Validate its defaults against your deployment requirements.