Skip to main content
Looking for an instant start? Check out the drop-in snippets:

Chat

Text to Speech

Classification

Structured output

Speculative summarization

Speculative classification

Cloud
Mirai lets you add high-performance AI right into your app with zero latency, full data privacy, and no inference costs. You don’t need an ML team or weeks of setup anymore. One developer can get it all running in minutes. To achieve this, we offer the following key products:
uzu

uzu

A Rust inference engine built to run AI with hardware specifics in mind.
lalamo

lalamo

A set of tools to optimize and convert models for on-device use.
cli

cli

A command-line tool to chat with models and serve them as a local API.
If you run into a problem and don’t find an answer here, feel free to reach out in our Discord community. We can even debug the issue with you over voice chat, or you can book a call with our engineers ❤️.

​
FAQ

The uzu and lalamo libraries are fully open source under the MIT license.
The uzu and lalamo libraries are completly free to use.
Currently, only Apple Silicon (iOS/macOS) devices are supported.
The full list of supported models is available here.