Nativ: Run AI models locally on your Mac

https://blaizzy.github.io/nativ/">Nativ: Run AI models locally on your Mac

Prince Canuma is the developer behind the excellent https://github.com/Blaizzy/mlx-vlm">MLX-VLM Python library for running vision-LLMs using MLX on a Mac.

I'm really excited about his new project, which wraps MLX in a full macOS desktop application.

It's similar in shape to LM Studio, providing both a chat interface and a localhost API server for accessing models.

The app picked up MLX models I had already tried that were present in my Hugging Face cache directory, which was a nice touch.

Via https://news.ycombinator.com/item?id=48982681">Hacker News

Tags: https://simonwillison.net/tags/macos">macos, https://simonwillison.net/tags/python">python, https://simonwillison.net/tags/ai">ai, https://simonwillison.net/tags/generative-ai">generative-ai, https://simonwillison.net/tags/local-llms">local-llms, https://simonwillison.net/tags/llms">llms, https://simonwillison.net/tags/mlx">mlx, https://simonwillison.net/tags/prince-canuma">prince-canuma