OpenDMG
LlamaChat icon

LlamaChat for Mac

Chat with your favourite LLaMA models.

By alexrozanski. Free and open source, MIT licence.

Get it with OpenDMG View source on GitHub

LlamaChat at a glance

Version
1.2.0
Released
21 April 2023
Download size
16 MB
Works on
Apple silicon and Intel
Licence
MIT
Category
Social and Communication
Developer
alexrozanski
GitHub stars
1.5K

About LlamaChat

Chat with your favourite LLaMA models in a native macOS app

Screenshots

LlamaChat screenshot 1

How to install LlamaChat on a Mac

  1. Get OpenDMG. It is a free app store for open source Mac apps. Download OpenDMG.
  2. Search for LlamaChat and press Get. OpenDMG downloads version 1.2.0 from alexrozanski's own GitHub release.
  3. Open it. The download is checked against its SHA-256 fingerprint and its signature is checked on your Mac before it lands in Applications.

Updates to LlamaChat show up in OpenDMG and install with one button. No account is needed.

Prefer to do it by hand? The developer's file is on GitHub: LlamaChat.dmg (16 MB).

What is new in LlamaChat 1.2.0

Happy Friday! This is the **v1.2.0** release of LlamaChat, and the big update this week is support for configuring ✨ model hyperparameters ✨, alongside a bunch of other tweaks and improvements.

<img width="1018" alt="Screenshot 2023-04-21 at 12 41 49" src="https://user-images.githubusercontent.com/170472/233630229-4c49c935-cb2e-4915-8a68-b23fc2790ff4.png">

## 🔥 New
- You can now configure the **model hyperparameters** (including context size and sampling parameters like top-p and top-k values) for all of your chat sources in Settings > Sources. These parameters still default to sensible values for each model type, allowing you to tweak them as you see fit (#13).
- You can now configure the **number of threads** that LlamaChat runs text generation on from Settings > General (#13).
- You can now configure whether the model for each chat source is fully loaded into memory during prediction, which can improve performance for smaller models. If you're familiar with [llama.cpp](https://github.com/ggerganov/llama.cpp) this controls the `--mlock` parameter. (#4)

## 🫧 Improved
- You can now import older `.ggml` files directly into LlamaChat without conversion, thanks to some [upstream changes](https://github.com/ggerganov/llama.cpp/commit/f963b63afa0e057cfb9eba4d88407c6a0850a0d8) made to [llama.cpp](https://github.com/ggerganov/llama.cpp). (#3)
…

More Social and Communication apps

All Social and Communication apps