Alpaca.cpp

lastmod 2023-03-22created 2023-03-221 edits

Run a ChatGPT-like model on your personal laptop

Features

• Combines and tunes LLaMA, Alpaca, and llama.cpp, then adds a chat interface
• Uses the Alpaca-7b-q4 model
• Generates fairly fast even on an M2 MacBook Air

See also

• Alpaca
• LLaMA
• llama.cpp
• ChatGPT

Favorite site

• antimatter15/alpaca.cpp: Locally run an Instruction-Tuned Chat-Style LLM