Xturing

lastmod 2023-04-06created 2023-04-041 edits

Build and control your own LLM

Features

• An open-source tool for fast, efficient fine-tuning of LLMs such as LLaMA, GPT-J, and GPT-2
• Pulls data from various sources and preprocesses it into a format LLMs can understand
• Uses single to multiple GPUs for fast tuning
• Cuts costs by using memory-efficient techniques (such as LoRA)
• Evaluates various fine-tuning methods to find the best model
• Evaluates fine-tuned models with well-defined metrics

See also

• LoRA
• LLM
• LLaMA
• GPT-J
• GPT-2

Favorite site

• Github - stochasticai/xturing