Pykoi

lastmod 2024-04-26created 2023-08-222 edits

pykoi is an open-source python library for LLMs providing UI & code for data & feedback collection, finetuning (RLHF & RAG), and model comparisons.

UI library for data & feedback collection for LLMs

Features

• Can add feedback options to LLM outputs in the form of a chatbot UI (vote & rank feedback)
  • Automatically collected in a DB and usable for RLHF
• Compare the outputs of models and assign Rank between outputs by drag & drop
• Easily integrate Retrieval Augmented Generation (RAG) into models
• Easily run Reinforcement Learning with Human Feedback (RLHF) with the collected data

See also

• LLM

Favorite site

• 🎏 pykoi web site
• CambioML/pykoi