FastChat

lastmod 2025-03-31created 2025-03-312 edits

See also

• LLM
• llama
• LangChain - A library that connects LLMs to the outside world
• Open WebUI
• LM Studio
• ollama - Ease of use, support for various models, efficient resource management
• vLLM - High-performance inference, memory efficiency, large-scale batch processing
• LocalAI - Support for various model types (text, speech, image)
• FastChat - Support for various open-source models, provides a web UI