Flash Learn
lastmod 2025-02-18created 2025-02-181 edits
Integrate LLM in any pipeline - fit/predict pattern, JSON driven flows, and built in concurency support.
Integrating agent LLMs into any pipeline
About
- A library that makes it easy to use "agent LLMs (Agent LLM)" in your own workflows and ETL pipelines
- Runs tasks such as data transformation, classification, summarization, and rewriting simply; JSON-based definitions are easy to understand and maintain
- Supports LiteLLM, Ollama, OpenAI, DeepSeek, and OpenAI API-compatible models
Key features
- Pipeline setup based on simple JSON definitions
- Handles 1000 calls/min (supports bulk jobs)
- Supports various LLM APIs (OpenAI, DeepSeek, LiteLLM, etc.)
- Multi-step agents available
- Data transformation, classification, summarization, rewriting, etc.