Cog

lastmod 2022-04-26created 2022-04-261 edits

A container tool for machine learning

Features

• An open-source tool for packaging machine learning models to a production-ready level
• Easily builds Docker images that include all the Best Practices: NVidia base image + caching + Python + environment variable defaults, and more
  • With version-compatible CUDA/cuDNN/PyTorch/TensorFlow/Python, etc.
• Generates an OpenAPI schema through Pydantic
• Dynamically generates a RESTful HTTP API with FastAPI from the model types
• Provides a Redis-based queue worker for long-running deep learning models or batch processing (others planned)
• Built for Replicate, an ML SaaS, but can also be used on your own infrastructure

See also

• Machine learning
• Deep learning

Favorites site

• Github - cog