FauxPilot

lastmod 2024-05-14created 2022-08-102 edits

Open-source GitHub CoPilot server

About

This is an attempt to build a locally hosted version of GitHub Copilot. It uses the SalesForce CodeGen models inside of NVIDIA's Triton Inference Server with the FasterTransformer backend.

Features

• An attempt to build a locally hosted CoPilot
• Uses the SalesForce CodeGen models: NVidia Triton Inference Server + FasterTransformer Backend
• Requirements: Docker , docker-compose >= 1.28, NVIDIA GPU (needs enough VRAM to run the model)

See also

• GitHub CoPilot
• NVidia Triton Inference Server
• FasterTransformer Backend

Favorite site

• Github - fauxpilot