FasterTransformer Backend
lastmod 2024-05-14created 2024-05-141 edits
FasterTransformer Backend
| NOTE |
| FasterTransformer development has transitioned to TensorRT-LLM. All developers are encouraged to leverage TensorRT-LLM and tensorrtllm_backend to get the latest improvements on LLM Inference. The NVIDIA/FasterTransformer repo will stay up, but will not have further development. |
See also
- FauxPilot - Open-source GitHub CoPilot server