A guideline for building practical production-level deep learning systems to be deployed in real world applications.

GTS Engine: A powerful NLU Training System。GTS引擎（GTS-Engine）是一款开箱即用且性能强大的自然语言理解引擎，聚焦于小样本任务，能够仅用小样本就能自动化生产NLP模型。

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

MLX: An array framework for Apple silicon

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.