Popular repositories Loading

1. nn-Meter nn-Meter Public

   Forked from microsoft/nn-Meter

   A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

   Python 1

2. transformers-stream-generator transformers-stream-generator Public

   Forked from LowinLi/transformers-stream-generator

   This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

   Python 1

3. dInfer dInfer Public

   Forked from inclusionAI/dInfer

   dInfer: An Efficient Inference Framework for Diffusion Language Models

   Python