5 Pull requests merged by 3 people

• vit check max batch size infer

  #887 merged May 9, 2025

• feat(vit_cuda_kernels):add norm quant and some fused ops

  #886 merged May 9, 2025

• fix circle ref

  #884 merged May 7, 2025

• model factory

  #882 merged May 7, 2025

• fix: remove use_dynamic_prompt_cache code in flashinfer_struct.py

  #883 merged May 7, 2025

2 Pull requests opened by 2 people

• use Cython improve post_handle performance

  #881 opened May 6, 2025

• MTP

  #885 opened May 8, 2025

1 Unresolved conversation

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Support disk radix cache

  #837 commented on May 9, 2025 • 0 new comments