PreRelease: v0.1.0#2

Merged

iofu728 merged 41 commits intomainfrom

hjiang/MInference

Jul 2, 2024

Commits on Jun 6, 2024

Feature(MInference): support vLLM and add examples
iofu728
committed
Feature(MInference): Use CUDAExtention to build indexing kernel instead of PyCUDA

iofu728
and
Starmys
committed

Commits on Jun 7, 2024

Feature(MInference): add benchmark experiments
iofu728
committed

Commits on Jun 8, 2024

Feature(MInference): add onepage
iofu728
committed

Commits on Jun 13, 2024

Commits on Jun 14, 2024

Commits on Jun 15, 2024

experiment commands test passed - warning disabled
liyucheng09
committed

Commits on Jun 16, 2024

Commits on Jun 23, 2024

Feature(MInference): support GLM-4 and Qwen2
iofu728
committed

Commits on Jun 24, 2024

Commits on Jun 25, 2024

Fix(MInference): fix config get issue
iofu728
committed

Commits on Jun 27, 2024

bug fixed - GLM-4
liyucheng09
committed

Commits on Jun 28, 2024

bug fix - ruler with StreamingLLM
liyucheng09
committed

Commits on Jun 29, 2024

Commits on Jun 30, 2024

Commits on Jul 1, 2024