repositories Search Results · repo:bjmsong/xLLM language:C++
Filter by
0 files
(136 ms)0 files
inbjmsong/xLLM (press backspace or delete to remove)A lightweight llama2 inference framework. It can inference llama2-7b with 166+ tokens/s on signle 4090.
- C++
- 3
- Updated on Aug 5, 2024
Sponsor open source projects you depend on
Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projectsProTip!
Press the /
key to activate the search input again and adjust your query.Sponsor open source projects you depend on
Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projectsProTip!
Press the /
key to activate the search input again and adjust your query.