Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added ability to compare results vs. llama.cpp #1461

Merged
merged 5 commits into from
Jan 7, 2025

Conversation

AlexKoff88
Copy link
Collaborator

Example:

rm -rf results/smollm2_N_FP16/gt.csv
mkdir -p results/smollm2_N_FP16

# References from PyTorch FP16
wwb --base-model HuggingFaceTB/SmolLM2-360M-Instruct --gt-data results/smollm2_N_FP16/gt.csv --hf --num-samples 4


#huggingface-cli download "bartowski/SmolLM2-360M-Instruct-GGUF" "SmolLM2-360M-Instruct-f16.gguf" 
wwb --target-model models/SmolLM2-360M-Instruct-f16.gguf --gt-data results/smollm2_N_FP16/gt.csv --llamacpp --output results/smollm2_N_L_FP16 --num-samples 

@github-actions github-actions bot added the category: WWB PR changes WWB label Jan 2, 2025
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Jan 7, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jan 7, 2025
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Jan 7, 2025
@ilya-lavrenov ilya-lavrenov removed this pull request from the merge queue due to a manual request Jan 7, 2025
@ilya-lavrenov ilya-lavrenov merged commit 65e8362 into openvinotoolkit:master Jan 7, 2025
59 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: WWB PR changes WWB
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants