Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DO NOT MERGE] A standard experiment #1929

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

[DO NOT MERGE] A standard experiment #1929

wants to merge 2 commits into from

Conversation

DonggeLiu
Copy link
Contributor

This reverts commit c734a74 and adds a dummy change to run experiments.

@DonggeLiu
Copy link
Contributor Author

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-12-08-standard-cov --fuzzers afl aflfast aflplusplus aflsmart centipede eclipser fairfuzz honggfuzz libafl libfuzzer mopt

@DonggeLiu DonggeLiu mentioned this pull request Dec 8, 2023
Closed
@DonggeLiu
Copy link
Contributor Author

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-12-08-standard-bug --fuzzers afl aflfast aflplusplus aflsmart centipede eclipser fairfuzz honggfuzz libafl libfuzzer mopt --benchmarks bloaty_fuzz_target_52948c harfbuzz_hb-shape-fuzzer_17863b libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb

@DonggeLiu
Copy link
Contributor Author

Experiment 2023-12-08-standard-cov data and results will be available later at:
The experiment data.
The experiment report.

Experiment 2023-12-08-standard-bug data and results will be available later at:
The experiment data.
The experiment report.

@jonathanmetzman
Copy link
Contributor

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-12-09-standard-cov --fuzzers afl aflfast aflplusplus aflsmart centipede eclipser fairfuzz honggfuzz libafl libfuzzer mopt

@jonathanmetzman
Copy link
Contributor

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-12-08-standard-bug --fuzzers afl aflfast aflplusplus aflsmart centipede eclipser fairfuzz honggfuzz libafl libfuzzer mopt --benchmarks bloaty_fuzz_target_52948c harfbuzz_hb-shape-fuzzer_17863b libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb

1 similar comment
@jonathanmetzman
Copy link
Contributor

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-12-08-standard-bug --fuzzers afl aflfast aflplusplus aflsmart centipede eclipser fairfuzz honggfuzz libafl libfuzzer mopt --benchmarks bloaty_fuzz_target_52948c harfbuzz_hb-shape-fuzzer_17863b libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb

@DonggeLiu
Copy link
Contributor Author

These two do not seem to work either:

Experiment 2023-12-09-standard-cov data and results will be available later at:
The experiment data.
The experiment report.

Experiment 2023-12-08-standard-bug (forgot to change the name? : )) data and results will be available later at:
The experiment data.
The experiment report.

In particular, the new 2023-12-09-standard-cov's experiment data dir is empty, but the old 2023-12-08-standard-cov was not.

@DonggeLiu
Copy link
Contributor Author

Oh I just have a theory about why 2023-12-09-standard-cov has not data:

Did you, by any chance, happen to comment the bug-based exp command right after the cov-based one?
This will interrupt the cov experiment.

@DonggeLiu
Copy link
Contributor Author

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-12-10-standard-cov --fuzzers afl aflfast aflplusplus aflsmart centipede eclipser fairfuzz honggfuzz libafl libfuzzer mopt

@DonggeLiu
Copy link
Contributor Author

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2023-12-10-standard-bug --fuzzers afl aflfast aflplusplus aflsmart centipede eclipser fairfuzz honggfuzz libafl libfuzzer mopt --benchmarks bloaty_fuzz_target_52948c harfbuzz_hb-shape-fuzzer_17863b libxml2_xml_e85b9b mbedtls_fuzz_dtlsclient_7c6b0e php_php-fuzz-parser_0dbedb

@DonggeLiu
Copy link
Contributor Author

DonggeLiu commented Dec 11, 2023 •
edited
Loading

Experiment 2023-12-10-standard-cov data and results will be available later at:
The experiment data.
The experiment report

Experiment 2023-12-10-standard-bug data and results will be available later at:
The experiment data.
The experiment report.

@jonathanmetzman
Copy link
Contributor

Dongge, FYI the URLs are wrong (a silly feature we have doesn't put "standard experiments" in experimental).
They actually are: https://storage.googleapis.com/www.fuzzbench.com/reports/2023-12-10-standard-bug/index.html
https://storage.googleapis.com/www.fuzzbench.com/reports/2023-12-10-standard-cov/index.html

@DonggeLiu
Copy link
Contributor Author

Dongge, FYI the URLs are wrong (a silly feature we have doesn't put "standard experiments" in experimental). They actually are: https://storage.googleapis.com/www.fuzzbench.com/reports/2023-12-10-standard-bug/index.html https://storage.googleapis.com/www.fuzzbench.com/reports/2023-12-10-standard-cov/index.html

Ah I see, thanks, that explains it.
I was wondering why we have the experiment data but not the report.

Is it a one-time thing or does it mean we will stop using experimental dir?
I will edit my script to generate this comment:

Experiment 2023-12-10-standard-bug data and results will be available later at:

@DonggeLiu DonggeLiu mentioned this pull request Jan 15, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@DonggeLiu @jonathanmetzman