-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Polish analysis of a multiclosure test #1982
Open
comane
wants to merge
61
commits into
master
Choose a base branch
from
240305_multict_analysis
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
61 commits
Select commit
Hold shift + click to select a range
9f2f9d4
Init analysis
andreab1997 be93df4
Add other functions
andreab1997 c041049
Add other functions again
andreab1997 b6abb53
Init analysis
andreab1997 c580a9a
Add other functions
andreab1997 d3c99b2
Add other functions again
andreab1997 82a9ff8
Remove ipdbs and make sure multiclosure_inconsistent work
comane 8d635b4
Add multiclosure comparefits
andreab1997 0b6acae
Add sklearn to pyproject
andreab1997 e6936db
Scikit added to conda
comane baa99a3
added PCA bias variance example to validphys2/examples
comane a739964
l2 condition number plot
comane 72ad203
added l2 condition number plot
comane 1909114
removed unused functions pca_covmat, dataset_fits_gaussian_parameters
comane 66f293f
updated multiclosure analysis with l2 plots
comane 90c553a
variance pdf has to be taken from the same fits
comane d245451
use np.nan and set default EVR to 0.99
comane d09018a
cleaned bias variance table
comane d9b94b8
added docs to func + removed sklearn preprocessing as unused
comane acf3f91
added single point dataset to example report
comane 2de09b8
added bootstrap of bias distribution
comane 325ad8f
added rbv plots as function of lambda
comane 95d608e
added ratio bias variance to multi closure report
comane 070e3f6
forgot ratio_bias_variance template
comane 7079292
fmt = 'o' for ratio bias variance plot
comane 49d0484
added functions for computing Rbv using old definition + runcard with…
comane 9d5f63e
Piazza pulita 1: removed old plotting functions that were never used
comane 3644cb8
Piazza pulita 2: removed principal_components_variance_distribution_d…
comane 462e63d
moved single data colorbar plots to multiclosure.py/_output.py
giovannidecrescenzo 7d696af
scikit-dep >=1.4.1 in pyproject file
comane 37b835c
use mean theory covmat for PCA -> gives more stable values of variance
comane 8b4d5c5
rewrote functions using new variance definition (covmat computed by a…
comane 5606f3e
removed sklearn dep from conda recipe meta file
comane ee8bf09
removed variancepdf as unused
comane 7144ac9
added check_multifit_replicas check
comane ce5ff2d
use plotting dataset labels for rbv vs lambda titles
comane 328a892
added hlines for rbv = 1
comane 1f4eacc
added bootstrapped_internal_multiclosure_dataset_loader for tuple of …
comane 8689a18
bootstrap of PCA regularised multiclosure tests
comane 2690bc9
bootstrap for internal_data_loadeer objecgs
comane cc77ed9
added bootstrapped_principal_components_bias_variance_dataset
comane 493e769
added bootstrap table to report
comane fb4fb4e
changed defaults of bootstrap
comane b154273
added title for single data point in latex mode
a1d6a08
Add PCA on corr matrix on full dataset
andreab1997 d1808ec
fixed inconsistency with single data point and suggest different way …
giovannidecrescenzo 7c20ec8
added delta plots
giovannidecrescenzo 6f2a8ef
use consistent bootstrap def and separate table datasets from table data
comane 75773d4
fixed PCA of correlation matrix for full dataset
comane cb61d22
compute rbv scan using bootstrap uncertainty quantification
comane 07b16a6
added full data bootstrapped table
comane 099af95
slight change in def of delta hist
89398ef
added definition of delta in line with eq. 2.22
comane 8d71a2e
added definition of delta in line with eq. 2.22
comane 8df13b2
added rbv scan for full dataset
comane defcd96
added bootstrapped xi indicator function for full dataset
comane e03c29e
removed unused import from vp_multiclosure.py script
comane 5b03cf4
removed new lines
comane ddc3c0d
removed unused variables
comane e4fe438
_covmats as array instead of list of arrays
comane 7cfdd9a
added eigendecomposition function
comane File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,65 @@ | ||
meta: | ||
title: PCA report for bias and variance of multiclosure fits. | ||
author: Mark N. Costantini | ||
keywords: [multiclosure, PCA, bias, variance] | ||
|
||
|
||
dataset_inputs: | ||
- {dataset: ATLAS_SINGLETOP_7TEV_TCHANNEL-XSEC, variant: legacy} | ||
- {dataset: HERA_NC_225GEV_EP-SIGMARED, variant: legacy} | ||
- {dataset: HERA_NC_251GEV_EP-SIGMARED, variant: legacy} | ||
- {dataset: HERA_NC_300GEV_EP-SIGMARED, variant: legacy} | ||
- {dataset: HERA_NC_318GEV_EP-SIGMARED, variant: legacy} | ||
- {dataset: HERA_CC_318GEV_EM-SIGMARED, variant: legacy} | ||
- {dataset: HERA_CC_318GEV_EP-SIGMARED, variant: legacy} | ||
|
||
|
||
|
||
theoryid: 200 | ||
use_cuts: internal | ||
use_t0: True | ||
t0pdfset: 210223-mw-000_fakepdf | ||
|
||
|
||
explained_variance_ratio: 0.99 | ||
|
||
##### Bootstrap parameters | ||
n_fit_max: 8 | ||
n_fit: 8 | ||
|
||
n_rep_max: 100 | ||
n_rep: 60 | ||
|
||
n_boot_multiclosure: 100 | ||
rng_seed_mct_boot: 1 | ||
|
||
|
||
fits: | ||
- 25_5_2023_19_47_5_dis_pt1_mnc_commit_4d5d473c_filterseed_415295 | ||
- 25_5_2023_19_49_38_dis_pt1_mnc_commit_4d5d473c_filterseed_120750 | ||
- 25_5_2023_19_50_27_dis_pt1_mnc_commit_4d5d473c_filterseed_754299 | ||
- 25_5_2023_19_51_19_dis_pt1_mnc_commit_4d5d473c_filterseed_361864 | ||
- 25_5_2023_19_52_54_dis_pt1_mnc_commit_4d5d473c_filterseed_516909 | ||
- 25_5_2023_19_52_7_dis_pt1_mnc_commit_4d5d473c_filterseed_539528 | ||
- 25_5_2023_19_53_41_dis_pt1_mnc_commit_4d5d473c_filterseed_307907 | ||
- 25_5_2023_19_54_28_dis_pt1_mnc_commit_4d5d473c_filterseed_279829 | ||
|
||
|
||
template_text: | | ||
|
||
PCA report for bias and variance of multiclosure fits. | ||
------------------------------------------------------ | ||
|
||
## Table of bias and variance | ||
{@table_bias_variance_datasets@} | ||
|
||
|
||
## Bootstrapped table for full dataset | ||
{@bootstrapped_table_bias_variance_data@} | ||
|
||
## L2 condition number | ||
{@plot_l2_condition_number@} | ||
|
||
|
||
actions_: | ||
- report(main=true) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why are you using the legacy versions? Is that necessary?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The fits that I use in that runcard were done using th 200. I think this is the reason, why I added the legacy version