You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Call validation function in summarize.py i.e. helm-summarize
Add test that calls the validation function on all schema files included in the HELM package
Things to validate:
For each group name in subgroups of a run_group, there is a run_group defined with that name.
For each entry in metric_groups of a run_group, there is a metric_group defined with that name.
For each entry in metrics of metric_groups, there is either a metric with that name, or it matches the format ${var_name} (where var_name can be any name).
For each split in metrics of metric_groups, split is either test, valid, __all__, or matches the format ${var_name} (where var_name can be any name).
(maybe?) Each entry in run_groups is either a parent node (contains category and subgroups) or a child node (contains metric_groups) but not both.
The text was updated successfully, but these errors were encountered:
Tasks:
summarize.py
i.e.helm-summarize
Things to validate:
subgroups
of arun_group
, there is arun_group
defined with that name.metric_groups
of arun_group
, there is ametric_group
defined with that name.metrics
ofmetric_groups
, there is either a metric with that name, or it matches the format${var_name}
(wherevar_name
can be any name).metrics
ofmetric_groups
, split is eithertest
,valid
,__all__
, or matches the format${var_name}
(wherevar_name
can be any name).run_groups
is either a parent node (containscategory
andsubgroups
) or a child node (containsmetric_groups
) but not both.The text was updated successfully, but these errors were encountered: