From dd99f95f1371727252eefb8cf39764bf07ad22a6 Mon Sep 17 00:00:00 2001 From: Federico Simonetta <22996003+00sapo@users.noreply.github.com> Date: Thu, 14 Mar 2024 17:16:34 +0100 Subject: [PATCH] Added experiments failed --- experiment.1.log | 113 +++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 113 insertions(+) create mode 100644 experiment.1.log diff --git a/experiment.1.log b/experiment.1.log new file mode 100644 index 0000000..20334a5 --- /dev/null +++ b/experiment.1.log @@ -0,0 +1,113 @@ +HOW MUCH OF EACH DATASET SHOULD WE ADD (BASELINE WITH IADS-E-NOMUSIC SHUFFLED LABELS)? +2024-03-14 03:07:54: Loading data +2024-03-14 03:08:09: Ratio: 1.0PMEmo + 0.0IADS-E-nomusic +2024-03-14 03:08:09: Label: AroMN +2024-03-14 03:08:09: [Clustering] +2024-03-14 03:08:10: [Ended] +2024-03-14 03:08:10: [Clustering] +2024-03-14 03:08:10: [Ended] +2024-03-14 03:08:10: Tuning AutoML +[WARNING] [2024-03-14 03:11:06,681:Client-AutoML(8229):b51589c4-e1a7-11ee-9a76-b499bab8ef8a] Time limit for a single run is higher than total time limit. Capping the limit for a single run to the total time given to SMAC (5396.293824) +[WARNING] [2024-03-14 03:11:06,681:Client-AutoML(8229):b51589c4-e1a7-11ee-9a76-b499bab8ef8a] Capping the per_run_time_limit to 2698.0 to have time for a least 2 models in each process. +[WARNING] [2024-03-14 03:11:28,852:Client-EnsembleBuilder] No runs were available to build an ensemble from +Needed time for optimizing the model: 5572.751062631607 +2024-03-14 04:41:03: Cross-validating best estimator +Needed time for cross-validating the best model: 875.0806183815002 +2024-03-14 04:55:38: ___________________ +2024-03-14 04:55:38: Obtained metrics for PMEmo +2024-03-14 04:55:38: r2, RMSE, MAE +2024-03-14 04:55:38: 7.21e-01 ± 3.02e-02 +2024-03-14 04:55:38: 1.95e-01 ± 5.80e-03 +2024-03-14 04:55:38: 1.54e-01 ± 7.12e-03 +2024-03-14 04:55:38: ___________________ +2024-03-14 04:55:38: Obtained metrics for IADS-E-nomusic +2024-03-14 04:55:38: r2, RMSE, MAE +2024-03-14 04:55:38: -1.10e-01 ± 9.43e-02 +2024-03-14 04:55:38: 4.92e-01 ± 2.16e-02 +2024-03-14 04:55:38: 3.84e-01 ± 2.53e-02 +2024-03-14 04:55:38: +-------- +2024-03-14 04:55:38: Label: ValMN +2024-03-14 04:55:38: [Clustering] +2024-03-14 04:55:39: [Ended] +2024-03-14 04:55:39: [Clustering] +2024-03-14 04:55:40: [Ended] +2024-03-14 04:55:40: Tuning AutoML +[WARNING] [2024-03-14 04:55:52,145:Client-AutoML(8229):b93225db-e1b6-11ee-9a76-b499bab8ef8a] Time limit for a single run is higher than total time limit. Capping the limit for a single run to the total time given to SMAC (5397.052737) +[WARNING] [2024-03-14 04:55:52,146:Client-AutoML(8229):b93225db-e1b6-11ee-9a76-b499bab8ef8a] Capping the per_run_time_limit to 2698.0 to have time for a least 2 models in each process. +[WARNING] [2024-03-14 04:56:15,036:Client-EnsembleBuilder] No runs were available to build an ensemble from +Needed time for optimizing the model: 5423.386756181717 +2024-03-14 06:26:03: Cross-validating best estimator +Needed time for cross-validating the best model: 1338.9953217506409 +2024-03-14 06:48:22: ___________________ +2024-03-14 06:48:22: Obtained metrics for PMEmo +2024-03-14 06:48:22: r2, RMSE, MAE +2024-03-14 06:48:22: 5.73e-01 ± 3.71e-02 +2024-03-14 06:48:22: 2.11e-01 ± 1.84e-02 +2024-03-14 06:48:22: 1.68e-01 ± 1.24e-02 +2024-03-14 06:48:22: ___________________ +2024-03-14 06:48:22: Obtained metrics for IADS-E-nomusic +2024-03-14 06:48:22: r2, RMSE, MAE +2024-03-14 06:48:22: 2.29e-02 ± 5.08e-02 +2024-03-14 06:48:22: 4.82e-01 ± 1.62e-02 +2024-03-14 06:48:22: 3.85e-01 ± 1.23e-02 +2024-03-14 06:48:22: +-------- +-------- +HOW MUCH OF EACH DATASET SHOULD WE ADD? +2024-03-14 06:48:22: Loading data +2024-03-14 06:48:46: Ratio: 1.0PMEmo + 0.0IADS-E-nomusic +2024-03-14 06:48:46: Label: AroMN +2024-03-14 06:48:46: [Clustering] +2024-03-14 06:48:47: [Ended] +2024-03-14 06:48:47: [Clustering] +2024-03-14 06:48:47: [Ended] +2024-03-14 06:48:47: Tuning AutoML +[WARNING] [2024-03-14 06:52:27,365:Client-AutoML(8229):86f8aeaa-e1c6-11ee-9a76-b499bab8ef8a] Time limit for a single run is higher than total time limit. Capping the limit for a single run to the total time given to SMAC (5397.083000) +[WARNING] [2024-03-14 06:52:27,365:Client-AutoML(8229):86f8aeaa-e1c6-11ee-9a76-b499bab8ef8a] Capping the per_run_time_limit to 2698.0 to have time for a least 2 models in each process. +[WARNING] [2024-03-14 06:52:48,910:Client-EnsembleBuilder] No runs were available to build an ensemble from +[WARNING] [2024-03-14 06:52:56,465:Client-EnsembleBuilder] No runs were available to build an ensemble from +Needed time for optimizing the model: 5615.499480009079 +2024-03-14 08:22:23: Cross-validating best estimator +Needed time for cross-validating the best model: 648.9891438484192 +2024-03-14 08:33:12: ___________________ +2024-03-14 08:33:12: Obtained metrics for PMEmo +2024-03-14 08:33:12: r2, RMSE, MAE +2024-03-14 08:33:12: 7.32e-01 ± 2.65e-02 +2024-03-14 08:33:12: 1.91e-01 ± 4.78e-03 +2024-03-14 08:33:12: 1.50e-01 ± 8.81e-03 +2024-03-14 08:33:12: ___________________ +2024-03-14 08:33:12: Obtained metrics for IADS-E-nomusic +2024-03-14 08:33:12: r2, RMSE, MAE +2024-03-14 08:33:12: -1.17e-01 ± 2.52e-01 +2024-03-14 08:33:12: 3.09e-01 ± 2.27e-02 +2024-03-14 08:33:12: 2.42e-01 ± 2.00e-02 +2024-03-14 08:33:12: +-------- +2024-03-14 08:33:12: Label: ValMN +2024-03-14 08:33:12: [Clustering] +2024-03-14 08:33:13: [Ended] +2024-03-14 08:33:13: [Clustering] +2024-03-14 08:33:13: [Ended] +2024-03-14 08:33:13: Tuning AutoML +[WARNING] [2024-03-14 08:33:34,437:Client-AutoML(8229):1dd34d63-e1d5-11ee-9a76-b499bab8ef8a] Time limit for a single run is higher than total time limit. Capping the limit for a single run to the total time given to SMAC (5396.894986) +[WARNING] [2024-03-14 08:33:34,437:Client-AutoML(8229):1dd34d63-e1d5-11ee-9a76-b499bab8ef8a] Capping the per_run_time_limit to 2698.0 to have time for a least 2 models in each process. +[WARNING] [2024-03-14 08:33:56,767:Client-EnsembleBuilder] No runs were available to build an ensemble from +Needed time for optimizing the model: 5419.825257062912 +2024-03-14 10:03:33: Cross-validating best estimator +Needed time for cross-validating the best model: 1886.1048514842987 +2024-03-14 10:34:59: ___________________ +2024-03-14 10:34:59: Obtained metrics for PMEmo +2024-03-14 10:34:59: r2, RMSE, MAE +2024-03-14 10:34:59: 5.67e-01 ± 4.85e-02 +2024-03-14 10:34:59: 2.13e-01 ± 2.11e-02 +2024-03-14 10:34:59: 1.69e-01 ± 1.80e-02 +2024-03-14 10:34:59: ___________________ +2024-03-14 10:34:59: Obtained metrics for IADS-E-nomusic +2024-03-14 10:34:59: r2, RMSE, MAE +2024-03-14 10:34:59: 1.52e-01 ± 1.50e-01 +2024-03-14 10:34:59: 3.19e-01 ± 3.04e-02 +2024-03-14 10:34:59: 2.41e-01 ± 2.41e-02 +2024-03-14 10:34:59: +-------- +--------