diff --git a/manual/develop/en/html/.buildinfo b/manual/develop/en/html/.buildinfo index 89998ec..f1e94cb 100644 --- a/manual/develop/en/html/.buildinfo +++ b/manual/develop/en/html/.buildinfo @@ -1,4 +1,4 @@ # Sphinx build info version 1 # This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done. -config: 09cbd1640c31fca0989e41f0ebfe898d +config: d0577335a099bbf09bab264ed0265eb4 tags: 645f666f9bcd5a90fca523b33c5a78b7 diff --git a/manual/develop/en/html/_images/task_view.png b/manual/develop/en/html/_images/task_view.png index 0ca4be0..44d038a 100644 Binary files a/manual/develop/en/html/_images/task_view.png and b/manual/develop/en/html/_images/task_view.png differ diff --git a/manual/develop/en/html/_sources/moller/about/index.rst.txt b/manual/develop/en/html/_sources/moller/about/index.rst.txt index 91ff390..ddc8951 100644 --- a/manual/develop/en/html/_sources/moller/about/index.rst.txt +++ b/manual/develop/en/html/_sources/moller/about/index.rst.txt @@ -23,6 +23,8 @@ Contributors This software was developed by the following contributors. +- ver.1.0.0 (Released on 2024/03/06) + - ver.1.0-beta (Released on 2023/12/28) - Developers diff --git a/manual/develop/en/html/_sources/moller/command/index.rst.txt b/manual/develop/en/html/_sources/moller/command/index.rst.txt index 1b846c6..7069b0f 100644 --- a/manual/develop/en/html/_sources/moller/command/index.rst.txt +++ b/manual/develop/en/html/_sources/moller/command/index.rst.txt @@ -57,7 +57,7 @@ DESCRIPTION: - ``list_file`` - specifies the file that contains list of job directories. If this file is not specified, the list will be obtained from the logfile of the batch job ``log_{task}.dat``. + specifies the file that contains list of job directories. If this file is not specified, the list will be obtained from the logfile of the batch job ``stat_{task}.dat``. - ``-o``, ``--output`` ``output_file`` @@ -91,5 +91,5 @@ DESCRIPTION: FILES: - When the programs are executed concurrently using the job script generated by ``moller``, the status of the tasks are written in log files ``log_{task}.dat``. ``moller_status`` reads these log files and makes a summary. + When the programs are executed concurrently using the job script generated by ``moller``, the status of the tasks are written in log files ``stat_{task}.dat``. ``moller_status`` reads these log files and makes a summary. diff --git a/manual/develop/en/html/_sources/moller/tutorial/basic.rst.txt b/manual/develop/en/html/_sources/moller/tutorial/basic.rst.txt index d1bd8b4..c2e0f70 100644 --- a/manual/develop/en/html/_sources/moller/tutorial/basic.rst.txt +++ b/manual/develop/en/html/_sources/moller/tutorial/basic.rst.txt @@ -78,7 +78,7 @@ A list of jobs is to be created. ``moller`` is designed so that each job is exec .. code-block:: bash - $ /usr/bin/ls -1d > list.dat + $ /usr/bin/ls -1d * > list.dat In this tutorial, an utility script ``make_inputs.sh`` is enclosed which generates datasets and a list file. @@ -128,3 +128,34 @@ An example of the output is shown below: where "o" corresponds to a task that has been completed successfully, "x" corresponds to a failed task, "-" corresponds to a skipped task because the previous task has been terminated with errors, and "." corresponds to a task yet unexecuted. In the above example, the all tasks have been completed successfully. + + +Rerun failed tasks +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +If a task fails, the subsequent tasks within the job will not be executed. +The following is an example of job status in which each task fails by 10% change. + +.. literalinclude:: ../../../../tutorial/moller/reference/status_failed.txt + +There, the jobs of dataset_0003 and dataset_0004 failed at task1, and the subsequent task2 and task3 were not executed. The other jobs were successful at task1, and proceeded to task2. +In this way, each job is executed independently of other jobs. + +Users can rerun the failed tasks by submitting the batch job with the retry option. +For SLURM job scheduler (e.g. used in ISSP system B), resubmit the job as follows: + +.. code-block:: bash + + $ sbatch job.sh --retry list.dat + +For PBS job scheduler (e.g. used in ISSP system C), edit the job script so that the line ``retry=0`` is replaced by ``retry=1``, and resubmit the job. + +.. literalinclude:: ../../../../tutorial/moller/reference/status_retry.txt + +The tasks that have failed will be executed in the second run. +In the above example, the task1 for dataset_0003 was successful, but the task2 failed. +For dataset_0004, task1, task2, and task3 were successfully executed. +For the jobs of datasets whose tasks have already finished successfully, the second run will not do anything. + +N.B. the list file must not be modified on the rerun. The jobs are managed according to the order of entries in the list file, and therefore, if the order is changed, the jobs will not be executed properly. + diff --git a/manual/develop/en/html/_static/documentation_options.js b/manual/develop/en/html/_static/documentation_options.js index c85b95c..b8fdae6 100644 --- a/manual/develop/en/html/_static/documentation_options.js +++ b/manual/develop/en/html/_static/documentation_options.js @@ -1,5 +1,5 @@ const DOCUMENTATION_OPTIONS = { - VERSION: '1.0-dev', + VERSION: '1.1-dev', LANGUAGE: 'en', COLLAPSE_INDEX: false, BUILDER: 'html', diff --git a/manual/develop/en/html/_static/task_view.pdf b/manual/develop/en/html/_static/task_view.pdf index e85cbb6..3af0603 100644 Binary files a/manual/develop/en/html/_static/task_view.pdf and b/manual/develop/en/html/_static/task_view.pdf differ diff --git a/manual/develop/en/html/_static/task_view.png b/manual/develop/en/html/_static/task_view.png index 0ca4be0..44d038a 100644 Binary files a/manual/develop/en/html/_static/task_view.png and b/manual/develop/en/html/_static/task_view.png differ diff --git a/manual/develop/en/html/genindex.html b/manual/develop/en/html/genindex.html index 49a1d8d..28d14ff 100644 --- a/manual/develop/en/html/genindex.html +++ b/manual/develop/en/html/genindex.html @@ -4,11 +4,11 @@ - Index — Moller Users Guide 1.0-dev documentation + Index — Moller Users Guide 1.1-dev documentation - + @@ -93,7 +93,7 @@

Quick search

| Powered by Sphinx 7.2.6 - & Alabaster 0.7.15 + & Alabaster 0.7.16 diff --git a/manual/develop/en/html/index.html b/manual/develop/en/html/index.html index 10647b7..21b1658 100644 --- a/manual/develop/en/html/index.html +++ b/manual/develop/en/html/index.html @@ -5,11 +5,11 @@ - Moller Users Guide — Moller Users Guide 1.0-dev documentation + Moller Users Guide — Moller Users Guide 1.1-dev documentation - + @@ -107,7 +107,7 @@

Quick search

| Powered by Sphinx 7.2.6 - & Alabaster 0.7.15 + & Alabaster 0.7.16 | - 1. Introduction — Moller Users Guide 1.0-dev documentation + 1. Introduction — Moller Users Guide 1.1-dev documentation - + @@ -53,6 +53,7 @@

1.2. License1.3. Contributors

This software was developed by the following contributors.