Skip to content

Commit

Permalink
add citation in cff RELEASE_NOTES and changelog
Browse files Browse the repository at this point in the history
  • Loading branch information
Jorge Ejarque authored and jenkis_wdc committed May 16, 2023
1 parent 5dc4234 commit 206afdc
Show file tree
Hide file tree
Showing 3 changed files with 146 additions and 23 deletions.
111 changes: 111 additions & 0 deletions CITATION.cff
Original file line number Diff line number Diff line change
@@ -0,0 +1,111 @@
# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.2.0
title: COMPSs
message: >-
If you use this software, please cite it using the
metadata from this file.
type: software
authors:
- given-names: Jorge
family-names: Ejarque
email: jorgq.ejarque@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0003-4725-5097'
- given-names: Francesc
family-names: Lordan
email: francesc.lordan@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0002-9845-8890'
- given-names: Rosa Maria
family-names: Badia
email: rosa.m.badia@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0003-2941-5499'
- given-names: Raul
family-names: Sirvent
email: raul.sirvent@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0003-0606-2512'
- given-names: Daniele
family-names: Lezzi
email: daniele.lezzi@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0001-5081-7244'
- given-names: Fernando
family-names: Vazquez
email: fernando.vazquez@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0001-5634-509X'
- given-names: Cristian
family-names: Tatu
email: cristian.tatu@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0009-0003-8848-9436'
- given-names: Gabriel
family-names: Puigdemunt
email: gabriel.puigdemunt@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0002-5576-9912'
- email: nihad.mammadli@bsc.es
given-names: Nihad
affiliation: Barcelona Supercomputing Center
family-names: Mammadli
orcid: 'https://orcid.org/0000-0001-8089-921X'
identifiers:
- type: doi
value: 10.5281/zenodo.6362594
description: software
repository-code: 'https://github.com/bsc-wdc/compss'
url: 'https://compss.bsc.es'
abstract: >
COMP Superscalar (COMPSs) is a framework which aims to
ease the development and execution of parallel
applications for distributed infrastructures, such as
Clusters, Clouds and containerized platforms.
keywords:
- hpc
- workflows
- distributed computing
license: Apache-2.0
version: '3.2'
preferred-citation:
type: article
authors:
- family-names: "Francesc"
given-names: "Lordan"
orcid: "https://orcid.org/0000-0002-9845-8890"
- family-names: "Tejedor"
given-names: "Enric"
orcid: "https://orcid.org/0000-0000-0000-0000"
- family-names: "Ejarque"
given-names: "Jorge"
orcid: "https://orcid.org/0000-0003-4725-5097"
- family-names: "Alvarez"
given-names: "Javier"
orcid: "https://orcid.org/0000-0001-7153-4649"
- family-names: "Marozzo"
given-names: "Fabrizio"
orcid: "https://orcid.org/0000-0001-7887-1314"
- family-names: "Lezzi"
given-names: "Daniele"
orcid: "https://orcid.org/0000-0001-5081-7244"
- family-names: "Sirvent"
given-names: "Raul"
orcid: "https://orcid.org/0000-0003-0606-2512"
- family-names: "Talia"
given-names: "Domenico"
orcid: "https://orcid.org/0000-0003-1910-9236"
- family-names: "Badia"
given-names: "Rosa M."
orcid: "https://orcid.org/0000-0003-2941-5499"
doi: "10.1007/s10723-013-9272-5"
journal: "Journal of Grid Computing"
month: 3
start: 67 # First page number
end: 91 # Last page number
title: "Servicess: An interoperable programming framework for the cloud"
issue: 1
volume: 12
year: 2014
29 changes: 8 additions & 21 deletions RELEASE_NOTES
Original file line number Diff line number Diff line change
Expand Up @@ -6,30 +6,17 @@ COMP Superscalar (COMPSs) is a programming model that aims to ease the developme
such as Clusters, Grids and Clouds. COMP Superscalar also features a runtime system that exploits the inherent parallelism of
applications at execution time.

Release number: 3.1 (Margarita)

Release date: June-2022
Release number: 3.2 (Narcissus)

Release date: May-2023
-------------------------------
New features
- Support for Julia applications as tasks
- Support for uDocker for container tasks.
- New decorator to apply a transformation to a parameter (@data_transformation)
- Automatic creation of Data Provenance information from Java applications.
- Constraint to force execution in the local agent. (is_local=True)
- Extended external software description (JSON file in Software decorator) to allow the definition of task parameters.
- Enable the specification of master working directory (location where data serializations are stored).
- Support for Containers in MPI and MPMD tasks
- Cache for cuPy Objects in GPU tasks.
- New SSH/SCP Adaptor to submit tasks to remote clusters (GOS Adaptor).

Improvements:
- Data Provenance: enhanced addition of source files using directories
- Fix issues when wait_on cancelled data. Get the latest version.
- Swap distutils with setuptools in the Python binding installation.
- Improvements in the management of tasks returning a modified parameter (a=task(a)).
- Container decorator allows to define flags to be passed to the container execution commands.
- Improvements in the support for agents and task nesting.
- Improvements in pluggable schedulers.
- Improvements in python cache.
- Improvements in tracing system: Fix assigned gpus events, include python cache events.
- Fix issues in Collection graph generation
- Configuration files for Hawk, Mahti, Dardel and Lenox system.
- Workflow Provenance: support the new Workflow Run Crate profile (v0.1), improved the structuring of source files for the application, new term to specify a submitter, more details on the machine that run the workflow (architecture and COMPSs environment variables)
- Configuration files for Jusuf system.
- Several Bug fixes.

Known Limitations:
Expand All @@ -43,7 +30,7 @@ Known Limitations:
- Master as worker feature is not working for executions with persistent worker in C++.
- Coherence and concurrent writing in parameters annotated with the "Concurrent" direction must be managed by the underlying distributed storage system.
- Delete file calls for files used as input can produce a significant synchronization of the main code.
- Defining a parameter as OUT is only allowed for files and colleions of objects with a default constructor.
- Defining a parameter as OUT is only allowed for files and collections of objects with a default constructor.

For further information, please refer to the COMPSs Documentation at:
https://compss-doc.readthedocs.io/en/stable/
Expand Down
29 changes: 27 additions & 2 deletions changelog
Original file line number Diff line number Diff line change
Expand Up @@ -549,7 +549,7 @@ Known Limitations:
- Defining a parameter as OUT is only allowed for files and collections of objects with a default constructor.

Release number: 3.1 (Margarita)

Release date: June-2022
Release date: November-2022
-------------------------------
New features
- Support for Julia applications as tasks
Expand Down Expand Up @@ -585,7 +585,32 @@ Known Limitations:
- Master as worker feature is not working for executions with persistent worker in C++.
- Coherence and concurrent writing in parameters annotated with the "Concurrent" direction must be managed by the underlying distributed storage system.
- Delete file calls for files used as input can produce a significant synchronization of the main code.
- Defining a parameter as OUT is only allowed for files and colleions of objects with a default constructor.
- Defining a parameter as OUT is only allowed for files and collections of objects with a default constructor.
Release number: 3.2 (Narcissus)

Release date: May-2023
-------------------------------
New features
- Support for Containers in MPI and MPMD tasks
- Cache for cuPy Objects in GPU tasks.
- New SSH/SCP Adaptor to submit tasks to remote clusters (GOS Adaptor).

Improvements:
- Workflow Provenance: support the new Workflow Run Crate profile (v0.1), improved the structuring of source files for the application, new term to specify a submitter, more details on the machine that run the workflow (architecture and COMPSs environment variables)
- Configuration files for Jusuf system.
- Several Bug fixes.

Known Limitations:
- Issues when using tracing with Java 14+. For Java 17+ require to include this jvm flag "-Dcom.sun.xml.bind.v2.bytecode.ClassTailor.noOptimize=true"
- Collections are not supported in http tasks.
- macOS support is limited to Java and Python without CPU affinity (require to execute with --cpu_affinity=disable). Tracing is not available.
- Reduce operations can consume more disk space than the manually programmed n-ary reduction.
- Objects used as task parameters must be serializable.
- Tasks that invoke Numpy and MKL may experience issues if a different MKL threads count is used in different tasks. This is due to the fact that MKL reuses threads in the different calls and it does not change the number of threads from one call to another. This can be also happen with other libraries implemented with OpenMP. To fix these issues use the DLB option for in the cpu_affinity flag.
- C++ Objects declared as arguments in coarse-grain tasks must be passed as object pointers in order to have proper dependency management.
- Master as worker feature is not working for executions with persistent worker in C++.
- Coherence and concurrent writing in parameters annotated with the "Concurrent" direction must be managed by the underlying distributed storage system.
- Delete file calls for files used as input can produce a significant synchronization of the main code.
- Defining a parameter as OUT is only allowed for files and collections of objects with a default constructor.

For further information, please refer to the COMPSs Documentation at:
https://compss-doc.readthedocs.io/en/stable/
Expand Down

0 comments on commit 206afdc

Please sign in to comment.