Skip to content

Commit

Permalink
Merge branch '3.2.pr' into 'trunk'
Browse files Browse the repository at this point in the history
3.2.pr

See merge request wdc/compss/framework!426
  • Loading branch information
jorgee committed May 16, 2023
2 parents 8c31736 + 206afdc commit cca3913
Show file tree
Hide file tree
Showing 27 changed files with 844 additions and 378 deletions.
111 changes: 111 additions & 0 deletions CITATION.cff
Original file line number Diff line number Diff line change
@@ -0,0 +1,111 @@
# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.2.0
title: COMPSs
message: >-
If you use this software, please cite it using the
metadata from this file.
type: software
authors:
- given-names: Jorge
family-names: Ejarque
email: jorgq.ejarque@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0003-4725-5097'
- given-names: Francesc
family-names: Lordan
email: francesc.lordan@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0002-9845-8890'
- given-names: Rosa Maria
family-names: Badia
email: rosa.m.badia@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0003-2941-5499'
- given-names: Raul
family-names: Sirvent
email: raul.sirvent@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0003-0606-2512'
- given-names: Daniele
family-names: Lezzi
email: daniele.lezzi@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0001-5081-7244'
- given-names: Fernando
family-names: Vazquez
email: fernando.vazquez@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0001-5634-509X'
- given-names: Cristian
family-names: Tatu
email: cristian.tatu@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0009-0003-8848-9436'
- given-names: Gabriel
family-names: Puigdemunt
email: gabriel.puigdemunt@bsc.es
affiliation: Barcelona Supercomputing Center
orcid: 'https://orcid.org/0000-0002-5576-9912'
- email: nihad.mammadli@bsc.es
given-names: Nihad
affiliation: Barcelona Supercomputing Center
family-names: Mammadli
orcid: 'https://orcid.org/0000-0001-8089-921X'
identifiers:
- type: doi
value: 10.5281/zenodo.6362594
description: software
repository-code: 'https://github.com/bsc-wdc/compss'
url: 'https://compss.bsc.es'
abstract: >
COMP Superscalar (COMPSs) is a framework which aims to
ease the development and execution of parallel
applications for distributed infrastructures, such as
Clusters, Clouds and containerized platforms.
keywords:
- hpc
- workflows
- distributed computing
license: Apache-2.0
version: '3.2'
preferred-citation:
type: article
authors:
- family-names: "Francesc"
given-names: "Lordan"
orcid: "https://orcid.org/0000-0002-9845-8890"
- family-names: "Tejedor"
given-names: "Enric"
orcid: "https://orcid.org/0000-0000-0000-0000"
- family-names: "Ejarque"
given-names: "Jorge"
orcid: "https://orcid.org/0000-0003-4725-5097"
- family-names: "Alvarez"
given-names: "Javier"
orcid: "https://orcid.org/0000-0001-7153-4649"
- family-names: "Marozzo"
given-names: "Fabrizio"
orcid: "https://orcid.org/0000-0001-7887-1314"
- family-names: "Lezzi"
given-names: "Daniele"
orcid: "https://orcid.org/0000-0001-5081-7244"
- family-names: "Sirvent"
given-names: "Raul"
orcid: "https://orcid.org/0000-0003-0606-2512"
- family-names: "Talia"
given-names: "Domenico"
orcid: "https://orcid.org/0000-0003-1910-9236"
- family-names: "Badia"
given-names: "Rosa M."
orcid: "https://orcid.org/0000-0003-2941-5499"
doi: "10.1007/s10723-013-9272-5"
journal: "Journal of Grid Computing"
month: 3
start: 67 # First page number
end: 91 # Last page number
title: "Servicess: An interoperable programming framework for the cloud"
issue: 1
volume: 12
year: 2014
29 changes: 8 additions & 21 deletions RELEASE_NOTES
Original file line number Diff line number Diff line change
Expand Up @@ -6,30 +6,17 @@ COMP Superscalar (COMPSs) is a programming model that aims to ease the developme
such as Clusters, Grids and Clouds. COMP Superscalar also features a runtime system that exploits the inherent parallelism of
applications at execution time.

Release number: 3.1 (Margarita)

Release date: June-2022
Release number: 3.2 (Narcissus)

Release date: May-2023
-------------------------------
New features
- Support for Julia applications as tasks
- Support for uDocker for container tasks.
- New decorator to apply a transformation to a parameter (@data_transformation)
- Automatic creation of Data Provenance information from Java applications.
- Constraint to force execution in the local agent. (is_local=True)
- Extended external software description (JSON file in Software decorator) to allow the definition of task parameters.
- Enable the specification of master working directory (location where data serializations are stored).
- Support for Containers in MPI and MPMD tasks
- Cache for cuPy Objects in GPU tasks.
- New SSH/SCP Adaptor to submit tasks to remote clusters (GOS Adaptor).

Improvements:
- Data Provenance: enhanced addition of source files using directories
- Fix issues when wait_on cancelled data. Get the latest version.
- Swap distutils with setuptools in the Python binding installation.
- Improvements in the management of tasks returning a modified parameter (a=task(a)).
- Container decorator allows to define flags to be passed to the container execution commands.
- Improvements in the support for agents and task nesting.
- Improvements in pluggable schedulers.
- Improvements in python cache.
- Improvements in tracing system: Fix assigned gpus events, include python cache events.
- Fix issues in Collection graph generation
- Configuration files for Hawk, Mahti, Dardel and Lenox system.
- Workflow Provenance: support the new Workflow Run Crate profile (v0.1), improved the structuring of source files for the application, new term to specify a submitter, more details on the machine that run the workflow (architecture and COMPSs environment variables)
- Configuration files for Jusuf system.
- Several Bug fixes.

Known Limitations:
Expand All @@ -43,7 +30,7 @@ Known Limitations:
- Master as worker feature is not working for executions with persistent worker in C++.
- Coherence and concurrent writing in parameters annotated with the "Concurrent" direction must be managed by the underlying distributed storage system.
- Delete file calls for files used as input can produce a significant synchronization of the main code.
- Defining a parameter as OUT is only allowed for files and colleions of objects with a default constructor.
- Defining a parameter as OUT is only allowed for files and collections of objects with a default constructor.

For further information, please refer to the COMPSs Documentation at:
https://compss-doc.readthedocs.io/en/stable/
Expand Down
2 changes: 1 addition & 1 deletion builders/specs/cli/PyCOMPSsCLIResources/VERSION.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
2.10.11
3.2
2 changes: 1 addition & 1 deletion builders/specs/cli/PyCOMPSsCLIResources/install.sh
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,6 @@

echo "Installing..."

python3 setup.py install --record installed_files.txt
python3 setup.py install --record installed_files.txt --user

echo "----- Installation finished -----"
Loading

0 comments on commit cca3913

Please sign in to comment.