v3.00.51rc6 sourceFromExchange, and many other fixes.

What's Changed

• Issue860 4 suppress the default source guess if some other option is specified. And more! by @petersilva in #877
• Add plugins and examples for retrieving data from Copernicus by @reidsunderland in #878
• Note about batch by @reidsunderland in #879
• close #880 implements list of vips, ORed. by @petersilva in #883
• closes #881 by removing files on download failure by @petersilva in #882
• reverting quoting in one place, to see if it helps by @petersilva in #885
• Issue740 3 Adding pyproject.toml support for better installation on python > 3.6 by @petersilva in #887
• Close gzip target file before renaming it (to ensure it's flushed) by @endlisnis in #889
• Issue884 second fix for #884, this time with safe= by @petersilva in #890
• New EUMETSAT plugins; updates for copernicus by @reidsunderland in #891
• Add plugin for rate limiting polls by @reidsunderland in #886
• fixing problem with inflight numeric value being ignored by @petersilva in #892
• Branch396 v3 51 re-enabling partitioned transfers on an experimental basis. by @petersilva in #888

Full Changelog: v3.00.50...v3.00.51rc6

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

PyPI: https://pypi.org/project/metpx-sr3/3.0.51rc6/

• RPM package for Redhat Version 8 attached here, install with rpm -ivh ... note:

  • Some dependencies are not readily avialable. May have to obtain packages
    from pip to get a fully functional installation. Verify with sr3 features after installation, to determine if everything needed is available.

• self-extracting windows installer also attached.

v3.00.51rc4 sourceFromExchange confirmed working.

What's Changed

• Issue860 3 fix sourceFromExchange by @petersilva in #876

Full Changelog: v3.00.51rc2...v3.00.51rc4

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

PyPI: https://pypi.org/project/metpx-sr3/3.0.51rc4/

• RPM package for Redhat Version 8 attached here, install with rpm -ivh ... note:

  • Some dependencies are not readily avialable. May have to obtain packages
    from pip to get a fully functional installation. Verify with sr3 features after installation, to determine if everything needed is available.

• self-extracting windows installer also attached.

v3.00.51rc2 fix two flags.

• sundew_compat_regex_first_match_is_zero
• sourceFromExchange

were both broken in the last few releases. (neither setting was effective in a configuration.)

Full Changelog: v3.00.51rc1...v3.00.51rc2

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

PyPI: https://pypi.org/project/metpx-sr3/3.0.51rc2/

• RPM package for Redhat Version 8 attached here, install with rpm -ivh ... note:

  • Some dependencies are not readily avialable. May have to obtain packages
    from pip to get a fully functional installation. Verify with sr3 features after installation, to determine if everything needed is available.

• self-extracting windows installer also attached.

v3.00.51rc1

What's Changed

• V03 release process revision by @petersilva in #859
• fix #866 by @petersilva in #867
• turn off magic support if redhat library present. by @petersilva in #868
• Fix Issue 861 - variable substitution issues by @reidsunderland in #865
• Issue824 - last transfer (for files) last message (for message flows) in metrics and status. by @petersilva in #871
• Issue860 fixing sourceFromExchange by @petersilva in #870
• fix #872 crashing because o.identity is kind of a typo by @petersilva in #873

Full Changelog: v3.00.50...v3.00.51rc1

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

PyPI: https://pypi.org/project/metpx-sr3/3.0.51rc1/

• RPM package for Redhat Version 8 attached here, install with rpm -ivh ... note:

  • Some dependencies are not readily avialable. May have to obtain packages
    from pip to get a fully functional installation. Verify with sr3 features after installation, to determine if everything needed is available.

• self-extracting windows installer also attached.

v3.00.50 position parameters working on ubuntu 18.

What's Changed

• Issue857 - fixes for python3.6 incompatibility with regex matches and deepcopy. by @petersilva in #858

Full Changelog: v3.00.49...v3.00.50

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

PyPI: https://pypi.org/project/metpx-sr3/3.0.50/

• self-extracting windows installer also attached.

v3.00.50rc1 first pre-release (fixes problem for python3.6 aka ubuntu18 & rh8)

Summary

• on newer OS and python verison, this release changes nothing.
• emergency fix #857 which cause many problems on older operating systems, essentially unusable.
• switching to a pre-release scheme for versioning... so this version will not be tagged "latest" but instead rc1, and labelled as a pre-release in github and pypi.

What's Changed

• Issue857 - fixes for python3.6 incompatibility with regex matches and deepcopy. by @petersilva in #858
• will not show up in pypi.org by default, you need to specify the exact version.
• uploading to "MetPX-Pre-Release" launchpad PPA repository, instead of the stable "MetPX" one.
• installation instructions below are appropriately adjusted.
• re-instated testing on older operating systems that had been dropped last spring as a result of loss
  of availability in github.

Full Changelog: v3.00.49...v3.00.50rc1

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

PyPI: https://pypi.org/project/metpx-sr3/3.0.50rc1/

• RPM package for Redhat Version 8 attached here, install with rpm -ivh ... note:

  • in the environments we use, EPEL is not available, so many dependencies are omitted, may have to obtain packages
    from pip to get a fully functional installation. verify with sr3 features after installation, to determine if everything needed is available.

• self-extracting windows installer also attached.

v3.00.49 small bugfixes for specific use cases.

Summary

• bugfixes to support flowcb/poll/airnow.py
• bugfixes to support flowcb/flow/wiski.py
• better integration with sr3_tools.

CAVEAT:

• BUG on python 3.6... do not use on RHEL8 or ubuntu18x (details #857 )

What's Changed

• plugin fixes from ddsr dev work... by @petersilva in #849
• typo, change old to new by @reidsunderland in #850
• Issue854 sr3_tools stuff should not be killed by sr3 stop, or sr3 sanity. by @petersilva in #855
• result of andre and peter working on ddsr-dev transition. by @petersilva in #852

Full Changelog: v3.00.48...v3.00.49

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx
PyPI: https://pypi.org/project/metpx-sr3/

v3.00.48 fix positional parameters in accept/directory settings.

Summary

• fixed settings like directory, ${1} type substitutions from v2 were misinterpreted in v3.
• better compatibility with v2 SFTP configurations & conversion.
• better messages for selective sr3 stop.

Caveat

• bug do not use on python 3.6 ... used by redhat 8 and ubuntu18... for more details see #857

What's Changed

• Fix one problem related to #639 is relative paths being absoluted... by @petersilva in #837
• fixing Issue #839 - fixing positional grouping in sr3 by @petersilva in #840
• Config print file name/line numbers ... doing a stacking thing also (for includes) by @petersilva in #844
• Issue841 sr3 convert add / do end of post_baseUrl. by @petersilva in #842
• fix #846 better messages when selectively stopping components by @petersilva in #847

Full Changelog: v3.00.47...v3.00.48

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx
PyPI: https://pypi.org/project/metpx-sr3/

v3.00.47 Make dangerWillRobinson Less Dangerous

Summary

• --dangerWillRobinson now requires a number argument to say how many configurations
  the user thinks they are changing. (prevents sr3 --dangerWillRobinson remove from removing everything.)
• broker side queue metric now available.
• self-cleanup for metrics files.
• fix for log files printing wrong information about exchange on publish.

What's Changed

• Issue808 setup on start by @petersilva in #814
• Issue816 - poll improve how permCopy/timeCopy work by @petersilva in #820
• adding class so octal values print intuitively. by @petersilva in #822
• Issue649 - create a metric for broker side queued message count, and report in sr3 status by @petersilva in #818
• Issue817 - have logRotate* apply to metrics files too. by @petersilva in #819
• for #803: remove setup command, it is just an undocumented alias by @petersilva in #821
• First attempt at switching to AMQP consumers instead of using basic_get by @reidsunderland in #823
• Issue828 - log message printing the wrong exchange. by @petersilva in #830

Full Changelog: v3.00.46...v3.00.47

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx
PyPI: https://pypi.org/project/metpx-sr3/

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx
PyPI: https://pypi.org/project/metpx-sr3/

Metpx-Sr3 v3.00.46

What's Changed

• closes #796, #791 incorrect messages published after transfer with mirror off.
• closes #793 move metrics to sub-directory (for Greg's work on cloud)
• fixes for windows executable generation.
• branch re-org: v03 now assumed, so development replaces v03_wip
• github container repository (GHCR) updates... "latest" now versioned.
• GHCR development snapshot image now available.
• GHCR both images built from _base image that does all dependencies.
• closes #811 - documentated default wrong for acceptUnmatch.
• closes #809 - flow_api_consumer example crashing.
• closes #804 - warning message on poll with exchange name mismatch.
• closes #802 - adds POST_BROKER_USER variable.

Full Changelog: v3.00.45...v3.00.46

Installation

Guide: https://metpx.github.io/sarracenia/Tutorials/Install.html

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx
PyPI: https://pypi.org/project/metpx-sr3/