4.3.0

This release is based on Science Pipelines w_2024_31 and rubin-env 8.0.0. It was published to include new features and fixes in Science Pipelines and in prompt processing framework. This includes DM-43599 (add progress logs to slow tasks) and other new features.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x [Known issue when working with ApdbSql 0.1.1; fixed on 4.4.0]
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-40434: Prompt Processing continues processing after timeout or termination by @kfindeisen in #182
• DM-45024: Reconcile PP workflows with "quick-stack" builds by @kfindeisen in #184

Full Changelog: 4.2.0...4.3.0

4.2.0

This release is based on Science Pipelines w_2024_29 and rubin-env 8.0.0. It was published to include new features and fixes in Science Pipelines and in prompt processing framework. This includes a new APDB feature to help performance (DM-45233).

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-45084: Quick-container fix breaks tagging of regular Prompt Processing containers by @kfindeisen in #178
• DM-45007: Memory leak in Prompt Processing service by @kfindeisen in #179
• Clarify that we can ignore ApdbCassandraReplica version. by @kfindeisen in #180
• DM-45275: Failure to build prompt-service with new prompt-base by @hsinfang in #183

Full Changelog: 4.1.2...4.2.0

Service Image

prompt-service@9b6e61c3

4.1.2

This release is based on the d_2024_06_21_DM-44996-8.0.0 Science Pipelines container and rubin-env 8.0.0. It fixes an issue where worker shutdowns caused pods to leak storage.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-43648: Old repos left behind on Prompt Processing worker reboot by @kfindeisen in #176

Full Changelog: 4.1.1...4.1.2

Service Image

prompt-service@d3109f8

4.1.1

This release is based on Science Pipelines d_2024_06_21, rubin-env 8.0.0, and a bug fix of DM-44996. It was published to patch the DM-44996 bug for OR4. This uses quick-stack d_2024_06_21_DM-44996-8.0.0.

This release is compatible with:

• Next Visit Fan Out v2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x.
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

Full Changelog: 4.1.0...4.1.1

4.1.0

This release is based on Science Pipelines d_2024_06_21 and rubin-env 8.0.0. It was published for Cassandra APDB support and new prompt-service features such as local repo sizing DM-40193, new Science Pipelines features and bug fixes such as DM-44850. A daily is used instead of w_2024_25 so to include the bug fix DM-44937.

This release is compatible with:

• Next Visit Fan Out v2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x.
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-44816: Add documentation for Cassandra APDB by @isullivan in #171
• DM-42924: Document use of apdb-cli metadata. by @kfindeisen in #170
• DM-40193: Disk space leak in prompt processing by @kfindeisen in #169
• DM-43180: Include private_efdStamp in test messages. by @kfindeisen in #172
• DM-44844: Deploy Cassandra for production Prompt Processing by @kfindeisen in #174

New Contributors

• @isullivan made their first contribution in #171

Full Changelog: 4.0.0...4.1.0

4.0.0

This release is based on Science Pipelines w_2024_23 and rubin-env 8.0.0. It was published to include new Science Pipelines features and use APDB schema 2.0.0 so to prepare for OR4.

This release is compatible with:

• Next Visit Fan Out v2.x
• APDB schema 2.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-44728: Create a temporary pipeline for Prompt Processing integration tests with OR3 by @kfindeisen in #168

Full Changelog: 3.1.0...4.0.0

3.1.0

This release is based on Science Pipelines w_2024_22 and rubin-env 8.0.0. It was published to include
DM-42925 (preprocessing pipeline) and DM-44605 (ISR pipeline for raw calibs), along with other Science Pipelines features.

This release is compatible with:

• Next Visit Fan Out v2.x
• APDB schema 1.0.0 to 1.1.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.0.

What's Changed

• DM-42925: Add support for preprocessing pipeline to Prompt Processing by @kfindeisen in #164
• DM-44605: Prompt processing can do ISR for LATISS calibrations of the survey BLOCK-295 by @hsinfang in #167

Full Changelog: 3.0.0...3.1.0

3.0.0

This release is based on Science Pipelines w_2024_20 and rubin-env 8.0.0. It bundles together breaking changes to the Butler, APDB, and Alerts schemas; there is no incompatibility with old nextVisit messages.

This release is compatible with:

• Next Visit Fan Out v2.x
• APDB schema 1.0.0 to 1.1.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.0.

What's Changed

• DM-43316: Use atomic chain operations where appropriate in Prompt Processing by @kfindeisen in #156
• DM-44096: Migrate Prompt Processing to external APDB configs by @kfindeisen in #157
• DM-43949: Require Butler dimensions-config 6+ in Prompt Processing by @kfindeisen in #158
• Clarify how minor versions work for APDB. by @kfindeisen in #159
• DM-44189: Remove ccdVisitId from Prompt Processing by @kfindeisen in #160 and #163
• DM-43948: Create region/time dataset in Prompt Processing by @kfindeisen in #161
• DM-44393: Prompt Processing does not transfer visit definitions by @kfindeisen in #166
• DM-43913: Make tester upload_hsc_rc2.py work with LATISS/LSSTComCamSim by @hsinfang in #154

Full Changelog: 2.6.0...3.0.0

Service Image

prompt-service@970b408

2.6.0

This release is based on Science Pipelines w_2024_16 and rubin-env 8.0.0. It was published to include new Science Pipelines features and fixes. This release distributes alerts with schema 6.1.

This release is compatible with:

• Next Visit Fan Out v2.x
• APDB schema 0.1.x and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 3 to 7.

What's Changed

• Add missing config override to register-dataset-types call. by @kfindeisen in #152
• Update Release Management docs by @kfindeisen in #150
• DM-42825: Prompt Processing does slow calib queries against /repo/embargo by @kfindeisen in #153

Full Changelog: 2.5.0...2.6.0

2.5.0

This release is based on Science Pipelines w_2024_14 and rubin-env 8.0.0. It was published to deploy fixes for DM-43590 (too aggressive timeouts in alert producer) and DM-43674 (corrected distortion model for ComCamSim), along with other Science Pipelines features.

This release is compatible with:

• Next Visit Fan Out v2.x
• APDB schema 0.1.x and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 3 to 7.

This release distributes alerts with schema 6.1.

What's Changed

• DM-43414: Update playbook to use apdb-cli in place of make_apdb.py by @andy-slac in #151

New Contributors

• @andy-slac made their first contribution in #151

Full Changelog: 2.4.0...2.5.0

Service Image

prompt-service@287b5bb