Skip to content

Commit

Permalink
temporarily disable some steps and run more often to expose more pgbe…
Browse files Browse the repository at this point in the history
…nch --initialize in benchmarking workflow (#10616)

## Problem

we want to disable some steps in benchmarking workflow that do not
initialize new projects and instead run the test more frequently

Test run
 https://github.com/neondatabase/neon/actions/runs/13077737888
  • Loading branch information
Bodobolero authored Jan 31, 2025
1 parent 48c87dc commit bc7822d
Showing 1 changed file with 9 additions and 4 deletions.
13 changes: 9 additions & 4 deletions .github/workflows/benchmarking.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,8 @@ on:
# │ │ ┌───────────── day of the month (1 - 31)
# │ │ │ ┌───────────── month (1 - 12 or JAN-DEC)
# │ │ │ │ ┌───────────── day of the week (0 - 6 or SUN-SAT)
- cron: '0 3 * * *' # run once a day, timezone is utc
# - cron: '0 3 * * *' # run once a day, timezone is utc
- cron: '0 */10 * * *' # Runs every 10 hours at minute 0
workflow_dispatch: # adds ability to run this manually
inputs:
region_id:
Expand Down Expand Up @@ -550,6 +551,7 @@ jobs:
SLACK_BOT_TOKEN: ${{ secrets.SLACK_BOT_TOKEN }}

pgbench-pgvector:
if: false
permissions:
contents: write
statuses: write
Expand Down Expand Up @@ -683,7 +685,8 @@ jobs:
#
# *_CLICKBENCH_CONNSTR: Genuine ClickBench DB with ~100M rows
# *_CLICKBENCH_10M_CONNSTR: DB with the first 10M rows of ClickBench DB
if: ${{ !cancelled() && (github.event.inputs.run_only_pgvector_tests == 'false' || github.event.inputs.run_only_pgvector_tests == null) }}
# if: ${{ !cancelled() && (github.event.inputs.run_only_pgvector_tests == 'false' || github.event.inputs.run_only_pgvector_tests == null) }}
if: false
permissions:
contents: write
statuses: write
Expand Down Expand Up @@ -810,7 +813,8 @@ jobs:
# We might change it after https://github.com/neondatabase/neon/issues/2900.
#
# *_TPCH_S10_CONNSTR: DB generated with scale factor 10 (~10 GB)
if: ${{ !cancelled() && (github.event.inputs.run_only_pgvector_tests == 'false' || github.event.inputs.run_only_pgvector_tests == null) }}
# if: ${{ !cancelled() && (github.event.inputs.run_only_pgvector_tests == 'false' || github.event.inputs.run_only_pgvector_tests == null) }}
if: false
permissions:
contents: write
statuses: write
Expand Down Expand Up @@ -929,7 +933,8 @@ jobs:
SLACK_BOT_TOKEN: ${{ secrets.SLACK_BOT_TOKEN }}

user-examples-compare:
if: ${{ !cancelled() && (github.event.inputs.run_only_pgvector_tests == 'false' || github.event.inputs.run_only_pgvector_tests == null) }}
# if: ${{ !cancelled() && (github.event.inputs.run_only_pgvector_tests == 'false' || github.event.inputs.run_only_pgvector_tests == null) }}
if: false
permissions:
contents: write
statuses: write
Expand Down

1 comment on commit bc7822d

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

7565 tests run: 7202 passed, 1 failed, 362 skipped (full report)


Failures on Postgres 16

# Run all failed tests locally:
scripts/pytest -vv -n $(nproc) -k "test_layer_map[release-pg16-github-actions-selfhosted]"
Flaky tests (2)

Postgres 17

Postgres 16

Code coverage* (full report)

  • functions: 33.4% (8518 of 25538 functions)
  • lines: 49.1% (71518 of 145571 lines)

* collected from Rust tests only


The comment gets automatically updated with the latest test results
bc7822d at 2025-01-31T21:38:37.394Z :recycle:

Please sign in to comment.