chore(deps): update dependency oban to v2.20.1 #104
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
2.18.3->2.20.1Release Notes
oban-bg/oban (oban)
v2.20.1Compare Source
Bug Fixes
[Worker] Handle missing fields in unique Worker validation.
Workers that specified
keyswithoutfieldswould fail validation at compile time. Nowdefault values are considered for
use Oban.Workeras well asJob.new/2.v2.20.0Compare Source
Enhancements
MigrationAdd V13 migration for indexing cancelled and discarded states.A new V13 migration adds compound indexes to significantly improve
Oban.Plugins.Prunerperformance when cleaning up
discardedandcancelledjobs. This is especially beneficial forapplications that process large volumes of jobs and retain them for extended periods.
RepoExpose dynamic repo switching aswith_dynamic_repo/2The function was previously internal, which made impossible to use in external modules or extend
upon. Now custom plugins and extensions can use
Repo.with_dynamic_repo/2to use the configureddynamic repo options.
Bug Fixes
[Oban] Allow
insert_all/1,3via Oban facadeThe
insert_all/1andinsert_all/3function variants were missing from the generated Obanfacade functions when using a named instance.
[Testing] Generate correct
perform_job/1,2,3clauses.The
perform_job/2,3clauses generated byuse Oban.Testingdidn't handle theperform_job/2variant designed to run jobs created with
build_job/3. This caused test failures when tryingto execute jobs built using the
build_job/3helper function.The fix generates the missing
perform_job/2clause along with a convenientperform_job/1variant, ensuring all testing scenarios work seamlessly regardless of how jobs are constructed.
[Testing] Restrict inline execution to
availableandscheduledstates.Jobs in the
completedstate or other non-runnable states were incorrectly attempted by theinline engine, potentially causing errors or unexpected behavior during testing.
[Worker] Disallow
:keyswhen:fieldsdoesn't contain:argsor:metaUnique job configurations using
:keyswere allowed even when:fieldsdidn't include:argsor
:meta, which would result in runtime errors since keys can only extract values from thesekeyable fields.
[Cron] Fix error message when the crontab has an invalid range.
Cron validation errors for invalid ranges were returning exception structs instead of readable
error messages, making it difficult to understand and fix crontab configuration issues.
v2.19.4Compare Source
v2.19.3Compare Source
v2.19.2Compare Source
Enhancements
[Oban] Allow setting a MFA in
:get_dynamic_repoAnonymous functions don't work with OTP releases, as anonymous functions cannot be used in configuration. Now a MFA tuple can be passed instead of a fun, and the scaling guide recommends a function instead.
[Cron] Include configured timezone in cron job metadata
Along with the cron expression, stored as
cron_expr, the configured timezone is also recorded ascron_tzin cron job metadata.[Cron] Add
next_at/2andlast_at/2for cron time calculationsThis implements jumping functions for cron expressions. Rather than naively iterating through minutes, it uses the expression values to efficiently jump to the next or last cron run time.
[Executor] Always convert
queue_timeto native time unitThe telemetry docs state that measurements are recorded in
nativetime units. However, that hasn't been the case forqueue_timefor a while now. It usually worked anyway native and nanosecond is of the same resolution, but now it is guaranteed.Bug Fixes
[Peer] Correct leadership elections for the
DolphinengineMySQL always returns the number of entries attempted, even when nothing was added. The previous match caused all nodes to believe they were the leader. This uses a secondary query within the same transaction to detect if the current instance is the leader.
[Reindexer] Drop invalid indexes concurrently when reindexing.
The
DROP INDEXquery would lock the whole table with anACCESS EXCLUSIVElock and could cause queries to fail unexpectedly.[Testing] Use
Ecto.Type.cast/2for backward compatibilityThe
cast!/2function wasn't added until Ecto 3.12. This reverts time casting to usecast/2for compatibility with earlier Ecto versions.[Worker] Validate that the
uniqueoption isn't an empty list.An empty list was accepted at compile time, but wouldn't be valid later at runtime. Now the two validations match for greater parity.
v2.19.1Compare Source
Bug Fixes
[Mix] Improve igniter installer idempotency and compatibility.
The installer now uses
on_exists: :skipwhen generating a migration, so it composes safely with other igniter installers. It also removes unnecessaryadd_depcalls that would overwrite a previously specified Oban version with~> 2.18.v2.19.0: v2.19Compare Source
The minimum Elixir version is now v1.15. The official policy is to only support the three latest versions of Elixir.
🐬 MySQL Support
Oban officially supports MySQL with the new
Dolphinengine. Oban supports modern (read "with full JSON support") MySQL versions from 8.4 on, and has been tested on the highly scalable Plantescale database.Running on MySQL is as simple as specifying the
Dolphinengine in your configuration:With this addition, Oban can run in estimated 10% more Elixir applications!
⚗️ Automated Installer
Installing Oban into a new application is simplified with a new igniter powered
mixtask. The newoban.installtask handles installing and configuring a standard Oban installation, and it will deduce the correctengineandnotifierautomatically based on the database adapter.This
oban.installtask is currently the recommended way to install Oban. As a bonus, the task composes together with other igniter installers, making it possible to installphoenix,ash,oban, and other packages with a single command:Look at the
Mix.Oban.Installdocs for full usage and options.📔 Logging Enhancements
Logging in a busy system may be noisy due to job events, but there are other events that are particularly useful for diagnosing issues. A new
eventsoption forattach_default_logger/1allows selective event logging, so it's possible to receive important notices such as notifier connectivity issues, without logging all job activity:Along with filtering, there are new events to make diagnosing operational problems easier.
A
peer:electionevents logs leadership changes to indicate when nodes gain or lose leadership. Leadership issues are rare, but insidious, and make diagnosing production problems especially tricky.Helpfully,
plugin:stopevents are now logged for all core plugins via an optional callback, andplugin:exceptionevents are logged for all plugins regardless of whether they implement the callback. Runtime information is logged forCron,Lifeline,Pruner,Stager, andReindexerplugins.For example, every time
Cronruns successfully it will output details about the execution time and all of the inserted job ids:⛵️ Official JSON
Oban will default to using the official
JSONmodule built into Elixir v1.18+ when available.A new
Oban.JSONmodule detects whether the official ElixirJSONmodule is available at compile time. If it isn't available, then it falls back toJason, and ifJasonisn't available (which is extremely rare) then it warns about a missing module.This approach was chosen over a config option for backward compatibility because Oban will only support the JSON module once the minimum supported Elixir version is v1.18.
v2.19.0 — 2025-01-16
Enhancements
[Oban] Start all queues in parallel on initialization.
The midwife now starts queues using an async stream to parallelize startup and minimize boot time for applications with many queues. Previously,
[Oban] Safely return
nilfromcheck_queue/2when checking queues that aren't running.Checking on a queue that wasn't currently running on the local node now returns
nilrather than causing a crash. This makes it safer to check the whether a queue is running at all without atry/catchclause.[Oban] Add
check_all_queues/1to gather all queue status in a single function.This new helper gathers the "check" details from all running queues on the local node. While it was previously possible to pull the queues list from config and call
check_queue/2on each entry, this more accurately pulls from the registry and checks each producer concurrently.[Oban] Add
delete_job/2anddelete_all_jobs/2operations.This adds
Oban.delete_job/2,Oban.delete_all_jobs/2, Engine callbacks, and associated operations for all native engines. Deleting jobs is now easier and safer, due to automatic state protections.[Engine] Record when a queue starts shutting down
Queue producer metadata now includes a
shutdown_started_atfield to indicate that a queue isn't just paused, but is actually shutting down as well.[Engine] Add
rescue_jobs/3callback for all engines.The
Lifelineplugin formerly used two queries to rescue jobs—one to mark jobs with remaining attempts asavailableand another thatdiscardedthe remaining stuck jobs. Those are now combined into a single callback, with the base definition in theBasicengine.MySQL won't accept a select in an update statement. The Dolphin implementation of
rescue_jobs/3uses multiple queries to return the relevant telemetry data and make multiple updates.[Cron] Introduce
Oban.Cronwithschedule_interval/4The new
Cronmodule allows processes, namely plugins, to get cron-like scheduled functionality with a single function call. This will allow plugins to removes boilerplate around parsing, scheduling, and evaluating for cron behavior.[Registry] Add
select/1to simplify querying for registered modules.[Testing] Add
build_job/3helper for easier testing.Extract the mechanism for verifying and building jobs out of
perform_job/3so that it's usable in isolation. This also introducesperform_job/2for executing built jobs.[Telemetry] Add information on leadership changes to
oban.peer.electionevent.An additional
was_leader?field is included in[:oban, :peer, :election | _]event metadata to make hooking into leadership change events simpler.[Telemetry] Add callback powered logging for plugin events.
Events are now logged for plugins that implement the a new optional callback, and exceptions are logged for all plugins regardless of whether they implement the callback.
This adds logging for
Cron,Lifeline,Pruner,Stager, andReindexer.[Telemetry] Add peer election logging to default logger.
The default logger now includes leadership events to make identifying the leader, and leadership changes between nodes, easier.
[Telemetry] Add option to restrict logging to certain events.
Logging in a busy system may be noisy due to job events, but there are other events that are particularly useful for diagnosing issues. This adds an
eventsoption toattach_default_logger/1to allow selective event logging.[Telemetry] Expose
default_handler_id/0for telemetry testing.Simplifies testing whether the default logger is attached or detached in application code.
Chores
PostgrestoDatabasebecause it is also used for MySQL databases.Bug Fixes
[Oban] Allow overwriting all
insert/*functions arities afteruse Oban.[Node] Correctly handle
:nodeoption forscale_queue/2Scoping
scale_queue/2calls to a single node didn't work as advertised due to some extra validation for producer meta compatibility.[Migration] Fix version query for databases with non-unique
oidUse
pg_catalog.obj_description(object_oid, catalog_name), introduced in PostgreSQL 7.2, to specify thepg_classcatalog so only theoban_jobsdescription is returned.[Pruner] Use state specific fields when querying for prunable jobs.
Using
scheduled_atis not correct in all situations. Depending on job state, one ofcancelled_at,discarded_at, orscheduled_atshould be used.[Peer] Conditionally return the current node as leader for isolated peers.
Prevents returning the current node name when leadership is disabled.
[Testing] Retain time as microseconds for
scheduled_attests.Include microseconds in the
beginanduntiltimes used for scheduled_at tests with a delta. The prior version would truncate, which rounded theuntildown and broke microsecond level checks.[Telemetry] Correct spelling of "elapsed" in
oban.queue.shutdownmetadata.Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.