CHANGELOG.md

Change Log

All notable changes to this project will be documented in this file. See Conventional Commits for commit guidelines.

1.42.0-0 (2023-03-22)

Bug Fixes

• bug fix: sourceIsPlaceholder wasn't passed through properly (14fa4ef)
• ensure that target file paths exists before writing to file (2d5381d)
• statusReport returning bad data (3e7d72e)

Features

• Package manager placeholder (47d2e1f)
• update server-core-integration to r49 (08971cd)

1.41.1 (2023-02-22)

Bug Fixes

• add packageExists property to tryPackageRead() method, in order to return better sourceExists from isFileReadyToStartWorkingOn() (ddccbbe)
• adjust MESSAGE_TIMEOUT during unit tests (2411472)
• bug in joinUrls where it incorrectly joined the paths ("asdf/package", "//nas/folder/path") (72b837a)
• check if prerelease tag or full release (46952cd)
• packageExists value (fc7e5c6)

1.41.0 (2023-02-03)

Note: Version bump only for package package-manager-monorepo

1.41.0-alpha.1 (2023-02-03)

Bug Fixes

• add a self-check function to ensure that coreHandler._getVersions() work (a94c0d3)
• bug with logLevels (115651b)
• bugs after refactoring (8b3f19e)
• change how process version is exposed (0f7f80f)

1.41.0-alpha.0 (2023-01-27)

Bug Fixes

• CachedQuantelGateway: (6597efe)
• increase WORKER_SUPPORT_TIME (bccf20e)
• possible race-condition when receiving new data (ba17cb1)
• rework CachedQuantelGateway (216ac06)

Features

• lib: add ensureValidValue (e7e19af)
• enforce a default delay removal package (53387b8)

1.40.2 (2023-01-26)

Bug Fixes

• app version is not reported to Core (5f0917c)

1.40.1 (2023-01-26)

Note: Version bump only for package package-manager-monorepo

1.40.0 (2023-01-23)

Bug Fixes

• bug when updating priority only. (30c00cd)
• do:build-win32 doesn't include all neccessary files (3cca6c5)
• don't re-evaluate expectations that has had recent errors (3d77d5f)
• don't respect timeSinceLastError if state is RESTARTED (c94de26)
• remove dependency on blueprints-integration (e545992)
• update server-core-integration (e90f2d9)
• when an exp is waiting for another exp, it will be jumping between WAITING and NEW unnecessarily. (44d6dd8)

Features

• CachedQuantelGateway to buffer requests (33a2477)
• export stateReevaluationConcurrency as concurrencty config arguement (3eabd63)

1.39.8-alpha.4 (2023-01-17)

Note: Version bump only for package package-manager-monorepo

1.39.8-alpha.3 (2023-01-13)

Note: Version bump only for package package-manager-monorepo

1.39.8-alpha.2 (2023-01-12)

Bug Fixes

• Quantel: shorten QUANTEL_TIMEOUT to be lower than INNER_ACTION_TIMEOUT (0758974)

1.39.8-alpha.1 (2023-01-12)

Bug Fixes

• add packageHandle.packageIsInPlace() method, used to signal that a package is in place (or is about to be), so that any scheduled delayRemoval are cleared. (1a71bc5)
• potential issue when using temporaryFilePaths and renaming a file to an already existing file (17caa32)

1.39.8-alpha.0 (2023-01-12)

Bug Fixes

• add timestamp to production logs (9deb2a3)
• increase timeout on quantel (d0e0379)

1.39.7 (2023-01-11)

Bug Fixes

• update quantel-gateway-client (0f75c1e)

1.39.6 (2023-01-09)

Note: Version bump only for package package-manager-monorepo

1.39.5 (2023-01-09)

Note: Version bump only for package package-manager-monorepo

1.39.4 (2023-01-04)

Bug Fixes

• a recursive function needs to be called recursively (8e06bbf)
• replace dots with underscore in keys in scan results. (e05f8ef)

Features

• push to ghcr (23b8af4)

1.39.4-alpha.0 (2022-12-05)

Bug Fixes

• blackDetectRegex expects black_duration to be a number with a decimal point (eb4aaa3)
• blackDetectRegex expects black_duration to be a number with a decimal point (#19) (bb23fba)
• support for multiple smartbulls (bc9db81)

1.39.3 (2022-11-30)

Bug Fixes

• Update default values to generate larger media preview thumbnails (f3d0bd7)

1.39.1 (2022-09-16)

Bug Fixes

• a case where multiple QuantelGateway clients where spawned by mistake (bfb42a5)
• minor improvements to the rateLimiter of the file-watcher (7741626)
• smartbull package happened to be replaced by itself (4d2153a)

1.39.0 (2022-09-07)

Bug Fixes

• add chaosMonkey CLI option (077bb2e)
• add event handler to correct EventListener (60328b1)
• add option for singleApp to not spin up the http-servers (1ca7588)
• add some logging and graceful process handling (65c0849)
• add WorkerStorage to AppContainer, to be used for storing data from workers (19a1516)
• allow empty baseUrl for http accessor (68af3d4)
• better handling (or hack) of the "connect EADDRINUSE" issue, by swallowing the error and try again once (3cd4dcc)
• better handling of errors and child issues in AppContainer (2dafa16)
• better logging of unhandled promises / warnings (c4be2c6)
• bug fix: invert logic (2f2db03)
• bug fix: use startRequirement for source, for CopyProxy (d7cdfee)
• bug in workerAgent, where the job wasn't cancelled upon timeout in workerAgent (8cf0020)
• change priority of deep-scan, so it runs last (edcf088)
• DataStorage: add custom timeout duration for write locks (32d993d)
• expectationManager should cancel a workInProgress it thinks has timed out (4658bd3)
• ffmpeg-issues on Windows (3a523df)
• FileShare: fast-path to avoid a timeout issue when many read/write-calls are queued at the same time (cfe389c)
• fix memory leaks (e8b5ca6)
• graceful process handling (#9) (47ac8e1)
• handle errors in killFFMpeg by ignoring them (43ff037)
• hide ffmpeg banner to decrease log size (e3a24c2)
• Implement a "chaos monkey" that cuts connections between the processes. This is to ensure that reconnections works as they should. (45b05af)
• improve logging, adding categories for logger to make it easier to know where a lig line comes from (db18a35)
• improve performance for preview generation (c761c8b)
• improve proxy-copy when copying from quantel http-transformer (8385e3a)
• improve some logging/explanations (f8fd2b4)
• increase HTTP_TIMEOUT to reduce Socket turnover (d26ea5d)
• increase the delay for waiting for progress updates from jobs (a836fb8)
• issues with black&freeze detection (be1adf8)
• only do a single job per worker (fc94d3c)
• Quantel-scans should use the original, not the temporary storage (149e6d8)
• refactor FFMpeg execution for previews (2e7e9ea)
• remove shell for ffmpeg (0237b05)
• replace execFile with spawn and use maxBuffer in other places (3816100)
• report progress 0 only after FFMpeg detects duration (7809d73)
• shadowing a global variable is a bad idea (84d3907)
• switch atem accessor to execFile (1514967)
• use HTTP agents for fetch (bf3cecc)
• workaround for windows-network-drive not returning all devices. (46bc210)
• worker child processes exit with null code (#11) (19ebe9c)
• Worker: use AppContainer datastore in order to ensure that only one worker is accessing windows drive letters at the same time. (6c3b58b)

Features

• add APPCONTAINER_MAX_KEEPALIVE (bd75dd8)
• add CLI option: considerCPULoad (6da6ab0)
• Apply a rate-limit to the Quantel-http-transformer proxy, to avoid DOS-ing the backend servers (29a09cf)
• support for "temporary-storage"; by copying packages to a local PackageContainer, scanning, preview-generation etc can be done quicker. (31513f3)
• worker/accessorHandlers/http(Proxy): rethrow last timeout error (9599603)
• terminate ffmpeg/ffprobe gracefully (202b286)
• use HEAD requests for querying http-servers (a077126)

Reverts

• Revert "feat(worker/accessorHandlers/http(Proxy)): add retries to getPackagesToRemove for resiliance" (f278d2f)

1.39.0-in-development.1 (2022-02-15)

Bug Fixes

• add expectationManager data (trackedExpectations) to troubleshoot-data (7c867ad)
• bug fix: previews & thumbnails metadata files wasn't stored propery for non latin file names (4c48084)
• bug fix: progress wasn't reported for a work in progress (105d1a1)
• Don't mark "waiting for orher Expectation" as an error (2b6413c)
• fix an issue in expectationManager where removed packages where not removed properly (8dfe60c)
• fs.open read access check (2f9ab79)
• Homogenized the headline with the other Sofie repos (ba69704)
• http-server: calrify what kind of 404 it returns (10a070d)
• improve work queue in expectationManager (f4b7410)
• let the worker fix an issue with the filePath automatically. (0dfec72)
• minor fix in error handling of expectation in expectationManager (b890917)
• prevReasons wasn't updated properly (0ec0593)
• report status of Package Manager to Core (4679e08)
• revert update of got-dependency, due to incompatible Typescript (42e8a12)
• status reporting from workforce (ea43e87)
• tidy up urls for http-upload a bit (753d5dc)
• update got-dep, possibly fixing a bug (26d2ecd)
• Updated headline (2d3c82f)

1.39.0-in-development.0 (2022-01-27)

Bug Fixes

• A pretty large rehaul of connection logic. (4b20139)
• add "HelpfulEventEmitter" to be used instead ot EventEmitter,, because it'll give the developer a warning if they've forgotten to listen to error events. (fc1b1db)
• add logging for when closing connections due to ping timeouts, and require two subsequent pings to fail before closing (48cbc0c)
• allow deep scanning of audio-only files (27ebd36)
• AppContainer didn't handle reconnection of apps properly (21ce287)
• better handling of FFScan errors (dd2d643)
• bug fix: race condition in messages to Core, that could result in messages being lost (5a92f26)
• bug in http-server: path.dirname stripped the last folder from basePath. (2337602)
• bug: Quantel clips with no frames showed up as fullfilled (d986e09)
• create folder if it doesn't exist (daec566)
• don't update the PackageOnPackageContainer status in some situations where we don't actually know what state the package actually is in. (3b41749)
• ExpectationManager: minor updates to expectedPackages (such as priority changes) should not trigger full restarts of expectations (f7a3de9)
• file access errors doesn't need to include stack (eed5507)
• fine-grained priority of accessors (87f26c0)
• fix of potential bug where a throw might not be caught (0dc2753)
• handle unhandled promises (13a6f5a)
• ignore "ExpectedPackages [...] not found"-errors from core. (7215cd8)
• ignore "ExpectedPackages [...] not found"-errors from core. (3dc51da)
• improve how loss-of-connections are handled (60c74fb)
• improve stringifyError, to avoid "Error: [object Object]" in logs (9c9e888)
• in init() methods: wait for the 'connected' event being handled before finishing initializing (b767e0d)
• limit the number of times to re-try removing a Package upon fail (085c1d9)
• only allow Quantel-GUIDs on a certain form, to filter out any invalid ones (27f0cad)
• pass on certificates into spun-up workers (b565da5)
• prevent active httpProxy file uploads from timing out (0c22f69)
• quantel-http-transformer-proxy: When the proxied server returns non-200 codes, we should just pass through the responses (9e4fe3d)
• re-export blueprint-integration exports in @sofie-package-manager/api inputApi.ts (803adc5)
• receivers will not time out if their methods are unresponsive. (b08c9ac)
• replace terrible hack with a slightly less terrible hack (65349cc)
• report various execution-times in getStatus (c03059f)
• smartbull scan expectation should have high prio (7a4fbfe)
• time out http-fetches properly, to avoid ugly timed out action errors (a6fee11)
• type fix (092d368)
• WebsocketServer: track, emit and log 'error' and 'close' events (e3ba67f)
• adapterClient: add an explicit timeout for websocket function invocations (bbc3903)
• fileCopy: fix copy/paste typo in error message (943681b)
• Worker should remove a cancelled job right away, not wait for the work to actually finish (cd11a16)

Features

• add CLI argument "--noCore=true" to be used when running without Sofie Core (1e4b920)
• add support for uploading packages to ATEM video switchers (798ee85)
• Add the expectationHandler "fileVerify", used to just verify that a file exists, (adbaf25)
• fileCopy: allow reporting progress using a custom event (020a47f)
• windowsWorker: allow omitting individual fields from VersionProperty (3879b2f)

1.38.0-in-testing.0 (2021-12-17)

Bug Fixes

• ignore "ExpectedPackages [...] not found"-errors from core. (3dc51da)
• re-export blueprint-integration exports in @sofie-package-manager/api inputApi.ts (803adc5)

1.38.0-alpha.0 (2021-12-17)

Bug Fixes

• ignore "ExpectedPackages [...] not found"-errors from core. (3dc51da)
• re-export blueprint-integration exports in @sofie-package-manager/api inputApi.ts (803adc5)

1.37.0 (2021-12-17)

Bug Fixes

• A pretty large rehaul of connection logic. (4b20139)
• add "HelpfulEventEmitter" to be used instead ot EventEmitter,, because it'll give the developer a warning if they've forgotten to listen to error events. (fc1b1db)
• add logging for when closing connections due to ping timeouts, and require two subsequent pings to fail before closing (48cbc0c)
• AppContainer didn't handle reconnection of apps properly (21ce287)
• bug fix: race condition in messages to Core, that could result in messages being lost (5a92f26)
• bug: Quantel clips with no frames showed up as fullfilled (d986e09)
• don't update the PackageOnPackageContainer status in some situations where we don't actually know what state the package actually is in. (3b41749)
• ExpectationManager: minor updates to expectedPackages (such as priority changes) should not trigger full restarts of expectations (f7a3de9)
• file access errors doesn't need to include stack (eed5507)
• fine-grained priority of accessors (87f26c0)
• fix of potential bug where a throw might not be caught (0dc2753)
• handle unhandled promises (13a6f5a)
• improve how loss-of-connections are handled (60c74fb)
• improve stringifyError, to avoid "Error: [object Object]" in logs (9c9e888)
• in init() methods: wait for the 'connected' event being handled before finishing initializing (b767e0d)
• limit the number of times to re-try removing a Package upon fail (085c1d9)
• pass on certificates into spun-up workers (b565da5)
• quantel-http-transformer-proxy: When the proxied server returns non-200 codes, we should just pass through the responses (9e4fe3d)
• receivers will not time out if their methods are unresponsive. (b08c9ac)
• report various execution-times in getStatus (c03059f)
• type fix (092d368)
• WebsocketServer: track, emit and log 'error' and 'close' events (e3ba67f)
• Worker should remove a cancelled job right away, not wait for the work to actually finish (cd11a16)

1.37.0-alpha.1 (2021-11-05)

Bug Fixes

• better handling of when sending statuses to Core fails (5d5f532)
• don't try to send updates to core when disconnected, queue them to be sent upon reconnection instead (1749207)

1.37.0-alpha.0 (2021-11-05)

Bug Fixes

• add CLI option to multiply worker cost (3d4f131)
• add workforcePort CLI option for singleApp (aba69cb)
• bug fix: quantel clone by title didn't work at all (b502862)
• bug fix: undefined properties could mess with spread operator (b8bd22b)
• check for status change while ABORTING (b36c6e0)
• check if fileflowURL is set on accessor when selecting the best accessor (abca120)
• disable drive mapping when using FileFlow (7800b82)
• don't generate expectations for packages with no source or target (b6a45c2)
• expedite handling of RESTARTED & REMOVED (ff6ee72)
• Fileflow exports correctly created (b1f8547)
• fileflow only supports Quantel to File_Share (a79664d)
• guid / title may be set in Quantel Accessor (98dcb53)
• if a packages shows up multiple times (with different targets), side-effects are only needed for one of them (2e06d03)
• improve how REMOVED, ABORTED & RESTARTED states are set (7326a5f)
• improve logging for requestResources methods (8dd3b62)
• listen to errors from Koa (6f2cd1d)
• more forgiving comparison of resource/network ids (e3041df)
• Quantel: handle edge case when title of clip has been changed (e9d1dca)
• refactor and fix: use guid & title from content or accessor interchangeably (171b396)

Features

• add fileflow profile support for Quantel Fileflow copy (38cfbfa)
• implement Quantel Fileflow Copy expectation (3844534)
• refactor Quantel FileFlow to just be a special case within FileCopy [WIP] (853e7e3)

1.1.0-alpha.0 (2021-09-24)

Bug Fixes

• add fields to repost status: priority & prevStatusReasons (e805c61)
• add method for cleaning out packageContainerPackage statuses upon startup (d12c163)
• add methods to restart packageContainer monitors (6dda1bb)
• also spin up resources based on packageContainers, not just expectations (3dc6190)
• bug fix: expectationManager tried to always scale up (838a51b)
• bug fix: non-writeable packageContainers didn't get their statuses reported back to Core (f906d70)
• expectationManager: improve how expectation error-statuses are handled, better querying for available workers etc (757f853)
• send packageContainerPackage statuses on all statuses (190c9e5)

Features

• change how monitors are setup, lifetime etc. Add MonitorInProgress and report statuses of monitors and packageContainers back to Core (5cafa70)

1.1.1 (2021-09-30)

Bug Fixes

• add fields to repost status: priority & prevStatusReasons (e805c61)
• add method for cleaning out packageContainerPackage statuses upon startup (d12c163)
• add methods to restart packageContainer monitors (6dda1bb)
• also spin up resources based on packageContainers, not just expectations (3dc6190)
• bug fix: expectationManager tried to always scale up (838a51b)
• bug fix: non-writeable packageContainers didn't get their statuses reported back to Core (f906d70)
• bug fix: set the priority of the smartbull clip (b74f239)
• clarify priorities (8351e8b)
• expectationManager: improve how expectation error-statuses are handled, better querying for available workers etc (757f853)
• send packageContainerPackage statuses on all statuses (190c9e5)
• add option to delay removal of PackageInfo (64af17f)

1.1.0 (2021-09-28)

Bug Fixes

• better handling of timed out jobs (82bb9fc)
• bug fix: set the priority of the smartbull clip (b74f239)
• clarify priorities (8351e8b)

Features

• change how monitors are setup, lifetime etc. Add MonitorInProgress and report statuses of monitors and packageContainers back to Core (5cafa70)
• back-port release37-features onto release36 (e2955ec)

1.0.2 (2021-09-15)

Bug Fixes

• all handlers that handle http_proxy should also be able to handle http (feac6d7)
• previews should support the source-types file-share and http_proxy (982ff4f)