CHANGELOG.rst

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Version 1.10.0 (2024-11-04)

• Added: support for repositories on S3 and MinIO servers, using the minio backend of audbackend
• Changed: depend on audbackend>=2.1.0

Version 1.9.0 (2024-08-22)

• Added: pseudo-streaming support with audb.stream(), which returns the new audb.DatabaseIterator object. In each iteration it will load a few rows from a requested table and downloads corresponding media files
• Added: map argument to audb.load_table(), which behaves identical to the map argument of audformat.Database.get()
• Added: pickle_tables argument to audb.load(), audb.load_to() and audb.load_table() with default value of True. It can be used to disable storing tables as pickle files in cache/root folder
• Fixed: audb.load_table() now only loads additional misc tables, that are used as scheme labels inside the requested table, and not in the whole database

Version 1.8.0 (2024-07-10)

• Added: support for publishing tables as parquet files
• Changed: depend on audeer >=2.1.0
• Changed: depend on audformat >=1.2.0
• Changed: depend on pandas >=2.1.0
• Fixed: update progress bar at least every second in audb.load(), audb.load_attachment(), audb.load_media(), audb.load_tables(), audb.load_to(), audb.publish()
• Removed: support for Python 3.8

Version 1.7.4 (2024-06-25)

• Fixed: ensure correct data types in dependency table when loaded from a version in cache, stored by audb<=1.6.3

Version 1.7.3 (2024-06-04)

• Fixed: ensure correct data types in dependency table when loaded from cache
• Fixed: publishing an update of a database when the previous version was stored in cache by an older version of audb
• Fixed: loading of database attachments when audb.config.CACHE_ROOT and audb.config.SHARED_CACHE_ROOT point to the same folder
• Fixed: ensure audb.versions() does not fail when database is not available in a repository
• Fixed: loading of dependency table from cache when the previous version was stored in cache by a different pandas version

Version 1.7.2 (2024-05-16)

• Fixed: loading of dependency table from cache under Python 3.8, when stored by an older version of audb

Version 1.7.1 (2024-05-14)

• Fixed: require pandas>=2.0.1 for pyarrow based data types

Version 1.7.0 (2024-05-10)

• Added: experimental support for text files as media files
• Added: dependency on pyarrow
• Added: audb.Repository.backend_registry that maps repository names like artifactory to corresponding backend classes, e.g. audbackend.backend.Artifactory
• Added: audb.Repository.register() to add an entry to audb.Repository.backend_registry
• Added: audb.Repository.create_backend_interface() returns a backend interface to access files in the repository
• Changed: improve speed of loading dependency table to the cache. E.g. for version 1.0.0 of the database musan loading time is reduced by 35%
• Changed: improve speed of downloading a database to the cache. E.g. for version 1.0.0 of the database musan loading time is reduced by 40% when using 8 threads
• Changed: depend on audbackend>=2.0.0
• Changed: dependency table dataframe returned by audb.Dependencies.__call__() now uses pyarrow based data types
• Changed: dependency table is now stored as a PARQUET file on the backend, instead as a CSV file
• Fixed: audb.versions() for non-existing repositories
• Fixed: documentation of audb.Repository.__eq__()

Version 1.6.5 (2024-03-28)

• Added: audb.Dependencies.__eq__() to compare two dependency tables
• Fixed: let audb.available() skip incomplete datasets instead of raising an error

Version 1.6.4 (2024-02-23)

• Fixed: in audb.publish() updating of multi-file archives that have been published before the version given by the previous_version argument
• Fixed: speed up most methods of audb.Dependencies
• Fixed: dtype of the index of the data frame returned by audb.Dependencies.__call__() is now string instead of object

Version 1.6.3 (2024-01-30)

• Fixed: audb.versions() when audb.config.REPOSITORIES includes non-existing Artifactory repositories or Artifactory repositories without read access

Version 1.6.2 (2024-01-25)

• Changed: depend on audeer>=2.0.0
• Changed: speed up audb.versions()
• Fixed: pandas deprecation warnings
• Fixed: make documentation independent of the number of public datasets

Version 1.6.1 (2023-11-16)

• Fixed: accessing a database in any repository listed after a repository with access restrictions or a non-existing repository in audb.config.REPOSITORIES

Version 1.6.0 (2023-10-17)

• Added: support for new backend API
• Changed: depend on audbackend>=1.0.0

Version 1.5.2 (2023-09-26)

• Added: BibTeX reference to README
• Fixed: link to Artifactory anonymous access in the documentation
• Fixed: enforce reproducible order of media files entries in dependency table during publication

Version 1.5.1 (2023-05-04)

• Changed: require audeer>=1.20.0
• Fixed: audb.load(), audb.load_to(), audb.load_media(), and audb.remove_media() were failing with audeer==1.20.0 under Windows

Version 1.5.0 (2023-04-27)

• Added: support loading and publishing of database attachments (audformat.Attachment)
• Added: audb.load_attachment() to load a single attachment of a database
• Added: audb.info.attachments() to return the attachments entry of a database header
• Added: attachments argument to audb.load() to load only specific attachments of a database
• Changed: raise RuntimeError in audb.publish() if the file extension of a media file contains uppercase letters
• Changed: raise RuntimeError in audb.publish() if a table ID or attachment ID contains a character not in [A-Za-z0-9._-]
• Changed: raise ValueError in audb.publish() if version or previous_version are not conform to audeer.StrictVersion
• Changed: use emodb v1.4.1 for documentation examples
• Changed: require audbackend<1.0.0 as audbackend will introduce breaking changes
• Fixed: speed up audb.load_to() when loading databases with large tables using only_metadata=True

Version 1.4.2 (2023-02-13)

• Added: support for Python 3.10
• Added: document optional needed overwrite permissions for audb.publish() when continuing a canceled publishing command
• Changed: require audbackend>=0.3.17
• Changed: split API documentation into sub-pages for each function

Version 1.4.1 (2022-10-17)

• Changed: audb.load() and audb.load_to() extract archives in the corresponding database folder inside the audb cache instead of the system-wide temporary folder

Version 1.4.0 (2022-08-18)

• Added: support for audformat's newly introduced misc tables
• Added: audb.info.misc_tables()
• Added: load_tables=True argument to audb.info.header() and audb.info.schemes() specifying if misc tables used as labels in a scheme should be downloaded
• Changed: require audformat >=0.15.2
• Changed: use version 1.3.0 of emodb in the documentation examples
• Removed: support for Python 3.7

Version 1.3.0 (2022-07-14)

• Added: lock cache folder with a lock file when modifying it
• Added: verbose argument to audb.dependencies()
• Added: audb.info.files()
• Added: media and tables arguments to appropriate functions in audb.info sub-module
• Added: only_metadata argument to audb.load_to()
• Added: audb.publish() raises ValueError if previous_version is not smaller than version
• Changed: audb.publish() does not require unchanged media files to exists in database folder
• Changed: audb.load() raises ValueError if a table or media file is requested that is not part of the database
• Fixed: add missing exceptions to docstrings

Version 1.2.6 (2022-04-01)

• Changed: use emodb v1.2.0 for examples and tests
• Changed: depend on audobject>=0.5.0
• Changed: depend on audformat>=0.14.0
• Changed: depend on audeer>=1.18.0
• Fixed: depend on audbackend>=0.3.15 to avoid the possibility of an error when requesting versions of a database
• Fixed: add full Windows support and tests
• Fixed: only create tmp folder when needed in audb.load()
• Removed: include/exclude keyword arguments
• Removed: audb.get_default_cache_root()

Version 1.2.5 (2022-02-23)

• Fixed: make moving of local files Windows compatible
• Fixed: create folder tree more efficiently when loading to cache

Version 1.2.4 (2022-02-07)

• Changed: depend on audformat>=0.13.3
• Fixed: conversion of pickle protocol 5 files to pickle protocol 4 in cache

Version 1.2.3 (2022-02-01)

• Added: more examples to the API docstrings
• Changed: depend on audformat>=0.13.2
• Changed: use pickle protocol-4 for caching dependencies

Version 1.2.2 (2022-01-03)

• Fixed: small improvements to API documentation
• Fixed: speed up audb.load_to() storing of CSV files

Version 1.2.1 (2021-11-18)

• Fixed: build documentation inside the release process with Python 3.8

Version 1.2.0 (2021-11-18)

• Added: support for Python 3.9
• Added: store file duration of the database in the duration cache of audformat.Database
• Changed: audb.publish() now raises an error if a table contains duplicated index entries
• Fixed: several speed ups when loading or publishing a database
• Fixed: the root attribute of the returned database object from audb.load_to() does now point to the correct folder and not the temporal folder
• Removed: support for Python 3.6

Version 1.1.9 (2021-08-05)

• Added: name argument to audb.cached() to limit search to given database name
• Changed: speedup audb.available() by 100%
• Changed: use audiofile.duration(..., sloppy=True) for estimating durations for dependency files
• Fixed: audb.cached() for empty or missing shared cache

Version 1.1.8 (2021-08-03)

• Fixed: set bit_depth to 0 instead of None for non SND formats in the dependency table

Version 1.1.7 (2021-08-03)

• Fixed: store metadata in dependency table for non SND formats like MP3 and MP4 files

Version 1.1.6 (2021-07-29)

• Added: documentation sub-section on database duration info
• Fixed: made compatible with future versions of pandas
• Fixed: missing audb.Repository documentation

Version 1.1.5 (2021-05-26)

• Fixed: audb.load() raises now error for wrong keyword argument
• Fixed: look also in shared cache for partial loaded databases

Version 1.1.4 (2021-05-19)

• Fixed: version number shown in the documentation table of content

Version 1.1.3 (2021-05-18)

• Added: discussion of needed system packages for handling audio files in the documentation
• Changed: allow only to publish portable databases
• Fixed: macOS support by relying on new audresample version

Version 1.1.2 (2021-05-06)

• Added: audb.load_media()
• Added: audb.load_table()
• Added: documentation on how to configure access rights for shared cache folder
• Changed: speedup audb.Dependencies methods
• Changed: speedup audb.info functions
• Changed: audb.info uses cache as well
• Changed: use emodb 1.1.1 in documentation
• Changed: depend on audformat>=0.11.0
• Fixed: allow audb.load() to work offline if database is cached

Version 1.1.1 (2021-04-30)

• Fixed: update removal version of deprecated stuff to 1.2.0

Version 1.1.0 (2021-04-29)

• Added: audb.Dependencies._remove()
• Changed: audb.Dependencies internally uses pd.DataFrame instead of dict
• Changed: store dependencies with pickle to speed up loading
• Changed: versions of the same flavor share dependency file
• Changed: if possible audb.load() copies tables and media files from other versions in the cache
• Changed: audb.Dependencies._add_media() is now private
• Changed: audb.Dependencies._add_meta() is now private
• Changed: audb.Dependencies.is_removed renamed to audb.Dependencies.removed
• Fixed: audb.load() considers format when searching the cache
• Fixed: audb.load() considers format when resolving missing media
• Fixed: audb.available() correctly returns versions of the same database from multiple repositories
• Fixed: add missing link to emodb example repository
• Removed: audb.Dependencies.data

Version 1.0.4 (2021-04-09)

• Changed: audb.Dependencies.bit_depth() now always returns an integer
• Changed: audb.Dependencies.channels() now always returns an integer
• Changed: audb.Dependencies.duration() now always returns a float
• Changed: audb.Dependencies.sampling_rate() now always returns an integer
• Fixed: audb.info.duration() for databases that contain files with a duration of 0s
• Fixed: remove dependency to fire package

Version 1.0.3 (2021-04-08)

• Fixed: docstring of audb.exists() falsely claimed that it was not returning a boolean
• Fixed: several typos in documentation

Version 1.0.2 (2021-04-07)

• Fixed: renamed latest_only argument of audb.available() to only_latest as it was before

Version 1.0.1 (2021-04-07)

• Fixed: appearance of documentation TOC by requirering docutils<0.17

Version 1.0.0 (2021-04-07)

• Added: first public release
• Added: audb.info.author()
• Added: audb.info.license()
• Added: audb.info.license_url()
• Added: audb.info.organization()
• Added: audb.Dependencies.archives property
• Added: section on publication in the documentation
• Added: introduction texts to documentation
• Changed: raise error for conversion of non-supported format
• Changed: audb.exists() to return bool
• Changed: rename audb.lookup_repository() to audb.repository()
• Changed: one combined section on load in the documentation
• Fixed: data types in dataframe returned by audb.cached()
• Fixed: support files stored in archives with nested folders
• Fixed: listing of cache entries
• Removed: command line interface
• Removed: audb.cached_databases()
• Removed: audb.define module

Version 0.93.0 (2021-03-29)

• Added: complete column in audb.cached()
• Added: previous_version argument to audb.publish()
• Added: backward compatibility with audb <0.90
• Changed: cache flavor path to name/version/flavor_id
• Changed: use open source releases of audbackend, audobject, and audresample
• Changed: require audformat>=0.10.0
• Changed: rename audb.load_original_to() to audb.load_to()
• Changed: shorten flavor ID in cache
• Changed: filter operations and only_metadata no longer part of audb.Flavor
• Deprecated: include and excldue arguments
• Fixed: looking for latest version across repositories
• Fixed: Flavor.destination for nested paths
• Fixed: allow for cross-backend dependencies for audb.publish()
• Fixed: audb.remove_media() can now be called several times

Version 0.92.1 (2021-03-19)

• Changed: enforce mixdown=False for mono file flavors
• Fixed: global config file was missing in PyPI package

Version 0.92.0 (2021-03-09)

• Added: configuration file
• Changed: use external package for backend implementations

Version 0.91.0 (2021-02-19)

• Added: audb.Backend.latest_version()
• Added: audb.Backend.create()
• Added: audb.Backend.register()
• Added: audb.lookup_repository()
• Added: config.REPOSITORY_PUBLISH
• Fixed: update fire dependency
• Fixed: remove config.GROUP_ID
• Fixed: use sphinx>=3.5.1 to fix inherited attributes in documentation

Version 0.90.3 (2021-02-01)

• Changed: define data types when reading dependency file

Version 0.90.2 (2021-01-28)

• Added: data-provate-local to the default repositories

Version 0.90.1 (2021-01-25)

• Fixed: CHANGELOG

Version 0.90.0 (2021-01-22)

• Added: initial release