Skip to content

Latest commit

 

History

History
3194 lines (2879 loc) · 142 KB

CHANGELOG.md

File metadata and controls

3194 lines (2879 loc) · 142 KB

Release notes for project op-worker

CHANGELOG

21.02.8

  • VFS-12482 Web GUI: Improved UX of file and share IDs presentation in file details panel.
  • VFS-12477 Greatly optimized the listing of Shares in GUI; both the Space's and global view of Shares are now based on an infinite-scroll mechanism.
  • VFS-12469 Web GUI: Improved UX of managing share name and Open Data title; disabled some operations when user has insufficient privileges for space shares.
  • VFS-12418 Improved error handling for S3 storages.
  • VFS-12370 Web GUI: Changed default views which are opened using tabs, remembering last used resource (eg. space), improved look of main views loading indicators and added "recently used" space icons.
  • VFS-12277 Web GUI: Changed "basic metadata" naming to "xattrs metadata" (extended attributes) to better differentiate with other custom metadata types (JSON, RDF).
  • VFS-12268 Enabled support for read-only and interface caveat tokens in OneS3.
  • VFS-10787 Added a circuit breaker mechanism that disables Oneprovider services when the database is close to running out of disk space.
  • VFS-10341 Web GUI: Upgraded EmberJS to v3.16.

21.02.7

  • VFS-12295 Web GUI: Fixed issues with opening share views without some privileges and when filea had been deleted.
  • VFS-12284 Web GUI: Improved GUI for Europeana Data Model: updated metadata specification, added more validators, improved UX.
  • VFS-12050 Web GUI: Added support for customizable extended attributes (xattrs) columns in file browser.

21.02.6

  • VFS-12239 Web GUI: Automatically filling-in the EDM file size property on metadata creation and modification.
  • VFS-12232 Web GUI: Improved UX of Europeana Data Model editor.
  • VFS-12198 Web GUI: Added public download URL to file details panel for shared files.
  • VFS-12197 Web GUI: Improved share list views.
  • VFS-12195 The name of the handle service where an Open Data handle has been registered is now publicly visible and always displayed on the Share view.
  • VFS-12060 Storage backends are now monitored and when failure is detected access to the supported spaces is blocked.
  • VFS-12049 Web GUI: Added File ID column in file browser.
  • VFS-12012 Web GUI: Added Permissions column in file browser.
  • VFS-12001 Web GUI: Added available users list inferring in the ACL view entity selector when user lacks some privileges in the space.
  • VFS-11948 Web GUI: Added Creation time and Access time columns in file browser.

21.02.5

  • VFS-11999 Improved listing objects on S3 storages during data import.
  • VFS-11979 Web GUI: Fixed ACL editor view crash when user has no space view privilege in the space. It is now possible to choose groups that the user belongs to in the ACL editor and as input to workflow stores, regardless of the user's privileges in the space.
  • VFS-11970 Web GUI: Added support for editing already published Open Data metadata.
  • VFS-11945 Automation: Added support for new group data type.
  • VFS-11923 Web GUI: Renamed privilege group names in the ACL editor: "General" to "Deletion" and "Data" to "Content".
  • VFS-11912 Web GUI: Added visual editor for Open Data metadata in Europeana Data Model format.
  • VFS-11904 Implemented storage specific health check, to check and monitor storage availability.
  • VFS-11876 Allow rtransfer storage parameters change without the need for rtransfer restart.
  • VFS-11761 Web GUI: Improved user experience in publishing share as Open Data.
  • VFS-11731 Web GUI: Fixed unexpected scroll down of file list after closing file details panel.
  • VFS-11726 Web GUI: Fixed items selection in archives browser after using breadcrumbs menu.
  • VFS-11712 Integration of Onedata and the Galaxy project; added a driver to Galaxy enabling the use of Onedata as a so-called "Object Store" --- this way, datasets in Galaxy can be stored in a Onedata space.
  • VFS-11710 Web GUI: added possibility to embed Onedata Web application into an iframe hosted on site with domain other than Onezone.
  • VFS-11707 Web GUI: Detecting web browser extensions potentially interfering with Onedata GUI.
  • VFS-11625 Extended functionality of runtime storage parameter updates to all storage backends.
  • VFS-11607 Web GUI: Improvements of the ACL editor in the file browser: detection of ACL rules forbidding permissions modification, better descriptions and hints about settings, and numerous minor User Experience tweaks.
  • VFS-11594 Web GUI: Fixed QoS query builder "Add" button out-of-the-screen placement.
  • VFS-11566 Web GUI: Fixed issues with show/download link to space root directory.
  • VFS-11536 Web GUI: Added "Changed (metadata)" (ctime) column to the file list.
  • VFS-11487 Web GUI: Added QoS and Replication columns to the file list. Reworked the file attribute fetching mechanisms to fetch only the required attributes.
  • VFS-11443 Automation: Added support for resolving only subset of selected file attributes for lambda invocation.
  • VFS-11365 Improvements to Open Data publishing and the OAI-PMH protocol implementation. Added support for Europeana Data Model metadata type. Improved the metadata editor in UI (both the visual and XML forms). Improved the conformity to OAI-PMH protocol spec and added support for optional functionalities. Added an HTTPS endpoint (next to previously supported HTTP).
  • VFS-11080 Web GUI: Fixed share disappearing from the list after delete failure.
  • VFS-10910 Reworked REST API endpoints used to retrieve file attributes (get attributes, list, list recursively). Options are now accepted as JSON body rather than in query string, some attributes were renamed, and the list of available ones has been extended. The old behaviour was retained as deprecated and scheduled for discontinuation in the future major release.
  • VFS-10265 Changes to user spaces (changing space name, joining/leaving a space) are now reflected in Oneclient in real time. Added support for spaces with the same name in Oneclient - in case of an ambiguity a space name is extended with its ID.
  • VFS-9157 Web GUI: Added support for advanced file info in file selector panel.
  • VFS-8554 Web GUI: Fixed uploading files to wrong directory after changing directory via URL.

21.02.4

  • VFS-11601 Web GUI: Fixed showing ACL when a subject user or group has been removed from space members list.
  • VFS-11513 Web GUI: Fixed rare issue when file browser list was not refreshed after deleting files.
  • VFS-11459 Added option to set custom region in S3 storage helper.
  • VFS-11405 Web GUI: Added columns drag&drop to change their order in transfers table.
  • VFS-11366 Improvements to directory size statistics; hard link sizes are now counted without duplicates toward virtual size (as opposed to logical size), archives are counted toward the space data size and presented in the UI.
  • VFS-11282 Added possibility to download automation store's content as a JSON file.
  • VFS-11268 Web GUI: Fixed a rare file list crash when the list is being refreshed simultaneously with deleting files.
  • VFS-11242 Web GUI: added showing separate directory size statistics of archives and directories in the space root.
  • VFS-11210 Fixed a bug with S3 storage backend config modification, causing wrong validation of the endpoint.
  • VFS-11125 Web GUI: Added columns drag&drop to change their order in file, dataset and archive browser.
  • VFS-10999 Added the public "infer access token scope" endpoint, which analyses the provided access token to infer the scope of data access the token can be used for.
  • VFS-10649 Web GUI: added complex charts dashboard editor to the automation GUI.

21.02.3

  • VFS-11231 Refactored oneclient connection pool to improve stability.
  • VFS-11220 Fixed handling of handshake error in oneclient.
  • VFS-11106 Refactored Oneclient-Oneprovider connection layer for improved resilience to network failures.
  • VFS-11100 Web GUI: Added support for global URLs to files for authenticated users.
  • VFS-10974 Automation: Added debug logs about items processing. They include traceId field allowing to correlate them and find corresponding items in exception store.
  • VFS-10962 Web GUI: Improved WebSocket auto-reconnect after connection lost (e.g. on system suspend).
  • VFS-10932 Added possibility to choose logging level during workflow execution scheduling.
  • VFS-10895 Added detailed specification of needed file properties in "file" automation type, including narrowing file properties set passed to lambda functions during automation workflow exectution.
  • VFS-10859 Fixed random crash in Oneclient related to events streaming.
  • VFS-10637 Web GUI: Added support for modifying order of columns in file, archive and dataset browsers.
  • VFS-10157 Web GUI: Added ID sufixes to workflow execution names to improve readability.
  • VFS-9052 Web GUI: Improved directory load error handling in file browser (eg. no such directory).

21.02.2

  • VFS-10996 Web GUI: Fixed effective protection badges in file dataset panel to be updated after ancestor protection change.
  • VFS-10928 Fixed bug in truncate for object storages with random write access, which caused not deleting data above the truncate threshold within the last object boundary.
  • VFS-10825 Web GUI: Fixed unnecessary scrollbars in Safari.
  • VFS-10824 Web GUI: Fixed file browser crash when entering share root using breadcrumbs.
  • VFS-10803 Web GUI: Fixed polling for file infinitely if moving or copying fails.
  • VFS-10692 Web GUI: Redesigned actions available in various context menus of file, dataset and archive browser.
  • VFS-10612 Add a journal that records the starts and shutdowns of services and procedures that help to ensure the graceful stopping of services.
  • VFS-10601 Web GUI: Added columns visibility configuration in file browsers.
  • VFS-10461 Web GUI: Added auto-update of files, datasets and archives lists accomplished using polling.
  • VFS-10411 Web GUI: Added support for incomplete infinite scroll listing chunks from backend. It increases stability of file browser GUI.

21.02.1

  • VFS-10754 Web GUI: Fixed file list crash after jumping to the end and deleting last file.
  • VFS-10622 Added scalable S3 server interface implementation based on Oneclient.
  • VFS-10546 Removed transfer charts padding when viewing them on remote providers.
  • VFS-10540 Ported rtransfer fixes with better error recovery and handling from develop to stable branch 20.02.
  • VFS-10531 Web GUI: Added support for enum-like data types in automation (list of allowed values for string and number types).
  • VFS-10502 Added option to null device enabling verification of whether read data matches written data based on offset and size of request, which can be used to test for instance transfer data consistency.
  • VFS-10414 Web GUI: Fixed displaying wrong names of spaces in shares sidebar.
  • VFS-10397 Fixed rtransfer link error propagation issues, which sometimes result in hanging transfers.
  • VFS-10389 Web GUI: Added showing data per provider in directory statistics.
  • VFS-10387 Blocked setting metadata_protection without data_protection.
  • VFS-10358 New archive privilege in space - manage archives. It is required for modifying other user's archives metadata (like description) as well as cancelling them. Those operations can be always performed on owned archives (even without this privilege). Manage dataset privilege is no longer required for archive operations.
  • VFS-10357 Web GUI: Added support for "manage archives" privilege and "creator" information in archives.
  • VFS-10312 Web GUI: Changed name conflict and disambiguation separator from # to @.
  • VFS-10283 Web GUI: Added possibility to delete, rename and move hardlink to file that is inside data-protected directory and is not data-protected itself.
  • VFS-10264 Added parameter to oneclient handshake protocol to distinguish between different oneclient modes of operation.
  • VFS-10222 Web GUI: Fixed starting multiple files replication/migration/eviction.
  • VFS-10216 Refactored transfer data source traversal and statistics counting so that only regular files would be counted.
  • VFS-10174 Fixed possible crash in the nulldevice helper when simulating large filesystems for importing to data space.
  • VFS-10149 It is no longer required to have SPACE_MANAGE_QOS space privilege in order to evaluate QoS expression.
  • VFS-10134 Improved statistics initialization error handling.
  • VFS-10129 Web GUI: Added global and per-lane chart dashboards in automation workflows.
  • VFS-10128 Web GUI: Added possibility to map a lambda result to many stores in an automation task definition.
  • VFS-10126 Web GUI: Added Space Marketplace - space configuration, spaces browser and membership requests resolver views.
  • VFS-10118 Web GUI: Introduced GUI for automation lambda parameters.
  • VFS-10046 Web GUI: Added user details popovers with user information in various views.
  • VFS-10037 Web GUI: Added "rate" and "timeDerivative" time series chart functions.
  • VFS-9999 Web GUI: Added space details popovers with space information in various views.
  • VFS-9985 Added garbage collector periodically removing old automation workflow executions.
  • VFS-9946 Web GUI: Added filename hashes for distinguishing files in audit logs.
  • VFS-9905 Web GUI: Showing error reason when transfer progress cannot be loaded.
  • VFS-9902 Web GUI: Fixed GUI crash when very long file path is shortened.
  • VFS-9849 Changed stopped status of interrupted automation workflow execution with uncorrelated results to failed instead of interrupted.
  • VFS-9846 Added automation workflow executions graceful stopping (pausing all running executions) procedure to Oneprovider stopping mechanism.
  • VFS-9843 Web GUI: Improved UX of action button in file info views.
  • VFS-9801 Web GUI: Added more detailed file counters in transfers view.
  • VFS-9800 Web GUI: Fixed missing owner name in file details and added "Owner" column in file browser (on wide screens).
  • VFS-9786 Web GUI: Improved UX of file info permissions tab by adding hints and disabling modifications when it is not permitted.
  • VFS-9781 Web GUI: Storage locations are no longer shown in shared file info.
  • VFS-9723 Web GUI: Fixed error message when removing dataset.
  • VFS-9710 It is now possible to specify that archive should be deleted after cancelation.
  • VFS-9709 Web GUI: Added Open Data tag to items on file list if file is published as Open Data.
  • VFS-9671 Improved monitoring of OpenFaaS cluster health for workflow execution purposes.
  • VFS-9655 Web GUI: Added presentation of directories data distribution.
  • VFS-9637 Web GUI: Improved and unified look of audit log browsers.
  • VFS-9626 Web GUI: Improved UX of file info tabs.
  • VFS-9622 Upgraded the base image for release dockers from Ubuntu 18.04 to Ubuntu 20.04.
  • VFS-9614 Web GUI: Added archivisation audit log view.
  • VFS-9611 Web GUI: Added showing current directory statistics above historical data charts.
  • VFS-9606 Web GUI: Moved file QoS settings from separate modal to file info panel.
  • VFS-9604 Web GUI: Moved file metadata settings from separate modal to file info panel.
  • VFS-9603 Web GUI: Moved file shares settings from separate modal to file info panel.
  • VFS-9602 Web GUI: Moved file permissions settings from separate modal to file info panel.
  • VFS-9589 Extend time series with information about measurements ranges.
  • VFS-9534 Added Content-Disposition headers to the file download REST endpoint.
  • VFS-9531 Web GUI: Improved UX of the automation stores browser.
  • VFS-9513 Web GUI: Added file path tooltip to file event in QoS audit log.
  • VFS-9473 Web GUI: Moved file distribution settings from separate modal to file info panel.
  • VFS-9471 Added endpoint for retrievieng regular file location on storages.
  • VFS-9420 Directory statistics and file/directory data distribution is now presented in GUI from the point of view of each supporting provider.
  • VFS-9418 Added accountingEnabled and dirStatsServiceEnabled settings for space support.
  • VFS-9342 Added automation task execution Id annotation to function registered in OpenFaaS service.
  • VFS-9339 Web GUI: Added a new file info tab with REST API samples.
  • VFS-9337 Implemented first version of "filePipe" relay method for automation lambdas, allowing streaming of results via a file located inside the container where the lambda is executed.
  • VFS-9235 Web GUI: added an input field in file browser for scrolling the list to a file or directory using its name prefix.
  • VFS-9207 Web GUI: Enforced loading fonts from server to avoid incorrect local fonts in browser.
  • VFS-9200 Changed name generation algorithm for functions registered in OpenFaaS so that they are unique for each task (previously if tasks used the same lambda only one function was registered).
  • VFS-9164 Web GUI: Added support for cancelling archive creation.
  • VFS-9162 Web GUI: Added API samples modal for space.
  • VFS-9129 Web GUI: Upgraded EmberJS to v3.8.
  • VFS-9122 It is now possible to enable directory size and capacity statistics collection. Thanks to this, size of directory and number of files/directories in subdirectories can be viewed as well as how this values change in time.
  • VFS-9120 Fixed uid/gid encoding to use unsigned int32 rather than signed int32, so that it now aligns with POSIX uid_t and gid_t types.
  • VFS-9104 It is now possible to list extended attributes along with file attributes in REST API.
  • VFS-9054 Improved connection closing in Oneclient.
  • VFS-9051 Added new files endpoint which allow to list all non-directory files (i.e regular files, symbolic links and hardlinks) in given top directory recursively. Files are listed lexicographically ordered by path.
  • VFS-9036 Web GUI: Added showing time series charts in executed automation workflows.
  • VFS-9028 Web GUI: added archive properties modal with support for changing archive description.
  • VFS-9026 Added option --message-trace-log to enable logging of protobuf messages with the server.
  • VFS-9023 Web GUI: added "stop recall" feature and improved presentation of remote provider recall process.
  • VFS-9022 It is now possible to cancel ongoing archive recalls.
  • VFS-9021 Web GUI: added recall error log view.
  • VFS-9019 Added support for automation time series store.
  • VFS-8987 Web GUI: Fixed Safari animation glitches.
  • VFS-8951 Extended directory children listing REST API - additional parameter 'attribute' can now be provided to specify one or more attributes to be included for each entry. Additionally, when there is more entries to be listed, the operation returns a 'nextPageToken' that can be used to list the subsequent page of results.
  • VFS-8948 Introduced the concept of time series dashboard specs - structured recipes for transforming and displaying measurements in charts, which can be organized into sections. Each time series collection has a linked dashboard spec that will be used for rendering the dashboard in GUI.
  • VFS-8935 Allow enabling statistics collecting for not empty spaces.
  • VFS-8914 Web GUI: redesigned and extended file datasets panel.
  • VFS-8903 Web GUI: Upgraded EmberJS to v3.4.
  • VFS-8887 Web GUI: fixed showing file information modal in shares.
  • VFS-8845 Added QoS transfer statistics collection with their preview in GUI. Each QoS requirement is associated with several time series concerning transferred bytes and files in the context of different storages.
  • VFS-8836 It is now possible to cancel ongoing archivisation.
  • VFS-8823 Fixed improper destruction of OnedataFS instances, resulting in possible deadlocks during deletion of the OnedataFS object.
  • VFS-8817 Added multisupport to NFS helper allowing handling of multiple NFS volumes in parallel via a single NFS helper for data import.
  • VFS-8814 Disable NFS direct io in oneclient on conda.
  • VFS-8788 Added the possibility to handle multiple mountpoints by a single POSIX helper in read only mode.
  • VFS-8783 Web GUI: fixed inability to list files of nested archive.
  • VFS-8739 Web GUI: fixed double listing of dataset items when their names have the same prefixes.
  • VFS-8716 Web GUI: Added complex data types editor to the automation views.
  • VFS-8663 Improved symbolic links resolution behaviour - now, the option to resolve symbolic links (e.g. during an archive creation or directory download) only applies to symbolic links pointing to paths outside of the dataset/directory.
  • VFS-8654 Web GUI: added support for symbolic links in an archive pointing outside it.
  • VFS-8653 Web GUI: added "follow symbolic links" option in create archive options.
  • VFS-8616 Added monitoring of statuses of Kubernetes pods that are deployed during workflow execution using the OpenFaaS platform. Monitoring is performed by the k8s-events-monitor component and reported to the scheduling Oneprovider. Added preview of pod status changes in GUI for each workflow task.
  • VFS-8598 Web GUI: improved presentation of state of archives being built and deleted.
  • VFS-8523 Information about files count and size in directory added.
  • VFS-8518 Web GUI: unlocked possibility to create a hardlink for symlink.
  • VFS-8483 Added direct NFS v3 storage helper.
  • VFS-8478 Preserved archives are now protected from any modifications. Before archive is marked as preserved its content is verified to ensure that no modifications have been made during its creation.
  • VFS-8425 Added basic cookie support to HTTP storage helper to support OAuth redirect authorization.
  • VFS-8405 Web GUI: fixed QoS modal errors when a hardlink for viewed file with QoS requirements has been deleted.
  • VFS-8404 Failed lanes are now retried up to specified max retries (given in schema definition).
  • VFS-8348 Web GUI: added links to transferred files on transfers view and information about their membership in archive and dataset.
  • VFS-8318 Fixed conda packaging for oneclient and onedatafs, switched dependencies to conda-forge channel.
  • VFS-8288 It is now possible to specify requested resources and resource limits on the lambda and task level for OpenFaaS functions.
  • VFS-8281 Improved file upload mechanisms to better handle clients with very slow network connections.
  • VFS-8250 Exceptions returned from user defined lambda OpenFaaS functions are now properly handled and saved to lane exception store.
  • VFS-8247 Added new option to harverster's indices that allow for harvesting details about archives (archiveId, archiveDescription and archiveCreationTime).
  • VFS-8242 Upgraded Oneclient to use Fuse 3 by default.
  • VFS-8240 Applied fixes suggested by new version of clang-tidy static C++ code analyzer.
  • VFS-8237 Updated C++ clang-format version to 12.
  • VFS-8225 Lanes are now created right before their execution rather than alltogether at the start of workflow execution.
  • VFS-8172 Add /health endpoints to REST APIs of all services.
  • VFS-8073 Upgrade folly, wangle and proxygen libraries to version 2021.01.04.00.
  • VFS-8045 Web GUI: added QoS audit log view.
  • VFS-8041 Added basic log entries to workflow execution and task execution audit logs.
  • VFS-8033 Introduced the possibility to pause and resume executions. Refined the phases of workflow execution and granularity of statuses on lane/parallel box/task levels.
  • VFS-8018 Added HTTP storage driver option to limit on the client side maximum number of requests per single session, after which the session is closed and reconnected.
  • VFS-7976 Ported oneclient communicator async event stream implementation from asio to folly IOThreadPoolExecutor.
  • VFS-7975 Added possibility to cancel running automation workflow.
  • VFS-7960 Fixed navigating through multiple spaces during files upload in GUI.
  • VFS-7947 Added possibility to run workflows directly from file browser.
  • VFS-7930 Web GUI: improved UX of creating incremental archives using archive context menu.
  • VFS-7904 Add system audit log for each workflow execution and each task in the execution, with the possibility to append custom logs during lambda execution (using the result mappers).
  • VFS-7898 Web GUI: added self-shortening links to files with support for files inside archives.
  • VFS-7892 Improved write performance on object storages by minimizing the number of memory copying from Erlang to C++.
  • VFS-7880 Introduce the concept of automation; tools for defining and executing automated workflows, made up of lambdas that are submitted to a local OpenFaaS platform. These functionalities currently have experimental status.
  • VFS-7863 Web GUI: Fixed file download in iOS Safari.
  • VFS-7856 Web GUI: added support for uploading, creating directories and renaming files in files selector.
  • VFS-7846 Added action "Upload BagIt" to file browser, which is available when OpenFaaS and special "BagIt uploader" workflow are available.
  • VFS-7817 GUI improvements in automation GUI: added navigation via URL to specific execution, creating stores during task and lane creation, showing inventory name for each execution entry.
  • VFS-7808 Added support for symbolic links resolution during TAR download. By default all symbolic links are resolved.
  • VFS-7796 Added support for navigating through symlinked directories without changing active directory path.
  • VFS-7780 Added support for creating incremental archives, which results in storing only files that have changed in comparison to the base archive while unchanged files are preserved as hard links to the corresponding files in the base archive.
  • VFS-7779 Added REST API for CRUD operations on file using relative paths.
  • VFS-7747 Upgrade the codebase to Erlang OTP 24.
  • VFS-7738 Fixed issues with navigation between datasets, archives and archive files browsers.
  • VFS-7736 Fixed latency and timeout simulation in nulldevice storage helper.
  • VFS-7728 Introduced versioning of lambdas and workflow schemas. Users may create subsequent revisions of the above models and modify their statuses (draft, stable, deprecated) to simplify management and retain backward compatibility of definitions that are already in use.
  • VFS-7724 Web GUI: redesigned datasets and archives browser to browse datasets tree and archives in single splitted view.
  • VFS-7705 Added more file actions to archive file browser GUI: share, metadata, permissions read, data distribution and quality of service.
  • VFS-7702 Add basic REST API for scheduling and retrieving workflow executions.
  • VFS-7692 Added stopped automation workflow execution discard functionality.
  • VFS-7664 It is now possible to configure symbolic links policy when creating an archive. By default symbolic links in dataset are resolved resulting in link target being archived.
  • VFS-7653 Added support for creating Dissemination Information Package (DIP) alongside with Archival Information Package (AIP).
  • VFS-7651 Implement dataset archivization with BagIt layout.
  • VFS-7649 Added support for purging archives in GUI.
  • VFS-7648 Added Web GUI views for browsing and creating datasets and archives.
  • VFS-7633 UX improvements in web GUI concerning navigation between files, datasets and archives using hyperlinks.
  • VFS-7631 Web GUI: added presentation of source file path in dataset browser.
  • VFS-7629 Web GUI: added new datasets panel with archives browser in file browser.
  • VFS-7617 Implemented archive recall functionality, used to copy the archive contents to a specified destination within the space scope.
  • VFS-7592 Added support for the Range header during directory or multi file (bulk) downloads, making it possible to resume them in case of interruption or network failure.
  • VFS-7589 Added StorageRouter and BufferedStorage helpers to handling of aggregate storages such as archive storage.
  • VFS-7575 Add the possibility to incorporate an XRootD server within the Onedata environment for exposing Open Data collections for public access using the XRootD protocol.
  • VFS-7512 Web GUI: redesigned file tags with information about inherited QoS and datasets properties.
  • VFS-7510 Add API for browsing dataset structures, separately for datasets in attached and detached state. The datasets can be listed using batches of requested size, with desired starting point and offset.
  • VFS-7486 Added option to nulldevice helper allowing control of file size returned by getattr in simulated file systems.
  • VFS-7429 Implemented the concept of datasets. Datasets allow the space users to organize their data into collections with desired granularity. A file or directory marked as a dataset offers additional features, such as optional data and metadata protection or the ability to create persistent snapshots of the physical dataset contents. In case of a directory, a dataset covers all its subdirectories and files. Datasets can be nested, allowing users to compose arbitrary hierarchical structures. Added corresponding views for managing datasets and write protection flags in file browser Web GUI and a REST API, accessible under /datasets, /datasets/{DatasetId} and /data/{FileId}/dataset/summary paths.
  • VFS-7428 Added support for hard links and symlinks. Added corresponding REST api specific for hard and symbolic links, accessible under /data/{FileId}/hardlinks and /data/{FileId}/symlink_value paths.
  • VFS-7378 Removed deprecated Oneprovider REST API. The modern API, available since versions 20.02.*, operates on file IDs rather than paths. A special endpoint for resolving file IDs based on paths is available.
  • VFS-7351 It is now possible to download directories and multiple files via gui as a compressed TAR archive.
  • VFS-7329 Added automation GUI - inventories, lambdas and workflows views in Onezone and workflows execution overview in Oneprovider.
  • VFS-7305 Basic support for hard links and symbolic links on the filesystem level, interaction with high-level mechanisms such as data transfers, storage import or QoS is still to be refined.
  • VFS-7304 Add preliminary REST API for dataset archivization - to be extended in near future.

20.02.19

  • VFS-9926 Web GUI: Opening Oneprovider view in Onezone GUI when entering Oneprovider domain.
  • VFS-9730 Improve handling of api caveats related to API operations concerning other components than Onezone - in some cases, tokens with such caveats could be treated as invalid.
  • VFS-10012 Web GUI: Fixed hanging file upload bug when multiple uploads have been scheduled.

20.02.18

20.02.17

  • VFS-9415 Improved display of sensitive storage config details in Onepanel GUI to show censored values instead of hiding them completely.

20.02.16

  • VFS-9119 Introduced a temporary fix for uid/gid encoding of values outside of signed int32 range - the values are trimmed to the value of 2,147,483,646 for displaying in Oneclient. Full support for unsigned int32 range (in alignment with POSIX uid_t and gid_t types) will be introduced in the next major release.
  • VFS-9118 Import ignores other file types than regular and directories (i.e., fifo, symlink).
  • VFS-8939 Fixed a bug related to path caveats in access tokens, where a Oneclient user would see the names of newly created files/directories outside of the allowed paths (but was not able to access them).
  • VFS-8828 Fixed conda packages for the stable branch 20.02.*, starting with version 20.02.15 and Python 3.9.

20.02.15

20.02.14

  • VFS-8482 Added dedicated page for privacy policy content.

20.02.13

  • VFS-8335 Fix a regression in proxied access to spaces (ones not supported by the Oneprovider serving the request) causing false ENOENT errors.
  • VFS-8212 Web GUI: fixed not working current directory rename.

20.02.12

20.02.11

  • VFS-8017 Added support for allowing setting of UID and GID in the admin context on the POSIX storage to be other than 0:0.

20.02.10

  • VFS-7739 Improved CPU affinity of storage driver threads in Oneprovider.

20.02.9

  • VFS-7579 Implement simple, automatically rotated file access audit log, which can be optionally enabled in Oneprovider config.

20.02.8

  • VFS-7517 Several bug fixes related to edge-cases when moving or deleting files.

20.02.7

  • VFS-7294 Added publicly available REST endpoints for fetching information and data of shared files/directories. The data-related endpoints are offered by Onezone, which redirects to a suitable Oneprovider so that a guest user does not need any knowledge of the environment to access the data. Improved the Web GUI's shares view to present the public endpoints in an easy-to-use manner.
  • VFS-7276 Improved handling of startup errors in Oneclient, including more graceful handling of various exceptions and more informative error messages including Oneclient and Oneprovider compatibility and invalid token issues.
  • VFS-7271 Fixed displaying shared space root directory name in GUI.
  • VFS-7165 Add a workaround for Erlang's SSL implementation that would not reload server certificate chain when it is changed (e.g. after Let's Encrypt certificate regeneration).
  • VFS-6566 Improved UX and fixed minor issues in share views. Fixed inability to open share hosted by Oneprovider 19.02.x using Onezone 20.02.x.
  • VFS-6289 Add support for ANONYMOUS@ principal to ACL.

20.02.6

  • VFS-7182 Storage name no longer needs to be unique.
  • VFS-6928 Fixed possible deadlock in massive parallel truncate operations on Ceph pools, which could've affected replica eviction and delete operations.
  • VFS-6802 Added visual QoS expression editor with live matching storages evaluation.

20.02.5

  • VFS-7129 Improved connection pool management for HTTP storages, including minimized reconnections and DNS caching.
  • VFS-7113 Fixed original timestamp preservation during `cp --preserve=times` or `rsync --times` commands.
  • VFS-7058 Handling detached shares after files or directories removal in GUI.
  • VFS-7047 Fixed possible race when using buffered helper to write to storage which fails after the file size has been updated.
  • VFS-6999 Improve error reporting in entrypoints of oneprovider/onezone dockers, always dump application logs to stdout in case of failures during batch deployment.
  • VFS-6745 Added new view with token templates in tokens creator GUI.

20.02.4

  • VFS-7003 Added new counters presenting progress of current/last finished scan of the storage import mechanism - number of all processed files (`Processed files`) and the total number of files residing on the storage during the scan (`Total storage files`).
  • VFS-6958 Added new endpoint that checks correctness of a QoS expression and returns the list of storages that match the expression.
  • VFS-6940 Fix truncating of sparse files.
  • VFS-6891 Added new REST api for file deletion, uploading and downloading in both normal mode and share mode, accessible under `/data/{fileId}` path.
  • VFS-6841 Introduce unified time management in all Onedata components - all clusters now regularly synchronize their clocks with the Onezone service, the process is managed by Onepanel's master node.
  • VFS-6687 Blocked file path resolutions for unsupported spaces.

20.02.3

  • VFS-6967 Fixed not visible JSON and RDF metadata editors in GUI in Safari.
  • VFS-6927 Optimize file blocks management to decrease memory usage.

20.02.2

  • VFS-6925 Fixed inability to scroll down files list in Firefox on macOS using HiDPI display.
  • VFS-6853 Matching session cookie is now required to verify a GUI access tokens (they are used behind the scenes by the Onedata web applications), which increases security.
  • VFS-6851 Fixed a security issue in Oneprovider share GUI.
  • VFS-6845 Prevent application from stopping until all documents are correctly persisted in order to improve resistance to temporary database errors.
  • VFS-6746 Added available QoS parameters suggestion box in QoS expression editor.
  • VFS-6732 New JSON and RDF metadata editor based on Ace Editor.
  • VFS-6685 Added new REST API for removing custom file metadata (xattrs, json and rdf).
  • VFS-6570 Showing loading indicator in file browser until file is available for download.
  • VFS-6456 Show more details about lack of privileges when trying to perform various actions in GUI.
  • VFS-6338 Enhanced API of the mechanism for importing existing data into Onedata spaces without need for copying the data. The mechanism is now called "storage import". Introduced modes of storage import: "manual" which allows for manual registration of files and "auto" which enables automatic detection and import of files from the storage. Introduced possibility to forcefully start/stop scans of auto storage import. Redesigned GUI related to storage import, adjusted to the new features.

20.02.1

  • VFS-6668 Fix bug resulting in timeouts of workers after 30s.
  • VFS-6645 Optimize changes querrying.
  • VFS-6628 Extended harvesting configuration - it is now possible to select harvesting options, like metadata types to harvest or additional file details (fileName, spaceId), upon index creation. New metadata types are now harvestable - xattrs and rdf. Default values of HarvestingBackendType and HarvestingBackendEndpoint can now be set by Onezone admin - if set, these values can be omitted when creating a new harvester. New option (retry_on_rejection) allowing for all payloads rejected by the harvesting backend to be automatically analysed for offending data (e.g. fields that do not match the schema), pruned and submitted again.
  • VFS-6580 Fixed bug that could block dbsync on-demand streams on multi-node deployments.
  • VFS-6577 Improve data transfer performance to object storages (e.g. S3) by aligning transferred block size to the object size on target storage, thus minimizing the overhead necessary when updating a file object with partial content.
  • VFS-6568 Introduced concept of readonly storage. If enabled, Oneprovider will block any operation that writes, modifies or deletes data on the storage. Such storage can only be used to import data into the space. Mandatory to ensure proper behaviour if the backend storage is actually configured as readonly.
  • VFS-6547 Fixed switching between spaces in file browser GUI during upload.
  • VFS-6535 Updated S3 SDK library to 1.8.7.
  • VFS-6504 Added HTTP storage helper allowing registration of HTTP and HTTPS servers as storage sources for Onedata Spaces.
  • VFS-6494 Introduced REST API for registering files.
  • VFS-6474 Added initial support for XRootD storage, including direct access to XRootD storages and importing of legacy data sets stored on XRootD or EOS servers.
  • VFS-6457 Added new publicly visible field to shares - description (supports the markdown format).
  • VFS-6456 Do not allow the user to perform actions in the GUI related to transfers without the appropriate permissions.
  • VFS-6455 Support for jumping to selected files in GUI, even if they are not visible on infinite-scroll list.
  • VFS-6453 New Open Data and share description views with visual Dublin Core editor and Markdown editor.
  • VFS-6450 Added file name and space id to harvested file metadata.
  • VFS-6431 Added performance logs for object storages, which can generate CSV file containing all storage requests including their duration.
  • VFS-6421 New generic GUI plugin for harvesters.
  • VFS-6378 Onepanel GUI and REST API now explicitly block supporting a space with more than one imported storage (globally) - such operation was possible in the past but was never supported by the internal storage import logic and led to incoherent view on space data.
  • VFS-6370 Create secure fold mechanism on model documents.
  • VFS-6361 Added new REST api for creating transfers and viewing file distribution, accessible respectively under `/transfers` and `/data/{fileId}/distribution` paths. Old `/replicas`, `/replicas-id` and `/replicas-view` endpoints were deprecated and will be removed in next major release.
  • VFS-6358 Optimization of files upload through GUI.
  • VFS-6346 GUI improvements: added Oneprovider GUI notifications, better file selection, additional error handling, better file manager refresh UX, fixed overflow of context menu in file browser, fixes in responsive layout.
  • VFS-6344 GUI: showing information if QoS requirement is impossible to be fulfilled.
  • VFS-6343 Added delete account feature in GUI.
  • VFS-6320 Old `/spaces/{sid}/indexes`, `/spaces/{sid}/indexes/{index_name}`, `/spaces/{sid}/indexes/{index_name}/reduce` and `/spaces/{sid}/indexes/{index_name}/query` endpoints were deprecated and will be removed in next major release.
  • VFS-6316 Added `statfs` support enabling preview of available storage in each space through oneclient, for instance using `df` or `stat` utilities.
  • VFS-6288 Basic HA functionality (experimental) - protect Oneprovider from single node failure.
  • VFS-6287 Integrate traverse pools with HA sub-system.
  • VFS-6263 New experimental Quality of Service functionality. It is used to manage file replica distribution and redundancy between supporting Oneproviders. Users can define any number of QoS requirements for a file or directory. Each requirement consists of target replicas number and an expression that is used to select storages where the replicas should be placed ‐ it is matched against parameters that were assigned to storages by Oneprovider admins.
  • VFS-6261 Integrate high-level services with HA sub-system.
  • VFS-6225 Added new `triggers` field to changes stream specification allowing to send events only on specified docs types changes.
  • VFS-6184 Added the space owner concept. Space owner works like "root" within the space - such user is allowed to perform all file/API operations, regardless of the assigned privileges and file permissions / ACLs. Ownership can be assigned to any number of users, and it is forbidden to leave a space without an owner - ownership must be transferred first.
  • VFS-6167 Allow nodes adding and deleting in-fly basing on HA sub-system.
  • VFS-6160 Reorganized Local User Mapping (LUMA) management. Introduced feeds for populating LUMA DB.
  • VFS-6095 Mask private file attributes, such as uid or gid, when showing file attrs in share mode.
  • VFS-5648 Extended QoS expression to allow comparators (<, >, <=, >=) and numeric values. Changed "-" operator to "\". Space characters (" "), dashes ("-") and underscores ("_") are now allowed in QoS parameters. Added more details to invalid QoS expression errors.
  • VFS-4760 Added implicit API caveats that limit access tokens used by Onedata GUIs behind the scenes for authentication and authorization. Different services in the system are presented with user's access token with power limited to bare minimum required for the service to handle user requests. For example, Oneproviders do not have access to APIs that could alter or delete user data and memberships.

20.02.0-beta4

20.02.0-beta3

  • VFS-5989 Regular files can now be shared. Also both files and directories can be shared multiple times. Due to those changes share REST API was reworked.

  • VFS-5901 Application config can now be customized with arbitrary number of config files added to /etc/op_worker/config.d/ directory.

  • VFS-5989 Removed old share REST API operating on file paths/ids.

  • VFS-6149 Allowed for RPN expression in QoS entry create

  • VFS-6149 Implemented API for QoS gui

  • VFS-6076 Set oz_domain env in initializer

  • VFS-6250 Improve logging related to running on-connect-to-oz procedures

  • VFS-6250 Secured on_zone_connection when cluster not ready

  • VFS-5983 Fix consistent_hashing usage after deps update

  • VFS-5983 Support datastore HA

  • VFS-6140 Do not include cdmi attrs into inherited xattrs

  • VFS-6231 Added upgrade essential workers in node manager

  • VFS-6140 Refactor metadata management

  • ensure that sync does not invalidate remotely created file when finding empty file created by opening the file, before it is replicated

  • VFS-6237 fix sync not detecting deletions in nested directories

  • VFS-5998 Removed storage sync cancel when resupporting space

  • VFS-5830 optimize replica_deletion and autocleaning mechanisms

  • VFS-6211 Fixed rtranfer_worker not starting when no connection to onezone

  • VFS-6142 Fix get_children_attrs name collision detection

  • VFS-6142 Rename compute_file_attr fun to resolve_file_attr in attr_req

  • VFS-5998 Implemented cease support cleanup

  • VFS-5830 fix bug in countdown_server, remove commented out code

  • VFS-6142 Reduce get_file_attrs functions

  • VFS-6142 Improve get_children, get_children_attrs/details docs

  • VFS-6181 Limit number of messages send to changes_stream_handler

  • VFS-6140 Add upper limits when listing directory children

  • VFS-6140 Return file itself when listing children for regular file

  • VFS-6142 Return name with collision suffix when fetching file details

  • VFS-6142 Add get file/children details fun to allowed ops in share mode

  • VFS-6142 Rename file_info to file_details

  • VFS-6142 Remove redundancies in attr_req module

  • VFS-6142 Remove redundancies in dir_req module

  • VFS-6142 Rename read_dir_plus_plus to get_children_info

  • VFS-6142 Clean up lfm_proxy code

  • VFS-6185 Minor fix to dbsync_state

  • VFS-6185 Add seq timestamp to dbsync state

  • VFS-6142 Return file details instead of jsut attrs for gs get op_file.instance

  • VFS-6142 Fix gui gs translations of fields returned by read dir plus plus

  • VFS-6142 Add read dir plus plus operation

  • VFS-6140 Add cases for requesting files on providers not supporting user

  • VFS-5983 Update deps to support datastore HA

  • VFS-6140 Fix using share object ids in REST endpoints

  • VFS-6140 Add data rest routes

  • VFS-6076 Do not provide a default Onezone domain

  • VFS-5830 add autocleaning_view_traverse, refactor autocleaning to use autocleaning_view_traverse

  • VFS-5830 scheduling task to replica_deletion_master blocks when its queue is full which results in automatic throttling

  • VFS-6192 Process GS prush messages asynchronously to avoid deadlocks

  • VFS-6043 Periodically report dbsync state to Onezone, synchronize info about support parameters and state from Onezone

  • change order of clear blocks - truncate operations

  • VFS-5642 Fixed paths bounded cache initialization

  • VFS-6093 Update ctool and onedata-documentation ref

  • VFS-6093 Do not send consumerToken to oz if it is undefined

  • VFS-6093 Add consumer token to verify_access_token request payload

  • VFS-6093 Fix races on auth_cache reacting to token status changes

  • VFS-6081 reorder function in simple_scan module

  • VFS-6100 Implemented cleanup after QoS entry was deleted. Improved QoS cache management.

  • VFS-5646 Added traverse cancel after QoS entry was deleted

  • VFS-6081 sync handles recreating file with different type

  • VFS-5642 Fixed wrong QoS cache management

  • VFS-6093 Rename auth_manager proto_credentials() to client_tokens()

  • VFS-6093 Rename auth_manager:auth() to auth_manager:credentials()

  • VFS-5642 Fixed status check for file without QoS

  • VFS-6093 Set session_validity_check_interval_seconds to 15 by default

  • VFS-6093 Add debug logs to auth_cache

  • VFS-6081 bugfix and fixed dialysis

  • VFS-6081 fix sync ignoring newly created file when rename of file with the same name and suffix is in progress

  • VFS-6081 fix races in detecting deletions by sync, fix sync reimporting file in case of race between sync, delete of opened file and release

  • VFS-6093 Extract auth cache logic from auth_manager to auth_cache

  • VFS-5642 Fixed race when dir deleted during traverse

  • VFS-6093 Properly handle all kinds of client() in gs_client_worker

  • VFS-6093 Fix auth manager mocks

  • VFS-6093 Improve auth_manager docs

  • VFS-6093 Monitor oz token/temp token status gs pushes/notifications

  • VFS-6093 Monitor token status after successful verification

  • VFS-6106 Update ctool and cluster-worker refs

  • VFS-6093 Clean auth_manager code

  • VFS-6081 fix importing conflicting files

  • VFS-5642 Added qos_status doc fixed dialyzer

  • VFS-5633 Use uuid instead of filename in qos status link name

  • VFS-6093 Improve token_auth verification code

  • VFS-6093 Invalidate auth cache entries on oz connection termination

  • VFS-6093 Make sure that auth verification works even without cache

  • VFS-6081 refactor fslogic_delete:process_file_links function

  • VFS-6093 Add temporary_token_secret record

  • VFS-5642 Added specs in qos_status

  • VFS-6096 Implemented QoS related documents clean up procedure

  • VFS-5642 Implemented QoS status check during traverse

  • VFS-6093 Add od_token record

  • VFS-6093 add root_auth and guest_auth types to auth_manager

  • VFS-6081 further refactor of fslogic_delete module, add emitting events to storage_sync

  • VFS-6093 Accept session:auth() in auth_manager:get_caveats/to_auth_override

  • VFS-6081 add checks for fixed races in storage_sync, code refactor according to PR comments

  • Allow getting file_location of deleted file if it is opened

  • VFS-6081 add extra check to prevent races which resulted in sync reimporting files that were being deleted

  • VFS-6081 fix sync reimporting files with file_meta marked as deleted, minor refactor

  • VFS-6081 do not remove deletion_link when removing file from storage fails, add deletion_links for directories

  • Hotfix - rename opened deleted files - prevent race

  • Hotfix - rename opened deleted files, enotdir when needed and fix async_request_manager

19.02.5

  • VFS-6857 Add support for resuming partial file downloads via CDMI.

19.02.4

  • VFS-6635 Improve synchronization retries politics to prevent synchronizer blocking by dead providers.
  • VFS-6631 Rtransfer takes into account storage block size choosing blocks to synchronize.
  • VFS-6607 Fix node restart with HA disabled.
  • VFS-6587 Replica synchronizer takes into account storage blocks size during choice of blocks to be replicated.
  • VFS-6578 Fix events manager initialization to prevent races between events.
  • VFS-6540 Files upload GUI optimization using optimal (per space) upload file chunk size.
  • VFS-6438 Decrease overhead of transfers of already replicated files. Optimization of on demand synchronization streams usage.
  • VFS-6401 All authentication errors are now wrapped in UNAUTHORIZED error and map to 401 HTTP code to avoid ambiguity when reporting token related errors - tokens can be used for authentication as well as input data for some operations (e.g. invite tokens).
  • VFS-6390 Because of asynchronous processing, it was possible that GraphSync session cleanup intertwined with deleted record cleanup (that removes corresponding subscriptions from sessions, possibly including the session being cleaned up) and caused an error that interrupted change propagation. Now, if the session is no longer existent, subscription removal errors are ignored and the propagation completes.
  • VFS-6369 Fix datastore internal call, batch management during links listing and infinite loop during storage directories creation.

19.02.3

  • Fix handling of remote helper params

19.02.2

VFS-6081 sync handles recreating file with different type VFS-6081 fix races in detecting deletions by sync, fix sync reimporting file in case of race between sync, delete of opened file and release VFS-6081 fix importing conflicting files VFS-6081 add extra check to prevent races which resulted in sync reimporting files that were being deleted VFS-6035 Add VM option that forbids terminating the node with Ctrl + C VFS-6008 fix listing transfers when not all docs are synchronized VFS-5933 Remove the concept of default space

19.02.1

  • Bump version to 19.02.1
  • VFS-5826 Ensure db start at cluster init
  • VFS-5900 GUI update * Added showing special subjects in ACL editor
  • VFS-5826 Add missing event during dir creation
  • VFS-5891 Clean authorization nonce after its TTL
  • VFS-5826 Add events during file creation
  • VFS-5826 Change max_read_dir_plus_procs value
  • VFS-5826 Emmit attr_changed events on chmod and acl change
  • VFS-5826 Change events processing - allow subscriptions per dir

19.02.0-rc2

  • VFS-5775 fix file distribution data backend crashing on empty file
  • VFS-5777 increase gui session ttl
  • VFS-5795 Add rebar3 get-deps command to Makefile and use it in package build instead of upgrade
  • VFS-5758 Update file creation
  • VFS-5699 Implement cluster upgrade procedure

19.02.0-rc1

  • VFS-5706 do not allow to create file if it exists on other provider
  • ensure time_slot_histogram shift size is non-negative
  • VFS-5678 create gui session instead of rest one for gs connection
  • VFS-5683 GUI update Renamed space indices to views
  • VFS-5678 replace app.config index vars with view ones
  • VFS-5678 replace index with view when possible
  • VFS-5631 use specific type for #subscription records
  • VFS-5678 rename indices routes to views routes
  • VFS-5523 return ENOTSUP for clproto msg impossible to reroute
  • VFS-5400 Use compatibility reference json
  • VFS-5622 refactor listing children (ls) API
  • VFS-5622 return ok tuple for moveFile and copyFile gs rpc
  • VFS-5622 set parent to null for space root dir in gs translator
  • VFS-5622 add revisions to op_logic (due to gs version 3)
  • VFS-5622 add data validation and authorization for gs rpc operations
  • VFS-5622 add move and copy rpc operations to gs
  • VFS-5622 add deleting file to gs
  • VFS-5657 Adjusted deb dependency versions for bionic
  • VFS-5657 Enabled Ubuntu distribution package tag
  • VFS-5486 Use async GS client API in gs_client_worker and handle timeouts in more elegant way
  • VFS-5544 Add revision awareness to od_* records cache to fix a possible race condition caused by asynchronous updates
  • VFS-5551 Use nobody auth override when applicable
  • VFS-5508 Allow to view provider list of a space for users without the view privilege,
  • VFS-5540 replace old cdmi container handler with new one
  • VFS-5597 Added s3 sync helper params
  • VFS-5540 remove obsolete cdmi_objectid_handler
  • VFS-5540 remove obsolete pre_handler
  • VFS-5540 add cdmi_capabilities which shows available cdmi operations
  • VFS-5540 add generic cdmi_handler
  • VFS-4698 Implemented onepanel rest proxy.
  • VFS-4547 add new swagger generated indices routes
  • VFS-4547 rename occurrences of indexes to indices
  • VFS-4547 rm transfer scheduling validation from lfm
  • VFS-4547 add new privilege checks to transfer and db_index backends
  • VFS-5107 Fix inability to change webdav credentials type to none
  • VFS-5107 Remove webdav credentials when type is none
  • VFS-4547 check user space privileges in REST operations
  • VFS-5454 implement op_logic framework
  • VFS-5454 omit validation for user root dir in op_file operations
  • VFS-5454 always use provider id in ERROR_SPACE_NOT_SUPPORTED_BY
  • VFS-5454 rename logical_file_manager to lfm
  • VFS-5454 add missing http codes macros
  • VFS-5454 use ?ROOT_SESS_ID when checking user space privs
  • VFS-5454 silence no_connections error in dbsync_communicator
  • VFS-5454 add location header to rest POST responses
  • VFS-5394 Restart rtransfer on all nodes after helper change
  • VFS-5394 Report errors when refreshing helper params
  • VFS-5394 Restart rtransfer after storage params change
  • VFS-5394 Create module handling helpers reload
  • VFS-5394 Refresh helper params after storage modification
  • VFS-5394 Add ability to list handles for a session
  • VFS-5394 Call event emition upon helper modification
  • VFS-5545 Fix storage verification
  • VFS-5454 accept REST req with no content-type and no body
  • VFS-5107 Extract helper functions for storage args preparation
  • VFS-5454 differentiate rest_errors from api_errors
  • VFS-5454 update rest routes
  • VFS-5454 add generic rest_handler
  • VFS-5454 add routes generated from swagger definitions
  • VFS-5454 replace lfm_files with logical_file_manager calls
  • VFS-5107 Ensure empty credentials for credentialsType:=none
  • VFS-5107 Disallow insecure mode for glusterfs and nulldevice
  • VFS-5107 Luma: convert only integers to binaries
  • VFS-5107 Convert LUMA response to binaries before validating
  • VFS-5107 Add missing webdav arguments to list of allowed fields
  • VFS-5107 Fix helper creation badmatch
  • VFS-5107 Validate admin ctx and args on helper update
  • VFS-5107 Never expect integers in helper user/group ctx
  • VFS-5107 Make webctx adminId special case of ctx transform
  • VFS-5107 Reuse validation between helper args and ctx
  • VFS-5107 Fix helper ctx validation
  • VFS-5392 Add file listing via id
  • VFS-5392 Add tree traverse and effective values
  • VFS-5107 Implement storage modification

18.02.3

  • VFS-5706 do not allow to create file if it exists on other provider

18.02.2

  • VFS-5391 Reduced size of monitoring and throttling log files
  • do not call getxattr when synchronisation of nfs4acl is disabled
  • VFS-5289 Added default callback for providing resources. Added unit tests for selecting callback that provides resources.
  • VFS-5371 return einval error when client msg decoding fails
  • VFS-5329 Fix rmdir on s3 and ceph
  • VFS-5348 fix connection deadlock
  • VFS-5076 increase connection:send_msg timeout
  • VFS-5076 rm race between setting up session and connection
  • VFS-5316 Improve event manager performance
  • VFS-5251 reorganize code in storage_detector
  • VFS-5320 improve auto-cleaning additional precondition was added that allows to check whether replica still needs to be deleted improved tests
  • VFS-5316 Improve sequencer manager performance
  • VFS-5251 improve verification of newly added storage
  • update file-popularity after scheduled replication
  • VFS-5076 rm unused fields from session model
  • VFS-5076 fill proxy info before sending msg in communicator
  • VFS-5076 add retries to functions in communicator
  • VFS-5076 change directory tree in session
  • VFS-5232 Update acl usage by rules
  • VFS-5076 add retries to communicator's communicate
  • VFS-5232 Improve file deletion verification by request handlers
  • VFS-5232 Improve rules verification
  • VFS-5076 refactor communicator
  • VFS-5076 add keepalive timer to connection_manager
  • VFS-5076 remove obsolete modules
  • VFS-5232 Update location management
  • VFS-5076 add sending heartbeats to connection_manager
  • VFS-5232 Update ownership management
  • VFS-5250 Added documents printing
  • VFS-5076 add connection_manager to session document
  • VFS-5076 refactor router
  • VFS-5232 Fix permissions management during read/write via proxy
  • VFS-5232 Update storage_id generation
  • VFS-5076 implement msg send via connection_manager
  • VFS-5232 Refactor delete
  • VFS-5076 rm connections management from session_watcher
  • VFS-5076 add API call to close connection
  • VFS-5232 Refactor file opening
  • VFS-5232 Fix file handles management
  • VFS-5232 Fix sync/delete race
  • VFS-5232 Fix rename into opened file
  • VFS-5232 Fix some races in simple_scan
  • VFS-5232 Refactor create
  • VFS-5076 rm heartbeats from new connection
  • VFS-5232 Fix critical section in replica_deletion_req
  • VFS-5076 replace gpb with enif_protobuf, add socket mode option
  • VFS-5076 new connection implementation

18.02.1

  • VFS-5139 Handle remote events timeout
  • VFS-5180 improvements of storage_sync mechanism: - sync now understands and properly handles suffixes for conflicted files - sync does not synchronize files for which deletion has been delayed due to existing handles - race between creation of file_meta and file_location docs has been removed, now file_location is always created before file_meta - this commit also adds tests of implemented improvements
  • VFS-5196 Added bearer authentication
  • VFS-5195 return error when file referenced by explicit name and tree_id is not_found
  • VFS-5165 return error when index referenced by explicit name and tree_id is not_found
  • VFS-5165 handle conflicting indexes' names
  • VFS-5190 Add REST enpoint for creating shares, make sure only directories can be shared and only one share per dir is allowed
  • fix missing function clauses for encoding and decoding webdav credentials in luma_cache module
  • VFS-5141 Fixed conflicting files names on storage
  • VFS-5139 Add notify when flush fails
  • VFS-5154 Clean no_dot_erlang scripts
  • VFS-4751 Ensure forward compatiblity of group/space privileges changing in future Onezone versions
  • VFS-5139 Improve events reliability
  • VFS-5161 Use new configuration endpoint for op compatibility
  • VFS-5161 Check both current and deprecated endpoints for compatibility check
  • VFS-5161 Add endpoint /api/v3/oneprovider/configuration
  • VFS-5142 Clean documents from memory when session is broken
  • VFS-5121 support modification of file-popularity-config
  • VFS-5121 introduce popularity function in the file-popularity view
  • VFS-5077 Update communicator
  • VFS-5023 refactor, move autocleaning util modules to utils directory
  • VFS-5110 check arguments order when calling aggregate_file_read_events
  • VFS-5023 fix test, add 2 fields to auto_cleaning_run report to prepare for infinite scroll over reports
  • VFS-5023 code improvement, revert sorting order of file_popularity_view, fix tests
  • VFS-5077 Refactor provider communicator
  • VFS-5077 Refactor communicator
  • VFS-5077 Refactor auth managers
  • VFS-5077 Refactor session manager worker
  • VFS-5122 Update GlusterFS to 3.12.15 on CentOS
  • VFS-5077 Refactor session manager
  • VFS-5077 Refactor session open files management
  • VFS-5023 refactor of auto-cleaning
  • VFS-5077 Refactor session module
  • VFS-5077 Refactor handshake error handling
  • VFS-4650 Added writing provider macaroon to a file
  • VFS-4977 document new metadata changes API
  • VFS-5077 Further refactor of event_router
  • VFS-5077 Create async request manager
  • VFS-4977 refactor space changes streaming
  • VFS-5021 Fixed changes stream not closing on disconnection
  • VFS-5077 Refactor streams routing
  • VFS-5077 Events refactoring
  • VFS-5046 escape specified map function when updating index
  • VFS-4970 Documents expire
  • VFS-4925 Added check of origin header in ws connection handshake
  • Updating GUI, including: VFS-5038-allow-empty-handle-metadata allow empty handle metadata fixes in share page * fixed handle detection after save
  • VFS-4825 call replica_deletion_master:cancel on eviction cancellation
  • VFS-4825 replace eviction_worker with new one using gen_transfer_worker
  • VFS-4825 add initial implementation of transfer_worker_behaviour

18.02.0-rc13

  • 8.Updating GUI, including: VFS-4980-index-transfers * VFS-4980 Added support for index transfers
  • VFS-4966 Using common property for file path and index name in transfer
  • VFS-4966 Added missing db_index id in GUI API
  • VFS-4998 fix provider emitting file_written_event to itself when mtime has changed
  • VFS-4978 stop calling dbsync_changes on ignored remote docs
  • VFS-4975 enable creating indexes on additional models
  • VFS-4968 Fix minor bug in synchronizer
  • VFS-4966 Fixed undefined QueryViewParams
  • VFS-4966 fix index_db_data_backend get_record to return proper proplist
  • VFS-4966 add db-index gui model, modify transfer model
  • VFS-4976 Changed gui to use create_and_open
  • Updating GUI, including: VFS-4927-transfers-loading * VFS-4927 Fixed delay before loading transfers list; error handling
  • VFS-4998 ensure that update scan does not start to fast
  • VFS-4968 Fix link problems in cluster_worker
  • VFS-4991 handle ENOENT in remove_utils:rm_children
  • VFS-4978 rm db view from provider when he no longer supports index
  • VFS-4991 fix race on cleaning up directory from storage
  • VFS-4902 Added WebDAV helper
  • VFS-4902 Added proxygen library dependency
  • VFS-4902 Added WebDAV helper integration test
  • handle undefined FileCtx in import_children. This situation occurs when files was deleted, and its link has been already deleted too, but it is still visible on storage
  • VFS-4968 Fix remote store
  • VFS-4614 Rename email_list to emails in user record
  • VFS-4952 Implement provider modification using graph sync
  • Updating GUI, including: VFS-3774-safari-opensans * VFS-3774 Fixed broken request for OpenSans font in Safari if redirecting to Onezone
  • VFS-4936 Implement supporting space via graph sync
  • VFS-4951 fix cleaning after removing file_meta doc, filter out deleted custom_metadata docs from indexes
  • VFS-4707 remove soft_quota_limit
  • VFS-4936 Use common errors API for space support change
  • VFS-4743 Refactor link trees
  • VFS-4936 Add function to change space support size

18.02.0-rc12

  • Releasing new version 18.02.0-rc12

18.02.0-rc11

  • VFS-4830 add add_reduce function
  • Updating GUI, including: VFS-4454-login-loader-close * VFS-4454 Fix hanging authorization loader spinner
  • Upgrade rtransfer_link.
  • VFS-4922 add parsing provider list in query string to validator
  • VFS-4614 Rename custom_static_root to static_root_override
  • VFS-4924 Fix move into itself check
  • VFS-4830 add migration by index tests
  • VFS-4830 enable replica eviction by index, add tests for that
  • Updating GUI, including: VFS-4856-cdmi-object-id * VFS-4856 Added CDMI object ID and file path info to file row
  • VFS-4830 transfer scheduling by index
  • ensure that sync does not invalidate replicated files
  • VFS-4813 Update error on quota
  • VFS-4813 Throw sync errors
  • VFS-4816 Use local time instead of Zone time when Onezone is unreachable
  • VFS-4816 Do not ivalidate GraphSync cache immediately after a connection to Onezone fails
  • VFS-4778 - refactor replica_synchronizer:get_holes
  • VFS-4778 - simplify find_overlapping logic, add unit tests for it
  • VFS-4813 Do not use local blocks in replica finder
  • VFS-4741 Prevent synchronizer from crush when provider is not connected to onezone
  • VFS-4741 Invalidation uses only public blocks
  • VFS-4741 Add async synchronization requests
  • VFS-4778 Add priority to transfer blocks in progress
  • VFS-4769 Do not get user document when it is not needed
  • Updating GUI, including: VFS-4806-fix-distribution-dir * VFS-4806 Fixed regression bug: file distribution modal for directory has no transfers buttons
  • Updating GUI, including: VFS-4791-many-chunks-render * VFS-4791 Support for highly scattered files in file distribution charts
  • VFS-4788 Add calculation of total blocks size in get_distribution API
  • VFS-4788 Implement file chunks interpolation to avoid transferring large file blocks lists to GUI frontend
  • Updating GUI, including: VFS-4242-add-cancel-button-for-transfers * VFS-4242 Added transfers cancelling and rerunning actions
  • VFS-4741 Force publishing of at least one block
  • VFS-4741 Flush synchrinizers on terminate
  • VFS-4741 Allow async local blocks flush
  • VFS-3858 Fix a minor bug in space_data_backend
  • VFS-3858 Update cluster_worker ref, adjust to new Graph Sync proto version
  • VFS-4741 Update cluster_worker to allow int keys in links
  • VFS-4757 Fix file permissions conversion in GUI backend, tidy up .gitignore
  • VFS-4741 Create local blocks store
  • VFS-4708 Minor fslogic cache fix
  • VFS-4708 Optimize sync and compute checksum
  • Upgrade rtransfer_link.
  • VFS-4055 Update bp_tree
  • VFS-4726 Add backwards compatibility for changing privileges in 18.07

18.02.0-rc10

  • fix duplicated transfer links after restart
  • VFS-4611 Refactor od optimize replica_synchronizer and blocks management
  • VFS-4146 Renmae ip_string to ip in clproto
  • VFS-4146 Prevent silencing of failure in resolving peer domain
  • VFS-4146 Introduce proto message with rtransfer nodes
  • VFS-4029 Implement responding to Let's Encrypt http challenge
  • VFS-4660 Allow configuration of sync priorities
  • VFS-4660 Set sync priorities
  • VFS-4656 Added cephrados to luma cache
  • VFS-4660 Extend synch messages with priority option
  • VFS-4656 Added cephrados helper
  • VFS-4562 check permissions when scheduling invalidation job
  • VFS-4590 Update cluster-worker ref to include pings in Graph Sync connection
  • VFS-4652 sync files with existing links but missing file-meta
  • VFS-4574 improve transfer doc conflict resolution
  • VFS-4574 add transfer_onf_stats_aggregator
  • VFS-4574 aggregate separately file blocks and transfer stats
  • VFS-4478 do not include deleted files in file_popularity_view
  • VFS-4478 implementation of replica_eviction

18.02.0-rc9

  • VFS-4611 Update garbage collection
  • VFS-4608 Fix leak in rtransfer quota manager
  • Updating GUI, including: VFS-4566-file-transfers-tab * VFS-4566 Added transfers list tab for specific file
  • VFS-4584 Introduce limited history of ended transfers per file
  • VFS-4611 Change algorithm of overlapping blocks finding
  • VFS-4608 Fix tp internal calls and errors during changes application
  • VFS-4532 Update node_package vars for all platforms
  • VFS-4532 Add autogenerated.config file to start params
  • Updating GUI, including: VFS-4507 * VFS-4507 Multiple improvements in transfers list view
  • VFS-4482 Set default values in http listener to more reasonable
  • VFS-4412 Update memory management
  • VFS-4569 Updated helpers and rtransfer_link
  • Updating GUI, including: VFS-4538 * VFS-4538 Better control of invalidation feature availability for files
  • VFS-4542 Ensure op-worker is backwards compatible when group and space privileges change

18.02.0-rc8

  • Releasing new version 18.02.0-rc8

18.02.0-rc7

  • VFS-4412 Add holes consolidation
  • Updating GUI, including: VFS-4471 * VFS-4471 Improved file chunks bar rendering
  • handle {error, ebusy} from truncate
  • VFS-4412 Fix remote driver
  • VFS-4412 Fix blocks synchronization bugs
  • VFS-4523 Allow listing transfers per space rather than per session
  • Updating GUI, including: VFS-4391 * VFS-4391 More efficient infinite scroll for transfers list and file transfer status

18.02.0-rc6

  • Upgrade rtransfer_link.
  • VFS-4412 Fix algorithm for excluding old blocks from transfers
  • not update file location only when mtime equals previously synced mtime
  • VFS-4412 Improve performance of file_location blocks management
  • VFS-4477 - add audit log for storage_sync

18.02.0-rc5

  • Update rtransfer_link.
  • VFS-4422 Hotfix for broken public share download
  • VFS-4482 Do not include link ids in transfer ids (GUI backend)
  • VFS-3953 Integrate new GUI static backend

18.02.0-rc4

  • VFS-4510 fix finish_time not set for cancellation of replication and invalidation and for failed invalidation
  • Updating GUI, including: VFS-4487 * VFS-4487 Fixed not updating completed transfer stats
  • VFS-4510 fix active transfer being restarted after restart of provider
  • Updating GUI, including: VFS-4387 * VFS-4387 Fixed not updating current transfers stats if user not scrolled view
  • VFS-4509 improve error handling in storage_sync full_update procedure
  • VFS-4481 Setting space transfer list limit to 250
  • VFS-4314 Add cleaning of tranfers history for files upon deletion or long inactivity
  • VFS-4314 Implement backend for transfers pagination in GUI Implement API for GUI frontend to list transfers by ranges and negative offsets Improve behaviour of transfer links Add enqueued transfer state between scheduled and active Add transferred_file record for tracking which files are currently being transferred

18.02.0-rc3

  • VFS-4430 remove unused fields from space_strategies record, fix bug in storage_sync_monitoring:get_record_struct function
  • VFS-4366 fix badmatch when updating space_transfer_stats
  • Reduce default num of rtransfer connections to 16.
  • Update rtransfer to fix missing blocks.
  • Updating GUI, including: VFS-3945 * VFS-3945 Added data invalidation functionality
  • VFS-4431 Stabilize zone_connection test, update ctool ref - include better handling of end_per_suite crashes, update meck, clean up in rebar.config
  • VFS-4407 Updated helpers and rtransfer_link refs
  • Updating GUI, including: VFS-4355 * VFS-4355 Added summarized transfer charts per provider
  • VFS-4265 check if replica target provider supports space
  • VFS-4366 refactor space_data_backend
  • VFS-4366 refactor space_transfer_stats_cache

18.02.0-rc2

  • Upgrade rtransfer_link.
  • VFS-4446 Updated jiffy ref
  • VFS-4427 ensure that sync does not updates files being replicated
  • VFS-4443 Fixed generation of source archive with submodules
  • VFS-4396 ensure that sync_file_counter has been deregistered
  • VFS-4417 do not update mtime when performing move on non-posix storage
  • VFS-4393 Upon connection failure, try to send responses via other connections of related session
  • VFS-4396 fix race when updating transfer stats
  • Update cluster_worker to enable links listing with neg offset
  • VFS-4361 increase timeout for verify_helper
  • VFS-4295 Changed subtrees to submodules
  • VFS-4361 add transfer stats aggregation and flushing
  • VFS-4394 Updated helpers and rtransfer refs
  • VFS-4241 added storage_sync_monitoring model, major refactor of storage_sync mechanism
  • VFS-4393 Close incoming connection upon unexpected errors
  • VFS-4313 Updated pkg config with new aws sdk s3 version
  • VFS-4313 Updated dockers.config

18.02.0-rc1

  • VFS-2021 Added dockers.config
  • VFS-4238 Updated helpers and rtransfer rebar refs
  • VFS-4280 Added simulated filesystem options to null device helper
  • Updating GUI, including: VFS-4239 * VFS-4239 Infinite scroll for transfers lists
  • VFS-4369 - emit file_renamed event
  • VFS-4299 Update config
  • VFS-4369 create delayed storage file with root session id
  • Updating GUI, including: VFS-4305 * VFS-4305 Added charts for on-the-fly transfers
  • VFS-4299 Extend ls with tokens
  • VFS-4299 Use links during files listing
  • VFS-4239 Using real start time for transfers in GUI backend
  • VFS-4304 erase zeroed histograms for on the fly transfers
  • VFS-4304 fix old comments and dialyzer specs
  • VFS-4238 fix not working updating stats for on the fly transfers
  • VFS-4239 Do not present active transfers on scheduled list
  • VFS-4304 add aggregated transfer stats for on the fly transfers
  • VFS-4239 Setting development version of GUI
  • VFS-4304 handle case when space transfer stats document do not exist
  • VFS-4304 update models to store and compute on the fly transfer stats
  • VFS-4304 store on the fly transfer data
  • VFS-4239 add listing of scheduled transfers
  • VFS-4239 Disabling transfer fetch limit

18.02.0-beta6

  • VFS-3732 - improve storage_sync tests
  • VFS-3732 - fix tests after removing sticky bit on space directory
  • VFS-3732 - remove sticky_bit on space_dir in file_meta
  • Update compatible versions
  • Releasing new version 18.02.0-beta6
  • Update vsn in app.src file
  • VFS-3731 - code style improvement
  • VFS-3731 - fix sync removing remotely created files, fix transfer model upgrader
  • VFS-3731 - fix dialysis
  • VFS-3731 - fix removing non-empty directory after remote deletion
  • VFS-4299 Add flush cooldown
  • VFS-4113 Updated exometer counters
  • VFS-4234 Updated rtransfer and helpers ref

18.02.0-beta6

  • VFS-3731 - fix sync removing remotely created files, fix transfer model upgrader
  • VFS-3731 - fix removing non-empty directory after remote deletion
  • VFS-4299 Add flush cooldown
  • VFS-4113 Updated exometer counters
  • VFS-4234 Updated rtransfer and helpers

18.02.0-beta5

  • don't count files' attrs hash when update is set to write_once
  • Upgrade rtransfer_link.
  • VFS-4310 Update replica management
  • Updating GUI, including: VFS-4260 * VFS-4260 Added menu for managing space root dir data distribution
  • VFS-4310 Update getting blocks for sync
  • VFS-3703 Switched from mochiweb JSON parsing to jiffy
  • VFS-4310 Update bp_tree
  • VFS-4316 - remove filename_mapping strategy
  • Fix session deletion
  • VFS-4316 deleted dirs should be removed from storage
  • fix user_logic:exists
  • improve error handling in fetch_lock_fetch_helper
  • fix displaying transfer status in GUI
  • VFS-4285 Fix restart of deletion_worker
  • VFS-4285 Add create/delete test with sync
  • VFS-4285 Update getting deleted files
  • VFS-4272 Check forward compatiblity during OP connections to OZ
  • VFS-4285 Update files deletion
  • bugfix in create_parent_dirs
  • VFS-4296 Fixed meck entry
  • VFS-4267 Adjust code to erl 20, update deps
  • Enable disabling rtransfer ssl in app.config
  • VFS-4281 pass UserCtx to create_delayed_storage_file function
  • VFS-4273 - reverse_luma cache refactored, tests fixed, added specs
  • VFS-4273 - handled direct luma cache
  • VFS-4273 - refactor of luma_cache, cache is now implemented using links
  • VFS-4274 Fixed helpers ref in rebar.config
  • VFS-4262 Updated rtransfer link
  • VFS-4262 Updated helpers with new asio version
  • refactor sfm_utils:create_parent_dirs function
  • VFS-4244 Scale helpers tests
  • VFS-4152 Fix missing event messages and performance test
  • VFS-4152 Extend rtransfer stress tests
  • Add rtransfer tests

18.02.0-beta4

  • VFS-4274 Fixed helpers ref in rebar.config
  • refactor sfm_utils:create_parent_dirs function
  • VFS-4262 Updated rtransfer link
  • VFS-4262 Updated helpers with new asio version

18.02.0-beta3

  • VFS-4249 storage_sync counters bugfixes and improvements
  • Enable graphite support for rtransfer_link.
  • Enable SSL for rtransfer_link.
  • Update storage select
  • Improve rtransfer prefetching counting.
  • Integrate rtransfer_link.
  • Switch to rebar-dependency helpers.
  • VFS-4114 - bugfix in storage_sync histogram
  • VFS-4155 add client keepalive msg handling
  • VFS-4155 increase cowboy and clproto timeouts.
  • VFS-4171 Added folly dependency
  • VFS-4171 Updated cberl ref to LibEvent based version
  • Updating GUI, including: VFS-4157 * VFS-4157 Requesting completed transfers list with delay to be compatible with backend fixes
  • VFS-4222 Force gs connection start only on the dedicated node
  • VFS-4217 - fix race on increasing deleted_files_counter and checking whether sync has been finished
  • Updating GUI, including: VFS-4223 * VFS-4223 Fixed long time of loading data distribution modal
  • VFS-4222 Separate graph sync status check from triggering reconnect
  • Updating GUI, including: VFS-4027 * VFS-4027 Added support for peta-, exa-, zetta- and yottabytes
  • VFS-4158 Add socket timeout test
  • VFS-4114 - transfer management fixes and refactor: this commit includes: fix for race condition on adding transfer to active transfers link major refactor of transfer module and model fix for handling error when replication of not yet synced file has been scheduled added backoff algorithm for retrying transfers added files_to_process and files_processed counters in transfer model refactor of multi_provider_rest_test_SUITE
  • VFS-4211 Restarting listeners is now done by node_manager because some ets tables need to be created in the process
  • Updating GUI, including: VFS-4206 * VFS-4206 Changed speed units on transfers view to bps
  • VFS-4209 Fix synchronization blocking with many spaces
  • VFS-4207 Do not match listener's stopping to ok to avoid crashes when it is not running
  • VFS-4207 Move listener restarting logic from onepanel to oneprovider, restart GS connection after ssl restart
  • VFS-4158 Fix root links scopes
  • VFS-4163 - use transfer timestamps as link keys
  • VFS-4158 Fix race in ensure connected
  • VFS-4158 Improve provider connection management
  • Updating GUI, including: VFS-4012, VFS-4154 VFS-4012 Info about remote statistics on transfers view; fixed transfer row sort issues VFS-4154 Dynamically adjust polling interval of transfers data; fixed transfer chart loading
  • VFS-4158 Fix minor bug in router
  • VFS-4158 Make connections asynchronous
  • VFS-4054 Make default IP undefined
  • VFS-4054 Delete check_node_ip_address from node_manager.
  • VFs-4054 Remove getting cluster ips from node_manager_plugin
  • VFS-4158 Fix batmatch in sequencer

18.02.0-beta2

  • Update app.config
  • fallback to admin_ctx when luma is disabled
  • handle luma returning integer values
  • fix handling uid and gid from luma as integers
  • VFS-4036 Added flat storage path support
  • VFS-4040 Improve speed and reliability of datastore, improve permission cache and times update
  • disable http2
  • VFS-4128 Fix tp internal call on space_storage
  • VFS-4035 Allow non-blocking provider messages handling
  • VFS-4130 Update ctool, adjust to new time_utils API, fallback to REST when get_zone_time via GS fails
  • VFS-4035 Prevent blocking event stream by connection
  • VFS-4035 Handle processing status during provider communication
  • VFS-4035 Fix deadlock in storage file creation function
  • VFS-4124 Added posix rename handling for nulldevice and glusterfs
  • VFS-4117 Implement new read_dir_plus protocol
  • VFS-3704 update cowboy to version 2.2.2
  • VFS-4117 Control read_dir_plus threads number

18.02.0-beta1

  • VFS-4080 Verify other providers' domains while connecting via IP addresses
  • VFS-3927 Remove support for IdP access token authorization and basic auth, only macaroon auth is now supported
  • VFS-3978 Do not distribute test CA with op-worker
  • VFS-3965 Provider now uses port 443 for protocol server
  • VFS-3965 Added an HTTP Upgrade Protocol procedure before handshake
  • VFS-3947 Use random nonce during every inter-provider connection to verify provider identity
  • VFS-3751 Ensure users can view basic info about their spaces and groups if they do not have view privileges
  • VFS-3751 Authorize providers using macaroons rather than certificates
  • VFS-3751 Rework provider communicator to work with macaroons and support verification
  • VFS-3751 Merge provider_listener and protocol_listener into one
  • VFS-3751 Add handshake message for providers
  • VFS-3635 Remove default OZ CA cert, download it every time before registration
  • VFS-3279 Implement new synchronization channel between OP and OZ (Graph Sync)
  • VFS-3730 Separate trusted CAs from certificate chain
  • VFS-3526 Implement subdomain delegation; Combine provider record fields \"redirection_point\" and \"urls\" into \"domain\"
  • VFS-3526 Remove old dns plugin module
  • Refactor datastore models to integrate them with new datastore
  • Change links storing model to use dedicated links tree for each provider
  • VFS-4088 GUI: Fixed incorrect ordering and stacking of transfer chart series
  • VFS-4068 GUI: Fixed incorrect icons positioning in transfers table
  • VFS-4062 GUI: Remember opened space when switching between data-spaces-transfers views; fixes in data-space sidebar
  • VFS-4059 GUI: Fixed provider icon scaling in transfers view

17.06.2

  • Updating GUI, including: VFS-4088 * VFS-4088 Fixed incorrect ordering and stacking of transfer chart series
  • VFS-4074 removes option start_rtransfer_on_init, added gateway_supervisor
  • VFS-4074 add rtransfer to supervision tree
  • Updating GUI, including: VFS-4068, VFS-4062, VFS-4059 VFS-4068 Fixed incorrect icons positioning in transfers table VFS-4062 Remember opened space when switching between data-spaces-transfers views; fixes in data-space sidebar * VFS-4059 Fixed provider icon scaling in transfers view
  • VFS-3889 increase transfer_workers_num to 50, remove commented out code and todo
  • VFS-3889 restart transfers via rest, add test for many simultaneous transfers
  • Bump compatible versions to 17.06.0-rc9 and 17.06.0
  • VFS-3906 Transfer GUI displays charts from before several seconds rather than approximate them to present
  • VFS-3889 add cancellation of invalidation transfers

17.06.1

  • Releasing new version 17.06.1

17.06.0-rc9

  • VFS-3951 add zone connection test suite
  • VFS-4004 Update ctool to include safe ciphers in TLS
  • fix storage_update not restarting after provider restart
  • move setting of rtransfer port to app.config, fix transfer destination being send as string \"undefined\" instead of null
  • lower rtransfer_block_size, increase number of transfer_workers
  • do not allow provider to restart all transfers in supported space
  • Updating GUI, including: VFS-4002 * VFS-4002 Showing transfer type (replication/migration/invalidation) in transfers table
  • change finalizing state of transfer in gui to invalidating, update finish time when invalidation is finished
  • Updating GUI, including: VFS-4000, VFS-3956, VFS-3595, VFS-3591, VFS-3210, VFS-3710
  • VFS-4000 Fixed fetching wrong transfer statistics for chosen timespan
  • VFS-3956 Fixed provider name tooltip rendering in migrate menu of data distribution modal
  • VFS-3595 Fixed locking ACL edit when switching between ACL and POSIX in permissions modal
  • VFS-3591 Fixed infinite loading of metadata panel when failed to fetch metadata for file
  • VFS-3210 Fixed displaying long text in basic file metadata keys and values
  • VFS-3710 Using binary prefix units for displaying sizes (MiB, GiB, etc.)
  • VFS-3951 add op ver compatibility check
  • VFS-3911 - mechanism for turning node_manager plugins on/off in app.config, turn monitoring_worker off by default
  • changes in throttling_config
  • VFS-3951 add build_version env var for op
  • VFS-3972 Fix attach-direct consoles in releases not being run with xterm terminal
  • VFS-3951 add rest endpoint for checking op version
  • add try-catch around rtransfer write, remove debug logs
  • fix bug in gateway_connection:garbage_collect function add retrying of fetching file chunk
  • VFS-3932 Reuse cluster worker graphite args
  • VFS-3911 - use exometer counter to control execution of storage_import and storage_update
  • VFS-3932 Added helper performance metrics
  • VFS-3892 Use weighted average (rather than arithmetic) to calculate transfer speeds between time windows, improve calculations on the edges of speedchart
  • VFS-3892 Move status field from transfer record to transfer-current-stat record
  • VFS-3857 make request_chunk_size and check_status_interval constants in replica_synchronizer configurable in app.config
  • VFS-3857 canceling and automatic retries of transfers
  • fallback to admin_ctx when luma is disabled
  • VFS-3811 Add exometer counters
  • handle luma returning integer values
  • Hotfix - Improve environment variables names
  • Hotfix - prevent rtransfer from crush
  • VFS-3864 Lower default request timeout to 30 seconds
  • do not restart transfers which has been deleted, create separate links trees for different spaces
  • add storageId and storageName to map_group luma request
  • create files on storage with appropriate uids and gids

17.06.0-rc8

  • fallback to admin_ctx when luma is disabled
  • handle luma returning integer values
  • Hotfix - Improve environment variables names
  • Hotfix - update deps
  • Hotfix - prevent rtransfer from crush
  • improvements according to PR
  • improve docs according to PR, please dialyzer
  • VFS-3864 Lower default request timeout to 30 seconds
  • do not restart transfers which has been deleted, create separate links trees for different spaces
  • add storageId and storageName to map_group luma request
  • please dialyzer
  • create files on storage with appropriate uids and gids
  • VFS-3846 Do not mock oneprovider in initializer
  • Releasing new version 17.06.0-rc8
  • Update vsn in app.src file
  • do not restart failed transfers
  • Hotfix - update cluster_worker
  • VFS-3851 - fix dialyzer
  • VFS-3851 - fix rtransfer not binding to many interfaces
  • VFS-3851 fix not casting replication of first file in the tree (replication was handled by transfer_controller itself)
  • VFS-3851 - remove timeout from function awaiting rtransfer completion, delete old TODO
  • handling onedata groups in luma, added tests for luma improvements, cleaning docs after make_file or create_file failed
  • VFS-3813 Update tests
  • VFS-3813 Improve files creation performance
  • VFS-3813 Add comment to vm.args
  • refactor luma map_group request
  • fix handling uid and gid from luma as integers
  • fix storage_sync tests that use luma
  • handling onedata groups in luma, added tests for luma improvements
  • VFS-3813 Update get_provider_id
  • add spaceId to resolve_group request, split resolving acl user id and group id to different functions
  • VFS-3808 Update deps
  • add case for onedata idp in reverse_luma_proxy:get_user_id
  • VFS-3808 Update deps
  • VFS-3808 Update deps
  • VFS-3808 Update deps
  • VFS-3808 Update deps
  • Update deps
  • Update deps

17.06.0-rc8

  • do not restart failed transfers
  • VFS-3851 - fix rtransfer not binding to many interfaces
  • VFS-3851 fix not casting replication of first file in the tree (replication was handled by transfer_controller itself)
  • VFS-3851 remove timeout from function awaiting rtransfer completion
  • VFS-3813 Improve files creation performance
  • fix reverse luma not resolving onedata groups, add storage name to reverse luma request parameters
  • VFS-3686 create autocleaning links tree for each space

17.06.0-rc7

  • Fix failures connected with exometer timeouts
  • VFS-3815 Added erlang-observer as RPM build dependency
  • VFS-3686 allow to start space cleaning manually
  • VFS-3781 Added radosstriper library
  • VFS-3686 autocleaning API and model
  • Updating GUI, including: VFS-3710 - VFS-3710 Using binary prefixes for size units (IEC format: MiB, GiB, TiB, etc.)
  • Updating GUI, including: VFS-3668 - VFS-3668 Show file conflict names in files tree and change conflict name format to same as in Oneclient
  • VFS-3756 Repair session (prevent hang up)
  • VFS-3756 Update cluster_worker to prevent provider from crush when database is down
  • VFS-3763 Fixed helpers namespace in NIF
  • VFS-3763 Updated to folly 2017.10.02
  • VFS-3753 - fix storage sync failing when luma is enabled

17.06.0-rc6

  • VFS-3693 Update exometer reporters management
  • VFS-3693 Reconfigure throttling

17.06.0-rc5

  • fix error that occurs when we try to count attrs hash of deleted file
  • fix fetching luma_config

17.06.0-rc4

  • VFS-3682 Upgraded GlusterFS libraries
  • VFS-3663 Fix delete events and improve changes broadcasting
  • VFS-3616 parallelize replication of file
  • VFS-3705 recount current file size on storage when saving sequence of blocks
  • VFS-3615 resuming transfer after restart, fix of synchronization of links in transfer model
  • VFS-3705 fix quota leak
  • VFS-3701 Update logging and cluster start procedure
  • VFS-3709 add mechanism to ensure that exometer_reporter is alive
  • VFS-3701 Better provider listener healthcheck
  • VFS-3666 Event emiter does not crush when file_meta is not synchronized

17.06.0-rc3

  • VFS-3649 Emit attrs remote attrs change even if location does not exist
  • VFS-3500 Extend logging for wrong provider ids in tree_broadcast messages
  • VFS-3449 set sync_acl flag default to false
  • VFS-3549 Add endpoint for enabling space cleanup.
  • VFS-3500 Limit calls to storage when new file is created. Limit calls to storage_strategies.
  • VFS-3549 Add list operation and histograms to transfers.
  • VFS-3549 Add transfer model.
  • VFS-3500 Do not create locations during get_attrs
  • VFS-3567 Store missing documents in datastore cache
  • VFS-3449 adapting luma to new protocol, refactor of luma_cache module, added tests of reverse_luma and importing acls associated with groups, WIP
  • VFS-3449 adapting reverse luma for querying by acl username, groups handling, WIP
  • VFS-3541 Move file_popularity increment from open to release.
  • VFS-3541 Do not migrate data during replica invalidation when migration_provider_id is set to undefined.
  • VFS-3449 storage_sync supports NFS4 ACL, preparation of luma modules to support requests considering groups mapping, extended handling of acl principals in acl_logic
  • VFS-3560 Updating GUI ref
  • VFS-3495 Improve rest error handling.
  • VFS-3444 Adjuster default helper buffer values in app.conf
  • VFS-3495 Update ctool and use its new util function for getting system time. Introduce hard open time limit to space cleanup.
  • VFS-3500 Configure throttling
  • VFS-3500 Use cache of parent during permissions checking
  • VFS-3495 Add parameters to file_popularity_view.
  • VFS-3495 Add histograms to file_popularity model.
  • VFS-3498 Read_dir+
  • VFS-3500 Reconfigure throttling
  • VFS-3495 Do not ivalidate partially unique file as root (we cannot guarantee its synchronization), add space cleanup test.
  • VFS-3500 Update couchbase pool size control
  • VFS-3500 Reconfigure cluster for better performance
  • VFS-3494 Add popularity views and use them in space_cleanup.
  • VFS-3494 Move cleanup_enabled flag to space_storage doc.
  • VFS-3494 Add cleanup_enabled flag to storage doc
  • VFS-3494 Add file_popularity model tracking file open.
  • VFS-3494 Add invalidate_file_replica function to logical_file_manager and rest api.
  • VFS-3464 Added extended attributes support to storage helpers

17.06.0-rc2

  • fix overlapping imports
  • VFS-3470 Improve dbsync changes filtering and queue size control
  • VFS-3454 Use silent_read in rrd_utils.
  • Generate file_meta uuid using default method.
  • VFS-3480 Remove file_location links.
  • storage_sync improvements: use storage_import_start_time set queue_type lifo in worker_poll * reset storage_file_ctx before adding job to pool
  • VFS-3430 Adjust stress tests to refactored file_meta.
  • VFS-3430 Move periodic cleanup of permission cache to fslogic_worker, refactor file_meta.
  • VFS-3430 Adjust changes stream test to delayed creation of file_location.
  • VFS-3430 remove file_consistency.

17.06.0-rc1

  • VFS-3384 save last_update_start_time and last_update_finish_time in storage_strategies
  • VFS-3384 save luma_api_key in luma_config, fix storage_sync chmod_file_update2 test
  • VFS-3448 Use single 'onedata' bucket
  • VFS-3384 implementation of reverse_luma and luma_cache_behaviour, update of luma tests
  • VFS-3378 Enabled native GlusterFS support on OSX
  • VFS-3363 Use no_seq for saves to default bucket
  • Reconfigure couchbase pools

17.06.0-beta6

  • VFS-3366 Repair lost changes scheduling
  • VFS-3376 Use pipe character instead of dot to join and split associative ids in gui ids
  • VFS-3416 Change subscriptions updates
  • VFS-3415 Make shares in public mode be fetched using provider authorization
  • fix errors in space_sync_worker check_strategies
  • VFS-3415 Fix a routing bug causing public share links malfuntion
  • VFS-3363 Use in-memory changes counter in streams
  • Add mising proxy_via field in recursive invocation.
  • Fix provider_communicator:send_async/2
  • VFS-3361 Emit event on times update.
  • VFS-3409 Handle share requests in user context rather that provider context so all operation can be performed despite lack of support
  • VFS-3356 Add space_storage/storage accessors
  • VFS-3361 Do not create empty replicated files.
  • VFS-3363 Improve dbsync performance
  • VFS-3289 backend for metrics of storage_sync
  • VFS-3363 Fix concurent delete
  • VFS-3361 Return updated file_ctx from storage_file_manager:new_handle.
  • VFS-3361 Add 'storage_file_created' field to file_location. Split sfm_utils_create_storage file into two functions creating file and location.
  • VFS-3361 Remove empty block from file_location response.

17.06.0-beta4

  • VFS-3362 Update web-client
  • Enable storage helper buffering

17.06.0-beta3

  • Releasing new version 17.06.0-beta3

17.06.0-beta2

  • Added GlusterFS support
  • VFS-3344 Improve dbsync changes aggregation
  • VFS-3309 Remove message_id model.
  • VFS-3350 Make sure that new permissions can be safely added to the system without breaking gui compliance
  • VFS-3350 Remove deprecated privilege names
  • VFS-3326 Fix dbsync recovery stream
  • VFS-3183 - refactor of storage_sync
  • Decode cacert from pem into der format, when opening websocket connection.

3.0.0-rc16

  • Generate empty monitoring events in order to fill null data.
  • Send size of event in read/write events.
  • VFS-3183 Add fsync operation to fslogic
  • VFS-3233 Add support for sig v2 to AWS S3 helper
  • VFS-3248 Move xattrs from provider to fuse messages. Add create and replace flags to setxattr.
  • VFS-3017 Fix wrong index encoding.
  • VFS-3017 Emit file_removed event when file removal is requested.
  • VFS-3187 Execute requests synchronously in connection process.
  • VFS-3187 Add trap_exit flag to connection.
  • VFS-3017 Copy/remove files during move when non posix storage is used
  • VFS-3017 Enable file garbage collection, adjust tests to the new rename implemenetation
  • VFS-3025 Implement rename operation.
  • VFS-3025 Rewrite current remove implementation and delete rename operation.

3.0.0-rc15

  • Add token_auth translator.
  • Disable storage helpers buffering
  • VFS-3233 Add support for sig v2 to AWS S3 helper
  • VFS-3244 Switch level of dbsync periodic status logs to debug
  • VFS-3244 Do not fail on deletion_worker's init when we cannot list file handles for cleanup.
  • VFS-3244 Add file_objectid to custom_metadata document.
  • VFS-3251 Updating GUI to 3.0.0-rc15
  • VFS-3181 Add onezone URL to sessionDetails
  • Add service version info to sessionDetails in GUI
  • VFS-3213 Update cberl reference
  • VFS-3213 Add libcouchbase package dependency
  • VFS-3146 Update models specyfications
  • VFS-3146 Update hooks after datastore update
  • VFS-3146 Update datastore models to use new datastore API
  • VFS-3116 Handle chmod, truncate and updating timestamps in storage_sync
  • VFS-3088 Update dbsync state and events
  • VFS-3116 Refactor storage_import and space_sync_worker
  • VFS-3088 Integrate with refactored datastore

3.0.0-rc14

  • Dbsync uses datastore_pool to dump documents to db
  • Update cluster_worker reference
  • Do not fail dbsync posthook when we cannot chown file on storage.
  • Refactor event_manager:get_provider function.
  • Fix event proxying.

3.0.0-rc13

  • VFS-3118 Change default env value for custom gui root
  • VFS-3025 Add create_and_open operation to sfm and use it during file copying.
  • VFS-3097 Do not deserialize macaroons when it is not necessary
  • VFS-3025 Do not open file in logical_file_manager, use provided handle.
  • VFS-2961 Refactor functions duplicating code in od_user module.

3.0.0-rc12

  • Update datastore caching mechanism - use dedicated processed instead of transactions
  • VFS-2991 Add consistent_hashing library.
  • VFS-2719 Introduce limits to the frequency of reconnect attempts in subscriptions websocket client
  • VFS-2496 Fix a bug causing user updates not to include new spaces / groups
  • VFS-2496 Make sure new spaces and groups appear after creation despite not being yet synchronized from onezone
  • VFS-2496 Change relations in space-user|group-permissions models
  • VFS-2910 Reduce number of helper system threads
  • VFS-2910 Update storage detection logic
  • VFS-2496 Allow updating default space in user data backend
  • VFS-2496 Migrate to fully relational model in gui backend
  • VFS-2909 Adjust code to updated ceph lib
  • VFS-2871 Update file_consistency and dbsync
  • VFS-2835 Update change propagation controller
  • VFS-2793 Implement several simple space strategies
  • VFS-2808 Integrate new helpers.
  • VFS-2522 Do not fail when trash file index is found.
  • VFS-2829 Exclude root and guest sessions from file handles
  • VFS-2829 Use hidden file prefix for rename
  • VFS-2696 Add better error logging to backend for file acl update
  • VFS-2696 Rework file ACL model in GUI backend
  • VFS-2696 Fix a bug in GUI file rename that was breaking file paths
  • VFS-2723 Fix events routing for file subscriptions
  • VFS-2755 Send SyncResponse message with checksum and file_location instead of sending solely checksum.
  • VFS-2860 Updating frontend to 3.0.0-rc12
  • VFS-2934 Enable storage helper buffering configuration
  • VFS-2856 Improve caching of rules result, inject modified file context into function arguments.
  • VFS-2856 Permission refactoring.
  • VFS-2856 Configure new log layout in lager.
  • VFS-2496 Push update of user record on every relation update
  • VFS-2496 Change relations in group-user|group-permissions models
  • VFS-2496 Return unauthorized when trying to update a user other than the one with current session
  • VFS-2931 Reduce number of kept rotated log files
  • VFS-2910 Refactor LUMA modules
  • VFS-2856 Synchronize file before moving it between spaces.
  • VFS-2696 Refactor fslogic
  • VFS-2808 Integrate new helpers.
  • VFS-2696 Rework file permissions in GUI into one record containing POSIX and ACL perms
  • VFS-2696 Rework file ACL model in GUI backend
  • VFS-1959 Add and handle OpenFile, CreateFile and MakeFile msgs
  • VFS-2696 Implement file rename in GUI backend
  • VFS-2807 Repair mnesia overload by session_watcher
  • VFS-2522 Add support for spatial queries.
  • VFS-2773 Subscribe for monitoring events on root session only.
  • VFS-2755 Do not send location update to the client who provoked the sync.
  • VFS-2742 Change API to work with GUID-based protocol.
  • VFS-2755 Send SyncResponse message with checksum and file_location instead of sending solely checksum.

3.0.0-rc11

  • VFS-2773 Listen to more changes in /changes api and add a few new tests.
  • VFS-2764 Fix directories having 0B size in GUI
  • VFS-2764 Fix size of files being zero right after upload
  • VFS-2696 Change text/javascript to applicaiton/javascript
  • VFS-2696 Reroute events through proxy for open files.
  • VFS-2696 Fix wrong aggregarion of file_attr event.
  • VFS-2733 Add REST routes to GUI listener
  • VFS-2733 Standarize app listeners

3.0.0-rc10

  • VFS-2742 Fix aggregation for update_attr events.
  • VFS-2494 Updating GUI frontend reference
  • VFS-2703 Update mocking
  • VFS-2662 Account uploaded files in LS cache
  • VFS-2662 Fix a badly stacktrace in fslogic worker
  • VFS-2662 Append new files to the beginning of the files list
  • VFS-2662 Implement file creation compatible with pagination model
  • VFS-2662 Add ETS for LS results caching
  • VFS-2665 Add proper deserialization of handle timestamp in subscriptions.
  • VFS-2665 Update ctool and change handle timestamp type definition.
  • VFS-2524 Fix problems with acl protocol encoding, add tests for acl conversion.
  • VFS-2524 Add old acl conversion functions.
  • VFS-2400 Update to new ceph and aws libraries
  • VFS-2524 Improve translation of acl and xattr records.
  • VFS-2524 Add basic attributes to /attributes endpoint.
  • VFS-2667 Improve json encoder for DB operations
  • VFS-2524 Change format of attributes in rest.
  • VFS-2524 Fix wrong file owner in cdmi.
  • VFS-2524 Add copy operation to cdmi interface.
  • VFS-2665 Improve consistency checking in dbsync_events module
  • VFS-2659 Add some new fields to subscriptions
  • VFS-2665 Add times as component of file_consistency.
  • VFS-2665 Move times from file_meta to separate model. Fix dbsync problems.
  • VFS-2573 Repair custom metadata propagation
  • VFS-2663 Update deps, update critical section and transaction usage
  • VFS-2659 Add some fields to records synchronized from OZ
  • VFS-2659 Refactor some filed names in records
  • VFS-2659 Rework user and group models
  • VFS-2659 OP no longer differentiates between groups and effective groups
  • VFS-2659 Rename spaces field in od_user to space_aliases
  • VFS-2659 Rename some of the key records in db
  • VFS-2593 Adapt stress tests to new mechanism allowing for running many test suites
  • VFS-2573 Invalidate permission cache propagation

3.0.0-rc9

  • VFS-2609 Fix error 500 when specifying wrong url for transfer
  • VFS-2609 Fix query-index invalid parameters
  • VFS-2609 Fix error 500 when requesting nonexistent transfer
  • VFS-2609 Handle metadata filter errors
  • VFS-2609 Handle invalid json as error 400

3.0.0-rc8

  • VFS-2625 Add tests for deletion and conflit resolving for handles and handle services
  • VFS-2625 Add support for public handles
  • VFS-2625 Do not use handle get or fetch
  • VFS-2625 Fix public share view not retrieving fiels correctly
  • VFS-2625 Fix handles not being properly retrieved via REST
  • VFS-2609 Add test of setting json primitives as metadata.
  • VFS-2524 Apply recommended changes.
  • VFS-2625 Add backends for handles and handle services
  • VFS-2524 Add move operation to cdmi, split move and copy tests.
  • VFS-2625 Add handle field to share record in data backend
  • VFS-2594 Make filters work with json metadata in arrays.
  • VFS-2625 Accound handles and handle_serives in subscriptions tests
  • VFS-2625 Set default value of service properties in handle services to empty list
  • VFS-2625 Add handles and handle_services to subscriptions
  • VFS-2626 Add handle field to share_info

3.0.0-rc7

  • VFS-2567 Use ShareId and FileId in getPublicFileDownloadUrl public rpc call
  • VFS-2567 Use new approach to shared files displaying in public view
  • VFS-2567 Push container dir change upon share rename
  • VFS-2567 Share.file is now file rather than file-shared record
  • VFS-2567 Add file-property-shared record dedicated for shares view
  • VFS-2567 Add file-shared record dedicated for shares view
  • VFS-2567 Add container dir to share record
  • VFS-2567 Change name of fileProperty field in file public record
  • VFS-2567 Add reference to publi file from public metadata record
  • VFS-2567 Add public metadata record in file public record
  • VFS-2567 Make sure group type is an atom in onedata_group fetch
  • VFS-2567 Allow getting only public data about a group
  • VFS-2567 Show shares only to users with space_view_data
  • VFS-2567 Fix json and rdf metadata not being properly deleted in update callback in data backend
  • VFS-2594 Add read and execute permission for others on space dir. Block guest users from reading non shared files
  • VFS-2567 Fix some bugs in code responsible for checking view privileges
  • VFS-2594 Add check of 'other' perms for share files.
  • VFS-2567 Check view permissions in groups and shares gui backend
  • VFS-2594 Refactor lfm_proxy module.
  • VFS-2594 Move xattr name definitions to header, do not alow direct modification of xattrs with 'onedata_' prefix.
  • VFS-2594 Add remove_metadata operation.
  • VFS-2567 Check view permissions in space gui backend
  • VFS-2594 Add has_custom_metadata method to logical_file_manager.
  • VFS-2180 Implement support for read only spaces
  • VFS-2180 Add provider's ID to file_attr message
  • VFS 2557 Update tests init/teardown
  • VFS-2456 Add metadata to public view
  • VFS-2456 Implement first version of metadata backend
  • VFS-2405 Add some error handling to group privileges
  • VFS-2405 Add some error handling to space privileges
  • VFS-2405 Add error handling when user is not authorized to manage shares
  • VFS-2555 Remove shares on file removal, add doc for share_guid, decode oz 403 error as eacces.
  • VFS-2555 Add shares field to file attr.
  • VFS-2405 Adjust to new shares API in OP, fix a badmatch
  • VFS-2405 Use lfm API to create and delete share
  • VFS-2555 Implement remove_share operation and move some logic out of share_logic.
  • VFS-2555 Add Name parameter to create_share operation.
  • VFS-2405 Implement share_logic:delete
  • VFS-2555 Adjust fslogic_proxyio_test to shares.
  • VFS-2555 Improve share permissions and guest user management.
  • VFS-2555 Add protocol for operations on shares
  • VFS-2555 Add guest session, prepare api and tests for shares.
  • VFS-2405 do not use root session id in shares view
  • VFS-2405 Add mockup of public share data backend
  • VFS-2405 Add mapping in gui backend for the new space permission (manage shares)
  • VFS-2405 Further code refactor
  • VFS-2405 Adjust to new OZ model where shares are no longer spaces
  • VFS-2405 Add share specific parameters to space record

3.0.0-rc6

  • VFS-2180 Improve links conflict resolution
  • VFS-2582 Using GUI fix for blank notifications
  • VFS-2180 Adapt code to cluster_worker's API change
  • VFS-2180 Improve dbsync implementation
  • VFS-2180 Use gen_server2 instead of erlang's gen_server module
  • VFS-2390 Fix handlers specification in REST API
  • VFS-2390 Update rebar to version 3
  • Update memory management
  • VFS-2180 Allow for concurrent file creation

3.0.0-rc5

  • VFS-2534 Use erlang:system_time/1 instead of os:timestamp/0
  • VFS-2534 Skip dbsync state update if not changed
  • VFS-2543 Integrate gen_server2
  • VFS-2446 Use default group type rather than undefined in group logic
  • VFS-2472 Convert metadata to from proplists to maps.
  • VFS-2472 Do not fail when user provides empty callback for replicate operation.
  • VFS-2540 add on_bamboo variable to coverage target
  • VFS-2540 implement collecting .coverdata files in coverage.escript from many ct directories
  • VFS-2534 Improve events processing
  • VFS-2426 Add check_perms operation to logical_file_manager.
  • VFS-2472 Add 1.1 as possible cdmi version, improve documentation.
  • VFS-2472 Handle acl identifier without '#' separator.
  • VFS-2472 Add correct handling of key and keys parameters to query_index handler.
  • VFS-2490 Update op-gui-default ref
  • VFS-2472 Add filter option to metadata PUT.
  • VFS-2472 Unify file identifiers in REST interface.
  • VFS-2472 Add checking permissions to REST API operations.
  • VFS-2472 Add listing and getting inherited xattrs to REST API.
  • VFS-2472 Add inherited option to listing and getting xattrs internals.
  • VFS-2472 Add inherited option to getting json metadata.
  • VFS-2472 Add json merging function.
  • VFS-2472 Add 'inherited' option to list_xattr and get_metadata interface.
  • VFS-2472 Add escaping of user defined js function.
  • VFS-2309 oz test mock updated to match actual implementation
  • VFS-2309 implemented provider registration besed on public keys & updated tests
  • VFS-2309 listener starting fixes
  • VFS-2309 fixed public key encoding
  • VFS-2309 public key based identity endpoind

3.0.0-rc4

  • VFS-2384 Prevent unrelated events from being lost on crash.
  • VFS-2320 Move RRD databases to file system

3.0.0-RC3

  • VFS-2156 Remove GUI files
  • VFS-2311 Add private RPC to retrieve file download URL
  • VFS-2389 Change event stream management
  • VFS-2263 Do not create handles for created file if not needed
  • VFS-2189 Close connection after file upload failure
  • VFS-2319 Remove spawns on event emits
  • VFS-2402 Update cluster_worker
  • Releasing new version 3.0.0-RC2
  • VFS-2273 Handle handshake errors
  • VFS-2233 Changing separate fuse request types to nested types
  • VFS-2336 Update LUMA API to swagger version
  • VFS-2303 Fix eunit tests.
  • VFS-2303 Add metadata-id endpoint.
  • VFS-2303 Add filters for getting metadata.
  • VFS-2303 Add query-index rest endpoint.
  • VFS-2340 Minor comments update
  • VFS-2303 Adjust query_view function to handle any view option.
  • VFS-2303 Fix /index/:id PUT rest internal error.
  • VFS-2303 Add /index and /index/:id endpoints to rest API.
  • VFS-2269 Enable Symmetric Multiprocessing
  • VFS-2303 Store all user indexes in one file.
  • VFS-2303 Adjust metadata changes stream to the new metadata organization.
  • VFS-2303 Add index model.
  • VFS-2303 Add validation of metadata type.
  • VFS-2303 Add filtering by spaceID to views.
  • VFS-2303 Add view tests.
  • VFS-2303 Add better error handling for custom metadata.
  • VFS-2319 Reimplement monitoring using events
  • VFS-2303 Add support for rdf metadata.
  • VFS-2303 Move xattrs to custom_metadata document.
  • VFS-2303 Add basic metadata operations.
  • VFS-2361 Turn off HSTS by default, allow configuration via app.config
  • VFS-2340, Update deps
  • Releasing new version 3.0.0-RC1
  • VFS-2049 Improve file_consistency waiting for parent mechanism.
  • VFS-2049 Add waiting for parent_links in dbsync hook.
  • VFS-2049 Fix file_consistency wrong list ordering.
  • VFS-2303 Add custom_metadata model.
  • VFS-2229 Add reaction to rename of external file_location
  • VFS-2215 Disable blocks prefetching.
  • VFS-2215 Exclude file removal originator from event recipients.
  • VFS-2049 Make file_consistency work after system restart.
  • VFS-1847 Refactor LUMA and helpers modules
  • Squashed 'appmock/' changes from 71733d3..1f49f58
  • VFS-2049 Improve file_consistency model.
  • VFS-2233 Extract file entry to generic fuse request
  • VFS-2049 Basic consistency checking before executing hook.

3.0.0-RC2

  • VFS-2336 Update LUMA API to swagger version
  • VFS-2303 Add metadata-id endpoint.
  • VFS-2303 Add filters for getting metadata.
  • VFS-2303 Add query-index rest endpoint.
  • VFS-2303 Adjust query_view function to handle any view option.
  • VFS-2303 Add /index and /index/:id endpoints to rest API.
  • Fix reactive file displaying in GUI during file upload
  • VFS-2269 Enable Symmetric Multiprocessing
  • VFS-2303 Store all user indexes in one file.
  • VFS-2303 Adjust metadata changes stream to the new metadata organization.
  • VFS-2303 Add custom_metadatada model to sync via dbsync.
  • VFS-2303 Add index model.
  • VFS-2303 Add validation of metadata type.
  • VFS-2303 Add filtering by spaceID to views.
  • VFS-2303 Add view tests.
  • VFS-2303 Add better error handling for custom metadata.
  • VFS-2340 Repair bug in storage file manager
  • VFS-2303 Add support for rdf metadata.
  • VFS-2303 Move xattrs to custom_metadata document.
  • VFS-2340 Update file consistency management
  • VFS-2340 Add file consistency test
  • VFS-2329 Include data requested for sync in prefetching range.
  • VFS-2361 Turn off HSTS by default, allow configuration via app.config

3.0.0-RC1

  • VFS-2316 Update etls.
  • VFS-2292, Update dbsync batches storing
  • VFS-2215 Disable blocks prefetching.
  • VFS-2215 Exclude file removal originator from event recipients.
  • VFS-2215 Wrap event_manager's handle_cast in try/catch.
  • VFS-2292 Session managmenet update
  • VFS-2292 Minor initializer update
  • VFS-2292 Add os-mon
  • VFS-2250 Use wrappers for macaroon serialization
  • VFS-2214, Release handles for created files
  • VFS-2214, Update session management and lfm proxy

3.0.0-beta8

  • VFS-2254 Additional GUI model relations
  • VFS-2254 Always allow to get acl after creation.
  • VFS-2254 Return full acl record on create operation in file-acl backend..
  • VFS-2254 Change EAGAIN to EIO error on sync fail.
  • VFS-2254 Adjust file-acl protocol.
  • VFS-2197 Fail sync when rtransfer fails.
  • VFS-2254 Add acls to file_data_backend.
  • VFS-2115 Fix changing file GUID in request after merge
  • VFS-2115 Add file redirection to rename, add phantom files expiration
  • VFS-2115 Add file redirection

3.0.0-beta7

  • VFS-2225 Update GUI docker image
  • VFS-1882 Postpone deletion of open files
  • VFS-2170 Improve dbsync's protocol reliability
  • VFS-2143, Improve dbsync_worker stashed changes management
  • VFS-2187 Add automatic file removal when upload fails
  • VFS-2187 Adjust rest_test to new OZ client API
  • VFS-2187 Use new OZ REST client API from ctool that uses arbitrary Auth term rather than predefined rest client.
  • VFS-2039 Extract non-client messages from fuse_messages

3.0.0-beta6

  • Update erlang tls
  • VFS-2112 Integrate monitoring with REST API
  • VFS-2109 Adjust cdmi tests to new error messages.
  • VFS-2108 Add prefetching for unsynchronized files.
  • VFS-2109 Accept Macaroon header with token, as auth method for REST.
  • VFS-2031 Improve queue flushing in dbsync
  • VFS-2031 Remove default space
  • VFS-2109 Add support for dir replication through REST api.
  • VFS-2109 Move rest error handling logic from cdmi_exception_handler to more generic request_exception_handler.
  • VFS-2019 Add space name to luma proxy call
  • VFS-1506 Make security rules more generic.
  • VFS-2081 Make dbsync singleton
  • VFS-2018 Add response after rename
  • VFS-1506 Fix sending file attributes after replica reconciliation.
  • VFS-1506 Include file gaps in file_location's blocks.
  • VFS-1999 Use message origin instead of message sender as dbsync's provider context
  • VFS-1506 Add permission checking to utime operation.
  • VFS-2071 Adjust code to the new S3 helper
  • VFS-1999 Quota implementation
  • VFS-2018 Adding file renamed subscription
  • VFS-2018 Adding file_renamed_event
  • VFS-1854 Enable inter-provider sequencer

3.0.0-beta5

  • VFS-2050, Get file size update
  • VFS-2050, Repair errors in connections usage and dbsync batch applying
  • VFS-1987 group privileges as atoms
  • VFS-1772 unify imports in gui backend, add returned value to group join group
  • Increase limit for cdmi_id, as guid of default space in production environment has 199 bytes.
  • VFS-1772 add relation to child groups in group record
  • VFS-2050, Extend multiprovider tests
  • Cache provider info pulled from onezone
  • Allow for zombie-file delete
  • Hotfix: Ignore sequencer messages that are received from provider
  • Hotfix: Fix sending changes of unsupported spaces
  • Ignore proxied subscription messages in router.
  • Ignore dbsync changes from unsupported spaces. Do not catch exceptions inside mnesia transactions (mnesia does not like it).
  • VFS-1772 update group logic concerning privileges
  • VFS-1772 align group logic with new group API
  • VFS-1987 set & get for nested group privileges
  • VFS-2059 change default create modes for files and directories
  • VFS-2059 use recursive remove in gui backend
  • VFS-2003 Add read_event subscription to rest api.
  • VFS-1987 nested groups via fetch
  • VFS-1987 nested groups in subscriptions
  • VFS-2003 Add replicate_file rest handler.
  • VFS-2003 Add rtransfer management api to fslogic.
  • VFS-1772 add backend for groups
  • VFS-2003 Reorganize rest modules.
  • VFS-1772 introduce models for system-user system-group system-provider

3.0.0-beta4

  • VFS-1995 Syncing locations update
  • Fixing updating times in rename interprovider
  • VFS-1999 Fix Write/read subscription translate
  • VFS-1618 Fix old rmdir usage
  • VFS-1671 Update cluster_worker ref.
  • VFS-1618 Move configurable values to config
  • VFS-1618 Sort synchronization keys to avoid potential deadlocks
  • VFS-1975 Add uuid to release message, update release routing
  • VFS-1618 Add synchronization for file_meta:rename
  • VFS-1854 Improve dbsync's temp state clearing
  • VFS-1854 Disable rereplication in dbsync
  • VFS-1954 Make session:get_connections const.
  • VFS-1854 Fix GUI upload
  • VFS-1854 Fix uuid_to_path/2
  • VFS-1618 Fix storage files mode changing
  • VFS-1854 Fix merge
  • VFS-1964 Adjust permission tests to changes in required permissions for dir removal.
  • VFS-1854 Fix several cdmi tests
  • VFS-1964 Remove unnecessary unlink.
  • VFS-1964 Adjust existing implementation of recursive remove to behave like linux.
  • VFS-1618 Delete target file after checking all permissions, add ls assertions in tests
  • VFS-1618 Change tests to check acl on proper provider
  • VFS-1618 Change moving into itself detection to interprovider-friendly
  • VFS-1854 Fix fslogic's events subscribtion
  • VFS-1618 Improve permissions handling
  • VFS-1618 Enable grpca in rename tests
  • VFS-1887 Add missing implementation of release.
  • VFS-1854 Introduce logical_file_manager:release/1
  • VFS-1841 Fix target parent path usage
  • VFS-1841 Fix target path usage
  • VFS-1841 Change usage of fslogic_req modules to logical_files_manager
  • VFS-1841 Use get_file_attr to check if target exists
  • VFS-1841 Use space_info:get_or_fetch instead of oz_spaces:get_providers
  • VFS-1954 Implement Ceph helper tests.
  • VFS-1841 Fix timestamps update
  • VFS-1841 Fix usage of gen_path after merge
  • VFS-1841 Fix chmod usage in rename
  • VFS-1841 Fix sfm file copy fallback
  • VFS-1781 Fix rename permissions annotations
  • VFS-1781 Inter-space and inter-provider rename
  • VFS-1618 First sketch of interspace rename

3.0.0-beta3

  • VFS-1932 Create StorageHelperFactory with unset BufferAgent.
  • VFS-1770 dissallow spaces with empty name
  • VFS-1953 Extracting times updating to functions, handling root space
  • VFS-1770 improve gui injection script
  • VFS-1747 Change checksum algorithm to md4.
  • VFS-1770 add polling mechainsm before onedata user is synced
  • VFS-1747 Add missing status to fuse_response.
  • VFS-1747 Add checksum computing during sync.
  • VFS-1521 File GUID to UUID translation
  • VFS-1862 Integrate move implementation with cdmi. Add copy_move_test to cdmi_test_SUITE.
  • VFS-1798, enable cover
  • VFS-1521: Get providers for space from cache instead of OZ
  • VFS-1521: Fetch all space_info data in space_info:fetch
  • Adjust luma for chown operation.
  • VFS-1749 Use proper types in LUMA config
  • VFS-1751 Allow specifying request method in IAM calls
  • VFS-1596 Ceph permissions adjustment
  • VFS-1596 Refactor luma nif, use hex_utils
  • VFS-1596 More readable LUMA tests
  • VFS-1596 Move LUMA internals to module
  • VFS-1596 Move app initialization to function
  • VFS-1596 Use dedicated credentials caches instead of luma response
  • VFS-1747 Fsync files after transfer.
  • VFS-1703 Add remove file event
  • VFS-1507 Omitting handle saving for root session
  • VFS-1596 Multi storage LUMA tests
  • VFS-1596 LUMA nif entry in Makefile
  • VFS-1507 Sending file handle in get_file_location
  • VFS-1596 Accessing Amazon IAM API from provider
  • VFS-1596 Python LUMA API description
  • VFS-1507 Sending file handle in get_new_file_location, using handles in read and write
  • VFS-1596 Python LUMA implementation
  • VFS-1596 Update getting user details
  • VFS-1596 Ceph credentials mapping in provider
  • VFS-1596 Move LUMA logic to separate modules.
  • VFS-1596 LUMA and in-provider credentials mapping with switch
  • VFS-1596 Getting credentials from LUMA
  • Fix GUI download handler.
  • VFS-1768: Permissions table sorting
  • VFS-1768: Resetting old tokens after token modal close
  • VFS-1768: Sorting provider names in blocks table
  • VFS-1770 fix wrong size calculation
  • VFS-1768: Fixing token copy with selectjs - to not copy newline on start;

3.0.0-beta1

  • VFS-1802 Improve proxyio performance.
  • VFS-1521: Get providers for space from cache instead of OZ
  • VFS-1521: Resolve issues with too long document.key in dbsync's state
  • VFS-1768: BS Tooltip component; style improvements in file chunks modal
  • VFS-1768: Prevent opening space page when clicking on space settings icon; blocking Groups page with generic info message
  • VFS-1553: Improvements in permissions table; add users/groups action stub
  • VFS-1770 first reactive GUI for files
  • VFS-1553: Create and join space buttons/modals
  • VFS-1757 Change application ports availability checking procedure.
  • VFS-1549: Uploaded file name in upload widget
  • VFS-1549: Modification time display
  • VFS-1549: Dragging file on file browser initial support
  • VFS-1728-increase timeouts, timeouts definitions in separate file
  • VFS-1549: Added ember-notify
  • VFS-1745 Improve handling pending files.
  • VFS-1549: Permissions modal
  • VFS-1745 Use fslogic_storage:new_user_ctx to generate uid and gid in chown function.
  • VFS-1746, Adjust db_sync to new cluster_worker
  • VFS-1549: Modals for create dir and file
  • VFS-1549: First modal for file browser
  • VFS-1549: File browser toolbar, with previous functions
  • VFS-1734 fix a bug in unique filename resolver
  • VFS-1734 server side file upload
  • VFS-1521 Enable cross-provider subscriptions
  • VFS-1629 added delete messages handling
  • VFS-1629 user included in subscription when gets session
  • VFS-1629 propagating updates to the datastore
  • VFS-1629 connected provider to the OZ (over websocket)
  • VFS-1629 registering connection under name
  • VFS-1521 Enable file_location update in lfm
  • VFS-1629 simple user subscriptions
  • VFS-1521 Proxy read and write events
  • VFS-1521 Implement remote ProxyIO
  • VFS-1521 Improve logging
  • VFS-1521 Fixup provider proxy communication

3.0.0-alpha3

  • VFS-1598 Fix oz_plugin module.
  • Add DBSync's stream restarter
  • VFS-1558: Changes in Polish i18n
  • Include Erlang ERTS include directory when building c_src/ .

3.0.0-alpha2

  • VFS-1665 Pull in ctool with new Macaroons.
  • VFS-1405 Update cluster_worker
  • VFS-1522 Find blocks to transfer in all file locations.

3.0.0-alpha

  • Dependencies management update
  • Add map for helpers IO service. Test open and mknod flags.
  • VFS-1524 Change space storage name to space ID. Resolve space name clash problem.
  • VFS-1504 Checking if directory is not moved into its subdirectory
  • VFS-1421 Change fslogic_spaces:get_space to return space when asking as root.
  • VFS-1421 Add malformed query string error message.
  • VFS-1484 Enable storage lookup by name.
  • VFS-1484 Set number of threads for Amazon S3 storage helper IO service.
  • VFS-1421 Send PermissionChangedEvent as list of events.
  • VFS-1421 Add translations for aggregated acl types.
  • VFS-1421 Handle proxyio exceptions, adjust lfm_files_test to new api.
  • VFS-1472 Add librados and libs3 package dependencies.
  • VFS-1472 Add IO service for Amazon S3 storage helper to factory.
  • VFS-1414 Swapping Limit and Offset arguments in lfm_dirs:ls
  • VFS-1474 Changing matching to assertions, adding comments
  • VFS-1421 Change space_id to file_uuid in proxyio_request.
  • VFS-1421 Add proper handling of accept headers in rest requests, fix some minor bugs.
  • VFS-1421 Chmod on storage with root privileges during set_acl operation.
  • VFS-1421 Enable permission checking on storage_file_manager open operation.
  • VFS-1428 Add list of application ports to config file.
  • VFS-1426 Add gateways to a process group.
  • VFS-1421 Add permission control to storage_file_manager.
  • VFS-1421 Do not allow direct modification of cdmi extended attributes.
  • VFS-1421 Add mimemetype, completion_status and transfer_encoding management to logical_file_manager api.
  • VFS-1421 Add set_acl, get_acl, remove_acl as separate fslogic requests, with proper permission control.
  • VFS-1421 Check permissions on rename operation, repair incorrect mock in fslogic_req_test_SUITE.
  • VFS-1421 Return 401 in case of unauthorized access to objects by objectid.
  • VFS-1421 Perform fsync after creation of file throught REST request.
  • VFS-1428 Add user context to fslogic:get_spaces function.
  • VFS-1148 adjust listeners to new cluster_worker API
  • VFS-1428 Enable multiple ceph user credentials.
  • VFS-1148 add sync button in top menu
  • VFS-1426 Migrate rtransfer from 2.0
  • VFS-1421 Add acl validation, annotate with access checks common fslogic functions.
  • VFS-1148 allow choosing where to create new files and dirs
  • VFS-1148 add ability to create new files and dirs in gui
  • VFS-1421 Integrate acls with cdmi.
  • VFS-1148 file browser allows to preview text files
  • VFS-1148 working prototype of basic file browser
  • VFS-1421 Add acls to logical_file_manager, add acl setting integration test.
  • VFS-1421 Add groups to test environment.
  • VFS-1421 Add onedata_group model and implement basic operations on acl.
  • VFS-1400 Add compilation utility script.
  • VFS-1148 first attempts at file manger page
  • VFS-1402 CDMI redirections based on trailing slashes.
  • VFS-1398 Add xattrs to onedata_file_api and cdmi_metadata implementation.
  • VFS-1403 CDMI object PUT operation + tests.
  • VFS-1407 Add mechanism that will remove inactive sessions after timeout.
  • VFS-1404 Cdmi object get.
  • VFS-1397 Replace identity with auth in container_handler.
  • VFS-1338 Cdmi container put.
  • Use Erlang cookie defined in env.json file while creating provider spaces.
  • VFS-1363 Add user context to all storage_file_manager operations
  • VFS-1382 fixed task manager test changing wrong env
  • VFS-1382 dns listener starts with cluster_worker supervisor
  • VFS-1378 adjust to new ctool API
  • Create storages on provider.
  • VFS-1382 op-worker related work removed from cluster-worker
  • VFS-1382 node_manager config extracted
  • VFS-1338 Implement mkdir operation, add tests of container creation to cdmi test
  • VFS-1382 separated packages meant to form cluster repo
  • VFS-1382 node_manager plugin - extracted behaviour & ported implementation
  • Storage creation improvement
  • VFS-1339 Move cdmi modules to different packages. Implement binary dir put callback.
  • VFS-1218 check permissions while opening a file based on \"open flags\"
  • VFS-1289 Add performance tests for events API.
  • Fix pattern matching on maps.
  • VFS-1289 Extend set of event and sequencer tests.
  • VFS-1338 Extract api for protocol_plugins. Implement dir exists callback.
  • VFS-1218 add lfm_utils:call_fslogic
  • Refactor of malformed_request/2 and get_cdmi_capability/2.
  • Map instead of dict.
  • Include guard for cdmi_errors.hrl.
  • Skeletons of capabilities handlers.
  • VFS-1289 Extend event manager with client subscription mechanism.
  • VFS-1327 Separate rest and cdmi as abstract protocol plugins.
  • VFS-1291 Add routing to cdmi object/container modules and add some tests.
  • Done users and groups; done getting token
  • VFS-1291 Add rest pre_handler that deals with exceptions. Update ctool.
  • VFS-1291 Rearrange http_worker modules hierarchy.
  • VFS-1255 Bump Boost to 1.58 for compatibility with client.
  • VFS-1218 merge delete_file with unlink
  • VFS-1258, transactions skeleton
  • VFS-1218 implement attributes and location notification
  • VFS-1244 add possibility for client to update auth
  • VFS-1218 fix lfm read/write test
  • VFS-1242, Cache controller uses tasks
  • VFS-1242, Task pool
  • VFS-1242, Task manager skeleton
  • VFS-1217 Use RoXeon/annotations.
  • VFS-1218 add file_watcher model
  • VFS-1194 add user context to StorageHelperCTX
  • VFS-1193 better connection handling
  • VFS-1194 initial helpers support
  • VFS-1199, cache dump to disk management update
  • VFS-1193 restart mcd_cluster after connection failure
  • VFS-1199, forcing cache clearing once a period
  • VFS-1199, Saving cache to disk status management
  • VFS-1193 add configurable persistence driver
  • VFS-1172, use botan on host machine rather than throw in so files
  • VFS-1145 Integrate SSL2 into oneprovider.
  • implement generic transactions in datastore ensure file_meta name uniqueness witihin its parent scope
  • VFS-1178, Cache controller uses non-transactional saves
  • move worker_host's state to ETS table
  • use couchbase 4.0
  • VFS-1147 Integration with new protocol.
  • VFS-1147 Implementation of first operations on directories.
  • add disable mnesia transactions option
  • VFS-1129 Add deb build dependencies
  • VFS-1118, local tests controller added
  • implement mnesia links
  • VFS-1118, global cache controller added
  • VFS-1118, cache clearing skeleton
  • VFS-1115 Allow building RPM package.
  • VFS-1025, merge lb with develop
  • VFS-1053 Selecting explicit node for mnesia to join, instead of finding it randomly
  • VFS-1049 add check_permissions annotation
  • VFS-1049 add initial fslogic file structure
  • VFS-1051 change worker startup order
  • implement datastore: 'delete with predicates' and list
  • VFS-997 Add event stream periodic emission ct test.
  • VFS-997 Add event stream crash ct test.
  • VFS-997 Event manager ct test.
  • VFS-997 Add event utils and unit test.
  • VFS-1041, add send data endpoint to remote control
  • checking endpoints during healthcheck of http_worker and dns_worker
  • VFS-997 Change sequencer manager connection logic.
  • move session definitions to separate header
  • change location of message_id header
  • extract certificate_info to separate header
  • client_communicator lib
  • VFS-1000, add logical and storage file manager's API design
  • oneproxy CertificateInfo message
  • new handshake
  • VFS-1000, add sequence support for response mocking
  • VFS-997 Add sequencer worker.
  • translation improvements
  • serialization improvements
  • VFS-1010 Make test master node discoverable through DNS.
  • client_auth + basic integration with protobuf
  • VFS-997 Add sequencer dispatcher ct test.
  • VFS-997 Sequencer logic.
  • VFS-997 Add sequencer.
  • move datastore init to node_manager
  • change created beam location to target dir
  • refactor worker_host header
  • add input_dir/target_dir configuration
  • enable init_cluster triggering when all nodes have appeared
  • rest/ccdmi function headers
  • remove request_dispatcher.hrl
  • remove node_manager.hrl
  • node_manager refactoring
  • oneprovider app reformat + doc adjustment
  • http_worker reformat + doc adjustment
  • redirector reformat + doc adjustment
  • session_logic and n2o_handler reformat + doc adjustment
  • rest_handler reformat + doc adjustment
  • cdmi_handler reformat + doc adjustment
  • dns_worker reformat + doc adjustment
  • logger_plugin reformat + doc adjustment
  • worker_plugin_behavior reformat + doc adjustment
  • worker_host reformat + doc adjustment
  • client_handler and provider_handler reformat + doc adjustment
  • request_dispatcher reformat + doc adjustment
  • oneproxy reformat + doc adjustment
  • gsi_nif reformat + doc adjustment
  • gsi_handler reformat + doc adjustment
  • node_manager_listener_starter reformat + doc adjustment
  • node_manager reformat + doc adjustment
  • cluster manager reformat + doc adjustment

v2.5.0

  • VFS-965, full functionality of spaces page
  • Perform operations asynchronously in ws_handler.
  • VFS-965, several funcionalities of page spaces
  • VFS-965, visial aspects of spaces page
  • VFS-965, first code for spaces page
  • VFS-959 Not sending notifications for a fuse that modifies a file.
  • set fuseID to CLUSTER_FUSE_ID during creation of file_location
  • VFS-954, adjust to new file blocks API
  • setting fslogic context
  • VFS-939 Implement rtransfer.
  • VFS-954, implementation of data distribution panel
  • VFS-952 support for AttrUnsubscribe message
  • VFS-593, GR push channel messages handling
  • getting size from available blocks map, instead of storage
  • creating file location for remote files
  • creating file location for empty remote files moved to get_file_location
  • VFS-940 Subscribing for container state events.
  • VFS-940 Add rt_map specialization.
  • informing client about available blocks
  • VFS-940 Add provider id to rt_block + clang-format.
  • VFS-940 Add rt_container abstraction.
  • VFS-939 Basic draft of rtransfer worker.
  • add get_file_size api
  • VFS-937 Saving provider ID in CCM state.
  • VFS-937 Add Global Registry channel.
  • register for db_sync changes
  • VFS-919 Module monitoring lifecycle.
  • VFS-889 first working dbsync prototype based on BigCouch long poll Rest API
  • remote location module - new data structure and basic api for sync purposes
  • VFS-896 Redesign communication layer of the Gateway module.

v2.1.0

  • conflicts resolved
  • VFS-900 Fix developer mode in gen_dev.
  • VFS-900 Fix onedata.org domain conversion.
  • VFS-900 Update onepanel ref.
  • VFS-900 Disable developer mode by default.
  • VFS-900 Fix gen_dev.
  • VFS-900 Add html encoding and fix some minor bugs.
  • VFS-900 Layout change.
  • VFS-900 Fix popup messages.
  • VFS-900 Apply recommended changes.
  • Remove config/sys.config.
  • VFS-900 Fix comments.
  • VFS-900 Update onepanel ref.
  • VFS-900 Add missing quote.
  • VFS-900 Change client download instructions.
  • VFS-900 Fix start of nodes management test.
  • VFS-900 Fix start of high load test.
  • VFS-900 Change format of some configuration variables.
  • VFS-900 Remove yamler.
  • versioning improvement
  • change versioning to fit short version format
  • change versioning not to include commit hash
  • package deb in gzip format (it's easier to sign such package with dpkg-sig)
  • VFS-923 Remove unnecessary provider hostname variable from start oneclient instruction.
  • VFS-923 Change client installation instructions.
  • ca certs loading fix
  • VFS-923 Change client package name.
  • VFS-923 Update client installation instructions.
  • release notes update
  • VFS-613, fix debounce fun
  • VFS-613, fix debounce function not being called prooperly
  • remove unused definitions
  • test adjustment
  • group hash improvement
  • client ACL fix
  • VFS-613, add debounce fun
  • VFS-897 Fix description.
  • VFS-613, move bootbox.js to template
  • VFS-613, merge with develop
  • VFS-613, fix top menu on all pages
  • VFS-613, fix collapsing top menu
  • VFS-613, adjust css

v2.0.0

  • VFS-897 Use effective user privileges on page_space.
  • VFS-897 Using effective user privileges.
  • VFS-899 Add breadcrumbs.
  • VFS-894, support for groups in acls
  • disable directory read permission checking
  • handling acl errors + some bugfixes
  • additional group synchronization
  • group permission checking
  • VFS-895 Add RPM package install files progress indicator.
  • VFS-888 Map files to blocks.
  • Include krb and ltdl dylibs in release
  • delete write permission check during set_acl cdmi request
  • delete read permission check during get_acl request
  • VFS-886, add posix and acl tabs for perms
  • VFS-886, add radio buttons
  • VFS-881 Minor GUI web pages refactoring.
  • VFS-881 Add groups management.
  • VFS-881 Add space privileges management page.
  • VFS-880 special characters in cdmi, + some minor fixes
  • VFS-881 Using privileges to enable/disable user actions.
  • VFS-886, modify chmod panel to include ACLs
  • VFS-888 Add file_block DAO record and move file_location into separate documents.
  • doc update
  • checking perms in cdmi
  • checking acl perms in storge_files_manager
  • VFs-859 Spaces and tokens web pages refactoring.
  • VFS-676 Update GRPCA.
  • VFS-855, change buttons to link to make them work without websocket
  • VFS-855, add download_oneclient page
  • send access token hash to user
  • VFS-828 Allow user authentication through HTTP headers.
  • Getting and setting user metadata for CDMI.
  • Add user matadata to file attrs
  • VFS-829: improve error recovery while moving files between spaces

1.6.0

  • Security mechanism against attack for atoms table added
  • Invalid use of WebGUI cache fixed

1.5.0

  • WebGUI and FUSE client handler can use different certificates.
  • Xss and csrf protection mechanisms added.
  • Attack with symbolic links is not possible due to security mechanism update.

1.0.0

  • support multiple nodes deployment, automatically discover cluster structure and reconfigure it if needed.
  • handle requests from FUSE clients to show location of needed data.
  • provide needed data if storage system where data is located is not connected to client.
  • provide Web GUI for users which offers data and account management functions. Management functions include certificates management.
  • provide Web GUI for administrators which offers monitoring and logs preview (also Fuse clients logs).
  • provide users' authentication via OpenID and certificates.
  • provide rule management subsystem (version 1.0).
  • reconfigure oneclient using callbacks.

Generated by sr-release.