Cells 2.0.5 - Bugfix and performance release

Cells 2.0.5 is a performance and bugfixes release. A couple of additional safety mechanisms were added to prevent wrong data manipulation.

• Drastically improved memory consumed by Cells forked processes, that used to load static assets in memory although not necessary.
• Frequent CPU spikes could be detected when storing many secrets in the internal Vault, which is now fixed.
• Long-running move/rename operations are now locking the branch to avoid concurrent index modification.
• ACLs deleted through internal events are not anymore deleted but flagged as expired, to ease Cells recovery in case of FS backup/restore.
• Additional checks were added at localFS datasources creation, to prevent creating datasources on nested path, or confusing between host and IP.
• WebDAV server: authentication was required twice at first request, trailing slash on /dav URL is no more required, self-signed support.
• Improved some cells CLI commands (help/messages displayed, ability to pass a go template to cells version command)
• Improved performances when updating index by uuid.
• Fixed bookmarks redirection when inside a Workspace/Cell with multiple roots.

Change log

You can find a summary of the change log here.

Cells 2.0.4 - Bugfix release

This is a bugfixes release.

• Fix limitation on s3 datasource when moving files bigger than 5GB, and some edgecases on Azure/GCS datasources
• New cli command user set-pwd to reset a password from command line
• UX fixes in admin logs and audit boards (cells enterprise)
• Remove key error at startup when relaunching an install on an existing DB.
• Throttle number of status message sent by scheduler tasks

Change log

You can find a summary of the change log here.

Cells 2.0.3 - Performance Release

Cells 2.0.3 is focused on performance. We have identified potential important memory and CPU hogs, that eventually lead to high memory consumption and services failure. For important files volumetry, mem and cpu usage are now drastically reduced and stabilized.

Upgrade is highly recommended and is straightforward with the in-app tool. As always, do not forget to use the setcap command before restarting if you bind to 80 or 443.

Performances

• MEM : Fix undeleted cache sessions from memory
• CPU : drastically reduce the number of goroutines in many locations :
  • Federate all config watchers to start only one per process
  • Adding non-locking log syncer and properly close scheduler dispatchers
  • Closing scheduler tasks properly
  • Search subscriber : filter events earlier in the process
• CPU : optimize "clean versions for deleted nodes" action
• MEM : Reduce "sortClosestMove" complexity when moving many files with same ETag (but still some room for improvements).
• DB access : add a skipFolderSize parameter on GetNodeTree to avoid this step during move
• Code : Always defer cancel when using WithTimeout()
• Improve profiling output : send pprof profiles in a dedicated folder with timestamp (using kill -SIGUSR1).

Services bug fixes and improvements

• Fix edge case for "move inside move" in index cache
• Binary update : safe move backup file after update, to avoid cross-device link rename error if running on a mounted volume
• Add a flag to stop server after installation
• Fix unique file compression
• Properly clear unused rules when updating security policies groups
• Clean logs in encryption keys service
• Views library : generic permissions checks when used in Wrapped context, use WrappedCanApply factorized methods

UX

• Publish new activity on usermeta update and new comment posted
• JS uploader: add a backoff on uploader retry, display error to user, missing some strings and their translations in overwrite alert dialog
• Validation check on metadata JsonValue before storing, to avoid breaking display if JSON is not valid.
• Massive clean of AdminPeople library
• Fix log table being refreshed on window resize

Change log

You can find a summary of the change log here.

Cells 2.0.2 - Bugfix and security release

Cells 2.0.2 is a bugfix and security release, upgrade is highly recommended.
It also improves S3 datasources with the support of multiple buckets.

Below is a detailed changelog :

• S3 Datasource : list buckets in admin interface and pick one or many using a regular expression
• Fixed wrong error management inside streams listing, which could lead to unexpected behavior with Cells Sync
• Added support for command completion on the cells binary
• Force reset url when changing tls configuration (particularly when port is 80)
• Added a parameter to disable mobile browsers "smart banner" (link to app stores)
• User Address book: fixed various UX glitches, re-wired DM button
• Admin console : prevent removing roles that have the auto-apply attribute (they would be re-added anyway)
• Disable remote download by default and add black/white list parameters
• Fixed notifications digest that did not support share event and could lead to empty digest email
• Fixed readonly status for public links to enable Collabora edition
• Lower log for invalid token as it would show unnecessary errors in the logs

Change log

You can find a summary of the change log here.

Hotfix for 2.0

Cells 2.0.1 is a hotfix for Cells 2.0. It fixes a couple of annoying issues :

• Third-party Office Docs editors Collabora and OnlyOffice (Cells Enterprise) could have issues for saving docs back to Cells under certain conditions.
• Creating an Azure Blob Storage (Cells Enterprise) data source could break the datasources listing.
• Some APIs would misbehave when called by third-party clients logged in with the new OAuth2 mechanism.

Upgrade is easily done in-app or by replacing the binary.

Change log

You can find a summary of the change log here.

Cells 2.0

Cells 2.0 is a major milestone release, bringing new features, better performances and more stability.

Main Changes

Synchronization reboot

The vision we had when rewriting Pydio PHP in GO is finally fulfilled : we are proud to ship CellsSync, a new synchronization client written in 100% GO. CellsSync is sharing most of its code with the Cells server, and most noticeably its internal sync library is the same that is used inside Cells data sources for syncing objects service to indexes.

Please note that this tool is not yet in v1 (0.9.1) as we need more feedback from the community before tagging it as stable.

Standard Authentication

Our existing OpenID Connect layer has be extended to provide endless SSO possibilities. It is now easy to use Cells as an Identity Provider for any third-party service that is OAuth2 or OIDC compatible. Talking to our REST API has never been easier.

In Cells Enterprise, Cells can be also connected to any external OIDC or SAML identity providers.

Many other improvements

DevOps will love Cells 2.0

Listening to your continuous feedback, we took the time to polish our builds and deployments channel to make sure they meet the standards of a modern cloud architecture. We also took good care of our docs, from the admin guide to the REST APIs and the command line tools documentations.

Of course, during the course of the development cycle, we have fixed many issues and brought small improvements here and there. See the Changelog for more info!

Windows Support

Cells binaries are now available for Windows servers. Tested on Windows Server 2012 and Windows 10.

Migration Tool from Pydio 8

Import existing data (files, workspaces, ACLs, shares...) from a Pydio 8 installation into a brand new Cells installation! All P8 features are not supported but should be good enough for most usecases.

Thank you !

We want to thank all contributors, translators, proof-readers and testers from the community, who have made this release possible. Special mention for @fajo-de, @tinymins, @rossbeazley, rfonseca1923, @kristapskr, @Padtz, @christian.eberle, @nhutoanvn, @spen.aa, @PG-MANA, @i3si.suporte, @koichi, @rasca.luca, @GwynethLlewelyn, @bsinou, @ghecquet, @jthabet, @c12simple, Tobi Bleiker.

Change log

You can find a summary of the change log here.

Cells 2.0.0 rc2 - New release candidate for v2

Coming closer to general availability of Cells 2.0, the most advanced Content Collaboration Platform written in 100% Go.

Welcome CellsSync

This version provides a desktop sync client that replaces (at last) PydioSync for Cells. This is a major step in fulfilling the promise of the initial rewrite of Pydio in GO language, as CellsSync is written in the same language and shares most of its libraries with the server. For this reason, many server components where also extended under the hood.

Most important changes in Cells server :

• The Sync library, that was used inside DataSources to mirror the object service modifications to the index service of each datasource was fully rewritten. This same library is used for server-to-desktop synchronization, and can even be used in other interesting scenariis : server-side folder-to-folder sync (directly through datasources), server-to-s3 storage sync (for realtime or scheduled backups), etc.
• The Authentication brick, originaly based on Open ID Connect, has been greatly rethought to allow external applications to use the server as a standard OIDC Identity Provider. Typically, adding an account inside CellsSync opens a common OAuth2 workflow by opening the server login page and getting a token back to the application. CellsSync does not know anything about users credentials locally.

Download Cells 2.0.0-rc2 and CellsSync 0.9.0

To download and test binaries on all platforms, please refer to this Release Note document. Carefully read the "Reporting Bugs" section: we will use the CellsSync repository issues to collect feedbacks.

Change log

You can find a summary of the change log here.

Hotfix for 1.6

This release fixes a couple of annoying bugs in Pydio Cells:

• Always use a natural order for workspace list in various places of the UX,
• Optimise header size when transmitting blocks to and from an encrypted datasourse,
• Fix a security issue that led to clear transmission of encryption key between services,
• Make some cleaning to prepare a community effort that will aim at adding PostgreSQL support to Cells.

Cells Enterprise specific fixes and enhancements:

• Remove 'About' page that had Pydio specific content,
• Add a template mechanism to fully brand sent emails,
• Enhance process of synchronisation with an external LDAP directory.

Update is done in-app or by just replacing the binary. Do not forget to setcap the new binary at restart if required (when using ports 80 or 443).

Change log

You can find a summary of the change log here.

Better encryption support and polishing UX

This release provides a better support for encrypted datasources, polishes many details in the UI and fixes issues.

Authentication

• WebDAV support was broken in 1.5.3 due to an optimization of the JWT authentication token (too many roles).
• Refix too many roles stored in JWT that can overflow grpc header size.
• Improve performances of JWT checks
• Better messaging when token retrieval fails

Encryption

• We implemented a new format for storing encrypted data to improve support for both download (video streaming) and upload (multipart uploads).
• Each block now contain a header with all necessary information that can be used to reconstruct the encryption metadata in case of loss of the associated database.
• The previous format is of course still supported and will be migrated when updating a file content.

GUI

• During long-lasting operations (long uploads, external editor opened in iFrame), disable the Activity Monitor to avoid auto-logout. This auto-logout parameter can be changed in Settings.
• Ability to select for copy/paste the content of a log in the log detail window
• Added a quick filter in the Settings > Available Plugins list
• Workspaces are better sorted in user profile default workspace list
• Fix html document title when not logged
• Fix Welcome Tour when info panel is hidden and add a SKIP button.
• Improved Metadata panel by auto-saving values when possible, better support for Long Text type
• Prevent drag'n'drop on readonly folder
• Fix naming when creating an archive (was always adding a "-1" suffix)
• Check Mailer configs and expose a property to UI to disable "Send Mail" buttons if no mailer is configured
• Fix how we check that a folder is readonly for a better adaptation of buttons
• Fix user locked/unlocked message in Settings > User Editor
• Do not hide group left panel when showing search results to be able to drag'n'drop a search result inside a given group

Other

• Update nats-io client
• Do not log.Fatal() when no db is found, but check in cmd/services-start instead.
• Better validation of input fields for workspaces, cells and links labels/descriptions
• Check the {HOME}/.caddy folder writeabilty to avoid Let's Encrypt setup fail
• Add a check on email address for LE cert generation
• Added a new command in cells-ctl to flag personal folders with the recycle_root metatadata

Enterprise

• Fix the need to restart server when adding a new external users directory
• Ability to update license directly from the Settings panel.

Change log

You can find a summary of the change log here.

Fixes for 1.5

This release provides various bugfixes and improvements

• Fixed an issue when too many roles (>50) are added to a user
• Fixed an issue with too restricted permissions on Cells Visibility - Add descriptions on Visibility panels to make them more clear to users
• Fix wopi format for a wrong date display in LibreOffice Only editor
• Fix micro errors formating
• Check ulimit at install and display a warning
• Make registry load simpler
• Send welcome email on user creation
• Ping s3 endpoint at datasource sync startup
• Better validation of external URL and database credentials at install
• UX: remember last choice for image resolution (HQ/LQ) using local storage

With this release and thanks to Jesus Peces San Clemente, we now also have a complete translation for Spanish language!
Every contributor is welcome on https://crowdin.com/project/pydio-cells to help.

Change log

You can find a summary of the change log here.