Release 2.0.0b9 - beta quality, for testing only

[ThomasWaldmann]

borgbackup 2.0.0b9 beta release - do not use this on production backup repositories.

Long changelog:
https://borgbackup.readthedocs.io/en/2.0.0b9/changes.html#version-2-0-0b9-2024-07-20

If you use pip to install this, use: pip install "borgbackup==2.0.0b9"

Docs: https://borgbackup.readthedocs.io/en/2.0.0b9/

---

This discussion was created from the release Release 2.0.0b9 - beta quality, for testing only.

[BapRx]

Hey @ThomasWaldmann,

I have the following error after upgrading to 2.0.0b9, I see it's a part of the code which has been recently refactored:

33 self tests completed in 0.24 seconds
Verified integrity of /srv/backups/srv01/index.1821
security: read previous location '/srv/backups/srv01'
security: read manifest timestamp '2024-07-21T14:33:43.313279+00:00'
security: determined newest manifest timestamp as 2024-07-21T14:33:43.313279+00:00
security: repository checks ok, allowing access
Creating archive at "/srv/backups/srv01"
Using /root/.cache/borg/1bcf0fefcc98bbe98f3d4c0c80d0c0036cb4454216c1d7ee68cfd7fc89d03ee5 as cache
Downloading chunk list...   0%
Downloading chunk list...  54%

Cache: downloaded 185240 chunk IDs in 0.14 s (3 requests), ~46.31 MB/s
Reading files cache ...
Verified integrity of /root/.cache/borg/1bcf0fefcc98bbe98f3d4c0c80d0c0036cb4454216c1d7ee68cfd7fc89d03ee5/files
security: read previous location '/srv/backups/srv01'
security: read manifest timestamp '2024-07-21T14:33:43.313279+00:00'
security: determined newest manifest timestamp as 2024-07-21T14:33:43.313279+00:00
security: repository checks ok, allowing access
Processing files ...
Initializing cache transaction: Reading config
Initializing cache transaction: Reading files

Cleaned up 1 uncommitted segment files (== everything after segment 1821).
Verified integrity of /srv/backups/srv01/hints.1821
Local Exception92 MB U 13 N root/.borgmatic/sqlite_databases/localhost/k3s

Error:

TypeError: ChunkListEntry.__new__() takes 3 positional arguments but 33 were given

If reporting bugs, please include the following:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/__init__.py", line 656, in main
    exit_code = archiver.run(args)
                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/__init__.py", line 549, in run
    rc = func(args)
         ^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/_common.py", line 158, in wrapper
    return method(self, args, repository=repository, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/create_cmd.py", line 280, in do_create
    create_inner(archive, cache, fso)
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/create_cmd.py", line 169, in create_inner
    self._rec_walk(
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/create_cmd.py", line 539, in _rec_walk
    self._rec_walk(
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/create_cmd.py", line 539, in _rec_walk
    self._rec_walk(
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/create_cmd.py", line 539, in _rec_walk
    self._rec_walk(
  [Previous line repeated 1 more time]
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/create_cmd.py", line 479, in _rec_walk
    status = self._process_any(
             ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/borg/archiver/create_cmd.py", line 296, in _process_any
    return fso.process_file(
           ^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/borg/archive.py", line 1558, in process_file
    known, chunks = cache.file_known_and_unchanged(hashed_path, path_hash, st)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/borg/cache.py", line 609, in file_known_and_unchanged
    chunks = [ChunkListEntry(*chunk) for chunk in entry.chunks]  # convert to list of namedtuple
              ^^^^^^^^^^^^^^^^^^^^^^
TypeError: ChunkListEntry.__new__() takes 3 positional arguments but 33 were given

Platform: Linux borgmatic-74c4cfcb7d-hhpqx 6.4.3-060403-generic #202307110536 SMP PREEMPT_DYNAMIC Tue Jul 11 05:43:58 UTC 2023 x86_64
Linux: Unknown Linux
Borg: 2.0.0b9  Python: CPython 3.12.3 msgpack: 1.0.8 fuse: llfuse 1.5.0 [pyfuse3,llfuse]
PID: 1251  CWD: /
sys.argv: ['/usr/local/bin/borg', 'create', '--exclude-from', '/tmp/tmpqjytq9wc', '--exclude-if-present', '.nobackup', '--one-file-system', '--read-special', '--stats', '--debug', '--show-rc', '--progress', '--repo', '/srv/backups/srv01', '{hostname}-{now:%Y-%m-%dT%H:%M:%S.%f}', '/etc/borgmatic.d/config.yaml', '/root/.borgmatic', '/var/lib/rancher/k3s']
SSH_ORIGINAL_COMMAND: None


terminating with error status, rc 2

Tell me if you need more info and how I can get it

[ThomasWaldmann]

The format of the files cache changed.

Either manually remove the file or do:

borg rdelete --cache-only -r REPO

Update: fixed command to rdelete.

[BapRx]

Thank you, I manually deleted the cache directory and the next run went through. borg delete --cache-only doesn't exist, I think it's borg rdelete --cache-only if anyone else has the issue.

[ThomasWaldmann]

BTW, it would be good if some users test this with BIG repos and maybe even multiple-client-one-repo scenarios and give back feedback about how well that works.

Of course, do that additionally to your production backups.

[ThomasWaldmann]

PSA: be aware that you need addtl. commands with b9 to free space, see the 2.0.0b9 changelog entry or #8324.