After upgrading to webdav-cli 1.5.1 TrueNAS cloud sync fails. Update to 1.5.2 is even worse.

[cheikemate]

Steps to reproduce:

1. Install webdav cli on a Linux VM running in TrueNAS
2. Configure webdav service in the VM specifying http as protocol
3. Configure CloudSync task in TrueNAS to use the VM IP as targe webdav service
4. Run the task

Results:

Task runs and partially transfers the files (total files 46GB / tranferred 1.2GB). Then fails.
Error in TrueNAS is generic (http 404).
Webdav service stays on and serving requests during task execution (doesn't crash).
Webdav service writes tons of errors in the log. Examples bellow.

{"level":"info","message":"Resource not found on local database","resource":{"name":"Backups_copia_para_iphone","parentPath":"/TrueNAS Sync/Backups Sao/","path":{"base":"Backups_copia_para_iphone","dir":"/TrueNAS Sync/Backups Sao","ext":"","name":"Backups_copia_para_iphone","root":"/"},"type":"folder","url":"/TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/"},"service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.045Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync/Backups%20Sao/Backups_copia_para_iphone/\nBody: {}\nHeaders: {\"host\":\"192.168.11.206:3005\",\"user-agent\":\"rclone/v1.57.0-DEV\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXBhc3M=\",\"depth\":\"0\",\"referer\":\"http://192.168.11.206:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.051Z"}
{"level":"info","message":"[PROPFIND] Request received for folder at /TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.052Z"}
{"level":"info","message":"Resource not found on local database","resource":{"name":"Backups_copia_para_iphone","parentPath":"/TrueNAS Sync/Backups Sao/","path":{"base":"Backups_copia_para_iphone","dir":"/TrueNAS Sync/Backups Sao","ext":"","name":"Backups_copia_para_iphone","root":"/"},"type":"folder","url":"/TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/"},"service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.054Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync/Backups%20Sao/Backups_copia_para_iphone/\nBody: {}\nHeaders: {\"host\":\"192.168.11.206:3005\",\"user-agent\":\"rclone/v1.57.0-DEV\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXBhc3M=\",\"depth\":\"0\",\"referer\":\"http://192.168.11.206:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.128Z"}
{"level":"info","message":"[PROPFIND] Request received for folder at /TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.129Z"}
{"level":"info","message":"Resource not found on local database","resource":{"name":"Backups_copia_para_iphone","parentPath":"/TrueNAS Sync/Backups Sao/","path":{"base":"Backups_copia_para_iphone","dir":"/TrueNAS Sync/Backups Sao","ext":"","name":"Backups_copia_para_iphone","root":"/"},"type":"folder","url":"/TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/"},"service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.131Z"}
{"level":"info","message":"WebDav request received\nMethod: MKCOL\nURL: /TrueNAS%20Sync/Backups%20Sao/Backups_copia_para_iphone/\nBody: {}\nHeaders: {\"host\":\"192.168.11.206:3005\",\"user-agent\":\"rclone/v1.57.0-DEV\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXBhc3M=\",\"referer\":\"http://192.168.11.206:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.157Z"}
{"level":"info","message":"[MKCOL] Request received for folder at /TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.158Z"}
{"level":"info","message":"Resource not found on local database","resource":{"name":"Backups Sao","parentPath":"/TrueNAS Sync/","path":{"base":"Backups Sao","dir":"/TrueNAS Sync","ext":"","name":"Backups Sao","root":"/"},"type":"folder","url":"/TrueNAS Sync/Backups Sao/"},"service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.160Z"}
{"level":"info","message":"WebDav request received\nMethod: MKCOL\nURL: /TrueNAS%20Sync/Backups%20Sao/Backups_copia_para_iphone/\nBody: {}\nHeaders: {\"host\":\"192.168.11.206:3005\",\"user-agent\":\"rclone/v1.57.0-DEV\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXBhc3M=\",\"referer\":\"http://192.168.11.206:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.164Z"}
{"level":"info","message":"[MKCOL] Request received for folder at /TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.165Z"}
{"level":"info","message":"Resource not found on local database","resource":{"name":"Backups Sao","parentPath":"/TrueNAS Sync/","path":{"base":"Backups Sao","dir":"/TrueNAS Sync","ext":"","name":"Backups Sao","root":"/"},"type":"folder","url":"/TrueNAS Sync/Backups Sao/"},"service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.167Z"}
{"level":"info","message":"WebDav request received\nMethod: MKCOL\nURL: /TrueNAS%20Sync/Backups%20Sao/Backups_copia_para_iphone/\nBody: {}\nHeaders: {\"host\":\"192.168.11.206:3005\",\"user-agent\":\"rclone/v1.57.0-DEV\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXBhc3M=\",\"referer\":\"http://192.168.11.206:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.237Z"}
{"level":"info","message":"[MKCOL] Request received for folder at /TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.238Z"}
{"level":"info","message":"Resource not found on local database","resource":{"name":"Backups Sao","parentPath":"/TrueNAS Sync/","path":{"base":"Backups Sao","dir":"/TrueNAS Sync","ext":"","name":"Backups Sao","root":"/"},"type":"folder","url":"/TrueNAS Sync/Backups Sao/"},"service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.240Z"}
{"level":"info","message":"WebDav request received\nMethod: MKCOL\nURL: /TrueNAS%20Sync/Backups%20Sao/Backups_copia_para_iphone/\nBody: {}\nHeaders: {\"host\":\"192.168.11.206:3005\",\"user-agent\":\"rclone/v1.57.0-DEV\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXBhc3M=\",\"referer\":\"http://192.168.11.206:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.276Z"}
{"level":"info","message":"[MKCOL] Request received for folder at /TrueNAS Sync/Backups Sao/Backups_copia_para_iphone/","service":"internxt-webdav","timestamp":"2025-03-16T11:02:52.277Z"}

From the TrueNAS perspective (rclone) it seems that the resources were not properly created in the Internxt drive during first sync and every subsequent syncs fails with HTTP not found. Logs follow.

2025/03/16 10:34:38 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Elapsed time:         2.2s

2025/03/16 10:34:41 ERROR : GPS and MAPS/PDF/BarrocoDoVelho_v1.pdf: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
2025/03/16 10:34:41 ERROR : GPS and MAPS/PDF/Fonte_v1.pdf: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
2025/03/16 10:34:41 ERROR : GPS and MAPS/PDF/CantoPereiro_1e2_v1.pdf: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
2025/03/16 10:34:42 ERROR : GPS and MAPS/PDF/Cimo_da_Cha_v1.pdf: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
2025/03/16 10:34:42 ERROR : GPS and MAPS/PDF/Fontinha_v1.pdf: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
2025/03/16 10:34:42 ERROR : GPS and MAPS/PDF/Fundo_Boucinho_v1.pdf: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
2025/03/16 10:34:42 ERROR : GPS and MAPS/PDF/Ladeira_v1.pdf: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
2025/03/16 10:34:43 ERROR : GPS and MAPS/PDF/Tojal_v1.pdf: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
2025/03/16 10:34:43 ERROR : GPS and MAPS/GPS RAW data/Garmin_eTrex_Ago018-GoogleEarth.kml: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">

[cheikemate]

I have tested with rclone latest version (v1.69.1) and the problem persists.

[mlsok]

I can confirm I receive the same output when I'm trying to upload any file on Windows 10 (internxt/cli + Cyberduck). Once I switch to Fedora 41 using recommended tools (internxt/cli + Cadaver) I manage to upload files. Mapping WebDav drive using Nautilus allows me to read directories but not their content.

[b3ni]

+1 same error

[cheikemate]

I guess nobody at Internxt is monitoring this issue. Problem persists.

WebDAV implementation doesn't work. Getting tired of this.

I have acquired 5TB just for the sake of spending money.

[JuanmaCano]

same here

[cheikemate]

2025/04/03 22:09:52 ERROR : Backups Sao/Backup_Photos/103NIKON/DSCN4381.JPG: Failed to copy: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found
... 194795 more lines ...
2025/04/03 22:35:39 Failed to copy with 6490 errors: last error was: Update mkParentDir failed: <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Not Found</pre>
</body>
</html>: 404 Not Found

Errors persist.

[mcdullmedia]

Yes. they are not replying and the last meaningful news is that they are working on native support on rclone, in weeks before.
Interestingly they pretent it is working well in reddit or other places, asking user to provide logs or issues for investigation.
I would rather have their service converted to an S3 block storage.

[sourceturner]

Seems that something is going on regarding that issue at last: fix/sqlite-errors
When is this going to be added to the release?

[cheikemate]

Update cli to 1.5.2. Didn't change anything else.
Re-login to Internxt and restarted the webdav service.

Now behavior changed. TrueNAS task fails after a couple of seconds with the error.

2025/05/05 19:34:17 Failed to create file system for "remote:/TrueNAS Sync": read metadata failed: EOF

On the webdav client side I get...

{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync\nBody: undefined\nHeaders: {\"host\":\"192.168.11.211:3005\",\"user-agent\":\"rclone/v1.67.0\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXRwYXNz\",\"depth\":\"1\",\"referer\":\"http://192.168.11.211:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.270Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /TrueNAS Sync","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.273Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync\nBody: undefined\nHeaders: {\"host\":\"192.168.11.211:3005\",\"user-agent\":\"rclone/v1.67.0\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXRwYXNz\",\"depth\":\"1\",\"referer\":\"http://192.168.11.211:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.609Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /TrueNAS Sync","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.611Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync\nBody: undefined\nHeaders: {\"host\":\"192.168.11.211:3005\",\"user-agent\":\"rclone/v1.67.0\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXRwYXNz\",\"depth\":\"1\",\"referer\":\"http://192.168.11.211:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.743Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /TrueNAS Sync","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.744Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync\nBody: undefined\nHeaders: {\"host\":\"192.168.11.211:3005\",\"user-agent\":\"rclone/v1.67.0\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXRwYXNz\",\"depth\":\"1\",\"referer\":\"http://192.168.11.211:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.868Z"}

Looks like it doesn't do anything. Just times out.
I am also getting this new error if I edit the TrueNAS remote.

So... with version 1.5.1 I managed to upload 126GB of data to my drive (after lot's of errors and retries), but with 1.5.2 it fails to browse the remote. I can list files when using the cli directly in the Linux command line though.

[cheikemate]

Created a new (empty) folder in my Internxt web.

I can see the folder on the TrueNAS when browsing the remote filesystem. But the error persists.

[JanickGers85]

Update cli to 1.5.2. Didn't change anything else. Re-login to Internxt and restarted the webdav service.

Now behavior changed. TrueNAS task fails after a couple of seconds with the error.

2025/05/05 19:34:17 Failed to create file system for "remote:/TrueNAS Sync": read metadata failed: EOF

On the webdav client side I get...

{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync\nBody: undefined\nHeaders: {\"host\":\"192.168.11.211:3005\",\"user-agent\":\"rclone/v1.67.0\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXRwYXNz\",\"depth\":\"1\",\"referer\":\"http://192.168.11.211:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.270Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /TrueNAS Sync","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.273Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync\nBody: undefined\nHeaders: {\"host\":\"192.168.11.211:3005\",\"user-agent\":\"rclone/v1.67.0\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXRwYXNz\",\"depth\":\"1\",\"referer\":\"http://192.168.11.211:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.609Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /TrueNAS Sync","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.611Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync\nBody: undefined\nHeaders: {\"host\":\"192.168.11.211:3005\",\"user-agent\":\"rclone/v1.67.0\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXRwYXNz\",\"depth\":\"1\",\"referer\":\"http://192.168.11.211:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.743Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /TrueNAS Sync","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.744Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /TrueNAS%20Sync\nBody: undefined\nHeaders: {\"host\":\"192.168.11.211:3005\",\"user-agent\":\"rclone/v1.67.0\",\"authorization\":\"Basic ZmFrZXVzZXI6ZmFrZXRwYXNz\",\"depth\":\"1\",\"referer\":\"http://192.168.11.211:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-05-05T18:34:12.868Z"}

Looks like it doesn't do anything. Just times out. I am also getting this new error if I edit the TrueNAS remote.

So... with version 1.5.1 I managed to upload 126GB of data to my drive (after lot's of errors and retries), but with 1.5.2 it fails to browse the remote. I can list files when using the cli directly in the Linux command line though.

Different taste, but same error for me
#251

@larryrider Could you take a look to this issue? It's quite blocking.

[larryrider]

Hey @cheikemate !
Could you try the new 1.5.3 release (install it via npm install -g @internxt/cli) and let us know how it goes?

Any feedback would be super helpful!