Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[abfs] Fix download by reading file correctly instead of extra 1 byte…
… always with every chunk (#3472) - When trying to read the file, we are giving wrong endByte value as per https://learn.microsoft.com/en-us/rest/api/storageservices/specifying-the-range-header-for-blob-service-operations#format-2-bytesstartbyte-endbyte. - We were reading 1 byte extra for every 1MB chunk size value i.e instead of 0-1023 we were sending 0-1024. This was messing up with the downloaded file and lead to truncation of end bytes to fit the downloaded size. Header['range'] = headers['range'] = 'bytes=x-y' in this x is starting point and y is end point and both are included hence we removed the 1 byte from y to make sure we are not duplicating the bytes. - We checked and this issue is only for ABFS, other FS in Hue should not show this behaviour.
- Loading branch information