-
Notifications
You must be signed in to change notification settings - Fork 0
Description
Description
The DataOps team reports they have file expiry set on files located on the anr thor cluster, that are not members of a superifle, and they are not being removed by sasha. This is causing disk space issues on the thor (10.194.27.1 - 8). I looked up one example.
File name: thor::base::ock_p2::inc::20251203_2::monitoring_auto_unsuppressed_backup
Looking in logical files on eclwatch:
image (1)-20260120-161831.png
The file is set to expire on 12/24. I checked the sasha logs that are on 10.194.112.102 and I don’t see where the removal was ever tried on 12/31, which is the only log the file name appears.
saserver.2025_12_31.log:000C3856 2025-12-31 22:26:00.862 1755280 1755697 "XREF: [thor_anr_storage] Process file thor::base::ock_p2::inc::20251203_2::monitoring_auto_unsuppressed_backup"
saserver.2025_12_31.log:0010AE5B 2025-12-31 23:32:34.488 1755280 1755697 "WARNING: /var/lib/HPCCSystems/hpcc-data/thor/thor/base/ock_p2/inc/20251203_2/monitoring_auto_unsuppressed_backup._$P$_of_400: Orphans ignored as thor::base::ock_p2::inc::20251203_2::monitoring_auto_unsuppressed_backup exists"
I am not sure why this is not working. Can someone please investigate? The thors in alpha prod are dangerously low on space and having files not being removed is not helping.
Steps to Reproduce
Expected Behavior
sasha should attempt to remove the file upon expiry
Actual Behavior
file is not removed
HPCC Systems Version
9.10.76
HPCC4J Module
wsclient - Web service clients for HPCC ESP services
HPCC4J Version
9.10.76
Java Version
java 11
Environment/Configuration
https://alpha_prod_thor_esp.risk.regn.net:18012/
Code Sample
Additional Context
No response
Pre-submission Checklist
- I have checked the Common Issues and Solutions wiki