Skip to content

[BUG]: File expiry set on logical files and sasha is not removing them #48

@rpastrana

Description

@rpastrana

Description

The DataOps team reports they have file expiry set on files located on the anr thor cluster, that are not members of a superifle, and they are not being removed by sasha. This is causing disk space issues on the thor (10.194.27.1 - 8). I looked up one example.

File name: thor::base::ock_p2::inc::20251203_2::monitoring_auto_unsuppressed_backup

Looking in logical files on eclwatch:

image (1)-20260120-161831.png

The file is set to expire on 12/24. I checked the sasha logs that are on 10.194.112.102 and I don’t see where the removal was ever tried on 12/31, which is the only log the file name appears.

saserver.2025_12_31.log:000C3856 2025-12-31 22:26:00.862 1755280 1755697 "XREF: [thor_anr_storage] Process file thor::base::ock_p2::inc::20251203_2::monitoring_auto_unsuppressed_backup"

saserver.2025_12_31.log:0010AE5B 2025-12-31 23:32:34.488 1755280 1755697 "WARNING: /var/lib/HPCCSystems/hpcc-data/thor/thor/base/ock_p2/inc/20251203_2/monitoring_auto_unsuppressed_backup._$P$_of_400: Orphans ignored as thor::base::ock_p2::inc::20251203_2::monitoring_auto_unsuppressed_backup exists"

I am not sure why this is not working. Can someone please investigate? The thors in alpha prod are dangerously low on space and having files not being removed is not helping.

Steps to Reproduce

Expected Behavior

sasha should attempt to remove the file upon expiry

Actual Behavior

file is not removed

HPCC Systems Version

9.10.76

HPCC4J Module

wsclient - Web service clients for HPCC ESP services

HPCC4J Version

9.10.76

Java Version

java 11

Environment/Configuration

https://alpha_prod_thor_esp.risk.regn.net:18012/

Code Sample

Additional Context

No response

Pre-submission Checklist

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions