fix parsing hidden directories

[ogmanojdev]

skips parsing directories like .git, .dvc, .cache, .venv, etc.

[rafiattrach]

The dotfile default makes sense for this tool's use case. One small ask: could you add a logger.debug when files are skipped due to hidden paths? Silent filtering is hard to debug if someone's data happens to live under a dotfile directory. Something like:

skipped = [f for f in files if any(part.startswith(".") for part in f.parts)]                                                                                              
if skipped:     
    logger.debug("Skipping %d file(s) in hidden directories", len(skipped))
files = [f for f in files if f not in skipped]                                                                                                                             

with that it would be great!

[rafiattrach]

Please see comment above, thanks!

[ogmanojdev]

added logger to capture skipped files and also a new test case