New Optimized Data Sync Manager with Parallel Data Sync Feature#5

Merged

jairajdev merged 14 commits intodevfrom

parallel-data-sync

Nov 17, 2025

Commits on Nov 17, 2025

feat: implement parallel sync with performance optimizations
jairajdev
committed
feat: enhance API request handling with gzip support and improved response size logging
jairajdev
committed
Enhance API timing logs with compression metrics and standardize naming
jairajdev
committed
refactor: rename ParallelCycleSync to ParallelDataSync and simplify sync architecture
jairajdev
committed
Add DataSyncManager for intelligent cycle-based data synchronization
jairajdev
committed
refactor: optimize data sync with improved anomaly detection and gap finding
jairajdev
committed
Refactor ParallelDataSync to use unified data fetching and improve batch processing
jairajdev
committed
fix: improve sync statistics and throughput calculation
jairajdev
committed
feat: add parallel fetching to data_sync_checker script
jairajdev
committed
Add deserialization timing tracking and improve error handling in parallel sync
jairajdev
committed
feat: implement buffered database writes with serialized queue for parallel sync
jairajdev
committed
feat: optimize receipt deserialization by processing in chunks to prevent event loop blocking
jairajdev
committed
refactor: Adjust Parallel Sync configurations for optimal performance
jairajdev
committed
feat: enhance logging for cycle and receipt comparisons in DataSyncManager
jairajdev
committed