v25.01.0

Project wise refactored version.

Major Changes

• Minimum python version 3.12 (before 3.9)
• Extract single file ingesting process and expose it as an independent command
• Thorough type-hinting
• Nested data class based configuration and related helpers
• Python related dev tools configurations in the project, i.e. ruff
• Integration test with kafka in CI

What's Changed

• Update python version to 3.12 from 3.9 by @YooSunYoung in #16
• Refactor configuration parsing option and add configuration structure using dataclass. by @YooSunYoung in #9
• Update dependencies for logging. by @YooSunYoung in #11
• Refactor logging configuration. by @YooSunYoung in #12
• Add confluent kafka as a dependency. by @YooSunYoung in #13
• Kafka configuration. by @YooSunYoung in #15
• Integration test CI by @YooSunYoung in #18
• Add Kafka connection test. (Part of integration test) by @YooSunYoung in #23
• Add more integration helpers. by @YooSunYoung in #24
• Add graylog as a dependency. by @YooSunYoung in #32
• Wrdn message by @nitrosx in #26
• Metadata configuration files by @nitrosx in #28
• Graylog integration - configuration refactoring by @YooSunYoung in #35
• Graylog integration test by @YooSunYoung in #34
• Metadata computing methods loader by @YooSunYoung in #36
• Graylog integration by @nitrosx in #29
• Background ingestor by @nitrosx in #39
• Copier update by @YooSunYoung in #38
• Add developer's guide in the readme. by @YooSunYoung in #37
• Background ingestor configuration refactoring. by @YooSunYoung in #41
• Refactoring background ingestor. by @YooSunYoung in #40
• added base and coda configuration examples by @nitrosx in #42
• Latest version of the metadata configuration file by @nitrosx in #43
• Schema selector refactor by @YooSunYoung in #45
• Metadata schema configuration and new logic by @nitrosx in #44
• updated schema configuration by @nitrosx in #46
• Scicat object schema rendering using jinja template. by @YooSunYoung in #49
• Update dependencies. by @YooSunYoung in #50
• Scicat data refactor by @YooSunYoung in #51
• [Refactoring] Jinja template refactoring by @YooSunYoung in #52
• [Refactoring] File description building/hash saving part. by @YooSunYoung in #55
• [Refactoring] Jinja template for datablock and data-file descriptions. by @YooSunYoung in #53
• Added examples of SciCat dataset and origdatablocks schema by @nitrosx in #47
• Fix typo and best practices violations. by @YooSunYoung in #59
• Refactor file instance constructor by @YooSunYoung in #60
• Refactor scicat dataset instance creation. by @YooSunYoung in #61
• Refactor scicat backend communication helpers. by @YooSunYoung in #62
• Data preparation functionalities by @nitrosx in #57
• Copier update by @YooSunYoung in #68
• System helper by @YooSunYoung in #69
• Refactor orgdatablock constructor by @YooSunYoung in #70
• Fix config by @YooSunYoung in #71
• Fix schema finding and selector by @YooSunYoung in #72
• Suppress argparser default value setter. by @YooSunYoung in #78
• Fix formatting and type-hints by @YooSunYoung in #82
• Check dataset by job id and metadata by @YooSunYoung in #75
• changes from manual testing by @nitrosx in #81
• Fix for testing patch by @YooSunYoung in #85
• Fix for testing by @nitrosx in #84
• Fix from testing 20241031 by @nitrosx in #86
• Fix scicat ingestor command in the integration test. by @YooSunYoung in #87
• Metadata stuff by @YooSunYoung in #89
• Configuration stuff by @YooSunYoung in #90
• Add online ingestor dry run mode. by @YooSunYoung in #91
• Small test dataset by @YooSunYoung in #92
• Increase maximum line length. by @YooSunYoung in #95
• All the fixes introduced while testing the production deployments by @nitrosx in #93
• Command configuration update. by @YooSunYoung in #96
• Patch fixes for deployment by @YooSunYoung in #98
• Fixes for deployment by @nitrosx in #97
• Allow only one type for a parameter and simplify the code. by @YooSunYoung in #101
• added check on number of offline ingestors and relevant configuration by @nitrosx in #100
• Fix offline command by @nitrosx in #99
• Fixed checking background offline ingestors, moved ingestor informati… by @nitrosx in #102
• Update logging for checking dataset by pid or metadata by @YooSunYoung in #113
• Update developers guide. by @YooSunYoung in #120

Full Changelog: v4.2.8...v25.01.0