add OCR Decoding support - WIP #39
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Added ResNet variants * ResNet50 example * Simplified example * fixed resnet config * [Automated] Updated coverage badge --------- Co-authored-by: Martin Kozlovsky <martin.kozlovsky@luxonis.com> Co-authored-by: GitHub Actions <actions@github.com>
* fixed incorrect class property call * fixed exporter uploading * uploadCheckpoint uploads on every checkpoint epoch * fix temp files names * updated callback readme * pre-commit run
* option to source custom code in CLI * removed empty dicts * [Automated] Updated coverage badge --------- Co-authored-by: GitHub Actions <actions@github.com>
* option to source custom code in CLI * removed empty dicts * fixed issue with removed tensor metadata in match case statements
* forbid extra fields in config * fixed configs
* automatic inference of attach index based on type signature * added inference for input and x names
* fixed link in docs * fixed repvgg backbone * fixed efficientnet
* upload logs to mlflow * added mlflwo instance * multithread log upload * fixed upload logs * fixed log file path * removed exceptions * logging exceptions * fixed typo * reverted exception * moved line * replaced warning with error log * Update trainer.py
* add archiver CLI * add archiver callback * add max_det parameter to EfficientBBoxHead * add enum to categorize tasks for the implemented heads * add archiver tests * adjust Archiver to new nn archive format * pre-comit formatting * add LDF creation and adjust to new nn archive format * update requirements.txt * add opencv-python to requirements.txt * add support for ImplicitKeypointBBoxHead * remove support for ObjectDetectionSSD * Update requirements.txt * Added mlflow and removed opencv * [Automated] Updated coverage badge * add support for SegmentationHead and BiSeNetHead * base archiver tests on model from luxonis-train instead of torchvision * adjust head parameters to changes in NN Archive * adjust keypoint detection head parameters to changes in NN Archive * bugfix - make sure self.max_det is used in nms * add max_det parameter to ImplicitKeypointBBoxHead * adjust task categorization for ImplicitKeypointBBoxHead * fixing Windows PermissionError occuring on file deletion * fixing Windows PermissionError occuring on file deletion due to unreleased logging handlers * add method to remove file handlers keeping the log file open * add a logging statement at the end of archiving * add optuna_integration to requirements.txt * add hard-coded solution to determining is_softmax parameter * added help --------- Co-authored-by: Martin Kozlovský <martin.kozlovsky@luxonis.com> Co-authored-by: GitHub Actions <actions@github.com>
* extend NN Archive generation test coverage to cover all implemented heads * [Automated] Updated coverage badge --------- Co-authored-by: GitHub Actions <actions@github.com>
* uploading all checkpoints * fix names * removed comment
* handling SIGTERM signal * resume argument takes path
* handling SIGTERM signal * resume argument takes path * basic task group labels support * updated requirements * fixed tests * fixed loader test * Update luxonis_train/models/luxonis_model.py Co-authored-by: conorsim <60359299+conorsim@users.noreply.github.com> --------- Co-authored-by: conorsim <60359299+conorsim@users.noreply.github.com>
* option to set torch matmul precision for tensor cores * updated readme
* fixed reset not being called * added metric resets * removed inheritance * proper oks reset * removed unnecessary resets * added annotations
* Added seed to config for reproducibility * fixed seg drawing when using torch deterministic backend * added deterministic order of creating nodes * removed seed from example config * added reproducability to inspect * formatting --------- Co-authored-by: DrejcPesjak <dp8949@student.uni-lj.si> Co-authored-by: Martin Kozlovský <martin.kozlovsky@luxonis.com>
* support for custom loaders and datasets * updated configs * custom loaders in inspect command * updated inspect for multi-task labels * removed custom loader from test config * deleted comment * deleted comment * removed custom dataset * removed comment * skipping archiver test untill fixed in luxonis-ml * [Automated] Updated coverage badge --------- Co-authored-by: GitHub Actions <actions@github.com>
Co-authored-by: GitHub Actions <actions@github.com>
Co-authored-by: GitHub Actions <actions@github.com>
Co-authored-by: GitHub Actions <actions@github.com>
☂️ Python Coverage
Overall Coverage
New Files
Modified Files
|
kozlov721
reviewed
Sep 10, 2024
| from .base_loss import BaseLoss | ||
|
|
||
|
|
||
| class FocalCTC(BaseLoss[Tensor, Tensor]): |
There was a problem hiding this comment.
Add class attribute supported_labels = [LabelType.TEXT] to all the losses and metrics
There was a problem hiding this comment.
Also the metrics and losses will probably require custom prepare method that takes the packed output of the head and labels and prepares argument to be passed to forward or update.
kozlov721
reviewed
Sep 10, 2024
| from luxonis_train.utils.types import LabelType | ||
|
|
||
|
|
||
| class ResBlock(nn.Module): |
There was a problem hiding this comment.
I believe both ResBlock nad DownSample should already be implemented in luxonis_train.nodes.blocks or in one of the backbones
kozlov721
reviewed
Sep 10, 2024
| return out | ||
|
|
||
|
|
||
| class OCRDecoderBackbone(BaseNode): |
There was a problem hiding this comment.
Instead of _task_type argument, add a class attribute tasks: list[LabelType] = [LabelType.TEXT]
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adding Nodes/Loss/Metric for OCR recognition/decoding
Conformity to contribution guidelines will be fixed before closing