Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Created magorshunov/layoutlm-invoices README.md File #21

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 37 additions & 0 deletions magorshunov-layoutlm-invoices/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
![Cover](https://user-images.githubusercontent.com/66431403/267597217-2285216a-209c-466b-a0da-ab610356c2af.png)

# layoutlm-invoices

## DagsHub Repository: https://dagshub.com/Rutam21/layoutlm-invoices

## Source: [HuggingFace layoutlm-invoices Model](https://huggingface.co/magorshunov/layoutlm-invoices)

# Description

This is a fine-tuned version of the multi-modal LayoutLM model for the task of question answering on invoices and other documents. It has been fine-tuned on a proprietary dataset of invoices as well as both SQuAD2.0 and DocVQA for general comprehension.

# Fine Tune Results

## Non-consecutive tokens

Unlike other QA models, which can only extract consecutive tokens (because they predict the start and end of a sequence), this model can predict longer-range, non-consecutive sequences with an additional classifier head. For example, QA models often encounter this failure mode:

### Before

![Before Results](https://dagshub.com/Rutam21/layoutlm-invoices/raw/main/before.png)

### After

However this model is able to predict non-consecutive tokens and therefore the address correctly.

![After Results](https://dagshub.com/Rutam21/layoutlm-invoices/raw/main/after.png)

# License

This model is available on HuggingFace under the CC by NC-SA 4.0 License.

# Citation

```citation
This model was created by the team at Impira.
```