Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BERT finetuning #40

Open
siemdejong opened this issue Apr 12, 2023 · 1 comment
Open

BERT finetuning #40

siemdejong opened this issue Apr 12, 2023 · 1 comment
Labels
experiment An experiment to do

Comments

@siemdejong
Copy link
Owner

Research question
Does BERT finetuning increase performance?

Hypothesis
Yes, the classifier in BERT will also pull apart the word embeddings belonging to specific locations, making it easier to distinguish images with different tumour classes.

Method
Train BERT with frozen and trainable parameters. Keep everything else the same. See if the performance is increased.

Finetuning BERT will take longer as a (backward) pass through BERT is costly.

Result comments on this should include results and a discussion.
@siemdejong siemdejong added the experiment An experiment to do label Apr 12, 2023
@siemdejong
Copy link
Owner Author

This accounts for the testing in #39

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
experiment An experiment to do
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@siemdejong