SIMSBIOHUB-587 API: Bulk Captures

[MacQSL]

Links to Jira Tickets

• SIMSBIOHUB-587

Description of Changes (only backend)

• Bulk import Critterbase captures via CSV
• importCSV strategy function
• updated columnValidator spec
• import services now implement shared interface (to be injected into importCSV)
• column validator now handles optional properties

Testing Notes

• Should be able to import capture CSV file with postman

[github-actions]

Openshift URLs for the PR Deployment:

• App Route: https://biohubbc-app-1324-af2668-dev.apps.silver.devops.gov.bc.ca/
• Api Route: https://biohubbc-api-1324-af2668-dev.apps.silver.devops.gov.bc.ca/
• Pods: https://console.apps.silver.devops.gov.bc.ca/k8s/ns/af2668-dev/pods?name=1324

[NickPhura]

Regarding the csvFileSchema allowed mime types enum [text/csv]:

I'm encountering an interesting issue, where the mime type, despite the extension being .csv, is parsed as application/vnd.ms-excel.

This blog post actually mentions the same issue: https://christianwood.net/posts/csv-file-upload-validation/

Their conclusion that they just have to add more mime types to the allowed list.

The issue doesn't seem to happen through postman.

(Everything else downstream works, I just had to add that extra mime type to the openapi schema)

[github-actions]

Openshift URLs for the PR Deployment:

• App Route: https://biohubbc-app-1324-af2668-dev.apps.silver.devops.gov.bc.ca/
• Api Route: https://biohubbc-api-1324-af2668-dev.apps.silver.devops.gov.bc.ca/
• Pods: https://console.apps.silver.devops.gov.bc.ca/k8s/ns/af2668-dev/pods?name=1324

[MacQSL]

Regarding the csvFileSchema allowed mime types enum [text/csv]:

I'm encountering an interesting issue, where the mime type, despite the extension being .csv, is parsed as application/vnd.ms-excel.

This blog post actually mentions the same issue: https://christianwood.net/posts/csv-file-upload-validation/

Their conclusion that they just have to add more mime types to the allowed list.

The issue doesn't seem to happen through postman.

(Everything else downstream works, I just had to add that extra mime type to the openapi schema)

I have updated the file schema to include all of these. I can remove some if we think they are not needed.

[NickPhura]

Looks great

[sonarcloud]

Quality Gate passed

Issues
2 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
2.1% Duplication on New Code

See analysis details on SonarCloud