✨ [open-api-framework#188] add csv option to data dump script

[Floris272]

Partially closes maykinmedia/open-api-framework#188

Changes

• adds csv flag to dump_data script

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 83.96%. Comparing base (9025da3) to head (df507e5).
⚠️ Report is 41 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #685      +/-   ##
==========================================
+ Coverage   82.33%   83.96%   +1.62%     
==========================================
  Files         130      131       +1     
  Lines        2463     2488      +25     
  Branches      200      198       -2     
==========================================
+ Hits         2028     2089      +61     
+ Misses        392      354      -38     
- Partials       43       45       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[Floris272]

Currently it checks if the CSV_OUTPUT_DIR exists but maybe it would be better if it creates it as well or that the default one exists in the project using .gitkeep?

In this project the core app does not have many tables but for openzaak for example it should probably be a zip/tar?

[stevenbal]

@Floris272 how much work would it be to export it to a .zip? I think that's probably ideal, otherwise let's make sure the CSV output dir always exists

[github-actions]

Bencher Report

Branch	feature/oaf-188-add-csv-option-to-data-dump-script
Testbed	ubuntu-latest

🚨 2 Alerts

Benchmark	Measure Units	View	Benchmark Result (Result Δ%)	Upper Boundary (Limit %)
performance_test/tests/test_objects_list.py::test_objects_api_list_large_page_size_page_1	Latency milliseconds (ms)	📈 plot 🚷 threshold 🚨 alert (🔔)	271.25 ms (+7.22%) Baseline: 252.98 ms	265.63 ms (102.11%)
performance_test/tests/test_objects_list.py::test_objects_api_list_large_page_size_page_5	Latency milliseconds (ms)	📈 plot 🚷 threshold 🚨 alert (🔔)	268.11 ms (+6.55%) Baseline: 251.64 ms	264.22 ms (101.47%)

Click to view all benchmark results

Benchmark	Latency	Benchmark Result milliseconds (ms) (Result Δ%)	Upper Boundary milliseconds (ms) (Limit %)
performance_test/tests/test_objects_list.py::test_objects_api_list_filter_by_object_type	📈 view plot 🚷 view threshold	111.73 ms (+4.62%) Baseline: 106.79 ms	112.13 ms (99.64%)
performance_test/tests/test_objects_list.py::test_objects_api_list_filter_one_result	📈 view plot 🚷 view threshold	20.62 ms (+1.82%) Baseline: 20.25 ms	21.27 ms (96.97%)
performance_test/tests/test_objects_list.py::test_objects_api_list_large_page_size_page_1	📈 view plot 🚷 view threshold 🚨 view alert (🔔)	271.25 ms (+7.22%) Baseline: 252.98 ms	265.63 ms (102.11%)
performance_test/tests/test_objects_list.py::test_objects_api_list_large_page_size_page_5	📈 view plot 🚷 view threshold 🚨 view alert (🔔)	268.11 ms (+6.55%) Baseline: 251.64 ms	264.22 ms (101.47%)
performance_test/tests/test_objects_list.py::test_objects_api_list_small_page_size_page_20	📈 view plot 🚷 view threshold	125.76 ms (+3.32%) Baseline: 121.72 ms	127.80 ms (98.40%)

🐰 View full continuous benchmarking report in Bencher

[Floris272]

@Floris272 how much work would it be to export it to a .zip? I think that's probably ideal, otherwise let's make sure the CSV output dir always exists

Didn't take much work, made export directory static and added it to the project, after the zip has been created all .csv files will be deleted in csv_dumps

[stevenbal]

Some stuff related to running the command in docker, forgot to test this previously

[stevenbal]

comment remaining about pg client version