Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[IMPORT] Include import documentation in GeoNature documention #2970

Closed
wants to merge 120 commits into from
Closed

[IMPORT] Include import documentation in GeoNature documention #2970

wants to merge 120 commits into from

Conversation

jacquesfize
Copy link
Contributor

@jacquesfize jacquesfize commented Mar 22, 2024 •
edited
Loading

(Work in progress)
Since the import module will be included in GeoNature, this PR proposes to move its documentation in the main one.

bouttier and others added 30 commits March 8, 2024 16:17
@bouttier @jacquesfize
import schema
5a13925
@bouttier @jacquesfize
import to synthese
accae28
@bouttier @jacquesfize
update synthese import after checks rework
3cb2f60
@bouttier @jacquesfize
import to occhab
d7049df
@bouttier @jacquesfize
rework uuid checks
ceef3de
@bouttier @jacquesfize
add imports backend code from gn_module_import
c1090e7
@bouttier @jacquesfize
add dependencies required for imports
160557b
@bouttier @jacquesfize
bump pandas 1.3.5 → 2.1.4
9867b32
@bouttier @jacquesfize
add redis service required by import
2beea9a
@bouttier @jacquesfize
run test for PR on branch feat/import
4c5c293
@Pierre-Narcisi @jacquesfize
feat(import) moving import frontend into the core
9df80b7
@Pierre-Narcisi @jacquesfize
Feat(import) remove ng_module from import
3886646
@bouttier @jacquesfize
lint(import) apply prettier to imported code
d6bdde0
@Pierre-Narcisi @jacquesfize
Fix(destination) add type occhab to module occhab
c69baf8
@bouttier @jacquesfize
fix(celery): move session.remove() in app context
4f80359
@bouttier @jacquesfize
permissions: skip caching when no request context
0a7818c
@bouttier @jacquesfize
fix(occhab): defaults nomenclature for 'ALL' orga
18aba42 
Correctly handle the 'ALL' organism.
@bouttier @jacquesfize
chore(occhab): complete models
889156f
@bouttier @jacquesfize
fix(tests/imports): determinist ordering
74b9e3e 
Add entity_source_pk_value column in test file for determinist ordering.
@bouttier @jacquesfize
fix(tests/imports): use M5 instead of M10
64a03ac
@bouttier @jacquesfize
fix(imports): several checks corrections
20e0d94 
- check_dataset
- check_duplicate_uuid
- check_duplicate_source_pk
- check_orphan_rows
- check_mandatory_fields
@bouttier @jacquesfize
feat(imports): add parent/child related checks
e0e376b 
- set_id_parent_from_destination
- set_parent_line_no
- check_no_parent_entity
- check_erroneous_parent_entities
@bouttier @jacquesfize
feat(imports): add parent related error code
3e6c00f 
- NO_PARENT_ENTITY
- ERRONEOUS_PARENT_ENTITY

Thus, set WARNING error level for ORPHAN_ROW errors
@bouttier @jacquesfize
feat(imports): add preprocess transient data hook
756287c
@bouttier @jacquesfize
chore(imports): concat_dates takes columns
8748af5 
instead of fields
@bouttier @jacquesfize
feat(import/occhab): add id_station_source
49ec338
@bouttier @jacquesfize
feat(imports/occhab): add id_import FK in pr_occhab
c21020f
@bouttier @jacquesfize
feat(imports/occhab): fix checks and add import
208c381
@bouttier @jacquesfize
tests(import/occhab): improve coverage
f4e44a7
@bouttier @jacquesfize
feat(imports/occhab): preprocess transient data
ba28a58
jacquesfize and others added 22 commits March 8, 2024 16:29
@jacquesfize
fix lint
58106f5
@edelclaux @jacquesfize
doc(test): add todos for occhab impor test
d4a3178
@andriacap @jacquesfize
fix: label stats in report pdf
3b3c90a 
Reviewed-by: andriacap
@jacquesfize
merge alembic branch
7bee951
@jacquesfize
fix rebase error
d87e880
@jacquesfize
feat (mapping, import) renaming data service and variables (less ambi…
e7cca18 
…guity)
@jacquesfize
add CruvedWithScope interface + function to parse the latter to boole…
5c0a608 
…an (Cruved interface)
@jacquesfize
refactor
79d4949
@Pierre-Narcisi @jacquesfize
Feat(mapping) controling entities controls and adding a badge
3320f64
@jacquesfize
(fix) badge computation no longer block the from validation process
632af60
@jacquesfize
lint + remove console.log
bf5a4c6
@jacquesfize
remove last trace of synthese in fields-mapping component
4e3e558
@jacquesfize
feat(import list, statistic): enable generic tooltip in the import list
e8dde46
@jacquesfize
(fix) typo
5789ecc
@jacquesfize
feat(import report filename) : add item in import configuration
f992232
@jacquesfize
feat(import report filename) : add function to generate report filename
bd588cf
@jacquesfize
feat(import report filename) : add import default value in default_co…
d7e1849 
…nfig toml
@jacquesfize
fix lint + refact
4630670
@jacquesfize
indicate unused import configuration variable
e3f5dd7
@jacquesfize
update defaut_config toml
63815f7
@Pierre-Narcisi @jacquesfize
Feat(mapping) sort mapping and put a ng-select
3acdfe7
@jacquesfize
(import,doc) : import orginal documention from gn_module_import
a0e943c
@jacquesfize jacquesfize self-assigned this Mar 22, 2024
@jacquesfize jacquesfize changed the base branch from master to develop March 22, 2024 10:58
@jacquesfize jacquesfize changed the base branch from develop to feat/import March 22, 2024 10:58
@jacquesfize jacquesfize deleted the importv3_doc branch April 16, 2024 12:55
@jacquesfize jacquesfize restored the importv3_doc branch April 16, 2024 12:55
@jacquesfize jacquesfize mentioned this pull request Apr 16, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@jacquesfize jacquesfize

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@jacquesfize @bouttier @Pierre-Narcisi @andriacap @VincentCauchois @edelclaux