Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error when no data in indep std window #29

Open
ndevilleBE opened this issue Feb 12, 2025 · 0 comments
Open

Error when no data in indep std window #29

ndevilleBE opened this issue Feb 12, 2025 · 0 comments
Assignees

Comments

@ndevilleBE
Copy link
Collaborator

The first QC of each cruise fails because there is no independent data (I think). Here is an example of logs with the timestamp:

[2025-02-11 20:13:28,432][main][INFO] - Docker image tag: rbinsbmdc/quality_assurance_tool:v0.8.4.
[2025-02-11 20:13:28,432][main][INFO] - Current git commit hash: d06aab7.
[2025-02-11 20:13:28,432][main][INFO] - Start
[2025-02-11 20:13:28,433][main][INFO] - Setup
[2025-02-11 20:13:28,446][pandassta.sta_requests][INFO] - Indep std window
[2025-02-11 20:13:28,447][pandassta.sta_requests][INFO] - Get all data.
[2025-02-11 20:13:28,447][pandassta.sta_requests][INFO] - ---- filter: phenomenonTime gt 2022-02-20T23:59:00.000000Z and phenomenonTime lt 2022-02-22T00:00:00.000000Z
[2025-02-11 20:13:28,447][pandassta.sta_requests][INFO] - ---- filter: phenomenonTime gt 2022-02-20T23:59:00.000000Z and phenomenonTime lt 2022-02-22T00:00:00.000000Z
[2025-02-11 20:13:28,447][pandassta.sta_requests][INFO] - Execute query.
[2025-02-11 20:13:28,447][pandassta.sta_requests][INFO] - Execute query.
[2025-02-11 20:13:30,322][pandassta.sta_requests][INFO] - Building dataframe.
[2025-02-11 20:13:30,324][pandassta.sta_requests][INFO] - Dataframe constructed with 0 rows.
[2025-02-11 20:13:30,325][pandassta.sta_requests][WARNING] - No data retrieved.
[2025-02-11 20:13:30,325][main][WARNING] - No data in indep std window.
[2025-02-11 20:17:44,896][pandassta.sta_requests][INFO] - Building dataframe.
[2025-02-11 20:17:57,301][pandassta.sta_requests][INFO] - Dataframe constructed with 615039 rows.
[2025-02-11 20:17:57,306][pandassta.sta_requests][INFO] - Quality flag counts as downloaded: {"0":395883,"2":198228,"4":20928,"1":0,"3":0,"5":0,"6":0,"7":0,"8":0,"9":0,"A":0,"B":0,"Q":0}
Error executing job with overrides: ['+time.start=2022-02-20 23:59:00', '+time.end=2022-02-22 00:00:00']
Traceback (most recent call last):
File "/app/src/main.py", line 410, in main
df_independent_timewindow_i = df_independent_timewindow.merge(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/pandas/core/frame.py", line 10819, in merge
return merge(
^^^^^^
File "/usr/local/lib/python3.12/site-packages/pandas/core/reshape/merge.py", line 170, in merge
op = _MergeOperation(
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/pandas/core/reshape/merge.py", line 794, in init
) = self._get_merge_keys()
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/pandas/core/reshape/merge.py", line 1310, in _get_merge_keys
left_keys.append(left._get_label_or_level_values(lk))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/pandas/core/generic.py", line 1910, in _get_label_or_level_values
raise KeyError(key)
KeyError: 'datastream_id'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants