You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is there a way to store failures using an incremental model?
For the time being this does not seem to be supported Compilation Error in test primary_key_unique_2 (sources/sources_glue_2.yml) 'incremental' is not a valid value for store_failures_as. Accepted values are: ['ephemeral', 'table', 'view']
Also the doc states
A test's results will always replace previous failures for the same test, even if that test results in no failures.
This would be helpful to keep a daily trace of failing records. We are using Glue adapter and it would be nice to keep failing records in an ACID table (Iceberg or Deltalake)
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hello,
Is there a way to store failures using an incremental model?
For the time being this does not seem to be supported
Compilation Error in test primary_key_unique_2 (sources/sources_glue_2.yml) 'incremental' is not a valid value for
store_failures_as. Accepted values are: ['ephemeral', 'table', 'view']
Also the doc states
This would be helpful to keep a daily trace of failing records. We are using Glue adapter and it would be nice to keep failing records in an ACID table (Iceberg or Deltalake)
Thanks in advance
Beta Was this translation helpful? Give feedback.
All reactions