snowplow-utils v0.3.0

Summary

This release is predominately focused on bringing Snowflake support to the snowplow-web v0.3.0 package, which requires snowplow-utils to run.

Features

• Add Snowflake support to macros and snowplow_incremental materialization (#26, #27)
• Add dynamic variables based on target name (#28).
  • Allows variables such as start_date to be dynamically set within snowplow-web package, based on your environment.

Improvements

• Remove create_snowplow_manifest_schema step (#30)

Fixes

• Fix get_successful_models for dbt 0.18.0 (#23)
• Fix BigQuery snowplow_incremental expected dataset (#25)

snowplow-utils v0.2.0

Summary

This release is predominately focused on bringing BigQuery support to the snowplow-web 0.2.0 package.

It also introduces integration tests for the most critical macros within the utils package. In order to achieve this some macros had to be refactored, in some instances involving breaking changes.

Breaking Changes

• Refactor & add tests get_run_limits (Close #9)
• Refactor & add tests update_incremental_manifest_table (Close #10)
• Refactor & add tests app_id_filter (Close #11)
• Replace get_successful_snowplow_models (Close #15)

Features

• Add functionality to support BigQuery in snowplow-web package (Close #8)
  • This includes combine_column_verions, which will assist user's modelling Snowplow data.
• Add BigQuery support to snowplow_incremental (Close #7)

Improvements

• Refactor & add tests get_enabled_snowplow_models (Close #13)
• Remove update_current_incremental_tstamp_table (Close #12)
• Integration tests added to multiple macros along with a script to run:
  • Add integrations_tests script (Close #16)
• Refactor create_incremental_manifest_table (Close #17)
• Refactor & add tests snowplow_delete_from_manifest (Close #18)
• Improve is_run_with_new_events performance (Close #19)
• Improve documentation (Close #21)

Fixes

• Fix snowplow_teardown_all macro (Close #14)
• Update dbt_utils URL to new dbt-labs repo (Close #20)

snowplow-utils v0.1.1

Fixes

• Fix README formatting for dbt hub (#3)
• Fix app_id_filter macro (#4)

snowplow-utils 0.1.0

To be used in conjunction with the snowplow-web package.

Features:

• Custom incremental materialization, snowplow_incremental. This reduces the size of table scans during the upsert step of an incremental model build.
• Pre and post hooks to handle incremental processing of events.
• Various helper macros used throughout the Snowplow Web package.