Skip to content

Releases: infinitelambda/dq-tools

1.4.0b0

01 Sep 04:24
Compare
Choose a tag to compare
1.4.0b0 Pre-release
Pre-release

What's changed

  • Migrate data_quality_score metric to adapt the new Semantic requirements introduced in dbt v1.6
  • And, migrate test_coverage

BREAKING CHANGES

  • Merge this will cause dq-tools required dbt v1.6+
  • All models will be enabled by default

Under the hood

  • Feature/migrate new metric def by @il-dat in #11

Full Changelog: 1.3.0b0...1.4.0b0

1.3.0

13 Sep 08:00
a6d6410
Compare
Choose a tag to compare

What's changed

  • Decomission macro create_table_dq_issue_log and no more pre-hook - we now manage dq_issue_log as a model
  • dq_issue_log has new columns
    • no_of_records_scanned
    • no_of_columns
    • no_of_tables
    • test_unique_id
    • table_query
  • New model test_coverage and corresponding dbt metrics (disabled by default)
  • 2 new private macros to get no of tables and to get coverage exclusion sql

Chore

  • Re-organize models dir
  • Add columns_csv to test test_equal_rowcount_where_db
  • Add/Update integration tests for this new feature, and test script run_test.sh

Breaking Changes

  • No more pre-hook required --> Remove it from dbt_project.yml, otherwise it will fail
  • No more selector of -s source:dq_tools --> Replace it by -s dq_issue_log
  • [WARN] New columns in dq_issue_log won't be backfilled

Under the hood

Full Changelog: 1.2.2...1.3.0

1.3.0b0

01 Sep 03:29
a6d6410
Compare
Choose a tag to compare
1.3.0b0 Pre-release
Pre-release

What's changed

  • Decomission macro create_table_dq_issue_log and no more pre-hook - we now manage dq_issue_log as a model
  • dq_issue_log has new columns
    • no_of_records_scanned
    • no_of_columns
    • no_of_tables
    • test_unique_id
    • table_query
  • New model test_coverage and corresponding dbt metrics (disabled by default)
  • 2 new private macros to get no of tables and to get coverage exclusion sql

Chore

  • Re-organize models dir
  • Add columns_csv to test test_equal_rowcount_where_db
  • Add/Update integration tests for this new feature, and test script run_test.sh

Breaking Changes

  • No more pre-hook required --> Remove it from dbt_project.yml, otherwise it will fail
  • No more selector of -s source:dq_tools --> Replace it by -s dq_issue_log
  • [WARN] New columns in dq_issue_log won't be backfilled

Under the hood

Full Changelog: 1.2.2...1.3.0b0

1.2.2

01 Aug 01:37
82ed511
Compare
Choose a tag to compare

What's Changed

  • Feature/#6 database config by @il-dat in #7
    • Allow to config database of dq_issue_log table via the dbt_dq_tool_database variable - default to get target.database

Full Changelog: 1.2.1...1.2.2

1.2.1

09 Apr 11:06
8047b72
Compare
Choose a tag to compare

What's Changed

Under the hood

Full Changelog: 1.2.0...1.2.1

1.2.0

17 Feb 05:35
e3c780d
Compare
Choose a tag to compare

Changes

  • New metric: data_quality_score (disabled by default along with upstream models)
  • Confirmed the support of dbt v1.3 and v1.4

Contributors:

1.1.2

14 Feb 08:08
Compare
Choose a tag to compare

Changes:

  • Add bi models (default disabled)
  • Migrate CI tests to Github actions

Contributors:
@dat

1.1.1

13 Jan 07:38
Compare
Choose a tag to compare

Changes:

  • New macro using at on-run-end context (with couple of utilities macro): store_test_results (here), and new corresponding variable: dq_tools_enable_store_test_results (here)
  • Added integration_tests to perform testing on PR. It will test your PR against: Snowflake, dbt (1.0 to 1.2)
  • Added dbt docs site: here - this will be built at the event of merged to master
  • Added Contribution Guildline with poetry setup

Contributors:

@dat
@christopher