feat(DENG-7810): Create holidays view for DS use #6953

kwindau · 2025-02-04T02:29:01Z

Description

This PR creates the following new view:

mozdata.external.holidays

This view contains a 1/0 flag for the following holidays:

New Year's Day
Lunar New Year
Valentine's Day
Holi
Easter
Memorial Day (US)
Juneteenth (US)
Independence Day (US)
Labor Day (US)
Thanksgiving (CA)
Thanksgiving (US)
Black Friday (US)
Cyber Monday (US)
Amazon Prime Days - only known ones, don't know future ones, will need to be added
Unity Day (DE)
Diwali
Halloween
Christmas Eve
Christmas Day
Boxing Day
Hanukkah
Kwanzaa
New Years Eve

For now the view is limited to 1/1/2020 - 12/31/2029

Related Tickets & Documents

DENG-7810

Reviewer, please follow this checklist

dataops-ci-bot · 2025-02-04T21:24:31Z

Integration report for "Merge branch 'main' into DENG-7810-holidays"

`sql.diff`

Click to expand!

Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/external: holidays
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/external/holidays/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/external/holidays/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/external/holidays/metadata.yaml	1970-01-01 00:00:00.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/external/holidays/metadata.yaml	2025-02-04 21:18:11.000000000 +0000
@@ -0,0 +1,13 @@
+friendly_name: Holidays
+description: |-
+  Please provide a description for the query
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references:
+  view.sql:
+  - moz-fx-data-shared-prod.external_derived.calendar_v1
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/external/holidays/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/external/holidays/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/external/holidays/view.sql	1970-01-01 00:00:00.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/external/holidays/view.sql	2025-02-04 21:15:05.000000000 +0000
@@ -0,0 +1,322 @@
+CREATE OR REPLACE VIEW
+  `moz-fx-data-shared-prod.external.holidays`
+AS
+SELECT
+  submission_date,
+  IF(calendar_month = 1 AND EXTRACT(day FROM submission_date) = 1, 1, 0) AS new_years_day,
+  IF(
+    submission_date IN (
+      '2020-01-25',
+      '2021-02-12',
+      '2022-02-01',
+      '2023-01-22',
+      '2024-02-10',
+      '2025-01-29',
+      '2026-02-17',
+      '2027-02-06',
+      '2028-01-26',
+      '2029-02-13'
+    ),
+    1,
+    0
+  ) AS lunar_new_year,
+  IF(calendar_month = 2 AND EXTRACT(day FROM submission_date) = 14, 1, 0) AS valentines_day,
+  IF(
+    submission_date IN (
+      '2020-03-10',
+      '2021-03-29',
+      '2022-03-18',
+      '2023-03-08',
+      '2024-03-25',
+      '2025-03-14',
+      '2026-03-04',
+      '2027-03-22',
+      '2028-03-11',
+      '2029-03-01'
+    ),
+    1,
+    0
+  ) AS in_holi,
+  IF(
+    submission_date IN (
+      '2020-05-23',
+      '2020-05-24',
+      '2021-05-12',
+      '2021-05-13',
+      '2022-05-01',
+      '2022-05-02',
+      '2023-04-20',
+      '2023-04-21',
+      '2024-04-09',
+      '2024-04-10',
+      '2025-03-29',
+      '2025-03-30',
+      '2026-05-19',
+      '2026-05-20',
+      '2027-03-09',
+      '2027-03-10',
+      '2028-02-26',
+      '2028-02-27',
+      '2029-02-14',
+      '2029-02-15'
+    ),
+    1,
+    0
+  ) AS eid_al_fitr,
+  IF(
+    submission_date IN (
+      '2020-04-12',
+      '2021-04-04',
+      '2022-04-17',
+      '2023-04-09',
+      '2024-03-31',
+      '2025-04-20',
+      '2026-04-05',
+      '2027-03-28',
+      '2028-04-16',
+      '2029-04-01'
+    ),
+    1,
+    0
+  ) AS easter_day,
+  IF(
+    submission_date IN (
+      '2020-05-25',
+      '2021-05-31',
+      '2022-05-30',
+      '2023-05-29',
+      '2024-05-27',
+      '2025-05-26',
+      '2026-05-25',
+      '2027-05-31',
+      '2028-05-29',
+      '2029-05-28'
+    ),
+    1,
+    0
+  ) AS us_memorial_day,
+  IF(calendar_month = 6 AND EXTRACT(day FROM submission_date) = 19, 1, 0) AS us_juneteenth,
+  IF(calendar_month = 7 AND EXTRACT(day FROM submission_date) = 4, 1, 0) AS us_independence_day,
+  IF(
+    submission_date IN (
+      '2020-09-07',
+      '2021-09-06',
+      '2022-09-05',
+      '2023-09-04',
+      '2024-09-02',
+      '2025-09-01',
+      '2026-09-07',
+      '2027-09-06',
+      '2028-09-04',
+      '2029-09-03'
+    ),
+    1,
+    0
+  ) AS us_labor_day,
+  IF(
+    submission_date IN (
+      '2020-11-26',
+      '2021-11-25',
+      '2022-11-24',
+      '2023-11-23',
+      '2024-11-28',
+      '2025-11-27',
+      '2026-11-26',
+      '2027-11-25',
+      '2028-11-23',
+      '2029-11-22'
+    ),
+    1,
+    0
+  ) AS us_thanksgiving,
+  IF(
+    submission_date IN (
+      '2020-11-27',
+      '2021-11-26',
+      '2022-11-25',
+      '2023-11-24',
+      '2024-11-29',
+      '2025-11-28',
+      '2026-11-27',
+      '2027-11-26',
+      '2028-11-24',
+      '2029-11-23'
+    ),
+    1,
+    0
+  ) AS us_blackfriday,
+  IF(
+    submission_date IN (
+      '2020-11-30',
+      '2021-11-29',
+      '2022-11-28',
+      '2023-11-27',
+      '2024-12-02',
+      '2025-12-01',
+      '2026-11-30',
+      '2027-11-29',
+      '2028-11-27',
+      '2029-11-26'
+    ),
+    1,
+    0
+  ) AS us_cybermonday,
+  IF(
+    submission_date IN (
+      '2020-10-12',
+      '2021-10-11',
+      '2022-10-10',
+      '2023-10-09',
+      '2024-10-14',
+      '2025-10-13',
+      '2026-10-12',
+      '2027-10-11',
+      '2028-10-09',
+      '2029-10-08'
+    ),
+    1,
+    0
+  ) AS ca_thanksgiving,
+--future dates unknown currently, will add as they are announced
+  IF(
+    submission_date IN (
+      '2020-10-13',
+      '2020-10-14',
+      '2021-06-21',
+      '2021-06-22',
+      '2021-10-10',
+      '2021-10-11',
+      '2022-07-12',
+      '2022-07-13',
+      '2022-10-11',
+      '2022-10-12',
+      '2023-07-11',
+      '2023-07-12',
+      '2023-10-10',
+      '2023-10-11',
+      '2024-07-16',
+      '2024-07-17',
+      '2024-10-08',
+      '2024-10-09'
+    ),
+    1,
+    0
+  ) AS amazon_prime_days_summer,
+  IF(calendar_month = 10 AND EXTRACT(day FROM submission_date) = 3, 1, 0) AS de_unity_day,
+  IF(
+    submission_date IN (
+      '2020-11-14',
+      '2021-11-04',
+      '2022-10-24',
+      '2023-11-12',
+      '2024-10-31',
+      '2025-10-20',
+      '2026-11-08',
+      '2027-10-29',
+      '2028-10-17',
+      '2029-11-05'
+    ),
+    1,
+    0
+  ) AS in_diwali,
+  IF(calendar_month = 10 AND EXTRACT(day FROM submission_date) = 31, 1, 0) AS halloween,
+  IF(calendar_month = 12 AND EXTRACT(day FROM submission_date) = 24, 1, 0) AS christmas_eve,
+  IF(calendar_month = 12 AND EXTRACT(day FROM submission_date) = 25, 1, 0) AS christmas_day,
+  IF(calendar_month = 12 AND EXTRACT(day FROM submission_date) = 26, 1, 0) AS boxing_day,
+  CASE
+    WHEN submission_date
+      BETWEEN '2020-12-10'
+      AND '2020-12-18'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2021-11-28'
+      AND '2021-12-06'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2022-12-18'
+      AND '2022-12-26'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2023-12-07'
+      AND '2023-12-15'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2024-12-25'
+      AND '2025-01-02'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2025-12-14'
+      AND '2025-12-22'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2026-12-04'
+      AND '2026-12-12'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2027-12-24'
+      AND '2028-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2028-12-12'
+      AND '2028-12-20'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2029-12-01'
+      AND '2029-12-09'
+      THEN 1
+    ELSE 0
+  END AS hanukkah,
+  CASE
+    WHEN submission_date
+      BETWEEN '2019-12-26'
+      AND '2020-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2020-12-26'
+      AND '2021-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2021-12-26'
+      AND '2022-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2022-12-26'
+      AND '2023-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2023-12-26'
+      AND '2024-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2024-12-26'
+      AND '2025-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2025-12-26'
+      AND '2026-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2026-12-26'
+      AND '2027-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2027-12-26'
+      AND '2028-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2028-12-26'
+      AND '2029-01-01'
+      THEN 1
+    WHEN submission_date
+      BETWEEN '2029-12-26'
+      AND '2030-01-01'
+      THEN 1
+    ELSE 0
+  END AS us_kwanzaa,
+  IF(calendar_month = 12 AND EXTRACT(day FROM submission_date) = 31, 1, 0) AS new_years_eve,
+FROM
+  `moz-fx-data-shared-prod.external_derived.calendar_v1`
+WHERE
+  submission_date
+  BETWEEN '2020-01-01'
+  AND '2029-12-31' --only included holidays for this date range for now

Link to full diff

kwindau added 3 commits February 3, 2025 20:05

work in progress

5a45b71

work in progress

0baf648

work in progress

74f9b4d

This comment has been minimized.

Sign in to view

kwindau added 3 commits February 4, 2025 11:40

Merge branch 'main' into DENG-7810-holidays

5f5c049

Update holidays view

b92df5f

Make all 1 or 0

4769cc6

kwindau changed the title ~~Deng 7810 holidays~~ Create holidays view for DS use Feb 4, 2025

kwindau changed the title ~~Create holidays view for DS use~~ feat(DENG-7810): Create holidays view for DS use Feb 4, 2025

This comment has been minimized.

Sign in to view

Add Diwali and Holi

8eba573

This comment has been minimized.

Sign in to view

kwindau marked this pull request as ready for review February 4, 2025 18:58

Merge branch 'main' into DENG-7810-holidays

882bec5

Marlene-M-Hirose approved these changes Feb 4, 2025

View reviewed changes

This comment has been minimized.

Sign in to view

kwindau and others added 4 commits February 4, 2025 13:54

Add boxing day and hannukah

4c407ed

Merge branch 'main' into DENG-7810-holidays

03a76df

Add kwanzaa

f0091c4

Fix kwanzaa dates

8d2f5df

This comment has been minimized.

Sign in to view

kwindau and others added 2 commits February 4, 2025 15:13

Add eid-al-fitr

10941eb

Merge branch 'main' into DENG-7810-holidays

a644315

kwindau enabled auto-merge February 4, 2025 21:13

kwindau added this pull request to the merge queue Feb 4, 2025

Merged via the queue into main with commit 67eb774 Feb 4, 2025
21 checks passed

kwindau deleted the DENG-7810-holidays branch February 4, 2025 21:43

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(DENG-7810): Create holidays view for DS use #6953

feat(DENG-7810): Create holidays view for DS use #6953

Uh oh!

kwindau commented Feb 4, 2025 •

edited

Loading

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

dataops-ci-bot commented Feb 4, 2025

Uh oh!

Uh oh!

Uh oh!

feat(DENG-7810): Create holidays view for DS use #6953

feat(DENG-7810): Create holidays view for DS use #6953

Uh oh!

Conversation

kwindau commented Feb 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Related Tickets & Documents

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

dataops-ci-bot commented Feb 4, 2025

Integration report for "Merge branch 'main' into DENG-7810-holidays"

sql.diff

Uh oh!

Uh oh!

Uh oh!

kwindau commented Feb 4, 2025 •

edited

Loading

`sql.diff`