Skip to content

Commit 201600a

Browse files
Update README.md (#21)
1 parent cab2196 commit 201600a

File tree

3 files changed

+5
-5
lines changed

3 files changed

+5
-5
lines changed

.github/workflows/build_dbt.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,14 +7,14 @@ on:
77
paths-ignore:
88
- adb/**
99
- adf/**
10-
- readme.md
10+
- README.md
1111
pull_request:
1212
branches:
1313
- main
1414
paths-ignore:
1515
- adb/**
1616
- adf/**
17-
- readme.md
17+
- README.md
1818

1919
env:
2020
profile: ajc_adb_dbt_all_purpose

README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ This is a simple personal project to extract and model music album data using Az
66

77
## Data: 1001 Albums To Hear Before You Die
88

9-
Data is sourced from an API provided by the webapp [1001albumsgenerator](https://1001albumsgenerator.com/), based off
9+
Data is sourced from an API provided by the webapp [1001albumsgenerator](https://1001albumsgenerator.com/), based on
1010
the book `1001 Albums You Must Hear Before You Die` by Robert Dimery.
1111

1212
Every day a new music album is listened to and rated. The API tracks the albums listened to and the rating assigned,
@@ -30,6 +30,8 @@ pipeline `get_albums`.
3030
The pipeline then calls an Azure Databricks notebook called `load_albums_delta` that loads today's json file into a
3131
delta table in an ADB workspace.
3232

33+
In addition, each week a maintainence script optimizes and vacuums the delta table.
34+
3335
Storage account access is managed via an API call to an Azure Key Vault that hold the details of a storage account
3436
key to be used by Databricks to connect to.
3537

@@ -46,5 +48,3 @@ visualisation.
4648

4749
In the ADB workspace, a Dashboard visualisation uses the Gold layer of the dbt warehouse and provides simple
4850
visualisations and analysis.
49-
50-
Users with permission can access the visualisation dashboard via the ADB workspace [here](https://adb-2359489148887710.10.azuredatabricks.net/dashboardsv3/01ef83092f1b1403b7967bea7000d543/published?o=2359489148887710)

0 commit comments

Comments
 (0)