Skip to content

Commit

Permalink
Merge branch 'main' into feature/94-upgrade-helm-charts-versions
Browse files Browse the repository at this point in the history
  • Loading branch information
merlos authored Dec 11, 2024
2 parents 2e3057d + f0a13f4 commit f8bbd72
Show file tree
Hide file tree
Showing 22 changed files with 642 additions and 73 deletions.
24 changes: 24 additions & 0 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
---
version: 2
updates:
- package-ecosystem: github-actions
directory: /
schedule:
interval: daily
time: "07:00"
timezone: "Europe/Amsterdam"

- package-ecosystem: pip
directory: /mag-cli
schedule:
interval: daily
time: "07:00"
timezone: "Europe/Amsterdam"

- package-ecosystem: docker
directory: /mag-sh
schedule:
interval: weekly
day: thursday
time: "07:00"
timezone: "Europe/Amsterdam"
24 changes: 24 additions & 0 deletions .github/workflows/dependabot.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
---
version: 2
updates:
- package-ecosystem: github-actions
directory: /
schedule:
interval: daily
time: "07:00"
timezone: "Europe/Amsterdam"

- package-ecosystem: pip
directory: /mag-cli
schedule:
interval: daily
time: "07:00"
timezone: "Europe/Amsterdam"

- package-ecosystem: docker
directory: /mag-sh
schedule:
interval: weekly
day: thursday
time: "07:00"
timezone: "Europe/Amsterdam"
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,13 +4,13 @@ _magasin_ enables organizations to perform of automatic data ingestion, storage,

_magasin_ is a toolset composed by mature open source projects that are integrated to provide an end-to-end data platform. It is designed to be cloud-native, scalable, and easy to deploy.

Learn more about [why _magasin_](https://unicef.github.io/magasin/why-magasin.html) and its [architecture](https://unicef.github.io/magasin/architecture.html).
Learn more about [why _magasin_](https://magasin.unicef.io/why-magasin.html) and its [architecture](https://magasin.unicef.io/architecture.html).

## Get started

### **[🚀 Go to get started](https://unicef.github.io/get-started/)**
### **[🚀 Go to get started](https://magasin.unicef.io/get-started/)**

In the [get started](https://unicef.github.io/get-started/) you will install magasin within your local machine or in a kubernetes cluster, then you will perform an end-to-end data analysis that includes:
In the [get started](https://magasin.unicef.io/get-started/) you will install magasin within your local machine or in a kubernetes cluster, then you will perform an end-to-end data analysis that includes:

* exploratory analysis of a data source,
* create a pipeline to automate data ingestion, and
Expand All @@ -20,12 +20,12 @@ In the [get started](https://unicef.github.io/get-started/) you will install mag
## Documentation
All the documentation, features, architecture, get started, advanced installation, deployment, contributing...

### [📚 Go to documentation](https://unicef.github.io/magasin/docs-home.html)
### [📚 Go to documentation](https://magasin.unicef.io/docs-home.html)

## Contributing
Magasin follows an open approach towards accepting contributions.

### [🇺🇳 Learn about contributing](https://unicef.github.io/magasin/contributing/)
### [🇺🇳 Learn about contributing](https://magasin.unicef.io/contributing/)

## Licenses
Software is distributed under:
Expand Down
26 changes: 20 additions & 6 deletions docs/_website.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ website:
repo-subdir: docs
repo-actions: [edit, issue]
page-navigation: true
#bread-crumbs: true
bread-crumbs: true

# website.navbar : Top navigation bar
navbar:
Expand All @@ -44,6 +44,13 @@ website:
file: get-started/index.qmd
- text: "Docs"
file: docs-home.qmd
- text: "Announcements" #
href: https://github.com/unicef/magasin/discussions/categories/announcements
target: _blank
- text: "Support " #
url: https://github.com/unicef/magasin/discussions
target: _blank

- text: "About"
file: about.qmd

Expand All @@ -58,6 +65,9 @@ website:
file: docs-home.qmd
- file: why-magasin.qmd
- file: architecture.qmd
- file: sdgs.qmd


- section: "Get started"
contents:
- file: get-started/index.qmd
Expand All @@ -77,7 +87,6 @@ website:
- section: "End user guides"
contents:
- file: user-guides/index.qmd
- file: user-guides/data-privacy.qmd


# TODO
Expand All @@ -91,13 +100,18 @@ website:
# - file: admin-guides/drill.qmd
# - file: admin-guides/superset.qmd

- section: "Deployment"
- section: "Implement"
contents:
- text: "Overview"
file: implement/index.qmd
- file: implement/magasin-team.qmd
- file: implement/organizational-processes.qmd
- file: implement/data-privacy.qmd
- text: "Deploying to production"
file: deployment.qmd
file: implement/deployment.qmd
- text: "Security"
file: security.qmd

file: implement/security.qmd
- section: "Contributing"
contents:
- file: contributing/index.qmd
Expand Down
15 changes: 11 additions & 4 deletions docs/about.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -5,22 +5,29 @@ format: html

## About Magasin

Magasin (pronounced /ma.ɡa.zɛ̃/) is an end-to-end suite of open-source tools stitched together to provide enterprise ready automated ingestion, transformation, and storage as well as the enabling infrastructure and tools to perform data analysis, visualization of datasets and ML / AI.
Magasin (pronounced /ma.ɡa.zɛ̃/) is an end-to-end set of mature open-source toolset that enables organizations to unlock the full potential of their data driving digital transformation effortessly.

Magasin enables data teams to seamlessly extract, analyze, and visualize data from multiple sources.

Magasin takes flexibility to another level, thanks to its loosely coupled [architecture](architecture.qmd) composed by mature open-source tools.

Magasin was created by [UNICEF](https://www.unicef.org) and since 2024, magasin is a [Digital Public Good (DPG)](https://github.com/unicef/magasin/discussions/103).

You can learn more about [why we created magasin](why-magasin.qmd) and its [architecture](architecture.qmd).

## Brief history

Magasin grew out of Office of Innovation's and Information and Communication Technology Division (ICTD) work to establish a [RapidPro](https://www.rapidpro.io) Data Warehouse to enable aggregation of global metrics across vendor instances.

Also informed by experiences of the [Magic Box](https://www.unicef.org/innovation/Magicbox) applied data science initiative, a range of components were evaluated and trialed with country offices to arrive at the current components and architecture.

In 2021, ICTD engaged one of its long term agreement vendors to assist with evolving the proof-of-concept into a minimum viable product (MVP).
In 2021, ICTD engaged one of its long term agreement with a vendor to assist with evolving the proof-of-concept into a minimum viable product (MVP).

In 2023, UNICEF ICTD Digital Center of Excellence (DCOE) started the journey to detach _magasin_ from its organizational and cloud infrastructure dependencies, and release it as an open-source platform with the goal of becoming a [Digital Public Good](https://digitalpublicgoods.net/digital-public-goods/).
In 2023, UNICEF ICTD Digital Center of Excellence (DCOE) started the journey to detach _magasin_ from its organizational and cloud infrastructure dependencies, and release it as an open-source platform with the aim helping to attain the [Sustainable Development Goals (SDGs)](./sdgs.qmd) and to create a more equitable world.

On [February 2nd](https://en.wikipedia.org/wiki/Groundhog_Day_(film)),2024, UNICEF released magasin as an [open source](https://github.com/unicef/magasin) solution. This release ships with an an [easy to install process](install/) toolkit as well as [how to get started documentation](get-started/).

On the [31st of October 2024](https://en.wikipedia.org/wiki/Halloween), magasin was declared a [Digital Public Good](https://github.com/unicef/magasin/discussions/103) by the [Digital Public Goods Alliance](https://app.digitalpublicgoods.net/a/11177).




Expand Down
Loading

0 comments on commit f8bbd72

Please sign in to comment.