Google Cloud · BigQuery · GitHub

MongoDB to BigQuery

I removed a redundant Cloud SQL layer and kept the live pipelines up the whole time.

• Empower Health Services
• Data Analyst
• Google Cloud

Details kept at a public level. No client or member data.

1. 01 · The ask

   A redundant Cloud SQL layer sat between the source data and BigQuery.

2. 02 · What I modeled

   Live pipelines that land in BigQuery directly. Query and script code moved into GitHub.

3. 03 · What they used

   The same reports, without that extra layer. Zero downtime.

4. 04 · What I taught

   How to keep the scheduled queries and the repo in sync.

All work