End-To-End Data Engineering Project. Made to learn some common data engineering practices.
python firebase etl terraform gcp svelte soccer data-engineering football data-pipeline cloud-run-functions
- Updated
Mar 15, 2026 - Python
#
cloud-run-functions
Here are 15 public repositories matching this topic...
A reusable solution to kill billing on any projects associated with a given budget and budget alert. If your budget is exceeded, the resulting budget alert will cause all projects associated with that alert to be detached from the billing account. This immediately prevents all paid resources in the project from being consumed.
- Updated
Mar 4, 2026 - Python
Build a data pipeline on Google Cloud using an event-driven architecture, leveraging GCS, Cloud Run functions, and BigQuery. Explore both VM and Composer options for Airflow management, and utilize Logging & Monitoring for pipeline health. Discover how SQL-based BigQuery ML can be used for initial ML implementation in specific scenarios.
bigquery airflow composer google-cloud-platform cloud-functions bigqueryml data-engineering-project cloud-run-functions
- Updated
Aug 25, 2024 - Python
A Google Cloud ELT pipeline project with dbt, Cloud Run, Composer, BigQuery, and Dataplex. Includes event-driven automation, data quality checks, and complete setup guidance.
- Updated
Mar 10, 2026 - Python
Serverless loader: copy remote files directly into Google Cloud Storage by a fully automated workflow using Terraform and Cloud Run Functions.
- Updated
Sep 21, 2025 - Shell
A serverless, event-driven data engineering pipeline on Google Cloud (Medallion Architecture) for real-time Transport for NSW transit analytics.
python bigquery cloud-storage google-cloud-platform data-lakehouse lookerstudio medallion-architecture cloud-run-functions
- Updated
Mar 9, 2026 - Python
PySpark-based ETL pipeline leveraging Dataproc, Cloud Storage, Cloud Run Functions and BigQuery, to automate Spotify "New Releases" data processing and visualization in Looker Studio.
python bigquery spark spotify-api google-cloud-storage google-cloud cloud-storage pyspark dataproc cloud-scheduler google-cloud-run google-cloud-scheduler secret-manager cloud-run-functions
- Updated
Jan 10, 2025 - Python
Develop and bundle your Cloud Run functions with ease
- Updated
Dec 29, 2025 - TypeScript
Cloud Run functionsとActiveReports for .NETでつくる帳票生成API
csharp google-cloud dotnet-core google-cloud-functions webapi activereports activereports18 cloud-run-functions
- Updated
Apr 7, 2025 - C#
A fully automated ETL pipeline that fetches and stores real-time traffic and weather data in BigQuery, with a live Looker dashboard for visualization.
python bigquery sql dashboard etl google-cloud data-visualization google-cloud-functions google-cloud-pubsub openweather-api google-cloud-scheduler google-cloud-secrets-manager tomtom-api looker-studio cloud-run-functions
- Updated
Oct 1, 2024 - Python
This repo hosts a data-engineering pipeline that utilizes google cloud-storage, google pub/sub, google cloud function, airflow, ngrok, open-ai to facilitate a trigger based ELT pipeline. It also manages some vectorized data and geometric data following standard data retrieval and storage practices.
- Updated
Oct 31, 2025 - Python
Los Mirlos Storytelling, a magical serverless backend built with Google Cloud Functions and powered by Gemini (Google's LLM)
python google cloud ai serverless storytelling chatbot google-cloud-storage gcp google-cloud gcs gemini serverless-functions chatbots google-cloud-platform gemini-api cloud-run cloud-run-functions
- Updated
Jun 25, 2025 - Python
Go microservices and serverless functions for GCP. Deploys to Cloud Run and Cloud Functions. Includes Makefile for automation. IAM setup and curl test included.
go docker devops automation microservices serverless backend makefile gcp google-cloud cloud-run cloud-run-functions
- Updated
Feb 1, 2026 - Go
Official LINE account for notifying garbage collection days
- Updated
Feb 27, 2026 - Go
Serverless ETL pipeline on GCP using Cloud Run, Pub/Sub, BigQuery & Looker for real-time NYC Taxi ML insights.
bigquery data-engineering google-cloud-pubsub etl-pipeline serveless cloud-run bigquery-ml looker-studio cloud-run-functions
- Updated
Jun 14, 2025 - Python
Improve this page
Add a description, image, and links to the cloud-run-functions topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the cloud-run-functions topic, visit your repo's landing page and select "manage topics."