Start here in GCP
The most useful guides in this topic, not just the most recent.
GCP Guides & Tutorials
Google Cloud for data — BigQuery, Dataflow, Pub/Sub, Vertex AI, Cloud Storage and the Professional Data Engineer path.
GCP articles
Disaster Recovery and Backups on GCP
Most data loss is not a disaster. It is a person running the wrong statement. This guide separates mistakes from outages, explains RPO and RTO, covers what BigQuery, Cloud Storage and Cloud SQL keep and for how long, and rehearses a backup and restore on a real database to show what a restore loses.
BigLake and External Tables in BigQuery
BigQuery can query files where they lie, through an external table or a BigLake table. Both point at the same files; what differs is who needs access to the bucket and how finely access can be controlled. This guide explains the difference with a worked access model, the DDL, metadata caching, limits and when to load.
Cost Controls and Budgets on Google Cloud
A budget on Google Cloud sends alerts; it does not stop spending. This guide sorts the cost tools into three jobs, seeing where money goes, being told when it changes and being stopped at a limit, and models a runaway query to show what each layer does to the month's bill.
GCP Data Engineering Projects for Your Portfolio
A portfolio project is evidence, and evidence means numbers, failure handling and a README someone can follow. This guide sets out six Google Cloud data engineering projects in rising difficulty, says what each proves and costs, and profiles a real public dataset to show what the write-up should contain.
Service Accounts and Workload Identity on GCP
A pipeline cannot sign in with a password, so on Google Cloud it runs as a service account. This guide explains the kinds of service account, the five ways a workload proves it is one, why key files are the last resort, and how Workload Identity Federation lets GitHub Actions and GKE pods authenticate with no key.
BigQuery Federated Queries Explained
A federated query lets BigQuery ask a live operational database a question and join the answer to warehouse tables, with no pipeline in between. This guide explains EXTERNAL_QUERY, shows on a sample database how much pushdown saves and where it stops, and covers connections, pricing, regions and when to replicate.