Processing streaming data is becoming increasingly popular as streaming enables businesses to get real-time metrics on business operations. This course covers how to build streaming data pipelines on Google Cloud. Pub/Sub is described for handling incoming streaming data. The course also covers how to apply aggregations and transformations to streaming data using Dataflow, and how to store processed records to BigQuery or Cloud Bigtable for analysis. Learners will get hands-on experience building streaming data pipeline components on Google Cloud using QwikLabs.
Offered By
About this Course
What you will learn
Understand use-cases for real-time streaming analytics.
Use Pub/Sub asynchronous messaging service to manage data events.
Write streaming pipelines and run transformations where necessary.
Interoperate Dataflow, BigQuery and Pub/Sub for real-time streaming and analysis
Offered by

Google Cloud
We help millions of organizations empower their employees, serve their customers, and build what’s next for their businesses with innovative technology created in—and for—the cloud. Our products are engineered for security, reliability, and scalability, running the full stack from infrastructure to applications to devices and hardware. Our teams are dedicated to helping customers apply our technologies to create success.
Syllabus - What you will learn from this course
Introduction
This module introduces the course and agenda
Introduction to Processing Streaming Data
This modules talks about challenges with processing streaming data
Serverless Messaging with Pub/Sub
This module talks about using Pub/Sub to ingest incoming streaming data
Dataflow Streaming Features
This module revisits Dataflow and focuses on its streaming data processing capabilities
High-Throughput BigQuery and Bigtable Streaming Features
This modules covers BigQuery and Bigtable for streaming data
Advanced BigQuery Functionality and Performance
This module dives into more advanced features of BigQuery
Summary
This module recaps the topics covered in course
Reviews
- 5 stars67.12%
- 4 stars25.83%
- 3 stars5.40%
- 2 stars1.37%
- 1 star0.25%
TOP REVIEWS FROM BUILDING RESILIENT STREAMING ANALYTICS SYSTEMS ON GOOGLE CLOUD
Another excellent course. Many opportunities to use Cloud Dataflow and effective ways of using Google's big data warehouse, BigQuery.
It was really good experience as always at Google cloud platform. Thanks for the team for materials and great course content. appreciated.
A great way to start on the road to understanding streaming data and how to use it for insights
Very useful course for data engineers specially covered lot of ways to optimize sql in bigquery
Frequently Asked Questions
Can I preview a course before enrolling?
What will I get when I enroll?
When will I receive my Course Certificate?
Why can’t I audit this course?
More questions? Visit the Learner Help Center.