When will I receive my Course Certificate?

If you complete the course successfully, your electronic Course Certificate will be added to your Accomplishments page - from there, you can print your Course Certificate or add it to your LinkedIn profile.

Why can’t I audit this course?

This course is currently available only to learners who have paid or received financial aid, when available.

Build Streaming Data Pipelines on Google Cloud

This course is part of multiple programs.

Instructor: Google Cloud Training

39,061 already enrolled

Included with Learn more

Ask Coursera

4 modules

Gain insight into a topic and learn the fundamentals.

1,267 reviews

Intermediate level

Some related experience required

Flexible schedule

8 hours to complete

Learn at your own pace

69%

Most learners liked this course

4 modules

Gain insight into a topic and learn the fundamentals.

1,267 reviews

Intermediate level

Some related experience required

Flexible schedule

8 hours to complete

Learn at your own pace

69%

Most learners liked this course

What you'll learn

Ingest and manage streaming data using Pub/Sub and Managed Service for Apache Kafka
Build and deploy streaming data pipelines with Dataflow
Implement streaming data solutions for real-time analytics and application serving with BigQuery and Bigtable

Skills you'll gain

Tools you'll learn

Apache Kafka

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

4 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is available as part of

When you enroll in this course, you'll also be asked to select a specific program.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate

There are 4 modules in this course

In this course you will get hands-on in order to work through real-world challenges faced when building streaming data pipelines. The primary focus is on managing continuous, unbounded data with Google Cloud products.

This module introduces the fundamentals of building streaming data pipelines on Google Cloud, providing a foundation for the entire course. It begins by outlining the course's overall learning objectives and introducing a practical, hands-on scenario that will be used throughout the content and labs to make the concepts tangible.

What's included

1 plugin

This module provides an introduction to streaming data use cases and architectures. You will learn about the applications and common architectural patterns for real-time data processing across four key scenarios: Streaming ETL, Streaming AI/ML, Streaming Application, and Reverse ETL.

What's included

1 plugin

This module provides a comprehensive overview of building streaming data pipelines on Google Cloud, covering the core services for messaging, processing, and analysis. It's designed to give you a hands-on understanding of how these components work together in a cohesive, real-time architecture.

What's included

4 assignments4 app items6 plugins

4 assignmentsTotal 26 minutes

Quiz 1: Pub/Sub and Managed Service for Apache Kafka 6 minutes
Quiz 2: Dataflow6 minutes
Quiz 3: BigQuery8 minutes
Quiz 4: Bigtable6 minutes

4 app itemsTotal 330 minutes

Lab 1: Stream Data with Pipelines - Esports Use Case90 minutes
Lab 2: Use Apache Beam and Bigtable to Enrich Esports DLC Data90 minutes
Lab 3: Stream Esports Data with Pub/Sub and BigQuery60 minutes
Lab: Monitor Esports Chat with Streamlit90 minutes

6 pluginsTotal 90 minutes

Understanding the products15 minutes
Architectural considerations for Pub/Sub and Managed Service for Apache Kafka15 minutes
Accessing and completing labs15 minutes
Dataflow: The processing powerhouse15 minutes
BigQuery: The analytical engine15 minutes
Bigtable: The solution for operational data15 minutes

This module provides a comprehensive wrap-up of the course, summarizing the key concepts you've learned for building resilient and robust streaming data pipelines on Google Cloud.

What's included

1 plugin

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Instructor ratings

(154 ratings)

Google Cloud Training

Google Cloud

2,276 Courses4,457,751 learners

Offered by

Google Cloud

Explore more from Cloud Computing

Status: Free Trial
Google Cloud
Build Batch Data Pipelines on Google Cloud
Course
Google Cloud
Building Realtime Pipelines in Cloud Data Fusion
Project
Google Cloud
Dataflow: Qwik Start - Templates
Project
Status: Preview
Board Infinity
Managing Data Lakes & Pipelines with Google Cloud Dataplex
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

5 stars
68.05%
4 stars
24.92%
3 stars
5.36%
2 stars
1.26%
1 star
0.39%

Showing 3 of 1267

Reviewed on Jun 28, 2020

An excellent course. A great way to teach building streaming data pipelines and optimizing queries on BigQuery and BigTable (by , inter alia, partitioning data sets )through hands-on labs.

Reviewed on Aug 12, 2020

I really enjoyed this course. There is ample time in the labs to experiment and get familiar with the concepts and techniques being taught in this course.

Reviewed on Jan 9, 2022

Great course to understand how to create batch and streaming pipelines to ingest data into data lakes and data warehouses, and advanced bigquery techniques optimization.

View more reviews

Unlock access to 10,000+ courses with a subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 4,700 global companies that choose Coursera for Business

Frequently asked questions

Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.

If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.

Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.