When will I receive my Course Certificate?

If you complete the course successfully, your electronic Course Certificate will be added to your Accomplishments page - from there, you can print your Course Certificate or add it to your LinkedIn profile.

Why can’t I audit this course?

This course is currently available only to learners who have paid or received financial aid, when available.

Is financial aid available?

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

Introduction to Data Engineering on Google Cloud

This course is part of Professional Cloud Architect Part 2: AI, Security, & Ops Specialization

Instructor: Google Cloud Training

Included with

Learn more

8 modules

Gain insight into a topic and learn the fundamentals.

Beginner level

No prior experience required

9 hours to complete

Flexible schedule

Learn at your own pace

8 modules

Gain insight into a topic and learn the fundamentals.

Beginner level

No prior experience required

9 hours to complete

Flexible schedule

Learn at your own pace

What you'll learn

Understand the role of a data engineer.
Identify data engineering tasks and core components used on Google Cloud.
Understand how to create and deploy data pipelines of varying patterns on Google Cloud.
Identify and utilize various automation techniques on Google Cloud.

Skills you'll gain

Tools you'll learn

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

6 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is part of the Professional Cloud Architect Part 2: AI, Security, & Ops Specialization

When you enroll in this course, you'll also be enrolled in this Specialization.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate

There are 8 modules in this course

In this course, you learn about data engineering on Google Cloud, the roles and responsibilities of data engineers, and how those map to offerings provided by Google Cloud. You also learn about ways to address data engineering challenges.

This section welcomes you to the Introduction to Data Engineering on Google Cloud course, and provides an overview of the course structure and goals.

What's included

1 video

This module provides an introduction to the role of a data engineer. It covers key concepts such as data sources and sinks, data formats, storage options on Google Cloud, metadata management, and the use of Analytics Hub for data sharing within and outside an organization.

What's included

8 videos1 assignment1 app item1 plugin

8 videosTotal 12 minutes

Module Introduction1 minute
The Role of a Data Engineer1 minute
Data Sources Versus Data Sinks2 minutes
Data Formats1 minute
Storage Solution Options on Google Cloud5 minutes
Metadata Management Options on Google Cloud1 minute
Sharing Datasets using Analytics Hub1 minute
Lab Intro: Loading Data into BigQuery0 minutes

1 assignmentTotal 15 minutes

Quiz - Data Engineering Tasks and Components15 minutes

1 app itemTotal 90 minutes

Lab: Loading Data into BigQuery90 minutes

1 pluginTotal 15 minutes

Accessing and completing labs15 minutes

This module provides an overview of data replication and migration on Google Cloud. It covers the basic architecture, the 'gcloud' command-line tool, Storage Transfer Service, Transfer Appliance, and Datastream, along with their functionalities and use cases.

What's included

6 videos1 assignment1 app item

6 videosTotal 7 minutes

Module Introduction0 minutes
Replication and Migration Architecture2 minutes
The gcloud Command Line Tool0 minutes
Moving Datasets1 minute
Datastream4 minutes
Lab Intro: Datastream: PostgreSQL Replication to BigQuery0 minutes

1 assignmentTotal 15 minutes

Quiz - Data Replication and Migration15 minutes

1 app itemTotal 45 minutes

Lab: Datastream: PostgreSQL Replication to BigQuery45 minutes

This module focuses on data extraction and loading processes on Google Cloud, particularly with BigQuery. It covers the basic extraction and loading architecture, the bq command-line tool, BigQuery Data Transfer Service, and BigLake as an alternative to traditional extract-load patterns.

What's included

6 videos1 assignment1 app item

This module provides an overview of ELT (extract, load, transform) processes on Google Cloud. It covers the basic ELT architecture, a common ELT pipeline example, BigQuery's capabilities for scripting and scheduling SQL, and the functionality and use cases of Dataform.

What's included

5 videos1 assignment1 app item

5 videosTotal 10 minutes

Module Introduction0 minutes
Extract, Load, and Transform (ELT) Architecture1 minute
SQL Scripting and Scheduling with BigQuery3 minutes
Dataform6 minutes
Lab Intro: Create and Execute a SQL Workflow in Dataform0 minutes

1 assignmentTotal 15 minutes

Quiz - The Extract, Load, and Transform Data Pipeline Pattern15 minutes

1 app itemTotal 60 minutes

Lab: Create and Execute a SQL Workflow in Dataform60 minutes

This module provides an overview of ETL (extract, transform, load) processes on Google Cloud. It covers the basic ETL architecture, GUI tools, batch and streaming data processing options (Dataproc, Dataproc Serverless), and the role of Bigtable in data pipelines.

What's included

8 videos1 assignment2 app items

8 videosTotal 13 minutes

Module Introduction1 minute
Extract, Transform, and Load (ETL) Architecture1 minute
Google Cloud GUI Tools for ETL Data Pipelines2 minutes
Batch Data Processing Using Dataproc5 minutes
Lab Intro: Use Serverless for Apache Spark to Load BigQuery0 minutes
Streaming Data Processing Options3 minutes
Bigtable and Data Pipelines1 minute
Lab Intro: Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow0 minutes

1 assignmentTotal 15 minutes

Quiz - The Extract, Transform, and Load Data Pipeline Pattern15 minutes

2 app itemsTotal 105 minutes

Lab: Use Serverless for Apache Spark to Load BigQuery45 minutes
Lab: Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow60 minutes

This module focuses on automation patterns and options for pipelines on Google Cloud. It covers various tools and services like Cloud Scheduler, Workflows, Cloud Composer, Cloud Run functions, and Eventarc, along with their functionalities and use cases for automation.

What's included

7 videos1 assignment1 app item

7 videosTotal 6 minutes

Module Introduction0 minutes
Automation Patterns and Options for Pipelines1 minute
Cloud Scheduler and Workflows1 minute
Cloud Composer1 minute
Cloud Run Functions1 minute
Eventarc1 minute
Lab Intro: Use Cloud Run Functions to Load BigQuery0 minutes

1 assignmentTotal 15 minutes

Quiz - Automation Techniques15 minutes

1 app itemTotal 45 minutes

Lab: Use Cloud Run Functions to Load BigQuery45 minutes

In this final section, we review what was presented in this course and discuss the next steps to continue your cloud learning journey.

What's included

1 video1 reading

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Google Cloud Training

Google Cloud

2,171 Courses4,177,269 learners

Offered by

Google Cloud

Explore more from Cloud Computing

Status: Free Trial
DeepLearning.AI
Introduction to Data Engineering
Course
Status: Free Trial
Duke University
Cloud Data Engineering
Course
Status: Free Trial
Google Cloud
Preparing for Google Cloud Certification: Cloud Data Engr
Professional Certificate
Status: Free Trial
IBM
Introduction to Data Engineering
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Learn more

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Explore degrees

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Learn more

Frequently asked questions

Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.

If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.

Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.

Introduction to Data Engineering on Google Cloud

Introduction to Data Engineering on Google Cloud

What you'll learn

Skills you'll gain

Tools you'll learn

Details to know

See how employees at top companies are mastering in-demand skills

Build your subject-matter expertise

There are 8 modules in this course

Course Introduction

What's included

Data Engineering Tasks and Components

What's included

Data Replication and Migration

What's included

The Extract and Load Data Pipeline Pattern

What's included

The Extract, Load, and Transform Data Pipeline Pattern

What's included

The Extract, Transform, and Load Data Pipeline Pattern

What's included

Automation Techniques

What's included

Course Summary

What's included

Earn a career certificate

Instructor

Offered by

Explore more from Cloud Computing

Introduction to Data Engineering

Cloud Data Engineering

Preparing for Google Cloud Certification: Cloud Data Engr

Introduction to Data Engineering

Why people choose Coursera for their career

Felipe M.

Jennifer J.

Larry W.

Chaitanya A.

Open new doors with Coursera Plus

Advance your career with an online degree

Join over 3,400 global companies that choose Coursera for Business

Frequently asked questions

Can I preview a course before enrolling?

When will I have access to the lectures and assignments?

What will I get when I enroll?

More questions