Data Management and Storage in the Cloud

This course is part of Google Cloud Data Analytics Professional Certificate

Instructor: Google Cloud Training

Access provided by ASTRA NAVIGATION INC.

5,556 already enrolled

4 modules

Gain insight into a topic and learn the fundamentals.

39 reviews

Beginner level

No prior experience required

2 weeks to complete

at 10 hours a week

Flexible schedule

Learn at your own pace

4 modules

Gain insight into a topic and learn the fundamentals.

39 reviews

Beginner level

No prior experience required

2 weeks to complete

at 10 hours a week

Flexible schedule

Learn at your own pace

What you'll learn

Explain how data is defined and structured in BigQuery and Google Cloud Storage.
Identify the key components that make up a data lakehouse architecture.
Explain how partitioning can improve query performance and reduce costs.
Define key components of data governance.

Skills you'll gain

Tools you'll learn

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

19 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your Cloud Computing expertise

This course is part of the Google Cloud Data Analytics Professional Certificate

When you enroll in this course, you'll also be enrolled in this Professional Certificate.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate from Google Cloud

There are 4 modules in this course

Hi again! This is the second course of the Google Cloud Data Analytics Certificate. Get cozy with the key components of data governance, normalized and star schemas, data catalogs, and data lakehouse architecture.

Unlock the secrets of data organization in the cloud! In this module, you'll dive into the different forms data can take, how to store it, and the magic of moving it around. (Think of APIs and connectors as your data transport wizards!) Get ready to understand the building blocks of a well-managed data system.

What's included

12 videos14 readings4 assignments2 app items1 plugin

12 videos Total 39 minutes

Introduction to Course 2 2 minutes
Eric: Data analytics skills translate across industries and roles 2 minutes
Welcome to module 1 1 minute
Data storage and connections 5 minutes
Gerrit: Experience with a variety of tools can help you as an analyst 3 minutes
Common ways to store data 3 minutes
Structured, unstructured, and semi-structured data 5 minutes
Example of a data lakehouse 4 minutes
Aspects of table schema 4 minutes
Introduction to nested data structure 4 minutes
Overview of data processing methods 4 minutes
Wrap-up 1 minute

14 readings Total 140 minutes

Course 2 overview 10 minutes
Helpful resources and tips 10 minutes
Lab technical tips 10 minutes
Explore your Course 2 scenario: TheLook eCommerce 10 minutes
[Supplemental] Common data storage systems 10 minutes
AI-based predictive data management 10 minutes
Overview of data lakehouse architecture 10 minutes
Comparison of data warehouses and data lakehouses 10 minutes
Overview of BigQuery's schema editing abilities 10 minutes
Components of BigQuery table schema 10 minutes
Complex data types in BigQuery 10 minutes
Guide to BigQuery 10 minutes
Batch versus streaming data processing 10 minutes
Glossary terms from module 1 10 minutes

4 assignments Total 80 minutes

Module 1 challenge 50 minutes
Test your knowledge: Data storage options 10 minutes
Test your knowledge: Data types and organization in BigQuery 10 minutes
Test your knowledge: Batch and streaming data sources 10 minutes

2 app items Total 180 minutes

Explore flat and nested data types in BigQuery 90 minutes
Identify different batch and streaming data sources 90 minutes

1 plugin Total 15 minutes

Accessing and completing labs 15 minutes

Level up your data organization skills! In this module, you'll decode the mysteries of data governance, schemas (the blueprints of data), and the power of the data lakehouse. Discover how these concepts work together to create a data system that's both powerful and easy to navigate.

What's included

10 videos5 readings5 assignments1 app item

10 videos Total 33 minutes

Welcome to module 2 1 minute
Denormalized data 2 minutes
Data governance for effective data management 5 minutes
MK: Risk management in a cloud-first world 2 minutes
Introduction to master data management 4 minutes
Introduction to data catalogs 5 minutes
Technical and business metadata 3 minutes
Overview of data lakehouse architecture 5 minutes
Components of data lakehouse architecture 5 minutes
Wrap-up 1 minute

5 readings Total 60 minutes

Normalized and denormalized data 20 minutes
Components and objectives of data governance 10 minutes
Data catalog components 10 minutes
Data lakehouse implementation best practices 10 minutes
Glossary terms from module 2 10 minutes

5 assignments Total 88 minutes

Module 2 challenge 50 minutes
Test your knowledge: Ways to organize data 8 minutes
Test your knowledge: Data governance 10 minutes
Test your knowledge: Foundations of accessible data 10 minutes
Test your knowledge: Data lakehouse architecture 10 minutes

1 app item Total 90 minutes

Explore a Lakehouse 90 minutes

Time for a data treasure hunt! In this module, you'll use Google Cloud tools, like BigQuery and Dataplex, to track down, access, and store the data you need. Think of it as your digital detective kit for solving those tricky business problems.

What's included

7 videos8 readings4 assignments1 app item

7 videos Total 21 minutes

Welcome to module 3 1 minute
Ryan: Curiosity can help you understand and connect data 3 minutes
Data lineage and traceability 3 minutes
Introduction to Analytics Hub 5 minutes
Data discovery, curation, and unification 4 minutes
Benefits of using Dataplex 4 minutes
Wrap-up 1 minute

8 readings Total 90 minutes

How to find data using BigQuery 10 minutes
Dataplex's data lineage feature 10 minutes
How to use the Dataplex data lineage feature 10 minutes
Analytics Hub enables data sharing 20 minutes
How to use Analytics Hub 10 minutes
Overview of Dataplex 10 minutes
How to search for data with BigQuery 10 minutes
Glossary terms from module 3 10 minutes

4 assignments Total 72 minutes

Module 3 challenge 50 minutes
Test your knowledge: Strategies for understanding data sources 6 minutes
Test your knowledge: Tools for sharing data 8 minutes
Test your knowledge: Dataplex and BigQuery for accessing data 8 minutes

1 app item Total 90 minutes

Navigate Dataplex 90 minutes

Become a data whisperer! This module teaches you how to talk to data tables and supercharge your queries for lightning-fast insights. You'll explore the power of cloud-based data lakes and warehouses, so you can answer tough business questions with confidence.

What's included

13 videos14 readings6 assignments2 app items

13 videos Total 55 minutes

Welcome to module 4 1 minute
Methods for defining BigQuery table schemas 5 minutes
Basic SQL commands for querying data 5 minutes
Steps and models for accessing data with machine learning 6 minutes
Introduction to machine learning with Vertex AI and BigQuery 5 minutes
Overview of Google Colab 6 minutes
Essentials of database partitioning 5 minutes
Methods for partitioning tables 6 minutes
Strategies for querying partitioned tables 4 minutes
Key processes and benefits of Dataproc 4 minutes
Wrap-up 1 minute
Vince and George: Interview role play 5 minutes
Course wrap-up 2 minutes

14 readings Total 140 minutes

Auto-detection of schemas in BigQuery 10 minutes
[Supplemental] SQL query terms 10 minutes
Cloud-based machine learning can train predictive models 10 minutes
Managed notebooks 10 minutes
Benefits of data partitioning 10 minutes
Data partitioning reduces cloud costs 10 minutes
Create a partitioned table 10 minutes
Tips for interacting with partitioned tables 10 minutes
How to create a Dataproc cluster 10 minutes
How to manage Dataproc clusters 10 minutes
Interview tip: Provide examples 10 minutes
Glossary terms from module 4 10 minutes
Course 2 resources and citations 10 minutes
Glossary terms from Course 2 10 minutes

6 assignments Total 90 minutes

Module 4 challenge 50 minutes
Test your knowledge: Data schemas and queries in BigQuery 10 minutes
Test your knowledge: Integration of Google Cloud tools 8 minutes
Test your knowledge: Overview of data partitioning 10 minutes
Test your knowledge: Techniques for managing partitioned tables 6 minutes
Test your knowledge: Dataproc for automation and improved data processing 6 minutes

2 app items Total 180 minutes

Compare data analytics with BigQuery and Dataproc 90 minutes
Manage a partitioned table in BigQuery 90 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Instructor ratings

(10 ratings)

Google Cloud Training

Google Cloud

2,064 Courses 3,939,703 learners

Offered by

Google Cloud

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

5 stars
72.50%
4 stars
7.50%
3 stars
2.50%
2 stars
0%
1 star
17.50%

Showing 3 of 39

Reviewed on Aug 8, 2024

nicely presented content and easy to understand language no matter which field are you from. in depth course material presented nicely and easy to manage your schedule while studying

Reviewed on Sep 30, 2024

This is very well design, one i would add is that add some more videos and more ways to solve the same problem. other than that i learn a lot.

Reviewed on Nov 28, 2024

I had technical challenge with the Lab Test on Comparing Datasets using BigQuery and Dataproc which I affected my overall grade.

View more reviews