Microsoft
Microsoft Azure Databricks for Data Engineering
Microsoft

Microsoft Azure Databricks for Data Engineering

This course is part of Microsoft Azure Data Engineering Associate (DP-203) Professional Certificate

Taught in English

Some content may not be translated

 Microsoft

Instructor: Microsoft

16,678 already enrolled

Included with Coursera Plus

Course

Gain insight into a topic and learn the fundamentals

4.2

(98 reviews)

Intermediate level

Recommended experience

21 hours (approximately)
Flexible schedule
Learn at your own pace

What you'll learn

  • How to work with large amounts of data from multiple sources in different raw formats

  • How to create production workloads on Azure Databricks with Azure Data Factory

  • How to build and query a Delta Lake

  • How to perform data transformations in DataFrame. How to understand the architecture of an Azure Databricks Spark Cluster and Spark Jobs

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

32 quizzes

Course

Gain insight into a topic and learn the fundamentals

4.2

(98 reviews)

Intermediate level

Recommended experience

21 hours (approximately)
Flexible schedule
Learn at your own pace

See how employees at top companies are mastering in-demand skills

Placeholder

Build your Data Analysis expertise

This course is part of the Microsoft Azure Data Engineering Associate (DP-203) Professional Certificate
When you enroll in this course, you'll also be enrolled in this Professional Certificate.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate from Microsoft
Placeholder
Placeholder

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

Placeholder

There are 9 modules in this course

Describe the capabilities of Azure Databricks and the Apache Spark notebook for processing huge files. Describe the Azure Databricks platform and identify the types of tasks well-suited for Apache Spark. Describe the architecture of an Azure Databricks Spark Cluster and Spark Jobs.

What's included

7 videos5 readings4 quizzes1 discussion prompt

Describe how to use Azure Databricks supports day-to-day data-handling functions, such as reads, writes, and queries.

What's included

2 videos6 readings3 quizzes

Process data in Azure Databricks by defining DataFrames to read and process the Data. Perform data transformations in DataFrames and execute actions to display the transformed data. Explain the difference between a transform and an action, lazy and eager evaluations, Wide and Narrow transformations, and other optimizations in Azure Databricks.

What's included

6 videos6 readings4 quizzes

Use the DataFrame Column Class Azure Databricks to apply column-level transformations, such as sorts, filters and aggregations. Use advanced DataFrame functions operations to manipulate data, apply aggregates, and perform date and time operations in Azure Databricks.

What's included

4 videos6 readings5 quizzes

Describe the Azure Databricks platform architecture and how it is securedUse Azure Key Vault to store secrets used by Azure Databricks and other services. Access Azure Storage with Key Vault-based secrets

What's included

6 videos4 readings3 quizzes

Describe how to use Delta Lake to create, append, and upsert data to Apache Spark tables, taking advantage of built-in reliability and optimizations. Describe Azure Databricks Delta Lake architecture

What's included

5 videos6 readings5 quizzes

Process streaming data with Azure Databricks structured streaming. Create production workloads on Azure Databricks with Azure Data Factory.

What's included

6 videos6 readings3 quizzes

Describe how to put Azure Databricks notebooks under version control in an Azure DevOps repo and build deployment pipelines to manage your release process. Describe how to integrate Azure Databricks with Azure Synapse Analytics as part of your data architecture. Describe best practices for workspace administration, security, tools, integration, databricks runtime, HA/DR, and clusters in Azure Databricks

What's included

11 videos5 readings4 quizzes

Prepare for the Microsoft Certified: Azure Data Engineer Associate exam

What's included

2 videos2 readings1 quiz1 discussion prompt

Instructor

Instructor ratings
4.3 (23 ratings)
 Microsoft
Microsoft
88 Courses696,660 learners

Offered by

Microsoft

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

Showing 3 of 98

4.2

98 reviews

  • 5 stars

    60.20%

  • 4 stars

    20.40%

  • 3 stars

    5.10%

  • 2 stars

    6.12%

  • 1 star

    8.16%

MN
5

Reviewed on Sep 11, 2023

RP
4

Reviewed on Dec 10, 2023

New to Data Analysis? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions