3.8
stars
79 ratings

Karthik Muthuraman +1 more instructor

9,930 already enrolled

Offered By

IBM Skills Network

About this Course

44,533 recent views

Organizations need skilled, forward-thinking Big Data practitioners who can apply their business and technical skills to unstructured data such as tweets, posts, pictures, audio files, videos, sensor data, and satellite imagery and more to identify behaviors and preferences of prospects, clients, competitors, and others. 
In this short course you'll gain practical skills when you learn how to work with Apache Spark for Data Engineering and Machine Learning (ML) applications. You will work hands-on with Spark MLlib, Spark Structured Streaming, and more to perform extract, transform and load (ETL) tasks as well as Regression, Classification, and Clustering.

The course culminates in a project where you will apply your Spark skills to an ETL for ML workflow use-case.

NOTE: This course requires that you have foundational skills for working with Apache Spark and Jupyter Notebooks.  The Introduction to Big Data with Spark and Hadoop course from IBM will equip you with these skills and it is recommended that you have completed that course or similar prior to starting this one.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Beginner Level

Computer and IT literacy.

Approx. 7 hours to complete

English

Could your company benefit from training employees on in-demand skills?

Try Coursera for Business

What you will learn

Explain how streaming data and Spark Structured Streaming empower machine learning and AI tasks.
Define graph theory, describe Apache Spark GraphFrames, and identify data suitable for GraphFrames.
Describe how ETL processes work with Apache Spark and machine learning and extend that knowledge to Spark MLlib capabilities and related benefits.
Explain supervised learning, unsupervised learning, and clustering, and explain how to use the k-means clustering algorithm with Spark MLlib.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Beginner Level

Computer and IT literacy.

Approx. 7 hours to complete

English

Could your company benefit from training employees on in-demand skills?

Try Coursera for Business

Instructors

Instructor rating

3.46/5 (15 Ratings)

Karthik Muthuraman

Software Engineer (Machine Learning)

IBM Center for Open-Source Data and AI Technologies

25,703 Learners

2 Courses

Romeo Kienzler

Chief Data Scientist, Course Lead

IBM Watson IoT

499,849 Learners

9 Courses

Offered by

IBM Skills Network

IBM is the global leader in business transformation through an open hybrid cloud platform and AI, serving clients in more than 170 countries around the world. Today 47 of the Fortune 50 Companies rely on the IBM Cloud to run their business, and IBM Watson enterprise AI is hard at work in more than 30,000 engagements. IBM is also one of the world’s most vital corporate research organizations, with 28 consecutive years of patent leadership. Above all, guided by principles for trust and transparency and support for a more inclusive society, IBM is committed to being a responsible technology innovator and a force for good in the world.

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

Syllabus - What you will learn from this course

Week1

Week 1

2 hours to complete

Spark for Data Engineering

In this first of two modules, learn what streaming data is and get the essential knowledge to use Spark for Structured Streaming. Learn about data sources, streaming output modes, and supported data destinations. Learn about data operations considerations and discover how Spark Structured streaming listeners and checkpointing benefit streaming data processing. Discover how graph theory works with streaming data. You’ll gain insights into the advantages that Apache Spark GraphFrames offers and learn what qualities make data suitable for GraphFrames processing. Then, explore ETL and learn how to use Apache Spark for data extraction, transformation, and loading, put your newfound knowledge to practice, and gain practical, real-world skills in the ETL for Machine Learning Pipelines hands-on lab.

2 hours to complete

4 videos (Total 25 min), 2 readings, 3 quizzes

Week2

Week 2

3 hours to complete

SparkML

This module demystifies the concepts and practices related to machine learning using SparkML and the Spark Machine learning library. Explore both supervised and unsupervised machine learning. Explore classification and regression tasks and learn how SparkML supports these machine learning tasks. Gain insights into unsupervised learning, with a focus on clustering, and discover how to apply the k-means clustering algorithm using the Spark MLlib. Complete this learning with the lab that solidifies your learning and gain real-world experience with Spark ML.

3 hours to complete

3 videos (Total 13 min), 1 reading, 4 quizzes

Week3

Week 3

3 hours to complete

Final Project

3 hours to complete

3 readings

Reviews

3.8

23 reviews

5 stars
50%
4 stars
17.50%
3 stars
11.25%
2 stars
7.50%
1 star
13.75%

TOP REVIEWS FROM DATA ENGINEERING AND MACHINE LEARNING USING SPARK

by RSJul 1, 2022

Fantastic delivery.

The instructions in the lab could be clearer.

View all reviews

Frequently Asked Questions

When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Certificate?
When you enroll in the course, you get access to all of the courses in the Certificate, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.

More questions? Visit the Learner Help Center.

Build employee skills, drive business results

Discover Coursera for Business

Data Engineering and Machine Learning using Spark

About this Course

What you will learn