About this Course
Specialization
100% online

100% online

Start instantly and learn at your own schedule.
Flexible deadlines

Flexible deadlines

Reset deadlines in accordance to your schedule.
Advanced Level

Advanced Level

Hours to complete

Approx. 6 hours to complete

Suggested: 4 weeks of study, 4-8 hours/week...
Available languages

English

Subtitles: English

Skills you will gain

KafkaNoSQLSpark StreamingSpark
Specialization
100% online

100% online

Start instantly and learn at your own schedule.
Flexible deadlines

Flexible deadlines

Reset deadlines in accordance to your schedule.
Advanced Level

Advanced Level

Hours to complete

Approx. 6 hours to complete

Suggested: 4 weeks of study, 4-8 hours/week...
Available languages

English

Subtitles: English

Syllabus - What you will learn from this course

Week
1
Hours to complete
5 minutes to complete

Welcome to the course "Big Data Applications: Real-Time Streaming"

...
Reading
3 videos (Total 5 min)
Video3 videos
Real-Time Streaming Course Structure2m
Meet Artyomm
Hours to complete
5 hours to complete

Basics of real-time data processing

...
Reading
12 videos (Total 56 min), 5 readings, 5 quizzes
Video12 videos
Real-time processing of Big Data4m
Delivery semantics6m
Approaches to real-time data processing5m
Lambda and Kappa Architectures6m
Introduction1m
Data storages for real-time big data processing6m
Introduction to Kafka6m
Kafka pros and cons4m
Kafka CLI6m
How to submit your first assignment3m
How to Install Docker on Windows 7, 8, 104m
Reading5 readings
Assignments. General requirements10m
Slack Channel is the quickest way to get answers to your questions10m
Docker Installation Guide10m
FAQ How to show your code to teaching staff10m
Grading System: Instructions and Common Problems10m
Quiz3 practice exercises
Introduction to the world of big data real-time processing. Delivery semantics12m
Data storages for real-time big data processing. Kafka16m
Basics of real-time data processing18m
Week
2
Hours to complete
4 hours to complete

Spark Streaming

...
Reading
6 videos (Total 34 min), 5 quizzes
Video6 videos
Spark Streaming concept6m
How to write Spark Streaming application6m
Spark Streaming hints6m
Spark Streaming and delivery semantics8m
Exactly once extended4m
Quiz2 practice exercises
Spark Streaming12m
Spark Streaming: final18m
Week
3
Hours to complete
2 hours to complete

NoSQL. Cassandra

...
Reading
13 videos (Total 68 min), 3 quizzes
Video13 videos
CAP theorem5m
Cassandra Architecture4m
Read-Write Path6m
Cassandra Data Model5m
Virtual nodes2m
Gossip Protocol5m
Building Applications with Cassandra3m
Getting Started with CQL7m
Accessing Cassandra from Python7m
Static Columns4m
Overcoming Cassandra's Limitation3m
Secondary Indexes4m
Quiz3 practice exercises
Basics of NoSQL18m
Apache Cassandra16m
NoSQL. Cassandra14m
Week
4
Hours to complete
3 hours to complete

NoSQL. Redis

...
Reading
7 videos (Total 46 min), 2 quizzes
Video7 videos
Command line interface8m
Python interface6m
Strings, Lists, Hashes5m
Sets, Sorted Sets, HyperLogLogs6m
Transactions6m
Advanced features6m
Quiz1 practice exercise
Redis0

Instructors

Avatar

Alexey A. Dral

Founder and Chief Executive Officer
BigData Team
Avatar

Artyom Vybornov

Lead software engineer at Rambler&Co
Avatar

Vladislav Goncharenko

DCAM MIPT, Skoltech
Avatar

Ivan Mushketyk

Software Engineer, ConsenSys

About Yandex

Yandex is a technology company that builds intelligent products and services powered by machine learning. Our goal is to help consumers and businesses better navigate the online and offline world....

About the Big Data for Data Engineers Specialization

This specialization is made for people working with data (either small or big). If you are a Data Analyst, Data Scientist, Data Engineer or Data Architect (or you want to become one) — don’t miss the opportunity to expand your knowledge and skills in the field of data engineering and data analysis on the large scale. In four concise courses you will learn the basics of Hadoop, MapReduce, Spark, methods of offline data processing for warehousing, real-time data processing and large-scale machine learning. And Capstone project for you to build and deploy your own Big Data Service (make your portfolio even more competitive). Over the course of the specialization, you will complete progressively harder programming assignments (mostly in Python). Make sure, you have some experience in it. This course will master your skills in designing solutions for common Big Data tasks: - creating batch and real-time data processing pipelines, - doing machine learning at scale, - deploying machine learning models into a production environment — and much more! Join some of best hands-on big data professionals, who know, their job inside-out, to learn the basics, as well as some tricks of the trade, from them. Special thanks to Prof. Mikhail Roytberg (APT dept., MIPT), Oleg Sukhoroslov (PhD, Senior Researcher, IITP RAS), Oleg Ivchenko (APT dept., MIPT), Pavel Akhtyamov (APT dept., MIPT), Vladimir Kuznetsov, Asya Roitberg, Eugene Baulin, Marina Sudarikova....
Big Data for Data Engineers

Frequently Asked Questions

  • Once you enroll for a Certificate, you’ll have access to all videos, quizzes, and programming assignments (if applicable). Peer review assignments can only be submitted and reviewed once your session has begun. If you choose to explore the course without purchasing, you may not be able to access certain assignments.

  • When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.

More questions? Visit the Learner Help Center.