About this Course

29,253 recent views

Learner Career Outcomes

25%

started a new career after completing these courses

40%

got a tangible career benefit from this course

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Advanced Level

Approx. 69 hours to complete

Suggested: 6 weeks of study, 6-8 hours/week...

English

Subtitles: English, Korean

Skills you will gain

GraphsHiveApache HiveApache Spark

Learner Career Outcomes

25%

started a new career after completing these courses

40%

got a tangible career benefit from this course

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Advanced Level

Approx. 69 hours to complete

Suggested: 6 weeks of study, 6-8 hours/week...

English

Subtitles: English, Korean

Syllabus - What you will learn from this course

Week
1

Week 1

22 minutes to complete

Welcome to the Second Course: Big Data Analysis

22 minutes to complete
8 videos (Total 12 min), 1 reading
8 videos
What is BigData Analysis?1m
Tools For BigData Analysis1m
Graph Data Analysis2m
Meet Alexey Dral2m
Meet Pavel Mezentsev37s
Meet Natalia Pritykovskaya40s
Meet Pavel Klemenkov40s
1 reading
Slack Channel is the quickest way to get answers to your questions10m
3 hours to complete

Big Data SQL: Hive

3 hours to complete
15 videos (Total 105 min)
15 videos
HTTP Web Service: Access Log Format4m
Business Use Cases: Solution with Hive6m
(optional) SQL: likbez10m
Hive Data Definition Language (DDL)11m
Hive Data Manipulation Language (DML)6m
Hive Analytics: RegexSerDe, Views7m
(optional) Regular Expressions, Likbez9m
Hive Analytics: UDF, UDAF, UDTF7m
Hive Streaming4m
Hive PTF (Window Functions)5m
Hive Optimization: Partitioning, Bucketing and Sampling8m
Hive Map-Side Joins: Plain, Bucket, Sort-Merge5m
Hive Optimization: Data Skew4m
Hive Optimization: Row-Columnar File Formats, Compression8m
3 practice exercises
Hive: SQL over Hadoop MapReduce20m
Hive Analytics with UDF and Streaming20m
Hive final20m
Week
2

Week 2

6 hours to complete

Big Data SQL: Hive (practice week)

6 hours to complete
3 videos (Total 11 min), 4 readings, 5 quizzes
3 videos
How to Install Docker on Windows 7, 8, 104m
How to submit your first Hadoop assignment3m
4 readings
Grading System: Instructions and Common Problems10m
Docker Installation Guide10m
Assignments. General requirements10m
Hive assignment. Intro and instructions10m
Week
3

Week 3

2 hours to complete

Spark SQL and Spark Dataframe

2 hours to complete
14 videos (Total 82 min)
14 videos
What is Pandas DataFrame and how to create it4m
How to process a DataFrame as SQL4m
Working with Hive4m
Reading and Writing Files7m
RDD vs. DF vs. SQL3m
Projection and Filtering5m
Functions5m
Aggregates6m
Join8m
User Defined Functions8m
Time Processing4m
Window Functions7m
Two-Dimensional Distributions4m
2 practice exercises
Introducing DataFrame and SQL16m
Spark SQL and Spark Dataframe18m
Week
4

Week 4

4 hours to complete

Graph Analysis from Big Data Perspective

4 hours to complete
13 videos (Total 83 min)
13 videos
Graph representation7m
Counting common friends. Part I2m
Counting common friends. Part II10m
Counting common friends. Part III5m
GraphFrames: Introduction6m
Motif Finding: DSL6m
Motif Finding: Counting Mutual Friends6m
Motif Finding: Under The Hood. Part 114m
Motif Finding: Under The Hood. Part 24m
Triangles Count: Introduction3m
Triangles Count: Edge Lists6m
Triangles Count: GraphFrame6m
4 practice exercises
Graph Representations10m
Motif Finding18m
Triangles Count8m
Graph Analysis from Big Data Perspective20m
4.1
31 ReviewsChevron Right

Top reviews from Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames

By SMNov 13th 2018

content of the course is remarkable and the way they explained concepts is very lucid. I just want to give suggestions please give link to the data set they are using for illustrating the concepts.

By SSFeb 3rd 2018

I wish I could give more rating than 5 :). Excellent course. Thanks so much for such an excellent course. All the instructors are great.

Instructors

Instructor rating3.5/5 (5 Ratings)Info
Image of instructor, Alexey A. Dral

Alexey A. Dral 

Founder and Chief Executive Officer
BigData Team
42,661 Learners
5 Courses
Image of instructor, Pavel Klemenkov

Pavel Klemenkov 

Chief Data Scientist
NVIDIA
14,540 Learners
1 Course
Image of instructor, Natalia Pritykovskaya

Natalia Pritykovskaya 

14,540 Learners
1 Course

Offered by

Yandex logo

Yandex

Frequently Asked Questions

  • Once you enroll for a Certificate, you’ll have access to all videos, quizzes, and programming assignments (if applicable). Peer review assignments can only be submitted and reviewed once your session has begun. If you choose to explore the course without purchasing, you may not be able to access certain assignments.

  • When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.

More questions? Visit the Learner Help Center.