No doubt working with huge data volumes is hard, but to move a mountain, you have to deal with a lot of small stones. But why strain yourself? Using Mapreduce and Spark you tackle the issue partially, thus leaving some space for high-level tools. Stop struggling to make your big data workflow productive and efficient, make use of the tools we are offering you.
Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames
YandexAbout this Course
33,800 recent views
Learner Career Outcomes
25%
started a new career after completing these courses
40%
got a tangible career benefit from this course
Shareable Certificate
Earn a Certificate upon completion
100% online
Start instantly and learn at your own schedule.
Flexible deadlines
Reset deadlines in accordance to your schedule.
Advanced Level
Approx. 39 hours to complete
English
Subtitles: French, Portuguese (Brazilian), Korean, Russian, English, Spanish
Skills you will gain
GraphsHiveApache HiveApache Spark
Learner Career Outcomes
25%
started a new career after completing these courses
40%
got a tangible career benefit from this course
Shareable Certificate
Earn a Certificate upon completion
100% online
Start instantly and learn at your own schedule.
Flexible deadlines
Reset deadlines in accordance to your schedule.
Advanced Level
Approx. 39 hours to complete
English
Subtitles: French, Portuguese (Brazilian), Korean, Russian, English, Spanish
Offered by
Yandex
Yandex is a technology company that builds intelligent products and services powered by machine learning. Our goal is to help consumers and businesses better navigate the online and offline world.
Syllabus - What you will learn from this course
22 minutes to complete
Welcome to the Second Course: Big Data Analysis
22 minutes to complete
8 videos (Total 12 min), 1 reading
8 videos
What is BigData Analysis?1m
Tools For BigData Analysis1m
Graph Data Analysis2m
Meet Alexey Dral2m
Meet Pavel Mezentsev37s
Meet Natalia Pritykovskaya40s
Meet Pavel Klemenkov40s
1 reading
Slack Channel is the quickest way to get answers to your questions10m
3 hours to complete
Big Data SQL: Hive
3 hours to complete
15 videos (Total 105 min)
15 videos
HTTP Web Service: Access Log Format4m
Business Use Cases: Solution with Hive6m
(optional) SQL: likbez10m
Hive Data Definition Language (DDL)11m
Hive Data Manipulation Language (DML)6m
Hive Analytics: RegexSerDe, Views7m
(optional) Regular Expressions, Likbez9m
Hive Analytics: UDF, UDAF, UDTF7m
Hive Streaming4m
Hive PTF (Window Functions)5m
Hive Optimization: Partitioning, Bucketing and Sampling8m
Hive Map-Side Joins: Plain, Bucket, Sort-Merge5m
Hive Optimization: Data Skew4m
Hive Optimization: Row-Columnar File Formats, Compression8m
3 practice exercises
Hive: SQL over Hadoop MapReduce30m
Hive Analytics with UDF and Streaming30m
Hive final30m
8 hours to complete
Big Data SQL: Hive (practice week)
8 hours to complete
3 videos (Total 14 min), 4 readings, 5 quizzes
3 videos
How to Install Docker on Windows 7, 8, 104m
How to submit your first Hive assignment6m
4 readings
Grading System: Instructions and Common Problems10m
Docker Installation Guide10m
Assignments. General requirements10m
Hive assignment. Intro and instructions10m
2 hours to complete
Spark SQL and Spark Dataframe
2 hours to complete
14 videos (Total 82 min)
14 videos
What is Pandas DataFrame and how to create it4m
How to process a DataFrame as SQL4m
Working with Hive4m
Reading and Writing Files7m
RDD vs. DF vs. SQL3m
Projection and Filtering5m
Functions5m
Aggregates6m
Join8m
User Defined Functions8m
Time Processing4m
Window Functions7m
Two-Dimensional Distributions4m
2 practice exercises
Introducing DataFrame and SQL30m
Spark SQL and Spark Dataframe30m
6 hours to complete
Graph Analysis from Big Data Perspective
6 hours to complete
13 videos (Total 83 min)
13 videos
Graph representation7m
Counting common friends. Part I2m
Counting common friends. Part II10m
Counting common friends. Part III5m
GraphFrames: Introduction6m
Motif Finding: DSL6m
Motif Finding: Counting Mutual Friends6m
Motif Finding: Under The Hood. Part 114m
Motif Finding: Under The Hood. Part 24m
Triangles Count: Introduction3m
Triangles Count: Edge Lists6m
Triangles Count: GraphFrame6m
4 practice exercises
Graph Representations30m
Motif Finding30m
Triangles Count30m
Graph Analysis from Big Data Perspective30m
Reviews
TOP REVIEWS FROM BIG DATA ANALYSIS: HIVE, SPARK SQL, DATAFRAMES AND GRAPHFRAMES
by SMNov 12, 2018
content of the course is remarkable and the way they explained concepts is very lucid. I just want to give suggestions please give link to the data set they are using for illustrating the concepts.
by VIDec 8, 2017
Quite a good course, but weeks about graphs I found somewhat poor. Apart from that you learn basics of Hive, details of DataFrame API of Spark and how it internally works.
by MGDec 4, 2018
Unfortunately, I often spent more time trying to get my assignments to pass the automatic grader than on solving them. This made the course a bit frustrating at times.
by SSFeb 2, 2018
I wish I could give more rating than 5 :). Excellent course. Thanks so much for such an excellent course. All the instructors are great.
Frequently Asked Questions
When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
- The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
- The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I purchase the Certificate?
When you purchase a Certificate you get access to all course materials, including graded assignments. Upon completing the course, your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
What is the refund policy?
You will be eligible for a full refund until two weeks after your payment date, or (for courses that have just launched) until two weeks after the first session of the course begins, whichever is later. You cannot receive a refund once you’ve earned a Course Certificate, even if you complete the course within the two-week refund period. See our full refund policy.
Is financial aid available?
Yes, Coursera provides financial aid to learners who cannot afford the fee. Apply for it by clicking on the Financial Aid link beneath the "Enroll" button on the left. You’ll be prompted to complete an application and will be notified if you are approved. Learn more.
Will I earn university credit for completing the Course?
This Course doesn't carry university credit, but some universities may choose to accept Course Certificates for credit. Check with your institution to learn more. Online Degrees and Mastertrack™ Certificates on Coursera provide the opportunity to earn university credit.
More questions? Visit the Learner Help Center.
