Data Collection and Processing with Python

Data Collection and Processing with Python

This course is part of Python 3 Programming Specialization

Instructor: Paul Resnick

Access provided by BITS Pilani

113,674 already enrolled

4 modules

Gain insight into a topic and learn the fundamentals.

4,042 reviews

Intermediate level

Some related experience required

Flexible schedule

2 weeks at 10 hours a week

Learn at your own pace

97%

Most learners liked this course

4 modules

Gain insight into a topic and learn the fundamentals.

4,042 reviews

Intermediate level

Some related experience required

Flexible schedule

2 weeks at 10 hours a week

Learn at your own pace

97%

Most learners liked this course

What you'll learn

Fetch and process data from Internet services effectively.
Master Python list comprehensions for data extraction and processing.
Utilize the Python requests module to interact with REST APIs and navigate API documentation.

Skills you'll gain

Tools you'll learn

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

2 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is part of the Python 3 Programming Specialization

When you enroll in this course, you'll also be enrolled in this Specialization.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate

There are 4 modules in this course

This course teaches you to fetch and process data from services on the Internet. It covers Python list comprehensions and provides opportunities to practice extracting from and processing deeply nested data. You'll also learn how to use the Python requests module to interact with REST APIs and what to look for in documentation of those APIs. For the final project, you will construct a “tag recommender” for the flickr photo sharing site.

The course is well-suited for you if you have already taken the "Python Basics" and "Python Functions, Files, and Dictionaries" courses (courses 1 and 2 of the Python 3 Programming Specialization). If you are already familiar with Python fundamentals but want practice at retrieving and processing complex nested data from Internet services, you can also benefit from this course without taking the previous two. This is the third of five courses in the Python 3 Programming Specialization.

What's included

5 videos3 readings1 ungraded lab

5 videos Total 41 minutes

Introduction to the Specialization 11 minutes
What’s New? Updates and Improvements in the Second Edition 2 minutes
Welcome to Python Data Collection and Processing with Python 2 minutes
(Optional) How to Use the Interactive Textbook 14 minutes
Executing Python in the Jupyter Environment 11 minutes

3 readings Total 30 minutes

Syllabus 10 minutes
A note to learners who have not taken the updated course 2 - Functions, Files and Dictionaries 10 minutes
Help Us Learn More About You! 10 minutes

1 ungraded lab Total 60 minutes

(Optional) Getting Started with Jupyter Notebooks 60 minutes

In week one the video lectures and activities from the Runestone textbook will cover more complex data structures. By the end of this week, you will have learned how to process json formatted data, traverse nested data using nested iteration, and extract values from nested data.

What's included

13 videos1 assignment1 programming assignment8 app items1 ungraded lab

13 videos Total 102 minutes

Introduction - Nested Data 1 minute
Nested Lists 17 minutes
Nested Dictionaries 7 minutes
JSON Format and the JSON Module 7 minutes
Conclusion - Nested Data 2 minutes
Introduction - Nested Iteration 2 minutes
Nested Iteration 19 minutes
Structuring Nested Data 6 minutes
Shallow Copies 7 minutes
Deep Copies 10 minutes
Extracting from Nested Data 14 minutes
A Worked Example of Nested Iteration 7 minutes
Conclusion: Nested Data and Nested Iteration 2 minutes

1 assignment Total 4 minutes

Optional - What Did You Use to Practice This Week? 4 minutes

1 programming assignment Total 60 minutes

Assessment - Nested Data and Nested Iteration 60 minutes

8 app items Total 75 minutes

Use the Runestone Practice Tool 5 minutes
Introduction: Nested Data and Nested Iteration 10 minutes
Nested Dictionaries 10 minutes
Processing JSON Results 10 minutes
Nested Iteration 10 minutes
Structuring Nested Data 10 minutes
Deep and Shallow Copies 10 minutes
Extracting from Nested Data 10 minutes

1 ungraded lab Total 60 minutes

(Optional) JavaScript Object Notation (JSON) 60 minutes

In week two you will be learning more advanced forms of accumulation. By the end of the week, you will have learned how to use the map and filter functions in combination with functions to transform or filter out data and store the resulting data in a new object. You will have also learned how to accumulate data using a list comprehension.

What's included

13 videos1 assignment1 programming assignment6 app items3 ungraded labs

13 videos Total 78 minutes

Introduction - Map and Filter 1 minute
Map 14 minutes
Filter 8 minutes
Conclusion - Map and Filter 3 minutes
Introduction - List Comprehensions 1 minute
List Comprehensions 9 minutes
List Comprehensions Example 1 7 minutes
List Comprehensions Example 2 10 minutes
Conclusion - List Comprehensions 1 minute
Introduction - Zip 1 minute
Zip 8 minutes
An Example Using Zip 13 minutes
Conclusion - Zip 1 minute

1 assignment Total 4 minutes

Optional - What Did You Use to Practice This Week? 4 minutes

1 programming assignment Total 60 minutes

Assessment - More on Accumulation 60 minutes

6 app items Total 55 minutes

Use the Runestone Practice Tool 5 minutes
Introduction: Map, Filter, List Comprehensions, and Zip 10 minutes
Map 10 minutes
Filter 10 minutes
List Comprehensions 10 minutes
Zip 10 minutes

3 ungraded labs Total 180 minutes

(Optional) Map and Filter 60 minutes
An Example Using Zip 60 minutes
(Optional) Review and List Comprehensions Warmup 60 minutes

In week three you will learn how to request data from the internet using Application Programming Interfaces (APIs). By the end of the week, you will have learned how to access data from a few APIs, cache data that you have requested, and also learned how to read and work with other APIs that were not touched on in the module.

What's included

25 videos2 readings1 programming assignment12 app items2 ungraded labs

25 videos Total 132 minutes

Introduction - REST APIs 2 minutes
URLs, Domain Names, and IP Addresses 5 minutes
Routing 4 minutes
HTTP: Behind the Scenes 6 minutes
URL Query Parameters 3 minutes
REST API URLs 3 minutes
The requests Module 6 minutes
Generating URLs with requests.get 6 minutes
Conclusion - REST APIs 2 minutes
Introduction - Using REST APIs 1 minute
Reading API Documentation: Datamuse 8 minutes
Debugging Calls to requests.get 6 minutes
Caching Response Content 8 minutes
The requests_with_caching Module 9 minutes
Conclusion - Using REST APIs 2 minutes
Introduction - Practice with REST APIs 1 minute
iTunes API 8 minutes
flickr API 15 minutes
Conclusion - Practice with REST APIs 1 minute
Fun with the Google Places API 20 minutes
Running Python in Hosted Systems 2 minutes
Creating Your Own API - Part 1 2 minutes
Creating Your Own API - Part 2 5 minutes
Creating Your Own API - Part 3 5 minutes
Introduction - Final Course Project 2 minutes

2 readings Total 20 minutes

Course Feedback 10 minutes
Keep Learning with Michigan Online 10 minutes

1 programming assignment Total 60 minutes

Project - OMDB and Dad Joke Mashup 60 minutes

12 app items Total 115 minutes

Use the Runestone Practice Tool 5 minutes
The Internet: Behind the Scenes 10 minutes
Anatomy of URLs 10 minutes
The HTTP Protocol 10 minutes
Using REST APIs 10 minutes
Fetching a Page 10 minutes
Figuring Out How to Use a REST API 10 minutes
Debugging Calls to requests.get 10 minutes
Caching Response Content 10 minutes
Searching for Media on iTunes 10 minutes
Searching for tags on Flickr 10 minutes
Unicode for Non-English Characters 10 minutes

2 ungraded labs Total 120 minutes

(Optional) REST APIs 60 minutes
(Optional) Request Data with Cache 60 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Instructor ratings

(513 ratings)

Paul Resnick

University of Michigan

13 Courses 593,065 learners

Offered by

University of Michigan

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

5 stars
77.06%
4 stars
17.46%
3 stars
3.95%
2 stars
0.64%
1 star
0.86%

Showing 3 of 4042

Reviewed on Jul 3, 2023

This course presents useful concepts, but as with earlier courses in this specialization, it is geared toward learners who are new to programming. Experienced learners may expect a greater challenge.

Reviewed on Jan 24, 2020

Excellent coursework and exercises to learn, especially for beginners -Really liked the presentation and constant support - seems like they know how people think while learning python :)

Reviewed on Jan 2, 2022

Excellent course. Highly recommended. I learned a lot about parts of Python that I was not previously proficient in. I will definitely use what I learned in a job that I'm just about to start.

View more reviews