This course is part of the Python, Bash and SQL Essentials for Data Engineering Specialization

4.6
stars
48 ratings

Alfredo Deza +2 more instructors

5,587 already enrolled

Offered By

Python, Bash and SQL Essentials for Data Engineering SpecializationDuke University

About this Course

24,652 recent views

In this third course of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will explore techniques to work effectively with Python and SQL. We will go through useful data structures in Python scripting and connect to databases like MySQL. Additionally, you will learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data. Finally, you will use extracted data from websites using scraping techniques. These skills will allow you to work effectively when data is not readily available, or when spatial queries are required to extract useful information from databases.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Course 3 of 4 in the

Python, Bash and SQL Essentials for Data Engineering Specialization

Intermediate Level

Some experience with Python programming (<1 year)

Approx. 19 hours to complete

English

What you will learn

Extract data from different sources and map it to Python data structures.
Design Scripts to connect and query a SQL database from within Python.
Apply scraping techniques to read and extract data from a website.

Skills you will gain

Database (DBMS)
Python Programming
Web Scraping
MySQL
SQL

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Course 3 of 4 in the

Python, Bash and SQL Essentials for Data Engineering Specialization

Intermediate Level

Some experience with Python programming (<1 year)

Approx. 19 hours to complete

English

Instructors

Instructor rating

4.25/5 (8 Ratings)

Offered by

Duke University

Syllabus - What you will learn from this course

Week1

Week 1

5 hours to complete

Working with Data in Python

5 hours to complete

19 videos (Total 62 min), 4 readings, 2 quizzes

19 videos

Welcome to Scripting with Python and SQL for Data Engineering45sMeet your Course Instructor: Alfredo Deza29sOverview of Key Concepts4mIntroduction to Working with Data in Python29sIntroduction to Python Data Structures46sUsing Lists to Save and Retrieve Data in Python5mUsing Dictionaries to Save and Retrieve Data in Python7mOverview of Lesson Common Data Structures in Python4mRecap of Data Structures in Python1mIntroduction to Choosing Data Structures in Python1mIterating Over Lists and Dictionaries in Python7mIterating Over Other Data Structures in Python2mStoring Data Between Data Structures in Python6mRecap of Mapping Data Structures in Python1mIntroduction to Data Sources and Formats in Python53sLoading Data from Files and File Paths in Python6mWorking with JSON in Python6mSaving Data from Python to Disk4mRecap of Persisting and Loading Data in Python47s

4 readings

Meet your Supporting Instructors: Kennedy Behrman and Noah Gift10mCourse Structure and Discussion Etiquette10mPython Lists and Dictionaries10mBuild a notebook that reformats data into JSON10m

2 practice exercises

Using Data Structures in Python30mWorking with Data in Python30m

Week2

Week 2

5 hours to complete

Python Scripting and SQL

5 hours to complete

15 videos (Total 56 min), 2 readings, 1 quiz

15 videos

Introduction to Python Scripting and SQL31sIntroduction to Scripting in Python40sCreating a Script as a Module in Python5mTraversing the File System with a Script in Python7mRecap of Python Scripting Basics43sIntroduction to Embedded Databases48sWhat is SQLite?2mCreating and Connecting to a SQLite Database in Python5mSaving and Querying from a SQLite Database in Python10mRecap of SQLite and Python1mIntroduction to Querying with SQL in Python1mBasic SQL Commands in Python6mExtracting Distinct Data using SQL in Python7mSearching with SQL in Python5mRecap of Querying with SQL in Python1m

2 readings

Minimal Python, Chapter 2: Learn to Store Data10mCreate a Reporting Script for File Sizes10m

1 practice exercise

Python Scripting and SQL30m

Week3

Week 3

5 hours to complete

Web Scraping using Python

5 hours to complete

15 videos (Total 65 min), 3 readings, 1 quiz

15 videos

Introduction to Web Scraping using Python30sIntroduction to Extracting Data from Unstructured HTML1mChallenges with Web Data3mParsing HTML with HTMLParser in Python5mRecap of Web Scraping Techniques in Python40sIntroduction to Scrapy and XPath in Python1mCreating a Web Scraping Project with Scrapy in Python6mParsing Data with XPath and Scrapy Shell11mUsing Scrapy Spider for Web Scraping5mRecap of Scrapy and XPath in Python43sOverview of Challenges with Web Scraping2mScraping Locally8mPersisting Data in CSV and JSON Formats9mPersisting Data to a SQLite Database6mRecap of Persistence and Efficacy with Web Scraping1m

3 readings

Parsing Techniques with HTMLParser10mEfficient Scraping Techniques10mBuild a Web Scraping Tool10m

1 practice exercise

Web Scraping using Python30m

Week4

Week 4

4 hours to complete

Working with MySQL

4 hours to complete

11 videos (Total 37 min), 2 readings, 1 quiz

11 videos

Introduction to Working with MySQL30sIntroduction to VSCode with MySQL1mConnecting to a MySQL Server8mRecap of VSCode with MySQL1mChallenges of Running MySQL Queries1mUsing VSCode to Execute MySQL Queries6mRecap of Running MySQL Queries1mChallenges with Importing to Databases1mImporting CSV Data into MySQL6mExporting Data from MySQL6mRecap of Importing and Exporting Data in MySQL1m

2 readings

Working with VSCode and MySQL10mLoading and Exporting Data using MySQL10m

1 practice exercise

Working with MySQL30m

Reviews

4.6

7 reviews

5 stars
79.59%
4 stars
14.28%
1 star
6.12%

TOP REVIEWS FROM SCRIPTING WITH PYTHON AND SQL FOR DATA ENGINEERING

by BMAug 28, 2022

This provides the essentials of data engineering and analysis.

by CQOct 20, 2022

Covered great Python. data engineering techniques as well as using SQLite and MySQL in VSCode

View all reviews

About the Python, Bash and SQL Essentials for Data Engineering Specialization

If you are interested in developing the skills needed to be a data engineer, the Python, Bash and SQL Essentials for Data Engineering Specialization is a great place to start. We live in a world that is driven by big data - from what we search online to the route we take to our favorite restaurant, and everything in between. Businesses and organizations use this data to make decisions that impact the ways in which we navigate our lives. How do engineers collect this data? How can this data be organized so that it can be appropriately analyzed? A data engineer is specialized in this initial step of accessing, cleaning and managing big data.

Data engineers today need a solid foundation in a few essential areas: Python, Bash and SQL. In Python, Bash and SQL Essentials for Data Engineering, we provide a nuts and bolts overview of these fundamental skills needed for entering the world of data engineering. Led by three professional data engineers, this Specialization will provide quick and accessible ways to learn data engineering strategies, give you a chance to practice what you’ve learned in integrated lab exercises, and then immediately apply these techniques in your professional or academic life.

Frequently Asked Questions

When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

More questions? Visit the Learner Help Center.

Scripting with Python and SQL for Data Engineering

About this Course

What you will learn

Skills you will gain

Instructors

Alfredo Deza

Kennedy Behrman

Noah Gift

Offered by

Duke University

Syllabus - What you will learn from this course

Working with Data in Python

Python Scripting and SQL

Web Scraping using Python

Working with MySQL

Reviews

TOP REVIEWS FROM SCRIPTING WITH PYTHON AND SQL FOR DATA ENGINEERING

About the Python, Bash and SQL Essentials for Data Engineering Specialization

Frequently Asked Questions

Learn Something New

Popular Data Science Courses

Popular Computer Science & IT Courses

Popular Business Courses

Coursera

Community

More

Scripting with Python and SQL for Data Engineering

About this Course

What you will learn

Skills you will gain

Instructors

Alfredo Deza

Kennedy Behrman

Noah Gift

Offered by

Duke University

Syllabus - What you will learn from this course

Working with Data in Python

Python Scripting and SQL

Web Scraping using Python

Working with MySQL

Reviews

TOP REVIEWS FROM SCRIPTING WITH PYTHON AND SQL FOR DATA ENGINEERING

About the Python, Bash and SQL Essentials for Data Engineering Specialization

Frequently Asked Questions

Coursera Footer

Learn Something New

Popular Data Science Courses

Popular Computer Science & IT Courses

Popular Business Courses

Coursera

Community

More