AI Infrastructure and Operations Fundamentals

AI Infrastructure and Operations Fundamentals

Taught in English

Some content may not be translated

18,630 already enrolled


Gain insight into a topic and learn the fundamentals

NVIDIA Training

Instructor: NVIDIA Training


(102 reviews)

Beginner level
No prior experience required
8 hours to complete
3 weeks at 2 hours a week
Flexible schedule
Learn at your own pace

What you'll learn

  • Explore diverse applications of AI across various industries. Understand concepts like Machine Learning, Deep Leaning, training and inference.

  • Trace the evolution of AI Technologies. From its inception to the revolutionary advances brought by Generative AI, and the role of GPUs.

  • You will become familiar with deep learning frameworks and AI software stack.

  • Learn about considerations when deploying AI workloads on a data center on prem, in the cloud, on a hybrid model, or on a multi-cloud environment.

Details to know

Shareable certificate

Add to your LinkedIn profile


21 assignments

See how employees at top companies are mastering in-demand skills


Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review


There are 4 modules in this course

In this module, you will explore AI applications across various industries and delve into fundamental concepts of AI, Machine Learning (ML), and Deep Learning (DL). Additionally, the course will introduce you to Generative AI, how Large Language Models (LLMs) work and new business opportunities being unlocked with this new technology. You will understand what a GPU is, distinguish the key differences between GPUs and CPUs, and delve into the software ecosystem enabling developers to harness GPU computing for data science. Finally, you will learn considerations for deploying AI workloads across different infrastructures, from on-premises data centers to models and multi-cloud setups.

What's included

7 videos5 assignments

In this module, we will visit infrastructure level considerations when deploying AI clusters. You will learn about requirements for multi-system AI clusters, such as the capabilities of NVIDIA GPUs and CPUs to address the requirements of AI workloads, storage, and networking considerations. We will discuss how energy efficient computing practices help data centers lower their carbon footprint, and how recommended design documents, or Reference Architectures (RAs), can be used as a foundation for building best-of-breed optimized AI systems. We will end this module discussing how cloud computing enhances AI deployments, outlining the key considerations for deploying AI in the cloud.

What's included

14 videos13 assignments

This last module covers key aspects involved in infrastructure management, monitoring, cluster orchestration, and job scheduling. You will identify the general concepts about provisioning, managing, and monitoring AI infrastructure, and describe the value and tools for cluster management. Finally, you will learn the key differences and common tools used for orchestration and scheduling, and the value of MLOps tools for continuous delivery and automation of AI workloads.

What's included

2 videos2 assignments

It is highly recommended that you complete all the course activities before you begin the quiz. Good luck!

What's included

1 reading1 assignment


Instructor ratings
4.5 (23 ratings)
NVIDIA Training
3 Courses28,337 learners

Offered by


Recommended if you're interested in Machine Learning

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

Showing 3 of 102


102 reviews

  • 5 stars


  • 4 stars


  • 3 stars


  • 2 stars


  • 1 star



Reviewed on Dec 24, 2023


Reviewed on May 30, 2024


Reviewed on Feb 3, 2024

New to Machine Learning? Start here.


Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions