Optimize TensorFlow Models For Deployment with TensorRT
Optimize Tensorflow models using TensorRT (TF-TRT)
Use TF-TRT to optimize several deep learning models at FP32, FP16, and INT8 precision
Observe how tuning TF-TRT parameters affects performance and inference throughput
Showcase this hands-on experience in an interview
This is a hands-on, guided project on optimizing your TensorFlow models for inference with NVIDIA's TensorRT. By the end of this 1.5 hour long project, you will be able to optimize Tensorflow models using the TensorFlow integration of NVIDIA's TensorRT (TF-TRT), use TF-TRT to optimize several deep learning models at FP32, FP16, and INT8 precision, and observe how tuning TF-TRT parameters affects performance and inference throughput. Prerequisites: In order to successfully complete this project, you should be competent in Python programming, understand deep learning and what inference is, and have experience building deep learning models in TensorFlow and its Keras API. Note: This course works best for learners who are based in the North America region. We’re currently working on providing the same experience in other regions.
It is assumed that are competent in Python programming and have prior experience with building deep learning models with TensorFlow and its Keras API
Skills you will develop
Learn step-by-step
In a video that plays in a split-screen with your work area, your instructor will walk you through these steps:
Introduction and Project Overview
Setup your TensorFlow and TensorRT Runtime
Load the Data and Pre-trained InceptionV3 Model
Create batched Input
Load the TensorFlow SavedModel
Get Baseline for Prediction Throughput and Accuracy
Convert a TensorFlow saved model into a TF-TRT Float32 Graph
Benchmark TF-TRT Float32
Convert to TF-TRT Float16 and Benchmark
Converting to TF-TRT INT8
How Guided Projects work
Your workspace is a cloud desktop right in your browser, no download required
In a split-screen video, your instructor guides you step-by-step
Frequently asked questions
Frequently Asked Questions
Are Guided Projects available on desktop and mobile?
Who are the instructors for Guided Projects?
Can I download the work from my Guided Project after I complete it?
How much experience do I need to do this Guided Project?
Can I complete this Guided Project right through my web browser, instead of installing special software?
What is the learning experience like with Guided Projects?
More questions? Visit the Learner Help Center.
Coursera Footer
