HARNESSING
THE VIRTUAL REALM
FOR SUCCESSFUL APPLIED AI
ALISON B LOWNDES
Senior Scientist | Global AI
@alisonblowndes
November 2021
https://blogs.nvidia.com/blog/2021/11/12/earth-2-supercomputer/
5
MOTLEY
FOOL
“NVIDIA IS NOT JUST A GRAPHICS CHIP
COMPANY ANYMORE”
GPU
Ampere A100
CPU
Grace
DPU
BlueField-3
Next-generation data centers are an orchestration of three pillars: the GPU for accelerated computing,
the CPU for general-purpose computing, and the DPU, which processes and moves data in the data
center. The introduction of the NVIDIA Grace™ CPU and the NVIDIA BlueField® DPU make NVIDIA a
three-chip company, aimed at rearchitecting the data center for AI.
NVIDIA
Accelerated Computing
Full Stack, 3 Chips, Data Center Scale
30 Million CUDA Downloads
150 SDKs
$100 Trillion Industry Served
Gaming
Data
Science
Robotics
Broadcast
CAD
Physical
Sciences
Life
Sciences
Quantum
Physics
Digital
Twins
Genomics
5G
Quantum
Computing
Cybersecurity
AI
NLU
Machine
Learning
AI
Recsys
AI
Speech
AI
Computer
Vision
Medical
Imaging
Autonomou
s
Vehicles
Edge
COMPUTING FOR THE DA VINCIS AND EINSTEINS OF OUR TIME
8 of 10
World’s Top 500
Supercomputers
9 of 10
World’s Top 500
Green
Supercomputers
#1
MLPerf
Training and Inference
2021 Nobel Prize in
Physics
Studying Earth’s Climate
25,000
Companies Run
on NVIDIA AI
Oak Ridge National Laboratory and the oak leaf symbol are registered trademarks of the U.S. Department of Energy. Use of this mark does not
constitute or imply its endorsement, recommendation, or favoring by the United States Government or any agency thereof or its contractors or
subcontractors.
8
AI AT NVIDIA
DLSS
AI Rendering
StyleGAN
High-Res Image Generation
GANcraft
3D Scene Generation
GANverse3D
2D to 3D Render
Sim2Real
Quadruped Locomotion
Face Vid2Vid
Audio-Driven Character
Animation
BioMegatron
Medical Language Model
BioMegatron
Medical Language Model
3DGT
3D Ground Truth
Modulus
Physics-Informed AI Model
OrbNet
AI for Quantum Chemistry
NATIVE 4K DLSS 4K
Triton
cuDF
cuIO cuDNN cuML cuGraph TAO TensorRT
NVIDIA CUDA, DOCA, vGPU, Magnum IO
NVIDIA GPU CLOUD REGISTRY
ngc.nvidia.com
NVIDIA AI
GEFORCE OMNIVERSE cuQUANTUM MORPHEUS RIVA MERLIN MAXINE CLARA METROPOLIS ISAAC DRIVE
AERIAL
APPLICATION FRAMEWORKS
CHIPS & SYSTEMS
PLATFORM SOFTWARE
AGX
DGX
RTX EGX
HGX
MORE THAN JUST HARDWARE
10
NVIDIA END-TO-END AI SOFTWARE STACK
Deep Learning Streamlined From Conception to Production at Scale
DATA PREP TRAIN AT SCALE OPTIMIZED FOR INFERENCE DEPLOY AT SCALE
PRE-TRAINED MODELS
Automatic Speech Recognition
Image Classification
Image Segmentation
Speech Synthesis
Language Modelling
Machine Translation
Recommender Systems
Object Detection
13
NGC CONTAINERS ENABLE YOU TO FOCUS ON BUILDING AI
PERFORMANCE OPTIMIZED DEPLOY ANYWHERE
ENTERPRISE READY SOFTWARE
Scanned for CVEs, malware, crypto
Tested for reliability
Backed by Enterprise support
Scalable
Updated monthly
Better performance on the same system
Docker | cri-o | containerd | Singularity
Bare metal, VMs, Kubernetes
Multi-cloud, on-prem, hybrid, edge
ngc.nvidia.com
A Blending of Physical and Virtual Worlds
THE METAVERSE
15
NVIDIA PUBLIC SECTOR APPLICATIONS
Geospatial Predictive Analytics Security
Autonomy and Avionics
Inspection and Forensics Modeling and Simulation
Spectrum Awareness
Phased Arrays
Natural Language Processing
Cyber Security
Economic Growth Public Health National Security
Urban Renewal Engaged Citizens
Competitive industries
Home-grown innovation
Robust startup community
Disease prevention
Efficientservices Accurate
diagnostics
Secure borders
Early threat detection Energy
and food security
Efficientpublic transit
Safer roads
Increased livability
Digitised public services
Up-skilled workforce
Public data exchanges
PUBLIC BENEFIT / OUTCOMES
AI STRATEGY + AI ECOSYSTEM + AI COMPUTE
NATIONAL AI PROGRAMS
MAIN INGREDIENTS
17
WWW.FRONTIERDEVELOPMENTLAB.ORG
18
19
21
MILLION-X CLIMATE SCIENCE
1000km
100km
10km
1km
100m
10m
1m
1980 1990 2000 2010 2020 2030 2040 2050 2060
AR1 AR2 AR3 AR4 AR5 AR6
(IPCC)
1km at 1min (1X COMPUTE)
100m at 1s (10,000X COMPUTE)
1m at 0.01s (100 BILLION X
COMPUTE)
CONVECTION
RESOLVING
STORM
RESOLVING
STRATOCUMULUS
RESOLVING
RESOLUTION
Figure adapted from: Schneider, T., Teixeira, J., Bretherton, C. et al. Climate goals and computing the future of clouds. Nature Clim Change 7, 3–5 (2017). https://doi.org/10.1038/nclimate3190
ANNOUNCING
NVIDIA MODULUS
Physics-ML Neural Simulation Framework
Framework for Developing Physics-ML Models
Train Physics-ML Models Using Governing Physics,
Simulation, and Observed Data
Multi-GPU, Multi-Node Training
1,000-100,000X Speed Models – Ideal for Digital Twins
SymPy Equation
Model Library
(SiREN, PINO, PINN, MESHFREE)
Multi-Node Multi-GPU Training Engine
Numerica
l
Optimizati
on Plans
Geometry
ICs & BCs
Observation
s
Computational Graph
Compiler
Available Now
developer.nvidia.com/modulus
EARTH DIGITAL TWIN IN OMNIVERSE
ERA5 ECMWF
Atmospheric Winds & Geopotential
10 TB | 30km | 5 Atmos Layers
RAPIDS
100,000X Speed-Up
0.25 Seconds for 7-Day Forecast
Training: 4 Hours on 128 A100 GPUs
Modulus Omniverse
Fourier Neural Operator
AI
EARTH
EMULATOR
Satellite
Ocean
Ecosystem
Atmosphere
Extreme
Weather
Prediction
Wind Energy
Forecasting
Disaster
Mitigation
26
OMNIVERSE EARTH
Digital Twins Of The Earth for Climate Adaptation And Resilience
Climate Modeling and Adaption: Building the user interface and visualization for EU’s Digital Twin Earth. Optimizing grid design. etc
ESA
EUMESTAT
ECMWF
NVIDIA
27
28
28
29
PROJECT TOKKIO WITH OMNIVERSE AVATAR
Video Out
Video In
Audio In
Audio Out
Megatron 530B
Triton MGMN
on DGX
ASR
Triton on EGX
DL FACE
TRACKER
DeepStream
on EGX
AUD2FACE
OMNIVERSE
Zero-Shot DM
Triton on EGX
Merlin
Triton on EGX
TTS
Triton on EGX
RIVA
AVATAR
SIMULATION
OMNIVERSE
SPEECH
NLU
RECOMMENDER
DIALOG
MANAGER
NV AVATAR
COMPUTER
VISION
CONVERSATIONAL AVATAR
Camera In
Mic In/Out
Graphics /
Video Out
MEGATRON
530B
MERLIN
DIALOG
MANAGER
RIVA
Mic In/Out
ANNOUNCING
NVIDIA RIVA SPEECH AI
World Class Quality and Response Time
SDK to Customize for Use Case and Unique Voice
for Brand Virtual Assistant
Train New Voice with Only 30 Mins of Speech Data
Human-Like Expressivity and Fine-Grained Control
Deploy in Cloud, On-Prem, Edge, and Embedded
Enterprise Support Available Q1 ‘22 Globally
developer.nvidia.com/riva
OMNIVERSE
Internet
Physical
World
OMNIVERSE
Omniverse
Internet
Physical
World
Path Tracing
MDL
Physic
s
AI
OMNIVERSE
Omniverse
Worlds
Omniverse
Worlds
Omniverse
Worlds
Omniverse
Internet
Physical
World
Path Tracing
MDL
Physic
s
AI
GTC Keynote 56:20mins
40
DATA
ANNOUNCING NEW OMNIVERSE FEATURES
SHOWROOM
Available in Beta
FARM
Available in Beta
AR
Available in Beta
VR
Coming Soon
44
PHYSICS IN USD + KIT
45
46
46
OpenAI training on 6,144 Core Cluster + Mujoco 1x
Isaac Gym, PhysX on 1x A100 GPU 250,000x
https://openai.com/blog/learning-dexterity/
47
47
48
DEPLOY ON ANY NVIDIA RTX GPU
From Laptop, to Data Center. On-premise or in the Cloud.
NVIDIA Studio
Any RTX Workstation or Laptop
EGX Platform
NVIDIA Certified Systems with
RTX
Professional Visualization
Quadro RTX 4000 to
NVIDIA RTX A6000
49
SEE YOU IN OMNIVERSE
DEVELOP ON OMNIVERSE DOCUMENTATION TUTORIALS AND WEBINARS
DOWNLOAD OPEN BETA
EXPLORE OMNIVERSE ENTERPRISE
50
51
https://developer.nvidia.com/blog/nvidia-research-auditing-ai-models-for-verified-deployment-under-semantic-specifications/
ObstacleNet
OpenRoadNet
RadarNet
SignNet
MapNet
LidarNet
OMNIVERSE REPLICATOR FOR DRIVE SIM
53
MEET CARTER
https://docs.nvidia.com/isaac/archive/2020.2/doc/tutorials/carter_hardware.html
ROBOTICS MONTAGE
https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/jetson-agx-orin/
58
APPLIED RESEARCH ACCELERATOR PROGRAM
Use case with deployed
GPU-accelerated
application
Development of GPU-
accelerated
application
Basic Research
conducted by University
Applied Research
project(s)
Program focus
Supports research projects that have the potential to make a real-world impact through
deployment into GPU-accelerated applications adopted by commercial and government
organizations.
Program Benefits
Hardware and funding grants
Technical guidance and support
Grant application support
Hands-on training with the NVIDIA Deep
Learning Institute
Networking and marketing opportunities
Robotics and AI for Automation
https://www.nvidia.com/en-us/industries/higher-education-research/applied-research-program/
59
DEEP LEARNING
INSTITUTE TRAINING
New Training Course “Getting Started with USD
for Collaborative 3D Workflows”
DLI for Data Science, Robotics, Accelerated
Computing courses
New Teaching Kit for 3D Graphics and
Omniverse
nvidia.com/dli
60
NVIDIA INCEPTION
PROGRAM
Over 8,000 AI startups and growing
Access to technology expertise
Go-to-Market support
Venture Capital Funding & Ecosystem
nvidia.com/inception
61
NVIDIA GPU TECH
CONFERENCE
www.nvidia.com/GTC
alowndes@nvidia.com
THANK YOU

NVIDIA DataArt IT

  • 1.
    HARNESSING THE VIRTUAL REALM FORSUCCESSFUL APPLIED AI ALISON B LOWNDES Senior Scientist | Global AI @alisonblowndes November 2021
  • 4.
  • 5.
    5 MOTLEY FOOL “NVIDIA IS NOTJUST A GRAPHICS CHIP COMPANY ANYMORE” GPU Ampere A100 CPU Grace DPU BlueField-3 Next-generation data centers are an orchestration of three pillars: the GPU for accelerated computing, the CPU for general-purpose computing, and the DPU, which processes and moves data in the data center. The introduction of the NVIDIA Grace™ CPU and the NVIDIA BlueField® DPU make NVIDIA a three-chip company, aimed at rearchitecting the data center for AI.
  • 6.
    NVIDIA Accelerated Computing Full Stack,3 Chips, Data Center Scale 30 Million CUDA Downloads 150 SDKs $100 Trillion Industry Served Gaming Data Science Robotics Broadcast CAD Physical Sciences Life Sciences Quantum Physics Digital Twins Genomics 5G Quantum Computing Cybersecurity AI NLU Machine Learning AI Recsys AI Speech AI Computer Vision Medical Imaging Autonomou s Vehicles Edge
  • 7.
    COMPUTING FOR THEDA VINCIS AND EINSTEINS OF OUR TIME 8 of 10 World’s Top 500 Supercomputers 9 of 10 World’s Top 500 Green Supercomputers #1 MLPerf Training and Inference 2021 Nobel Prize in Physics Studying Earth’s Climate 25,000 Companies Run on NVIDIA AI Oak Ridge National Laboratory and the oak leaf symbol are registered trademarks of the U.S. Department of Energy. Use of this mark does not constitute or imply its endorsement, recommendation, or favoring by the United States Government or any agency thereof or its contractors or subcontractors.
  • 8.
    8 AI AT NVIDIA DLSS AIRendering StyleGAN High-Res Image Generation GANcraft 3D Scene Generation GANverse3D 2D to 3D Render Sim2Real Quadruped Locomotion Face Vid2Vid Audio-Driven Character Animation BioMegatron Medical Language Model BioMegatron Medical Language Model 3DGT 3D Ground Truth Modulus Physics-Informed AI Model OrbNet AI for Quantum Chemistry NATIVE 4K DLSS 4K
  • 9.
    Triton cuDF cuIO cuDNN cuMLcuGraph TAO TensorRT NVIDIA CUDA, DOCA, vGPU, Magnum IO NVIDIA GPU CLOUD REGISTRY ngc.nvidia.com NVIDIA AI GEFORCE OMNIVERSE cuQUANTUM MORPHEUS RIVA MERLIN MAXINE CLARA METROPOLIS ISAAC DRIVE AERIAL APPLICATION FRAMEWORKS CHIPS & SYSTEMS PLATFORM SOFTWARE AGX DGX RTX EGX HGX MORE THAN JUST HARDWARE
  • 10.
    10 NVIDIA END-TO-END AISOFTWARE STACK Deep Learning Streamlined From Conception to Production at Scale DATA PREP TRAIN AT SCALE OPTIMIZED FOR INFERENCE DEPLOY AT SCALE PRE-TRAINED MODELS Automatic Speech Recognition Image Classification Image Segmentation Speech Synthesis Language Modelling Machine Translation Recommender Systems Object Detection
  • 13.
    13 NGC CONTAINERS ENABLEYOU TO FOCUS ON BUILDING AI PERFORMANCE OPTIMIZED DEPLOY ANYWHERE ENTERPRISE READY SOFTWARE Scanned for CVEs, malware, crypto Tested for reliability Backed by Enterprise support Scalable Updated monthly Better performance on the same system Docker | cri-o | containerd | Singularity Bare metal, VMs, Kubernetes Multi-cloud, on-prem, hybrid, edge ngc.nvidia.com
  • 14.
    A Blending ofPhysical and Virtual Worlds THE METAVERSE
  • 15.
    15 NVIDIA PUBLIC SECTORAPPLICATIONS Geospatial Predictive Analytics Security Autonomy and Avionics Inspection and Forensics Modeling and Simulation Spectrum Awareness Phased Arrays Natural Language Processing Cyber Security
  • 16.
    Economic Growth PublicHealth National Security Urban Renewal Engaged Citizens Competitive industries Home-grown innovation Robust startup community Disease prevention Efficientservices Accurate diagnostics Secure borders Early threat detection Energy and food security Efficientpublic transit Safer roads Increased livability Digitised public services Up-skilled workforce Public data exchanges PUBLIC BENEFIT / OUTCOMES AI STRATEGY + AI ECOSYSTEM + AI COMPUTE NATIONAL AI PROGRAMS MAIN INGREDIENTS
  • 17.
  • 18.
  • 19.
  • 21.
  • 22.
    MILLION-X CLIMATE SCIENCE 1000km 100km 10km 1km 100m 10m 1m 19801990 2000 2010 2020 2030 2040 2050 2060 AR1 AR2 AR3 AR4 AR5 AR6 (IPCC) 1km at 1min (1X COMPUTE) 100m at 1s (10,000X COMPUTE) 1m at 0.01s (100 BILLION X COMPUTE) CONVECTION RESOLVING STORM RESOLVING STRATOCUMULUS RESOLVING RESOLUTION Figure adapted from: Schneider, T., Teixeira, J., Bretherton, C. et al. Climate goals and computing the future of clouds. Nature Clim Change 7, 3–5 (2017). https://doi.org/10.1038/nclimate3190
  • 24.
    ANNOUNCING NVIDIA MODULUS Physics-ML NeuralSimulation Framework Framework for Developing Physics-ML Models Train Physics-ML Models Using Governing Physics, Simulation, and Observed Data Multi-GPU, Multi-Node Training 1,000-100,000X Speed Models – Ideal for Digital Twins SymPy Equation Model Library (SiREN, PINO, PINN, MESHFREE) Multi-Node Multi-GPU Training Engine Numerica l Optimizati on Plans Geometry ICs & BCs Observation s Computational Graph Compiler Available Now developer.nvidia.com/modulus
  • 25.
    EARTH DIGITAL TWININ OMNIVERSE ERA5 ECMWF Atmospheric Winds & Geopotential 10 TB | 30km | 5 Atmos Layers RAPIDS 100,000X Speed-Up 0.25 Seconds for 7-Day Forecast Training: 4 Hours on 128 A100 GPUs Modulus Omniverse Fourier Neural Operator AI EARTH EMULATOR Satellite Ocean Ecosystem Atmosphere Extreme Weather Prediction Wind Energy Forecasting Disaster Mitigation
  • 26.
    26 OMNIVERSE EARTH Digital TwinsOf The Earth for Climate Adaptation And Resilience Climate Modeling and Adaption: Building the user interface and visualization for EU’s Digital Twin Earth. Optimizing grid design. etc ESA EUMESTAT ECMWF NVIDIA
  • 27.
  • 28.
  • 29.
  • 32.
    PROJECT TOKKIO WITHOMNIVERSE AVATAR Video Out Video In Audio In Audio Out Megatron 530B Triton MGMN on DGX ASR Triton on EGX DL FACE TRACKER DeepStream on EGX AUD2FACE OMNIVERSE Zero-Shot DM Triton on EGX Merlin Triton on EGX TTS Triton on EGX RIVA AVATAR SIMULATION OMNIVERSE
  • 33.
  • 34.
    MEGATRON 530B MERLIN DIALOG MANAGER RIVA Mic In/Out ANNOUNCING NVIDIA RIVASPEECH AI World Class Quality and Response Time SDK to Customize for Use Case and Unique Voice for Brand Virtual Assistant Train New Voice with Only 30 Mins of Speech Data Human-Like Expressivity and Fine-Grained Control Deploy in Cloud, On-Prem, Edge, and Embedded Enterprise Support Available Q1 ‘22 Globally developer.nvidia.com/riva
  • 35.
  • 36.
  • 37.
  • 38.
  • 40.
  • 43.
    ANNOUNCING NEW OMNIVERSEFEATURES SHOWROOM Available in Beta FARM Available in Beta AR Available in Beta VR Coming Soon
  • 44.
  • 45.
  • 46.
    46 46 OpenAI training on6,144 Core Cluster + Mujoco 1x Isaac Gym, PhysX on 1x A100 GPU 250,000x https://openai.com/blog/learning-dexterity/
  • 47.
  • 48.
    48 DEPLOY ON ANYNVIDIA RTX GPU From Laptop, to Data Center. On-premise or in the Cloud. NVIDIA Studio Any RTX Workstation or Laptop EGX Platform NVIDIA Certified Systems with RTX Professional Visualization Quadro RTX 4000 to NVIDIA RTX A6000
  • 49.
    49 SEE YOU INOMNIVERSE DEVELOP ON OMNIVERSE DOCUMENTATION TUTORIALS AND WEBINARS DOWNLOAD OPEN BETA EXPLORE OMNIVERSE ENTERPRISE
  • 50.
  • 51.
  • 52.
  • 53.
  • 55.
  • 56.
  • 57.
  • 58.
    58 APPLIED RESEARCH ACCELERATORPROGRAM Use case with deployed GPU-accelerated application Development of GPU- accelerated application Basic Research conducted by University Applied Research project(s) Program focus Supports research projects that have the potential to make a real-world impact through deployment into GPU-accelerated applications adopted by commercial and government organizations. Program Benefits Hardware and funding grants Technical guidance and support Grant application support Hands-on training with the NVIDIA Deep Learning Institute Networking and marketing opportunities Robotics and AI for Automation https://www.nvidia.com/en-us/industries/higher-education-research/applied-research-program/
  • 59.
    59 DEEP LEARNING INSTITUTE TRAINING NewTraining Course “Getting Started with USD for Collaborative 3D Workflows” DLI for Data Science, Robotics, Accelerated Computing courses New Teaching Kit for 3D Graphics and Omniverse nvidia.com/dli
  • 60.
    60 NVIDIA INCEPTION PROGRAM Over 8,000AI startups and growing Access to technology expertise Go-to-Market support Venture Capital Funding & Ecosystem nvidia.com/inception
  • 61.
  • 63.