@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Democratizing & Accelerating AI
Through Automated Machine
Learning
Silviu Niculiță
Engineering Manager – Cluj Campus @
Microsoft MVP - AI
silviu@niculita.ro
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
• Why Machine Learning?
• Why Automated Machine Learning?
• Automated ML Capabilities
• Automated ML Demo
• Conclusions & Call to Action
• Q & A & C
Agenda
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
WHY MACHINE LEARNING?
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
ML/AI is becoming a core software capability
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Interesting Use Cases
You're probably used to the presence of facial recognition
cameras at airports and other transport hubs, but what about
at concerts?
That's the step Taylor Swift's team took at her May 18th show at
the Rose Bowl, in a bid to identify her stalkers.
According to Rolling Stone, the camera was hidden inside a
display kiosk at the event, and sent images of anyone who
stopped to look at the display to a "command post" in Nashville,
where they were cross-referenced with other photos of the star's
known stalkers.
As the target of numerous death and rape threats, Swift
arguably has a valid motivation for leveraging such technology.
However, it's unclear who has ownership of the photos of her
concertgoers, or how long they will remain on file.
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Microsoft's Sports Performance
Platform can, for example, figure out
when a player is at risk of injury,
based on his or her most recent
performance and recovery time.
The difference between a win or a loss
can be decided by an extra five
minutes of wind sprints, levels of
hydration or getting to bed 30
minutes earlier the night before.
Interesting Use Cases
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
The deep learning engine can examine
CT, MRI and other scans and
automatically detect lung, liver, heart
and bone diseases.
New capabilities like lung and breast
cancer, brain trauma, hypertension and
others are "constantly being released,"
the company says.
The results are then passed on to
radiologists, saving them time in
making a diagnosis or requesting
further tests.
Interesting Use Cases
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Interesting Use Cases
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
“Prison labor” is usually associated
with physical work, but inmates at two
prisons in Finland are doing a new
type of labor: classifying data to train
artificial intelligence algorithms for a
startup.
Though the startup in question, Vainu,
sees the partnership as a kind of
prison reform that teaches valuable
skills, other experts say the claim of
job training is more evidence of hype
around the promises of AI.
Behind The Curtain
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
WHY AUTOMATED MACHINE LEARNING?
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Typical ML Development Process
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
CURRENT APPROACHES DON’T
SCALE WELL
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
OK….BUT HOW?
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
ML API Example
How much is this car worth?
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Typical ML Creation Example
Mileage
Condition
Car brand
Year of make
Regulations
…
Parameter 1
Parameter 2
Parameter 3
Parameter 4
…
Gradient Boosted
Nearest Neighbors
SVM
Bayesian Regression
LGBM
…
Mileage Gradient Boosted Criterion
Loss
Min Samples Split
Min Samples Leaf
Others Model
Which algorithm? Which parameters?Which features?
Car brand
Year of make
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Typical ML Creation Example
Criterion
Loss
Min Samples Split
Min Samples Leaf
Others
N Neighbors
Weights
Metric
P
Others
Which algorithm? Which parameters?Which features?
Mileage
Condition
Car brand
Year of make
Regulations
…
Gradient Boosted
Nearest Neighbors
SVM
Bayesian Regression
LGBM
…
Nearest Neighbors
Model
Iterate
Gradient BoostedMileage
Car brand
Year of make
Car brand
Year of make
Condition
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Typical ML Creation Example
Which algorithm? Which parameters?Which features?
Iterate
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Algorithm Selection Complexity
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
PUTTING THE AUTO IN AUTO ML
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Automated ML Accelerates Model Development
Enter data
Define goals
Apply constraints
OutputInput Intelligently test multiple models in parallel
Optimized model
95%
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
AUTOMATED ML CAPABILITIES
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
• ML Scenarios: Classification & Regression;
• Integration: Azure Machine Learning, Azure Notebooks, Jupyter
Notebooks;
• Data Type: Numeric, Text;
• Languages: Python SDK for deployment and hosting for inference;
• Training Compute: Local Machine, Remote Azure DSVM (Linux),
Azure Batch AI;
• Transparency: View run history, model metrics;
• Scale: Faster model training using multiple cores and parallel
experiments;
• Privacy preserving: No need to “see” the data
Automated ML Capabilities
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
AUTOMATED ML DEMO
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
CONCLUSIONS & CALL TO ACTION
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Target Audience
New to Machine Learning Novice Data Scientists ML Experts
Build model and prefer visual
tool than coding
Quick prototypeLearn machine learning
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Manual ML
Dataset
Training
Algorithm 1
Hyperparameter
Values – config 1
Model 1
Hyperparameter
Values – config 2
Model 2
Hyperparameter
Values – config 3
Model 3
Model Training
InfrastructureTraining
Algorithm 2
Hyperparameter
Values – config 4
Model 4
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Automated ML
Dataset
Optimization
Metric
Constraints
(Time/Cost)
ML ModelAutomated ML
Accessible & Faster
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Competition?
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
• During training, you only pay for the
cost of the underlying compute;
• When deploying models to AKS, there
is an Azure Machine Learning service
surcharge of $0.040 per core/hr;
• If you deploy to non-AKS VMs, there is
no surcharge;
Pricing
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Is Microsoft The Winning Horse?
Gartner 2019 Magic Quadrant for Data Science and Machine
Learning Platforms (as of Nov 2018)
Microsoft remains a Visionary, having maintained a strong
commitment to breadth and ease of open-source technology
integration and excellence in relation to deep learning. Azure
Machine Learning is not an option for the many data science
teams and use cases that require a strictly on-premises
product.
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Is AutoML a Silver Bullet?
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Start Free
Build, train, and deploy models
with an Azure free account
http://bit.ly/AzureMLS
Documentation
Dig into the technical
documentation
http://bit.ly/AzureMLSDocs
Ask Questions
Send an email to the product team
AskAutomatedML@microsoft.com
Call To Action
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
• The really nice animated slides in this deck are copied
from a Microsoft AI Platform Team deck;
• Article screenshots are from Engadget, The Verge, The
New York Times and Stanford News;
Credits
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
Many thanks to our sponsors & partners!
GOLD
SILVER
PARTNERS
PLATINUM
POWERED BY
@ITCAMPRO #ITCAMP19Community Conference for IT Professionals
QUESTIONS & ANSWERS & CANDY
Thank you!
ITCamp 2019 - Silviu Niculita - Supercharge your AI efforts with the use of Automated Machine Learning

ITCamp 2019 - Silviu Niculita - Supercharge your AI efforts with the use of Automated Machine Learning

  • 1.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Democratizing & Accelerating AI Through Automated Machine Learning Silviu Niculiță Engineering Manager – Cluj Campus @ Microsoft MVP - AI [email protected]
  • 2.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals • Why Machine Learning? • Why Automated Machine Learning? • Automated ML Capabilities • Automated ML Demo • Conclusions & Call to Action • Q & A & C Agenda
  • 3.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals WHY MACHINE LEARNING?
  • 4.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals ML/AI is becoming a core software capability
  • 5.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Interesting Use Cases You're probably used to the presence of facial recognition cameras at airports and other transport hubs, but what about at concerts? That's the step Taylor Swift's team took at her May 18th show at the Rose Bowl, in a bid to identify her stalkers. According to Rolling Stone, the camera was hidden inside a display kiosk at the event, and sent images of anyone who stopped to look at the display to a "command post" in Nashville, where they were cross-referenced with other photos of the star's known stalkers. As the target of numerous death and rape threats, Swift arguably has a valid motivation for leveraging such technology. However, it's unclear who has ownership of the photos of her concertgoers, or how long they will remain on file.
  • 6.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Microsoft's Sports Performance Platform can, for example, figure out when a player is at risk of injury, based on his or her most recent performance and recovery time. The difference between a win or a loss can be decided by an extra five minutes of wind sprints, levels of hydration or getting to bed 30 minutes earlier the night before. Interesting Use Cases
  • 7.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals The deep learning engine can examine CT, MRI and other scans and automatically detect lung, liver, heart and bone diseases. New capabilities like lung and breast cancer, brain trauma, hypertension and others are "constantly being released," the company says. The results are then passed on to radiologists, saving them time in making a diagnosis or requesting further tests. Interesting Use Cases
  • 8.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Interesting Use Cases
  • 9.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals “Prison labor” is usually associated with physical work, but inmates at two prisons in Finland are doing a new type of labor: classifying data to train artificial intelligence algorithms for a startup. Though the startup in question, Vainu, sees the partnership as a kind of prison reform that teaches valuable skills, other experts say the claim of job training is more evidence of hype around the promises of AI. Behind The Curtain
  • 10.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals WHY AUTOMATED MACHINE LEARNING?
  • 11.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Typical ML Development Process
  • 12.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals CURRENT APPROACHES DON’T SCALE WELL
  • 14.
  • 15.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals OK….BUT HOW?
  • 16.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals ML API Example How much is this car worth?
  • 17.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Typical ML Creation Example Mileage Condition Car brand Year of make Regulations … Parameter 1 Parameter 2 Parameter 3 Parameter 4 … Gradient Boosted Nearest Neighbors SVM Bayesian Regression LGBM … Mileage Gradient Boosted Criterion Loss Min Samples Split Min Samples Leaf Others Model Which algorithm? Which parameters?Which features? Car brand Year of make
  • 18.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Typical ML Creation Example Criterion Loss Min Samples Split Min Samples Leaf Others N Neighbors Weights Metric P Others Which algorithm? Which parameters?Which features? Mileage Condition Car brand Year of make Regulations … Gradient Boosted Nearest Neighbors SVM Bayesian Regression LGBM … Nearest Neighbors Model Iterate Gradient BoostedMileage Car brand Year of make Car brand Year of make Condition
  • 19.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Typical ML Creation Example Which algorithm? Which parameters?Which features? Iterate
  • 20.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Algorithm Selection Complexity
  • 21.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals PUTTING THE AUTO IN AUTO ML
  • 22.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Automated ML Accelerates Model Development Enter data Define goals Apply constraints OutputInput Intelligently test multiple models in parallel Optimized model 95%
  • 23.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals AUTOMATED ML CAPABILITIES
  • 24.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals • ML Scenarios: Classification & Regression; • Integration: Azure Machine Learning, Azure Notebooks, Jupyter Notebooks; • Data Type: Numeric, Text; • Languages: Python SDK for deployment and hosting for inference; • Training Compute: Local Machine, Remote Azure DSVM (Linux), Azure Batch AI; • Transparency: View run history, model metrics; • Scale: Faster model training using multiple cores and parallel experiments; • Privacy preserving: No need to “see” the data Automated ML Capabilities
  • 25.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals AUTOMATED ML DEMO
  • 26.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals CONCLUSIONS & CALL TO ACTION
  • 27.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Target Audience New to Machine Learning Novice Data Scientists ML Experts Build model and prefer visual tool than coding Quick prototypeLearn machine learning
  • 28.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Manual ML Dataset Training Algorithm 1 Hyperparameter Values – config 1 Model 1 Hyperparameter Values – config 2 Model 2 Hyperparameter Values – config 3 Model 3 Model Training InfrastructureTraining Algorithm 2 Hyperparameter Values – config 4 Model 4
  • 29.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Automated ML Dataset Optimization Metric Constraints (Time/Cost) ML ModelAutomated ML Accessible & Faster
  • 30.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Competition?
  • 31.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals • During training, you only pay for the cost of the underlying compute; • When deploying models to AKS, there is an Azure Machine Learning service surcharge of $0.040 per core/hr; • If you deploy to non-AKS VMs, there is no surcharge; Pricing
  • 32.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Is Microsoft The Winning Horse? Gartner 2019 Magic Quadrant for Data Science and Machine Learning Platforms (as of Nov 2018) Microsoft remains a Visionary, having maintained a strong commitment to breadth and ease of open-source technology integration and excellence in relation to deep learning. Azure Machine Learning is not an option for the many data science teams and use cases that require a strictly on-premises product.
  • 33.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Is AutoML a Silver Bullet?
  • 34.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Start Free Build, train, and deploy models with an Azure free account http://bit.ly/AzureMLS Documentation Dig into the technical documentation http://bit.ly/AzureMLSDocs Ask Questions Send an email to the product team [email protected] Call To Action
  • 35.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals • The really nice animated slides in this deck are copied from a Microsoft AI Platform Team deck; • Article screenshots are from Engadget, The Verge, The New York Times and Stanford News; Credits
  • 36.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals Many thanks to our sponsors & partners! GOLD SILVER PARTNERS PLATINUM POWERED BY
  • 37.
    @ITCAMPRO #ITCAMP19Community Conferencefor IT Professionals QUESTIONS & ANSWERS & CANDY Thank you!