Managing Complexity at Velocity
Matt Ray, David Echols
Our Vision
the most enduring and transformative companies
use Chef to become fast, efficient, and
innovative software driven organizations
The Promise Of The Coded Business
Velocity Consistency Scale Feedback
What is Stopping Us?
Ideas/Business Objectives
The Enterprise Challenge
Platform Services (CD/Automation/…)
LOB LOB LOB
Legacy Shared ServicesCloud/PaaS
LOBLOB
Security / Compliance
Ideas/Business Objectives
The Enterprise Challenge
Platform Services (CD/Automation/…)
LOB LOB LOB
Legacy Shared ServicesCloud/PaaS
LOBLOB
Security / Compliance
cloud & IaaS OS
bare metal
virtualization
Infrastructure
Runtime
grid PaaS containers & discovery
Applications
Complexity Budget:
● Pick (at least) one from each layer
● Write your application to it
● Let that be 100% complexity
● Automate all of it; let that be 100% of the original complexity
● Add an additional 50% for emergent conditions you hadn’t thought of yet
The Looming Complexity Crisis
Automation
By
Side
Effect
• Scale and services unlock ability to move faster
• Cloud is not inherently more reliable
• Operate with assumption of ephemeral infrastructure
• Easier to re-deploy and move ahead than to solve for
root-cause of failures
Cloud Brings Further Complexity
How do Humans Manage This Complexity?
Platform
CultureWorkflow
How Do Humans Manage This Complexity?
Infrastructure Automation Application Automation Compliance Automation
Workflow
Visibility
Compliance
Platform: Chef Automate
Chef: Infrastructure automation and delivery at scale
● Manages deployment and on-going
automation
● Define reusable resources and
infrastructure state as code
● Scale elegantly from one to tens of
thousands of managed nodes across
multiple complex environments
● Community, Certified Partner, &
Chef supported content available
for all common automation tasks
InSpec: Turn security and compliance into code
• Translate compliance into Code
• Clearly express statements of policy
• Move risk to build/test from runtime
• Find issues early
• Write code quickly
• Run code anywhere
• Inspect machines, data and APIs
A simple example of an InSpec CIS rule
Part of a process of continuous compliance
Scan for
Compliance
Build &
Test Locally
Build &
Test CI/CD Remediate Verify
Habitat: Automation that travels with the app
• Ease the burden of managing microservice apps and
bring benefits of apps architected for microservices to
legacy applications
–Gain consistent management of new and legacy
applications across lifecycle
–Provides application portability for new and
legacy apps
–Autonomous nodes self-manage runtime state
of application based upon policy you define
–APIs expose application behaviors as data for
better management
• Works in tandem with infrastructure automation
• Makes applications running on containers, PaaS, virtual
machines, bare metal, … better
Visibility: Real-time data collection and analysis
• Search, analyze, audit, and report on workflow
processes and environment behaviors
–multiple Chef Servers
–Chef Solo
–InSpec
–Chef Compliance
–Habitat
–Chef Automate Workflow
•Better manage ephemeral, long-lived, and large
federated environments
•Easily export data to 3rd party analytic platforms
and event notification systems
Platform
CultureWorkflow
How Do Humans Manage This Complexity?
Workflow: Continuous delivery of any code
• Improve collaboration across
infrastructure & applications
– Cross-team productivity enhanced by
consistent overall pipeline shape
– Specific teams given flexibility to configure
pipeline automation specific to their app
– Service dependencies across pipelines are
easily mapped and tested
–Stakeholder visibility keeps teams in the
know and involved as needed
–Robust governance ensures compliance
controls are enforced
Chef Automate removes infrastructure as a speed bump
Move at any speed the business requires safely and without breaking IT processes
● Build, deploy, and manage
applications and infrastructure
environments with one platform
● Gain consistency, security, and
compliance across complex and
any-size enterprise environments
● Collaboration, governance, and
visibility across dev, security,
compliance, and ops teams
● Improve productivity, reinforce
the right organizational behaviors,
and accelerate time from idea to
shipment
InfrastructureApps
+
Infrastructure Automation Application Automation Compliance Automation
Workflow
Visibility
Compliance
Workflow
CulturePlatform
How Do Humans Manage This Complexity?
What every modern application team wants
An Empowered Team
● Development and
operations collaborating
● Ability to focus on doing
the work rather than
managing it
● Easy on-ramps to the
modern application world
High Velocity Development
Cycle
● Time to market matters
● Repeatable and
predictable
● Want to bring velocity to
legacy applications along
with new greenfield apps
Tools That Simplify/Tame
The Complexity
● Consistent app behavior
● Easy to port old and new
to cloud
● Apps have autonomy to
run anywhere
Confidential & subject to NDA
Modern application teams aren’t just developers and operations; they also include leadership, finance, security,
marketing, sales, business people…
Technology & Process
Current
State
Process
Bliss
Local
Development
Coding
Practices
The DevOps Journey
Organization & Culture
Current
State
Organizational
Structure
Data-Driven
Decision
Making
Cultural
Bliss
Organizational
Alignment
Organizational
Culture
Continuous
Integration
Chef Code
Deployment
Application
Deployment
Virtualization
as a Service
Full Stack
Automation
Continuous
Delivery
• Expect and embrace failures
• Test Driven Infrastructure
• Chaos Monkeys
• Mean Time To Repair > Mean Time Between Failures
Resilience over Strength
• Continuous Integration means continuously providing value
• Small batch changes mean more safety, faster feedback
• New technology is not slowing down
Risk over Safety
Infrastructure Automation Application Automation Compliance Automation
Workflow
Visibility
Compliance
Managing Complexity at Velocity

More Related Content

PDF
OpenStack Deployments with Chef
PDF
Deploying OpenStack with Chef
PDF
Chef for OpenStack: OpenStack Spring Summit 2013
PDF
OpenStack Deployment with Chef Workshop
PDF
OpenStack Summit Vancouver: Lessons learned on upgrades
PPTX
An Evaluation of OpenStack Deployment Frameworks
PDF
Atlanta OpenStack 2014 Chef for OpenStack Deployment Workshop
PDF
TIAD : Automating the aplication lifecycle
OpenStack Deployments with Chef
Deploying OpenStack with Chef
Chef for OpenStack: OpenStack Spring Summit 2013
OpenStack Deployment with Chef Workshop
OpenStack Summit Vancouver: Lessons learned on upgrades
An Evaluation of OpenStack Deployment Frameworks
Atlanta OpenStack 2014 Chef for OpenStack Deployment Workshop
TIAD : Automating the aplication lifecycle

What's hot (20)

PDF
2 Day Bootcamp for OpenStack--Cloud Training by Mirantis (Preview)
PDF
CAPS: What's best for deploying and managing OpenStack? Chef vs. Ansible vs. ...
PPT
February 2016 HUG: Running Spark Clusters in Containers with Docker
PDF
Introduction openstack-meetup-nov-28
PPT
Openstack - An introduction/Installation - Presented at Dr Dobb's conference...
PDF
Openstackoverview-DEC2013
PDF
Red Hat Enteprise Linux Open Stack Platfrom Director
PPTX
OpenStack Framework Introduction
PPTX
Deploying OpenStack using Crowbar
PDF
Chef for OpenStack December 2012
PDF
Dell Crowbar Software Framework for OpenStack Deployments
PPTX
DevOps tools for winning agility
PDF
OpenStack Glance Project Update
PPT
Introduction to Apache CloudStack by David Nalley
PPTX
All the troubles you get into when setting up a production ready Kubernetes c...
PPTX
How bigtop leveraged docker for build automation and one click hadoop provis...
PPTX
Configuration Management Evolution at CERN
PDF
Build cloud like Rackspace with OpenStack Ansible
PDF
OpenStack Scale-out Networking Architecture
PDF
RedHat OpenStack Platform Overview
2 Day Bootcamp for OpenStack--Cloud Training by Mirantis (Preview)
CAPS: What's best for deploying and managing OpenStack? Chef vs. Ansible vs. ...
February 2016 HUG: Running Spark Clusters in Containers with Docker
Introduction openstack-meetup-nov-28
Openstack - An introduction/Installation - Presented at Dr Dobb's conference...
Openstackoverview-DEC2013
Red Hat Enteprise Linux Open Stack Platfrom Director
OpenStack Framework Introduction
Deploying OpenStack using Crowbar
Chef for OpenStack December 2012
Dell Crowbar Software Framework for OpenStack Deployments
DevOps tools for winning agility
OpenStack Glance Project Update
Introduction to Apache CloudStack by David Nalley
All the troubles you get into when setting up a production ready Kubernetes c...
How bigtop leveraged docker for build automation and one click hadoop provis...
Configuration Management Evolution at CERN
Build cloud like Rackspace with OpenStack Ansible
OpenStack Scale-out Networking Architecture
RedHat OpenStack Platform Overview
Ad

Similar to Managing Complexity at Velocity (20)

PPTX
Compliance Automation with Inspec Part 1
PPTX
SoCal DevOps Meetup 1/26/2017 - Habitat by Chef
PPTX
Automation, Audits, and Apps Tour
PDF
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
PPTX
Automation, Audits, and Apps Tour
PPTX
Agility and Control from AWS [FutureStack16]
PDF
Securing the Cloud Native stack
PDF
Securing the Cloud Native Stack
PDF
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
PDF
Chef Automating Everything-AWS-PubSec-SAO-WashDC_2018
PPTX
Disruptive Trends in Application Development
PDF
Ultra-scale e-Commerce Transaction Services with Lean Middleware
PPTX
Technology insights: Decision Science Platform
PDF
DevOps for Enterprise Systems : Innovate like a Startup
PDF
AWS OpsWorks for Chef Automate
PDF
A DevOps adoption playbook- achieving business value at scale
PPTX
PPTX
End to-End Monitoring for ITSM and DevOps
PPTX
DevOps-Automation-Services-Accelerating-Software-Delivery-and-Business-Agilit...
PDF
OpsWorks for Chef Automate - Auckland AWS
Compliance Automation with Inspec Part 1
SoCal DevOps Meetup 1/26/2017 - Habitat by Chef
Automation, Audits, and Apps Tour
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Automation, Audits, and Apps Tour
Agility and Control from AWS [FutureStack16]
Securing the Cloud Native stack
Securing the Cloud Native Stack
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Chef Automating Everything-AWS-PubSec-SAO-WashDC_2018
Disruptive Trends in Application Development
Ultra-scale e-Commerce Transaction Services with Lean Middleware
Technology insights: Decision Science Platform
DevOps for Enterprise Systems : Innovate like a Startup
AWS OpsWorks for Chef Automate
A DevOps adoption playbook- achieving business value at scale
End to-End Monitoring for ITSM and DevOps
DevOps-Automation-Services-Accelerating-Software-Delivery-and-Business-Agilit...
OpsWorks for Chef Automate - Auckland AWS
Ad

More from Matt Ray (20)

PDF
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
PDF
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
PDF
SCaLE 20X: Kubernetes Cloud Cost Monitoring with OpenCost & Optimization Stra...
PDF
HashiTalks 2020 - Chef Tools & Terraform: Better Together
PDF
EmacsConf 2019: Interactive Remote Debugging and Development with TRAMP Mode
PDF
Wellington DevOps: Bringing Your Applications into the Future with Habitat
PDF
DevOps Days Singapore 2018 Ignite - Bringing Your Applications into the Futur...
PDF
Cloud Expo Asia 20181010 - Bringing Your Applications into the Future with Ha...
PDF
Compliance as Code Everywhere
PDF
DevOpsDays Jakarta: State of DevOps 2018
PDF
DevOps Talks Melbourne 2018: Whales, Cats and Kubernetes
PDF
Infrastructure and Compliance Delight with Chef Automate
PDF
Cooking Up Windows with Chef Automate
PDF
DevOpsDays Singapore - Continuous Auditing with Compliance as Code
PDF
DevOpsDays Singapore Habitat Ignite
PDF
Chef Automate - Azure Sydney User Group
PDF
Automating Compliance with InSpec - AWS North Sydney
PDF
Automating Applications with Habitat - Sydney Cloud Native Meetup
PDF
Automating AWS Compliance with InSpec
PDF
Chef Automate - Infracoders Canberra August 8, 2017
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
SCaLE 20X: Kubernetes Cloud Cost Monitoring with OpenCost & Optimization Stra...
HashiTalks 2020 - Chef Tools & Terraform: Better Together
EmacsConf 2019: Interactive Remote Debugging and Development with TRAMP Mode
Wellington DevOps: Bringing Your Applications into the Future with Habitat
DevOps Days Singapore 2018 Ignite - Bringing Your Applications into the Futur...
Cloud Expo Asia 20181010 - Bringing Your Applications into the Future with Ha...
Compliance as Code Everywhere
DevOpsDays Jakarta: State of DevOps 2018
DevOps Talks Melbourne 2018: Whales, Cats and Kubernetes
Infrastructure and Compliance Delight with Chef Automate
Cooking Up Windows with Chef Automate
DevOpsDays Singapore - Continuous Auditing with Compliance as Code
DevOpsDays Singapore Habitat Ignite
Chef Automate - Azure Sydney User Group
Automating Compliance with InSpec - AWS North Sydney
Automating Applications with Habitat - Sydney Cloud Native Meetup
Automating AWS Compliance with InSpec
Chef Automate - Infracoders Canberra August 8, 2017

Recently uploaded (20)

PDF
The influence of sentiment analysis in enhancing early warning system model f...
PPTX
future_of_ai_comprehensive_20250822032121.pptx
PPTX
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
PDF
The-Future-of-Automotive-Quality-is-Here-AI-Driven-Engineering.pdf
PDF
Rapid Prototyping: A lecture on prototyping techniques for interface design
DOCX
Basics of Cloud Computing - Cloud Ecosystem
PPTX
GROUP4NURSINGINFORMATICSREPORT-2 PRESENTATION
PPTX
Custom Battery Pack Design Considerations for Performance and Safety
PDF
The-2025-Engineering-Revolution-AI-Quality-and-DevOps-Convergence.pdf
PDF
sbt 2.0: go big (Scala Days 2025 edition)
PDF
Transform-Your-Supply-Chain-with-AI-Driven-Quality-Engineering.pdf
PDF
Transform-Your-Streaming-Platform-with-AI-Driven-Quality-Engineering.pdf
PDF
Advancing precision in air quality forecasting through machine learning integ...
PPTX
Microsoft User Copilot Training Slide Deck
PPTX
Configure Apache Mutual Authentication
PPTX
MuleSoft-Compete-Deck for midddleware integrations
PPTX
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
PDF
Enhancing plagiarism detection using data pre-processing and machine learning...
PDF
Accessing-Finance-in-Jordan-MENA 2024 2025.pdf
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
The influence of sentiment analysis in enhancing early warning system model f...
future_of_ai_comprehensive_20250822032121.pptx
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
The-Future-of-Automotive-Quality-is-Here-AI-Driven-Engineering.pdf
Rapid Prototyping: A lecture on prototyping techniques for interface design
Basics of Cloud Computing - Cloud Ecosystem
GROUP4NURSINGINFORMATICSREPORT-2 PRESENTATION
Custom Battery Pack Design Considerations for Performance and Safety
The-2025-Engineering-Revolution-AI-Quality-and-DevOps-Convergence.pdf
sbt 2.0: go big (Scala Days 2025 edition)
Transform-Your-Supply-Chain-with-AI-Driven-Quality-Engineering.pdf
Transform-Your-Streaming-Platform-with-AI-Driven-Quality-Engineering.pdf
Advancing precision in air quality forecasting through machine learning integ...
Microsoft User Copilot Training Slide Deck
Configure Apache Mutual Authentication
MuleSoft-Compete-Deck for midddleware integrations
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
Enhancing plagiarism detection using data pre-processing and machine learning...
Accessing-Finance-in-Jordan-MENA 2024 2025.pdf
Taming the Chaos: How to Turn Unstructured Data into Decisions

Managing Complexity at Velocity

  • 1. Managing Complexity at Velocity Matt Ray, David Echols
  • 2. Our Vision the most enduring and transformative companies use Chef to become fast, efficient, and innovative software driven organizations
  • 3. The Promise Of The Coded Business Velocity Consistency Scale Feedback
  • 5. Ideas/Business Objectives The Enterprise Challenge Platform Services (CD/Automation/…) LOB LOB LOB Legacy Shared ServicesCloud/PaaS LOBLOB Security / Compliance
  • 6. Ideas/Business Objectives The Enterprise Challenge Platform Services (CD/Automation/…) LOB LOB LOB Legacy Shared ServicesCloud/PaaS LOBLOB Security / Compliance
  • 7. cloud & IaaS OS bare metal virtualization Infrastructure Runtime grid PaaS containers & discovery Applications Complexity Budget: ● Pick (at least) one from each layer ● Write your application to it ● Let that be 100% complexity ● Automate all of it; let that be 100% of the original complexity ● Add an additional 50% for emergent conditions you hadn’t thought of yet The Looming Complexity Crisis Automation By Side Effect
  • 8. • Scale and services unlock ability to move faster • Cloud is not inherently more reliable • Operate with assumption of ephemeral infrastructure • Easier to re-deploy and move ahead than to solve for root-cause of failures Cloud Brings Further Complexity
  • 9. How do Humans Manage This Complexity?
  • 10. Platform CultureWorkflow How Do Humans Manage This Complexity?
  • 11. Infrastructure Automation Application Automation Compliance Automation Workflow Visibility Compliance Platform: Chef Automate
  • 12. Chef: Infrastructure automation and delivery at scale ● Manages deployment and on-going automation ● Define reusable resources and infrastructure state as code ● Scale elegantly from one to tens of thousands of managed nodes across multiple complex environments ● Community, Certified Partner, & Chef supported content available for all common automation tasks
  • 13. InSpec: Turn security and compliance into code • Translate compliance into Code • Clearly express statements of policy • Move risk to build/test from runtime • Find issues early • Write code quickly • Run code anywhere • Inspect machines, data and APIs A simple example of an InSpec CIS rule Part of a process of continuous compliance Scan for Compliance Build & Test Locally Build & Test CI/CD Remediate Verify
  • 14. Habitat: Automation that travels with the app • Ease the burden of managing microservice apps and bring benefits of apps architected for microservices to legacy applications –Gain consistent management of new and legacy applications across lifecycle –Provides application portability for new and legacy apps –Autonomous nodes self-manage runtime state of application based upon policy you define –APIs expose application behaviors as data for better management • Works in tandem with infrastructure automation • Makes applications running on containers, PaaS, virtual machines, bare metal, … better
  • 15. Visibility: Real-time data collection and analysis • Search, analyze, audit, and report on workflow processes and environment behaviors –multiple Chef Servers –Chef Solo –InSpec –Chef Compliance –Habitat –Chef Automate Workflow •Better manage ephemeral, long-lived, and large federated environments •Easily export data to 3rd party analytic platforms and event notification systems
  • 16. Platform CultureWorkflow How Do Humans Manage This Complexity?
  • 17. Workflow: Continuous delivery of any code • Improve collaboration across infrastructure & applications – Cross-team productivity enhanced by consistent overall pipeline shape – Specific teams given flexibility to configure pipeline automation specific to their app – Service dependencies across pipelines are easily mapped and tested –Stakeholder visibility keeps teams in the know and involved as needed –Robust governance ensures compliance controls are enforced
  • 18. Chef Automate removes infrastructure as a speed bump Move at any speed the business requires safely and without breaking IT processes ● Build, deploy, and manage applications and infrastructure environments with one platform ● Gain consistency, security, and compliance across complex and any-size enterprise environments ● Collaboration, governance, and visibility across dev, security, compliance, and ops teams ● Improve productivity, reinforce the right organizational behaviors, and accelerate time from idea to shipment InfrastructureApps + Infrastructure Automation Application Automation Compliance Automation Workflow Visibility Compliance
  • 19. Workflow CulturePlatform How Do Humans Manage This Complexity?
  • 20. What every modern application team wants An Empowered Team ● Development and operations collaborating ● Ability to focus on doing the work rather than managing it ● Easy on-ramps to the modern application world High Velocity Development Cycle ● Time to market matters ● Repeatable and predictable ● Want to bring velocity to legacy applications along with new greenfield apps Tools That Simplify/Tame The Complexity ● Consistent app behavior ● Easy to port old and new to cloud ● Apps have autonomy to run anywhere Confidential & subject to NDA Modern application teams aren’t just developers and operations; they also include leadership, finance, security, marketing, sales, business people…
  • 21. Technology & Process Current State Process Bliss Local Development Coding Practices The DevOps Journey Organization & Culture Current State Organizational Structure Data-Driven Decision Making Cultural Bliss Organizational Alignment Organizational Culture Continuous Integration Chef Code Deployment Application Deployment Virtualization as a Service Full Stack Automation Continuous Delivery
  • 22. • Expect and embrace failures • Test Driven Infrastructure • Chaos Monkeys • Mean Time To Repair > Mean Time Between Failures Resilience over Strength
  • 23. • Continuous Integration means continuously providing value • Small batch changes mean more safety, faster feedback • New technology is not slowing down Risk over Safety
  • 24. Infrastructure Automation Application Automation Compliance Automation Workflow Visibility Compliance