Buy New
-39%
$40.00$40.00
FREE delivery Sunday, June 14
Ships from: Amazon.com Sold by: Amazon.com
Used - Very Good
$29.99$29.99
$4.99 delivery June 16 - 18
Ships from: HPB-Diamond Sold by: HPB-Diamond
Sorry, there was a problem.
There was an error retrieving your Wish Lists. Please try again.Sorry, there was a problem.
List unavailable.
Download the free Kindle app and start reading Kindle books instantly on your smartphone, tablet, or computer - no Kindle device required.
Read instantly on your browser with Kindle for Web.
Using your mobile phone camera - scan the code below and download the Kindle app.
Follow the author
OK
Designing Machine Learning Systems: An Iterative Process for Production-Ready Applications
Purchase options and add-ons
Machine learning systems are both complex and unique. Complex because they consist of many different components and involve many different stakeholders. Unique because they're data dependent, with data varying wildly from one use case to the next. In this book, you'll learn a holistic approach to designing ML systems that are reliable, scalable, maintainable, and adaptive to changing environments and business requirements.
Author Chip Huyen, co-founder of Claypot AI, considers each design decision--such as how to process and create training data, which features to use, how often to retrain models, and what to monitor--in the context of how it can help your system as a whole achieve its objectives. The iterative framework in this book uses actual case studies backed by ample references.
This book will help you tackle scenarios such as:
- Engineering data and choosing the right metrics to solve a business problem
- Automating the process for continually developing, evaluating, deploying, and updating models
- Developing a monitoring system to quickly detect and address issues your models might encounter in production
- Architecting an ML platform that serves across use cases
- Developing responsible ML systems
- ISBN-101098107969
- ISBN-13978-1098107963
- Edition1st
- PublisherO'Reilly Media
- Publication dateJune 21, 2022
- LanguageEnglish
- Dimensions6.9 x 0.7 x 9.1 inches
- Print length386 pages
Frequently bought together

Explore more items
AI Engineering: Building Applications with Foundation ModelsPaperbackFREE Shipping by AmazonGet it as soon as Sunday, Jun 14
Fundamentals of Data Engineering: Plan and Build Robust Data SystemsPaperbackFREE Shipping by AmazonGet it as soon as Sunday, Jun 14
Generative AI System Design InterviewPaperbackFREE Shipping by AmazonGet it as soon as Sunday, Jun 14
System Design Interview – An insider's guidePaperbackFREE Shipping by AmazonGet it as soon as Sunday, Jun 14
Fluent Python: Clear, Concise, and Effective ProgrammingPaperbackFREE Shipping by AmazonGet it as soon as Sunday, Jun 14
The Staff Engineer's Path: A Guide for Individual Contributors Navigating Growth and ChangePaperbackFREE Shipping on orders over $35 shipped by AmazonGet it as soon as Sunday, Jun 14
Customers also bought or read
- AI Engineering: Building Applications with Foundation Models#1 Best SellerMachine Theory
Paperback$57.19$57.19FREE delivery Sun, Jun 14 - Machine Learning Design Patterns: Solutions to Common Challenges in Data Preparation, Model Building, and MLOps
Paperback$36.99$36.99FREE delivery Sun, Jun 14 - Hands-On Large Language Models: Language Understanding and Generation
Paperback$47.69$47.69FREE delivery Sun, Jun 14 - LLM Engineer's Handbook: Master the art of engineering large language models from concept to production
Paperback$44.99$44.99FREE delivery Sun, Jun 14 - Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems
Paperback$49.50$49.50FREE delivery Sun, Jun 14 - Machine Learning System Design: With end-to-end examples
Paperback$54.99$54.99FREE delivery Sun, Jun 14 - Natural Language Processing with Transformers, Revised Edition
Paperback$41.60$41.60FREE delivery Sun, Jun 14 - Fundamentals of Data Engineering: Plan and Build Robust Data Systems
Paperback$43.99$43.99FREE delivery Sun, Jun 14 - Reliable Machine Learning: Applying SRE Principles to ML in Production
Paperback$44.13$44.13FREE delivery Sun, Jun 14 - Building Machine Learning Powered Applications: Going from Idea to Product
Paperback$36.99$36.99FREE delivery Sun, Jun 14 - LLMs in Production: From language models to successful products
Paperback$50.66$50.66FREE delivery Sun, Jun 14 - Building LLMs for Production: Enhancing LLM Abilities and Reliability with Prompting, Fine-Tuning, and RAG
Paperback$58.58$58.58FREE delivery Sun, Jun 14 - Introducing MLOps: How to Scale Machine Learning in the Enterprise
Paperback$36.49$36.49FREE delivery Sun, Jun 14 - Practical Statistics for Data Scientists: 50+ Essential Concepts Using R and Python
Paperback$45.25$45.25FREE delivery Sun, Jun 14 - Deep Learning (Adaptive Computation and Machine Learning series)
Hardcover$61.00$61.00FREE delivery Sun, Jun 14 - Building Applications with AI Agents: Designing and Implementing Multiagent Systems
Paperback$59.57$59.57FREE delivery Sun, Jun 14 - The Hundred-Page Machine Learning Book (The Hundred-Page Books)
Paperback$30.16$30.16Delivery Sun, Jun 14 - Generative Deep Learning: Teaching Machines To Paint, Write, Compose, and Play
Paperback$47.37$47.37FREE delivery Sun, Jun 14 - Hands-On Machine Learning with Scikit-Learn and PyTorch: Concepts, Tools, and Techniques to Build Intelligent Systems
Paperback$83.87$83.87FREE delivery Sun, Jun 14 - Machine Learning with PyTorch and Scikit-Learn: Develop machine learning and deep learning models with Python
Paperback$37.95$37.95FREE delivery Sun, Jun 14 - Building Agentic AI Systems: Create intelligent, autonomous AI agents that can reason, plan, and adapt
Paperback$41.24$41.24FREE delivery Sun, Jun 14 - Inside the Machine Learning Interview: 151 Real Questions from FAANG and How to Answer Them
Paperback$34.79$34.79Delivery Sun, Jun 14 - Software Engineering for Data Scientists: From Notebooks to Scalable Systems
Paperback$45.00$45.00FREE delivery Sun, Jun 14 - Building AI Agents with LLMs, RAG, and Knowledge Graphs: A practical guide to autonomous and modern AI agents
Paperback$44.99$44.99FREE delivery Sun, Jun 14
From the brand
-
Machine Learning, AI & more
-
Machine Learning
-
Artificial Intelligence
-
Deep Learning
-
Language Processing (NLP, LLM)
-
Sharing the knowledge of experts
O'Reilly's mission is to change the world by sharing the knowledge of innovators. For over 40 years, we've inspired companies and individuals to do new things (and do them better) by providing the skills and understanding that are necessary for success.
Our customers are hungry to build the innovations that propel the world forward. And we help them do just that.
From the Publisher
From the Preface
Who This Book Is For
This book is for anyone who wants to leverage ML to solve real-world problems. ML in this book refers to both deep learning and classical algorithms, with a leaning toward ML systems at scale, such as those seen at medium to large enterprises and fast-growing startups. Systems at a smaller scale tend to be less complex and might benefit less from the comprehensive approach laid out in this book.
Because my background is engineering, the language of this book is geared toward engineers, including ML engineers, data scientists, data engineers, ML platform engineers, and engineering managers.
You might be able to relate to one of the following scenarios:
- You have been given a business problem and a lot of raw data. You want to engineer this data and choose the right metrics to solve this problem.
- Your initial models perform well in offline experiments and you want to deploy them. You have little feedback on how your models are performing after your models are deployed, and you want to figure out a way to quickly detect, debug, and address any issue your models might run into in production.
- The process of developing, evaluating, deploying, and updating models for your team has been mostly manual, slow, and error-prone. You want to automate and improve this process.
- Each ML use case in your organization has been deployed using its own workflow, and you want to lay down the foundation (e.g., model store, feature store, monitoring tools) that can be shared and reused across use cases.
- You’re worried that there might be biases in your ML systems and you want to make your systems responsible!
You can also benefit from the book if you belong to one of the following groups:
- Tool developers who want to identify underserved areas in ML production and figure out how to position your tools in the ecosystem.
- Individuals looking for ML-related roles in the industry.
- Technical and business leaders who are considering adopting ML solutions to improve your products and/or business processes. Readers without strong technical backgrounds might benefit the most from Chapters 1, 2, and 11.
What This Book Is Not
This book is not an introduction to ML. There are many books, courses, and resources available for ML theories, and therefore, this book shies away from these concepts to focus on the practical aspects of ML. To be specific, the book assumes that readers have a basic understanding of the following topics:
- ML models such as clustering, logistic regression, decision trees, collaborative filtering, and various neural network architectures including feed-forward, recurrent, convolutional, and transformer
- ML techniques such as supervised versus unsupervised, gradient descent, objective/loss function, regularization, generalization, and hyperparameter tuning
- Metrics such as accuracy, F1, precision, recall, ROC, mean squared error, and log-likelihood
- Statistical concepts such as variance, probability, and normal/long-tail distribution
- Common ML tasks such as language modeling, anomaly detection, object classification, and machine translation
You don’t have to know these topics inside out—for concepts whose exact definitions can take some effort to remember, e.g., F1 score, we include short notes as references—but you should have a rough sense of what they mean going in.
While this book mentions current tools to illustrate certain concepts and solutions, it’s not a tutorial book. Technologies evolve over time. Tools go in and out of style quickly, but fundamental approaches to problem solving should last a bit longer. This book provides a framework for you to evaluate the tool that works best for your use cases. When there’s a tool you want to use, it’s usually straightforward to find tutorials for it online. As a result, this book has few code snippets and instead focuses on providing a lot of discussion around trade-offs, pros and cons, and concrete examples.
Designing Machine Learning Systems: An Iterative Process for Production-Ready...
|
AI Engineering: Building Applications with Foundation Models
|
|
|---|---|---|
|
Add to Cart
|
Add to Cart
|
|
| Customer Reviews |
4.6 out of 5 stars 961
|
4.7 out of 5 stars 823
|
| Books by Chip Huyen | no data | no data |
Editorial Reviews
Review
- Josh Wills, Software Engineer at WeaveGrid and former Director of Data Engineering, Slack
"There is so much information one needs to know to be an effective machine learning engineer. It's hard to cut through the chaff to get the most relevant information, but Chip has done that admirably with this book. If you are serious about ML in production, and care about how to design and implement ML systems end to end, this book is essential."
- Laurence Moroney, AI and ML Lead, Google
"One of the best resources that focuses on the first principles behind designing ML systems for production. A must-read to navigate the ephemeral landscape of tooling and platform options."
- Goku Mohandas, Founder of Made With ML
"Chip's manual is the book we deserve and the one we need right now. In a blooming but chaotic ecosystem, this principled view on end-to-end ML is both your map and your compass: a must-read for practitioners inside and outside of Big Tech—especially those working at 'reasonable scale.' This book will also appeal to data leaders looking for best practices on how to deploy, manage, and monitor systems in the wild."
- Jacopo Tagliabue, Director of AI, Coveo; Adj. Professor of MLSys, NYU
"Chip is truly a world-class expert on machine learning systems, as well as a brilliant writer. Both are evident in this book, which is a fantastic resource for anyone looking to learn about this topic."
- Andrey Kurenkov, PhD Candidate at the Stanford AI Lab
From the Author
These questions can also be specific, such as "I'm convinced that switching from batch prediction to online prediction will give our model a performance boost, but how do I convince my manager to let me do so?" or "I'm the most senior data scientist at my company and I've recently been tasked with setting up our first machine learning platform; where do I start?"
My short answer to all these questions is always: "It depends." My long answers often involve hours of discussion to understand where the questioner comes from, what they're actually trying to achieve, and the pros and cons of different approaches for their specific use case.
ML systems are both complex and unique. They are complex because they consist of many different components (ML algorithms, data, business logics, evaluation metrics, underlying infrastructure, etc.) and involve many different stakeholders (data scientists, ML engineers, business leaders, users, even society at large). ML systems are unique because they are data dependent, and data varies wildly from one use case to the next.
For example, two companies might be in the same domain (ecommerce) and have the same problem that they want ML to solve (recommender system), but their resulting ML systems can have different model architecture, use different sets of features, be evaluated on different metrics, and bring different returns on investment.
Many blog posts and tutorials on ML production focus on answering one specific question. While the focus helps get the point across, they can create the impression that it's possible to consider each of these questions in isolation. In reality, changes in one component will likely affect other components. Therefore, it's necessary to consider the system as a whole while attempting to make any design decision.
This book takes a holistic approach to ML systems. It takes into account different components of the system and the objectives of different stakeholders involved. The content in this book is illustrated using actual case studies, many of which I've personally worked on, backed by ample references, and reviewed by ML practitioners in both academia and industry. Sections that require in-depth knowledge of a certain topic—e.g., batch processing versus stream processing, infrastructure for storage and compute, and responsible AI—are further reviewed by experts whose work focuses on that one topic. In other words, this book is an attempt to give nuanced answers to the questions mentioned above and more.
When I first wrote the lecture notes that laid the foundation for this book, I thought I wrote them for my students to prepare them for the demands of their future jobs as data scientists and ML engineers. However, I soon realized that I also learned tremendously through the process. The initial drafts I shared with early readers sparked many conversations that tested my assumptions, forced me to consider different perspectives, and introduced me to new problems and new approaches.
I hope that this learning process will continue for me now that the book is in your hand, as you have experiences and perspectives that are unique to you. Please feel free to share with me any feedback you might have for this book!
About the Author
LinkedIn included her among Top Voices in Software Development (2019) and Top Voices in Data Science & AI (2020). She is also the author of four bestselling Vietnamese books, including the series Xach ba lo len va Di (Pack Your Bag and Go). She also runs a Discord server on MLOps with over 6,000 members (https://discord.com/invite/Mw77HPrgjF).
Product details
- Publisher : O'Reilly Media
- Publication date : June 21, 2022
- Edition : 1st
- Language : English
- Print length : 386 pages
- ISBN-10 : 1098107969
- ISBN-13 : 978-1098107963
- Item Weight : 1.4 pounds
- Dimensions : 6.9 x 0.7 x 9.1 inches
- Best Sellers Rank: #12,412 in Books (See Top 100 in Books)
- #2 in Machine Theory (Books)
- #2 in Business Intelligence Tools
- #17 in Artificial Intelligence & Semantics
- Customer Reviews:
About the author

I’m Chip Huyen, a writer and computer scientist. I grew up chasing grasshoppers in a small rice-farming village in Vietnam.
I work in the intersection of AI, data, and storytelling. Previously, I built machine learning tools at NVIDIA, Snorkel AI, Netflix, and founded an AI infrastructure startup (acquired).
I also taught Machine Learning Systems Design at Stanford.
My last book, Designing Machine Learning Systems, is an Amazon bestseller in AI and has been translated into over 10 languages (very proud!).
In my free time, I like writing stories. I'm also the author of 4 Vietnamese story books.
Customer reviews
Customer Reviews, including Product Star Ratings help customers to learn more about the product and decide whether it is the right product for them.
To calculate the overall star rating and percentage breakdown by star, we don’t use a simple average. Instead, our system considers things like how recent a review is and if the reviewer bought the item on Amazon. It also analyzed reviews to verify trustworthiness.
Learn more how customers reviews work on AmazonCustomers say
Generated from the text of customer reviewsSelect to learn more
Reviews with images
Great book
Top reviews from the United States
- 5 out of 5 stars
A Practical Guide to Building Scalable and Reliable Machine Learning Systems
Reviewed in the United States on February 2, 2025Designing Machine Learning Systems by Chip Huyen is an essential guide for practitioners looking to bridge the gap between machine learning research and real-world applications. The book offers a comprehensive, systems-focused approach to building scalable, reliable, and efficient ML models. Huyen’s writing is clear and insightful, covering topics like data-centric AI, model deployment, monitoring, and iteration. The real-world case studies and practical examples make complex concepts accessible. Whether you’re an engineer, researcher, or data scientist, this book provides valuable insights into productionizing ML effectively. A must-read for those seeking to build robust and maintainable machine learning systems. I liked its content.
2 people found this helpfulSending feedback...Sending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again - 5 out of 5 stars
Distills the best of the blogs and folk wisdom that ML engineers pick up over the years
Reviewed in the United States on July 2, 2022I am a PhD student, and have been working to apply ML to different domains for a few years. Recently, I started working with undergrad researchers who did not have any prior experience with ML applications, besides a class or so. But, there is a lot of knowledge that is just collected over the years while debugging problems, discussing with lab mates, or through the many blog posts online. These are the kind of issues that rarely come up in classes --- not just conceptual AI issues -- but how to deal with data / features / efficiently store things / logging etc. In the few chapters I have read through, I found this book to be like the collecting together and unifying the best blogposts and folk wisdom for practical, day to day ML issues. There were a whole lot of things that I did not know, or was curious about, but didn't know where to look for precise answers. But more than that, I found this book to be a perfect reference for the undergrad students I was mentoring -- I have lent my copy to a couple of students for reading particular chapters, particularly on training data and feature engineering, which quickly brings them up to speed on the best practices.
25 people found this helpfulSending feedback...Sending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again - 5 out of 5 stars
Great read
Reviewed in the United States on November 3, 2025Great read for a high level view of machine learning systems.
Sending feedback...Sending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again - 5 out of 5 stars
Well written
Reviewed in the United States on June 9, 2026Well written and makes difficult concepts easy to understand.
Sending feedback...Sending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again - 4 out of 5 stars
Scratches the surface, no deep dive, wide amount of topics covered
Reviewed in the United States on January 23, 2025(4.5*) Overall a good overview of the topic, very easy to read and covers almost all the topics but only scratches the surface, and almost never goes deep into details.
7 people found this helpfulSending feedback...Sending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again - 5 out of 5 stars
Absolutely worth it
Reviewed in the United States on April 21, 2026Excellent book if not the best for Machine Learning System Design
Sending feedback...Sending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again - 5 out of 5 stars
Great AI Engineering book
Reviewed in the United States on November 12, 2025Solid book for AI Engineering with broad and in-depth coverage of each topic.
Sending feedback...Sending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again - 5 out of 5 stars
good good
Reviewed in the United States on August 18, 2025Very organized and detailed review of designing typical ML system. Helpful for preparing for interviews and actual work
One person found this helpfulSending feedback...Sending feedback...HelpfulThank you for your feedback.Sorry, we failed to record your vote. Please try againThanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again
Top reviews from other countries
Eva Garcia Martin5 out of 5 stars10/10 fantastic book
Reviewed in Sweden on February 24, 2025Covers so so many important points of putting ML in production. Highly recommend
Sending feedback...Thanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again
uysalserkan1 out of 5 starsComes with black white colors
Reviewed in Turkey on October 3, 2024Poor page quality and black-white colors.
Sending feedback...Thanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again
Khalida4 out of 5 starsGood book
Reviewed in Belgium on April 16, 2025Interesting book! i enjoyed reading it
Sending feedback...Thanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again
Raghu5 out of 5 starsA must read for an ML enthusiast
Reviewed in Japan on September 29, 2025I got it delivered on time and the book is a nice read for anyone who wants to get into the field of Machine Learning system development.
Sending feedback...Thanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again
MG5 out of 5 starsGo-to reference for AI pipelines insights.
Reviewed in the United Kingdom on August 18, 2025Very well written and enjoyable technical book.
Whether you already work in this domain, want a refresher, or simply clarify some topics that are outside of your day-to-day duties, this book won't disappoint.
Sending feedback...Thanks, we'll investigate in the next few days.Sorry, We failed to report this review. Please try again













