Matt Garman’s Post

View profile for Matt Garman
Matt Garman Matt Garman is an Influencer

Most people never think about what powers the AI models they use every day. But the infrastructure matters. Our AWS Trainium chips, designed in-house for AI workloads, now power more than 50% of Amazon Bedrock token usage. In practice, that means most of the generative AI responses you see from models on Bedrock are running on Trainium. That's a big deal for customers: faster results, lower costs, and more efficient scaling as demands grows. This is how we turn innovation under the hood into real-world value for builders everywhere. Take a look at what makes Trainium different and the solutions it enables. https://lnkd.in/gCa5rwAn

  • No alternative text description for this image
  • No alternative text description for this image
  • No alternative text description for this image
Yi Su

Principal Engineer | Director of Engineering

2w

Very insightful! 🔧 Infrastructure plays a crucial role behind AI models. AWS Trainium chips not only increase the responsiveness of AI generation, but also reduce costs and enable efficient scalability.

Thank you so much for sharing, Matt!

Carmen Campos, MBA, ITIL/ ITSM/ AWS Certified

Senior Program Manager | ITIL / ITSM / ITOM | Governance, Risk & Compliance | PMO & Operational Excellence Leader | I help organizations achieve operational excellence through business transformations.

2w

Bringing Trainium innovation directly into real-world impact is what elevates AWS - 50%+ on Bedrock token usage is huge. Efficiency and cost are critical as AI adoption hits scale. Great progress across the stack. #DeliverRightResults

Rinat Uzbekov

Principal Account Manager | L7, ISV Global at Amazon Web Services Munich, Germany

2w

Looking forward for Trainium 3!

Brian Sathianathan

Serial Entrepreneur, Co-Founder Iterate.ai, Member of Apple's first iPhone Team

2w

Incredible progress, Matt. Trainium is a great example of how innovation in infrastructure quietly powers the next leap in AI efficiency and accessibility.

Altyapının gücü gerçekten görünmez ama kritik. Trainium sayesinde Bedrock’taki modellerin daha hızlı, daha verimli ve maliyet etkin çalışması, yapay zekanın gerçek dünya etkisini artırıyor. Bu tür yenilikler, teknoloji ile iş değerini birleştirmede fark oluşturuyor.

Bijay Nandagiri

Engineering Manager @Cyara| AI.Net Full Stack Lead | AWS| AZURE| .Net/Cloud Architect |System Design |Microservices |GEN AI| EDA| ReactJs| NodeJS |Azure DevOps|Engineering excellence|Product Manager|AI for leaders| Scrum

2w

Annapurna labs .. that made my day 🤩

Sam Colegrove

🚀 Proven Sales Leader | Director of Sales | Cybersecurity, Cloud, AI, Mobility, Managed Services | SaaS | UCaaS | Enterprise, SLED, K12-Higher Ed | Growth | RVP Leadership | CX | Marketing | Channel | Partner Management

2w

Internal nerd activation level 💯 😆 so many times during customer consultations I’ve wanted to show them this kind of stuff. Like, guys I know what selling you know what you’re buying BUT do you know what it takes to actually make it talk? So cool.

Masood An

Vice President | Customer Experience & Analytics Leader | Workforce Management & Digital Transformation Expert

2w

Impressive milestone! Optimizing AI infrastructure with Trainium really shows how much impact innovation under the hood can have for customers.

See more comments

To view or add a comment, sign in

Explore content categories