Aurimas Griciūnas’ Post

View profile for Aurimas Griciūnas
Aurimas Griciūnas Aurimas Griciūnas is an Influencer

Founder @ SwirlAI • UpSkilling the Next Generation of AI Talent • Author of SwirlAI Newsletter • Public Speaker

AI Supercomputer on my desk! 𝗡𝗩𝗜𝗗𝗜𝗔 𝗗𝗚𝗫 𝗦𝗽𝗮𝗿𝗸 has arrived and I finally got my hands on one of these beasts a few days ago. A quick reminder why it is a big deal: 🚀 NVIDIA GB10 Grace Blackwell Superchip. 💾 128 GB of Unified System memory - you can run models with up to 200 billion parameters on GPU locally! ☁️ Supports the same software stack that runs on datacenter GPUs - build on NVIDIA DGX Spark, deploy to cloud seamlessly. 𝗙𝗶𝗿𝘀𝘁 𝗶𝗺𝗽𝗿𝗲𝘀𝘀𝗶𝗼𝗻𝘀. 𝘏𝘦𝘳𝘦 𝘪𝘴 𝘸𝘩𝘢𝘵 𝘴𝘵𝘰𝘰𝘥 𝘰𝘶𝘵 𝘢𝘧𝘵𝘦𝘳 𝘴𝘰𝘮𝘦 𝘵𝘦𝘴𝘵𝘪𝘯𝘨. After some early testing, what really stood out was how smooth the 𝗗𝗲𝘃𝗘𝘅 is: ✅ Everything just works out of the box. ✅ NVIDIA Sync enables remote work on the machine as if I was running everything on my laptop. ✅ Tons of advanced examples that can be easily adjusted for your own workloads. 𝘐𝘯 𝘭𝘦𝘴𝘴 𝘵𝘩𝘢𝘯 𝘵𝘸𝘰 𝘥𝘢𝘺𝘴 𝘰𝘧 𝘵𝘦𝘴𝘵𝘪𝘯𝘨 𝘐 𝘸𝘢𝘴 𝘢𝘣𝘭𝘦 𝘵𝘰: ⚡ Run gpt-oss-120b on the device with as much as ~30 tokens/s throughput. Moved one of my projects to run locally on the device using the model endpoint. 🤖 Migrate two of my multi-agent projects to run on device using LLMs deployed on the machine. Currently fine-tuning performance with new models in the background 𝘞𝘩𝘢𝘵’𝘴 𝘯𝘦𝘹𝘵: 🕐 I have few projects lined up that require fine tuning of reasonably large models, can’t wait to try the machine for this use case. Want to get your own? 👉 https://nvda.ws/47nDdqG Huge shout-out to NVIDIA AI for the collaboration and support! #LLM #AI #DGXSpark

  • No alternative text description for this image
Yang Pei, MBA

Technical Program & AI Delivery Leader | Hands-on Developer | Cloud & Data Strategist | Fluent German & Mandarin | MBA

9h

Nice, mine just arrived in an oversized box. I've been contemplating whether I want to return the thing, but the more I think about it, I can probably get enough value out of it within 1-2 years. Compared to the Strix Halo things, this is a dedicated all-in-one setup. Unlike my desktop PC it would be a dedicated 'work' machine for sure.

Niti Bikash Chakraborty

Senior Manager & Lead Solutions Architect @ Accenture | Shaping Scalable Solutions for Modern Enterprise Challenges | Curiosity Fueled | From Insight to Impact

6d

Incredible performance, and migrating full multi-agent projects to a local device in two days is seriously impressive mate! For that multi-agent setup, did you consolidate the full orchestration and tool execution stack onto the DGX Spark, or is it primarily serving the model endpoints?

Alysson Possebon

Software Engineering Manager | Head of Data | Tech Lead | Python | Data | Generative AI | AWS | GCP | Azure

6d

I want one :)

Thank you for the collaboration, and support for launch. ✨

Sandipan Bhaumik 🌱

Enterprise GenAI & Data Platforms | C-Suite Data/AI Advisor | Community Founder | Speaker | Podcast Host

6d

This really showcases the power of DGX Spark for both experimentation and production workloads. Aurimas Griciūnas

Anurag(Anu) Karuparti

Agentic AI Leader @Microsoft | Author - Generative AI for Cloud Solutions | LinkedIn Learning Instructor | Responsible AI Advisor | Ex-PwC, EY | Marathon Runner

6d

Useful first impressions for anyone considering high performance AI infrastructure. Aurimas Griciūnas

Bonnie Murray

Mother/Founder & CEO at Raccord Inc./International Marathon Runner

6d

Aurimas Griciūnas conceptually, if everyone can run compute on their desktop, how does this impact data center demand?

Mohammad Syed

Founder & Principal Architect | AI/ML Architecture - AI Security - Cybersecurity | Securing AWS/Azure/GCP

6d

Aurimas, Local AI beast unleashed!

Hina Arora

AI-Assisted Personal Branding for Tech Leaders | 9yrs+ in Tech | Helping Tech Leaders & Coaches Build Personal Brand for Professional Growth | Partnered with 21+ CTOs, Directors & Founders | Done-for-You Service

6d

Love this Aurimas Griciūnas, being able to migrate multi agent projects to a local supercomputer opens huge possibilities.

See more comments

To view or add a comment, sign in

Explore content categories