What runs ChatGPT? Inside Microsoft's AI supercomputer | Featuring Mark Russinovich

Microsoft Mechanics Podcast

Get an inside look at the AI supercomputer infrastructure built to run ChatGPT and other large language models, and see how to leverage it for your workloads in Azure, at any scale.

Go behind the scenes: -For how we collaborated with NVIDIA to deliver purpose-built AI infrastructure with NVIDIA GPUs -How Project Forge checkpointing works to restore job states if a long training job fails or needs to be migrated -How we used LoRA fine-tuning to update a fraction of the base model for more training throughput and smaller checkpoints -How UK-based company, Wayve, is using Azure's AI supercomputer infrastructure for self-driving cars -And how Confidential Computing works with Azure AI to combine datasets without sharing personally identifiable information for secure multiparty collaborations.

Mark Russinovich, Azure CTO, joins Jeremy Chapman to break it down.

► QUICK LINKS: 00:00 - Introduction 01:15 - AI innovation building specialized hardware and software 04:22 - Optimizing hardware 05:40 - Improved throughput 06:17 - Project Forge 08:01 - Project Forge checkpointing demo 10:02 - LoRA fine tuning 11:29 - Use AI supercomputer infrastructure for your workloads 12:34 - How Wayve is leveraging AI supercomputer infrastructure ​​ 13:47 - How Confidential Computing works with Azure AI 15:21 - Wrap up

► Link References:

Leverage Azure AI capabilities for yourself at https://aka.ms/AzureAIInfrastructure

► Unfamiliar with Microsoft Mechanics? As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics