Accelerating AI development with Windows-based AI workstations

Today, we announced powerful capabilities for AI development with Windows AI Foundry, featuring components like Windows ML that enable developers to bring their own models and deploy them efficiently across diverse silicon partner ecosystem including – AMD, Intel, NVIDIA and Qualcomm spanning CPU, GPU, NPU (Neural Processing Unit).  In the rapidly evolving field of AI development, having robust hardware is just as important as reliable software and tools for optimizing performance and efficiency.

We heard from developers that they need powerful workstations equipped with advanced CPUs, GPUs and specialized processors like NPUs  with blazing fast memory and storage for moving massive amounts of data around to handle the intensive computational demands of AI tasks such as data processing, model training, finetuning, inference and deployment. A robust Windows-based workstation combined with a reliable platform like Windows AI Foundry enables AI developers to streamline their workflows, reduce latency and achieve real-time processing capabilities.

Your AI stack, your machine: The case for Windows-based Workstations

For AI developers, a workstation is more than just a powerful machine; it’s a critical asset that enhances their ability to develop, test and deploy AI models efficiently and more importantly – locally. It offers a few key benefits:

  • Privacy and Security: Workstations enable local development without the need for internet access, ensuring sensitive data remains on device, minimizing security threats and maximizing privacy.
  • Cost Efficiency: By handling fine-tuning and inference locally, developers can reduce recurring cloud compute costs. In the case of Copilot+ PCs, local AI workloads are becoming more energy efficient, lowering overall power consumption.
  • Speed and Reliability: Developers can iterate quickly and debug without delays from cloud syncs or network dependencies. The hardware also enables low latency inferencing and high-performant user experiences.

Choosing a Windows-based AI workstation is especially important for Windows developers who require speed, flexibility and control in AI workloads. It is also ideal for leveraging AI Toolkit for Visual Code and the full capabilities of Windows AI Foundry and its components such as Foundry Local and  Windows ML, which are optimized for local workflows.

Diverse options of Windows workstations, catering to the demanding needs of AI developer workloads

AI developers on Windows 11 can choose from a wide array of PC hardware from OEM partners like Dell, HP, Lenovo and more. Not only are these systems optimized for AI model finetuning, inferencing and deployment, but they also provide flexibility in your developer workflow with different form factors and price points.

For developers requiring raw power, a desktop workstation with a powerful CPU and GPU can significantly reduce the time for local model finetuning. Those looking for physical space efficiency may consider a mini workstation, while developers on the move can benefit from a mobile workstation, which enables them to run inference on a proprietary model locally in absence of a stable network connection.

At Build 2025, we featured the latest workstations from a few of our OEM partners:

  • The Dell Pro Max Tower T2 desktop leads in thermal innovation and is the world’s fastest tower for single-threaded application performance,1 made possible by Dell’s exclusive unlimited turbo duration technology. This ensures top-tier performance under sustained heavy workloads. Turbo duration allows the device to excel in prolonged intensive tasks, keeping AI applications running efficiently over extended periods without compromising thermal integrity. The Tower will be available with Intel’s Core Ultra series processors delivering up to 32GB of DDR5 memory, 1TB self-encrypting storage and NVIDIA’s RTX PRO Blackwell Generation GPUs in July 2025. Learn more about Dell Pro Max PCs.
  • The Dell Pro Max 16 laptop packs high-end performance in a portable, lightweight and modern design. The 16-inch QHD+ resolution display provides expansive screen real estate and supports complex and demanding applications on-the-go. The laptop is available on both AMD Ryzen AI PRO 300 series and Intel Core Ultra series processors running NVIDIA’s RTX PRO Blackwell Generation Laptop GPUs in July 2025, providing engineers and designers with performance for AI inferencing, rendering and creative applications. Learn more about Dell Pro Max PCs.
  • The HP ZBook Ultra G1a 14” powerful 14-inch mobile workstation laptop defies what’s possible on the go. A Copilot+ PC with a compact design and new AMD Ryzen AI Max PRO processor, the ZBook Ultra offers the performance to tackle workflows previously not possible on a laptop. Take desk-bound workflows anywhere with an ultra-thin and light design, combined with a long-lasting battery, Next-Gen AI PC features and AI-enhanced privacy. Featuring up to 16 desktop-class CPU cores, discrete-like integrated graphics and up to 128GB of unified memory architecture, and the ability to assign up to 96GB RAM to the GPU, the ZBook Ultra enables seamless multitasking between applications. Learn more about the ZBook Ultra G1a.
  • The HP Z2 Mini G1a mini workstation is equipped with the AMD Ryzen AI Max PRO processor and scalable 128GB of unified memory architecture with the ability to assign up to 96GB exclusively to the GPU, the Z2 Mini G1a delivers performance for graphics-intensive workflows. With an internal power supply, this PC cleanly fits on a desk, mounted behind a monitor or attached under a desk. It also easily fits in a rack, and its small size allows for a high-density rack mount solution that combines performance, manageability and security. Learn more about the Z2 Mini G1a.
  • The Lenovo ThinkPad P14s Gen 6 mobile workstation laptop is a Copilot+ PC that combines pro-grade performance with true mobility. Featuring the latest AMD Ryzen AI PRO 300 series processors and integrated AMD Radeon graphics, it’s ISV-certified and ideal for workflows such as 2D CAD, light 3D design and content creation. Built for hybrid professionals, students and educators, it balances performance, security and battery life in a compact 14-inch chassis. Learn more about Lenovo workstations.
  • The Lenovo ThinkPad P16s Gen 4 mobile workstation laptop is a Copilot+ PC that offers enhanced performance, a larger display and greater configuration flexibility. Also powered by AMD Ryzen AI PRO 300 series processors and certified for key ISV applications, it’s built to handle more demanding workloads, such as 3D CAD, BIM modeling and data-heavy tasks. With a 16-inch screen, integrated AI acceleration and robust ThinkShield security, it’s ideal for professionals in engineering, architecture and media. Learn more about Lenovo workstations.

Examples of how workstations benefit the developer workflow

Fine-Tuning on the Dell Pro Max Tower T2 with Intel Core Ultra 7 processor and the NVIDIA RTX PRO 6000 Blackwell GPU

Local fine-tuning on a workstation improves developer productivity by offering a quick, powerful and easy way to run and debug your prototypes locally before you take your final workflows to cloud.

With the Dell Pro Max Tower T2, we fine-tuned the Microsoft’s Phi-4-mini model using the NVIDIA GPU with LoRA (low-rank adaption) in AI Toolkit and the alpaca-cleaned dataset which contained 51,760 prompts. For a batch size of 8 prompts, the system was able to backpropagate 2.16 batches per second, finishing 3 full epochs of fine-tuning in about 2 hours and 15 minutes. The same workflow could take up to a day to complete on the cloud due to round trip latency with the additional costs of cloud billing.

Example 1: Fine-tuning Phi-4-mini model local off the NVIDIA RTX PRO 60000 GPU on a Dell Pro Max Tower T2 (sped up 150x)

AI Anywhere: Harnessing GPU Power on the go with the HP ZBook Ultra G1a 14”

The new HP ZBook Ultra G1a 14” powered by the AMD Ryzen AI Max+ PRO 395 is a Copilot+ PC that leverages the power of a CPU, GPU and NPU to maximize performance and resources in various workflows.

Example 2: Loading and running 70b DeepSeek R1 locally on HP ZBook Ultra G1a 14”

In one use case, we utilized AI Tool Kit for VS Code to load and run a large 70b parameter DeepSeek R1 model locally – an impressive feat for a mobile workstation.

Example 3: Running SDXL and Phi-4 Mini concurrently on the HP ZBook Ultra G1a 14” laptop

In another use case, we ran Stable Diffusion XL (SDXL) model and Phi-4 Mini CPU ONNX model at the same time. The image generation ran at ~3 to 6 it/sec concurrently while the text generation task concluded within 7-17 tokens/sec. You can see from the task manager that the GPU is utilized to give max processing performance. The NVMe SSD makes it ideal for high performance applications like these.

To run both the image generation and text generation concurrently, you typically need a system with enough processing power, memory and storage. Although a desktop setup can meet these requirements, the HP ZBook Ultra G1a 14” laptop is capable of handling such tasks within a compact form factor for productivity on the go.

Building for the future of AI on Windows based workstations

By 2027, it is expected that 60% of PCs shipped will feature on-device AI capabilities2 pushing the boundaries of AI models running locally. Having the right workstation not only accelerates the development cycle but also ensures that AI models run across a wide breadth of CPUs, GPUs and NPUs. Understanding the breadth of available options and investing in the right workstation can significantly enhance developers’ ability to innovate and succeed in the competitive landscape of AI.

To drive innovation, both software and hardware must align. Not only do we encourage developers to check out Windows AI Foundry, but we also encourage developers to leverage the latest hardware in Windows-based AI workstations for the best developer experience.

1 The Dell Pro Max Tower T2 is the World’s fastest for single-threaded application performance – Based on internal analysis of competitors within the entry level workstation space, Lenovo P3 Ultra, HP Z2 G9 Mini, HP Z2 G1a Mini and Lenovo P3 Tiny. February 2025

2 Based on report by Canalys “Now and next for AI-capable PCs: Revolutionizing computing: AI PCs and the market outlook.” (January 2024)

This site uses cookies to offer you a better browsing experience. By browsing this website, you agree to our use of cookies. Click More Info to view Privacy Policy.