Skip to content
Tiatra, LLCTiatra, LLC
Tiatra, LLC
Information Technology Solutions for Washington, DC Government Agencies
  • Home
  • About Us
  • Services
    • IT Engineering and Support
    • Software Development
    • Information Assurance and Testing
    • Project and Program Management
  • Clients & Partners
  • Careers
  • News
  • Contact
 
  • Home
  • About Us
  • Services
    • IT Engineering and Support
    • Software Development
    • Information Assurance and Testing
    • Project and Program Management
  • Clients & Partners
  • Careers
  • News
  • Contact

8-10x performance upticks in next-gen infrastructure enable AI workloads

CIOs and IT leaders call it the most disruptive technology yet, and now it’s moving rapidly into the mainstream. 

Artificial intelligence (AI), an increasingly crucial piece of the technology landscape, has arrived. 

More than 91 percent of businesses surveyed have ongoing — and increasing — investments in artificial intelligence.

Deploying AI workloads at speed and scale, however, requires software and hardware working in tandem across data centers and edge locations. 

Foundational IT infrastructure, such as GPU- and CPU-based processors, must provide big capacity and performance leaps to efficiently run AI. Without higher performance levels, AI workloads could take months and years to run. With it, organizations can accelerate AI advancements. 

Dell Technologies’ recent developments in hardware and software solutions mirror AI software capabilities to do just that—advance AI. 

More specifically, next-gen offerings from Dell Technologies provide 8-10x performance improvements according to MLCommons ®MLPerf™ benchmarks. The upgraded Dell Technologies solution portfolio includes a range of GPU-optimized servers for AI training and CPU-powered servers for enterprise-wide AI inferencing, both of which are essential, co-existing elements of AI deployment.

MLCommons MLPerf Results

For benchmarking, the MLCommons updated version 3.0, MLPerf Inference was used; the latest results are shown here. Benchmarks include categories such as image classification, object detection, natural language processing, speech recognition, recommender systems and medical image segmentation.

While the inference benchmark rules did not change significantly, Dell Technologies expanded its submission with the new generation of Dell PowerEdge servers, including new PowerEdge XE9680, XR7620, and XR5610 servers and new accelerators from its partners. Submissions were made with VMware running on NVIDIA AI Enterprise software and NVIDIA accelerators as well as Intel-based CPU-only results.

The results for Dell Technologies’ next-gen processors are extraordinary for the highly demanding use cases of AI training, generative AI model training and tuning and AI inferencing. Compared to previous generations of hardware, the results show a significant uptick in performance:

  • 8-10x improvement in performance.
  • 6-8x improvement in performance.

More detailed results can be seen here. 

AI in Action

AI data center and edge deployments mandate a highly interdependent ecosystem of up-level software and hardware capabilities, including a mix of GPU- and CPU-based processors. 

Each industry and organization can tailor infrastructure based on unique needs, preferences and requirements.

Consider, for example, a pharmaceutical company using AI modeling and simulation for drug discovery. 

Modern developments are based on a chemist finding highly active molecules that also test negative for neurotoxicity. There are trillions of compounds to consider and evaluate. 

Each search takes almost two months and thousands of dollars, limiting the number of searches and tests that can be conducted. Using AI, simulations can examine many more molecules much faster and cheaper, opening a new world of possibilities. 

To accelerate drug discovery (there are thousands of diseases and only hundreds of cures), pharmaceutical companies need powerful processors to handle large and diverse data sets efficiently and effectively.

Retailers typically use AI differently than pharmaceutical companies. Retail use cases often revolve around video imagery used to enhance security, bolster intrusion detection and support self-check-out capabilities. To boost newfound capabilities in these areas, retailers need more powerful GPU-optimized processors to handle image-based data streams.

Advancing AI

Emerging generative AI use cases, such as digital assistants and co-pilots for software development, are appearing as the next frontier of AI. That’s why at Dell Technologies, innovation never rests. When it comes to technology infrastructure, Dell Technologies and its partners are constantly innovating to reach new performance levels and help redefine what is possible. 

The exponential performance increase in NVIDIA GPU-optimized servers and the infusion of AI Inferencing in Intel’s® Xeon®-based servers are creating the required AI foundation. With these results, Dell Technologies can help organizations fuel AI transformations precisely and efficiently, including new AI training and inferencing software, generative AI models, AI DevOps tools and AI applications.

***

Dell Technologies. To help organizations move forward, Dell Technologies is powering the AI journey, including enterprise generative AI. With best-in-class IT infrastructure and solutions to run AI workloads and advisory and support services that roadmap AI initiatives, Dell is enabling organizations to boost their digital transformation and accelerate intelligent outcomes. 

Intel. The compute required for AI models has put a spotlight on performance, cost and energy efficiency as top concerns for enterprises today. Intel’s commitment to the democratization of AI and sustainability will enable broader access to the benefits of AI technology, including generative AI, via an open ecosystem. Intel’s AI hardware accelerators, including new built-in accelerators, provide performance and performance per watt gains to address the escalating performance, price and sustainability needs of AI.

Artificial Intelligence
Read More from This Article: 8-10x performance upticks in next-gen infrastructure enable AI workloads
Source: News

Category: NewsMay 5, 2023
Tags: art

Post navigation

PreviousPrevious post:We are innovationNextNext post:CarMax drives business value with GPT-3.5

Related posts

SAS supercharges Viya platform with AI agents, copilots, and synthetic data tools
May 8, 2025
IBM aims to set industry standard for enterprise AI with ITBench SaaS launch
May 8, 2025
Consejos para abordar la deuda técnica
May 8, 2025
Training data: The key to successful AI models
May 8, 2025
Bankinter acelera la integración de la IA en sus operaciones
May 8, 2025
The gen AI at Siemens Mobility making IT more accessible
May 8, 2025
Recent Posts
  • SAS supercharges Viya platform with AI agents, copilots, and synthetic data tools
  • IBM aims to set industry standard for enterprise AI with ITBench SaaS launch
  • Consejos para abordar la deuda técnica
  • Training data: The key to successful AI models
  • Bankinter acelera la integración de la IA en sus operaciones
Recent Comments
    Archives
    • May 2025
    • April 2025
    • March 2025
    • February 2025
    • January 2025
    • December 2024
    • November 2024
    • October 2024
    • September 2024
    • August 2024
    • July 2024
    • June 2024
    • May 2024
    • April 2024
    • March 2024
    • February 2024
    • January 2024
    • December 2023
    • November 2023
    • October 2023
    • September 2023
    • August 2023
    • July 2023
    • June 2023
    • May 2023
    • April 2023
    • March 2023
    • February 2023
    • January 2023
    • December 2022
    • November 2022
    • October 2022
    • September 2022
    • August 2022
    • July 2022
    • June 2022
    • May 2022
    • April 2022
    • March 2022
    • February 2022
    • January 2022
    • December 2021
    • November 2021
    • October 2021
    • September 2021
    • August 2021
    • July 2021
    • June 2021
    • May 2021
    • April 2021
    • March 2021
    • February 2021
    • January 2021
    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • August 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • January 2020
    • December 2019
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • April 2019
    • March 2019
    • February 2019
    • January 2019
    • December 2018
    • November 2018
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • February 2017
    • January 2017
    Categories
    • News
    Meta
    • Log in
    • Entries feed
    • Comments feed
    • WordPress.org
    Tiatra LLC.

    Tiatra, LLC, based in the Washington, DC metropolitan area, proudly serves federal government agencies, organizations that work with the government and other commercial businesses and organizations. Tiatra specializes in a broad range of information technology (IT) development and management services incorporating solid engineering, attention to client needs, and meeting or exceeding any security parameters required. Our small yet innovative company is structured with a full complement of the necessary technical experts, working with hands-on management, to provide a high level of service and competitive pricing for your systems and engineering requirements.

    Find us on:

    FacebookTwitterLinkedin

    Submitclear

    Tiatra, LLC
    Copyright 2016. All rights reserved.