Photo credit: www.gadgets360.com
Intel has recently made waves in the technology sector by launching new hardware specifically aimed at enhancing artificial intelligence (AI) workflows. The introduction of the Xeon 6 processor alongside the Gaudi 3 AI Accelerator marks a significant step for the company, targeting enterprise customers and data centers. This new hardware is designed to help businesses manage the ever-growing demands associated with advanced AI models, promising increased throughput and better cost efficiency.
Introduction of the Intel Xeon 6 Processor
The newly unveiled Intel Xeon 6 processor incorporates Performance-cores that are tailored not for consumer use but to enhance data center operations, particularly for cloud servers. This upgrade is said to offer double the performance of its predecessors, benefiting from a greater core count, along with increased memory bandwidth and significantly improved AI acceleration features.
Intel asserts that with its hardware-based acceleration capabilities, the Xeon 6 processor is well-equipped to handle large language models (LLMs) efficiently. This capability is crucial as organizations strive to meet the high-performance requirements of AI technologies across various environments, from edge computing to comprehensive data center solutions.
Launch of Gaudi 3 AI Accelerators
The Gaudi 3 AI Accelerator represents a new generation of specialized hardware from Intel, specifically engineered to expedite AI tasks such as deep learning and machine learning. These accelerators encompass a range of technologies including GPUs, Application-Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), and Neural Processing Units (NPUs).
Featuring 64 Tensor processor cores and eight matrix multiplication engines (MMEs), the Gaudi 3 is designed to enhance the performance of deep neural networks. It is equipped with 128GB of HBM2e memory, facilitating both training and inference, and includes 24 Ethernet ports for scalable server configurations.
This advanced AI Accelerator is compatible with popular AI frameworks like PyTorch and integrates seamlessly with modern transformer and diffuser models from Hugging Face. Intel has already begun collaborations with IBM for deploying the Gaudi 3 within IBM Cloud environments, in addition to partnerships with Dell Technologies for enhancing its data center capabilities.
Source
www.gadgets360.com