You are viewing a single comment's thread from:

RE: LeoThread 2024-10-31 10:28

Cisco shifts focus to AI with new infrastructure solutions

While most people think of Cisco as a company that links infrastructure elements in data centers and the cloud

While most people think of Cisco as a company that links infrastructure elements in data centers and the cloud, it is not the first company that comes to mind when discussing GenAI. However, at its recent Partner Summit event, the company made several announcements aimed at changing that perception.

#cisco #cloud #generativeai #infrastructure #ai #technology

Sort:  

Specifically, Cisco debuted several new servers equipped with Nvidia GPUs and AMD CPUs, targeted for AI workloads, a new high-speed network switch optimized for interconnecting multiple AI-focused servers, and several preconfigured PODs of compute and network infrastructure designed for specific applications.

On the server side, Cisco's new UCS C885A M8 Server packages up to eight Nvidia H100 or H200 GPUs and AMD Epyc CPUs into a compact rack server capable of everything from model training to fine-tuning. Configured with both Nvidia Ethernet cards and DPUs, the system can function independently or be networked with other servers into a more powerful system.

The new Nexus 9364E-SG2 switch, based on Cisco's latest G200 custom silicon, offers 800G speeds and large memory buffers to enable high-speed, low-latency connections across multiple servers.

The most interesting new additions are in the form of AI PODs, which are Cisco Validated Designs (CVDs) that combine CPU and GPU compute, storage, and networking along with Nvidia's AI Enterprise platform software. Essentially, they are completely preconfigured infrastructure systems that provide an easier, plug-and-play solution for organizations to launch their AI deployments – something many companies beginning their GenAI efforts need.