AI continues to return at us from all instructions. Think about a world the place billions of individuals, AI brokers, and operators are in fixed communication, exchanging knowledge and fixing beforehand unthinkable issues at lightning velocity.
The change isn’t restricted to the velocity of AI evolution; it’s additionally concerning the magnitude of complexity it should introduce. So, what do organizations have to do otherwise to organize for this? AI transformation calls for high-speed interconnects each inside and between knowledge facilities—which solely fiber optics can present. Successfully navigating AI requires a elementary architectural shift, and Cisco is right here for it.
Maximizing reliability and efficiency for AI knowledge middle connections
With AI investments anticipated to surge to $5.2 trillion by 2030 in keeping with McKinsey Quarterly, the calls for on networks have by no means been better. Information middle visitors is exploding, with back-end visitors rising 10x each two years and the speedy adoption of 800G and 1.6T speeds as reported by the Dell’Oro Group. AI clusters are scaling at an unprecedented tempo, with the most important fashions now exceeding 100,000 GPU nodes—over 20x bigger than just some years in the past in keeping with Epoch AI.
Amid such a dramatic shift in knowledge middle infrastructure, reliability isn’t simply necessary, it’s important. An evaluation from Meta discovered {that a} single gradual GPU hyperlink or failed community connection can cut back cluster efficiency by as much as 40%, leaving costly GPUs idle and investments stranded. In contrast to conventional IP networking, AI workloads require the very best ranges of hyperlink integrity to make sure steady coaching and inference. This places immense strain on high-speed optics, which should function beneath the extraordinary situations present in immediately’s AI knowledge facilities.
Cisco is uniquely positioned to satisfy these challenges. We’ve got what we wish to name a “platform benefit” within the full stack of know-how—ASICs, optics, platforms, software program, safety, and visibility. This permits us to optimize the design and integration of each ingredient to make sure efficiency and reliability for AI environments.
Cisco’s technique for AI infrastructure depends on three core strengths:
Cisco silicon photonics: basis, efficiency, and reliability
- On the coronary heart of our innovation is Cisco silicon photonics, delivering larger efficiency, higher energy effectivity, and elevated reliability. Cisco has over 20 years of high-volume silicon photonics manufacturing and deployment expertise.
Trade’s most strong stress testing for demanding AI environments
- Leveraging our methods and optics design experience, we stress take a look at our optics for AI networking parameters. Our testing methodology encompasses optical, electrical, and mechanical design verification; regulatory and requirements compliance; in addition to Cisco and third-party host platform and software program compatibility testing. Rigorous qualification is carried out on the transceiver module degree and on the platform degree of totally loaded switches and routers.
Architectural improvements to scale back energy consumption
- At Cisco Stay this previous June, we demonstrated a 51.2T change populated with 64 x 800G linear pluggable optics. By shifting power-consuming DSP performance from pluggable optics to the Cisco Silicon One ASIC, we demonstrated a 30% discount in system energy in comparison with conventional retimed optics.
- We’re additionally dedicated to rising applied sciences reminiscent of co-packaged optics (CPO) that may additional cut back total SerDes energy consumption required to generate the optical channel on account of ultra-short electrical traces. Following functionality demonstrations in 2023, our strategy to this rising know-how/resolution consists of leveraging our world provide chain for variety in elements from a number of foundries, optical engines, and geographies.
As well as, Cisco’s globally diversified provide chain leverages a number of sources for silicon photonics wafer fabs, DSPs, lasers, and manufacturing. This ensures well timed entry to crucial elements, enhancing provide chain resilience and enabling speedy deployments for essentially the most demanding AI knowledge middle infrastructure wants.
Connecting AI knowledge facilities with coherent transport
As AI knowledge middle infrastructure continues to develop, it has created demand for connecting knowledge facilities utilizing coherent transport. AI’s affect on coherent transport demand is undisputable, and Cisco can ship the bandwidth required for this new era of computing. Giant language mannequin (LLM) model updates and better performing GPUs have been launched, terminology reminiscent of neocloud supplier and AI factories have turn into more and more mainstream, and new entities are being created worldwide to accommodate the infrastructure to create large AI coaching services.
As well as, a number of service suppliers which have historically supported wholesale bandwidth and fiber connectivity providers have publicly introduced offers to assist AI connectivity development. These connections would particularly deal with connectivity between knowledge middle websites—with the AI connectivity alternatives not restricted to hyperscaler websites, but in addition together with enterprise buyer connectivity.
The ramp-up of AI networks and infrastructure is enjoying a component in present 400G coherent pluggable module adoption, in addition to anticipated 800G coherent module adoption. Cignal AI lately acknowledged that development in latest quarters of coherent pluggable 400G shipments is being pushed by knowledge middle interconnects (DCIs) for AI knowledge facilities, with AI software program being designed to assist a number of bodily places. As hyperscalers and repair suppliers construct out to assist AI, Cisco coherent modules are already being deployed in these DCI builds, and prospects are projecting rising bandwidth necessities to assist these architectures.
Cisco Routed Optical Networking continues to increase and turns into much more crucial within the AI period. In line with Heavy Studying, a good portion (58%) of communication service suppliers plan to deploy 800G coherent pluggables between 2026 and 2028. New Cisco coherent modules, together with 100ZR, 400G extremely long-haul (ULH), and 800G ZR/ZR+, are enabling 100% protection of community purposes from shorter attain campus and entry purposes to long-haul and even subsea, as evidenced by groundbreaking trials.
AARNet (Australia’s Educational and Analysis Community) achieved a exceptional milestone with the profitable completion of a subject trial showcasing the capabilities of cutting-edge 400G ULH pluggable coherent optics know-how. Performed over an unimaginable distance of 4,600 km on the Indigo Central subsea cable system, which connects Sydney and Perth, this achievement heralds a brand new period in long-haul optical networking.
GÉANT efficiently accomplished a subject trial that achieved 3,403 km of terrestrial transmission, representing one of many longest recognized reaches ever demonstrated on a terrestrial community utilizing a 400G QSFP-DD coherent pluggable transceiver with a 24 W energy envelope, making it appropriate with all current 400G-capable routers. Beforehand, Arelion held an 800G ZR+ subject trial that demonstrated diminished CapEx by 66% and OpEx by 95%. Because the integration of Cisco Routed Optical Networking, COLT has reported a surprising 97% vitality financial savings and 67% financial savings in CapEx.
Cisco is ideally positioned to assist hyperscaler, neocloud, service supplier, and enterprise prospects evolve their networks for AI. Our Cisco Silicon One chips are powering the switching/routing platforms for AI coaching and inferencing purposes. We’ve got the optics portfolio for 400G and 800G, and evolving to 1.6T. We will leverage our platform benefit to scale back energy and enhance latency for AI knowledge facilities with applied sciences like LPO and CPO. And we’re persevering with to advance the position of pluggables to achieve into extra components of the community, changing capabilities historically delivered from a devoted chassis—from DWDM transponders with ZR/ZR+ coherent optics to amplifiers, line methods, conventional PON OLTs, and extra.
Our hyperscale, neocloud, service supplier, and enterprise prospects have expressed their confidence in Cisco. That is evidenced by the AI momentum we lately reported in our FY25 earnings, the place we greater than doubled our preliminary goal of AI orders, surpassing $2.1B. We stay up for strengthening our partnership with our prospects.
Hear from our Cisco consultants and prospects
Register for the Cisco Packet Optical Networking Convention (PONC)—September 17–18 in Dallas, TX (digital or in particular person). We’ll discover how operator networks are evolving to satisfy the calls for of AI by making the most of Routed Optical Networking. You’ll additionally be taught the newest in quantum networking; what’s new in routing, optical methods, and optics; learn how to higher handle your community with automation and assurance; and way more.
You can too go to us at ECOC September 29–October 1 in Copenhagen at sales space #C4136.
Share:
