On this common replace, RCR Wi-fi Information highlights the highest information and developments impacting the booming AI infrastructure sector.
NVIDIA brings agentic AI reasoning to enterprises with Google Cloud
NVIDIA stated it’s collaborating with Google Cloud to deliver agentic AI to enterprises looking for to regionally harness the Google Gemini household of AI fashions utilizing the NVIDIA Blackwell HGX and DGX platforms and NVIDIA Confidential Computing for information security.
With the NVIDIA Blackwell platform on Google Distributed Cloud, on-premises information facilities can keep aligned with regulatory necessities and information sovereignty legal guidelines by locking down entry to delicate info, comparable to affected person data, monetary transactions and labeled authorities info, the corporate stated. NVIDIA Confidential Computing additionally secures delicate code within the Gemini fashions from unauthorized entry and information leaks, it added.
Confidential computing with NVIDIA Blackwell gives enterprises with the technical assurance that their consumer prompts to the Gemini fashions’ software programming interface — in addition to the info they used for fine-tuning — stay safe and can’t be considered or modified. On the identical time, mannequin homeowners can defend towards unauthorized entry or tampering, offering dual-layer safety that permits enterprises to innovate with Gemini fashions whereas sustaining information privateness, NVIDIA added.
This new providing arrives as agentic AI is remodeling enterprise expertise, providing extra superior problem-solving capabilities. In contrast to AI fashions that understand or generate primarily based on realized data, agentic AI methods can cause, adapt and make selections in dynamic environments, stated NVIDIA.
AT&T to supply fiber connectivity for Jericho Power Ventures’ AI modular information middle web site
Jericho Power Ventures (JEV) has partnered with AT&T to install a minimal of 10Gbps of fiber optic at its preliminary Modular Excessive Efficiency AI Information Heart web site in Oklahoma.
On March 31, 2025, JEV unveiled its modular information middle enterprise, harnessing its pure fuel belongings and infrastructure to drive the event of superior, technology-driven, AI-focused computing options tailor-made for the AI period.
Brian Williamson, CEO of Jericho Power Ventures, commented: “We’re shifting full steam forward in constructing out our AI modular information facilities, and partnering with industry-leader AT&T together with others to deploy high-speed fiber connectivity on-site is a crucial step in creating a next-generation modular AI computing infrastructure. By leveraging our pure fuel belongings and strategic places, we’re uniquely positioned to supply scalable, dependable, and cost-effective energy options to fulfill the rising calls for of the AI age.”
Google unveils new TPU for inference AI
At Google Cloud Subsequent 2025, Google launched Ironwood, its seventh-generation Tensor Processing Unit (TPU) and the primary designed particularly for AI inference. The brand new TPU, dubbed Ironwood, helps large-scale, considering AI fashions like LLMs and Combination of Specialists (MoEs) that demand large computation and communication capabilities.
Google famous that Ironwood can scale as much as 9,216 liquid-cooled chips, delivering 42.5 Exaflops per pod. Every chip achieves 4,614 TFLOPs of peak compute, powered by 192 GB of Excessive Bandwidth Reminiscence (HBM) and seven.2 TBps of bandwidth, enabling environment friendly dealing with of huge datasets and fashions. Its enhanced Inter-Chip Interconnect (ICI) reaches 1.2 Tbps, enabling low-latency communication for distributed AI workloads.
The TPU consists of an improved SparseCore for ultra-large embeddings and helps Pathways, Google’s ML runtime for scaling throughout pods. Ironwood’s liquid cooling ensures vitality effectivity, providing 2x the efficiency per watt of its predecessor, Trillium, and 30x effectivity over the unique Cloud TPU.
Why these bulletins matter
These bulletins spotlight key developments shaping the way forward for AI infrastructure. Google’s Ironwood TPU, constructed particularly for inference, and NVIDIA’s push for agentic AI mark a shift towards fashions that don’t simply course of info, however cause and make selections in actual time. On the identical time, each corporations are emphasizing safe AI deployments — with applied sciences like Confidential Computing and compliance-ready cloud infrastructure — to guard delicate information and mannequin integrity. Jericho Power Ventures’ modular, AI-focused information facilities powered by pure fuel and supported by fiber from AT&T replicate the rising want for localized, energy-efficient infrastructure. Collectively, these developments sign an evolution towards safe, inference-ready and extremely scalable AI methods designed to fulfill the calls for of the following technology of clever purposes.
Observe AI Infrastructure Insights on LinkedIn to get extra AI infra briefs.
