Keysight AI (KAI) Information Heart Builder emulates AI workloads with out requiring massive GPU clusters, enabling analysis of how new algorithms, parts, and protocols have an effect on AI coaching. The software program suite integrates massive language mannequin (LLM) and different AI mannequin workloads into the design and validation of AI infrastructure parts, together with networks, hosts, and accelerators.
KAI Information Heart Builder simulates real-world AI coaching community patterns to hurry experimentation, cut back the educational curve, and establish efficiency degradation causes that actual jobs could not reveal. Keysight clients can entry LLM workloads like GPT and Llama, together with fashionable mannequin partitioning schemas, similar to Information Parallel (DP), Totally Sharded Information Parallel (FSDP), and 3D parallelism.
The KAI Information Heart Builder workload emulation utility permits AI operators to:
- Experiment with parallelism parameters, together with partition sizes and distribution throughout AI infrastructure (scheduling)
- Assess the affect of communications inside and between partitions on total job completion time (JCT)
- Determine low-performing collective operations and pinpoint bottlenecks
- Analyze community utilization, tail latency, and congestion to grasp their impact on JCT
For extra info on the KAI Information Heart Builder, or to request a demo or value quote, click on the product web page hyperlink under.
KAI Information Heart Builder product web page
Discover extra datasheets on merchandise like this one at Datasheets.com, searchable by class, half #, description, producer, and extra.
The put up Software program optimizes AI infrastructure efficiency appeared first on EDN.
