NextBigFuture

XAI Completes Nvidia 100K Training Cluster and Will Double in Months

This weekend, the xAI team brought the Colossus 100k H100 training cluster online. From start to finish, it was done in 122 days. Colossus is the most powerful AI training system in the world.
Honolulu Star-Advertiser

COVID-19 cluster report highlights risk of exposure at Oahu employee training event

The Hawaii Department of Health’s cluster report this week highlights an Oahu cluster that resulted from in-person employee training. Health officials said they are now investigating a cluster from an ...
TweakTown

Meta's huge 16,384 NVIDIA H100 AI GPU cluster: HBM3 memory crashed half of Llama 3 training

Meta released a new study detailing its Llama 3 405B model training, which took 54 days with the 16,384 NVIDIA H100 AI GPU cluster. During that time, 419 unexpected component failures occurred, with ...
Semiconductor Engineering

Low-Power Heterogeneous Compute Cluster For TinyML DNN Inference And On-Chip Training

A new technical paper titled “DARKSIDE: A Heterogeneous RISC-V Compute Cluster for Extreme-Edge On-Chip DNN Inference and Training” was published by researchers at University of Bologna and ETH Zurich ...