GPU Computing
-
Machine Learning & Research
Memorilla Shrinks Massive Document Stores to 16 Tokens
Long documents just became a 16-token problem. Stanford researchers have released Memorilla, an open-source memory system that reads an entire…
Read More » -
Hardware & Semiconductors
Vertiv’s New Power Panel Targets the Next Era of AI Racks
AI racks are pushing data center power systems into unfamiliar territory, and Vertiv is responding with a new design built…
Read More » -
Hardware & Semiconductors
Nvidia Faces a Historic Leadership Shock at the AI Chip Summit
Nvidia has lost its longtime leader at the moment its chips sit at the center of the global AI boom.…
Read More » -
AI News & Trends
Nvidia’s Power Shift After a High-Stakes Intelligence Scandal
Nvidia has been pulled into a storm that reaches from corporate leadership to US national security. An alleged relationship involving…
Read More » -
Hardware & Semiconductors
Lenovo’s Liquid-Cooled AI Servers Push Enterprise Computing Forward
AI and high-performance computing are moving into the same infrastructure conversation, and Lenovo is responding with a broad new portfolio…
Read More » -
Cloud Computing
AI Infrastructure Faces a Visibility Problem From Cloud to Continent
AI infrastructure is moving in several directions at once. Amazon CloudWatch accelerated compute insights focuses on visibility into expensive accelerators,…
Read More » -
Hardware & Semiconductors
Torus Brings AI Inference to Existing Power With $500 Million
Torus is taking a new route to the AI infrastructure crunch: bring the computing system to available power instead of…
Read More » -
Cloud Computing
NVIDIA Snapshot Cuts Kubernetes GPU Startup From Minutes to Seconds
Starting a large AI model can take minutes before it handles a single request. NVIDIA Snapshot takes a different approach:…
Read More » -
AI Ethics & Policy
Jensen Huang Scandal Puts Nvidia, Trump and AI Security Under Pressure
Jensen Huang sits at the center of the artificial intelligence boom, with a $160bn fortune and control of Nvidia, the…
Read More » -
Cloud Computing
The Hidden Cost of Real-Time State in AI Inference
Real-time AI inference carries a cost that a memory bill alone cannot show. The model must fit on the available…
Read More »