VAST Data has launched a new AI inference architecture that redefines how large language models and multi-agent AI systems handle data. By running their AI Operating System directly on NVIDIA BlueField-4 DPUs, they are creating a faster, more efficient way to manage context at scale. This new approach aims to support the growing needs of
Loading
All posts tagged in NVIDIA
Nvidia has taken a big step in AI hardware by licensing technology from Groq, a chip designer specialized in AI inference. While Nvidia hasn’t bought Groq outright, it has secured a non-exclusive license to use Groq’s intellectual property and hired some of its top engineers. This move hints at Nvidia’s strategy to expand its AI
Read More
241
Nvidia has taken a new step in its AI hardware strategy by licensing technology from Groq, a company known for its specialized AI inference chips. Instead of buying Groq outright, Nvidia has chosen to license its intellectual property and bring some of Groq’s top engineers onto its team. This move helps Nvidia expand its capabilities
Read More212
Last week at AWS re:Invent, Amazon announced a new offering called AWS AI Factories. The company highlighted how these factories aim to speed up AI development using powerful hardware like Trainium, Nvidia GPUs, and secure infrastructure. The idea is to make deploying AI easier, safer, and more sophisticated for large organizations. But as with many
Read More255
As AI adoption accelerates worldwide, a significant infrastructure challenge has emerged: the limited availability of high-performance computational resources. Cloud providers report extensive waitlists for premium GPU instances, highlighting the stark imbalance between demand and supply. Unlike the previous crypto-mining GPU surge, today’s crunch is driven by genuine needs in AI research and deployment, creating a
Read More292
EY is advancing the integration of artificial intelligence into the physical world by developing a comprehensive platform for testing and deploying robotic, drone, and other smart device applications. This initiative includes launching a new EY.ai Lab in Georgia and establishing strategic leadership to guide its physical AI efforts. The platform leverages NVIDIA’s advanced tools, including
Read More298
According to recent insights from TrendForce, the technology industry is on the cusp of significant transformation by 2026, driven by emerging trends in AI hardware, data center cooling, and high-bandwidth communication technologies. These developments will reshape competitive dynamics and technological capabilities across the globe. Intensified AI Chip Competition and Advanced Cooling Solutions The demand for
Read More263
Microsoft is experiencing significant leadership changes as it strives to expand its AI infrastructure capabilities. The company has recently seen the departures of two senior executives, raising concerns about its ability to meet the increasing demand for power-intensive AI workloads during a critical growth phase. Leading Experts Depart Amid Growing Infrastructure Pressures Nidhi Chappell, who
Read More233
Dell Technologies and NVIDIA have announced a new phase of their AI partnership. Their latest updates aim to make running different AI tasks simpler and faster. This comes at a good time as more companies look to expand their AI efforts but face challenges with hardware, software, and data management. Streamlined Deployment and Improved Performance
Read More285
Big changes are underway in the world of AI computing. Microsoft, NVIDIA, and Anthropic have teamed up to create a new alliance focused on pushing the limits of AI hardware and software. This partnership aims to build a more diverse and efficient ecosystem for training and deploying powerful AI models, moving away from reliance on
Read More275
