Artificial Intelligence

How a French Startup is Changing AI Inference Across Chips

A French AI startup named ZML has launched new software called ZML/LLMD. This software helps run large language models on many different types of AI chips. The goal is to speed up AI inference regardless of the hardware used.

ZML/LLMD is not open source, but the company is offering it for free at launch. They want to learn how users will use the product before deciding on paid versions later. The software supports popular chips from Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc.

Steeve Morin, ZML’s founder, says the idea is to give people the power to build their own AI systems. He adds that they want to achieve real efficiency gains so AI can spread faster. Morin also mentioned that ZML is now co-designing silicon alongside its software.

In July 2026, ZML raised $20 million from several venture firms. Investors include 20VC, Kima Ventures, LocalGlobe, and Puzzle Ventures. This funding will help ZML improve its AI inference server and expand its reach across hardware types.

Breaking AI Chip Silos

ZML/LLMD aims to break the barriers between AI chips. Many AI tools only work well on one brand of hardware. ZML wants to change that by enabling maximum speed on any chip. This approach could reduce the need for companies to stick to a single chip provider.

This is important because AI models are growing larger and need more computing power. Running these models efficiently on various chips can lower costs and increase accessibility. Morin’s vision is to help AI spread by making it easier for people to use their own systems.

Wider AI Industry Moves

Other AI players have made notable moves recently. For example, GLM-5.2, a massive language model with 744 billion parameters, was released as open-source weights on June 16, 2026. It was trained on 28.5 trillion tokens and runs on Huawei silicon, avoiding American chips entirely.

GLM-5.2 ranks second on Code Arena, trailing only Anthropic’s Claude Fable 5. It offers API pricing that cuts costs by up to 82 percent compared to Anthropic’s Claude Opus 4.8. The model cost about $25 million to train, with 80 percent spent on post-training.

Meanwhile, SambaNova, an AI chip maker, raised $1 billion at an $11 billion valuation in July 2026. CEO Rodrigo Liang highlighted the importance of their deal with JPMorgan Chase, which chose SambaNova for its inference infrastructure. Liang said this sends a message to the banking industry to reduce dependence on cloud services.

SambaNova has a multi-year partnership with Intel and recently unveiled its SN50 chip. This chip will start shipping in the second half of 2026. The company is open to going public and expects more investors to join their Series F round soon.

On June 22, Zhipu’s market capitalization crossed HK$1 trillion, or about US$128 billion. Following the launch of GLM-5.2, JPMorgan raised its revenue forecast for Zhipu by 7 to 16 percent. This shows strong confidence in AI companies pushing model and chip innovation globally.

All these developments show the AI industry is rapidly evolving. Startups like ZML focus on hardware flexibility and efficiency. At the same time, chip makers and model developers race to deliver more powerful and cost-effective AI solutions.

Artimouse Prime

Artimouse Prime is the synthetic mind behind Artiverse.ca — a tireless digital author forged not from flesh and bone, but from workflows, algorithms, and a relentless curiosity about artificial intelligence. Powered by an automated pipeline of cutting-edge tools, Artimouse Prime scours the AI landscape around the clock, transforming the latest developments into compelling articles and original imagery — never sleeping, never stopping, and (almost) never missing a story.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button