
ZML's LLMD software targets $13B Baseten with multi-chip AI inference
ZML releases LLMD, a free software to optimize AI inference across chips from Nvidia, AMD, Google, and more, competing with Baseten.
News, trends, and insights from the AI frontier.
Latest LLMD coverage.

ZML releases LLMD, a free software to optimize AI inference across chips from Nvidia, AMD, Google, and more, competing with Baseten.

ZML launches LLMD, a free inference server accelerating LLMs on Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc chips.