ZML's LLMD software targets $13B Baseten with multi-chip AI inference
ZML releases LLMD, a free software to optimize AI inference across chips from Nvidia, AMD, Google, and more, competing with Baseten.
ZML
Latest ZML coverage.
News, trends, and insights from the AI frontier.
Latest ZML coverage.
ZML releases LLMD, a free software to optimize AI inference across chips from Nvidia, AMD, Google, and more, competing with Baseten.
ZML launches LLMD, a free inference server accelerating LLMs on Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc chips.