Hot French startup ZML releases free product to speed inference across lots of AI chips

ZML released LLMD, an open-source LLM inference server that optimizes performance across multiple chip architectures including Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc. The software aims to reduce vendor lock-in and enable enterprises to mix chips for cost and energy efficiency.

Mentioned entities