Weflayr raises $2.5M to optimize AI model routing and cut inference costs
Weflayr secures $2.5M pre-seed to build an AI inference routing layer that cuts costs by 55% for customers.
AI inference
Latest AI inference coverage.
IBM launches llm-d 1.0, an open-source AI inference framework for enterprise scale
IBM introduces llm-d 1.0, an open-source framework for large language model inference, and partners with Procore for asset data management.
Ready Server's free LLM API offers private AI inference to VPS customers
Singapore-based Ready Server launches OpenAI-compatible LLM API for VPS customers, eliminating per-token billing and API keys.
SUNMMIO raises $277M to mass-produce 3D-stacked AI chips
Beijing-based SUNMMIO secures $277M in Pre-A2 and Series A rounds to scale 3D TokenPU chips for AI inference.
Aerospike slashes AI inference traffic costs by 70% with delta replication, compression
Aerospike introduces delta replication and in-cluster compression to cut AI inference traffic costs by 70%, benefiting enterprises running agentic AI workloads.
Samsung invests in Euclyd's $230M AI chip push to challenge Nvidia
Samsung co-leads a $230M round for Dutch AI chip startup Euclyd, aiming to offer cheaper, more efficient alternatives to Nvidia GPUs.
Delos Data raises $100M+ to scale AI inference hardware with 1.6Tbps networking
Delos Data secures $100M+ to expand its AI inference hardware lineup, including a new 1.6Tbps networking chip.
Gimlet Labs' $3B valuation hinges on multi-silicon inference cloud
AI inference startup Gimlet Labs raises $300M, reaching a $3B valuation with its multi-silicon cloud technology
Orbital Compute Startup K2 Space Raises $500M at $6.8B Valuation
K2 Space secures $500M Series D to build orbital data centers, aiming for $15M per satellite and 100kW power by 2028.
OpenAI's Jalapeño chip outperforms Nvidia by 1.9x on power efficiency
OpenAI's Jalapeño chip, built with Broadcom, delivers 1.5x to 1.9x more AI work per watt than Nvidia's GB200 and GB300 systems.
Fractile's $6.5B valuation talks follow Anthropic chip deal
British AI-chip startup Fractile is in advanced talks to raise funds at a $6.5B valuation after securing a deal with Anthropic.
Groq raises $350M at $3.5B valuation, shifts focus to AI cloud infrastructure
Groq raises $350M to expand its AI cloud infrastructure, pivoting from chipmaking to compete with Nvidia-backed neoclouds.
OpenAI's GPT-5.6 Sol Ultrafast hits 750 tokens per second, 11x faster than Fable 5
OpenAI and Cerebras launch GPT-5.6 Sol Ultrafast, delivering 750 tokens per second and 11x faster performance than Fable 5.
Microsoft targets $100B/year in AI inference revenue, per SemiAnalysis
Microsoft is poised to generate $100 billion annually from AI inference, challenging OpenAI and Anthropic, according to SemiAnalysis.
Arm's $312M bet on Olix targets AI inference chips, triples valuation to $3.3B
Arm Holdings joins a $312M funding round for AI chip startup Olix, boosting its valuation to $3.3B and targeting AI inference markets.
ZML's LLMD software targets $13B Baseten with multi-chip AI inference
ZML releases LLMD, a free software to optimize AI inference across chips from Nvidia, AMD, Google, and more, competing with Baseten.
Etched's $300M Series C values AI chip startup at $10.3B, challenging Nvidia
Etched raises $300M in Series C, valuing the AI chip startup at $10.3B to challenge Nvidia's dominance.
AMD's $909B valuation hinges on Venice CPU launch July 22
AMD's new 2nm EPYC Venice CPU, launching July 22, could drive its market cap to $1 trillion, analysts say.