Product Launches

Grammarly's 100B weekly LLM calls power Superhuman's last-mile AI push

Share
Grammarly's 100B weekly LLM calls power Superhuman's last-mile AI push

Grammarly processes over 100 billion LLM calls weekly, a scale that underpins Superhuman's new AI-powered workflow integration strategy. The company's latest product, Superhuman Go, aims to embed AI directly into users' existing tools, addressing what CEO Shishir Mehrotra calls 'the last mile of AI.'

TL;DR

  • Grammarly's massive LLM call volume enables real-time AI integration in users' workflows.
  • Superhuman Go aims to make AI more accessible by embedding it directly into existing tools.
  • The success of this strategy hinges on solving the challenge of measuring AI productivity.

What happened

Grammarly, now part of the Superhuman suite, processes over 100 billion LLM calls weekly, with 98% served by custom models at under 100ms latency. This scale enables real-time AI integration across over 1 million applications daily. Superhuman Go, the latest product, is an agent platform that brings AI capabilities directly to the user's cursor, with partners like Databricks and Lora. The suite also includes Superhuman Mail, Docs, and the recently acquired note-taker Fathom, all aimed at embedding AI into existing workflows.

Why it matters

This strategy addresses the 'last mile' challenge in enterprise AI, where powerful tools often fail to reach users due to behavior change requirements. By integrating AI directly into users' workflows, Superhuman aims to significantly increase AI usage and productivity. However, the company acknowledges that measuring AI productivity remains an open question, with no settled metrics currently available. The success of this approach could set a new standard for AI integration in enterprise tools.

Key facts

  • Grammarly processes over 100 billion LLM calls weekly, according to CEO Shishir Mehrotra.
  • 98% of these calls are served by custom models with under 100ms latency.
  • Grammarly's AI capabilities are integrated into over 1 million applications daily.
  • Superhuman Go is an agent platform that brings AI capabilities directly to the user's cursor.
  • The Superhuman suite includes Mail, Docs, and the recently acquired note-taker Fathom.
  • Partners like Databricks and Lora have built agents running inside Superhuman Go.
  • Mehrotra predicts 10 to 100 times more inference volume over the next year.
  • The company aims to become the 'must-have AI productivity suite' with AI woven directly into existing tools.

Context

Grammarly's transition from a rules-based to an AI-powered engine predates the generative-AI era, positioning it well in the current AI landscape. The company's focus on inference economics and real-time AI integration sets it apart in the competitive AI market. As frontier models converge in capability, the durable advantage may belong to companies that own the point of work, as Superhuman is attempting to do. The unresolved challenge of measuring AI productivity remains a critical issue for the industry.

Topics

Join the discussion

Have a take on this story? Weigh in with our community on Facebook.

💬 Discuss on Facebook →