OpenAI chairman Bret Taylor predicts that companies will stop worrying about AI tokens within a year, focusing instead on paying for outcomes. He believes the AI market is still maturing, and entrepreneurs will develop solutions to manage token costs.
TL;DR
- OpenAI chairman Bret Taylor predicts companies will stop worrying about AI tokens within a year.
- Taylor believes the AI market is still maturing and entrepreneurs will develop solutions to manage token costs.
What happened
OpenAI chairman Bret Taylor said on CNBC that companies will soon stop worrying about AI tokens, focusing instead on paying for outcomes. He believes the AI market is still maturing, and entrepreneurs will develop solutions to manage token costs.
Taylor compared the current AI market to the early days of the internet, when building a website was more expensive. He expects IT departments to become sophisticated about industrial applications of AI within a year.
Taylor mentioned Ramp's token spend tool and legal startup Harvey as examples of companies managing tokens for their customers. He also noted that token costs are expected to come down over time as AI models become more efficient.
Why it matters
This shift could significantly impact AI startups and developers, as they may no longer need to focus on token management. Instead, they can concentrate on delivering outcomes and improving ROI.
For investors, this prediction suggests a potential shift in the AI market towards outcome-based pricing models. This could open up new opportunities for startups developing solutions that manage token costs and improve efficiency.
However, Taylor noted that the jury is still out on whether newer, more efficient models like Kimi K3 from Chinese startup Moonshot will indeed be cheaper to use. This uncertainty could impact investment decisions in the short term.
Key facts
- Bret Taylor is the chairman of OpenAI and founder of AI startup Sierra.
- Taylor made his predictions during an appearance on CNBC.
- He believes the AI market is still maturing and entrepreneurs will develop solutions to manage token costs.
- Taylor expects IT departments to become sophisticated about industrial applications of AI within a year.
- He mentioned Ramp's token spend tool and legal startup Harvey as examples of companies managing tokens for their customers.
- Token costs are expected to come down over time as AI models become more efficient.
- Kimi K3, a model released by Chinese startup Moonshot, grabbed Silicon Valley's attention by rivaling the capabilities of powerful models from OpenAI and Anthropic at a lower cost.
- Taylor noted that the jury is still out on whether newer, more efficient models will indeed be cheaper to use.
Context
AI tokens are units of text that AI models process, used to calculate AI usage and cost. Earlier this year, spiraling token costs prompted companies to rein in their AI spending and assess whether they were getting a return on investment.
The shift towards paying for outcomes instead of tokens echoes the views of other executives who are now prioritizing ROI. This trend could significantly impact the AI industry, as companies focus more on the results they achieve with AI rather than the cost of processing tokens.
