AI is accelerating the pace of change, and it's not your imagination

AI's rapid adoption and cost impacts redefine tech progress with unprecedented speed.

: Mary Meeker's latest report reveals that AI adoption is happening at an unprecedented pace, faster than any previous technological revolution. Her data shows ChatGPT hit 800 million users in just 17 months and that inference costs dropped by 99% over two years. The developing competition among companies, especially with open-source models from China, is intense and rapidly reducing costs. However, while AI's pace is unmatched, financial profitability for companies remains uncertain.

Mary Meeker, known as the 'Queen of the Internet,' returns to the spotlight with her comprehensive report titled 'Trends — Artificial Intelligence.' Her findings emphasize the unprecedented speed of AI adoption, development, and application. In particular, Meeker highlights the impressive growth of ChatGPT, which reached 800 million users within just 17 months—a testament to the swift embrace of AI technologies by the public.

The report underscores the significant cost reductions seen in AI usage. While training a model might cost up to $1 billion, the expense for using AI systems, like paying for inference processes, has radically decreased. In fact, the per-token cost has dropped by 99% over two years, according to research from Stanford. This trend suggests that while AI development might be resource-intensive, the usage of the technology becomes increasingly accessible and affordable.

AI's momentum is further fueled by intense competition among tech giants and startups worldwide. Companies are not only keeping pace with technological advancements but are also surpassing previous benchmarks in energy efficiency. For example, Nvidia's 2024 Blackwell GPU is noted for using 105,000 times less energy per token compared to its 2014 predecessor, the Kepler GPU. Meanwhile, Google and Amazon are rapidly scaling their respective AI chips, the TPU and Trainium, to bolster their cloud service capabilities.

However, Meeker points out that financial returns from AI have not yet matched the pace of its technological innovations. Venture capital firms continue to invest heavily in AI, but the industry's substantial infrastructure investment demands present a challenge. There is uncertainty around which companies will ultimately emerge as long-term, profitable leaders in this burgeoning field.

AI's swift advancements benefit consumers and enterprises by driving rapid improvements and cost reductions. But as Meeker aptly puts it, determining which AI aspirants will achieve financial success remains a matter for the future. The global race for AI dominance is relentless, and while technological feats are realized at unprecedented speed, the economic landscape is still taking shape.

Sources: Economic Times, Stanford, TechCrunch, Dealroom