‘Reasoning’ AI models have become a trend, for better or worse
AI labs develop costly 'reasoning' models, facing skepticism and resource demands.
AI labs have ushered in a surge of 'reasoning' models, inspired by OpenAI's o1, which promises advanced problem-solving capabilities. Despite initial excitement, experts like Ameet Talwalkar are cautious, highlighting that while these models show promise, their future impact is uncertain due to financial motives driving optimistic projections.
High costs and resource-intensive operations are key challenges for reasoning models. OpenAI's platforms reflect this, with services like o1 Pro Mode priced at $2,400 annually, significantly more than non-reasoning models. This is primarily due to the additional power required for these AI models to self-assess as they function, prolonging problem-solving time frames.
The viability of current reasoning models remains contentious, as exemplified by Costa Huang's observation of their limited domain performance and errors in recent models like o1 Pro Mode. Supporters believe advances will come with time, driven by investment in AI research. However, experts like Talwalkar express concerns that secrecy within major labs could hinder broader research community engagement and innovation.