Ola CEO Bhavish Aggarwal on Tuesday announced a significant breakthrough in improving Krutrim, his AI venture, notably reducing its “time to first ticket” (TTFT) from 22 seconds at launch to a swift 0.3 seconds.
What Happened: Aggarwal revealed this update on the social platform X, promising to elaborate on these advancements in a detailed blog post later in the week.
TTFT measures how quickly an AI model responds with its first word after receiving a prompt. Factors such as model complexity, the operating hardware, and the intricacy of the input prompt influence this speed, indicating the model’s efficiency.
See also: Apple Considers Murugappa Group Or Titan For Assembling iPhone Camera Modules In India
Aggarwal, who likes to keep his followers informed of Krutrim-related improvements, shared on Saturday that the AI model now hosts itself on its own cloud infrastructure, moving away from third-party providers like AWS or Azure. This shift is part of broader enhancements to both the model and its infrastructure.
Ola has also partnered with Intel, using its Gaudi 2 clusters to enhance Krutrim’s generative capabilities across ten languages, achieving leading price-performance ratios. Currently, Krutrim is developing a larger foundational model on this advanced Intel hardware, aiming to expand its AI functionalities further.
Read next: Zomato Customer Gets Non-Veg Food During Navratri, Platform Responds To ‘Big Mix Up'
Don't miss a beat on the share market. Get real-time updates on top stock movers and trading ideas on Benzinga India Telegram channel.
© 2024 Benzinga.com. Benzinga does not provide investment advice. All rights reserved.