Bhavish Aggarwal Announces Improvement In Krutrim's Response Time To Milliseconds
Take Stock Of The Week Ahead

Get all the latest Share Market trends and news to set you up for the week ahead.

Congratulations!
You have successfully subscribed.

Ola CEO Bhavish Aggarwal on Tuesday announced a significant breakthrough in improving Krutrim, his AI venture, notably reducing its “time to first ticket” (TTFT) from 22 seconds at launch to a swift 0.3 seconds.

What Happened: Aggarwal revealed this update on the social platform X, promising to elaborate on these advancements in a detailed blog post later in the week.

TTFT measures how quickly an AI model responds with its first word after receiving a prompt. Factors such as model complexity, the operating hardware, and the intricacy of the input prompt influence this speed, indicating the model’s efficiency.

See also: Apple Considers Murugappa Group Or Titan For Assembling iPhone Camera Modules In India

Aggarwal, who likes to keep his followers informed of Krutrim-related improvements, shared on Saturday that the AI model now hosts itself on its own cloud infrastructure, moving away from third-party providers like AWS or Azure. This shift is part of broader enhancements to both the model and its infrastructure.

Ola has also partnered with Intel, using its Gaudi 2 clusters to enhance Krutrim’s generative capabilities across ten languages, achieving leading price-performance ratios. Currently, Krutrim is developing a larger foundational model on this advanced Intel hardware, aiming to expand its AI functionalities further.

Read next: Zomato Customer Gets Non-Veg Food During Navratri, Platform Responds To ‘Big Mix Up'

Don't miss a beat on the share market. Get real-time updates on top stock movers and trading ideas on Benzinga India Telegram channel.

Comments
Loading...
Techartificial intelligenceBhavish AggarwalKrutrim