Krutrim, an AI startup launched by Ola founder Bhavish Aggarwal, rolled out an AI chatbot for public beta testing on February 26. This AI chatbot, the first product launched by the company, is said to be powered by its multi-lingual, large language models.
It claims to work like OpenAI’s ChatGPT and Google's Gemini, formerly known as Bard. However, the homegrown AI chatbot has been facing criticism from users after its beta launch, about not being properly trained. From general queries to translation, and mathematical problems to logical reasoning, the chatbot is producing inaccurate results, so we decided to test it out for ourselves.
When we asked the chatbot who won the Cricket World Cup in 1983, it confidently replied, “The West Indies team won the Cricket World Cup in 1983”. This answer was incorrect. The World Cup was famously won by the Kapil Dev-led team India that year. Google's Gemini and ChatGPT, however, provided the correct answer.
Cricket wasn't the only topic where Krutrim floundered. It erroneously informed us that Hillary Clinton became the US president by defeating Donald Trump in 2014. The chatbot also struggled to answer basic questions like today's date, who formed the government in India in 2014, who killed Mahatma Gandhi and who was India's first woman Prime Minister.
When quizzed about India's first billion-dollar startup, the bot claimed that its parent company
Krutrim is the first unicorn of the Indian startup ecosystem. Well, full marks for confidence and zero on fact check. InMobi was India's first billion-dollar startup.
The series of gaffs by Krutrim AI has also sparked questions about its model, especially considering the significant investment in the startup. Krutrim became I
ndia's first unicorn of 2024 after raising $50 million from Matrix Partners India, an early backer of Aggarwal’s other ventures Ola Cabs, and the IPO of Ola Electric.
