One of India’s toughest competitive exams reportedly saw failure for OpenAI’s chatbot ChatGPT. A report claims that ChatGPT failed the Indian Civil Services Examination, which is known as one of the most difficult in the world and is administered by the Union Public Service Commission (UPSC).
Almost 10 lakh aspirants from all over India attempt the UPSC exams each year. One of the most difficult exams in the world is the civil service examination in India. Only 5% of the 10–12 lakh applicants are selected for the UPSC Mains.
Also Read: TOP 10 UFC hottest girls in 2023
Analytics India Magazine’s Experiment: Will ChatGPT Pass the UPSC Exam?
Bengaluru-based Analytics India Magazine was put to the test with Civil Service Exam-style questions covering a wide range of subjects, such as Geography, Economics, History, Ecology, General Science, and current affairs.
Source: Google
“We at Analytics India Magazine have also been experimenting with ChatGPT for a while and were intrigued by its ability to crack tough exams and interviews. In that spirit, we wondered, ‘Can ChatGPT clear UPSC?’,” said the magazine about the test.
The fact is that all 100 of the questions on Question Paper 1 (Set A) from the UPSC Prelims 2022 have answers online on the web, ChatGPT was only able to answer 54 of them correctly.
On its page, ChatGPT makes it clear that its knowledge is limited to September 2021 hence, it won’t be able to answer questions on current affairs.
Also Read: Varanasi Airport को बम से उड़ाने की मिली धमकी, एयरपोर्ट प्रबंधन और सुरक्षा एजेंसियां सतर्क
According to the magazine, ChatGPT gave inaccurate answers for topics like geography and the economy that didn’t always need time-sensitive information. The publication also claimed that ChatGPT misrepresented even a simple and basic history-related topic. It appears like ChatGPT created some of its own alternatives in some cases.
ChatGPT on passing UPSC exam
Incidentally, ChatGPT did acknowledge that it may not be able to attempt the prelim exam for UPSC. When asked: Do you think you can pass the prelim exam for UPSC? The chatbot replied: “As an Al language model, I do possess a vast amount of knowledge and information, including about the UPS examination and related topics. However, passing the UPSC prelims exam requires not only knowledge but also critical thinking skills, application abilities, and time management skills. Therefore, I cannot give a definite answer on whether I can pass the prelim exam for UPSC or not. Nonetheless, I can provide you with relevant information and guidance regarding the exam and related topics to the best of my abilities.”
Source: Physics Wallah
Not the first exam ChatGPT failed
On a recent occasion, a YouTuber asked the chatbot JEE-related questions, but the chatbot was unable to respond with sufficient information. JEE – Joint Entrance Examination, is a test used to determine admission to engineering programmes at IITs and NITs in India. It includes the JEE-Main and JEE-Advanced exams.
Does ChatGPT pass any exam?
ChatGPT may have failed to clear UPSC or JEE but it passed the Wharton exam. Not only this, but the AI bot was also able to crack the law exams at the University of Minnesota.
Also Read: WhatsApp, Spotify, Instagram: How the AI is transforming every app on your phone.