ChatGPT failed in India's biggest competitive exam UPSC and JEE

author-image
Anshu DV Vaishnav
Updated On

One of India's toughest competitive exams reportedly saw failure for OpenAI's chatbot ChatGPT. A report claims that ChatGPT failed the Indian Civil Services Examination, which is known as one of the most difficult in the world and is administered by the Union Public Service Commission (UPSC).

Almost 10 lakh aspirants from all over India attempt the UPSC exams each year. One of the most difficult exams in the world is the civil service examination in India. Only 5% of the 10–12 lakh applicants are selected for the UPSC Mains.

Also Read: TOP 10 UFC hottest girls in 2023

Analytics India Magazine’s Experiment: Will ChatGPT Pass the UPSC Exam?

Bengaluru-based Analytics India Magazine was put to the test with Civil Service Exam-style questions covering a wide range of subjects, such as Geography, Economics, History, Ecology, General Science, and current affairs.

ChatGPT failed in India's biggest competitive exam UPSC and JEE

The fact is that all 100 of the questions on Question Paper 1 (Set A) from the UPSC Prelims 2022 have answers online on the web, ChatGPT was only able to answer 54 of them correctly.

On its page, ChatGPT makes it clear that its knowledge is limited to September 2021 hence, it won’t be able to answer questions on current affairs.

Also Read: Varanasi Airport को बम से उड़ाने की मिली धमकी, एयरपोर्ट प्रबंधन और सुरक्षा एजेंसियां सतर्क

According to the magazine, ChatGPT gave inaccurate answers for topics like geography and the economy that didn't always need time-sensitive information. The publication also claimed that ChatGPT misrepresented even a simple and basic history-related topic. It appears like ChatGPT created some of its own alternatives in some cases.

ChatGPT on passing UPSC exam

Incidentally, ChatGPT did acknowledge that it may not be able to attempt the prelim exam for UPSC. When asked: Do you think you can pass the prelim exam for UPSC? The chatbot replied: "As an Al language model, I do possess a vast amount of knowledge and information, including about the UPS examination and related topics. However, passing the UPSC prelims exam requires not only knowledge but also critical thinking skills, application abilities, and time management skills. Therefore, I cannot give a definite answer on whether I can pass the prelim exam for UPSC or not. Nonetheless, I can provide you with relevant information and guidance regarding the exam and related topics to the best of my abilities."

ChatGPT failed in India's biggest competitive exam UPSC and JEE

Toughest exam in india Exam Competitive exam ChatGPT #UPSC JEE