ChatGPT fails UPSC Exam: Popular AI bot ChatGPT has failed the UPSC Prelims exam. ChatGPT could answer only 54 out of 100 questions correctly. The cut off for the UPSC 2022 exam was 87.54.
ChatGPT fails the UPSC Exam: Details
Popular AI chatbot ChatGPT, which cleared the University of Pennsylvania's Wharton School MBA Final Exams, has failed in qualifying the Indian Civil Services Examinations (CSE) conducted by the Union Public Service Commission (UPSC). UPSC is considered to be one of the toughest exams in the world and when the chatbot ChatGPT was asked whether it would pass the UPSC Prelims exam, it replied that it could not give a definite answer.
ChatGPT only scored 54 out of 100, while the cut off for the UPSC 2022 exam was 87.54. A Bengaluru based magazine, Analytics India Magazine, subjected ChatGPT to the UPSC Prelims exam.
"We at Analytics India Magazine have also been experimenting with ChatGPT for a while and were intrigued by its ability to crack tough exams and interviews. In that spirit, we wondered, ‘Can ChatGPT clear the UPSC?’," said the magazine about the test. It asked ChatGPT all the 100 questions from Question Paper 1 (Set A) from the UPSC Prelims 2022, the answers to which are available on the web. The ChatGPT chatbot could answer only 54 of them correctly.
ChatGPT has a clear disclaimer on its page that says that its knowledge is limited to September 2021, hence, it won’t be able to answer questions on current events.
The Analytics India Magazine stated, "ChatGPT's knowledge is limited to September 2021, hence, it won't be able to answer questions on current events. However, ChatGPT provided wrong answers for topics such as Economy and Geography that are not necessarily time-specific."
