ChatGPT from OpenAI Struggles in Response to Inquiries
In the realm of artificial intelligence, ChatGPT has made significant strides, demonstrating impressive capabilities in various domains. However, when it comes to passing prestigious Indian exams like the JEE Advanced, UPSC, and CLAT, ChatGPT has some limitations.
In the JEE Advanced 2025, AI systems, including ChatGPT, performed exceptionally well, outperforming many students in answering and analyzing exam questions. Yet, the success in these virtual scenarios falls short of the traditional sense of "passing" an exam administered under controlled real-world conditions. The key challenge lies in ChatGPT's inability to excel in real-time problem-solving, especially for complex multi-step mathematics and physics problems.
Similarly, in exams like the UPSC and CLAT, ChatGPT's performance is limited. These exams test not just factual knowledge and problem-solving but also essay writing, critical thinking, and legal reasoning. While ChatGPT can generate well-structured text and explain concepts across many subjects, it lacks human qualities like insight into current affairs nuances, legal interpretation, or ethical judgment. As a result, its answers might lack the depth or context required for these exams, resulting in performance that may not meet passing or competitive thresholds.
Core reasons for these limitations include ChatGPT's role as a generalist language model, its struggle with novel problem-solving steps, ambiguous questions, or questions requiring real-time reasoning and adaptability, and the emphasis on human judgment, ethics, and current events awareness in these exams. Furthermore, exam environments require controlled conditions, time management, and strategic answering techniques, which ChatGPT cannot perform autonomously.
Despite these challenges, ChatGPT has shown remarkable abilities in other areas. For instance, it scored 54 out of 100 on UPSC Prelims 2022 Question Paper 1 (Set A), although it failed the test. In the English and Current Affairs categories, ChatGPT performed exceptionally well. It has also been successful in passing the United States Medical Licensing Test (USMLE) and various MBA exams in the US.
However, ChatGPT has faced criticism and restrictions in some countries. Ulrich Kelber, the German data protection commissioner, has issued a warning that ChatGPT may be subject to a potential ban in Germany due to concerns surrounding the security of users' data. Moreover, ChatGPT has been banned in two major countries, including Germany and Italy, due to concerns about the lack of safeguards to prevent minors from being exposed to offensive material.
In a unique instance, ChatGPT was able to correctly diagnose a dog's condition and save the animal's life. However, its inability to answer all questions is likely due to its data set only extending to 2021. This limitation is particularly evident when questions pertain to historical events that occurred before 2021.
In conclusion, while AI models like ChatGPT have shown strong capabilities in solving and analyzing exam content, passing these prestigious and multi-dimensional Indian exams in an official capacity remains a challenge due to the need for nuanced reasoning, judgment, and exam-taking skills beyond rote knowledge and text generation.
Despite its remarkable achievements in various fields such as coding and technology, the artificial-intelligence-based model ChatGPT faces limitations when it comes to passing prestigious Indian exams like the JEE Advanced, UPSC, and CLAT. This is because these exams test more than just factual knowledge and problem-solving, extending to essay writing, critical thinking, and legal reasoning, areas where ChatGPT lacks the human qualities required.
In the realm of education and self-development, ChatGPT has demonstrated impressive learning capabilities in certain subjects but falls short in others, particularly in complex real-time problem-solving, ethical judgment, and current affairs nuances, topics that are crucial for passing some exams.
