Goto

Collaborating Authors

 current affair


ParamBench: A Graduate-Level Benchmark for Evaluating LLM Understanding on Indic Subjects

arXiv.org Artificial Intelligence

Large language models have been widely evaluated on tasks such as comprehension, summarization, code generation, etc. However, their performance on graduate-level, culturally grounded questions in the Indian context remains largely unexplored. Existing Indian benchmarks emphasise basic fact-orientated queries that offer limited assessment of a deeper disciplinary understanding tailored to the Indian setting. In this paper, we present ParamBench, consisting of more than 17K questions in the Hindi language, comprising questionnaires from 21 diverse subjects. These questions are primarily derived from a nationwide graduate-level entrance examination covering topics such as history, music, instruments, yoga, literature, philosophy, law, etc.~ specifically for the Indian context. Additionally, we assess the ability of LLMs to handle diverse question formats - such as list-based matching, assertion-reason pairs, and sequence ordering - alongside conventional multiple-choice questions. We evaluated the performance of more than 16 open source LLMs on this benchmark, observing that Gemma3-27B attains the highest overall accuracy of 56.4\%. Furthermore, subject-wise analysis indicates that even for the best-performing LLMs, performance remains weak on topics such as music, classical instruments, and law, underscoring persistent challenges in culturally grounded reasoning. The dataset and source code is present at https://github.com/ayushbits/ParamBench.


AI chatbots distort and mislead when asked about current affairs, BBC finds

The Guardian

Leading artificial intelligence assistants create distortions, factual inaccuracies and misleading content in response to questions about news and current affairs, research has found. More than half of the AI-generated answers provided by ChatGPT, Copilot, Gemini and Perplexity were judged to have "significant issues", according to the study by the BBC. The errors included stating that Rishi Sunak was still the prime minister and that Nicola Sturgeon was still Scotland's first minister; misrepresenting NHS advice about vaping; and mistaking opinions and archive material for up-to-date facts. The researchers asked the four generative AI tools to answer 100 questions using BBC articles as a source. The answers were then rated by BBC journalists who specialise in the relevant subject areas.


What Will Artificial Intelligence Do To Us? Current Affairs

#artificialintelligence

Will artificial intelligence soon outsmart human beings, and if so, what will become of us? The great computer scientist Alan Turing argued in the early 1950s that we were probably going to see our intellectual capacities surpassed by computers sooner or later. He thought it was probable "that at the end of the [20th] century it will be possible to program a machine to answer questions in such a way that it will be extremely difficult to guess whether the answers are being given by a man or by the machine." "Machines can be constructed," he said, "which will simulate the behavior of the human mind very closely" because "if it is accepted that real brains, as found in animals, and particularly in men, are a sort of machine it will follow that our digital computer, suitably programmed, will behave like a brain." Other early AI pioneers anticipated even more rapid developments. Herbert Simon thought in 1965 that "machines will be capable, within twenty years, of doing any work a man can do," and Marvin Minsky said two years later that it would only take a "generation" to "solve" the problem of artificial intelligence. Things have taken a bit longer than that, and theorists in the field of AI have become somewhat notorious for making promises that we might call "Friedmanesque." But there are still those who think we have reason to fear that AI will surpass human intelligence in the near future, and, in fact, that an AI-driven cataclysm may be coming. Elon Musk--who, it should be noted, does not have a good track record when it comes to predicting the future--has warned that "robots will be able to do everything better than us," and "if AI has a goal and humanity just happens to be in the way, it will destroy humanity as a matter of course without even thinking about it." He is not alone in spinning apocalyptic stories about a coming "superintelligence" that could literally exterminate the entire human race.


What is Artificial Intelligence, Deep Learning& Machine Learning? - Ohio News Time

#artificialintelligence

Nowadays, most people are quite familiar with terms like Artificial Intelligence, Deep Learning, and Machine Learning but the majority of people do not know the actual difference between these terms. You might have heard of these terms before, but you might wonder what they are, and the real differences between all three of them? The main objective of this article is to spread knowledge about technologies like artificial intelligence, deep learning, and machine learning so that you can easily differentiate between these terms and learn how to use such technologies to enhance your productivity. In this article, you will also learn how the Internet of Things is related to artificial intelligence and what other technologies are emerging in the upcoming years. Before we discuss the following technologies, it is worth mentioning that to incorporate them in your personal or professional life; you will need a high-speed internet connection that can easily power all the latest technological equipment without any interruption.


Chinese state news agency unveils 'the world's first 3D AI anchor'

#artificialintelligence

China's state news agency has revealed its first 3D AI-powered news anchor after replicating the looks and the actions of a human journalist with cutting-edge technologies. The virtual female presenter, branded as the world's first of its kind, can move around smoothly and display complex facial expressions. She can even change her outfits and hairstyles according to different scenarios, a spokesperson said. Beijing's state media has revealed'the world's first 3D AI news anchor' today after'cloning' a human reporter with cutting edge technologies. The virtual female presenter, branded as the world's first of its kind, can move around smoothly and display complex facial expressions The uncanny avatar (pictured), named Xin Xiaowei, was developed by Xinhua along with Sogou, a Chinese technology company specialising in web search.


Questions on artificial intelligence in UPSC CSE Main, more focus on analytical skills

#artificialintelligence

The Union Public Service Commission (UPSC) Civil Services Main exam started Friday and will continue till September 29. Based on the feedback of students and experts, the recruitment exam is believed to be easier than last year. Several are of the opinion that the 2017 pattern has made a comeback after undergoing slight changes in 2018. "In the essay paper, UPSC is back to questions on current affairs in one section and philosophical topics in the other. So, it is a good mix that tests your skills for writing both kinds of essays. This is almost the template that UPSC followed until 2017, and it is back to it in 2019. The candidates would have felt confident seeing the topics, particularly after the extremely difficult topics in 2018," said Pulkit Sachdeva, co-founder, SleepyClasses, a UPSC preparation platform.


Beware fake IDs! Artificial Intelligence can now spot fake online reviews

#artificialintelligence

Nowadays, you see a lot of user reviews of products and services on sites such as TripAdvisor, Yelp and Amazon. Most of the people read these peer reviews and trust what they see without knowing that not all of them are legitimate. Some of the reviews are fake. In fact, up to 40 per cent of users decide to make a purchase based on only a couple of reviews and great reviews make people spend 30 per cent more on their purchases. To combat this, an artificial intelligence (AI) system has been developed by the scientists that can identify machine-generated fake reviews on online e-commerce websites.


Tate Britain's new AI finds art in current affairs

#artificialintelligence

Stare across the gallery of the Tate Britain at a Turner and you bring with you a quiet murmur of experiences โ€“ a family holiday, an orgasm, that morning's news. What you see works in co-ordination with echoes. But what does a computer see? What does it think when it looks at a Turner? Recognition, the winner of the Tate's IK Prize 2016 for digital innovation, asks โ€“ and answers โ€“ some of these questions. Made up of multiple artificial-intelligence technologies, Recognition makes use of object recognition, facial recognition and composition analysis to pull up-to-the-minute photojournalism from Reuters, then trawls through Tate Britain's vast collection to plonk a comparable picture beside it.