Goto

Collaborating Authors

 sanyal


How Green are Neural Language Models? Analyzing Energy Consumption in Text Summarization Fine-tuning

Rehman, Tohida, Sanyal, Debarshi Kumar, Chattopadhyay, Samiran

arXiv.org Artificial Intelligence

Artificial intelligence systems significantly impact the environment, particularly in natural language processing (NLP) tasks. These tasks often require extensive computational resources to train deep neural networks, including large-scale language models containing billions of parameters. This study analyzes the trade-offs between energy consumption and performance across three neural language models: two pre-trained models (T5-base and BART-base), and one large language model (LLaMA 3-8B). These models were fine-tuned for the text summarization task, focusing on generating research paper highlights that encapsulate the core themes of each paper. A wide range of evaluation metrics, including ROUGE, METEOR, MoverScore, BERTScore, and SciBERTScore, were employed to assess their performance. Furthermore, the carbon footprint associated with fine-tuning each model was measured, offering a comprehensive assessment of their environmental impact. This research underscores the importance of incorporating environmental considerations into the design and implementation of neural language models and calls for the advancement of energy-efficient AI methodologies.


National Digital Library of India

Communications of the ACM

The National Digital Library of India was conceptualized with an aim to bring equity of access to educational resources for every Indian through a single window access mechanism.


A Primer To Explainable and Interpretable Deep Learning

#artificialintelligence

One of the biggest challenges in the data science industry is the Black Box Debate and the lack of trust in the algorithm. In the talk titled "Explainable and Interpretable Deep Learning" during the DevCon 2021, Dipyaman Sanyal, Head, Academics & Learning at Hero Vired, discusses the developing solution for the black box problem. Dipyaman Sanyal's educational background consists of an MS and a PhD in Economics. His career only becomes more colourful, with his current title being the co-founder of Drop Math. In his 15 year career, he has been awarded several honours, including 40 under 40 in India in Data Science in 2019.


Three ways for insurers to stay resilient through COVID-19

#artificialintelligence

A good example of hyper-personalisation – and one that has garnered lots of attention throughout the coronavirus pandemic – is usage-based insurance (UBI), particularly in the auto insurance industry. When governments started ordering lockdowns and social distancing to prevent spread of the virus, the number of drivers on the road reduced dramatically. As such, many insurers offered premium rebates to reflect reduced vehicle usage, which could be seen as a version of UBI. "Virtualisation of all technology services and solution delivery, including an increased consumption of cloud-based services [is also key]," Sanyal added. "Pre-pandemic, most insurers were already pursuing a digital strategy. COVID-19 has not only accelerated this journey, but has also compressed the timeframe. What would have taken months and years is now taking days and weeks. The question is no longer: 'Should we?' It's more: 'How should we, and what should we do?' "On the other hand, there's another set of dynamics that are taking place in certain lines.


Artificial Intelligence Makes Inroads into LT/PAC

#artificialintelligence

An executive working in the artificial intelligence (AI) space, Shourjya Sanyal, PhD, chief executive officer of Think Biosolution, said the rapid aging of the worldwide population is opening the door to the use of AI to help care for people with chronic diseases as health care delivery adapts to increased demands. In an article written for Forbes magazine, he noted the number of people aged 80 years and older will rise from the current 14.5 percent of the U.S. population (65 and older) to more than 20 percent by 2030, with similar patterns seen across most of the rest of the Western world. As a result, health care delivery pathways "need to be readjusted, keeping in mind the prevalence of chronic diseases, comorbidities and polypharmacy requirements of the elderly and geriatric patients." There are also specific diseases related to this age cohort as well, like atherosclerosis, osteoporosis, cardiovascular diseases, obesity, diabetes, dementia, and osteoarthritis that require "quick diagnosis and continuous supervision by a professional caregiver." Added to the mix is the growing shortage of physicians and caregivers, Sanyal said.