Goto

Collaborating Authors

 artificial intelligence review


PEFT A2Z: Parameter-Efficient Fine-Tuning Survey for Large Language and Vision Models

Prottasha, Nusrat Jahan, Chowdhury, Upama Roy, Mohanto, Shetu, Nuzhat, Tasfia, Sami, Abdullah As, Ali, Md Shamol, Sobuj, Md Shohanur Islam, Raman, Hafijur, Kowsher, Md, Garibay, Ozlem Ozmen

arXiv.org Artificial Intelligence

Large models such as Large Language Models (LLMs) and Vision Language Models (VLMs) have transformed artificial intelligence, powering applications in natural language processing, computer vision, and multimodal learning. However, fully fine-tuning these models remains expensive, requiring extensive computational resources, memory, and task-specific data. Parameter-Efficient Fine-Tuning (PEFT) has emerged as a promising solution that allows adapting large models to downstream tasks by updating only a small portion of parameters. This survey presents a comprehensive overview of PEFT techniques, focusing on their motivations, design principles, and effectiveness. We begin by analyzing the resource and accessibility challenges posed by traditional fine-tuning and highlight key issues, such as overfitting, catastrophic forgetting, and parameter inefficiency. We then introduce a structured taxonomy of PEFT methods -- grouped into additive, selective, reparameterized, hybrid, and unified frameworks -- and systematically compare their mechanisms and trade-offs. Beyond taxonomy, we explore the impact of PEFT across diverse domains, including language, vision, and generative modeling, showing how these techniques offer strong performance with lower resource costs. We also discuss important open challenges in scalability, interpretability, and robustness, and suggest future directions such as federated learning, domain adaptation, and theoretical grounding. Our goal is to provide a unified understanding of PEFT and its growing role in enabling practical, efficient, and sustainable use of large models.


A Comprehensive Review of Recommender Systems: Transitioning from Theory to Practice

Raza, Shaina, Rahman, Mizanur, Kamawal, Safiullah, Toroghi, Armin, Raval, Ananya, Navah, Farshad, Kazemeini, Amirmohammad

arXiv.org Artificial Intelligence

Recommender Systems (RS) play an integral role in enhancing user experiences by providing personalized item suggestions. This survey reviews the progress in RS inclusively from 2017 to 2024, effectively connecting theoretical advances with practical applications. We explore the development from traditional RS techniques like content-based and collaborative filtering to advanced methods involving deep learning, graph-based models, reinforcement learning, and large language models. We also discuss specialized systems such as context-aware, review-based, and fairness-aware RS. The primary goal of this survey is to bridge theory with practice. It addresses challenges across various sectors, including e-commerce, healthcare, and finance, emphasizing the need for scalable, real-time, and trustworthy solutions. Through this survey, we promote stronger partnerships between academic research and industry practices. The insights offered by this survey aim to guide industry professionals in optimizing RS deployment and to inspire future research directions, especially in addressing emerging technological and societal trends


Matrix-based fast granularity reduction algorithm of multi-granulation rough set - Artificial Intelligence Review

#artificialintelligence

In order to overcome the limitation of low efficiency of existing granularity reduction algorithms in multi-granulation rough sets, based on matrix method, a fast granularity reduction algorithm is proposed and the time complexity is \(O({ U } {2} \cdot A U \cdot { A } {2})\). First, the definitions of positive region matrix and granularity column matrix of multi-granulation space are proposed. Second, through the quantity product of these two matrices, the definition of positive region column matrix is presented. Based on the positive region column matrix, cut matrix and matrix norm are defined, respectively. Third, the matrix-based calculation methods of multi-granulation approximation quality and granularity significance are proposed.


Survey on aspect detection for aspect-based sentiment analysis - Artificial Intelligence Review

#artificialintelligence

Sentiment analysis is an important tool to automatically understand the user-generated content on the Web. The most fine-grained sentiment analysis is concerned with the extraction and sentiment classification of aspects and has been extensively studied in recent years. In this work, we provide an overview of the first step in aspect-based sentiment analysis that assumes the extraction of opinion targets or aspects. We define a taxonomy for the extraction of aspects and present the most relevant works accordingly, with a focus on the most recent state-of-the-art methods. The three main classes we use to classify the methods designed for the detection of aspects are pattern-based, machine learning, and deep learning methods.


Video description: A comprehensive survey of deep learning approaches - Artificial Intelligence Review

#artificialintelligence

Video description refers to understanding visual content and transforming that acquired understanding into automatic textual narration. Deep learning-based approaches employed for video description have demonstrated enhanced results compared to conventional approaches. The current literature lacks a thorough interpretation of the recently developed and employed sequence to sequence techniques for video description. This paper fills that gap by focusing mainly on deep learning-enabled approaches to automatic caption generation. Sequence to sequence models follow an Encoder–Decoder architecture employing a specific composition of CNN, RNN, or the variants LSTM or GRU as an encoder and decoder block.


Vision-based techniques for automatic marine plankton classification - Artificial Intelligence Review

#artificialintelligence

Plankton are an important component of life on Earth. Since the 19th century, scientists have attempted to quantify species distributions using many techniques, such as direct counting, sizing, and classification with microscopes. Since then, extraordinary work has been performed regarding the development of plankton imaging systems, producing a massive backlog of images that await classification. Automatic image processing and classification approaches are opening new avenues for avoiding time-consuming manual procedures. While some algorithms have been adapted from many other applications for use with plankton, other exciting techniques have been developed exclusively for this issue.


Time series forecasting using fuzzy cognitive maps: a survey - Artificial Intelligence Review

#artificialintelligence

Among various soft computing approaches for time series forecasting, fuzzy cognitive maps (FCMs) have shown remarkable results as a tool to model and analyze the dynamics of complex systems. FCMs have similarities to recurrent neural networks and can be classified as a neuro-fuzzy method. In other words, FCMs are a mixture of fuzzy logic, neural network, and expert system aspects, which act as a powerful tool for simulating and studying the dynamic behavior of complex systems. The most interesting features are knowledge interpretability, dynamic characteristics and learning capability. The goal of this survey paper is mainly to present an overview on the most relevant and recent FCM-based time series forecasting models proposed in the literature.


Greedy opposition-based learning for chimp optimization algorithm - Artificial Intelligence Review

#artificialintelligence

The chimp optimization algorithm (ChOA) is a hunting-based model and can be utilized as a set of optimization rules to tackle optimization problems. Although ChOA has shown promising results on optimization functions, it suffers from a slow convergence rate and low exploration capability. Therefore, in this paper, a modified ChOA is proposed to improve the exploration and exploitation capabilities of the ChOA. This improvement is performed using greedy search and opposition-based learning (OBL), respectively. In order to investigate the efficiency of the OBLChOA, the OBLChOA's performance is evaluated by twenty-three standard benchmark functions, ten suit tests of IEEE CEC06-2019, randomly generated landscape, and twelve real-world Constrained Optimization Problems (IEEE COPs-2020) from a variety of engineering fields, including industrial chemical producer, power system, process design and synthesis, mechanical design, power-electronic, and livestock feed ration.


Artificial intelligence for template-free protein structure prediction: a comprehensive review - Artificial Intelligence Review

#artificialintelligence

Protein structure prediction (PSP) is a grand challenge in bioinformatics, drug discovery, and related fields. PSP is computationally challenging because of an astronomically large conformational space to be searched and an unknown very complex energy function to be minimised. To obtain a given protein's structure, template-based PSP approaches adopt a similar protein's known structure, while template-free PSP approaches work when no similar protein's structure is known. Currently, proteins with known structures are greatly outnumbered by proteins with unknown structures. Template-free PSP has obtained significant progress recently via machine learning and search-based optimisation approaches.


A review of redundancy allocation problem for two decades: bibliometrics and future directions - Artificial Intelligence Review

#artificialintelligence

Redundancy allocation problem (RAP) has attracted many researchers in recent years as it is very important aspect in the field of reliability and system engineering. It plays an important role in high-tech industries. Present paper conducts a comprehensive literature review to classify, analyze and intercept the existing studies related to the RAP with respect to different systems, system configuration, methodology, constraints. The previous literature related to the RAP problems have been invested by the researchers such as Tillman in 1980, Kuo in 2007 and Soltani from 2000 to 2014. The objective of this paper is to cover the study over the past two decades starting from 2000.

  Genre: Overview (0.64)