Goto

Collaborating Authors

 electronic engineering


TMIQ: Quantifying Test and Measurement Domain Intelligence in Large Language Models

arXiv.org Artificial Intelligence

The Test and Measurement domain, known for its strict requirements for accuracy and efficiency, is increasingly adopting Generative AI technologies to enhance the performance of data analysis, automation, and decision-making processes. Among these, Large Language Models (LLMs) show significant promise for advancing automation and precision in testing. However, the evaluation of LLMs in this specialized area remains insufficiently explored. To address this gap, we introduce the Test and Measurement Intelligence Quotient (TMIQ), a benchmark designed to quantitatively assess LLMs across a wide range of electronic engineering tasks. TMIQ offers a comprehensive set of scenarios and metrics for detailed evaluation, including SCPI command matching accuracy, ranked response evaluation, Chain-of-Thought Reasoning (CoT), and the impact of output formatting variations required by LLMs on performance. In testing various LLMs, our findings indicate varying levels of proficiency, with exact SCPI command match accuracy ranging from around 56% to 73%, and ranked matching first-position scores achieving around 33% for the best-performing model. We also assess token usage, cost-efficiency, and response times, identifying trade-offs between accuracy and operational efficiency. Additionally, we present a command-line interface (CLI) tool that enables users to generate datasets using the same methodology, allowing for tailored assessments of LLMs. TMIQ and the CLI tool provide a rigorous, reproducible means of evaluating LLMs for production environments, facilitating continuous monitoring and identifying strengths and areas for improvement, and driving innovation in their selections for applications within the Test and Measurement industry.


Overview of AI and Communication for 6G Network: Fundamentals, Challenges, and Future Research Opportunities

arXiv.org Artificial Intelligence

With the growing demand for seamless connectivity and intelligent communication, the integration of artificial intelligence (AI) and sixth-generation (6G) communication networks has emerged as a transformative paradigm. By embedding AI capabilities across various network layers, this integration enables optimized resource allocation, improved efficiency, and enhanced system robust performance, particularly in intricate and dynamic environments. This paper presents a comprehensive overview of AI and communication for 6G networks, with a focus on emphasizing their foundational principles, inherent challenges, and future research opportunities. We first review the integration of AI and communications in the context of 6G, exploring the driving factors behind incorporating AI into wireless communications, as well as the vision for the convergence of AI and 6G. The discourse then transitions to a detailed exposition of the envisioned integration of AI within 6G networks, delineated across three progressive developmental stages. The first stage, AI for Network, focuses on employing AI to augment network performance, optimize efficiency, and enhance user service experiences. The second stage, Network for AI, highlights the role of the network in facilitating and buttressing AI operations and presents key enabling technologies, such as digital twins for AI and semantic communication. In the final stage, AI as a Service, it is anticipated that future 6G networks will innately provide AI functions as services, supporting application scenarios like immersive communication and intelligent industrial robots. In addition, we conduct an in-depth analysis of the critical challenges faced by the integration of AI and communications in 6G. Finally, we outline promising future research opportunities that are expected to drive the development and refinement of AI and 6G communications.


Super-resolution imaging using super-oscillatory diffractive neural networks

arXiv.org Artificial Intelligence

The Abbe-Rayleigh diffraction limit of traditional optical equipment has always been an obstacle to the study of micro-/nano-scale objects [1, 2]. Near-field microscopic imaging techniques, such as contact photography [3] and scanning near-field imaging (SNOM) [4, 5], capture evanescent fields by placing a probe or light-sensitive material extremely close to the object to achieve nanoscale resolution, which is not possible for imaging inside biological samples or encapsulated micro-/nano-structures. Far-field microscopic imaging technology is not restricted by the above bottlenecks. Some typical far-field microscopic imaging techniques, such as single-molecule localization (SML) microscopy [6, 7] or stimulated emission depletion (STED) [8, 9], have demonstrated the possibility of nanoscale imaging without capturing evanescent fields. However, SML microscopy and STED typically require intense beams to excite, deplete, or bleach fluorophores in a sample that produces photobleaching and phototoxicity in living samples. Optical super-oscillations are rapid sub-wavelength spatial variations of light intensity and phase that occur in complex electromagnetic fields formed by the precise interference of coherent waves, which provide an advanced method for far-field super-resolution imaging beyond the diffraction limit [10, 11]. To generate optical super-oscillation, the complicated lens design methods [12-14] or Fresnel zone plate (FZP) optimization design methods, including optimizing algorithms [15-18] or optimization-free algorithms [19, 20], have been proposed.


Bangladeshi Native Vehicle Detection in Wild

arXiv.org Artificial Intelligence

The success of autonomous navigation relies on robust and precise vehicle recognition, hindered by the scarcity of region-specific vehicle detection datasets, impeding the development of context-aware systems. To advance terrestrial object detection research, this paper proposes a native vehicle detection dataset for the most commonly appeared vehicle classes in Bangladesh. 17 distinct vehicle classes have been taken into account, with fully annotated 81542 instances of 17326 images. Each image width is set to at least 1280px. The dataset's average vehicle bounding box-to-image ratio is 4.7036. This Bangladesh Native Vehicle Dataset (BNVD) has accounted for several geographical, illumination, variety of vehicle sizes, and orientations to be more robust on surprised scenarios. In the context of examining the BNVD dataset, this work provides a thorough assessment with four successive You Only Look Once (YOLO) models, namely YOLO v5, v6, v7, and v8. These dataset's effectiveness is methodically evaluated and contrasted with other vehicle datasets already in use. The BNVD dataset exhibits mean average precision(mAP) at 50% intersection over union (IoU) is 0.848 corresponding precision and recall values of 0.841 and 0.774. The research findings indicate a mAP of 0.643 at an IoU range of 0.5 to 0.95. The experiments show that the BNVD dataset serves as a reliable representation of vehicle distribution and presents considerable complexities.


Academic and Research

#artificialintelligence

Applications are invited for a new prestigious DeepMind Academic Fellow in Machine Learning at Queen Mary University of London. Following a recent donation to the University from DeepMind, this three-year Fellowship is created to provide an opportunity for an excellent early career researcher in the fields of Computer Science and/or Machine Learning/ Artificial Intelligence to further their research and prepare for a full academic role within a supportive environment. The ideal candidate will have completed a PhD in a relevant field (or expect to have completed by this September) and have clear and ambitious plans for their future research, alongside the enthusiasm to act as a role model for Black researchers of the future. We particularly encourage applications from those who are in under-represented groups, and particularly those who identify as Black, as Black staff are under-represented at this level within the School of Electronic Engineering and Computer Science at Queen Mary. The Fellowship will be research-focused and the successful candidate will be allocated a research studentship to support outputs.


First Woman Director At MIT CS AI Lab: "Want More Women In STEM? Inspire Them Early."

#artificialintelligence

We decide on our careers long before we ever step foot in our workplace. We take cues from our family and dramatized media depictions of professionals who often look and act nothing like their real-life counterparts. Therefore, to solve the gender inequality in technical roles, we need to kickstart our efforts in college or even high school – when students are open-minded, and there is still time to make real change. Because later in life, for every dollar men earn – women earn 81 cents. One woman trailblazing change is Professor Daniela Rus, the first woman director of the Massachusetts Institute of Technology's Computer Science Artificial Intelligence Lab, or MIT CSAIL for short.


FPGA Arithmetic for Machine Learning

#artificialintelligence

Applications are invited for a PhD studentship, to be undertaken at Imperial College London (Electrical and Electronic Engineering Department). This studentship will form part of a newly established International Centre for Spatial Computational Learning http://spatialml.net, and a supervisory team will be allocated based on the student's interest from the Imperial College supervisors participating in the Centre. This is an exciting cutting-edge project involving close collaboration between Imperial College (UK), the University of California Los Angeles (USA), the University of Toronto (Canada), and the University of Southampton (UK). The successful candidate will be based at Imperial but will have the opportunity to travel frequently to America to attend research meetings and for a placement period at either UCLA or Toronto. Traditional deep learning has been based on the idea of large-scale linear arithmetic units, effectively computing matrix-matrix multiplication, combined with nonlinear activation functions.