Expert Systems
QuarkMed Medical Foundation Model Technical Report
Li, Ao, Yan, Bin, Cai, Bingfeng, Li, Chenxi, Zhao, Cunzhong, Yao, Fugen, Liu, Gaoqiang, Jiang, Guanjun, Xu, Jian, Dong, Liang, Sun, Liansheng, Zhang, Rongshen, Gui, Xiaolei, Liu, Xin, Shang, Xin, Wu, Yao, Cao, Yu, Ma, Zhenxin, Jia, Zhuang
Recent advancements in large language models have significantly accelerated their adoption in healthcare applications, including AI-powered medical consultations, diagnostic report assistance, and medical search tools. However, medical tasks often demand highly specialized knowledge, professional accuracy, and customization capabilities, necessitating a robust and reliable foundation model. QuarkMed addresses these needs by leveraging curated medical data processing, medical-content Retrieval-Augmented Generation (RAG), and a large-scale, verifiable reinforcement learning pipeline to develop a high-performance medical foundation model. The model achieved 70% accuracy on the Chinese Medical Licensing Examination, demonstrating strong generalization across diverse medical benchmarks. QuarkMed offers a powerful yet versatile personal medical AI solution, already serving over millions of users at ai.quark.cn.
LD-RPMNet: Near-Sensor Diagnosis for Railway Point Machines
Li, Wei, Wu, Xiaochun, Hu, Xiaoxi, Zhang, Yuxuan, Bader, Sebastian, Huang, Yuhan
Near-sensor diagnosis has become increasingly prevalent in industry. This study proposes a lightweight model named LD-RPMNet that integrates Transformers and Convolutional Neural Networks, leveraging both local and global feature extraction to optimize computational efficiency for a practical railway application. The LD-RPMNet introduces a Multi-scale Depthwise Separable Convolution (MDSC) module, which decomposes cross-channel convolutions into pointwise and depthwise convolutions while employing multi-scale kernels to enhance feature extraction. Meanwhile, a Broadcast Self-Attention (BSA) mechanism is incorporated to simplify complex matrix multiplications and improve computational efficiency. Experimental results based on collected sound signals during the operation of railway point machines demonstrate that the optimized model reduces parameter count and computational complexity by 50% while improving diagnostic accuracy by nearly 3%, ultimately achieving an accuracy of 98.86%. This demonstrates the possibility of near-sensor fault diagnosis applications in railway point machines.