Large Language Model
UltraMedical: Building Specialized Generalists in Biomedicine
Exploring how to build open-source, GPT-4-level LLMs in the field of biomedicine is underway.
R: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning Shirley Wu
Current approaches have primarily focused on directly deploying agents using complex human-designed "mega-prompts" [
Learning 1D Causal Visual Representation with De-focus Attention Networks Chenxin Tao
While images typically require 2D non-causal modeling, texts utilize 1D causal modeling.
Understanding the Expressive Power and Mechanisms of Transformer for Sequence Modeling
Our study reveals the roles of critical parameters in the Transformer, such as the number of layers and the number of attention heads.
AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation
Pre-trained vision-language models (VLMs) have shown impressive results in various visual classification tasks.
