idar
CIDAR: Culturally Relevant Instruction Dataset For Arabic
Alyafeai, Zaid, Almubarak, Khalid, Ashraf, Ahmed, Alnuhait, Deema, Alshahrani, Saied, Abdulrahman, Gubran A. Q., Ahmed, Gamil, Gawah, Qais, Saleh, Zead, Ghaleb, Mustafa, Ali, Yousef, Al-Shaibani, Maged S.
Instruction tuning has emerged as a prominent methodology for teaching Large Language Models (LLMs) to follow instructions. However, current instruction datasets predominantly cater to English or are derived from English-dominated LLMs, resulting in inherent biases toward Western culture. This bias significantly impacts the linguistic structures of non-English languages such as Arabic, which has a distinct grammar reflective of the diverse cultures across the Arab region. This paper addresses this limitation by introducing CIDAR: https://hf.co/datasets/arbml/CIDAR, the first open Arabic instruction-tuning dataset culturally-aligned by human reviewers. CIDAR contains 10,000 instruction and output pairs that represent the Arab region. We discuss the cultural relevance of CIDAR via the analysis and comparison to other models fine-tuned on other datasets. Our experiments show that CIDAR can help enrich research efforts in aligning LLMs with the Arabic culture. All the code is available at https://github.com/ARBML/CIDAR.
- Africa > Sudan (0.14)
- North America > Canada > Ontario > Toronto (0.04)
- Asia > Singapore (0.04)
- (26 more...)
- Consumer Products & Services (0.67)
- Information Technology (0.46)
- Education (0.46)
- Information Technology > Artificial Intelligence > Natural Language > Machine Translation (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.71)
Advance in perception and motion planning for autonomous vehicles Electric Vehicles Research
AEye Inc has introduced iDAR, a new form of intelligent data collection that enables rapid, dynamic perception and path planning. AEye's iDAR is designed to intelligently prioritize and interrogate co-located pixels (2D) and voxels (3D) within a frame, enabling the system to target and identify objects within a scene 10-20x more effectively than LiDAR-only products. Additionally, iDAR is capable of overlaying 2D images on 3D point clouds for the creation of True Color LiDAR. Its embedded AI capabilities enable iDAR to utilize thousands of existing and custom computer vision algorithms, which add intelligence that can be leveraged by path planning software. The introduction of iDAR follows AEye's September demonstration of the first 360 degree, vehicle-mounted, solid-state LiDAR system with ranges up to 300 meters at high resolution.
- Transportation > Ground > Road (1.00)
- Transportation > Electric Vehicle (0.85)