Multi-Method Analysis of Mathematics Placement Assessments: Classical, Machine Learning, and Clustering Approaches
Allagan, Julian D., Singleton, Dasia A., Perry, Shanae N., Morgan, Gabrielle C., Morgan, Essence A.
–arXiv.org Artificial Intelligence
This study evaluates a 40-item mathematics placement examination administered to 198 students using a multi-method framework combining Classical Test Theory, machine learning, and unsupervised clustering. Classical Test Theory analysis reveals that 55\% of items achieve excellent discrimination ($D \geq 0.40$) while 30\% demonstrate poor discrimination ($D < 0.20$) requiring replacement. Question 6 (Graph Interpretation) emerges as the examination's most powerful discriminator, achieving perfect discrimination ($D = 1.000$), highest ANOVA F-statistic ($F = 4609.1$), and maximum Random Forest feature importance (0.206), accounting for 20.6\% of predictive power. Machine learning algorithms demonstrate exceptional performance, with Random Forest and Gradient Boosting achieving 97.5\% and 96.0\% cross-validation accuracy. K-means clustering identifies a natural binary competency structure with a boundary at 42.5\%, diverging from the institutional threshold of 55\% and suggesting potential overclassification into remedial categories. The two-cluster solution exhibits exceptional stability (bootstrap ARI = 0.855) with perfect lower-cluster purity. Convergent evidence across methods supports specific refinements: replace poorly discriminating items, implement a two-stage assessment, and integrate Random Forest predictions with transparency mechanisms. These findings demonstrate that multi-method integration provides a robust empirical foundation for evidence-based mathematics placement optimization.
arXiv.org Artificial Intelligence
Nov-7-2025
- Country:
- Asia > Taiwan
- Taiwan Province > Taipei (0.04)
- North America > United States
- California > Los Angeles County
- Long Beach (0.04)
- District of Columbia > Washington (0.04)
- Florida > Palm Beach County
- Boca Raton (0.04)
- Massachusetts
- Middlesex County
- Suffolk County > Boston (0.04)
- New Jersey > Bergen County
- Mahwah (0.04)
- New York > New York County
- New York City (0.04)
- North Carolina > Pasquotank County
- Elizabeth City (0.04)
- California > Los Angeles County
- Asia > Taiwan
- Genre:
- Instructional Material > Course Syllabus & Notes (0.93)
- Research Report > New Finding (1.00)
- Industry:
- Education
- Assessment & Standards (0.68)
- Curriculum > Subject-Specific Education (0.94)
- Education
- Technology: