Is AI the better programming partner? Human-Human Pair Programming vs. Human-AI pAIr Programming
Ma, Qianou, Wu, Tongshuang, Koedinger, Kenneth
–arXiv.org Artificial Intelligence
The emergence of large-language models (LLMs) that excel at code generation and commercial products such as GitHub's Copilot has sparked interest in human-AI pair programming (referred to as "pAIr programming") where an AI system collaborates with a human programmer. While traditional pair programming between humans has been extensively studied, it remains uncertain whether its findings can be applied to human-AI pair programming. We compare human-human and human-AI pair programming, exploring their similarities and differences in interaction, measures, benefits, and challenges. We find that the effectiveness of both approaches is mixed in the literature (though the measures used for pAIr programming are not as comprehensive). We summarize moderating factors on the success of human-human pair programming, which provides opportunities for pAIr programming research. For example, mismatched expertise makes pair programming less productive, therefore well-designed AI programming assistants may adapt to differences in expertise levels.
arXiv.org Artificial Intelligence
Jun-8-2023
- Country:
- Oceania
- New Zealand > North Island
- Auckland Region > Auckland (0.04)
- Australia > New South Wales
- Sydney (0.04)
- New Zealand > North Island
- North America
- United States
- Hawaii (0.04)
- Kentucky (0.04)
- Texas > Travis County
- Austin (0.04)
- Pennsylvania > Allegheny County
- Pittsburgh (0.04)
- North Carolina > Mecklenburg County
- Charlotte (0.04)
- New York > New York County
- New York City (0.05)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- California > San Diego County
- San Diego (0.04)
- Canada > Ontario
- Toronto (0.04)
- United States
- Europe
- Switzerland > Zürich
- Zürich (0.04)
- Spain > Galicia
- Madrid (0.04)
- Germany > Rhineland-Palatinate
- Kaiserslautern (0.04)
- Denmark > Central Jutland
- Aarhus (0.04)
- Switzerland > Zürich
- Asia
- Oceania
- Genre:
- Research Report
- Experimental Study (0.46)
- New Finding (0.46)
- Research Report
- Industry:
- Education (1.00)
- Technology: