A Qualitative Study of User Perception of M365 AI Copilot
Bano, Muneera, Zowghi, Didar, Whittle, Jon, Zhu, Liming, Reeson, Andrew, Martin, Rob, Parson, Jen
–arXiv.org Artificial Intelligence
Adopting AI copilots in professional workflows presents opportunities for enhanced productivity, efficiency, and decision making. In this paper, we present results from a six month trial of M365 Copilot conducted at our organisation in 2024. A qualitative interview study was carried out with 27 participants. The study explored user perceptions of M365 Copilot's effectiveness, productivity impact, evolving expectations, ethical concerns, and overall satisfaction. Initial enthusiasm for the tool was met with mixed post trial experiences. While some users found M365 Copilot beneficial for tasks such as email coaching, meeting summaries, and content retrieval, others reported unmet expectations in areas requiring deeper contextual understanding, reasoning, and integration with existing workflows. Ethical concerns were a recurring theme, with users highlighting issues related to data privacy, transparency, and AI bias. While M365 Copilot demonstrated value in specific operational areas, its broader impact remained constrained by usability limitations and the need for human oversight to validate AI generated outputs.
arXiv.org Artificial Intelligence
Mar-22-2025
- Country:
- North America > United States
- Virginia (0.04)
- Oceania > Australia
- Australian Capital Territory > Canberra (0.04)
- North America > United States
- Genre:
- Personal > Interview (0.93)
- Research Report
- Experimental Study (1.00)
- New Finding (1.00)
- Industry:
- Education (1.00)
- Government (1.00)
- Health & Medicine (0.93)
- Information Technology > Security & Privacy (1.00)
- Law (0.93)
- Technology:
- Information Technology
- Artificial Intelligence
- Applied AI (1.00)
- Issues > Social & Ethical Issues (1.00)
- Machine Learning > Neural Networks
- Deep Learning (1.00)
- Natural Language
- Chatbot (1.00)
- Large Language Model (1.00)
- Representation & Reasoning (1.00)
- Security & Privacy (1.00)
- Artificial Intelligence
- Information Technology