Organization Science· 2026Q1
Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality
- 218citations
- Q1SCImago
- 2026year
Short summary
AI, specifically GPT-4, improved knowledge worker performance by 12.2% in task completion and 25.1% in speed on tasks within its capabilities, but decreased accuracy by 19% on a complex task outside its frontier.
AI-generated from the title and abstract; the full text is not read.
Key points
- AI (GPT-4) improved knowledge worker performance by 12.2% in task completion and 25.1% in speed on tasks within its capabilities.
- AI assistance led to significantly improved solution quality on tasks within the AI frontier.
- For a complex managerial task outside the AI frontier, AI users were 19% less likely to produce correct solutions.
- The study introduces the "jagged technology frontier" concept to describe AI's uneven impact on different tasks.
AI-generated from the title and abstract; the full text is not read.
Abstract
We introduce and study the concept of a “jagged technology frontier” to describe the uneven impact of artificial intelligence (AI) capabilities, where AI assistance improves performance for some tasks but worsens it for others, even within the same knowledge workflow and with a seemingly similar level of difficulty. In collaboration with the global management consulting firm Boston Consulting Group, we have developed realistic management consulting tasks and examined the human performance implications of using AI to perform complex and knowledge-intensive work. The preregistered experiment involved 758 knowledge workers. After establishing a performance baseline on similar tasks, subjects were randomly assigned to one of three conditions: no AI access, GPT-4 AI access, or GPT-4 AI access with a prompt engineering overview. For each one of a set of 18 realistic knowledge tasks within the frontier of AI capabilities ranging from creative to analytical tasks, subjects using AI outperformed those not using AI, completing 12.2% more tasks and completing them 25.1% more quickly on average while also delivering solutions of significantly improved quality. However, for a complex managerial task selected to be outside the frontier, subjects using AI were 19% less likely to produce correct solutions compared with those without AI, pointing to potential limitations of AI supporting knowledge workers. We discuss the positive and negative implications of AI-aided human performance in knowledge-intensive tasks. Funding: Financial support of the Harvard Business School Digital Data Design Institute and Division of Research and Faculty Development is acknowledged. Supplemental Material: The online appendix is available at https://doi.org/10.1287/orsc.2025.21838 .
The authors' abstract, as published at the source. Organization Science, 2026 · DOI ↗
Continue with a free account
Ask the paper: 3 free questions a day about this paper; save it, get its citation, new summaries every day for your field. Takeaways are Premium.
Continue free on the webSign in with Google or Apple; no card needed. You come back to this paper.
On your phone:
Field: Artificial Intelligence Information Systems and Management
Information Systems and ManagementDecision SciencesArtificial Intelligence