AI’s Limits Exposed: New Study Finds Machines Struggle With Real Remote Work
Research shows AI agents fail most remote tasks, with top performer automating just 2.5% of freelance work.
The study, called the Remote Labor Index (RLI), represents one of the most detailed attempts so far to measure AI’s performance on practical digital work.
It focuses on tasks that mirror real online freelancing jobs rather than theoretical tests or benchmark problems.
- Researchers collected 240 completed projects from professional freelancers working through platforms such as Upwork.
- Each project included the original brief, all input materials, and the final deliverable that a client had accepted.
- These projects came from 23 categories of work, including product design, animation, architecture, game development, and data analysis.
- Together they covered more than 6,000 hours of paid labor valued at about $140,000.
Six advanced AI agents were then tested on the same projects.
- The systems included Manus, Grok 4, Sonnet 4.5, GPT-5, ChatGPT agent, and Gemini 2.5 Pro.
AI agents fail most remote tasks.
Author's summary: AI struggles with remote work tasks.
More News
- An Instant Classic, the 2025 World Series Was a Huge Win for MLB
- techUK’s Autumn 2025 Budget submission
- How former Vancouver Canadians performed for the Blue Jays in the World Series
- Steve García demolishes a lifeless David Onama with a first-round finish at UFC Vegas 110
- Milei comes up trumps
- Can the World Health Organization still be the World’s health conscience? - 2 | A house built on donor sand
- Can the World Health Organization still be the World’s health conscience? -1 | The cracks in global trust
- The wildest fight in UFC history: Cortés-Acosta goes from being finished to finishing Ante Delija
- Why Millie Bobby Brown Accused Her 'Reel-Dad'? Did Netflix Launch An Inquiry Against David Harbour?