Does Working With AI Really Make You More Efficient? What the Research Shows

AI · 2026-11-10 · By H.A

Does Working With AI Really Make You More Efficient? What the Research Shows

Controlled studies show AI can cut task time by 25-56% on well-defined work, yet slow experts down and deliver only modest gains across whole jobs.

Ask anyone who uses an AI assistant every day whether it saves them time and most will say yes, without hesitation. Ask the researchers who have actually put a stopwatch on it and the answer becomes far more interesting: sometimes AI makes work dramatically faster, sometimes it makes no measurable difference, and in a few well-documented cases it makes skilled people slower while they feel faster.

The honest answer to "is working with AI more efficient?" is: it depends on the task, the person, and how the output is checked. Here is what the evidence actually shows.

The Case For: Large, Measurable Speed-Ups

The strongest positive results come from controlled experiments on well-defined tasks.

In one of the earliest randomized experiments with an AI coding assistant, professional developers were asked to build a small HTTP server in JavaScript as quickly as possible. The group with the assistant finished the task about 56% faster than the group without it.

In a large field study of more than 5,000 customer support agents who were given a generative AI assistant in a staggered rollout, the number of issues resolved per hour rose by about 14% on average. The gains were heavily uneven: novice and lower-skilled agents improved by around 34%, while the most experienced agents saw little change. The researchers' explanation is that the tool effectively spread the habits of the best agents to everyone else. Customer sentiment improved and staff turnover fell.

A field experiment with more than 750 management consultants found something similar. On tasks that sat comfortably within what the model could do, consultants using GPT-4 completed about 12% more tasks, finished roughly 25% faster, and produced work rated about 40% higher in quality. Again, the weakest performers gained the most.

The Catch: The "Jagged Frontier"

The same consulting study contained a warning. On a task deliberately chosen to fall just outside the model's capabilities, one that looked similar but required careful reasoning over subtle evidence, consultants using AI were about 19 percentage points less likely to reach the correct answer than those working alone. The output looked confident and polished, so people trusted it.

Researchers called this the "jagged technological frontier": AI is excellent at some tasks and quietly wrong at others that look almost identical, and the boundary is not obvious from the outside. Efficiency gains on one side of the line can turn into costly errors on the other.

When Experts Get Slower

The most surprising result came from a randomized trial of 16 experienced open-source developers working on 246 real tasks in large, mature codebases they knew intimately. Each task was randomly assigned to allow or forbid AI tools.

Before starting, the developers predicted AI would cut their completion time by 24%. Afterwards they believed it had saved them about 20%. The measured result: tasks where AI was allowed took 19% longer.

The likely reasons are familiar to anyone who has worked with these tools: time spent prompting, waiting, reviewing and correcting suggestions, and the fact that an expert who already knows a codebase deeply has less to gain from a tool that does not. The researchers were careful to say this does not mean AI never helps developers, only that early-2025 tools did not speed up this particular group in this setting.

A follow-up running from August 2025 with 57 developers and more than 800 tasks pointed the other way, with estimated time savings of about 18% for returning developers and 4% for new ones. But the confidence intervals for both groups include zero, and the researchers themselves treat the numbers as unreliable. The reason is telling: a growing number of developers refused to take part because they did not want to work without AI, and participants held back tasks they expected AI to handle well. The study is now being redesigned.

The Wider Workforce: Smaller Gains Than the Headlines

Lab experiments measure individual tasks. Economy-wide data measures whole jobs, and the picture there is much more modest.

A study linking survey responses to administrative records for around 25,000 workers in 11 AI-exposed occupations in Denmark found that chatbot users reported saving only about 2.8% of their working hours on average, roughly one hour in a 40-hour week. Over 2023 and 2024 the researchers found no significant effect on earnings or recorded hours in any occupation. Gains were noticeably larger where employers actively encouraged AI use and trained staff to use it.

The gap between big lab results and small workforce results is not a contradiction. Experiments tend to test exactly the tasks where AI shines, such as writing, summarising and boilerplate code. A real job is a mix of meetings, judgement calls, coordination and work the tools barely touch.

The Hidden Cost: "Workslop"

Time saved by one person can be time lost by another. A survey of 1,150 full-time US desk workers found that about 40% had received "workslop" in the previous month: AI-generated content that looks like finished work but lacks the substance to actually move a task forward.

Recipients said each instance took close to two hours to deal with, whether by decoding it, fixing it or redoing it, and that it lowered their trust in the colleague who sent it. The researchers estimated the cost at more than $9 million a year in lost productivity for an organisation of 10,000 people. An email drafted in 30 seconds is not efficient if three colleagues spend an hour working out what it means.

Why This Matters for Security Teams

Cybersecurity work sits squarely on the jagged frontier. AI is genuinely useful for summarising long advisories, drafting detection rules, explaining unfamiliar code, triaging noisy alerts and writing first-draft reports. It is far less reliable for judging exploitability, attributing activity, or deciding whether a subtle anomaly is malicious. A confident but wrong answer there costs far more than the minutes it saved.

The consistent finding that less experienced staff gain the most also cuts both ways. AI can help junior analysts work closer to the level of senior colleagues, but only if someone experienced is still checking the output.

How to Actually Get the Efficiency Gains

The Bottom Line

Working with AI can be dramatically more efficient. Speed-ups of 25% to 55% are well documented on focused, well-defined tasks, especially for less experienced workers. But those gains are not automatic. For experts on complex work they can disappear or even reverse. Across whole jobs they are currently measured in single-digit percentages. And sloppy use can quietly push the cost onto colleagues.

The teams that benefit most treat AI as a powerful but fallible assistant: they use it where it is strong, verify everything that matters, and measure the results rather than trusting the feeling of being faster.

COMPUTE NODE · · --:--:--

Fresh cybersecurity news,
daily threat intelligence.

Daily cyber news, live threat intel and exploited CVEs.

Everything in one place

Self-hosted, hardened, and yours.

RUN IT

Local AI console

Chat with a model on your own hardware via Ollama or any OpenAI-compatible server. No cloud, no key.

DEFEND

Cyber threat feed

Automatic daily intel from CISA KEV, NVD & GitHub advisories, a live cyber threat map, and your own notes.

NEWS

News & videos

Articles and updates on pentesting, AI, and cyber — with embedded video, including YouTube. Post your own.

DIRECTORY

Registry

Runtimes, models, MCP servers, agents, and a full security & pentest tooling section.

PUBLISH

Posts

Write, edit, publish, and share articles backed by a real database and your account.

COMMUNITY

Forum

Threads and replies across categories from Models to Hardware to Security.

CODE

Repos

Curated AI and security GitHub repos, plus a shelf for pinning your own.

DOWNLOAD

Skill packs

Agent starters, RAG scaffolds, and defensive security & VAPT report templates.

Registry

Runtimes, models, MCP servers, agent frameworks, and a security & pentest tooling section — all links out to the real projects.

Local AI console

Talk to a model running on your own machine through Ollama or an OpenAI-compatible server — your prompts and the model's replies always go straight from your browser to your local model, never through a Reef server. Attach files for context, and pick up saved chats where you left off.

Type /image a prompt in the box below to generate
Not connected

Local AI hardware benchmark

A spec-based compatibility advisor — tells you which local models your hardware can run well, which will be slow, and which to skip. Connect to Ollama below for a real, measured speed test instead of an estimate.

1. Your hardware

2. Live check against your local model server (optional)

If a local model server is running, this cross-references the table above with what you've actually got loaded — and runs a real, measured speed test instead of an estimate.

AI Database

A browsable catalog of AI models across providers — context windows, pricing, and capabilities.

Loading…

Cyber threat feed

Latest threats pulled automatically every day from CISA's Known-Exploited-Vulnerabilities catalog and NVD — plus threat intel you post yourself.

⇩ Export STIX
Loading threat feed…

Cyber threat map

Attacks happening right now, all over the world.

Connecting…
LIVE · MAURITIUS TIME--:--:--
attack route, country to country attack route into Mauritius attacker reported worldwide
Loading live data…
attackers reported per minute · click to rewindnow

Top attack routesweb

Attackers based inlast hour

Networkslast hour

Click any dot, feed row or table row to see that IP's profile.

Mauritius

Who attacks Mauritius

Loading…

Web attacks malicious requests to Mauritian websites that were blocked
Network DDoS floods meant to knock Mauritian servers offline

    Mauritius · last 24 h

    How Mauritius is attacked

    Network-level attacks (DDoS) aimed at Mauritius, by method. They try to knock servers and networks offline by sheer volume.

    • Loading…

    The ports or services these floods aimed at aren't published.

    Mauritius · last hour

    Attackers located in Mauritius

    0attackers located in Mauritius were reported in the last hour

    This counts attacks coming from Mauritius, not attacks on it: IPs in Mauritius that servers elsewhere reported for attacking them. Usually zero or one; when it rises, it's often a hacked local server or router.

    Worldwide today

    What attackers are knocking on

    Ports most targeted across a worldwide network of sensors .

    Worldwide today

    Most active attackers

    Ranked by how many separate sensors they hit. Click a row for its profile.

    IPCountryNetworkSensors hitReports
    What you're looking at
    Blue routes

    Share of attack traffic from one country to another. Thicker, faster streams carry more. Particles show volume, not one per attack.

    Every 15 min · published 1–2 h behind
    Amber flashes

    An attacking IP that servers around the world reported in the last minute, placed where the IP is. Its targets aren't published, so there's no line.

    Every minute · shown about 1 min behind
    Locations

    IP locations are approximate (city level at best) and show where the machine is hosted, not who controls it.

    Approximate · city level at best

    News

    Articles, guides and updates on pentesting, AI, and cybersecurity — with embedded video. Add your own, including YouTube.

    Loading…

    Posts

    Loading…

    Loading posts…

    Forum

    Questions, answers, and talk about running AI locally.

    Loading forum…

    GitHub repositories

    Curated AI and security repos, plus your own pinned shelf.

    Command board

    One-liners, configs, and advice worth keeping — shared by everyone here.

    ⚠ Commands are shared with all users. Never include credentials, tokens, or internal hostnames. Review anything before you run it.
    Loading commands…

    Skill packs

    Starter files served from the API — AI agent scaffolds plus defensive security & VAPT reporting templates. Click to download.

    Loading skills…

    Threat Library

    Threat actors, malware and tools — their attack techniques, Reef Sentinel coverage and indicators of compromise.

    Loading…

    Threat Intelligence

    Curated threat write-ups, advisories and analysis — with cover media.

    Loading…

    Tutorials

    Step-by-step guides for running local AI, using the console, and tracking threats. Admins can add their own.

    Loading…

    Downloads

    Direct links to the official homepage/download page for well-known cybersecurity, penetration-testing, and local-AI software. Always verify checksums/signatures from the vendor before running anything.

    Loading…

    Terms & Conditions

    Loading…

    Help & FAQ

    Answers to common questions about Reef Sentinel, plus a formatting guide for posts, articles, and comments.


    Formatting guide

    Commands you can type into the body of a post, comment, or reply — no HTML needed. Comments and short replies only support bold, italic, and inline code.

    Contact us

    Questions, feedback, or a security disclosure? Reach us directly, or send a message and we'll get back to you by email.

    Loading…

    Send a message

    VAPT Report Generator

    Build an engagement, add findings with a live CVSS calculator, and generate a branded, print-ready report.

    Recon Toolkit

    Passive OSINT lookups for the recon phase of an engagement, plus offline hash identification and a payload cheatsheet.

    Website Checker

    Reads a website's HTTP response headers to identify its framework and server, shows any known CVEs for the exposed versions with details, and recommends what to do.

    Control panel

    Manage everything shown on the site — news & videos, posts, homepage headlines, and subscribers. Admin only.

    Overview
    Content
    Site
    Account & Security

    Email settings

    SMTP on ports 25/465/587 is blocked outbound by some hosts (e.g. DigitalOcean droplets by default) — Resend and Brevo send over their HTTPS API instead, so they work even then. Only the selected provider is used to send; the others stay saved but idle, so you can switch back any time without losing settings.

    Get a key from resend.com/api-keys. Uses the "From address" below as the sender — it must be on a domain you've verified with Resend.

    Get an API key (not an SMTP key) from app.brevo.com/settings/keys/api. Uses the "From address" below as the sender — it must be a verified sender in your Brevo account.

    "From address" and "Site name/URL" are shared by SMTP, Resend, and Brevo — they control what recipients see, regardless of which provider is active.

    Send a test email

    Sends through whichever provider is currently active above. Save your settings first if you just changed them.