GitHub and Microsoft's AI Scanner Cut 9,791 Findings to 99 Verified Reports: 55 Vulnerabilities Fixed in Caddy, ImageMagick, Express, Netty, FastMCP and AutoGPT

AI · 2026-11-18 · By H.A

GitHub and Microsoft's AI Scanner Cut 9,791 Findings to 99 Verified Reports: 55 Vulnerabilities Fixed in Caddy, ImageMagick, Express, Netty, FastMCP and AutoGPT

A GitHub–Microsoft pilot used the MDASH AI scanner, a triage agent and human verification to send six open-source projects 99 private, patch-ready reports, and 55 flaws are now fixed.

GitHub and Microsoft have published the results of a pilot that used an AI scanner on six widely used open-source projects. Unlike most AI bug-hunting campaigns, it did not leave maintainers with a pile of raw findings. Of 9,791 candidate issues, only 99 verified reports reached the maintainers, each with a proof of concept and a suggested fix. By 15 November, 55 of those flaws had been fixed and 14 fixes had already shipped in releases.

The six projects were AutoGPT, Caddy, Express, FastMCP, ImageMagick and Netty. Together they sit under a large share of modern web servers, Node.js applications, Java network stacks, image pipelines and AI agent tooling.

What Happened

GitHub announced the results on 17 November, the same day Microsoft introduced MAI Cyber 2 Flash, a new security model, at its Ignite conference. GitHub's title sums up the pilot's message: maintainers don't need more AI bug reports, they need fixes.

All six projects are alumni of the GitHub Secure Open Source Fund and agreed to be scanned. Maintainers kept full control over what to fix, how and when. GitHub says the first fixes shipped about a week after the first scan.

How the Pipeline Worked

The pilot ran in five stages, each narrowing the output of the one before:

That works out to roughly one report for every 100 raw findings. GitHub's point is that triage should be done by whoever sends the report, not by the volunteer who receives it.

What the Maintainers Saw

GitHub shared each project's experience:

GitHub did not publish the individual vulnerabilities, CVE IDs or advisory IDs behind the 55 fixes. It also did not break down their severity.

Why It Matters

Open-source maintainers are dealing with a flood of AI-generated security reports. Many are duplicates, misreadings of the threat model, or "vulnerabilities" that cannot actually be exploited. Every one still takes a volunteer's time to read and reject.

The pilot argues that the fix is a higher bar for the sender, not a ban on AI. GitHub proposes a standard for anyone reporting with AI tools:

The post quotes Log4j maintainer Christian Grobmeier: "AI defending open source has to be better than the AI attacking it." That matters because attackers are using the same capability. AI agents that read patches and write exploits are already being used in real intrusions. Bugs that defenders find and fix first are bugs attackers cannot weaponise.

The Caveats

GitHub is open about what doesn't scale yet:

The sample is also small and self-selected. All six projects are well funded by open-source standards, had security training through the fund, and opted in. Results for a one-person project with no security process could look very different.

What Comes Next

GitHub says it will offer AI security scans to every alumni project of the Secure Open Source Fund. Findings will be checked before private reporting, and alumni also get GitHub Copilot Max. Lessons from the pilot will go into private vulnerability reporting and security advisories. The fund says it has supported 216 projects and more than 300 maintainers so far.

On the scanning side, Microsoft says MAI Cyber 2 Flash will be available only inside its security products, including MDASH. From mid-December it will replace the current model in MDASH's MAI profile for eligible customers. Microsoft reports a 92.3% task success rate on the CyberGym-E2E benchmark after excluding 92 tasks that overlapped with its training data. These are vendor-reported figures and have not been independently reproduced.

What To Do Now

Sources

COMPUTE NODE · · --:--:--

Fresh cybersecurity news,
daily threat intelligence.

Daily cyber news, live threat intel and exploited CVEs.

Everything in one place

Self-hosted, hardened, and yours.

RUN IT

Local AI console

Chat with a model on your own hardware via Ollama or any OpenAI-compatible server. No cloud, no key.

DEFEND

Cyber threat feed

Automatic daily intel from CISA KEV, NVD & GitHub advisories, a live cyber threat map, and your own notes.

NEWS

News & videos

Articles and updates on pentesting, AI, and cyber — with embedded video, including YouTube. Post your own.

DIRECTORY

Registry

Runtimes, models, MCP servers, agents, and a full security & pentest tooling section.

PUBLISH

Posts

Write, edit, publish, and share articles backed by a real database and your account.

COMMUNITY

Forum

Threads and replies across categories from Models to Hardware to Security.

CODE

Repos

Curated AI and security GitHub repos, plus a shelf for pinning your own.

DOWNLOAD

Skill packs

Agent starters, RAG scaffolds, and defensive security & VAPT report templates.

Registry

Runtimes, models, MCP servers, agent frameworks, and a security & pentest tooling section — all links out to the real projects.

Local AI console

Talk to a model running on your own machine through Ollama or an OpenAI-compatible server — your prompts and the model's replies always go straight from your browser to your local model, never through a Reef server. Attach files for context, and pick up saved chats where you left off.

Type /image a prompt in the box below to generate
Not connected

Local AI hardware benchmark

A spec-based compatibility advisor — tells you which local models your hardware can run well, which will be slow, and which to skip. Connect to Ollama below for a real, measured speed test instead of an estimate.

1. Your hardware

2. Live check against your local model server (optional)

If a local model server is running, this cross-references the table above with what you've actually got loaded — and runs a real, measured speed test instead of an estimate.

AI Database

A browsable catalog of AI models across providers — context windows, pricing, and capabilities.

Loading…

Cyber threat feed

Latest threats pulled automatically every day from CISA's Known-Exploited-Vulnerabilities catalog and NVD — plus threat intel you post yourself.

⇩ Export STIX
Loading threat feed…

Cyber threat map

Attacks happening right now, all over the world.

Connecting…
LIVE · MAURITIUS TIME--:--:--
attack route, country to country attack route into Mauritius attacker reported worldwide
Loading live data…
attackers reported per minute · click to rewindnow

Top attack routesweb

Attackers based inlast hour

Networkslast hour

Click any dot, feed row or table row to see that IP's profile.

Mauritius

Who attacks Mauritius

Loading…

Web attacks malicious requests to Mauritian websites that were blocked
Network DDoS floods meant to knock Mauritian servers offline

    Mauritius · last 24 h

    How Mauritius is attacked

    Network-level attacks (DDoS) aimed at Mauritius, by method. They try to knock servers and networks offline by sheer volume.

    • Loading…

    The ports or services these floods aimed at aren't published.

    Mauritius · last hour

    Attackers located in Mauritius

    0attackers located in Mauritius were reported in the last hour

    This counts attacks coming from Mauritius, not attacks on it: IPs in Mauritius that servers elsewhere reported for attacking them. Usually zero or one; when it rises, it's often a hacked local server or router.

    Worldwide today

    What attackers are knocking on

    Ports most targeted across a worldwide network of sensors .

    Worldwide today

    Most active attackers

    Ranked by how many separate sensors they hit. Click a row for its profile.

    IPCountryNetworkSensors hitReports
    What you're looking at
    Blue routes

    Share of attack traffic from one country to another. Thicker, faster streams carry more. Particles show volume, not one per attack.

    Every 15 min · published 1–2 h behind
    Amber flashes

    An attacking IP that servers around the world reported in the last minute, placed where the IP is. Its targets aren't published, so there's no line.

    Every minute · shown about 1 min behind
    Locations

    IP locations are approximate (city level at best) and show where the machine is hosted, not who controls it.

    Approximate · city level at best

    News

    Articles, guides and updates on pentesting, AI, and cybersecurity — with embedded video. Add your own, including YouTube.

    Loading…

    Posts

    Loading…

    Loading posts…

    Forum

    Questions, answers, and talk about running AI locally.

    Loading forum…

    GitHub repositories

    Curated AI and security repos, plus your own pinned shelf.

    Command board

    One-liners, configs, and advice worth keeping — shared by everyone here.

    ⚠ Commands are shared with all users. Never include credentials, tokens, or internal hostnames. Review anything before you run it.
    Loading commands…

    Skill packs

    Starter files served from the API — AI agent scaffolds plus defensive security & VAPT reporting templates. Click to download.

    Loading skills…

    Your watchlist

    Follow threat actors, malware, CVEs and vendors — we tell you when a new report, CVE record or exploitation alert mentions them.

    Threat Library

    Threat actors, malware and tools — their attack techniques, Reef Sentinel coverage and indicators of compromise.

    Loading…

    Threat Intelligence

    Curated threat write-ups, advisories and analysis — with cover media.

    Loading…

    Tutorials

    Step-by-step guides for running local AI, using the console, and tracking threats. Admins can add their own.

    Loading…

    Downloads

    Direct links to the official homepage/download page for well-known cybersecurity, penetration-testing, and local-AI software. Always verify checksums/signatures from the vendor before running anything.

    Loading…

    Privacy Policy

    Loading…

    Terms & Conditions

    Loading…

    Help & FAQ

    Answers to common questions about Reef Sentinel, plus a formatting guide for posts, articles, and comments.


    Formatting guide

    Commands you can type into the body of a post, comment, or reply — no HTML needed. Comments and short replies only support bold, italic, and inline code.

    Contact us

    Questions, feedback, or a security disclosure? Reach us directly, or send a message and we'll get back to you by email.

    Loading…

    Send a message

    VAPT Report Generator

    Build an engagement, add findings with a live CVSS calculator, and generate a branded, print-ready report.

    Recon Toolkit

    Investigate any domain, IP, URL, file hash, email or CVE in one search, plus breach and password checks, hash identification and a payload cheatsheet.

    Outage Monitor

    Is Microsoft 365, Facebook, Google, AWS or ChatGPT down? Live status of the big tech services from their official status pages, every incident with its full timeline, and how long each one took to fix.

    Website Checker

    Reads a website's HTTP response headers to identify its framework and server, shows any known CVEs for the exposed versions with details, and recommends what to do.

    Control panel

    Manage everything shown on the site — news & videos, posts, homepage headlines, and subscribers. Admin only.

    Overview
    Content
    Site
    Account & Security

    Email settings

    SMTP on ports 25/465/587 is blocked outbound by some hosts (e.g. DigitalOcean droplets by default) — Resend and Brevo send over their HTTPS API instead, so they work even then. Only the selected provider is used to send; the others stay saved but idle, so you can switch back any time without losing settings.

    Get a key from resend.com/api-keys. Uses the "From address" below as the sender — it must be on a domain you've verified with Resend.

    Get an API key (not an SMTP key) from app.brevo.com/settings/keys/api. Uses the "From address" below as the sender — it must be a verified sender in your Brevo account.

    "From address" and "Site name/URL" are shared by SMTP, Resend, and Brevo — they control what recipients see, regardless of which provider is active.

    Send a test email

    Sends through whichever provider is currently active above. Save your settings first if you just changed them.

    SIGNAL LOST

    We couldn't find this page

    The page may have been moved or deleted, or the address was mistyped.