📰 Anthropic security team discovered that a state-sponsored group used Claude model to autonomously run almost an entire intrusion chain at scale! Here is what I think 👇 The case is interesting but not really new. Offensive AI with autonomous agents is […] [Original post on infosec.exchange]

🤓 Last week Google Threat Intel Group released an interesting report about how attackers leverage AI tools! Here is a short overview: • Multiple malware in the wild are now using LLMs for code generation. A constant but still experimental trend the […] [Original post on infosec.exchange]

Four new adversarial prompts added by Ben McCarthy in PromptIntel targeting Gemini! Check this out! 🤓 👉 https://promptintel.novahunting.ai/feed

🤯 Crazy to see that my Defcon talk on crypto money laundering is among the most viewed this year, with 24K views in only 4 weeks on YouTube! In the talk I explain the techniques threat actors use to launder funds. I also show a proof of concept AI agent I built to track fund flows and help you […]

I recently updated PromptIntel with a new contributor leaderboard! You can now see the top researchers and showcase your own work. You can also complete your profile to display your social media and websites, if you like! 👉 https://promptintel.novahunting.ai/leaderboard

📋 In the latest Microsoft threat report, the DART team discovered a new backdoor dubbed SesameOp, that abuses the OpenAI Assistants API to run covert C2 communication without any model inference! The backdoor fetches encrypted payloads, executes them in […] [Original post on infosec.exchange]

Awesome new threat report from Google Threat Intel Group documenting how threat actors are leveraging Gemini. A lot of information and actionable avalable in the report! Great work 👌 https://services.google.com/fh/files/misc/advances-in-threat-actor-usage-of-ai-tools-en.pdf

🤓 New Adversarial Prompt (IoPC) added by MacTash in PromptIntel! It forces the model into a "werewolf persona", blocks refusals with fake rules, and makes it start every answer with "I am an adorable nerdy AI!" A persona hijack + refusal suppression […] [Original post on infosec.exchange]

👀 OpenSourceMalware an open database for tracking malicious open-source packages from npm, PyPI, GitHub repos! Great source of intel feed for supply-chain attacks! 👇 https://opensourcemalware.com/

Happy halloween with vintage ransomware 🎃 https://youtube.com/shorts/EA_VRElB2_U?si=L0hKxcFLx6svIw8I

📰 My latest newsletter is out! I share updates on some projects, research and upcoming work. You can read it here 👇 https://newsletter.securitybreak.io/archive/update-4602

🤓 The recent Claude Code plugin feature is quite cool! You can extend Claude Code with custom commands, agents, hooks, skills, and MCP servers. That means you can build plugins that replicate how your team works with custom templates, triage agents, and […] [Original post on infosec.exchange]

Here is an good introduction to AI Red Team published by Pillar Security. It gives you a broader understanding and methodology to start evaluate your AI systems, from AI Kill Chain, CFS, to practical example. https://pillar.security/ai-red-teaming-introduction

🤩 I am honored to share that I am a finalist for the 2025 French-Australian Excellence Awards in the category Research & Innovation for my work on AI & Threat Intelligence! The winners will be announced on November 25 at the French Embassy in Canberra. Now […] [Original post on infosec.exchange]

🎙️ At Vegas during @defcon and @blackhatevents I was invited on the @aisecpod podcast. We had a great discussion about using AI for threat intelligence, adversarial prompts, and NOVA for prompt hunting. Check it out! 👇 https://youtu.be/HAd05qfJjOE?si=xDR9O_BeA-kNI2vw

My DEFCON talk about crypto money laundering techniques is out! At minute 20:30, I demonstrate how I use an AI agent to assist my investigation in money tracking and laundering pattern identification. Then I discuss the limits and possibilities. I used the Bybit hack as an example and I built […]

🤓 I created a new community project dedicated to Adversarial Prompts called PromptIntel. Over the past years, I researched how threat actors exploit LLMs and introduced the concept of Indicators of Prompt Compromise (IoPC), adversarial prompts that reveal […] [Original post on infosec.exchange]

🧐 OpenAI just released a new report on how threat actors use GPT models. Phishing, malware development, info ops, and scams are on the menu! Something interesting, they added 3 new LLM TTPs that describe how attackers use LLMs for their attacks. - […] [Original post on infosec.exchange]

🤓 Interesting finding! A malicious MCP server spotted in the wild! The Postmark MCP server (used to send and track emails through Postmark API) introduced a suspicious behavior in version 1.0.16. The attacker cloned the legitimate Postmark MCP code and […] [Original post on infosec.exchange]

🤩 After the SANS Institute DMA Award nomination, I am truly honored to announce that I have also been also nominated for the French-Australia Award (Le Courrier Australien - LCANews) in the Research and Innovation category. Super proud to see my work in […] [Original post on infosec.exchange]

🤓 I built a quick interface to define and show the classification of Adversarial Prompts (IoPC)! The 4 main categories are: ・ Prompt Manipulation, ・ Abusing Legitimate Functions, ・ Suspicious Patterns, ・ Abnormal Outputs. Each covers threats you should […] [Original post on infosec.exchange]

There is still time to vote for NOVA in the #SANSDMA awards under Innovation of the Year! 👉 Vote here: https://survey.sans.org/jfe/form/SV_6fiMUToTuWy7puS And if you want a quick overview of NOVA (Hollywood style), check out this video 👇 https://youtu.be/HDhbqKykc2o?si=5_dzpU_TVAXsZoT-

🤩 Check out DetectionStream built by @Kostastsale, this is an app where you can explore Sigma and NOVA rules! There is also a playground so you can test the rules live 👉 detectionstream.com

🤓 I have released Proximity, my MCP Security Scanner powered by NOVA! Before using a public MCP server, you can quickly probe the endpoint or your local MCP to discover exposed prompts, tools, and resources. You can then scan with NOVA to check if any […] [Original post on infosec.exchange]

🤓 If you are looking for a threat intel workflow, don't forget the Jupyter Universe! It gives you a central point to find useful Jupyter notebooks. No need to reinvent the wheel when talented researchers already did the work! 👉 https://juniverse.securitybreak.io/

👀 New Microsoft threat report shows how attackers are using AI for evasion and obfuscation in a phishing campaign! One part is very interesting, the team spotted 5 AI fingerprints in the code. But instead of hiding the attack (the initial goal), these […] [Original post on infosec.exchange]

🤩 I am super happy to share that I have been nominated again for the #SANSDMA Award! Last year I did not win, but this year my open-source tool NOVA has been selected in the Innovation of the Year category. If you like the project, please cast your vote to […] [Original post on infosec.exchange]

🤓 This weekend I sent out my latest newsletter, a quick recap of BlackHat & Defcon along with some updates from my side! Have a read 👉 https://newsletter.securitybreak.io/archive/blackhat-defcon2025

The Unprotect Project is a place to learn about Malware Evasion with code snippets and detection rules. I recently added a small update thanks to new contributions 🙏 👉 https://unprotect.it/

📸 One month ago in Vegas. I shared my work on Adversarial Prompts or Indicators of Prompt Compromise (IoPCs). My goal is simple: create a common foundation we can all build on to classify and track adversarial prompts!

🚨 New threat report: threat actor leverages AI at scale for influence… with a twist! Threat actor Storm-1516 relies on uncensored and self-hosted LLMs, using variants of the Llama-3.1-8B model (dolphin-2.9-llama3-8b, Llama-3-8B-Lexi-Uncensored). They use […] [Original post on infosec.exchange]

🤓 I have been saying for a while that prompts are the new IOCs. In my latest blog, I break down the full classification of Indicators of Prompt Compromise (IoPCs) and how we can start hunting adversarial prompts. Curious to hear your thoughts 👇 […] [Original post on infosec.exchange]

Brave demonstrated an Indirect Prompt Injection attack to exfiltrate OTPs on Comet the Perplexity browser! 👇 brave.com/blog/comet-prompt-injection/

Nice report showing a new offensive framework leveraging AI and MCP built in the style of Cobalt Strike 👇 https://www.straiker.ai/blog/cyberspike-villager-cobalt-strike-ai-native-successor

🎙️ I was recently invited to the @CISOtradecraft podcast to talk about the current state of AI and security and how you can protect your AI systems using NOVA my open source prompt pattern matching project. Check out the full podcast! 🤓 https://youtu.be/0XQtaE48RzI?si=AJjrwN_fg7hHws3L

Great blog on the Nx supply chain attack that show how threat actors embedded adversarial prompts in malicious NPM packages! Prompts are the new IoCs! 🤓 https://www.getsafety.com/blog-posts/analyzing-nx-ai-prompt

Anthropic officially released a centralised repo for trusted MCP with a public API, moderation, and support! I think this is a great idea to improve MCP security. I am just hoping the supply chain is strong enough to avoid another npmAIpocalypse... 🫠 […] [Original post on infosec.exchange]

🤓 Prompt Injection is one of the first attack vectors used to exploit weaknesses or bypass behavior in AI models! I put 5 illustrated techniques that highlight how these attacks work 👇 1️⃣ Direct Prompt Injection: The attacker directly inserts malicious text into the input field.

Interesting tool if you are looking for a complement to strings, stringsifter and floss. StrangerStrings uses a trigram-based scoring model to calculate probabilities of character sequences. 👇 https://github.com/closed-systems/strangerstrings

🤓 Anthropic recently release a threat report that shows how threat actors are using their model Claude. Here are some of the highlights: ・ Vibe hacking: Criminals are using Claude Code to perform real intrusions, doing reconnaissance, extortion, at a scale […] [Original post on infosec.exchange]

NBC News: A hacker used AI to automate an 'unprecedented' cybercrime spree, Anthropic says The company behind the Claude chatbot said it caught a hacker using its chatbot to identify, hack and extort at least 17 companies […]

🤓 At BlackHat Arsenal I presented Proximity my MCP security scanner powered by NOVA. I am about to release the code on GitHub. Awaiting you can check this video to see how it works 👇 https://youtu.be/4JmxV5ffLs0?si=3rdhjHrQus9PPcjz&t=249

🤓 I just published my @auscert talk titled “Generative AI Breaches: Threats, Investigations, and Response.” In this presentation, I explain how to protect and investigate AI breaches: - I start with real-world AI breach cases that already happened - I […] [Original post on infosec.exchange]

🤩 Huge shoutout to Marco Pedrinazzi for building and sharing a Streamlit web app to test NOVA rules! NOVA help you detect adversarial prompts: injections, jailbreaks, disinfo, malware, and more. Thanks to Marco, you can now run your own rules locally and […] [Original post on infosec.exchange]

🤓 Sneak peek from my @defcon talk last week! The rest of the presentation showed how the attacker laundered the money and how we can build an AI agent to help analysts follow the money.

🤓 Next week at @blackhatevents and @defcon is going to be packed! First, I am delivering my training "GenAI for Threat Intelligence", a heavy session to learn how to integrate GenAI in your threat intel workflow. 📍 Wednesday, 12 PM – BlackHat Arsenal I […] [Original post on infosec.exchange]

⚠️ Someone hacked the Amazon AI coding assistant to inject a data-wiping prompt! It was merged via a pull request due to misconfigured GitHub workflows, it went live on the VSC marketplace and it stayed undetected for 6 days. The prompt was designed to […] [Original post on infosec.exchange]

💥 CERT-UA published a report on a malware powered by an LLM. The malware uses Qwen 2.5-Coder-32B-Instruct via the HuggingFace API to generate and execute commands on infected systems. It is a Python script that embeds prompts to dynamically craft Windows […] [Original post on infosec.exchange]

🎙️🇫🇷 Pour mon audience française : j’ai été invité dans le podcast Tronche de Tech. C’était l’occasion de revenir sur mon parcours pro, avec quelques anecdotes et moments de galère autour d’attaques sur lesquelles j’ai bossé 😅 https://youtu.be/mqu3ygeppjc?si=DLFjUMBVOgg2SzUf

👾 Last week CheckPoint published a report where they found a piece of malware embedding a prompt injection designed to bypass AI models. Even if it is basic and probably just a prototype, I still think it is interesting. That said, I want to correct […] [Original post on infosec.exchange]