Modern Cyber with Jeremy Snyder

Modern Cyber with Jeremy Snyder

por Jeremy Snyder
Temporada 1

This Week in AI Security - 6th November 2025

In this week's episode, Jeremy looks at three compelling stories and a significant academic paper that illustrate the accelerating convergence of AI, APIs, and network security. API Exposure in AI Services: We discuss a path traversal vulnerability that led to the discovery of 3,000 API keys in a managed AI hosting service, underscoring that the API remains the exposed attack surface where data exfiltration occurs. AI Code Agent Traffic Analysis: Drawing on research from Chaser Systems, Jeremy breaks down the network traffic from popular AI coding agents (like Copilot and Cursor). The analysis reveals that sensitive data, including previous conversation context and PII, is repeatedly packaged and resent with every subsequent request, making detection and leakage risk significantly higher. LLM-Powered Malware: We cover a groundbreaking discovery by the Microsoft Incident Response Team (DART): malware using the OpenAI Assistants API as its Command and Control (C2) server. This new category of malware replaces traditional hard-coded instructions with an LLM-driven "brain," giving it the potential to coordinate malicious activity with context, creativity, and adaptability. The Guardrail Fallacy: Finally, Jeremy discusses an academic paper showing that strong, adaptive attacks can bypass LLM defenses against Jailbreaks and Prompt Injections with an Attack Success Rate (ASR) of over 90%. The research argues that simple guardrails provide organizations with a dangerous false sense of security. Episode Links https://chasersystems.com/blog/what-data-do-coding-agents-send-and-where-to/ https://embracethered.com/blog/posts/2025/claude-abusing-network-access-and-anthropic-api-for-data-exfiltration/ https://arxiv.org/pdf/2510.09023 https://www.microsoft.com/en-us/security/blog/2025/11/03/sesameop-novel-backdoor-uses-openai-assistants-api-for-command-and-control/ ------ Worried about AI security? Get Complete AI Visibility in 15 Minutes. Discover all of your shadow AI now. Book a demo of Firetail's AI Security & Governance Platform: https://www.firetail.ai/request-a-demo

This Week in AI Security - 30th October 2025

In this week's episode, Jeremy focuses on two rapidly evolving areas of AI security: the APIs that empower AI services and the risks emerging from new AI Browsers. We analyze two stories highlighting the exposure of secrets and sensitive data: API Insecurity: A path traversal vulnerability was discovered in the APIs powering an MCP server hosting service, leading to the exposure of 3,000 API keys. This reinforces the lesson that foundational security mistakes, such as inadequate secret management and unpatched vulnerabilities, are being repeated in the rush to launch new AI services. CVE in Google Cloud Vertex AI: We discuss a confirmed CVE in Google's Vertex AI service APIs. This vulnerability briefly allowed requests made by one customer's application to be routed and responded to another customer's account, risking exposure of sensitive corporate data and intellectual property in a multi-tenant SaaS environment. Finally, we explore the risks of AI Browsers (like the ChatGPT Atlas or Perplexity Comet browser) and AI Sidebars. These agents, designed to act with agency on a user's behalf (e.g., price comparison), are vulnerable to techniques that can reveal sensitive PII and user credentials to malicious websites, or unwittingly download malware. Episode Links https://blog.gitguardian.com/breaking-mcp-server-hosting/https://cloud.google.com/support/bulletins#gcp-2025-059 https://fortune.com/2025/10/23/cybersecurity-vulnerabilities-openai-chatgpt-atlas-ai-browser-leak-user-data-malware-prompt-injection/ https://securityboulevard.com/2025/10/news-alert-squarex-reveals-new-browser-threat-ai-sidebars-cloned-to-exploit-user-trust/ https://techcrunch.com/2025/10/25/the-glaring-security-risks-with-ai-browser-agents/ ____________ Worried about AI security? Get Complete AI Visibility in 15 Minutes. Discover all of your shadow AI now. Book a demo of FireTail's AI Security & Governance Platform

This Week in AI Security - 23rd October 2025

In this week's episode, recorded live from the inaugural AI Security Summit hosted by Snyk, Jeremy reports on the latest threats and strategic discussions shaping the industry. Covering multiple instances of "old risks" reappearing in new AI contexts... The Salesforce "forced leak" vulnerability, where an AI agent was exposed to malicious prompt injection via seemingly innocuous text fields on web forms (a failure of input sanitization). Research from Nvidia detailing waterhole attacks where malicious code (e.g., PowerShell) is hidden in decoy libraries (like "react-debug") that AI coding assistants might suggest to developers. A consumer AI girlfriend app that exposed customer chat data by storing conversations in an open Apache Kafka pipeline, demonstrating a basic failure of security hygiene under the pressure of rapid AI development. The "Glass Worm" campaign, where invisible Unicode control characters (similar to Ascii Smuggling research by Firetail) were used to embed malware in a VS Code plugin, proving the invisible code risk is actively being leveraged in development tools. Finally, Jeremy shares strategic insights from the summit, including the massive projected growth of the AI market (approaching the size of cloud computing), the urgency of data readiness and governance to prevent model poisoning, and the futurist perspective that AI's accelerated skill acquisition (potentially surpassing humans in certain tasks in an 18-month cycle) will require human workers to constantly upskill and change roles more frequently. Episode Links https://noma.security/blog/forcedleak-agent-risks-exposed-in-salesforce-agentforce/ https://www.koi.ai/blog/glassworm-first-self-propagating-worm-using-invisible-code-hits-openvsx-marketplace https://developer.nvidia.com/blog/from-assistant-to-adversary-exploiting-agentic-ai-developer-tools/ https://www.foxnews.com/tech/ai-girlfriend-apps-leak-millions-private-chats https://layerxsecurity.com/blog/cometjacking-how-one-click-can-turn-perplexitys-comet-ai-browser-against-you/ Worried about AI security? Get Complete AI Visibility in 15 Minutes. Discover all of your shadow AI now. Book a demo of Firetail's AI Security & Governance Platform

Chris Farris of fwd:cloudsec

In this special in-person episode of Modern Cyber, recorded at fwd:cloudsec Europe, Jeremy is joined by cloud security expert and conference organizer Chris Farris. Drawing on his over 30 years in IT, Chris recounts his journey into cloud security, from his early days with Linux to moving video archives to AWS S3. The conversation revisits the foundational mindset shifts that occurred with the rise of the cloud, focusing on the agility it brought and the security gaps it created, such as the transition from rigid, on-premises governance to the chaotic freedom of API calls and ClickOps. The core of the episode explores the concept of the Sovereign Cloud, specifically Amazon's intended European Sovereign Cloud. Chris clarifies that simple data residency is not true sovereignty due to the US Cloud Act. He details the unique nature of the European partition—a completely separate partition, billing system, and support staff operated only by EU citizens—and identifies the primary flaw: the lack of a legal statute protecting the European employees from being compelled to act under the Cloud Act. Finally, Chris shares a powerful reflection on the fwd:cloudsec community, calling it a "second cloud family". Guest Bio Chris Farris is a highly experienced IT professional with a career spanning over 25 years. During this time, he has focused on various areas, including Linux, networking, and security. For the past eight years, he has been deeply involved in public-cloud and public-cloud security in media and entertainment, leveraging his expertise to build and evolve multiple cloud security programs. Chris is passionate about enabling the broader security team’s objectives of secure design, incident response, and vulnerability management. He has developed cloud security standards and baselines to provide risk-based guidance to development and operations teams. As a practitioner, he has architected and implemented numerous serverless and traditional cloud applications, focusing on deployment, security, operations, and financial modeling. He is one of the organizers of the fwd:cloudsec conference and presented at various AWS conferences and BSides events. He was named one of the inaugural AWS Security Heroes. Chris shares his insights on security and technology on social media platforms like BlueSky, Mastodon and his website chrisfarris.com. Episode Links‍ https://fwdcloudsec.org https://fwdcloudsec.org/forum/ https://www.chrisfarris.com Discover all of your Shadow AI now Worried about AI security? Get Complete AI Visibility in 15 Minutes. Book a demo of Firetail's AI Security & Governance Platform.

This Week in AI Security - 16 October 2025

In this week's episode of This Week in AI Security, Jeremy covers four key developments shaping the AI security landscape. Jeremy begins by analyzing a GitHub Copilot flaw that exposed an LLM vulnerability similar to the one Jeremy disclosed last week. Researchers were able to use a hidden code comment feature to smuggle malicious prompts into the LLM, allowing them to potentially exfiltrate secrets and source code from private repositories. This highlights a growing risk in how LLMs process different input formats. Next, we discuss a fascinating research paper demonstrating the effectiveness of data poisoning. The study found that corrupting a model's behavior was possible with as few as 250 malicious documents—even in models with large training sets. By embedding a malicious command that mimicked sudo, researchers could implement a backdoor that sends data out, proving that the Attack Success Rate (ASR) is a critical metric for this real-world threat. We then examine a story at the intersection of agentic AI and supply chain risk, where untrusted actors exploited vulnerabilities in AI development plugins. By intercepting system prompts that lacked proper encryption, an attacker could discover the agent's permissions and potentially exfiltrate sensitive data, including Windows NTLM credentials. Finally, we look at the latest State of AI report, which provides further confirmation that LLMs like Claude are being used by malicious actors—specifically suspected North Korean state actors—to "vibe hack" the hiring process. By using AI to create perfect-looking resumes and tailored interview responses, the traditional method of spotting phony candidates by poor text quality is no longer reliable. Episode Links: https://www.securityweek.com/github-copilot-chat-flaw-leaked-data-from-private-repositories/ https://www.anthropic.com/research/small-samples-poison https://versprite.com/blog/watch-who-you-open-your-door-to-in-ai-times/ https://excitech.substack.com/p/16-highlights-from-the-state-of-ai https://www.stateof.ai/ https://www.firetail.ai/blog/we-interviewed-north-korean-hacker-heres-what-learned Discover all of your Shadow AI now... Worried about AI security? Get Complete AI Visibility in 15 Minutes. Discover all of your shadow AI now. Book a demo of Firetail's AI Security & Governance Platform.

This Week in AI Security - 9th Oct 2025

In this very first episode of 'This Week in AI Security', brought to you by the Firetail team, Jeremy dives into three crucial stories from the past week that highlight the rapidly evolving security landscape of AI adoption. We start with a classic error: a contractor for the Australian State of New South Wales repeated the "open S3 bucket" mistake by uploading a sensitive data set to a generative AI platform, confirming that old security missteps are resurfacing with new technology. Next, we look at a win for the defense: how Microsoft's AI analysis tools blocked a sophisticated phishing campaign that used AI-generated malicious code embedded in an SVG file and was sent from a compromised small business—a clear proof that AI can be very useful on the defensive side. Finally, we discuss recent research from the Firetail team uncovering an ASCII Smuggling vulnerability in Google Gemini, Grok, and other LLMs. This technique uses hidden characters to smuggle malicious instructions into benign-looking prompts (e.g., in emails or calendar invites). We detail the surprising dismissal of this finding by Google, which highlights the urgent need to address common, yet serious, social engineering risks in the new age of LLMs. Show links: https://databreaches.net/2025/10/06/nsw-gov-contractor-uploaded-excel-spreadsheet-of-flood-victims-data-to-chatgpt/ https://www.infosecurity-magazine.com/news/ai-generated-code-phishing/ https://www.firetail.ai/blog/ghosts-in-the-machine-ascii-smuggling-across-various-llms https://thehackernews.com/2025/09/researchers-disclose-google-gemini-ai.html ________ Worried about AI security? Get Complete AI Visibility in 15 Minutes. Discover all of your shadow AI now. Book a demo of Firetail's AI Security & Governance Platform: https://www.firetail.ai/request-a-demo

Noora Ahmed-Moshe of Hoxhunt

In this special in-person episode of Modern Cyber, recorded in Helsinki, Jeremy Snyder sits down with Noora Ahmed-Moshe, VP of Strategy and Operations at Hoxhunt, for a critical discussion on the evolving human risk in cybersecurity. Noora shares her unique perspective on the intersection of human psychology, technological advancement, and defense, stressing that people are not the problem, but the final, essential layer of defense. The conversation dives into Hoxhunt's research, which revealed that AI-powered phishing agents have become significantly more effective than elite human red teams at creating successful spear phishing attacks. Noora discusses how Hoxhunt is fighting AI with AI, using gamification and positive reinforcement, rather than fear and punishment, to train users against increasingly sophisticated threats like deepfakes and highly personalized social engineering. Finally, she offers guidance on how organizations must abandon compliance-only training and embrace change to build a strong, psychologically safe security culture that can withstand the accelerating AI threat landscape. Guest Bio – Noora Ahmed-Moshe Noora is the Vice President of Strategy and Operations at Hoxhunt, where she works with internal teams, customers, and partners to develop the future of Human Risk Management. With a strong focus on the human side of cybersecurity, she is an advocate for the importance of culture in driving secure behaviours, and in bridging the gap between technology and human interaction. Noora’s career spans 20 years of digital product and strategy development across industries in the UK and in Finland. Hoxhunt Website - https://hoxhunt.com/ AI Powered Phishing Outperforms Elite Cybercriminals in 2025- https://hoxhunt.com/blog/ai-powered-phishing-vs-humans

Noora Ahmed-Moshe of Hoxhunt

In this special in-person episode of Modern Cyber, recorded in Helsinki, Jeremy Snyder sits down with Noora Ahmed-Moshe, VP of Strategy and Operations at Hoxhunt, for a critical discussion on the evolving human risk in cybersecurity. Noora shares her unique perspective on the intersection of human psychology, technological advancement, and defense, stressing that people are not the problem, but the final, essential layer of defense. The conversation dives into Hoxhunt's research, which revealed that AI-powered phishing agents have become significantly more effective than elite human red teams at creating successful spear phishing attacks. Noora discusses how Hoxhunt is fighting AI with AI, using gamification and positive reinforcement, rather than fear and punishment, to train users against increasingly sophisticated threats like deepfakes and highly personalized social engineering. Finally, she offers guidance on how organizations must abandon compliance-only training and embrace change to build a strong, psychologically safe security culture that can withstand the accelerating AI threat landscape. Guest Bio – Noora Ahmed-Moshe Noora is the Vice President of Strategy and Operations at Hoxhunt, where she works with internal teams, customers, and partners to develop the future of Human Risk Management. With a strong focus on the human side of cybersecurity, she is an advocate for the importance of culture in driving secure behaviours, and in bridging the gap between technology and human interaction. Noora’s career spans 20 years of digital product and strategy development across industries in the UK and in Finland. Hoxhunt Website - https://hoxhunt.com/ AI Powered Phishing Outperforms Elite Cybercriminals in 2025- https://hoxhunt.com/blog/ai-powered-phishing-vs-humans ‍

Joe Carson of Segura

In this episode of Modern Cyber, Jeremy is joined by Joseph Carson, Chief Security Evangelist and Advisory CISO at Segura. With over 30 years of experience, Joe shares insights from his latest research into AI-powered threats, from flawless phishing in complex languages to chatbot-driven fraud and automated data analysis. He explains how attackers are accelerating operations with machine learning, what that means for enterprises and governments alike, and why resilience depends on awareness, identity protection, and continuous innovation. Guest Bio – Joseph Carson Joseph Carson is Chief Security Evangelist and Advisory CISO at Segura, where he helps organizations worldwide strengthen identity security and build resilient cyber defense strategies. An award-winning cybersecurity leader with more than three decades of experience, Joe has advised governments, critical infrastructure, and global enterprises. He is the author of Cybersecurity for Dummies, read by over 50,000 professionals, and a regular contributor to leading outlets including The Wall Street Journal and Dark Reading. Joe also hosts the podcast Security by Default and is a frequent keynote speaker on identity and AI-driven threats. Security by Default Podcast - https://open.spotify.com/show/0mzN5M5CkFVLn8fq5TnH0O Joseph on Linkedin - https://www.linkedin.com/in/josephcarson/ Segura Website - https://segura.security/

Eldon Sprickerhoff of Caledon Ventures

In this episode of Modern Cyber, Jeremy talks with Eldon Sprickerhoff, co-founder of eSentire and now strategic advisor at Caledon Ventures. Eldon reflects on his journey from starting one of the first MDR companies to mentoring the next generation of cybersecurity founders. He shares lessons from building a business in the “wild west” of early network security, insights into the evolution of MDR, and advice on balancing innovation, stress, and mental health as a founder. Guest Bio – Eldon Sprickerhoff Eldon Sprickerhoff is an acclaimed entrepreneur, advisor, and investor with deep expertise in information security, machine learning, SaaS, and finance. He co-founded eSentire, a global leader in managed detection and response, and served there for over two decades before founding Caledon Ventures, where he now advises and invests in cybersecurity startups. A graduate of the University of Waterloo, Eldon received the J.W. Graham Medal for computing and innovation and was inducted into the Waterloo Region Entrepreneur Hall of Fame in 2024. He is also the author of Committed, a candid guide for startup founders. Eldon's Book: https://www.amazon.com/Committed-Survival-Uncommon-First-Time-Founders/dp/1738396428 Caledon Ventures on Linkedin: https://www.linkedin.com/company/caledon-ventures
7 de 14