Giving agent frameworks a threat-intel safety check: RelayShield's smolagents tools
smolagents, two of the riskiest surfaces are usually invisible until something goes wrong: the MCP servers your agent connects to, and the prompts it gets fed by tools/data sources it doesn't fully trust. We built four smolagents.Tool classes that let an agent check both before it acts.
What's in the Space
relayshieldadmin/relayshield-agentic-attack-surface is a live MCP server (also usable as a Gradio Space) exposing four tools:
mcp-registry-risk— checks an MCP server against known-malicious/impersonation registry entries before your agent connects to itprompt-injection-breach— flags whether content an agent is about to ingest matches known prompt-injection patternstech-stack-cve— cross-references a declared tech stack (including agent frameworks themselves — LangChain, CrewAI, AutoGPT, Nacos, etc.) against CISA KEV + high-EPSS CVEsbulk-identity-risk— scores up to 10 domains x 5 associated emails each for breach/infostealer/session/CVE exposure in one call
relayshield_smolagents_tool.py wraps all four as drop-in smolagents.Tool subclasses. Pull it from the Space repo and hand it to your CodeAgent/ToolCallingAgent alongside your other tools.
Why this matters for agent builders specifically
The Sysdig/JadePuffer report on the first fully-autonomous-LLM-agent ransomware operation showed initial access through an unauthenticated RCE in an agent framework (Langflow, CVE-2025-3248, CISA KEV-tagged). It is exactly the class of thing tech-stack-cve is built to catch generically, including on your own agent's dependencies, not just customer-facing infrastructure.
Pricing
Each call is billed pay-as-you-go via Stripe using self-serve signup at api.relayshield.net/developers, no subscription and no monthly minimum, billed monthly for what you actually use (most teams spend $0 in their first week while integrating). Set your key as RELAYSHIELD_API_KEY and you're calling all four tools; the key is what gates usage, not a Space-level secret, so you're never paying for someone else's calls.
For fully autonomous agent-to-agent payments with no human provisioning a key up front, these same four checks are also available pay-per-call in USDC via x402 on the underlying API's /v1/payg/* routes.
Feedback welcome
These four tools draw from a continuously growing pipeline behind them: 3M+ IOCs, 4,500+ tracked malware families, 40+ monitored criminal marketplaces, 20+ authoritative feeds, MITRE ATT&CK threat actor profiles (see our companion MITRE ATT&CK group-technique dataset), and CISA KEV-backed early warnings. We picked these four as the most agent-relevant checks to start with, out of a broader 24-endpoint API. If there's a fifth tool that would actually get used in your agent pipelines, we'd like to hear your ideas.
— RelayShield