Skip to content

A multi-agent system for automated Cyber Threat Intelligence (CTI) collection, analysis, and enrichment using Google's Agent Development Kit (ADK) & Google Cloud. This project was developed specifically for the "Agent Development Kit Hackathon with Google Cloud"

Notifications You must be signed in to change notification settings

efesn/AgentThreat

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AgentThreat: Multi-Agent CTI System with Google's ADK

Overview

AgentThreat is an autonomous, AI-driven multi-agent system built with Google’s Agent Development Kit (ADK) to collect, clean, enrich, and analyze cyber threat intelligence (CTI) reports from various trusted sources in real time. Designed to handle noisy and unstructured threat feeds from trusted sources.

The project addresses the common challenge faced by security researchers: extracting meaningful data from the high volume of noisy, duplicate, and unstructured resources. Using LLM powered agents built with ADK, AgentThreat automatically filters, enriches, and classifies CTI entries.

By enabling AI-native workflows with the Agent Development Kit, AgentThreat automatically filters out irrelevant or duplicate content, extracts key indicators of compromise (IOCs), identifies threat actors and malware, maps attacks to MITRE ATT&CK techniques, and summarizes threat context, all without human intervention. AgentThreat empowers threat hunters & security researchers by significantly reducing manual workload.

Key Features

Intelligent Feed Processing

The system employs three specialized agents:

1. RSS Fetcher Agent

  • Fetches feeds from trusted cybersecurity sources
  • Handles feed parsing and validation

2. Feed Cleaner Agent

  • Filters out non-security & CTI related content
  • Removes duplicates
  • Inserts filtered data to BigQuery

3. Threat Analyzer Agent

  • Extracts IOCs (IPs, domains, hashes, CVEs etc.)
  • Identifies threat actors and TTPs
  • Maps to MITRE ATT&CK framework
  • Generates human readable summaries
  • Inserts analyzed data to BigQuery

Tech Stack

  • Language: Python
  • Framework: Google Agent Development Kit (ADK)
  • Cloud Services: Google Cloud BigQuery for data storage
  • LLM: Gemini 2.0 Flash

Requirements

  • Python 3.9+
  • Google Cloud project with Vertex AI API enabled
  • BigQuery (required table schema & configs are provided below)
  • Google ADK (Agent Development Kit)

Installation

  1. Clone the repository:
git clone https://github.com/efesn/AgentThreat.git
cd AgentThreat
  1. Set up environment variables:
# Rename .env.example to .env. Then edit .env with proper settings
cp .env.example .env
  1. (Recommended) Create a Virtual Environment

Prefer that to isolate project dependencies and avoid conflicts instead of using break system packages flag, create a virtual environment:

python -m venv agentthreat

Active the virtual environment:

Windows:

agentthreat\Scripts\activate

macOS/Linux:

source agentthreat/bin/activate

Install Python Dependencies:

pip install -r requirements.txt
  1. Set up BigQuery:

Go to BigQuery Studio in the Google Cloud Console

In your BigQuery Studio on Google Cloud Console, create new SQL Query and insert this required table structure & run:

CREATE TABLE `your-project-id.your-dataset-name.your-table-name`
(
    -- Basic Feed Data
    title STRING NOT NULL,
    link STRING NOT NULL,
    published TIMESTAMP,
    
    -- Analysis Status
    analyzed BOOLEAN DEFAULT FALSE,
    analysis_timestamp TIMESTAMP,
    
    -- Threat Analysis Data
    threat_category STRING,
    iocs STRING,  --stores as JSON string of extracted IOCs
    summary STRING,
    threat_actor STRING,
    mitre_techniques STRING,  --stores as JSON array of technique IDs
    
    -- Time datas
    insertion_timestamp TIMESTAMP DEFAULT CURRENT_TIMESTAMP(),
    last_updated TIMESTAMP DEFAULT CURRENT_TIMESTAMP()
)
CLUSTER BY link, published;

Usage

Basic usage: Interact with agents in a browser-based playground.

adk web .

Data Sources

Future Enhancements

  • Running autonomous daily/weekly and provide weekly/monthly insights by analyzing them

This project was developed specifically for the "Agent Development Kit Hackathon with Google Cloud"

About

A multi-agent system for automated Cyber Threat Intelligence (CTI) collection, analysis, and enrichment using Google's Agent Development Kit (ADK) & Google Cloud. This project was developed specifically for the "Agent Development Kit Hackathon with Google Cloud"

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors