Skip to main content

Primary supervisor

Carsten Rudolph

Co-supervisors


Large Language Model (LLM) agents are increasingly extended through external skills, tools,
plugins, and reusable instruction modules. These skills allow agents to perform complex tasks
such as file processing, web search, code execution, data analysis, and workflow automation.
However, current security checks usually evaluate each skill in isolation. A skill may appear
benign when tested alone, but become harmful when combined with other skills in the same
agent workflow.


This project investigates skill-composition poisoning in LLM agents. The key idea is that an
attacker may design or select multiple individually benign skills whose interaction causes unsafe
behaviour only when they are used together. For example, one skill may summarize user data,
another may transform or store intermediate outputs, and a third may send a final result. None of
these skills is clearly malicious by itself, but their composed execution path may lead to privacy
leakage, unauthorized actions, policy bypass, or misleading agent behaviour.


This research will develop a framework for identifying such composition-level risks. Instead of
asking whether a single skill is malicious, the project asks whether a set of skills can jointly
create an unsafe execution path. The project will focus on controlled, sandboxed LLM-agent
environments and will study both attack discovery and defensive detection.

Aim/outline

  1. Define a threat model for skill-composition poisoning in LLM agents, where individual skills are benign in isolation but harmful when composed.
  2. Build a small benchmark of agent skills and multi-skill workflows covering risks such as data leakage, unauthorized tool use, unsafe delegation, and misleading final responses.
  3. Design an automated testing framework that generates and evaluates candidate skill combinations under realistic agent tasks.
  4. Compare isolated skill vetting with composition-aware testing to measure how many risks are missed by single-skill evaluation.
  5. Develop simple defensive mechanisms, such as path-level risk scoring, skill dependency analysis, and runtime monitoring of intermediate states.
  6. Evaluate the framework across different LLM backbones and agent settings, using metrics such as attack success rate, false positive rate, detection accuracy, and query cost.

Required knowledge

Must Have

  • Python Programming
  • Artificial Intelligence and Large Language Models Fundamentals
  • Basic Data Analysis
  • Research and Problem-Solving Skills
  • Interest in Cybersecurity and AI Safety

Recommended

  • Natural Language Processing
  • Prompt Engineering
  • Hugging Face / OpenAI APIs
  • Basic Software Security Concepts
  • Linux and Command Line Basics
  • Familiarity with LangChain, AutoGen, or LlamaIndex