Research library
Conference research
AI safety research, organized by conference, year and research area.
Total 75 papers
- A Causal Perspective for Enhancing Jailbreak Attack and Defense
- A Deep Dive into Function Inlining and its Security Implications for ML-based Binary Analysis
- A Hard-Label Black-Box Evasion Attack against ML-based Malicious Traffic Detection Systems
- Beyond Jailbreak: Unveiling Risks in LLM Applications Arising from Blurred Capability Boundaries
- Dataset Reduction and Watermark Removal via Self-supervised Learning for Model Extraction Attack
- DUALBREACH: Efficient Dual-Jailbreaking via Target-Driven Initialization and Multi-Target Optimization
- NeuroStrike: Neuron-Level Attacks on Aligned LLMs
- Odysseus: Jailbreaking Commercial Multimodal LLM-integrated Systems via Dual Steganography
- Targeted Physical Evasion Attacks in the Near-Infrared Domain
- ThinkTrap: Denial-of-Service Attacks against Black-box LLM Services via Infinite Thinking
- Towards Effective Prompt Stealing Attack against Text-to-Image Diffusion Models
Prompt injection
4- Attention is All You Need to Defend Against Indirect Prompt Injection Attacks in LLMs
- ObliInjection: Order-Oblivious Prompt Injection Attack to LLM Agents with Multi-source Data
- Prompt Injection Attack to Tool Selection in LLM Agents
- When Cache Poisoning Meets LLM Systems: Semantic Cache Poisoning and Its Countermeasures
- Benchmarking and Understanding Safety Risks in AI Character Platforms
- Character-Level Perturbations Disrupt LLM Watermarks
- Constructive Noise Defeats Adversarial Noise: Adversarial Example Detection for Commercial DNN Services
- MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness
- Paladin: Defending LLM-enabled Phishing Emails with a New Trigger-Tag Paradigm
- Q-MLLM: Vector Quantization for Robust Multimodal Large Language Model Security
- There is No War in Ba Sing Se: A Global Analysis of Content Moderation in Large Language Models
- VeriLoRA: Fine-Tuning Large Language Models with Verifiable Security via Zero-Knowledge Proofs
- ViGText: Deepfake Image Detection with Vision-Language Model Explanations and Graph Neural Networks
- ZKSL: Verifiable and Efficient Split Federated Learning via Asynchronous Zero-Knowledge Proofs
Interpretability
1- CatBack: Universal Backdoor Attacks on Tabular Data via Categorical Encoding
- Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Models
- InverTune: A Backdoor Defense Method for Multimodal Contrastive Learning via Backdoor-Adversarial Correlation Analysis
- Rounding-Guided Backdoor Injection in Deep Learning Model Quantization
Privacy and data breaches
22- A Unified Defense Framework Against Membership Inference in Federated Learning via Distillation and Contribution-Aware Aggregation
- Augmented Shuffle Differential Privacy Protocols for Large-Domain Categorical and Key-Value Data
- Cascading and Proxy Membership Inference Attacks
- CELLSHIFT: RTT-Aware Trace Transduction for Real-World Website Fingerprinting
- Convergent Privacy Framework for Multi-layer GNNs through Contractive Message Passing
- CRISP: An Efficient Cryptographic Framework for ML Inference Against Malicious Clients
- CryptPEFT: Efficient and Private Neural Network Inference via Parameter-Efficient Fine-Tuning
- DNN Latency Sequencing: Extracting DNN Architectures from Intel SGX Enclaves with Single-Stepping Attacks
- Enhancing Website Fingerprinting Attacks against Traffic Drift
- In-Context Probing for Membership Inference in Fine-Tuned Language Models
- Memory Backdoor Attacks on Neural Networks
- Peering Inside the Black-Box: Long-Range and Scalable Model Architecture Snooping via GPU Electromagnetic Side-Channel
- PrivCode: When Code Generation Meets Differential Privacy
- PrivORL: Differentially Private Synthetic Dataset for Offline Reinforcement Learning
- Prεεmpt: Sanitizing Sensitive Prompts for LLMs
- Shadow in the Cache: Unveiling and Mitigating Privacy Risks of KV-cache in LLM Inference
- STIP: Three-Party Privacy-Preserving and Lossless Inference for Large Transformers in Production
- SVDefense: Effective Defense against Gradient Inversion Attacks via Singular Value Decomposition
- To Shuffle or not to Shuffle: Auditing DP-SGD with Shuffling
- Was My Data Used for Training? Membership Inference in Open-Source LLMs via Neural Activations
- WhiteCloak: How to Hold Anonymous Malicious Clients Accountable in Secure Aggregation?
Supply chain security
1AI and cyber offense and defense
18- An LLM-Driven Fuzzing Framework for Detecting Logic Instruction Bugs in PLCs
- Automated Code Annotation with LLMs for Establishing TEE Boundaries
- Automating Function-Level TARA for Automotive Full-Lifecycle Security
- Beyond Raw Bytes: Towards Large Malware Language Models
- Beyond RTT: An Adversarially Robust Two-Tiered Approach For Residential Proxy Detection
- BSFuzzer: Context-Aware Semantic Fuzzing for BLE Logic Flaw Detection
- CHAMELEOSCAN: Demystifying and Detecting iOS Chameleon Apps via LLM-Powered UI Exploration
- Chimera: Harnessing Multi-Agent LLMs for Automatic Insider Threat Simulation
- Decompiling the Synergy: An Empirical Study of Human–LLM Teaming in Software Reverse Engineering
- FirmAgent: Leveraging Fuzzing to Assist LLM Agents with IoT Firmware Vulnerability Discovery
- Incident Response Planning Using a Lightweight Large Language Model with Reduced Hallucination
- IoTBec: An Accurate and Efficient Recurring Vulnerability Detection Framework for Black Box IoT devices
- LLMBisect: Breaking Barriers in Bug Bisection with A Comparative Analysis Pipeline
- ProtocolGuard: Detecting Protocol Non-compliance Bugs via LLM-guided Static Analysis and Dynamic Verification
- Strategic Games and Zero Shot Attacks on Heavy-Hitter Network Flow Monitoring
- TIPSO-GAN: Malicious Network Traffic Detection Using a Novel Optimized Generative Adversarial Network
- Trust Me, I Know This Function: Hijacking LLM Static Analysis using Bias
- What Do They Fix? LLM-Aided Categorization of Security Patches for Critical Memory Bugs