Model Exfiltration Drill
Weights, adapters, or a functional copy of a model leaving the environment, either downloaded directly or distilled out through the API.
3 scenarios in this pool
3:12 AM: Systematic Model Extraction via Inference API: Threshold Breach on Token Entropy & Request Volume
The target system is a production inference API serving a fine-tuned LLaMA-3 70B model, hosted on a Kubernetes cluster in AWS us-east-1. The model was fine-tuned on proprietary enterprise data and represents significant IP. You are an on-call ML security analyst for a SaaS company that licenses this model's capabilities to enterprise customers.
SIEM Rule "ML_EXTRACT_003" fired at 03:12:07 UTC. Single API key (key_id: cust-4471-prod) issued 14,382 inference requests over 47 minutes, 98th percentile baseline is 340 req/hr for this customer tier. Mean input token length: 6.3 tokens ("What is", "Define", "Explain", "Output the"). Mean output token length: 847 tokens. Response entropy variance is abnormally LOW (sigma=0.04 vs. baseline sigma=0.31), consistent with structured probing. Egress volume: 2.3 GB from inference endpoint in session. Source IPs: 3 addresses across AS14061 (DigitalOcean), rotating every ~900 seconds. No WAF blocks triggered.
Your first action at 3:12 AM is to triage the severity of this alert. Which factor most strongly indicates this is a model extraction attempt rather than a runaway automation bug or misconfigured integration?

