Data Anonymization
Data anonymization transforms datasets containing Personal Identifiable Information (PII) so that individuals cannot be readily identified, while preserving statistical utility for analysis.
Key Attribute Classifications
| Attribute Type | Description | Examples |
|---|---|---|
| Direct Identifiers | Uniquely identifies an individual directly. | Full Name, SSN, Passport Number, Email |
| Quasi-Identifiers (QIs) | Attributes that do not identify on their own, but can uniquely identify when combined or linked with external datasets. | ZIP Code, Birth Date, Gender, Job Title |
| Sensitive Attributes | Private attributes associated with individuals that require protection from disclosure. | Medical Diagnosis, Salary, Credit Score |
Core Anonymization Techniques
- Suppression / Masking: Removing or masking sensitive attributes or identifiers entirely (e.g., masking credit card digits
**** **** **** 1234). - Generalization / Bucketing: Replacing specific values with broader categories or intervals (e.g., replacing exact age
29with range20–29, or ZIP code94043with940**). - Perturbation / Noise Addition: Adding random noise (e.g., Laplace or Gaussian noise) to numerical attributes to obscure exact values while preserving aggregate means and variances.
- Pseudonymization / Tokenization: Replacing direct identifiers with artificial identifiers (tokens/hashes). Note: Pseudonymization is reversible with a lookup key and is considered de-identification rather than full anonymization.
Privacy Models
1. -Anonymity
A dataset satisfies -anonymity if every combination of quasi-identifiers in the released table matches at least distinct individuals (an equivalence class of size ).
- Example (): A release where any (Age Group, Gender, ZIP) combination appears at least 2 times.
Limitations & Weaknesses of -Anonymity
- Homogeneity Attack: If all records in an equivalence class share the same sensitive value (e.g., all 4 patients in an age/ZIP bucket have Flu), an attacker knows with 100% certainty the victim has Flu.
- Background Knowledge Attack: An attacker combining domain knowledge with -anonymized data can narrow down possibilities (e.g., knowing an individual's diet or lifestyle can eliminate specific diagnoses).
- Vulnerable to High Dimensions: In datasets with many attributes ("curse of dimensionality"), achieving -anonymity requires heavy data suppression, destroying utility.
2. -Diversity
Extends -anonymity by requiring that each equivalence class contains at least "well-represented" distinct values for each sensitive attribute.
- Fixes: Mitigates the homogeneity attack by ensuring diversity among sensitive values in each group.
- Limitations:
- Skewness Attack: If a sensitive attribute is rare overall (e.g., 99% negative, 1% positive), forcing equal representation can distort real distributions.
- Similarity Attack: If the sensitive values are semantically similar (e.g., Stomach Cancer, Colon Cancer, Gastric Ulcer), the attacker still learns the general condition.
3. -Closeness
Extends -diversity by requiring the distance between the distribution of a sensitive attribute within any equivalence class and the global distribution of that attribute in the entire dataset to be no more than a threshold (using Earth Mover's Distance).
- Benefit: Prevents attribute disclosure by preserving the natural background distribution across all groups.
4. Differential Privacy (DP)
Differential Privacy is the mathematical standard for privacy-preserving data analysis. An algorithm is -differentially private if the presence or absence of any single individual's record does not significantly change the probability distribution of the query output.
Where:
- are neighboring datasets differing by at most one individual.
- (Privacy Budget): Controls the privacy-utility tradeoff. Smaller means stronger privacy but more added noise.
- : Probability of failure (usually negligible, e.g., ).
Mechanisms
- Laplace Mechanism: Adds noise drawn from to numerical query results, where is the global sensitivity of the query function .
- Gaussian Mechanism: Adds noise drawn from for -DP.
- Local DP vs. Global DP:
- Global DP: Trusted curator adds noise to query results over the central dataset (e.g., US Census Bureau).
- Local DP: Client/device perturbs data before sending it to the server (e.g., Apple iOS telemetry, Google RAPPOR).
Comparison Summary
| Model | Primary Defense | Vulnerability / Drawback |
|---|---|---|
| -Anonymity | Identity disclosure | Homogeneity attack, background knowledge |
| -Diversity | Homogeneity attack | Skewness attack, semantic similarity attack |
| -Closeness | Distribution-based inference | Loss of utility, complex to compute |
| Differential Privacy | Arbitrary auxiliary knowledge & reconstruction attacks | Requires noise tuning; complex for multi-dimensional queries |