Hugging Face's logo
NAMLV's picture

NAMLV

NAMANDREWLV
·

AI & ML interests

None yet

Recent Activity

reacted to MikeDoes's post with ❤️ about 5 hours ago
What happens when PII masking is treated as a trainable behavior, not just a detection task? A new reinforcement learning environment tackles this question using a dataset derived from ai4privacy/open-pii-masking-500k-ai4privacy, transformed into a verifier-based training and evaluation setup. Instead of evaluating PII masking as a one-off redaction step, this environment frames privacy as something models must consistently optimize for under feedback. The task requires models to correctly identify sensitive spans, replace them with [PII] tags, and comply with strict output formatting — all scored through explicit reward signals. To make this realistic, the author filtered and normalized the dataset to focus on US-English examples, ensuring consistent masking targets while preserving the structural diversity needed to expose failure modes. What's notable here isn't just the environment itself, but the shift in perspective. By turning PII masking into a reinforcement learning problem, privacy stops being a static rule and becomes a behavior models are trained to maintain even under optimization pressure. This is a strong example of how open privacy datasets can move beyond benchmarks and become infrastructure for new learning paradigms. 🔗 Explore the PII Masking RL environment on Prime Intellect: https://app.primeintellect.ai/dashboard/environments/adamlucek/pii-masking
reacted to MikeDoes's post with ❤️ about 5 hours ago
PII leakage isn't just a model problem — it's a data problem. A recent paper takes a hard look at how well current systems actually detect and redact personal data at scale. One of their key conclusions is something the privacy community keeps rediscovering: without large, structured, and diverse PII datasets, evaluation collapses into guesswork. To ground their experiments, the authors benchmarked their approach using the 500K PII-Masking dataset from AI4Privacy, leveraging its scale and coverage to test real-world redaction behavior rather than toy examples. What's interesting here isn't just the model performance — it's what the evaluation reveals. The paper shows that many systems appear robust under narrow tests but fail once PII appears in varied formats, contexts, and combinations. This gap between "works in theory" and "works in practice" is exactly where privacy risks emerge. This is the value of open, research-grade datasets: They expose failure modes early They make comparisons reproducible They let the community measure progress honestly When researchers build on shared data foundations, everyone benefits — from academic insight to safer downstream applications. 🔗 Read the full paper here: https://arxiv.org/abs/2407.08792
published a dataset about 1 month ago
NAMANDREWLV/pii-masking-95k-preencoded
View all activity

Organizations

Ai4Privacy's profile picture VNCYBERS., JSC's profile picture