Self-Redaction

Self-Redaction
Photo by Nathan Dumlao / Unsplash

Redaction is usually treated as an inference problem: given a piece of text, identify the names, addresses, phone numbers, account numbers, and other sensitive values it contains. But much operational text comes attached to a structured record. A clinical note belongs to a patient; a claim to a policyholder; a support chat to a customer. The surrounding system often already knows the facts the redactor is trying to infer.

Call the alternative self-redaction, or more precisely, record-conditioned redaction. Once the relevant person or account has been resolved, retrieve the sensitive values in its record, match them against the text, and replace them with typed tokens. Matching should handle ordinary variations in formatting and abbreviation. A general PII detector can then operate on the residual: new addresses, third-party information, and anything else absent from the record.

This has clear prior art in healthcare. The 2008 MIMIC II de-identification system matched names from structured patient records directly against associated notes, alongside dictionaries, regular expressions, and contextual heuristics. CRATE later generalized the approach, building patient-specific scrubbers from structured fields such as names, dates, addresses, phone numbers, and identifiers.

The opportunity is therefore not a new redaction primitive, but a broader design pattern. A bank can use the account and its transactions; an insurer, the policy and claim; a support system, the customer profile and any orders or shipments retrieved during the interaction. Instead of one global detector, each task gets a small, temporary set of known sensitive values.

In the public contact-center documentation I reviewed, for instance, redaction is still presented mainly as generic entity detection. I found little evidence in their documentation that the already-resolved customer record is commonly used as a first-class, per-interaction detector. That is a missed opportunity: much of what appears to be a difficult classification problem is simply a lookup problem with side information.

The implementation still requires judgment. An email address is distinctive; a first name or four-digit number may not be. Matching policy should depend on the value’s type, length, provenance, and confidence in the record linkage.

The basic principle is simple: use lookup for facts the system already knows, and inference for the rest.

Subscribe to Gojiberries

Don’t miss out on the latest issues. Sign up now to get access to the library of members-only issues.
jamie@example.com
Subscribe