Skip to content
AI Security & Governance

AI Data Privacy for LLM features that handle personal data

Map where personal data flows through your AI feature, remove what the model does not need, pseudonymise what it does, and keep logs and providers within your retention rules.

  • UK GDPR and EU GDPR aware
  • Works with your DPO
  • Implementation included
Who this is for

Any AI feature that touches customer, patient, employee or applicant data

LLM features create new copies of personal data: in prompts, in provider logs, in vector indexes, in traces and in model outputs. Each copy needs a purpose, a lawful basis, a retention period and an access rule. Most teams have thought about the first copy and none of the others.

Outcomes

  • A data flow map of every hop personal data takes through the feature.
  • Redaction and pseudonymisation implemented in your pipeline.
  • Provider terms, regions and retention settings verified and recorded.
  • The technical sections of a DPIA, ready for your DPO.
Data flow

Where personal data goes, and where it is removed

The pattern below is what we implement most often. Personal data is tokenised early, the model works on pseudonyms, and re-identification happens only inside your application for the authorised user.

Privacy-preserving data flow: sources feed ingestion, where PII is detected and replaced by tokens; the pseudonymised store sends only needed fields to prompt assembly; the redacted prompt goes to the model provider; logs are redacted and time-limited; the key vault holds the pseudonym map and re-identification happens only when the output is shown to an authorised user. Sources CRM, tickets, files Ingestion detect + redact PII Store pseudonymised Prompt assembly minimum fields Provider region, no training raw tokens needed fields redacted Key vault pseudonym map map, restricted Logs & traces redacted, time-limited ids, not content Output to authorised user answer re-identify in the app only, for this user, this request The provider, the logs and the index only ever see pseudonyms.
Personal data is replaced by tokens at ingestion. The model, the provider and the logs work on pseudonyms; the real values return only at the point of display.
Patterns

PII handling patterns we implement

PatternWhat it doesUse it whenWatch out for
MinimisationSend only the fields the task needs; drop the rest before prompt assemblyAlways. It is the cheapest control and the first one auditors ask about"Just send the whole record" creeping back in as features grow
RedactionReplace detected PII with a type marker such as [EMAIL] or [NAME]The model does not need the value: classification, summarisation, routingDetector misses on names, addresses and free text; test on your data, not samples
PseudonymisationReplace PII with a stable token per entity and keep the map in a vaultThe model must refer to entities consistently across a conversation or documentRe-identification must be scoped to the authorised user and logged
Field-level encryptionEncrypt sensitive columns at rest in indexes and storesVector indexes or caches hold personal data that cannot be pseudonymisedKey management and rotation; search over encrypted fields is limited
Retention rulesTime-limited storage for prompts, outputs, traces and index entriesEverywhere personal data is copied; set per copy, not per systemProvider-side retention and backups outside your deletion job
Access scopingTool and retrieval calls run as the end user, never a broad service accountAgents and RAG over records with differing access rightsService accounts that quietly accumulate scope over time
Providers

Five questions for every model provider

  • Is there a data processing agreement, and are we the controller or a processor?
  • Is our data used for training by default, and have we opted out in writing?
  • How long are prompts and outputs retained, including for abuse monitoring?
  • In which region is the data processed and stored, and can we pin it?
  • Which sub-processors are involved, and how are we told when they change?

We work with Anthropic, OpenAI, Google and open-weight models hosted on Azure, Cloudflare or your own infrastructure. The answers differ by provider and by plan; we record them in your model inventory so they are not re-researched every quarter.

DPIA support

We write the technical sections of a data protection impact assessment: processing description, data flow diagram, necessity and proportionality of each copy, risks to individuals and the controls applied. Your DPO or counsel completes the legal assessment and sign-off. The same material feeds the ISO 42001 impact assessment.

How we work

Map, minimise, implement, prove

  1. Map

    Every hop personal data takes: sources, prompts, providers, indexes, logs, outputs, backups. One diagram, agreed with your DPO.

  2. Minimise

    For each hop, decide: not needed, redact, pseudonymise or keep with controls. Record the reasoning.

  3. Implement

    Detection and tokenisation in the pipeline, vault and re-identification service, log redaction, retention jobs, provider settings.

  4. Prove

    Tests that assert no raw PII reaches the provider or logs, run in CI. DPIA technical sections and inventory updated.

FAQ

Frequently asked questions

Do we need a DPIA for an LLM feature?

Often, yes. A data protection impact assessment is expected where processing is likely to result in high risk to individuals, and new technology applied to personal data is a classic trigger. We produce the technical half of the DPIA: data flows, risks, controls. Your DPO or counsel owns the legal assessment.

Is it safe to send customer data to a model provider?

It can be, with the right terms and controls: a data processing agreement, no training on your data, a defined retention period, a known region, and redaction of what the task does not need. We check all five before any production call.

Redaction or pseudonymisation: which should we use?

Redaction when the model does not need the value at all. Pseudonymisation when the model needs to refer to an entity consistently, for example 'Customer 4821' across a conversation, with re-identification only in your application for authorised users.

Should we run models on-premise to avoid the question?

Sometimes. Open-weight models hosted in your own environment remove the provider transfer but add operational cost and narrow your model choice. Our on-prem versus cloud guide walks through the decision.

What about data in logs and traces?

Most privacy incidents happen in logs. We redact prompts and outputs at the logging layer, keep chunk and record identifiers instead of content, restrict access and set a retention limit that matches your policy.

Talk to us about your AI project

Tell us what you are trying to do, which systems are involved and what is in the way. We reply within one business day with an opinion and a suggested next step.