By · Last updated 2026-04-03

Rudi kwa BlogKitaalamu

Kodi ya Taarifa Potofu kwenye Zana za PII

Mjadala wa GitHub wa Presidio #1071 unaandika taarifa potofu za kimfumo. Utafiti wa 2024 uligundua usahihi wa 22.7% katika datasets za biashara za lugha nyingi.

April 3, 20268 dakika kusoma
false positive ratePresidio precisionPII detection accuracyscore threshold configurationhybrid detection

Kodi ya Taarifa Potofu kwenye Zana za Ugunduzi wa PII

Imesasishwa kwa 2026

Zana nyingi za PII zinapimwa kwa kumbukumbu. Kumbukumbu inapima sehemu ngapi ya PII halisi zana inapata. Lakini usahihi pia una umuhimu sawa. Usahihi unapima sehemu ngapi ya tahadhari za zana ni PII halisi.

Usahihi wa chini ni ghali. Mfumo wenye kumbukumbu ya 95% na usahihi wa 22.7% unakamata PII nyingi. Lakini kwa kila kitengo halisi cha PII kinachowekwa alama, pia hunua tahadhari 3.4 potofu. Katika dataset yenye vitengo 10,000 vya PII halisi, mfumo huo unawasha tahadhari takriban 44,000. Takriban 34,000 kati yao ni potofu. Kila moja inahitaji muda wa kupitiwa au inasababisha ufutaji wa kupita kiasi.

Hii ndiyo kodi ya taarifa potofu. Ni mzigo wowote timu inaoubeba wakati wa kuendesha mfumo wa PII wenye kumbukumbu kubwa lakini usahihi mdogo kwa kiwango kikubwa. Gharama ya moja kwa moja ni muda wa mpitio. Gharama ya moja kwa moja ni mbaya zaidi: hati zilizofutwa kupita kiasi zinaficha data muhimu, zinakawamisha kazi, na zinadhoofisha imani kwa zana.

Kinachoonekana katika Suala la Presidio #1071

Mjadala wa GitHub wa Microsoft Presidio #1071 (2024) unarekodi mfumo maalum. Vitambulisho vya TFN (Tax File Number) na PCI vinatumia uthibitishaji wa jumla. Nambari zinazopita jumla hupokea alama ya 1.0 -- imani ya juu kabisa. Muktadha wa PII hauhitajiki.

Sababu ya msingi: ukaguzi wa maneno ya muktadha hufanyika baada ya hatua ya jumla, si kabla. Nambari inayopita jumla hupata alama ya juu bila kujali maandishi yanayoizunguka. Katika lahajedwali za fedha, datasets za kisayansi, au faili za kumbukumbu, hii inajaza matokeo na tahadhari potofu. Uchujaji wa kizingiti cha alama hauwezi kurekebisha hili. Alama tayari ziko kiwango cha juu kabisa.

Mfumo wa pili unaonekana katika suala la Presidio #999. Usegmentaji wa maneno ya Kijerumani unashindwa kwa nomino zinazounganishwa. Maneno kama Bundesbehorde (mamlaka ya shirikisho) yanaweza kugawanywa kwa makosa na kuandikwa alama kama majina ya kibinafsi. Hii inaongeza kelele katika hati yoyote ya Kijerumani.

Tatizo la Usahihi wa 22.7%

Alvaro et al. (2024) walijaribu Presidio kwenye datasets za biashara za lugha nyingi. Waligundua usahihi wa 22.7%. Katika hati halisi, chini ya moja kati ya nne ya tahadhari za Presidio ni kitengo halisi cha PII. Hii inalingana na kile wataalamu wanaripoti. Zana iliyoratibishwa kwa kumbukumbu peke yake inazalisha kelele nyingi sana kwa matumizi ya uzalishaji.

Utafiti wa DICOM wa 2024 ulionyesha kwamba kuinua score_threshold hadi 0.7 bado kuliacha tahadhari potofu katika picha 38 kati ya 39 za matibabu. Kizingiti kinachoondoa kelele katika aina moja ya hati huunda makosa katika nyingine.

Hii si tatizo la Presidio peke yake. Kizingiti chochote cha kudumu kinalazimisha biashara. Kizingiti kikubwa hukata kelele lakini kinaongeza makosa. Kizingiti kidogo huinua kumbukumbu lakini kinafurika idadi ya tahadhari.

Upimaji wa Alama Unaozingatia Muktadha

Urejesho ni upimaji wa imani unaozingatia muktadha. Badala ya kupima kulingana na ulinganisho wa mfumo peke yake, mfumo huinua imani wakati maneno ya muktadha yanaonekana karibu na ulinganisho. Pia hupunguza alama wakati muktadha hauko.

Kwa ugunduzi wa TFN: maneno kama "tax file number," "TFN," au "Australian tax" karibu na nambari huinua alama yake. Nambari inayopita jumla lakini haina maneno ya muktadha karibu inapata alama chini ya kizingiti cha mapitio. Tahadhari ya bandia inazuiwa.

Kwa kelele ya lugha nyingi: aina za vitengo zinazohusu nchi maalum zinaweza kupewa upeo kwa hati katika lugha inayolingana. Kitambulishi cha TFN kilichopewa upeo kwa Kiingereza na Kiingereza cha Australia huondoa kelele. Kukiendesha kwenye maudhui ya Kijerumani bila upeo ndiyo chanzo cha tatizo.

Tabaka la tatu katika mfumo wa mseto ni mfano wa transformer. Inasoma dirisha kamili la muktadha karibu na kila mgombea. Inabainisha tofauti kati ya "John Smith, Patient ID 12345" na msimbo wa bidhaa unaolingana na mfumo wa jina. Muktadha hutatua utata ambao regex na jumla haiwezi.

Angalia jinsi injini ya ugunduzi ya tabaka tatu inavyoshughulikia usahihi kwa kiwango kikubwa. Mwongozo wa ugunduzi wa PII wa lugha nyingi unashughulikia jinsi kelele ya lugha nyingi inavyoathiri uzingatiaji wa GDPR.

Hatua za Vitendo

Kabla ya kupeleka zana yoyote ya PII, pima usahihi wake -- si kumbukumbu peke yake.

Endesha zana kwenye seti ya hati yenye PII inayojulikana na PII isiyojulikana. Hesabu tahadhari katika vikundi vyote viwili. Hesabu true_positives / (true_positives + false_positives). Nambari hii inafunua mzigo wa mapitio kabla ya kujitolea kwa upelekaji.

Kwa timu zinazotumia Presidio tayari, uchambuzi wa usambazaji wa alama ni njia ya haraka. Hamisha sampuli ya ugunduzi na alama zao za imani. Hesabu ni ngapi zinapata alama chini ya 0.6, 0.7, na 0.8. Sehemu kubwa ya tahadhari za alama za juu katika maandishi safi inaashiria pengo la muktadha, si tatizo la kizingiti. Muhtasari wa uzingatiaji wa usalama unaeleza jinsi ya kuandika hili katika DPIA.

Vyanzo

Tayari kulinda data yako?

Anza kuanonymisha PII na aina 285+ za vitu katika lugha 48.

About this page

We update this page when our platform or the law changes.

Read our founder note for how we work.

Each change shows up in the timestamp at the top.

Related reading

We follow these rules

  • GDPR (EU 2016/679).
  • ISO/IEC 27001:2022.
  • NIS2 (EU 2022/2555).
  • HIPAA safe harbor under 45 CFR § 164.514(b)(2).

Our promise

We do not sell your data.

We do not train models on your text.

We store your files in Germany.

You can delete your account at any time.

You own your work.

Where we run

Our servers live in Falkenstein, Germany.

We use Hetzner. They hold ISO 27001 certification.

All data stays in the EU.

Backups run every day.

Need help?

Email support@anonym.legal.

We reply within one business day.

How we test

We run a full check suite on every release.

Each surface gets its own sweep script and report.

Human reviewers spot-check the output each week.

We track recall and precision on a labelled set.

Bad runs block the deploy.

What we never do

  • We never sell your information to third parties.
  • We never train models on what you upload.
  • We never keep your work after you delete it.
  • We never share keys with any outside firm.
  • We never run ads inside the product.

Plans in plain words

We sell credits, not seats.

One credit covers one short job.

Long jobs use a few credits each.

You can top up at any time.

Unused credits roll over each month.

Read the plans page for current rates.

Who built this

A small team of engineers and lawyers built this.

We ship from Europe and work in the open.

Our founder note spells out why we started.

Where to start

How the parts fit

A browser add-on cleans text inside Chrome.

A Word plug-in handles drafts in Office.

A small desktop tool works on whole folders.

An agent protocol link feeds large models safely.

All four share one core engine and one rule set.

Words from our team

We started this work after a lunch about cookies.

One friend kept getting odd ads on her phone.

We asked why a court file leaked through a draft.

We sketched the first build on a napkin that week.

By month three we had a tiny demo for a friend.

She used it on her first case the next day.

Common questions we hear

Can the tool read scanned PDFs? Yes, with OCR.

Does it work on long files? Yes, in small chunks.

Can I roll my own rule set? Yes, save it as a preset.

Does it run offline? The desktop build runs offline.

Do you keep my files? No, the cloud build wipes after each run.

Will it learn from my work? No, we never train on inputs.

A short tour of the workflow

Upload a file or paste a snippet of prose.

Pick the entities you want gone from the draft.

Choose a method: replace, mask, hash, encrypt, or redact.

Press run and watch the side panel show each hit.

Skim the result and tweak any rule that misfired.

Save the cleaned file or send it to a teammate.