Julian Kusenberg IT Beratung

Microsoft Purview · Compliance · AI Governance

Microsoft Purview · Compliance · Data Security

The Screenshot Blind Spot

·

Microsoft Purview Data Security Investigations now supports OCR for image based content, bringing screenshots, scans, and hidden text into the investigation flow. In my first Japanese only OCR test, DSI performed surprisingly well on…

Julian Kusenberg
Microsoft Purview · Data Security Investigations · OCR

The Screenshot Blind Spot

A password in a Word document is easy to find. A password in a screenshot is where things get messy. And if that screenshot is in Japanese, Chinese, or Korean, most systems get even less reliable. In a first Japanese-only OCR test, DSI performed surprisingly well on larger printed Japanese text blocks. Not perfect, but good enough to make the blind spot visible. That is exactly why OCR in DSI matters more than it looks.

project_notes.png
⛔ Without OCR: just pixels

✅ With OCR: searchable text

Japanese-only test image used to evaluate OCR text extraction in Microsoft Purview Data Security Investigations

The Japanese-only test image I ran through DSI OCR: credentials, HR and compensation data, confidentiality markers, and external sharing restrictions, all in printed Japanese.
📌 TL;DR: the short version

Microsoft Purview Data Security Investigations now supports OCR for supported image file types. DSI extracts text from images, screenshots, and scanned content during data preparation, then vectorizes it so it surfaces in vector search and AI analysis alongside normal text. In my first Japanese-only test image, the result was surprisingly strong: most larger printed Japanese text blocks were detected well enough to preserve the investigation context, including credentials, HR information, confidentiality markers, and external sharing restrictions. The double byte angle is not theoretical. It works well enough to matter, but analysts still need to validate the output because small labels, handwritten-style text, and exact credential strings remain challenging.

01Data is not always text

Picture a typical incident. A risky user shared several files externally. Some Office docs, some PDFs, some Teams messages. And somewhere in the noise, a screenshot called project_notes.png. No obvious name. No label. No structured metadata. Just an image.

But inside that screenshot there is an investigation memo with a username, a password, an access level, and the words „confidential“ and „internal test use“, all in Japanese.

調査メモ  (investigation memo)
機密情報  (confidential information)
ユーザー名: julian.demo
パスワード: Test2026!JP  (password)
アクセス権限: 機密
内部テスト用

Without OCR this is just pixels. With OCR it becomes searchable, analyzable content. With AI based analysis in DSI it becomes part of the broader incident context. That is the shift.

Before OCR

The screenshot is an opaque image. No keyword match, no classification, no place in the AI pipeline. The credentials stay invisible.

After OCR

Text is extracted during data prep, vectorized, and discoverable through vector search and categorization. The credentials enter the investigation.

02The surprising part: Japanese worked better than expected

Most DLP, classification, and investigation workflows behave well when data is English, Latin script, and full of obvious words like password, confidential, or secret. Real enterprise data is not that clean. It is multilingual, pasted into images, full of product names, project codes, credentials, HR notes, and internal comments, and in global organizations, often written in double byte character set languages.

That is why I did not only test a clean English screenshot. I created a Japanese-only investigation board with credentials, HR and compensation information, confidentiality markers, external sharing restrictions, tokens, and case notes. The result was honestly better than expected. DSI OCR extracted most of the larger printed Japanese text blocks and kept enough context to identify the relevant risk categories.

This is the important part: the Japanese content was not just detected as random characters. The output preserved meaningful signals such as 認証情報を検出 for detected authentication information, 人事機密メモ for confidential HR notes, 年収 for annual salary, 機密 for confidential, and 社外共有禁止 for external sharing prohibited. For investigation and risk discovery, that is a very positive result.

調査記録
認証情報を検出
利用者名: julian.kusenberg
パスワード: P@ssw0rd!Demo2026
APIキー: sk-test-9A7B-2C4D-8E1F
アクセス区分: 制限付き

人事機密メモ
年収: 12,500,000円
評価区分: 機密
共有区分: 社外共有禁止

In a rough, non-scientific review of the OCR output, I would describe the result as over 80% field-level usable accuracy across the full complex image, and significantly higher for larger printed structured text blocks. That is not a benchmark. It is a practical observation from one deliberately messy test image. But it is enough to say: Japanese OCR in DSI is not just a checkbox feature. It can surface meaningful investigation signals.

Microsoft Purview documents support for double byte character set languages, including Simplified Chinese, Traditional Chinese, Korean, and Japanese, for sensitive information types and keyword dictionaries.
Microsoft Learn: Regex & keywords for double byte character sets

There were still issues. Some Japanese characters were misread, spaces were inserted between characters, small bottom cards were harder to interpret, and handwritten-style sticky notes performed worse. But for larger, printed Japanese content, the result was much more usable than I expected.





03What DSI OCR actually changes

DSI is not basic keyword search. It helps cybersecurity teams use generative AI to analyze and respond to data security incidents, risky insiders, and breaches, with vector search, categorization, and examination. OCR matters because image based content can now enter that pipeline. Items are vectorized when they contain text or supported image content with extractable text, and for JPEG, PNG, and scanned PDF files, OCR extracts text automatically before vectorization.

In the AI analysis experience, vector search includes content from image based items processed through OCR, so text from screenshots and scans can be found alongside normal text based content. Vector search can also work across multiple languages.
Microsoft Learn: Use AI analysis in Data Security Investigations

The real story is not „OCR can read an image.“ It is OCR can move previously invisible image content into the investigation flow.

04Why it matters for breach & insider risk

In many investigations, the critical detail is not in the obvious place. It hides inside images and scans.

🔑

Credential screenshots

A folder that looked like low value material suddenly contains passwords and access details.

🖋️

Scanned signed docs

Contracts and signatures locked inside image-only PDFs that looked unsearchable.

📋

Whiteboard photos

Architecture, secrets, and project names captured on a phone and shared.

💬

Embedded Teams images

Sensitive content pasted into chat as a picture instead of text.

In a breach, this changes the impact assessment. In an insider case, the difference between „user shared some files“ and „user shared screenshots containing access details“ is massive. DSI mitigation already covers resetting exposed credentials, containing exposure, removing external sharing links, remediating documents, and tracking actions. OCR makes that workflow realistic by surfacing content hidden inside images.

05Supported image formats

A meaningful test should not stop at one perfect PNG. Microsoft lists these formats as supported for file identification, metadata extraction, and OCR text extraction in DSI:

BMPEMFGIFJPEG / JPGPNGSVGTIFF / TIFDWG / DXFWMF

A better test set includes screenshots, compressed images, scans, technical diagrams, embedded visuals, multilingual images, and different file formats.

06DSI OCR ≠ tenant level Purview OCR

This distinction is important.

🏢

Tenant level OCR

Optional, requires pay as you go setup, and runs across Exchange, SharePoint, OneDrive, Teams, Windows, and macOS. Existing DLP, records management, and insider risk policies can then act on image content.

🔎

DSI OCR

Part of adding items to an investigation scope. The automatic OCR processing is not an additional charge, but the investigation still consumes storage and compute.

To use OCR scanning at tenant level, a Global admin must verify an Azure pay-as-you-go subscription is in place. Because it is optional, billing must be set up before OCR can be enabled.
Microsoft Learn: Learn about optical character recognition in Microsoft Purview

Billing in DSI is based on the combination of stored data volume and AI capacity. Storage is billed per gigabyte per month; compute is measured in Data Security Investigation Compute Units.
Microsoft Learn: Billing models in Data Security Investigations

Clean wording: DSI OCR does not create an additional OCR charge, but DSI investigations can still consume storage and compute units.

07This is not a DLP replacement

OCR in DSI is useful, but it does not replace DLP, sensitivity labels, classification, or governance. DLP is about prevention and control. DSI is about investigation, analysis, and mitigation. OCR simply makes the investigation more complete, and helps answer a question too few organizations ask: what sensitive information are we missing because it is stored as an image?

08Good signal, not perfect truth

The Japanese-only test was a good reminder that OCR does not have to be perfect to be valuable. For investigations, the first question is often not „did OCR extract every character perfectly?“ The first question is „did OCR make previously invisible content visible enough to investigate?“ In this case, the answer was clearly yes.

The larger Japanese printed text blocks were surprisingly well detected. DSI preserved enough meaning to identify credentials, HR information, confidentiality markers, salary context, and external sharing restrictions. That is a strong signal for analysts and a very positive result for multilingual investigations.

But exact extraction is a different standard. Credential-like strings, API keys, employee IDs, small labels, handwritten-style notes, and visually dense areas still showed OCR errors. For example, single-character mistakes in a password, token, or employee number can be critical if the goal is exact value extraction.

AI generated results may not always be accurate or complete and should be verified carefully.
Microsoft Learn: Responsible AI FAQ for Data Security Investigations

So my takeaway is positive but realistic: DSI OCR looks promising for Japanese risk detection and investigation context. It should not be treated as a perfect transcript engine. Analysts still need to validate the original evidence, especially when exact values matter.

09What I would test first

I would not start with a clean English screenshot. I would start with messy, realistic content: credentials, real business app screenshots, mixed-quality scans, internal project names, personal data, and Japanese, Chinese, and Korean text. A strong test example mixes scripts and risk categories:

Password: Test2026!
パスワード: Test2026!JP
Confidential
機密情報
Annual salary
年収: 12,500,000円
External sharing prohibited
社外共有禁止

That is much closer to real life than a perfect sample file with one English keyword in the middle. The key lesson from my first Japanese-only test is simple: do not only test whether OCR sees text. Test whether it preserves enough context to make the data security risk visible.

The most dangerous data is not always hidden in dark corners. Sometimes it sits in plain sight: inside a screenshot, a scan, an image pasted into Teams. DSI OCR brings those contents into view. And based on my first Japanese-only test, it can do this surprisingly well for larger printed Japanese text. The analyst still makes the call. But at least now, the screenshot can become part of the investigation.

© Julian Kusenberg. Personal blog and independent views.
Microsoft Purview · Compliance · AI Governance

Autor

  • Julian Kusenberg

    Julian Kusenberg ist Senior Consultant bei SoftwareOne und unterstützt Unternehmen bei der Implementierung von Microsoft Purview, insbesondere in den Bereichen Information Governance, Datenschutz und Insider Risk Management. Mit langjähriger Erfahrung in der Umsetzung von Compliance- und Datenschutzlösungen hilft er Organisationen, regulatorische Anforderungen in Microsoft-365-Umgebungen effizient zu erfüllen. Seine Expertise umfasst komplex eDiscovery- und Forensikprojekte, bei denen er technisches Know-how mit strategischer Beratung kombiniert.

Mehr Microsoft Purview Insights?

Ich teile regelmäßig Gedanken zu Microsoft Purview, eDiscovery, Insider Risk Management, Data Security, Compliance und AI Governance.

Kommentare

Schreibe einen Kommentar

Deine E-Mail-Adresse wird nicht veröffentlicht. Erforderliche Felder sind mit * markiert