OCR & Document IntelligenceIn Active Build

Handwritten Clinical Chart Digitization & HITL Pipeline

Multimodal Ophthalmology Extraction with Click-to-Verify HITL — Vision-language pipeline digitizing handwritten clinical charts with dense cursive handwriting, tabular IOP logs, and an interactive click-to-verify human-in-the-loop workflow.

Vision-Language Models (Gemini 3.1 Pro)Human-in-the-Loop (HITL) VerificationModel BenchmarkingFastAPIMultimodal AI

Ophthalmology HITL

In Active Build

Scribe Time Reduction:80–90%

Unit Cost / Page:~$0.012 / page

Models Benchmarked:17 Frontier AI Models

Interactive Click-to-VerifyDense Handwriting OCR

Measured Production Impact

80–90%

Scribe Time Cut

Click-to-verify flow

~$0.012

Cost / Page

17-model benchmark

Frontier Models

Rigorous evaluation

Interactive

HITL Interface

Progressive streaming

The Clinical Challenge in Ophthalmology

Ophthalmology charts present extreme digitization challenges: rapid cursive handwriting, proprietary shorthand, dense tabular IOP (intraocular pressure) logs, and physical lens (IOL) stickers attached to paper charts.

17-Model Benchmark & HITL Architecture

Benchmarked 17 frontier vision-language models for extraction accuracy vs. latency vs. cost, establishing an optimal pipeline running at just ~$0.012/page. Paired this with a progressive streaming verification interface where human reviewers click to verify low-confidence fields.

Current Milestones & Ongoing Work

Reduced scribe transcription time by 80–90%. Incorporating automated blank-page suppression and clinical range sanity checks to ensure 100% safety before EMR integration.

Key Engineering & Operational Highlights

80–90% Scribe Time Reduction: Built an interactive progressive streaming verification UI converting manual transcription into a click-to-verify flow.

Cloud Cost Optimization: Benchmarked 17 frontier AI models to establish an architecture lowering processing cost to ~$0.012/page.

High Extraction Recall: Evaluated across dense handwriting, tabular IOP logs, and surgical notes with automated medical shorthand normalization on benchmark evaluation sets.

Quality Controls & Validation: Built multi-threaded background execution with automated blank-page suppression and clinical sanity checks (IOL stickers, IOP ranges).

← All Projects Next: Custom Template AI Engine