Universal Screen Drag-and-Drop Catching

How to drop files, images, PDFs, or web links anywhere on your screen for instant local parsing, auto-sorting, or triage.

Opening app file pickers or dragging files into specific UI upload boxes breaks your mental flow. Dori turns your entire desktop into a Universal Catch Target.

1. How Universal Catching Works

Dori runs a lightweight, native screen listener on macOS (app/floating-capture.tsx). Whenever you drag a file or web link across your screen:

1. A sleek drop overlay automatically appears: 📥 Drop file to capture into Dori.
2. Release the file anywhere over your screen.
3. Dori catches the item and executes local processing:
   • PDFs / Word Docs / Spreadsheets: Processed locally via embedded Markitdown into clean Markdown.
   • Audio Files & Voice Memos: Transcribed locally via embedded Whisper models.
   • Web Links & YouTube URLs: Extracted into searchable notes with key takeaways.
   • Images & Screenshots: Parsed via local OCR or multi-modal vision.

2. High-Confidence Auto-Sorting vs. Triage

Once parsed, Dori evaluates the content against your active vault memory and projects:

• High Confidence ($\ge 0.85$): If the file strongly matches a specific project or client account (e.g. mentions a project key or known client), Dori automatically files and indexes it silently into that project’s Markdown folder.
• Ambiguous or Low Confidence ($< 0.85$): If Dori isn’t completely certain where the file belongs, it routes it to the Needs You / Triage bar on your home screen. Dori suggests its best recommendation so you can confirm or re-route it with a single click.

3. Zero File Picker Dialogs

With Universal Drag-and-Drop:

• No File → Open modals.
• No navigating finder folder hierarchies.
• No copy-pasting raw text.

Just grab any file from your desktop, browser, or Slack and drop it onto Dori.

Related Guides

• Automated Triage & Confidence Thresholds — deep dive into confidence routing algorithms.
• The Floating Action Bar — system-wide hotkeys and quick capture HUD.
• Local Folder Sync — automatically monitoring folders like ~/Downloads.