2026-04-23T11-22-15Z__iter_03
4/23/2026, 11:22:15 AM · 1 flow · 159,140ms total
clean All settings match production defaults (app_defaults.yaml asOf 2026-04-19).
Build provenance
App
1.4·3
com.flashcopy.app.dev
Git
8ef32bfcc2
feature/ocr-v2-structured-lambdas · dirty
Sim
AAC26DF1…
com.flashcopy.app.dev
Built at
4/22/2026, 12:12:39 PM
video
Input media
No media file found for this input.
IMG_4558.mov37.21 MBsha256 96059437ee…
Input id
BBBB0003
Total
159.14s
Output
485 words
5036 chars
Cost est
$0.00145
gemini-2.5-flash · basis: chars
in 9,275 · out 2,518 tok
Stage timings
frame-extraction
0ms
s3-upload
4.54s
cloud-processing
154.60s
Stage details
| frame-extraction | model gemini-2.5-flash frames 28 |
| s3-upload | bucket qr-video-ocr-frames |
| cloud-processing | lambda backgroundProcessor model gemini-2.5-flash persisted true chars 5036 |
Extracted text
485 words · 5,036 charspolish json parsed
// src/extension.ts
import * as vscode from "vscode";
import * as aws from "aws-sdk";
export function activate(context: vscode.ExtensionContext) {
const disposable = vscode.commands.registerCommand(
"qrcode-extension.openQRCodePanel",
() => {
// 1) Create the webview as before
const panel = vscode.window.createWebviewPanel(
"qrCodePanel",
"QR Code + Data Viewer",
vscode.ViewColumn.One,
{ enableScripts: true }
);
// 2) Generate a session ID
const sessionId = Date.now().toString();
// 3) Notify server about this ses…Prompts used
all prompts → frame_ocr gemini-2.5-flash 66326cc5be… · 81 chars
Perform OCR on this image and return plain text only. Do not describe the image.
qr_reader_v1/frame_ocr_lambda.py:31
video_polish gemini-2.5-flash structured JSON sha n/a · 898 chars
Please stitch together the OCRs that are taken from individual screenshots/frames from a video. There should be overlapping lines which can be used as a marker for when one frame ends and another begins. Please do not alter the content in any way besides stitching the content together and please add correct indentation. Do not alter or add any content.
Your final output must be a single, valid JSON object and nothing else. The JSON object must conform to the following structure:
{
"stitched_response": "(string) This key must hold the final, fully reconstructed and cleaned document text.",
"additional_notes": "(string) Use this field to briefly describe your process. Mention any significant noise you filtered out (e.g., 'Removed text from a Save As dialog box') or any ambiguities you encountered during the reconstruction."
}
Here is the raw OCR text from video frames:
{raw_text} qr_reader_v1/video_ocr_polishing_lambda_rest.py:102
Output diff
vs 2026-04-23T11-17-41Z__iter_03 Diff+4 words−4 words=481 unchanged·99.2% similar (by char)(prior run 2026-04-23T11-17-41Z__iter_03 → this run)
// src/extension.ts import * as vscode from "vscode"; import * as aws from "aws-sdk"; export function activate(context: vscode.ExtensionContext) { const disposable = vscode.commands.registerCommand( "qrcode-extension.openQRCodePanel", () => { // 1) Create the webview as before const panel = vscode.window.createWebviewPanel( "qrCodePanel", "QR Code + Data Viewer", vscode.ViewColumn.One, { enableScripts: true } ); // 2) Generate a session ID const sessionId = Date.now().toString(); // 3) Notify server about this session fetch("http://localhost:3000/init-session", { method: "POST", headers: { "Content-Type": "application/json" }, body: JSON.stringify({ sessionId }), }).catch((err) => { console.error("Failed to init session with server:", err) }); // 4) Provide minimal HTML that shows the QR code and polls for scan panel.webview.html = getWebviewContent(sessionId); // 5) Listen for messages FROM the webview panel.webview.onDidReceiveMessage(async (message) => { if (message.command === "scanned") { const { s3Url } = message; try { // Fetch the file from S3 (public or private) const fileContent = await fetchFromPublicS3Url(s3Url); // Extract the base name (no extension) from the S3 URL const baseName = pickBaseFilenameNoExtension(s3Url); // e.g. "22_generate_parenthesis" from "22_generate_parenthesis.py" // Create an untitled document with no extension // e.g. "untitled:22_generate_parenthesis" const untitledUri = vscode.Uri.parse( `untitled:${baseName}` ); // Open the doc const doc = await vscode.workspace.openTextDocument( untitledUri ); const editor = await vscode.window.showTextDocument( doc ); // Paste the content await editor.edit((editBuilder) => { editBuilder.insert( new vscode.Position(0, 0), fileContent ); }); // Optionally close the panel panel.dispose(); } catch (err) { console.error( "[Extension] Error fetching data from S3: ", err ); vscode.window.showErrorMessage( "Failed to load file from S3." ); } } }); } ); context.subscriptions.push(disposable); } // Fetch from public S3 URL async function fetchFromPublicS3Url(url: string): Promise<string> { const response = await fetch(url); if (!response.ok) { throw new Error(`Fetch to ${url} returned status ${response.status}`); } return response.text(); } /** * Extract the final filename from the S3 URL, then remove the extension. * e.g. "https://bucket.s3.amazonaws.com/foo/bar/22_generate_parenthesis.py" * -> "22_generate_parenthesis.py" -> "22_generate_parenthesis" */ function pickBaseFilenameNoExtension(url: string): string { try { const lastPart = url.split("/").pop() ?? "untitledFile"; // Remove dot extension if present // This regex removes the last .xyz portion, if any const baseName = lastPart.replace(/\.[^.]*$/, ""); return baseName || "untitledFile"; } catch { return "untitledFile"; } } // Minimal HTML function getWebviewContent(sessionId: string): string { return `<!DOCTYPE` <!DOCTYPE html> <html> <head> <meta charset="UTF-8" /> <title>QR Code Demo</title> <script src="https://cdn.jsdelivr.net/npm/qrcode@1.5.1/build/qrcode.min.js"></script> </head> <body> <h2>My QR Code (Session: ${sessionId})</h2> <canvas id="qrcode"></canvas> <div id="status"></div> <script> const vscode = acquireVsCodeApi(); const sessionId = "${sessionId}"; QRCode.toCanvas(document.getElementById('qrcode'), sessionId, (err) => { if (err) console.error(err); console.log("QR code rendered!"); }); async function checkForScan() { try { const res = await fetch("http://localhost:3000/check-scan", { method: "POST", headers: { "Content-Type": "application/json" }, body: JSON.stringify({ sessionId }), }); const data = await res.json(); if (data.scanned) { document.getElementById("status").innerText = "Scanned! Opening file..."; vscode.postMessage({ command: "scanned", s3Url: data.s3Url, }); } else { document.getElementById("status").innerText = "Not scanned yet. Polling again in 5s..."; setTimeout(checkForScan, 5000); } } catch (err) { console.error(err); document.getElementById("status").innerText = "Error polling server. Retrying in 5s..."; setTimeout(checkForScan, 5000); } } checkForScan(); </script> </body> </html>`;</html> `; }
Video credit reconciliation
1 credit / frame Frames
28
Charged
28
Expected (1/frame)
28
Current app bills by duration seconds; at fps=1.0 frames == seconds so this matches by accident. Any non-1.0 fps surfaces a mismatch.
Run settings
Show all 20 values
{
"videoFramesPerSecond": 1,
"videoStitchingMethod": "gemini_only",
"videoPipelineMode": "s3_parallel",
"useBackgroundVideoProcessing": true,
"rekognitionThreshold": 80,
"geminiModel": "gemini-2.5-flash",
"photoOcrPromptSha": "48496a3017a2708a92d142281c5ab19f64f8132555514a00cbc35ca9d39daeba",
"frameOcrPromptSha": "66326cc5be6bdd434dbbdd330b519e26bd8bbcab4a6037a64c2148b66cd2aceb",
"imageRetentionHours": 24,
"bypassImageSaveConfirmation": true,
"bypassProcessingResultWindow": true,
"enableAnalytics": true,
"confirmCollectionReset": true,
"enableNotifications": false,
"autoProcessImages": true,
"includeBrandingInSharedText": true,
"autoSavePhotos": true,
"multiPhotoSeparator": "double_line",
"showDebugInfo": false,
"headerFooterStyle": "equals"
}