From 9d6d29f0bd66ef53b62d3b089406c654c2f3d766 Mon Sep 17 00:00:00 2001 From: aeroreyna Date: Thu, 16 Jul 2026 18:58:11 -0400 Subject: [PATCH] Document Hermes Ink Chat prototype loop --- projects/remarkable_hermes_communication_app.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/projects/remarkable_hermes_communication_app.md b/projects/remarkable_hermes_communication_app.md index b3b334a..5356722 100644 --- a/projects/remarkable_hermes_communication_app.md +++ b/projects/remarkable_hermes_communication_app.md @@ -37,7 +37,11 @@ Initial SSH-based proof of concept works. - `ABS_PRESSURE`: `0..4096` - `ABS_DISTANCE`: `0..65535` - `ABS_TILT_X/Y`: `-9000..9000` -- Next implementation should use a native C++ pen input reader for `/dev/input/event2` and a throttled/custom painted item instead of reparsing/repainting a QML Canvas on every move. +- Native C++ pen app now reads `/dev/input/event2`, maps marker coordinates through full-screen-to-local drawing-area offset, gates drawing on `BTN_TOUCH` or `ABS_PRESSURE >= 80` so hover/proximity does not draw, and throttles repaint to reduce e-paper churn. +- `Send to Hermes` saves SVG ink to `/home/root/hermes-chat/outbox/ink-native-*.svg` and updates `/home/root/hermes-chat/outbox/latest.txt`. +- Pulled latest SVG from tablet, converted to PNG, and Hermes vision read the handwriting as: `Hey there Pal!` +- App build `bd5b992d...` adds inbox polling: it checks `/home/root/hermes-chat/inbox/response.txt` every ~2s and updates the console when Hermes writes a response. +- Remaining work: create the automatic bridge loop that watches/pulls `latest.txt`, sends the image to Hermes/OCR, and writes `/home/root/hermes-chat/inbox/response.txt`; current test response was written manually. Hermes can: - Connect to the reMarkable via SSH alias `remarkable`.