daily auto-sync 2026-07-10

2026-07-10 23:00:01 -04:00
parent dd7666ef96
commit 9e49fb02e0
2 changed files with 195 additions and 0 deletions
@@ -0,0 +1,26 @@
+---
+Date: 2026-07-10
+Author: Hermes
+Tags: [journal]
+---
+
+# 2026-07-10 - Jarvis v2 rebuild
+
+Built Jarvis v2 from scratch for iMac (i3 550 Ubuntu 26.04). Original v1 was mlx-whisper macOS-only monolith. New v2:
+
+- **Audio**: PipeWire pw-record backend (no PortAudio) - tested live, chunks 512 samples OK
+- **VAD**: Energy + Silero fallback
+- **Wakeword**: openWakeWord 0.4.0 TFLite hey_jarvis_v0.1.onnx - fixed API from wakeword_models to wakeword_model_paths, 9 models found, silence correctly not triggering
+- **STT**: faster-whisper base INT8 CPU loads OK (needs HuggingFace download on first run)
+- **SpeakerID**: fallback stats embedding works (enroll -> identify 1.0 match), ECAPA speechbrain pending (heavy, not in venv yet)
+- **Vision**: Camera /dev/video0 640x480 OK, FaceStore empty, Haar detector ready
+- **LLM**: Echo placeholder works with speaker context fusion (voice_conf + face_conf -> fused_conf)
+- **TTS**: Echo + spd-say available, Piper pending download
+
+Pushed to Gitea Jarvis branch v2. Fixed openWakeWord API bug, pipeline runs idle 60s waiting for Hey Jarvis.
+
+Pipeline: Mic -> VAD -> Wake -> pre-roll 0.8s -> recording silence 800ms -> STT -> Speaker+Face fusion -> LLM -> TTS -> followup 12s.
+
+Next: enroll Adolfo/Grace/Elias voices+faces, install Ollama qwen2.5:3b, Piper voice.
+
+See [[jarvis_v2_always_listening]] for full doc.