aeroreyna
27 lines
1.3 KiB
Markdown
27 lines
1.3 KiB
Markdown
---
|
|
Date: 2026-07-10
|
|
Author: Hermes
|
|
Tags: [journal]
|
|
---
|
|
|
|
# 2026-07-10 - Jarvis v2 rebuild
|
|
|
|
Built Jarvis v2 from scratch for iMac (i3 550 Ubuntu 26.04). Original v1 was mlx-whisper macOS-only monolith. New v2:
|
|
|
|
- **Audio**: PipeWire pw-record backend (no PortAudio) - tested live, chunks 512 samples OK
|
|
- **VAD**: Energy + Silero fallback
|
|
- **Wakeword**: openWakeWord 0.4.0 TFLite hey_jarvis_v0.1.onnx - fixed API from wakeword_models to wakeword_model_paths, 9 models found, silence correctly not triggering
|
|
- **STT**: faster-whisper base INT8 CPU loads OK (needs HuggingFace download on first run)
|
|
- **SpeakerID**: fallback stats embedding works (enroll -> identify 1.0 match), ECAPA speechbrain pending (heavy, not in venv yet)
|
|
- **Vision**: Camera /dev/video0 640x480 OK, FaceStore empty, Haar detector ready
|
|
- **LLM**: Echo placeholder works with speaker context fusion (voice_conf + face_conf -> fused_conf)
|
|
- **TTS**: Echo + spd-say available, Piper pending download
|
|
|
|
Pushed to Gitea Jarvis branch v2. Fixed openWakeWord API bug, pipeline runs idle 60s waiting for Hey Jarvis.
|
|
|
|
Pipeline: Mic -> VAD -> Wake -> pre-roll 0.8s -> recording silence 800ms -> STT -> Speaker+Face fusion -> LLM -> TTS -> followup 12s.
|
|
|
|
Next: enroll Adolfo/Grace/Elias voices+faces, install Ollama qwen2.5:3b, Piper voice.
|
|
|
|
See [[jarvis_v2_always_listening]] for full doc.
|