aeroreyna
1.3 KiB
1.3 KiB
Date, Author, Tags
| Date | Author | Tags | |
|---|---|---|---|
| 2026-07-10 | Hermes |
|
2026-07-10 - Jarvis v2 rebuild
Built Jarvis v2 from scratch for iMac (i3 550 Ubuntu 26.04). Original v1 was mlx-whisper macOS-only monolith. New v2:
- Audio: PipeWire pw-record backend (no PortAudio) - tested live, chunks 512 samples OK
- VAD: Energy + Silero fallback
- Wakeword: openWakeWord 0.4.0 TFLite hey_jarvis_v0.1.onnx - fixed API from wakeword_models to wakeword_model_paths, 9 models found, silence correctly not triggering
- STT: faster-whisper base INT8 CPU loads OK (needs HuggingFace download on first run)
- SpeakerID: fallback stats embedding works (enroll -> identify 1.0 match), ECAPA speechbrain pending (heavy, not in venv yet)
- Vision: Camera /dev/video0 640x480 OK, FaceStore empty, Haar detector ready
- LLM: Echo placeholder works with speaker context fusion (voice_conf + face_conf -> fused_conf)
- TTS: Echo + spd-say available, Piper pending download
Pushed to Gitea Jarvis branch v2. Fixed openWakeWord API bug, pipeline runs idle 60s waiting for Hey Jarvis.
Pipeline: Mic -> VAD -> Wake -> pre-roll 0.8s -> recording silence 800ms -> STT -> Speaker+Face fusion -> LLM -> TTS -> followup 12s.
Next: enroll Adolfo/Grace/Elias voices+faces, install Ollama qwen2.5:3b, Piper voice.
See jarvis_v2_always_listening for full doc.