Castellan
The Envoy
HouseholdWorks with you
What others say in your voice chats, captioned in your language.
While you're in a voice chat (Discord, TeamSpeak, Mumble), it writes down what the others say and translates it into your language with the local AI on your NPU (on the processor, more slowly, without one), with captions on its page and over your game. Live captions for deaf and hard-of-hearing players too. It does nothing while no call is on, and keeps nothing said.
The lord's envoy spoke for the household at other courts, and carried their words back in the household's own tongue.
How it works
In the call
- Player 1Speaking Spanish
- Player 2Speaking German
- Player 3Speaking English
Envoy captions
- Player 1: Push left, I'll cover you
- Player 2: Two on the bridge
- Player 3: Out of ammo
- Nothing said is kept
An example: the names and numbers are made up.
Documentation
What's new
Every release0.1.5
On a PC with an Intel Core Ultra, Envoy turns speech into text on Intel's NPU.
What's new
- Envoy hears voice chat on Intel's NPU (Core Ultra: Meteor Lake, Arrow Lake, Lunar Lake, Panther Lake and Wildcat Lake), as it already did on Snapdragon PCs.
- The first time, it fetches Intel's NPU runtime (OpenVINO, about 118 MB) and prepares the speech model for your NPU, behind the "setting up" note.
- Only PCs with an Intel NPU fetch it.
- When speech has to run on the processor, the page now names the real reason: no NPU, an NPU Envoy can't use yet (AMD's), or an Intel NPU driver that's too old, with the version it needs.
envoy speech-checktests speech on your PC's NPU from start to finish. It fetches what's needed, prepares the model, transcribes a short clip in Windows' own voice, checks the words, and ends with PASS or FAIL and the timings.
What changed
- Snapdragon PCs work as before, through Qualcomm's NPU runtime.
Before you update
- Nothing: it updates itself as usual. On an Intel PC, Envoy fetches and prepares Intel's runtime once after the update, with a "setting up" note in Manor meanwhile.