ghcr.io/willisback/syntheo-transcription. It contains NVIDIA NeMo-Speech.cpp 0.3.0 (Apache-2.0 license) and its two models, Nemotron 3.5 ASR Streaming for transcription and Nemotron 3 Diarization to tell speakers apart (OpenMDW-1.1 license). It understands French.
The service runs on your computer and only listens on it (127.0.0.1). The audio does not leave the machine.
Minimum requirements
Port 9000 must be free on the machine.
With exactly 4 cores, a sentence usually becomes final about 0.1 s after the pause that ends it, but that delay can occasionally reach 1 or 2 s at the start of a stream. On a processor limited to 4 cores, speaker identification can also merge two similar voices: an NVIDIA card gives better results.
These figures come from the measurements below. The service was validated on Linux (x86_64). Docker Desktop on Windows and macOS has not been tried.
Install and start the service
1
Get the configuration files
Create a folder and download
compose.yaml and .env.example into it:.env.example lists the settings: API key, port, listening interface, image. Copy it to .env only if you want to change one.2
Start
With an NVIDIA card:On the processor alone:On the first start, Docker downloads the image (1.8 GB with an NVIDIA card, 0.9 GB on the processor). The models are in the image: there is nothing else to download or build. The output ends with
Container syntheo-transcription-nemo-speech-gpu-1 Started (or -cpu-1).3
Check that the service answers
{"capabilities":["asr","diarization"],"device":"auto","ready":true} means the service is ready: about 8 s after starting with an NVIDIA card, 3 s on the processor. docker compose --profile gpu ps (or --profile cpu) shows healthy a few seconds later.On start, the service log shows
warning: HTTP is listening beyond loopback. Inside the container, the server listens on every interface, but Docker only publishes its port on 127.0.0.1 of your computer (NEMO_SPEECH_BIND setting): the service stays unreachable from the network.Without Docker Compose
A single command also works. With an NVIDIA card:-e NEMO_SPEECH_HTTP_API_KEY=<key>. Stop and remove: docker rm -f syntheo-transcription.
Connect Syntheo to the service
1
Open the Transcription page
2
Enter the address
In “Server address”, enter
http://localhost:9000.3
Test the connection
Click “Test connection”. The status shows “Connected”: Syntheo detects the “NVIDIA NeMo-Speech.cpp” protocol and the
nemotron-3.5-asr-streaming-0.6b.q8_0 model. If another protocol is selected, click “Use this protocol”.Measured performance
Measurements on a Ryzen 9 9950X machine with an RTX 5080, French transcription with speaker separation. The “Ready after”, “Import” (NVIDIA card and 4 cores) and “Memory” columns come from the published image; the live meeting and the 2-core row come from an earlier measurement of the same service (same NeMo-Speech.cpp and models):
A sentence ends after one second of silence: that is the setting Syntheo sends to the service. The delays above add to that second.
During a meeting, Syntheo sends two streams at the same time, the microphone and the system audio: on the processor alone, plan for 4 free cores. An imported file goes in a single request. See Import a recording.
Protect access
By default, the service only listens on your computer and requires no key. To set one:1
Fill in the key
Copy
.env.example to .env if you have not already, then fill in ASR_API_KEY=<key>.2
Restart the service
--profile cpu). Docker recreates the container with the key.3
Enter the key in Syntheo
Under “Advanced”, in the “API key (optional)” field. Without it, the status shows “Key refused”.
/ready and /health stay open without a key: they are the health probes.
Stop, update, uninstall
Give the profile (--profile gpu or --profile cpu) in every command: without it, Docker Compose sees no service.
The service restarts with Docker as long as you do not stop it (
restart: unless-stopped).
Licenses
The image bundles NeMo-Speech.cpp (Apache-2.0, with its third-party components), the two models (OpenMDW-1.1, with their model cards) and the Ubuntu libraries it ships. Their texts are in the image’s/licenses folder, with a README.md giving the origin of each component. The image has no shell. To copy that folder to your computer:
-cpu-1, or syntheo-transcription with docker run).
Troubleshooting
Build the image from source
The image’s Dockerfile is in the Syntheo repository, indeploy/transcription/. It reuses the official NeMo-Speech.cpp Dockerfile at the version 0.3.0 commit, and checks the SHA-256 fingerprint of the models. Plan for about a dozen GB of disk during the build.
CUDA_ARCH=120a-real for an RTX 50xx (89-real for an RTX 40xx, 86-real for an RTX 30xx).
Then start the service with the built image, named syntheo-transcription: