Skip to main content
Syntheo does not transcribe anything itself: it sends the audio to a transcription server. If you do not have one, a ready-to-use Docker image is published: ghcr.io/willisback/syntheo-transcription. It contains NVIDIA NeMo-Speech.cpp 0.3.0 (Apache-2.0 license) and its two models, Nemotron 3.5 ASR Streaming for transcription and Nemotron 3 Diarization to tell speakers apart (OpenMDW-1.1 license). It understands French. The service runs on your computer and only listens on it (127.0.0.1). The audio does not leave the machine.

Minimum requirements

Port 9000 must be free on the machine. With exactly 4 cores, a sentence usually becomes final about 0.1 s after the pause that ends it, but that delay can occasionally reach 1 or 2 s at the start of a stream. On a processor limited to 4 cores, speaker identification can also merge two similar voices: an NVIDIA card gives better results. These figures come from the measurements below. The service was validated on Linux (x86_64). Docker Desktop on Windows and macOS has not been tried.

Install and start the service

1

Get the configuration files

Create a folder and download compose.yaml and .env.example into it:
.env.example lists the settings: API key, port, listening interface, image. Copy it to .env only if you want to change one.
2

Start

With an NVIDIA card:
On the processor alone:
On the first start, Docker downloads the image (1.8 GB with an NVIDIA card, 0.9 GB on the processor). The models are in the image: there is nothing else to download or build. The output ends with Container syntheo-transcription-nemo-speech-gpu-1 Started (or -cpu-1).
3

Check that the service answers

The answer {"capabilities":["asr","diarization"],"device":"auto","ready":true} means the service is ready: about 8 s after starting with an NVIDIA card, 3 s on the processor. docker compose --profile gpu ps (or --profile cpu) shows healthy a few seconds later.
On start, the service log shows warning: HTTP is listening beyond loopback. Inside the container, the server listens on every interface, but Docker only publishes its port on 127.0.0.1 of your computer (NEMO_SPEECH_BIND setting): the service stays unreachable from the network.

Without Docker Compose

A single command also works. With an NVIDIA card:
On the processor alone:
To require a key, add -e NEMO_SPEECH_HTTP_API_KEY=<key>. Stop and remove: docker rm -f syntheo-transcription.

Connect Syntheo to the service

1

Open the Transcription page

2

Enter the address

In “Server address”, enter http://localhost:9000.
3

Test the connection

Click “Test connection”. The status shows “Connected”: Syntheo detects the “NVIDIA NeMo-Speech.cpp” protocol and the nemotron-3.5-asr-streaming-0.6b.q8_0 model. If another protocol is selected, click “Use this protocol”.
The rest of the configuration is described in Set up transcription and AI.

Measured performance

Measurements on a Ryzen 9 9950X machine with an RTX 5080, French transcription with speaker separation. The “Ready after”, “Import” (NVIDIA card and 4 cores) and “Memory” columns come from the published image; the live meeting and the 2-core row come from an earlier measurement of the same service (same NeMo-Speech.cpp and models): A sentence ends after one second of silence: that is the setting Syntheo sends to the service. The delays above add to that second. During a meeting, Syntheo sends two streams at the same time, the microphone and the system audio: on the processor alone, plan for 4 free cores. An imported file goes in a single request. See Import a recording.

Protect access

By default, the service only listens on your computer and requires no key. To set one:
1

Fill in the key

Copy .env.example to .env if you have not already, then fill in ASR_API_KEY=<key>.
2

Restart the service

(or --profile cpu). Docker recreates the container with the key.
3

Enter the key in Syntheo

Under “Advanced”, in the “API key (optional)” field. Without it, the status shows “Key refused”.
The key protects transcription and the model list. /ready and /health stay open without a key: they are the health probes.
Only change NEMO_SPEECH_BIND (the listening interface, 127.0.0.1 by default) behind an HTTPS proxy, on a trusted network, and with a key. The service sends audio in clear text.

Stop, update, uninstall

Give the profile (--profile gpu or --profile cpu) in every command: without it, Docker Compose sees no service. The service restarts with Docker as long as you do not stop it (restart: unless-stopped).

Licenses

The image bundles NeMo-Speech.cpp (Apache-2.0, with its third-party components), the two models (OpenMDW-1.1, with their model cards) and the Ubuntu libraries it ships. Their texts are in the image’s /licenses folder, with a README.md giving the origin of each component. The image has no shell. To copy that folder to your computer:
(or -cpu-1, or syntheo-transcription with docker run).

Troubleshooting

Build the image from source

The image’s Dockerfile is in the Syntheo repository, in deploy/transcription/. It reuses the official NeMo-Speech.cpp Dockerfile at the version 0.3.0 commit, and checks the SHA-256 fingerprint of the models. Plan for about a dozen GB of disk during the build.
With an NVIDIA card, the build compiles the service for RTX 30xx to 50xx cards and the DGX Spark. For a single card it is faster: prefix the command with, for example, CUDA_ARCH=120a-real for an RTX 50xx (89-real for an RTX 40xx, 86-real for an RTX 30xx). Then start the service with the built image, named syntheo-transcription: