Significative delay in real time mic input about rnnoise HOT 13 OPEN

@jmvalin thanks for the details. I'm trying in this case the AudioContext in the browser and your model converted via emscripten.

When using ScriptProcessorNode, its buffer size needs to be at least 512 (minimum allowed is 256) to avoid glitches because it runs on a different thread than the AudioContext. Since 512 > 480, the intrinsic latency becomes 512 + 512 == 1024, i.e. 21.333ms.
To reduce the latency by 8ms, use AudioWorkletProcessor which runs on the same thread as the AudioContext. Currently, its buffer size is fixed at 128. Since minimum multiples of 128 not less than 480 is 512 again, the intrinsic latency becomes 512 + 128 == 640, i.e. 13.333ms.

Here is an example in WASM that uses AudioWorkletProcessor when available and falls back to ScriptProcessorNode: https://github.com/wegylexy/rnnoise_wasm/tree/master/src

Demo: https://rnnoise.timtim.hk/demo/

from rnnoise.

The code itself causes exactly 10 ms delay. Anything else you see comes from your implementation (most likely how you access the soundcard).

from rnnoise.

@jmvalin thanks for the details. I'm trying in this case the AudioContext in the browser and your model converted via emscripten.

from rnnoise.

@loretoparisi the online demo purposely inserts a delay to make it easier to listen to the denoised output.

from rnnoise.

@mbebenita ah so! that makes sense then!!! So it's something on the output buffer?

from rnnoise.

@loretoparisi you can probably tweak the bufferSize in https://people.xiph.org/~jm/demo/rnnoise/record.js

RNNoise is pretty fast, the reason we did this in the demo was because it was impossible to hear your own speech being denoised as you were taking.

from rnnoise.

@loretoparisi @mbebenita @jmvalin I have tried realtime in python using sound device library which is giving me 2.5 seconds delay. In this i am running rnnoise as subprocess from python code.

I am very new to javascript can you please tell me steps to do in javascript using emscripten.

Thanks in advance

from rnnoise.

@venkat-kittu I have asked to the authors here #32
Basically they have a compiled emscripten in the repository, but there is no docs how to generate it

from rnnoise.

Then how i can do live in javascript or python?

from rnnoise.

@loretoparisi any idea how to convert rnnoise model to use in browser ? like I saw noise.js in their demo but how are they initializinf weights in it if I want it finetune this model and use it there ?

from rnnoise.

@vishaldhull09 See https://github.com/wegylexy/rnnoise_wasm . Set your weights in https://github.com/xiph/rnnoise/blob/master/src/rnn_data.c .

from rnnoise.

@vishaldhull09 See https://github.com/wegylexy/rnnoise_wasm . Set your weights in https://github.com/xiph/rnnoise/blob/master/src/rnn_data.c .

thanks @wegylexy
sorry but little new to node and JS so I have this doubt ...
https://jmvalin.ca/demo/rnnoise/noise.js
as far as i understood , demo for browser is using this file to load Rnnoise
any idea how this file is created from the saved model, as I don't want to use node.js

from rnnoise.

@vishaldhull09 It has nothing to do with node.js. That's just a module that can also be loaded in node.js as well as the browser. If you prefer C over JS, compile to WASM like I do https://github.com/wegylexy/rnnoise_wasm/blob/master/src/worklet.c .

from rnnoise.