fatchord / fftnet Goto Github PK
View Code? Open in Web Editor NEWPytorch Implementation of FFTNet
Pytorch Implementation of FFTNet
@fatchord Hi, happy to see you again! I'm also working on the FFTNet. But in my experiments, I cannot get the similar results of the paper's demo page, mainly about conditional sampling and post-denoising. Do you try to reconstruct their results? Thanks.
Hi, I'm wondering if you could help me. I'm trying to build a WaveNet-style vocoder in TensorFlow which uses acoustic features as auxiliary input, similar to FFTNet, but I'm struggling to understand how auxiliary input is feed to the network, is it added in parallel (two parallel layers) to the sample values and the output combined at a later layer? If you can point me in the direction of a text-book/article on auxiliary input/conditioning network I would be eternally grateful, I've looked many times and I can't find anything that gives a general undestanding of this.
Hi, is it possible to use this model conditioned on the first few samples to generate a specific audio? Say I want to generate audio1.wav, then after training with my dataset, I'd be able to produce that audio given the first N samples.
Thank you for your time
I tried running on a different audio file but I keep getting this error. Why?
---------------------------------------------------------------------------
IndexError Traceback (most recent call last)
<ipython-input-81-d644dae333d9> in <module>()
3 #data = torch.zeros((50000,))
4 print(data.shape)
----> 5 train(data, model, optimizer, batch_size=2, seq_len=5000, lr=1e-5, steps=10_000)
~/dev/FFTNet/fftnet.py in train(data, model, optimizer, batch_size, seq_len, lr, steps)
138 print(y_hat[:, :, 1:])
139 print(y.unsqueeze(-1))
--> 140 loss = criterion(y_hat[:, :, 1:], y.unsqueeze(-1))
141
142 running_loss += loss.item()
/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py in __call__(self, *input, **kwargs)
548 result = self._slow_forward(*input, **kwargs)
549 else:
--> 550 result = self.forward(*input, **kwargs)
551 for hook in self._forward_hooks.values():
552 hook_result = hook(self, input, result)
/usr/local/lib/python3.7/site-packages/torch/nn/modules/loss.py in forward(self, input, target)
203
204 def forward(self, input, target):
--> 205 return F.nll_loss(input, target, weight=self.weight, ignore_index=self.ignore_index, reduction=self.reduction)
206
207
/usr/local/lib/python3.7/site-packages/torch/nn/functional.py in nll_loss(input, target, weight, size_average, ignore_index, reduce, reduction)
2115 ret = torch._C._nn.nll_loss(input, target, weight, _Reduction.get_enum(reduction), ignore_index)
2116 elif dim == 4:
-> 2117 ret = torch._C._nn.nll_loss2d(input, target, weight, _Reduction.get_enum(reduction), ignore_index)
2118 else:
2119 # dim == 3 or dim > 4
IndexError: Target -9 is out of bounds.
Hey There!
You've talked a bit about working on a new vocoder algorithm. You have also worked on WaveRNN and FFTNet. Would love to assist you and contribute.
Who I am:
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.