Giter Club home page Giter Club logo

fdtd-vocaltract-model-1's Introduction

A three-dimensional (3D) articulatory model

๐Ÿ“ซ Summary:
The implemented 3D articulatory model synthesizes speech acoustic for static vocal tract shapes. The model couples a lumped-element vocal fold model [1] (i.e., two-mass model) with the 3D vocal tract model to generate synthetic audio output for various vocal tract shapes. During the simulation, the model uses the 1D area functions dataset [2] (i.e., change in vocal tract cross-sectional shape from glottis to lips) to generate the 3D vocal tract contour. The synthesizer then uses the finite-difference time-domain numerical scheme [3][4] to discretize acoustic components (pressure and velocity) on a staggered othrogonal grid and computes the acoustic pressure wave propagation. The implemented model is motivated from Takemoto's 3D vocal tract model [3] and "Aerophones In Flatland" [5] research articles. It also faciliates the transfer function analysis of static vocal tracts having different cross-sectional shapes (i.e., circular, elliptical and square).

๐ŸŽฎ Start the simulator:
- To simulate the articulatory model, use the main.m file in the MATLAB environemnt.
- For transfer function analysis, use the plotFrequencyPhase.m file.
- To geneate audio samples, use the generateAudio.m file.

๐Ÿ“š References:
If you use the code for your research work, please cite the following papers -
[1] "Three-dimensional finite-difference time-domain acoustic analysis of simplified vocal tract shapes" by Mohapatra et al.

@inproceedings{mohapatra22_interspeech,
  author={Debasish Mohapatra and Mario Fleischer and Victor Zappi and Peter Birkholz and Sidney Fels},
  title={{Three-dimensional finite-difference time-domain acoustic analysis of simplified vocal tract shapes}},
  year=2022,
  booktitle={Proc. Interspeech 2022},
  pages={764--768},
  doi={10.21437/Interspeech.2022-10649}
}


[2] "An Extended Two-Dimensional Vocal Tract Model for Fast Acoustic Simulation of Single-Axis Symmetric Three-Dimensional Tubes" by Mohapatra et al.

@inproceedings{mohapatra19_interspeech,
  author={Debasish Ray Mohapatra and Victor Zappi and Sidney Fels},
  title={{An Extended Two-Dimensional Vocal Tract Model for Fast Acoustic Simulation of Single-Axis Symmetric Three-Dimensional Tubes}},
  year=2019,
  booktitle={Proc. Interspeech 2019},
  pages={3760--3764},
  doi={10.21437/Interspeech.2019-1764}
}

โ›ณ Future work:
- Implementation of bent vocal tract geometries having simplified cross-sections.
- Studying the effect of side branches/cavities.
- Simulation of realistic vocal tract models.
- Implementation of mouth radiation.
- Implementation of an accelerated 3D FDTD vocal tract model using modern GPUs [CUDA/OpenCL environment]

โš ๏ธ Note:
For bugs/suggestion/collaboration, please contact: [email protected]

fdtd-vocaltract-model-1's People

Contributors

debasishray19 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.