Giter Club home page Giter Club logo

neural-machine-translation's Introduction

Neural Machine Translation

This project focuses on Solving Sequence-to-Sequence problem of Machine translation which is conversion of English words into corresponding Hindi words by the means of a Encoder-Decoder Architecture.

Work Flow

image

The work flow is as follows -

  • Preprocessing - The inputs are converted into suitable format along with a start and end token so that it can be fed to the encoder.
  • Encoder - This is the initial part of the Encoder decoder structure where the networks learn to predict the initial texts and weights are updated.
  • Decoder - This part translates the encoded weights into the target language by utilizing the weights provided by the encoder structure.

Encoder Decoder Model

The encoder-decoder model is a way of using recurrent neural networks for sequence-to-sequence prediction problems. The approach involves two recurrent neural networks, one to encode the input sequence, called the encoder, and a second to decode the encoded input sequence into the target sequence called the decoder. The pretrained model is available in the code section

img

Dataset Used

The Dataset used is englishHindicorpora- https://www.kaggle.com/aiswaryaramachandran/hindienglish-corpora Which Consists of Pairs of hindi and English sentences.

Results

These are some of the results of the notebook - img img img img

Tech Stack

  • Numpy - To perform Scientific mathetatics
  • Tensorflow 2.x - A deep learning library
  • Pandas - For manipulating data

To dos

  • Improve model performance by using more training examples
  • Implement Attention mechanism for better performance
  • Using Pretrained vectors for better results

Contact

want to contribute ? contact me at [email protected]

neural-machine-translation's People

Contributors

gd1m3y avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.