Giter Club home page Giter Club logo

recurrent_neural_net_demo's Introduction

RNN Demo

Overview

This project helps train a Recurrent neural net to predict the sum of two binary numbers.

Dependencies

  • numpy
  • copy

Use pip to install any missing dependencies

Basic Usage

Run rnn.py, that's it!

Credits

Credit for the vast majority of code here goes to @iamtrask! I've merely created a wrapper around all of the important functions to get people started.

recurrent_neural_net_demo's People

Contributors

llsourcell avatar testbounty avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar

Forkers

wanjinchang bobz653 phpcmsapp benjamesbabala johnsmithm jithsjoy mrgoogol aymankhattar hidfors wajihullahbaig merico34 prateek1095 sunnysai12345 chromeappplayj fatmas1982 jaydenwhyte am-firnas utkarsh97s aminofory shubhampachori12110095 pre10 schnapi wendy0601 anandvidvat abhishekshukla1289 gabeochieng bothsidesm6m huqicheng tignite hejianfei0 aeltoukhi yangyyt auserj rajnish-aryann fisherq cyberican sergiohzlz nelsonbeltran dazionmau sahanduiuc bashirsadat abhijeetjain99 vedraiyani blessingkoketso bbueno5000 lpcteste junamarv fatest chediak hudakas subo93 sangarajukumar

recurrent_neural_net_demo's Issues

Wrong formula in back-propagating

I inspected whole of the code, but I guess there is a mistake in this line.
As far as I am concerned, the cost function used in your code is:

Therefore, If you are going to follow delta rule, the data needed for back-propagation is:

But in your code it is:

The difference between them is sigmoid function.
I think there is a small mistake in this line.

recurrent_neural_net_demo/rnn.py

Line 77 in 35fb080

layer_2_deltas.append((layer_2_error)*sigmoid_output_to_derivative(layer_2))

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.