hkproj / mamba-notes Goto Github PK
View Code? Open in Web Editor NEWNotes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
Home Page: https://youtu.be/8Q_tqwpTpVU
Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
Home Page: https://youtu.be/8Q_tqwpTpVU
Hi there. This note is really helpful for me to understand about the Mamba. Thank you for such an amazing job you've done.
However, when looking at the notes, I stumble into a problem trying to the discrete formula.
From you notes, using the Euler Method, we will arrive the final formula as below.
From that equation, I interpret that the new hidden state depends on the previous hidden state and the previous input x.
However, in the Mamba paper, I notice that the equation is slightly different.
The term that changed here is
Does it imply that using different algorithm (ZOH vs Euler) will result in different final equation? In addition, I found this Wikipedia link that states the equation different from the paper.
I'm a newbie here so if there is any mistake, please tell me know. Thank you.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.