Design Discussions about bnn HOT 5 OPEN

Great idea! We should rename Matrix to Tensor.

from bnn.

I have thought of the following modules,

1. core - Containing the data structures(Matrix, and others) for CPU(including parallel computing support on CPU using threads).
2. cuda - Containing CUDA support for most probably the data structures in the core module and some operations in the operations module. We will start with only single GPU support.
3. layers - Containing various layers in BNNs.
4. operations - Containing operations like back-propagation, update, train, classify, test.
5. wrappers - Containing wrappers for various languages. We will start only with python wrappers. Boost.Python will be used here.
6. tests - Containing test suites for the above modules. Boost.Test for cuda tests and GoogleTest for the rest.

Note that CUDA tests will not be enabled on CI because they are to costly and Travis CI doesn't provide support GPU enables tests. So, we may have to establish a scheme for obtaining the reports of tests on various PRs before merging.

Let me know of any modifications or clarifications. Thanks.

from bnn.

Let's proceed forward with the discussion here.
So, we will start with core module. We will be only needing matrices(multidimensional ones like 2D, 3D) as ConvNets are very general in using them. We can build a base class, Matrix and then for multidimensional matrices we will just create class MatrixND with N-sized array of Matrix as it's data member. The on going PR at codezonediitj/adaboost#5 has the code for 2D Matrices.
I was just wondering if we should rename Matrix to Tensor? What do you say?
ping @pristineVedansh
P.S. We don't need Boost.Test as after compiling the .cu files, these can be linked with gtest code.

from bnn.

We will be required to use 1D layout(Row Major Order) for arbitrary dimensional Tensors.

from bnn.

We should also, have autodiff operator in operators module which was left out and is crucial. It should be specialised for the BNNs. I will come up with the API design of Tensors in a separate issue.

from bnn.