Kerasify
Kerasify is a small library for running trained Keras models from a C++ application.
Design goals:
- Compatibility with image processing Sequential networks generated by Keras using Theano backend.
- CPU only, no GPU
- No external dependencies, standard library, C++11 features OK.
- Model stored on disk in binary format that can be quickly read.
- Model stored in memory in contiguous block for better cache performance.
- Doesn't throw exceptions, returns only bool on error.
- Unit testable, rigorous unit tests.
Looking for more Keras/C++ libraries? Check out https://github.com/pplonski/keras2cpp/
Example
make_model.py:
import numpy as np
from keras.models import Sequential
from keras.layers import Dense
test_x = np.random.rand(10, 10).astype('f')
test_y = np.random.rand(10).astype('f')
model = Sequential()
model.add(Dense(1, input_dim=10))
model.compile(loss='mean_squared_error', optimizer='adamax')
model.fit(test_x, test_y, nb_epoch=1, verbose=False)
print model.predict(np.array([[0, 1, 2, 3, 4, 5, 6, 7, 8, 9]]))
from kerasify import export_model
export_model(model, 'example.model')
test.cc:
#include "keras_model.h"
int main() {
// Initialize model.
KerasModel model;
model.LoadModel("example.model");
// Create a 1D Tensor on length 10 for input data.
Tensor in(10);
in.data_ = {{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}};
// Run prediction.
Tensor out;
model.Apply(&in, &out);
out.Print();
return 0;
}
To test:
$ python make_model.py
[[-1.85735667]]
$ g++ --std=c++11 -Wall -O3 test.cc keras_model.cc
$ ./a.out
[ -1.857357 ]
Unit tests
To run the unit tests, generate the unit test models and then run keras_model_test:
$ python make_tests.py
...
$ make
cppcheck --error-exitcode=1 keras_model.cc
Checking keras_model.cc...
Checking keras_model.cc: DEBUG...
g++ --std=c++11 -I. -Wall -Werror -MMD -O3 -mtune=core2 -o keras_model.o -c keras_model.cc
cppcheck --error-exitcode=1 keras_model_test.cc
Checking keras_model_test.cc...
Checking keras_model_test.cc: DEBUG...
g++ --std=c++11 -I. -Wall -Werror -MMD -O3 -mtune=core2 -o keras_model_test.o -c keras_model_test.cc
g++ -o keras_model_test keras_model_test.o keras_model.o
$ ./keras_model_test
TEST dense_1x1
TEST dense_10x1
TEST dense_2x2
TEST dense_10x10
TEST dense_10x10x10
TEST conv_2x2
TEST conv_3x3
TEST conv_3x3x3
TEST elu_10
TEST benchmark
TEST benchmark
TEST benchmark
TEST benchmark
TEST benchmark
Benchmark network loads in 0.022415s
Benchmark network runs in 0.022597s
License
MIT
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent