[ RUN      ] Scan9.ShortSequenceOneInBatchOneLoopStateVar_NoShapeInMainGraph_NoTypeAndShapeInSubgraph
2019-01-21 12:36:35.1219826 [E:onnxruntime:Default, provider_test_utils.cc:361 onnxruntime::test::OpTester::Run] Resolve failed with status: [ShapeInferenceError] Axis value -1952214784 is invalid for a tensor of rank 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(362): error: Value of: status.IsOK()
  Actual: false
Expected: true
[ShapeInferenceError] Axis value -1952214784 is invalid for a tensor of rank 2
[  FAILED  ] Scan9.ShortSequenceOneInBatchOneLoopStateVar_NoShapeInMainGraph_NoTypeAndShapeInSubgraph (2 ms)
[ RUN      ] Scan9.OnnxScalarLoopState
2019-01-21 12:36:35.1243646 [E:onnxruntime:Default, provider_test_utils.cc:361 onnxruntime::test::OpTester::Run] Resolve failed with status: [ShapeInferenceError] Axis value -1952211872 is invalid for a tensor of rank 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(362): error: Value of: status.IsOK()
  Actual: false
Expected: true
[ShapeInferenceError] Axis value -1952211872 is invalid for a tensor of rank 2
[  FAILED  ] Scan9.OnnxScalarLoopState (24 ms)
[ RUN      ] Scan9.OuterScopeAccess_NoShapeInMainGraph_TypeAndShapeInSubgraph
2019-01-21 12:36:35.1494243 [E:onnxruntime:Default, provider_test_utils.cc:361 onnxruntime::test::OpTester::Run] Resolve failed with status: [ShapeInferenceError] Axis value -1952214784 is invalid for a tensor of rank 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(362): error: Value of: status.IsOK()
  Actual: false
Expected: true
[ShapeInferenceError] Axis value -1952214784 is invalid for a tensor of rank 2
[  FAILED  ] Scan9.OuterScopeAccess_NoShapeInMainGraph_TypeAndShapeInSubgraph (2 ms)
[ RUN      ] Scan9.OuterScopeAccess_ShapeInMainGraph_NoTypeAndShapeInSubgraph
2019-01-21 12:36:35.1517906 [E:onnxruntime:Default, provider_test_utils.cc:361 onnxruntime::test::OpTester::Run] Resolve failed with status: [ShapeInferenceError] Axis value -1952213664 is invalid for a tensor of rank 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(362): error: Value of: status.IsOK()
  Actual: false
Expected: true
[ShapeInferenceError] Axis value -1952213664 is invalid for a tensor of rank 2
[  FAILED  ] Scan9.OuterScopeAccess_ShapeInMainGraph_NoTypeAndShapeInSubgraph (1 ms)
[ RUN      ] Scan9.OuterScopeAccess_NoShapeInMainGraph_NoTypeAndShapeInSubgraph
2019-01-21 12:36:35.1541204 [E:onnxruntime:Default, provider_test_utils.cc:361 onnxruntime::test::OpTester::Run] Resolve failed with status: [ShapeInferenceError] Axis value -1952211312 is invalid for a tensor of rank 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(362): error: Value of: status.IsOK()
  Actual: false
Expected: true
[ShapeInferenceError] Axis value -1952211312 is invalid for a tensor of rank 2
[  FAILED  ] Scan9.OuterScopeAccess_NoShapeInMainGraph_NoTypeAndShapeInSubgraph (2 ms)
[ RUN      ] Scan9.BadShape
[       OK ] Scan9.BadShape (1 ms)
[ RUN      ] Scan9.ReversedInput
2019-01-21 12:36:35.2563468 [E:onnxruntime:Default, provider_test_utils.cc:361 onnxruntime::test::OpTester::Run] Resolve failed with status: [ShapeInferenceError] Axis value -1952213664 is invalid for a tensor of rank 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(362): error: Value of: status.IsOK()
  Actual: false
Expected: true
[ShapeInferenceError] Axis value -1952213664 is invalid for a tensor of rank 2
[  FAILED  ] Scan9.ReversedInput (2 ms)
[ RUN      ] Scan9.ReversedOutput
2019-01-21 12:36:35.2586460 [E:onnxruntime:Default, provider_test_utils.cc:361 onnxruntime::test::OpTester::Run] Resolve failed with status: [ShapeInferenceError] Axis value -1952212544 is invalid for a tensor of rank 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(362): error: Value of: status.IsOK()
  Actual: false
Expected: true
[ShapeInferenceError] Axis value -1952212544 is invalid for a tensor of rank 2
[  FAILED  ] Scan9.ReversedOutput (2 ms)
[ RUN      ] Scan9.TransposeInput
2019-01-21 12:36:35.2609655 [E:onnxruntime:Default, provider_test_utils.cc:361 onnxruntime::test::OpTester::Run] Resolve failed with status: Node:node1 Unrecognized attribute: axes for operator Scan
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(362): error: Value of: status.IsOK()
  Actual: false
Expected: true
Node:node1 Unrecognized attribute: axes for operator Scan
[  FAILED  ] Scan9.TransposeInput (1 ms)
[ RUN      ] Scan9.InvalidInput
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(359): error: Value of: status.ErrorMessage()
Expected: has substring "Invalid values in 'scan_input_directions'."
  Actual: "[ShapeInferenceError] Axis value -1952622704 is invalid for a tensor of rank 2"
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(359): error: Value of: status.ErrorMessage()
Expected: has substring "Invalid values in 'scan_output_directions'."
  Actual: "[ShapeInferenceError] Axis value -1952214448 is invalid for a tensor of rank 2"
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(359): error: Value of: status.ErrorMessage()
Expected: has substring "Number of entries in 'scan_input_directions' was 3 but expected 2"
  Actual: "[ShapeInferenceError] Axis value -1952211984 is invalid for a tensor of rank 2"
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(359): error: Value of: status.ErrorMessage()
Expected: has substring "Number of entries in 'scan_output_directions' was 3 but expected 4"
  Actual: "[ShapeInferenceError] Axis value -1952211984 is invalid for a tensor of rank 2"
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(359): error: Value of: status.ErrorMessage()
Expected: has substring "Invalid value in axes for input 0 of 2. Input tensor rank was 2"
  Actual: "Node:node1 Unrecognized attribute: axes for operator Scan"
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\providers\provider_test_utils.cc(359): error: Value of: status.ErrorMessage()
Expected: has substring "[ShapeInferenceError] Number of axes specified (3) is not equal to number of scan inputs (2)."
  Actual: "Node:node1 Unrecognized attribute: axes for operator Scan"
[  FAILED  ] Scan9.InvalidInput (8 ms)

[----------] 2 tests from CUDAFenceTests
[ RUN      ] CUDAFenceTests.TileWithInitializer
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(185): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 5.60519e-45
  expected_output[i]
    Which is: -1
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(185): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: -1.4013e-45
  expected_output[i]
    Which is: 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(185): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -1
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(185): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 2
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(185): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 3
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(185): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -4
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(185): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 3
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(185): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -4
[  FAILED  ] CUDAFenceTests.TileWithInitializer (1716 ms)
[ RUN      ] CUDAFenceTests.TileWithComputedInput
2018-12-27 18:55:50.6266368 [E:onnxruntime:Default, cuda_call.cc:93 onnxruntime::CudaCall] CUDA failure 77: an illegal memory access was encountered ; GPU=0 ; hostname=LTL-DP ; expr=cudaMemcpy_ptds(dst_data, src_data, bytes, cudaMemcpyDeviceToHost);
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: -1
  expected_output[i]
    Which is: 7
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 2
  expected_output[i]
    Which is: -10
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 3
  expected_output[i]
    Which is: 7
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: -4
  expected_output[i]
    Which is: -10
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -15
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 22
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -15
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 22
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 7
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -10
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 7
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -10
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -15
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 22
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: -15
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\framework\cuda\fence_cuda_test.cc(251): error: Expected equality of these values:
  output.template Data<float>()[i]
    Which is: 0
  expected_output[i]
    Which is: 22

[ RUN      ] CApiTestWithProviders/CApiTestWithProvider.simple/1
Running simple inference with cuda provider
2018-12-27 19:06:10.7618910 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 256
2018-12-27 19:06:10.7628040 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 512
2018-12-27 19:06:10.7629832 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 1024
2018-12-27 19:06:10.7631395 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 2048
2018-12-27 19:06:10.7632994 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 4096
2018-12-27 19:06:10.7634528 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 8192
2018-12-27 19:06:10.7636054 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 16384
2018-12-27 19:06:10.7637581 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 32768
2018-12-27 19:06:10.7639104 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 65536
2018-12-27 19:06:10.7640627 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 131072
2018-12-27 19:06:10.7642152 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 262144
2018-12-27 19:06:10.7643677 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 524288
2018-12-27 19:06:10.7645194 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 1048576
2018-12-27 19:06:10.7646717 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 2097152
2018-12-27 19:06:10.7648234 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 4194304
2018-12-27 19:06:10.7649758 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 8388608
2018-12-27 19:06:10.7651281 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 16777216
2018-12-27 19:06:10.7652814 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 33554432
2018-12-27 19:06:10.7654338 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 67108864
2018-12-27 19:06:10.7655868 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 134217728
2018-12-27 19:06:10.7657393 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 268435456
2018-12-27 19:06:10.7659054 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 256
2018-12-27 19:06:10.7660596 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 512
2018-12-27 19:06:10.7662132 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 1024
2018-12-27 19:06:10.7663660 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 2048
2018-12-27 19:06:10.7665177 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 4096
2018-12-27 19:06:10.7666698 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 8192
2018-12-27 19:06:10.7668210 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 16384
2018-12-27 19:06:10.7669726 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 32768
2018-12-27 19:06:10.7671262 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 65536
2018-12-27 19:06:10.7673427 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 131072
2018-12-27 19:06:10.7675006 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 262144
2018-12-27 19:06:10.7676537 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 524288
2018-12-27 19:06:10.7678051 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 1048576
2018-12-27 19:06:10.7679572 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 2097152
2018-12-27 19:06:10.7681093 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 4194304
2018-12-27 19:06:10.7682677 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 8388608
2018-12-27 19:06:10.7684198 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 16777216
2018-12-27 19:06:10.7685717 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 33554432
2018-12-27 19:06:10.7687234 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 67108864
2018-12-27 19:06:10.7688753 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 134217728
2018-12-27 19:06:10.7690271 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 268435456
2018-12-27 19:06:10.7694816 [I:onnxruntime:InferenceSession, inference_session.cc:350 onnxruntime::InferenceSession::Impl::Initialize] Initializing session.
2018-12-27 19:06:10.7696910 [I:onnxruntime:InferenceSession, inference_session.cc:364 onnxruntime::InferenceSession::Impl::Initialize] Adding default CPU execution provider.
2018-12-27 19:06:10.7698515 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 256
2018-12-27 19:06:10.7700105 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 512
2018-12-27 19:06:10.7701609 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 1024
2018-12-27 19:06:10.7703700 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 2048
2018-12-27 19:06:10.7705302 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 4096
2018-12-27 19:06:10.7706810 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 8192
2018-12-27 19:06:10.7708314 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 16384
2018-12-27 19:06:10.7709824 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 32768
2018-12-27 19:06:10.7711326 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 65536
2018-12-27 19:06:10.7918542 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 131072
2018-12-27 19:06:10.7920390 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 262144
2018-12-27 19:06:10.7922010 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 524288
2018-12-27 19:06:10.7923545 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 1048576
2018-12-27 19:06:10.7925052 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 2097152
2018-12-27 19:06:10.7926556 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 4194304
2018-12-27 19:06:10.7928185 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 8388608
2018-12-27 19:06:10.7929689 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 16777216
2018-12-27 19:06:10.7931194 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 33554432
2018-12-27 19:06:10.7933425 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 67108864
2018-12-27 19:06:10.7935094 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 134217728
2018-12-27 19:06:10.7936630 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 268435456
2018-12-27 19:06:10.7949537 [I:onnxruntime:Default, kernel_registry.cc:220 onnxruntime::KernelRegistry::TryFindKernel] Mul kernel is not supported in CUDAExecutionProvider Encountered following errors: Op: Mul Execution provider mismatch. Expected: CUDAExecutionProvider Acutal: CPUExecutionProvider Op: Mul Execution provider mismatch. Expected: CUDAExecutionProvider Acutal: CPUExecutionProvider Op: Mul Execution provider mismatch. Expected: CUDAExecutionProvider Acutal: CPUExecutionProvider Op: Mul Execution provider mismatch. Expected: CUDAExecutionProvider Acutal: CPUExecutionProvider
2018-12-27 19:06:10.7957519 [I:onnxruntime:Default, kernel_registry.cc:220 onnxruntime::KernelRegistry::TryFindKernel] Mul kernel is not supported in CPUExecutionProvider Encountered following errors: Op: Mul Execution provider mismatch. Expected: CPUExecutionProvider Acutal: CUDAExecutionProvider Op: Mul Execution provider mismatch. Expected: CPUExecutionProvider Acutal: CUDAExecutionProvider Op: Mul Execution provider mismatch. Expected: CPUExecutionProvider Acutal: CUDAExecutionProvider Op: Mul Execution provider mismatch. Expected: CPUExecutionProvider Acutal: CUDAExecutionProvider Op: Mul Execution provider mismatch. Expected: CPUExecutionProvider Acutal: CUDAExecutionProvider Op: Mul Execution provider mismatch. Expected: CPUExecutionProvider Acutal: CUDAExecutionProvider Op: Mul Execution provider mismatch. Expected: CPUExecutionProvider Acutal: CUDAExecutionProvider
2018-12-27 19:06:10.7967512 [I:onnxruntime:Default, kernel_registry.cc:220 onnxruntime::KernelRegistry::TryFindKernel] Mul kernel is not supported in  Encountered following errors:
2018-12-27 19:06:10.7969745 [I:onnxruntime:InferenceSession, session_state_initializer.cc:137 onnxruntime::SaveMLValueNameIndexMapping] SaveMLValueNameIndexMapping
2018-12-27 19:06:10.7972119 [I:onnxruntime:InferenceSession, session_state_initializer.cc:183 onnxruntime::SaveMLValueNameIndexMapping] Done saving MLValue mappings.
2018-12-27 19:06:10.7973902 [I:onnxruntime:Default, kernel_registry.cc:220 onnxruntime::KernelRegistry::TryFindKernel] Mul kernel is not supported in  Encountered following errors:
2018-12-27 19:06:10.7977274 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 256
2018-12-27 19:06:10.7979259 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 512
2018-12-27 19:06:10.7981400 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 1024
2018-12-27 19:06:10.7983035 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 2048
2018-12-27 19:06:10.7985619 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 4096
2018-12-27 19:06:10.7987218 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 8192
2018-12-27 19:06:10.7988733 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 16384
2018-12-27 19:06:10.7990237 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 32768
2018-12-27 19:06:10.7991751 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 65536
2018-12-27 19:06:10.7993321 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 131072
2018-12-27 19:06:10.7994840 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 262144
2018-12-27 19:06:10.7996905 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 524288
2018-12-27 19:06:10.7998502 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 1048576
2018-12-27 19:06:10.8000008 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 2097152
2018-12-27 19:06:10.8001503 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 4194304
2018-12-27 19:06:10.8185119 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 8388608
2018-12-27 19:06:10.8186971 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 16777216
2018-12-27 19:06:10.8188517 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 33554432
2018-12-27 19:06:10.8190039 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 67108864
2018-12-27 19:06:10.8191546 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 134217728
2018-12-27 19:06:10.8193067 [I:onnxruntime:Default, bfc_arena.cc:25 onnxruntime::BFCArena::BFCArena] Creating bin of max chunk size 268435456
2018-12-27 19:06:10.8194734 [I:onnxruntime:Default, kernel_registry.cc:220 onnxruntime::KernelRegistry::TryFindKernel] Mul kernel is not supported in  Encountered following errors:
2018-12-27 19:06:10.8196636 [I:onnxruntime:InferenceSession, session_state_initializer.cc:252 onnxruntime::SaveInitializedTensorsWithMemPattern] Saving initialized tensors.
2018-12-27 19:06:10.8208022 [I:onnxruntime:Default, bfc_arena.cc:102 onnxruntime::BFCArena::Extend] Extending allocation by 1048576 bytes.
2018-12-27 19:06:10.8210931 [I:onnxruntime:Default, bfc_arena.cc:106 onnxruntime::BFCArena::Extend] Total allocated bytes: 1048576
2018-12-27 19:06:10.8213834 [I:onnxruntime:Default, bfc_arena.cc:109 onnxruntime::BFCArena::Extend] Allocated memory at 0000001409000000 to 0000001409100000
2018-12-27 19:06:10.8217212 [I:onnxruntime:Default, bfc_arena.cc:102 onnxruntime::BFCArena::Extend] Extending allocation by 1048576 bytes.
2018-12-27 19:06:10.8220052 [I:onnxruntime:Default, bfc_arena.cc:106 onnxruntime::BFCArena::Extend] Total allocated bytes: 1048576
2018-12-27 19:06:10.8223281 [I:onnxruntime:Default, bfc_arena.cc:109 onnxruntime::BFCArena::Extend] Allocated memory at 000002016EAD1040 to 000002016EBD1040
2018-12-27 19:06:10.8227791 [I:onnxruntime:InferenceSession, session_state_initializer.cc:324 onnxruntime::SaveInitializedTensorsWithMemPattern] Done saving initialized tensors
2018-12-27 19:06:10.8229741 [I:onnxruntime:InferenceSession, session_state_initializer.cc:412 onnxruntime::SaveKernels] Saving kernels.
2018-12-27 19:06:10.8232252 [I:onnxruntime:Default, kernel_registry.cc:220 onnxruntime::KernelRegistry::TryFindKernel] Mul kernel is not supported in CUDAExecutionProvider Encountered following errors:
2018-12-27 19:06:10.8236029 [I:onnxruntime:InferenceSession, session_state_initializer.cc:421 onnxruntime::SaveKernels] Done saving kernels.
2018-12-27 19:06:10.8237616 [I:onnxruntime:Default, kernel_registry.cc:220 onnxruntime::KernelRegistry::TryFindKernel] Mul kernel is not supported in  Encountered following errors:
2018-12-27 19:06:10.8242002 [I:onnxruntime:Default, kernel_registry.cc:220 onnxruntime::KernelRegistry::TryFindKernel] Mul kernel is not supported in  Encountered following errors:
2018-12-27 19:06:10.8245266 [I:onnxruntime:InferenceSession, inference_session.cc:410 onnxruntime::InferenceSession::Impl::Initialize] Session successfully initialized.
2018-12-27 19:06:12.4997850 [I:onnxruntime:, sequential_executor.cc:38 onnxruntime::SequentialExecutor::Execute] Begin execution
C:\Users\tolia\AppData\Local\Temp\onnxruntime\onnxruntime\test\shared_lib\test_inference.cc(51): error: Expected equality of these values:
  values_y[i]
    Which is: 4
  f[i]
    Which is: 2
[  FAILED  ] CApiTestWithProviders/CApiTestWithProvider.simple/1, where GetParam() = 1 (2333 ms)

pip3 install onnxruntime
Collecting onnxruntime
  Downloading https://files.pythonhosted.org/packages/e6/97/39c630134268a29a7c26f5f1c8fd2f7ff089ccee567cb076087ddf1cb6e0/onnxruntime-0.1.4-cp35-cp35m-manylinux1_x86_64.whl (4.6MB)
    100% |################################| 4.6MB 389kB/s 
Installing collected packages: onnxruntime
Successfully installed onnxruntime-0.1.4

import time
import numpy as np

x = np.random.random((1,416, 416, 3))
iters = 20

import onnxruntime as rt

sess = rt.InferenceSession("image.onnx")

input_name = sess.get_inputs()[0].name
label_name = sess.get_outputs()[0].name

_start_time = time.time()
for i in range(iters):
    sess.run([label_name], {input_name: x.astype(np.float32)})[0]
duration = time.time() - _start_time

print("ONNX prediction total duration is %s, per round is %.3f" %
              (duration, duration / iters))

from keras.models import load_model

model = load_model("image.h5")

_start_time = time.time()

for i in range(iters):
    model.predict(x.astype(np.float32))

duration = time.time() - _start_time

print("Keras prediction total duration is %s, per round is %.3f" %
              (duration, duration / iters))

>>> import onnxruntime
>>> options = onnxruntime.SessionOptions()
>>> options.enable_sequential_execution = False
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: 'onnxruntime.capi.onnxruntime_pybind11_state.SessionOptions' object has no attribute 'enable_sequential_execution'
>>> options.session_thread_pool_size = 1
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: 'onnxruntime.capi.onnxruntime_pybind11_state.SessionOptions' object has no attribute 'session_thread_pool_size'

import numpy as np
import onnxruntime as rt
from onnx import *
from onnxmltools.utils import save_mode

initializer = []
initializer.append(helper.make_tensor(name="W", data_type=TensorProto.FLOAT, dims=(1,), vals=np.ones(1).tolist()))

graph = helper.make_graph(
    [
        helper.make_node('MatMul', ["X", "W"], ["Y"]),
    ],
    "TEST",
    [
        helper.make_tensor_value_info('X' , TensorProto.FLOAT, [1]),
        helper.make_tensor_value_info('W', TensorProto.FLOAT, [1]),
    ],
    [
        helper.make_tensor_value_info('Y', TensorProto.FLOAT, [1]),
    ],
    initializer=initializer,
    )

checker.check_graph(graph)
model = helper.make_model(graph, producer_name='TEST')
save_model(model, "model.onnx")
sess = rt.InferenceSession('model.onnx')

Traceback (most recent call last):
File "onnxruntime_test.py", line 35, in <module>
sess = rt.InferenceSession('model.onnx')
File "/usr/local/lib/python3.5/dist-packages/onnxruntime/capi/session.py", line 29, in __init__
self._sess.load_model(path_or_bytes)
RuntimeError: [ONNXRuntimeError] : 1 : GENERAL ERROR : Node: Output:Y [ShapeInferenceError] Mismatch between number of source and target dimensions. Source=0 Target=1

def test_NASNetMobile(self):
    from keras.applications.nasnet import NASNetMobile
    model = NASNetMobile(include_top=True, weights='imagenet')
    self._test_keras_model(model)

def test_NASNetLarge(self):
    from keras.applications.nasnet import NASNetLarge
    model = NASNetLarge(include_top=True, weights='imagenet')
    self._test_keras_model(model, img_size=331)

  :
[ 31%] Built target protoc
[ 31%] Running cpp protocol buffer compiler on /home/ytakeda/Projects/onnxruntime/onnxruntime/onnxruntime/core/protobuf/onnx-operators-ml.proto
../external/protobuf/cmake/protoc: 1: ../external/protobuf/cmake/protoc: Syntax error: word unexpected (expecting ")")
onnx/CMakeFiles/onnx_proto.dir/build.make:70: recipe for target 'onnx/onnx-operators-ml.pb.h' failed
make[2]: *** [onnx/onnx-operators-ml.pb.h] Error 2
CMakeFiles/Makefile2:1185: recipe for target 'onnx/CMakeFiles/onnx_proto.dir/all' failed
make[1]: *** [onnx/CMakeFiles/onnx_proto.dir/all] Error 2
Makefile:140: recipe for target 'all' failed
make: *** [all] Error 2

   export PATH=/opt/gcc-linaro-6.3.1-2017.05-x86_64_arm-linux-gnueabihf/bin:$PATH
   export CC=arm-linux-gnueabihf-gcc
   export CXX=arm-linux-gnueabihf-g++```

set(CMAKE_SYSTEM_NAME Linux)
set(CMAKE_SYSTEM_PROCESSOR arm)
set(CMAKE_CXX_COMPILER arm-linux-gnueabihf-c++)
set(CMAKE_C_COMPILER arm-linux-gnueabihf-gcc)
set(CMAKE_FIND_ROOT_PATH_MODE_PROGRAM NEVER)
set(CMAKE_FIND_ROOT_PATH_MODE_LIBRARY ONLY)
set(CMAKE_FIND_ROOT_PATH_MODE_INCLUDE ONLY)
set(CMAKE_FIND_ROOT_PATH_MODE_PACKAGE ONLY)

git clone --recursive https://github.com/Microsoft/onnxruntime
cd onnxruntime
mkdir my_build
cd my_build
cmake -DCMAKE_TOOLCHAIN_FILE=../../tool.cmake ../cmake

make

/onnxruntime_exec -m model.onnx -t ./test_data_2.npz
2019-01-15 04:25:03.793697147 [W:onnxruntime:Default, graph.cc:2178 CleanUnusedInitializers] gpu_0/imagenet1k_blobs_queue_f22e83c9-22cd-4a8b-a66d-113af6b832b4_0 exists in this graph's initializers but it is not used by any node
'model.onnx' loaded successfully.
Done loading model: model.onnx
Execution Status: DATA_LOADING_FAILURE
Exception msg: Not enough features in sample.

exlsunshine@exlsunshine:~/downloads $ pip install onnxruntime
Collecting onnxruntime
  Could not find a version that satisfies the requirement onnxruntime (from versions: )
No matching distribution found for onnxruntime

- OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 18.04.1 LTS
Release:        18.04
Codename:       bionic

exlsunshine@exlsunshine:~/downloads $ python -V
Python 2.7.15rc1
exlsunshine@exlsunshine:~/downloads $ python3 -V
Python 3.6.7

exlsunshine@exlsunshine:~/downloads $ gcc --version
gcc (Ubuntu 7.3.0-27ubuntu1~18.04) 7.3.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

import torch
from onnxruntime import backend

/opt/conda/lib/python3.6/site-packages/onnxruntime/capi/_pybind_state.py:12: UserWarning: Cannot load onnxruntime.capi. Error: '/opt/conda/lib/python3.6/site-packages/onnxruntime/capi/onnxruntime_pybind11_state.so: undefined symbol: mkldnn_sgemm'
  warnings.warn("Cannot load onnxruntime.capi. Error: '{0}'".format(str(e)))
Traceback (most recent call last):
  File "info.py", line 2, in <module>
    from onnxruntime import backend
  File "/opt/conda/lib/python3.6/site-packages/onnxruntime/__init__.py", line 21, in <module>
    from onnxruntime.capi._pybind_state import RunOptions, SessionOptions, get_device, NodeArg, ModelMetadata```

./build.sh --config RelWithDebInfo --build_wheel

C:\Users\guyan\AppData\Local\Programs\Python\Python36\lib\site-packages\onnxruntime\capi\_pybind_state.py:12: UserWarning: Cannot load onnxruntime.capi. Error: 'DLL load failed: The specified module could not be found.'
  warnings.warn("Cannot load onnxruntime.capi. Error: '{0}'".format(str(e)))
Traceback (most recent call last):
  File ".\inference.py", line 1, in <module>
    import onnxruntime
  File "C:\Users\guyan\AppData\Local\Programs\Python\Python36\lib\site-packages\onnxruntime\__init__.py", line 21, in <module>
    from onnxruntime.capi._pybind_state import RunOptions, SessionOptions, get_device, NodeArg, ModelMetadata
ImportError: cannot import name 'RunOptions'

import onnxruntime

session = onnxruntime.InferenceSession("alexnet.onnx")