Support BigQuery for tensorflow-io about io HOT 6 CLOSED

I've recently joined Google CloudAI team and going to work on this.
Btw, BigQuery has recently released https://cloud.google.com/bigquery/docs/reference/storage/rpc/google.cloud.bigquery.storage.v1beta1#google.cloud.bigquery.storage.v1beta1.ReadRowsRequest API that is using gRPC and specifically designed for high performance scenarios like this one.

from io.

One challenge is that BigQuery essentially returns a json response so a json library with good performance in C/C++ is needed.

from io.

@yongtang: I used jsoncpp last year (https://github.com/open-source-parsers/jsoncpp) for a RESTful API. It was nowhere near a performance critical path so I can't speak for the performance - however I can say it was trivially to use it for encoding & decoding and it was super easy to build it as an external dependency with cmake.

from io.

@yongtang: Just checked and it is also used in TF - so all bazel build infrastructure should be there

from io.

@suphoff Thanks! Will take a look at jsoncpp.

from io.

Thanks @vlasenkoalexey 👍 ! Let me know if you have any questions or anything I could be of help.

from io.