Problem in reading integer value about spark-sql-on-hbase HOT 5 CLOSED

Astro does not actually use HBase's Bytes utilities which was discovered to be not order-preserving. Please consider using Astro's own utilities in the org.apache.spark.sql.hbase.util package.

from spark-sql-on-hbase.

Yes, the integer is stored as binary array in HBase. To keep its ordering, for example, -1 and 1, we need to handle it by ourselves, not via HBase Bytes utility.

from spark-sql-on-hbase.

Thank you. It works now.

from spark-sql-on-hbase.

Hi @frdo. How exactly did you make it work? We are facing the same problem. Thank you.

from spark-sql-on-hbase.

I'm sorry to answer you too late. Hope this is still useful.
I solved it by encoding the integer value as follow:

import org.apache.spark.sql.hbase.util.BinaryBytesUtils;
import org.apache.spark.sql.types.DataType;
byte[] bytes_value = BinaryBytesUtils.create(DataType.fromCaseClassString("IntegerType")).toBytes(21);

from spark-sql-on-hbase.