barseghyanartur / starbase Goto Github PK

It works with argument scanner_config={}. The default value '' can't be parsed by Java side, and causes an HTTP Error 500.

Support limit with fetch and fetch_all_rows?

Now you're using requests instead of urllib2, you need to pass in auth to the various requests methods, it doesn't understand basic auth encoded in the url afaict

Are there any plans of adding support for counters in starbase.

hello, startbase support scan timestamp range ?

i can not find startbase doc abort timestamp range...

tks very much !!!

Hello All:

(1) I install starbase and write a python script:

from starbase import Connection
c = Connection(host='192.168.1.11', port=8022)
print c.tables()

but I got empty table list:
[]

(2) Use hbase shell:

[hdfs@hdp01~]$ hbase shell
15/12/07 16:47:50 INFO Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
HBase Shell; enter 'help' for list of supported commands.
Type "exit" to leave the HBase Shell
Version 0.98.6-cdh5.3.3, rUnknown, Wed Apr 8 15:00:15 PDT 2015

hbase(main):001:0> list
TABLE
mytable
transactions_hbase
users
3 row(s) in 1.8320 seconds

=> ["mytable", "transactions_hbase", "users"]

What's this problem? How can I solve it?
Thank you!!

Hi, I'm working with the hbase 1.2.6, while fetch works great, but when I do table.fetch_all_rows() it returns None. I don't have huge dataset, as I'm just trying to work with the small data first. I was just wondering why it was not working. Could you please help?

Thanks

At this time, it is not possible to use increment columns :

With Hbase Shell

hbase(main):066:0> incr 'plop', 'hit_13977231081', 'apache:hit', 5
COUNTER VALUE = 15
hbase(main):067:0> scan 'plop'
 1397723117                            column=apache:url, timestamp=1397723117, value=/blog/article1
 hit_13977231081                       column=apache:hit, timestamp=1397731265432, value=\x00\x00\x00\x00\x00\x00\x00\x0F

From Starbase :

print( table.fetch( 'hit_1397723108' ) )
print( table.fetch( '1397723117' ) )

None
{'apache': {'url': '/blog/article1', 'method': 'GET', 'elapsed': '83'}}

I've created 5 columns using the examples that is shown in the documentation.

And I've a data like this:
{'column1':'value1', 'column2':'value2',column3':'value3', 'column4':'value4', 'column5':'value5'}

while doing t.insert, it throws an error saying "AttributeError: 'unicode' object has no attribute 'items'". Isn't it possible for a column to have just a single string value unlike another object as shown in the documentation?

Such check might significantly slow down requests on a large scale, because it makes an additional HTTP request per query all the time. This is especially useless if I know my table exists.
It might be better to just surround query with try/except or something?

while migrating postgresql data to hadoop hbase using starbase python library .I am unable to dynamically add column family as i have to create it while creating table instance t.create('column1').

Has someone managed to insert or update data with a specific timestamp? I made somes test and it works only when the specified timestamp is > than the existing timestamp.

By the way can someone explain me the difference between insert and update?

Best,
lise

"""
Note, that you may also use the native way of naming the columns and cells (qualifiers). Result of the following would be equal to the result of the previous example.

t.insert(
'my-key-1',
{
'column1:key11': 'value 11', 'column1:key12': 'value 12',
'column1:key13': 'value 13',
'column2:key21': 'value 21', 'column2:key22': 'value 22',
'column3:key32': 'value 31', 'column3:key32': 'value 32'
}
)
"""

This is not supported, tested on version 0.3.3

I am new user of starbase, I want to retrieve few records using some condition like start date or end date or some other fields(columns) not keyID field. Is there any other api or any other syntax in starbase.

I checked fetch is used for keyID and fetch_all_rows is using for all record retrieve.

Even I checked fetch_all_rows(with_row_id=False, raw=False, perfect_dict=None, flat=False, filter_string=None, scanner_config={}', fail_silently=True)

row_filter_string = '{"type": "RowFilter", "op": "EQUAL", "comparator": ' '{"type": "RegexStringComparator", "value": "IN825615" }}' here also value is specific keyID only working, I am not getting any proper solution. Is there any other alternative api.

Plz suggest, how can resolve this query issue.

The URL of the Stargate endpoint for HBase on Azure HDInsight clusters is like this:
https://your-cluster.azurehdinsight.net/hbaserest
Starbase constructs the base URL like this:
self.base_url = 'http{secure}://{host}:{port}/'.format(**data)
I would propose adding an argument called 'url' to Connection.__init__, which would default to None, but if set, would override the above base_url construction.