Giter Club home page Giter Club logo

Comments (29)

vroyer avatar vroyer commented on May 25, 2024

I can't see your log file, but you mapping should have cql_primary_key_order:2 to reflect your CQL schema. You can also create the es mapping from CQL by using a "discover":"c" in your mapping (see bi-directionnal mapping in the elassandra doc).
Thanks'
Vincent

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

At the end of the message, there is a "system.log.txt" ? Or isn't that enough.
Note that it doesn't work with also creating the tables from inserting a document in es in an index that doesn't exist.

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

Sorry, it's probably a github issue but i can't see or download your log file to go further. Could you try this :

  • delete you index
  • create your index with "mappings":{ "b": { "discover":".*" } }

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

This is what I get when trying to index a document in es {'project_id': 2, 'keywords': ['one', 'two'], } on an index that doesn't exist.

2016-07-15 11:01:55,472 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (-3415713271258857992,-3374968318384734883]
2016-07-15 11:01:55,473 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (1631706903485087307,1720629959088217019]
2016-07-15 11:01:55,473 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (552514496116556952,576460325380966129]
2016-07-15 11:01:55,473 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (4579611286047849499,4605379767297528506]
2016-07-15 11:01:55,533 INFO  [elasticsearch[0.0.0.0][listener][T#1]] BytesRestResponse.java:131 convert /s/feed/1 Params: {index=s, id=1, type=feed}
java.lang.NullPointerException: null
    at org.elasticsearch.cluster.routing.IndexRoutingTable$Builder.<init>(IndexRoutingTable.java:528) ~[elassandra-2.1.1-14.jar:na]
    at org.elasticsearch.cluster.routing.RoutingTable$Builder.<init>(RoutingTable.java:422) ~[elassandra-2.1.1-14.jar:na]
    at org.elasticsearch.cluster.routing.RoutingTable.builder(RoutingTable.java:388) ~[elassandra-2.1.1-14.jar:na]
    at org.elasticsearch.cluster.metadata.MetaDataCreateIndexService$2.execute(MetaDataCreateIndexService.java:512) ~[elassandra-2.1.1-14.jar:na]
    at org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:468) ~[elassandra-2.1.1-14.jar:na]
    at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:231) ~[elassandra-2.1.1-14.jar:na]
    at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:194) ~[elassandra-2.1.1-14.jar:na]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

This error should be fixed in 2.1.1-15. To upgrade, just replace lib/elassandra-2.1.1-14.jar by lib/elassandra-2.1.1-15.jar. Thanks'.

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

I got that error with 2.1.1.-15 too. I shut down 2.1.1-14 and started the new one and tried to insert the same document as previously:

2016-07-16 09:29:46,361 WARN [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (6878418231371780355,6965715832733238798]
2016-07-16 09:29:46,445 INFO [elasticsearch[0.0.0.0][listener][T#1]] BytesRestResponse.java:131 convert /s/feed/1 Params: {index=s, id=1, type=feed}
java.lang.NullPointerException: null
at org.elasticsearch.cluster.routing.IndexRoutingTable$Builder.(IndexRoutingTable.java:528) ~[elassandra-2.1.1-15.jar:na]
at org.elasticsearch.cluster.routing.RoutingTable$Builder.(RoutingTable.java:422) ~[elassandra-2.1.1-15.jar:na]
at org.elasticsearch.cluster.routing.RoutingTable.builder(RoutingTable.java:388) ~[elassandra-2.1.1-15.jar:na]
at org.elasticsearch.cluster.metadata.MetaDataCreateIndexService$2.execute(MetaDataCreateIndexService.java:512) ~[elassandra-2.1.1-15.jar:na]
at org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:469) ~[elassandra-2.1.1-15.jar:na]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:231) ~[elassandra-2.1.1-15.jar:na]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:194) ~[elassandra-2.1.1-15.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

i can't figure out why you still have a orphan token range ( first line in your log) this should be fixed by 2.1.1-15. Could you set logging level to TRACE for org.elasticsearch.cluster.routing and org.elasticsearch.cassandra.cluster.routing in your conf/ logback.xml and provide a nodetool ringinfo of your cluster. Thanks'.

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

Note those options weren't defined in logback.xml, but I created them. Logs and nodetool ring attached.

Note that this is just a virtualbox 32bit ubuntu14.04. I can even send you the full vm if you want.

nodetool_ring.txt
es_logs.txt

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

Ok, there is a bug when creating an index by inserting a document ( the routing table is built before the keyspace is created). As a workaround, can you create a keyspace "s" before inserting the first document ?
Thanks'
Vincent

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

I execute:
CREATE KEYSPACE IF NOT EXISTS s WITH REPLICATION={ 'class' : 'SimpleStrategy', 'replication_factor':'1'} ;"
Then I try to insert the document from elasticsearch and I get:::


2016-07-17 23:42:57,265 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (6878418231371780355,6965715832733238798]
2016-07-17 23:42:57,266 DEBUG [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:113 topology topology for keyspace s = {}, consistent=false unreachableNodes=[localhost/127.0.0.1] orphanRanges=[(7705978799237338668,7716472797475363018], (-6397866958730310980,-6374644129541776904], (-3475852481001823757,-3449142536321900070], (-4349974655859310619,-4270555926593850865], (-2121391251672669896,-1960093086471708115], (7329329544601364487,7359142320446873078], (8901712879247265105,8937956827472707994], (-1173297175306574420,-1161969361744004784], (6258419835440478547,6315379934192237608], (4818470147489137544,4820541012664212566], (-4215930762824671141,-4199092759551388279], (19561795566035235,134868184257870309], (4542804751961700996,4658663104610808097], (-6626279860694910217,-6589124617778598963], (-4689311042619490380,-4676208368509977342], (6638110720311029748,6711850881577841632], (8219877533367632229,8307953184294073679], (460484485492913173,520325780335127393], (3777272120309031431,3825559153565990443], (5922202005598105282,5933650639568493994], (-195277555759024415,-50891220633984432], (3888098991505707485,3951372425341140731], (-3367881044774227518,-3341931331719710834], (615956222830420997,621664543354190117], (-4710708772957139936,-4689311042619490380], (-8020065496663759037,-7970157441760624372], (7391706359546492554,7546517715491777177], (3679736680802510289,3694349421256180919], (225552897381581618,332248475366057672], (-1133054856985925888,-1074070959526922492], (-3146098278984191407,-3133365439409472008], (-4270555926593850865,-4215930762824671141], (441382048077949645,460484485492913173], (-1429642428945335210,-1194537134448904308], (-2721157510932109876,-2509713425923005459], (-432559732201454885,-376882609146966368], (-4676208368509977342,-4671521433524029486], (4457729691596595299,4542804751961700996], (-5005376282101692357,-4826942884905153887], (-1918815282674568805,-1913144900270573314], (8810178314840076053,8901712879247265105], (8564024768601745356,8567645715196037518], (2193521865313616483,2300965396900053792], (5984823447673644161,6117234466388885830], (-2840681140594725829,-2721157510932109876], (9064498144528451687,9069090030094305561], (-5203804162187207459,-5005376282101692357], (-8978000202918131544,-8948294789027474844], (-1074070959526922492,-1072032663016626224], (-8948294789027474844,-8939881479061386727], (-8194228960323724620,-8167372767431857711], (-8596070786747368651,-8568953964833760385], (4820541012664212566,4982601710440706802], (-4581651378378176219,-4578697773413979187], (655284540902137756,707656069231422746], (-5844569777135256810,-5792380210798637673], (3694349421256180919,3743022300744867391], (8783118334452845573,8810178314840076053], (3951372425341140731,4003127755614140468], (-1018734615799388302,-985655299325475139], (8585239989330938803,8593350097158016934], (-3427025823740558768,-3367881044774227518], (-4578697773413979187,-4388632308947711035], (5910546070877656057,5922202005598105282], (-7481994566834237583,-7444481297701638822], (-8939881479061386727,-8677938522332607735], (8405756373118010420,8548892797673211284], (4431254789678217131,4457729691596595299], (6248347332800625941,6254460679115878352], (1196248592854278022,1212403393006514069], (7853699615579312190,8019813092330822070], (-7925641291752533301,-7628115345390502309], (1460867140568836197,1743147804972403321], (9069090030094305561,9223181362472230970], (-5556119221781641681,-5548077507028173111], (3204598367728467311,3529660907296251783], (5772657643975142078,5808602976236290859], (-5548077507028173111,-5316580839989081269], (8548892797673211284,8564024768601745356], (-4372442890320765428,-4349974655859310619], (7677219272662982481,7705978799237338668], (757625871202926663,931665455752800518], (6765378709729291988,6878418231371780355], (5657471464295863212,5772657643975142078], (931665455752800518,980724992077292794], (-818357126345942160,-560522977679529205], (-6373754410243621822,-6300246290699862824], (-2860557497712287178,-2840681140594725829], (-5668652823049581317,-5556119221781641681], (-4814275153623921110,-4710708772957139936], (707656069231422746,757625871202926663], (-6374644129541776904,-6373754410243621822], (1212403393006514069,1240603197152919938], (5064439733452827331,5077086625395233433], (-3133365439409472008,-2860557497712287178], (520325780335127393,539709998044165857], (-8630576424142481604,-8603377518160039977], (-9044592193168877668,-8978000202918131544], (-4671521433524029486,-4669883525453470917], (1895966252339961290,1961191790709070852], (8636345264378663439,8742369401287698556], (-9077762922100480170,-9044592193168877668], (-7234423890758509999,-7168675257538305135], (2056998966531660262,2185334176907134487], (5037532593165026275,5064439733452827331], (2782267404384741078,2996832357856030057], (-6300246290699862824,-6011143631273973802], (4019787843664062556,4055218812470256868], (8137831078805445848,8219877533367632229], (-2315994820723442097,-2124487292507570055], (5427948798724802774,5567628760268333366], (5077086625395233433,5079147353232591688], (637843149675016075,655284540902137756], (-1617857912083743729,-1483237875300831431], (2996832357856030057,3043545537047107633], (6597269842242382875,6638110720311029748], (1961191790709070852,2056998966531660262], (-6894761419779333004,-6708676181290826247], (-4826942884905153887,-4814275153623921110], (-1483237875300831431,-1474743810252150119], (4222949158846163924,4431254789678217131], (4108442144727836207,4222949158846163924], (-6536143839884954598,-6397866958730310980], (1810955306336809485,1895966252339961290], (1106813632278527554,1196248592854278022], (7242871543962350130,7269568472581086374], (-2416353674471549567,-2345812349938455211], (8593350097158016934,8636345264378663439], (-284750727009477748,-255463616305506606], (-2442187908132139878,-2416353674471549567], (5104512085275416693,5225151490394717027], (-8167372767431857711,-8079302261032841997], (-6989176600674960972,-6894761419779333004], (-8526852802005820700,-8337502360226969397], (-7970157441760624372,-7925641291752533301], (6229335978978911982,6248347332800625941], (-865813783026395844,-818357126345942160], (-3987346161697258585,-3605515518424939308], (5588075779019502102,5597578420331233762], (-4666349768022335961,-4613364404054114205], (8567645715196037518,8582115252294333701], (-7168675257538305135,-7149649709127989390], (6965715832733238798,7063036099816220331], (7546517715491777177,7677219272662982481], (-1748715914423704679,-1675951140703819450], (3043545537047107633,3204598367728467311], (-1675951140703819450,-1617857912083743729], (-3341931331719710834,-3243363005711974427], (2300965396900053792,2334834053137823094], (-3242247155184405641,-3146098278984191407], (-4669883525453470917,-4666349768022335961], (-3605515518424939308,-3475852481001823757], (-2124487292507570055,-2121391251672669896], (5808602976236290859,5910546070877656057], (-2345812349938455211,-2315994820723442097], (-5316580839989081269,-5302908483712120036], (-2509713425923005459,-2442187908132139878], (6448751560452938024,6597269842242382875], (5079147353232591688,5103747128845174010], (1094798156314490587,1106813632278527554], (-8079302261032841997,-8020065496663759037], (4813016556963291644,4818470147489137544], (4658663104610808097,4813016556963291644], (7770071327164997496,7808368515849224035], (-1960093086471708115,-1918815282674568805], (-6670223322263202283,-6626279860694910217], (134868184257870309,225552897381581618], (-4613364404054114205,-4581651378378176219], (7063036099816220331,7073580318726593089], (-1474743810252150119,-1455434959085114174], (4003127755614140468,4019787843664062556], (6117234466388885830,6229335978978911982], (6315379934192237608,6448751560452938024], (-6566055038174482825,-6536143839884954598], (8955838783088646399,9052361047361040724], (-6011143631273973802,-5910940673245312250], (-891112059782189194,-865813783026395844], (4055218812470256868,4108442144727836207], (5103747128845174010,5104512085275416693], (6755922288859516114,6765378709729291988], (8937956827472707994,8955838783088646399], (-1191162261161172230,-1173297175306574420], (5263009221051312616,5427948798724802774], (8094439204847933313,8126093409311349165], (8582115252294333701,8585239989330938803], (-8337502360226969397,-8194228960323724620], (-8677938522332607735,-8630576424142481604], (4982601710440706802,5037532593165026275], (-7444481297701638822,-7234423890758509999], (5225151490394717027,5263009221051312616], (8742369401287698556,8783118334452845573], (5597578420331233762,5657471464295863212], (539709998044165857,540107228278559383], (-7628115345390502309,-7568347090412391551], (-4012831506196956144,-3987346161697258585], (6254460679115878352,6258419835440478547], (-376882609146966368,-284750727009477748], (1743147804972403321,1775464220617467482], (5567628760268333366,5588075779019502102], (332248475366057672,338605477654946414], (7269568472581086374,7329329544601364487], (3825559153565990443,3888098991505707485], (5933650639568493994,5984823447673644161], (-4199092759551388279,-4012831506196956144], (8126093409311349165,8134772137645605183], (-5792380210798637673,-5668652823049581317], (-7149649709127989390,-7090966678799303421], (8134772137645605183,8137831078805445848], (7716472797475363018,7744208753724406282], (-3243363005711974427,-3242247155184405641], (-560522977679529205,-432559732201454885], (3529660907296251783,3679736680802510289], (-7040474757304608631,-6989176600674960972], (-1913144900270573314,-1883862654879506199], (7359142320446873078,7391706359546492554], (1240603197152919938,1257254658726334250], (3743022300744867391,3777272120309031431], (-7090966678799303421,-7040474757304608631], (338605477654946414,441382048077949645], (7808368515849224035,7853699615579312190], (6711850881577841632,6755922288859516114], (9052361047361040724,9064498144528451687], (-7568347090412391551,-7481994566834237583], (540107228278559383,615956222830420997], (2185334176907134487,2193521865313616483], (-8603377518160039977,-8596070786747368651], (-3449142536321900070,-3427025823740558768], (-4388632308947711035,-4372442890320765428], (8019813092330822070,8094439204847933313], (-8568953964833760385,-8526852802005820700], (1257254658726334250,1460867140568836197], (-985655299325475139,-891112059782189194], (7206294117513911708,7242871543962350130], (-5251098634085353447,-5203804162187207459], (-6708676181290826247,-6676861192176208960], (-6676861192176208960,-6670223322263202283], (-5910940673245312250,-5844569777135256810], (626143352733571491,637843149675016075], (1775464220617467482,1810955306336809485], (-1072032663016626224,-1018734615799388302], (621664543354190117,626143352733571491], (-50891220633984432,19561795566035235], (9223181362472230970,-9077762922100480170], (-1161969361744004784,-1133054856985925888], (2334834053137823094,2782267404384741078], (7744208753724406282,7770071327164997496], (7073580318726593089,7206294117513911708], (-6589124617778598963,-6566055038174482825], (-255463616305506606,-195277555759024415], (-1883862654879506199,-1748715914423704679], (-5302908483712120036,-5251098634085353447], (-1194537134448904308,-1191162261161172230], (8307953184294073679,8405756373118010420], (980724992077292794,1094798156314490587], (-1455434959085114174,-1429642428945335210], (6878418231371780355,6965715832733238798]]
2016-07-17 23:42:57,283 INFO  [elasticsearch[0.0.0.0][listener][T#1]] BytesRestResponse.java:131 convert /s/feed/1 Params: {index=s, id=1, type=feed}
java.lang.NullPointerException: null
        at org.elasticsearch.cluster.routing.IndexRoutingTable$Builder.<init>(IndexRoutingTable.java:528) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.routing.RoutingTable$Builder.<init>(RoutingTable.java:422) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.routing.RoutingTable.builder(RoutingTable.java:388) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.metadata.MetaDataCreateIndexService$2.execute(MetaDataCreateIndexService.java:512) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:469) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:231) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:194) ~[elassandra-2.1.1-15.jar:na]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

Sorry, same error because the SimpleStrategy does not have any datacenter. I should have mentionned a keyspace "s" with NetworkTopologyStrategy with RF=1 for tour local datacenter (the GossipPropertyFileSnitch having the datacenter name set).
Thanks'

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

I created keyspace with:
CREATE KEYSPACE IF NOT EXISTS s WITH REPLICATION={'class':'NetworkTopologyStrategy','DC1':1};
Now I get:

2016-07-18 11:51:00,383 INFO  [elasticsearch[0.0.0.0][index][T#1]] BytesRestResponse.java:131 convert /s/feed/1 Params: {index=s, id=1, type=feed}
org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
        at org.apache.cassandra.db.ConsistencyLevel.assureSufficientLiveNodes(ConsistencyLevel.java:257) ~[elassandra-2.1.1-15.jar:na]
        at org.apache.cassandra.service.AbstractWriteResponseHandler.assureSufficientLiveNodes(AbstractWriteResponseHandler.java:146) ~[elassandra-2.1.1-15.jar:na]
        at org.apache.cassandra.service.StorageProxy.performWrite(StorageProxy.java:839) ~[elassandra-2.1.1-15.jar:na]
        at org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:578) ~[elassandra-2.1.1-15.jar:na]
        at org.apache.cassandra.service.StorageProxy.mutateWithTriggers(StorageProxy.java:671) ~[elassandra-2.1.1-15.jar:na]
        at org.apache.cassandra.cql3.statements.ModificationStatement.executeWithoutCondition(ModificationStatement.java:524) ~[elassandra-2.1.1-15.jar:na]
        at org.apache.cassandra.cql3.statements.ModificationStatement.execute(ModificationStatement.java:510) ~[elassandra-2.1.1-15.jar:na]
        at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:226) ~[elassandra-2.1.1-15.jar:na]
        at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:257) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.process(InternalCassandraClusterService.java:375) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.process(InternalCassandraClusterService.java:359) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.insertRow(InternalCassandraClusterService.java:1689) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.insertDocument(InternalCassandraClusterService.java:1642) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.index.TransportXIndexAction.shardOperationOnPrimary(TransportXIndexAction.java:92) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase.performOnPrimary(TransportReplicationAction.java:581) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase$1.doRun(TransportReplicationAction.java:452) [elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elassandra-2.1.1-15.jar:na]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

Now I used:
CREATE KEYSPACE IF NOT EXISTS s WITH REPLICATION={'class':'NetworkTopologyStrategy','RF':1};
And when I try to index I get:

        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.process(InternalCassandraClusterService.java:375) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.process(InternalCassandraClusterService.java:359) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.insertRow(InternalCassandraClusterService.java:1689) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.insertDocument(InternalCassandraClusterService.java:1642) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.index.TransportXIndexAction.shardOperationOnPrimary(TransportXIndexAction.java:92) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase.performOnPrimary(TransportReplicationAction.java:581) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase$1.doRun(TransportReplicationAction.java:452) [elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elassandra-2.1.1-15.jar:na]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
2016-07-18 11:52:42,253 INFO  [elasticsearch[0.0.0.0][index][T#1]] BytesRestResponse.java:131 convert /s/feed/1 Params: {index=s, id=1, type=feed}
org.elasticsearch.action.ActionRequestValidationException: Validation Failed: 1: s.feed table does not exists;
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.getCFMetaData(InternalCassandraClusterService.java:1000) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.insertDocument(InternalCassandraClusterService.java:1572) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.index.TransportXIndexAction.shardOperationOnPrimary(TransportXIndexAction.java:92) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase.performOnPrimary(TransportReplicationAction.java:581) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase$1.doRun(TransportReplicationAction.java:452) [elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elassandra-2.1.1-15.jar:na]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

After creating a table on the keyspace:

CREATE table if not exists s.feed(
project_id bigint,
feed text,
keywords set<text>,
PRIMARY KEY ((project_id, feed)))

Now when I try to index on es {'project_id': 2, 'keywords': ['one', 'two'], 'feed': 'test'} I get:

2016-07-18 12:16:42,099 INFO  [elasticsearch[0.0.0.0][index][T#1]] BytesRestResponse.java:131 convert /s/feed Params: {index=s, type=feed}
java.lang.ClassCastException: java.lang.Integer cannot be cast to java.lang.Long
        at org.elasticsearch.cluster.ClusterService$Utils.addToJsonArray(ClusterService.java:281) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cassandra.cluster.InternalCassandraClusterService.insertDocument(InternalCassandraClusterService.java:1589) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.index.TransportXIndexAction.shardOperationOnPrimary(TransportXIndexAction.java:92) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase.performOnPrimary(TransportReplicationAction.java:581) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase$1.doRun(TransportReplicationAction.java:452) [elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elassandra-2.1.1-15.jar:na]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

You get a type mismatch error because elasticsearch parse your project_id as an integer while your CQL project_id is bigint, a java long. If you want to index an existing Cassandra table, you should use a discover request like this :
Put /s/_mapping/feed -d'{ "feed": {"discover":".*" }}'

This creates an elasticsearch mapping from CQL and your project_id will be typed as a long ( see your cluster state after to check it). Then, when you index a document, field mapping convert your project_id to long and write it to the Cassandra table s.feed as bigint and generate an id as a JSON array for each columns of your primary key.
Thanks'

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

@vroyer I already fixed that in my last email.

For now, it's like this:::::

  1. I create keyspace:
    CREATE KEYSPACE IF NOT EXISTS s WITH REPLICATION={'class':'NetworkTopologyStrategy','dc1':1};
  2. I create table:
    CREATE TABLE IF NOT EXISTS s.feed(project_id BIGINT,feed TEXT,keywords set<TEXT>, PRIMARY KEY ((project_id, feed)))
    Also insert 1 row into the table and I can select it back.
  3. I try to create es-index:
    { "settings": {"keyspace": "s"},"mappings": {"feed": { "discover": ".*"} } }
    I get back:
2016-07-18 19:49:53,601 INFO  [elasticsearch[0.0.0.0][listener][T#1]] BytesRestResponse.java:131 convert /s Params: {index=s}
java.lang.NullPointerException: null
        at org.elasticsearch.cluster.routing.IndexRoutingTable$Builder.<init>(IndexRoutingTable.java:528) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.routing.RoutingTable$Builder.<init>(RoutingTable.java:422) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.routing.RoutingTable.builder(RoutingTable.java:388) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.metadata.MetaDataCreateIndexService$2.execute(MetaDataCreateIndexService.java:512) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:469) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:231) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:194) ~[elassandra-2.1.1-15.jar:na]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

Sorry, i cannot reproduce your issue, with elassandra 2.1.1-15 2 nodes cluster, it works. After creating the keyspace s and the table feed, i have successfully created the right mapping for s.feed.

rvince800@elassandra-eu-01:~$ cqlsh
Connected to Test Cluster at elassandra-eu-01:9042.
[cqlsh 5.0.1 | Cassandra 2.2.6 | CQL spec 3.3.1 | Native protocol v4]
Use HELP for help.
cqlsh> desc keyspace s;
CREATE KEYSPACE s WITH replication = {'class': 'NetworkTopologyStrategy', 'dc1': '1'}  AND durable
_writes = true;
CREATE TABLE s.feed (
    project_id bigint,
    feed text,
    keywords set<text>,
    PRIMARY KEY ((project_id, feed))
) WITH bloom_filter_fp_chance = 0.01
    AND caching = '{"keys":"ALL", "rows_per_partition":"NONE"}'
    AND comment = ''
    AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'}
    AND compression = {'sstable_compression': 'org.apache.cassandra.io.compress.LZ4Compressor'}
    AND dclocal_read_repair_chance = 0.1
    AND default_time_to_live = 0
    AND gc_grace_seconds = 864000
    AND max_index_interval = 2048
    AND memtable_flush_period_in_ms = 0
    AND min_index_interval = 128
    AND read_repair_chance = 0.0
    AND speculative_retry = '99.0PERCENTILE';
cqlsh> 

rvince800@elassandra-eu-01:~$ put s -d'{"settings":{"keyspace":"s"},"mappings":{"feed":{"discover":".*"}}}'
{"acknowledged":true}

rvince800@elassandra-eu-01:~$ get s/_mapping?pretty=true
{
  "s" : {
    "mappings" : {
      "feed" : {
        "properties" : {
          "feed" : {
            "type" : "string",
            "index" : "not_analyzed",
            "cql_collection" : "singleton",
            "cql_partition_key" : true,
            "cql_primary_key_order" : 1
          },
          "keywords" : {
            "type" : "string",
            "index" : "not_analyzed",
            "cql_collection" : "set"
          },
          "project_id" : {
            "type" : "long",
            "cql_collection" : "singleton",
            "cql_partition_key" : true,
            "cql_primary_key_order" : 0
          }
        }
      }
    }
  }
}

May be check that you have a GossipPropertyFileSnitch correctly configured.
Thanks'

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

Only things I changed in config is the rpc-listen address + rpc-broad-cast. I confirm that endpoint_snitch is GossipPropertyFileSnitch .

If I do:
ALTER KEYSPACE s WITH REPLICATION ={ 'class' : 'NetworkTopologyStrategy', 'rf' : 1 };
I can create the es-index. But then can't query/insert data. I have to do:
ALTER KEYSPACE s WITH REPLICATION ={ 'class' : 'NetworkTopologyStrategy', 'dc1' : 1 };
After doing that I can insert data and query from es-index.

Can you paste your entire "create keyspace" query so I can try on a clean installation ? And what configs do you change (as few as possible)?

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

I created the keyspace as described in my previous post, but notes that NetworkTopology take a map '<datacenter_name>':'<replication_factor>' and in my configuration, the elassandra datacenter name is dc1 (configured in cassandra-rackdc.properties). As your datacenter name is likely not rf, your initial keyspace configuration was incorrect. I will improve error management to log a meaningful message.

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

Yes the same for me, it's dc1 (didn't change it). But the problem is that when it's "rf" I can change the es-index (and not change the data) while when it's dc1 I can change data but not es-index. I will try on a clean installation and record everything to see if I can duplicate it.

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

I can confirm this on a simple vm ubuntu-16.04 64bit. I literally did:

  1. sudo add-apt-repository ppa:webupd8team/java
  2. sudo apt-get update
  3. sudo apt-get install oracle-java8-installer
  4. wget https://github.com/vroyer/elassandra/releases/download/2.1.1-15/elassandra-2.1.1-15.zip
  5. export CASSANDRA_HOME=full-path
    5.5. Change rpc-address + rpc-broadcast so I can connect from outside the vm
  6. cd & bin/cassandra -e
  7. CREATE KEYSPACE IF NOT EXISTS s WITH REPLICATION={'class':'NetworkTopologyStrategy','dc1':1};
  8. CREATE TABLE IF NOT EXISTS s.feed(project_id BIGINT,feed TEXT,keywords set<TEXT>,PRIMARY KEY ((project_id, feed)))
  9. Try to create the es-index:

End of system.log:

no alive node having range (4460737942367183122,4562750158711199391]
2016-07-26 16:15:56,385 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (-550419119887495606,-312968028765712978]
2016-07-26 16:15:56,385 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (8805273660069962344,8904137568355170000]
2016-07-26 16:15:56,385 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (4177701556465592315,4237394382111071584]
2016-07-26 16:15:56,385 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (2625561592893301633,2716491260590861291]
2016-07-26 16:15:56,385 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (2416974695458684072,2622976447017867203]
2016-07-26 16:15:56,386 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (-312968028765712978,-231165947009811918]
2016-07-26 16:15:56,386 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (4237394382111071584,4261403175495556830]
2016-07-26 16:15:56,386 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (-7362967702189533597,-7274826506198351471]
2016-07-26 16:15:56,386 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (7535020162996869855,7652066726073258498]
2016-07-26 16:15:56,386 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (-2261664232022499424,-2190699842298598216]
2016-07-26 16:15:56,386 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (-1228739131211012494,-1204416224380688254]
2016-07-26 16:15:56,386 WARN  [elasticsearch[0.0.0.0][clusterService#updateTask][T#1]] PrimaryFirstSearchStrategy.java:101 topology Inconsistent search for keyspace s, no alive node having range (7798480172795911119,7808354218705087479]
2016-07-26 16:15:56,389 INFO  [elasticsearch[0.0.0.0][listener][T#1]] BytesRestResponse.java:131 convert /s Params: {index=s}
java.lang.NullPointerException: null
        at org.elasticsearch.cluster.routing.IndexRoutingTable$Builder.<init>(IndexRoutingTable.java:528) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.routing.RoutingTable$Builder.<init>(RoutingTable.java:422) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.routing.RoutingTable.builder(RoutingTable.java:388) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.metadata.MetaDataCreateIndexService$2.execute(MetaDataCreateIndexService.java:512) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:469) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:231) ~[elassandra-2.1.1-15.jar:na]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:194) ~[elassandra-2.1.1-15.jar:na]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_101]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_101]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_101]

Then I have to do:

  1. ALTER KEYSPACE s WITH REPLICATION ={ 'class' : 'NetworkTopologyStrategy', 'rf' : 1 };
  2. create the index {"settings": {"keyspace": "s"},"mappings": {"feed": {"discover": ".*",}}}
  3. ALTER KEYSPACE s WITH REPLICATION ={ 'class' : 'NetworkTopologyStrategy', 'dc1' : 1 };
  4. and then it works

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

Please copy the create keyspace order of my previous post ( with single quotes around the 1) to properly define it (rf is not a datacenter name nor a valid parameter, dc1 is correct but 1 should be quoted).
Thanks'.

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

@vroyer It still doesn't work for me. Did you try it with 1 node ?

cqlsh> desc s;
CREATE KEYSPACE s WITH replication = {'class': 'NetworkTopologyStrategy', 'dc1':                                                                                         '1'}  AND durable_writes = true;
CREATE TABLE s.feed (
    project_id bigint,
    feed text,
    keywords set<text>,
    PRIMARY KEY ((project_id, feed))
) WITH bloom_filter_fp_chance = 0.01
    AND caching = '{"keys":"ALL", "rows_per_partition":"NONE"}'
    AND comment = ''
    AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCom                                                                                        pactionStrategy'}
    AND compression = {'sstable_compression': 'org.apache.cassandra.io.compress.                                                                                        LZ4Compressor'}
    AND dclocal_read_repair_chance = 0.1
    AND default_time_to_live = 0
    AND gc_grace_seconds = 864000
    AND max_index_interval = 2048
    AND memtable_flush_period_in_ms = 0
    AND min_index_interval = 128
    AND read_repair_chance = 0.0
    AND speculative_retry = '99.0PERCENTILE';

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

It works for me on a single node elassandra cluster under ubutnu 4.4 + java 8 (Google VM). Here is my setup:

sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java8-installer
sudo apt install zip
sudo apt install python-pip
sudo pip install --upgrade pip
sudo pip install cassandra-driver

cd /opt
sudo wget https://github.com/vroyer/elassandra/releases/download/2.1.1-15/elassandra-2.1.1-15.zip
sudo unzip elassandra-2.1.1-15.zip 

cd elassandra-2.1.1-15/
sudo chmod a+w logs
sudo chmod a+w data
sudo vi cassandra.yaml
# change liste_address and rpc_address by listen_interface: ens4 
# change seed address by local IP address

export CASSANDRA_HOME=$PWD
. bin/shortcuts-env.sh (load usefull alias and functions)
ecdebug (alias to start elassandra with debug mode)

rvince800@elassandra-us1:/opt/elassandra-2.1.1-15$ uname -a
Linux elassandra-us1 4.4.0-31-generic #50-Ubuntu SMP Wed Jul 13 00:07:12 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

vince800@elassandra-us1:/opt/elassandra-2.1.1-15$ nodetool status s
Datacenter: dc1
===============
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address     Load       Tokens       Owns (effective)  Host ID                               Rack
UN  10.128.0.4  98.67 KB   256          100.0%            e430d72d-12b5-48ba-9bd0-0fd3d8f0a323  rack1

vince800@elassandra-us1:/opt/elassandra-2.1.1-15$ cqlsh
CREATE KEYSPACE s WITH replication = {'class': 'NetworkTopologyStrategy', 'dc1': '1'}  AND durable_writes = true;
CREATE TABLE s.feed (
    project_id bigint,
    feed text,
    keywords set<text>,
    PRIMARY KEY ((project_id, feed))
)
exit

rvince800@elassandra-us1:/opt/elassandra-2.1.1-15$ put s -d'{"settings":{"keyspace":"s"},"mappings":{"feed":{"discover":".*"}}}'

rvince800@elassandra-us1:/opt/elassandra-2.1.1-15$ get /s/_mapping?pretty=true
{
  "s" : {
    "mappings" : {
      "feed" : {
        "properties" : {
          "feed" : {
            "type" : "string",
            "index" : "not_analyzed",
            "cql_collection" : "singleton",
            "cql_partition_key" : true,
            "cql_primary_key_order" : 1
          },
          "keywords" : {
            "type" : "string",
            "index" : "not_analyzed",
            "cql_collection" : "set"
          },
          "project_id" : {
            "type" : "long",
            "cql_collection" : "singleton",
            "cql_partition_key" : true,
            "cql_primary_key_order" : 0
          }
        }
      }
    }
  }
}

In addition, to fix the JNA mlockall warning in elassandra logs, you can apply this to replace the provided lib/jna-4.1.0.jar

sudo apt-get install libjna-java
sudo ln -s /usr/share/java/jna.jar /opt/elassandra-2.1.1-15/lib
sudo rm /opt/elassandra-2.1.1-15/lib/jna-4.1.0.jar

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

Just did a clean install on a clean vm of 2.1.1-17 version. Writing to cassandra works ok with previous sql
CREATE KEYSPACE IF NOT EXISTS s WITH REPLICATION={'class':'NetworkTopologyStrategy','dc1':'1'};
CREATE TABLE IF NOT EXISTS s.feed(project_id BIGINT,feed TEXT,keywords set<TEXT>,PRIMARY KEY ((project_id, feed)))
Inserting data works ok!. And creating the es-index like previously works:
es.indices.create('s', { "settings": {"keyspace": "s"}, "mappings": { "feed": { "discover": ".*", } } })
But cluster health is red:

{
  "cluster_name" : "Test Cluster",
  "status" : "red",
  "timed_out" : false,
  "number_of_nodes" : 1,
  "number_of_data_nodes" : 1,
  "active_primary_shards" : 0,
  "active_shards" : 0,
  "relocating_shards" : 0,
  "initializing_shards" : 0,
  "unassigned_shards" : 0,
  "delayed_unassigned_shards" : 0,
  "number_of_pending_tasks" : 0,
  "number_of_in_flight_fetch" : 0,
  "task_max_waiting_in_queue_millis" : 0,
  "active_shards_percent_as_number" : "NaN"
}

And logs (running with ecdebug):

2016-10-11 10:07:58,365 WARN  [main] ElassandraDaemon.java:343 main jvm uses the client vm, make sure to run `java` with the server vm for best performance by adding `$
2016-10-11 10:07:58,417 WARN  [main] JNANatives.java:186 trySeccomp Secomp disabled
2016-10-11 10:08:09,590 WARN  [main] TransportService.java:442 registerRequestHandler [0.0.0.0] registered two transport handlers for action internal:gateway/local/sta$
2016-10-11 10:08:09,591 WARN  [main] TransportService.java:442 registerRequestHandler [0.0.0.0] registered two transport handlers for action internal:gateway/local/sta$
2016-10-11 10:08:09,768 DEBUG [main] ElassandraDaemon.java:110 activate Internal workload set to elasticsearch
2016-10-11 10:08:09,769 WARN  [main] CLibrary.java:205 tryMlockall Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out, especially$
2016-10-11 10:08:09,769 WARN  [main] StartupChecks.java:150 execute JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info.
2016-10-11 10:08:09,769 WARN  [main] StartupChecks.java:168 execute 32bit JVM detected.  It is recommended to run Cassandra on a 64bit JVM for better performance.
2016-10-11 10:08:09,772 WARN  [main] SigarLibrary.java:174 warnIfRunningInDegradedMode Cassandra server running in degraded mode. Is swap disabled? : false,  Address s$
2016-10-11 10:08:10,467 DEBUG [main] ElassandraDaemon.java:146 systemKeyspaceInitialized Starting Elasticsearch shards before open user keyspaces...
2016-10-11 10:08:13,406 DEBUG [main] ElassandraDaemon.java:121 activate Schedule elastic_admin post initialization in 5s
2016-10-11 10:08:18,416 DEBUG [Timer-0] ElassandraDaemon.java:126 run Executing elastic_admin post initialization
2016-10-11 10:11:50,625 WARN  [main] DatabaseDescriptor.java:527 applyConfig Small commitlog volume detected at /home/guru/elassandra-2.1.1-17/data/commitlog; setting $
2016-10-11 10:11:50,633 WARN  [main] DatabaseDescriptor.java:573 applyConfig Only 14023 MB free across all data volumes. Consider adding more capacity to your cluster $
2016-10-11 10:11:51,056 WARN  [main] ElassandraDaemon.java:343 main jvm uses the client vm, make sure to run `java` with the server vm for best performance by adding `$
2016-10-11 10:11:51,111 WARN  [main] JNANatives.java:186 trySeccomp Secomp disabled
2016-10-11 10:12:02,858 WARN  [main] TransportService.java:442 registerRequestHandler [0.0.0.0] registered two transport handlers for action internal:gateway/local/sta$
2016-10-11 10:12:02,858 WARN  [main] TransportService.java:442 registerRequestHandler [0.0.0.0] registered two transport handlers for action internal:gateway/local/sta$
2016-10-11 10:12:03,077 DEBUG [main] ElassandraDaemon.java:110 activate Internal workload set to elasticsearch
2016-10-11 10:12:03,079 WARN  [main] CLibrary.java:205 tryMlockall Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out, especially$
2016-10-11 10:12:03,079 WARN  [main] StartupChecks.java:150 execute JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info.
2016-10-11 10:12:03,080 WARN  [main] StartupChecks.java:168 execute 32bit JVM detected.  It is recommended to run Cassandra on a 64bit JVM for better performance.
2016-10-11 10:12:03,083 WARN  [main] SigarLibrary.java:174 warnIfRunningInDegradedMode Cassandra server running in degraded mode. Is swap disabled? : false,  Address s$
2016-10-11 10:12:04,292 DEBUG [main] ElassandraDaemon.java:146 systemKeyspaceInitialized Starting Elasticsearch shards before open user keyspaces...
2016-10-11 10:12:07,638 DEBUG [main] ElassandraDaemon.java:121 activate Schedule elastic_admin post initialization in 5s
2016-10-11 10:12:12,645 DEBUG [Timer-0] ElassandraDaemon.java:126 run Executing elastic_admin post initialization

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

Hi,
As you can seen in the cluster health, there is no active shards, so active_shards_percent_as_number is undefined.
If you check your cluster state, i think you don’t have any entry in your routing table, for some reasons.
Maybe check that you create index request has really targeted elassandra.
Thanks.

Le 11 oct. 2016 à 10:23, ddorian [email protected] a écrit :

Just did a clean install on a clean vm of 2.1.1-17 version. Writing to cassandra works ok with previous sql
CREATE KEYSPACE IF NOT EXISTS s WITH REPLICATION={'class':'NetworkTopologyStrategy','dc1':'1'};
CREATE TABLE IF NOT EXISTS s.feed(project_id BIGINT,feed TEXT,keywords set,PRIMARY KEY ((project_id, feed)))
Inserting data works ok!. And creating the es-index like previously works:

es.indices.create('s', {
"settings": {"keyspace": "s"},
"mappings": {
"feed": {
"discover": ".*",
}
}
})

But cluster health is red:

{
"cluster_name" : "Test Cluster",
"status" : "red",
"timed_out" : false,
"number_of_nodes" : 1,
"number_of_data_nodes" : 1,
"active_primary_shards" : 0,
"active_shards" : 0,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : "NaN"
}
And logs (running with ecdebug):

2016-10-11 10:07:58,365 WARN [main] ElassandraDaemon.java:343 main jvm uses the client vm, make sure to run java with the server vm for best performance by adding $ 2016-10-11 10:07:58,417 WARN [main] JNANatives.java:186 trySeccomp Secomp disabled 2016-10-11 10:08:09,590 WARN [main] TransportService.java:442 registerRequestHandler [0.0.0.0] registered two transport handlers for action internal:gateway/local/sta$ 2016-10-11 10:08:09,591 WARN [main] TransportService.java:442 registerRequestHandler [0.0.0.0] registered two transport handlers for action internal:gateway/local/sta$ 2016-10-11 10:08:09,768 DEBUG [main] ElassandraDaemon.java:110 activate Internal workload set to elasticsearch 2016-10-11 10:08:09,769 WARN [main] CLibrary.java:205 tryMlockall Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out, especially$ 2016-10-11 10:08:09,769 WARN [main] StartupChecks.java:150 execute JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. 2016-10-11 10:08:09,769 WARN [main] StartupChecks.java:168 execute 32bit JVM detected. It is recommended to run Cassandra on a 64bit JVM for better performance. 2016-10-11 10:08:09,772 WARN [main] SigarLibrary.java:174 warnIfRunningInDegradedMode Cassandra server running in degraded mode. Is swap disabled? : false, Address s$ 2016-10-11 10:08:10,467 DEBUG [main] ElassandraDaemon.java:146 systemKeyspaceInitialized Starting Elasticsearch shards before open user keyspaces... 2016-10-11 10:08:13,406 DEBUG [main] ElassandraDaemon.java:121 activate Schedule elastic_admin post initialization in 5s 2016-10-11 10:08:18,416 DEBUG [Timer-0] ElassandraDaemon.java:126 run Executing elastic_admin post initialization 2016-10-11 10:11:50,625 WARN [main] DatabaseDescriptor.java:527 applyConfig Small commitlog volume detected at /home/guru/elassandra-2.1.1-17/data/commitlog; setting $ 2016-10-11 10:11:50,633 WARN [main] DatabaseDescriptor.java:573 applyConfig Only 14023 MB free across all data volumes. Consider adding more capacity to your cluster $ 2016-10-11 10:11:51,056 WARN [main] ElassandraDaemon.java:343 main jvm uses the client vm, make sure to runjavawith the server vm for best performance by adding$
2016-10-11 10:11:51,111 WARN [main] JNANatives.java:186 trySeccomp Secomp disabled
2016-10-11 10:12:02,858 WARN [main] TransportService.java:442 registerRequestHandler [0.0.0.0] registered two transport handlers for action internal:gateway/local/sta$
2016-10-11 10:12:02,858 WARN [main] TransportService.java:442 registerRequestHandler [0.0.0.0] registered two transport handlers for action internal:gateway/local/sta$
2016-10-11 10:12:03,077 DEBUG [main] ElassandraDaemon.java:110 activate Internal workload set to elasticsearch
2016-10-11 10:12:03,079 WARN [main] CLibrary.java:205 tryMlockall Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out, especially$
2016-10-11 10:12:03,079 WARN [main] StartupChecks.java:150 execute JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info.
2016-10-11 10:12:03,080 WARN [main] StartupChecks.java:168 execute 32bit JVM detected. It is recommended to run Cassandra on a 64bit JVM for better performance.
2016-10-11 10:12:03,083 WARN [main] SigarLibrary.java:174 warnIfRunningInDegradedMode Cassandra server running in degraded mode. Is swap disabled? : false, Address s$
2016-10-11 10:12:04,292 DEBUG [main] ElassandraDaemon.java:146 systemKeyspaceInitialized Starting Elasticsearch shards before open user keyspaces...
2016-10-11 10:12:07,638 DEBUG [main] ElassandraDaemon.java:121 activate Schedule elastic_admin post initialization in 5s
2016-10-11 10:12:12,645 DEBUG [Timer-0] ElassandraDaemon.java:126 run Executing elastic_admin post initialization
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub #38 (comment), or mute the thread https://github.com/notifications/unsubscribe-auth/AJzHmXBpHZMlVeUKDYktvy2J_EhEG-W-ks5qy0d1gaJpZM4JMe5P.

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

Note that before I issued the create_index the cluster-state was green! and the active_shards_percent_as_number was 0. I can also see the index on:
http://localhost:9200/s/ (returns the body as always)
Though I can't "cd" into the /data/elasticsearch.data/Test Cluster (-bash: cd: Test: No such file or directory)

So I changed the cluster-name to "els01" and then I could go in the directory (after recreating data+indicies) and see the normal data that es saves in the data dir.

But still the cluster-health-status is read:

{
  "cluster_name" : "els01",
  "status" : "red",
  "timed_out" : false,
  "number_of_nodes" : 1,
  "number_of_data_nodes" : 1,
  "active_primary_shards" : 0,
  "active_shards" : 0,
  "relocating_shards" : 0,
  "initializing_shards" : 0,
  "unassigned_shards" : 0,
  "delayed_unassigned_shards" : 0,
  "number_of_pending_tasks" : 0,
  "number_of_in_flight_fetch" : 0,
  "task_max_waiting_in_queue_millis" : 0,
  "active_shards_percent_as_number" : "NaN"
}

And no new stuff in logs.
Index settings:

{"s":{"aliases":{},"mappings":{"feed":{"properties":{"feed":{"type":"string","index":"not_analyzed","cql_collection":"singleton","cql_partition_key":true,"cql_primary_key_order":1},"keywords":{"type":"string","index":"not_analyzed","cql_collection":"set"},"project_id":{"type":"long","cql_collection":"singleton","cql_partition_key":true,"cql_primary_key_order":0}}}},"settings":{"index":{"keyspace":"s","creation_date":"1476347486082","number_of_shards":"1","number_of_replicas":"0","uuid":"w_KjcwRTQnK7sDcmsrH9ig","version":{"created":"2010199"}}},"warmers":{}}}

from elassandra.

vroyer avatar vroyer commented on May 25, 2024

To go in a directory containing a space character, just type cd "Test Cluster" or cd Test\ Cluster

Changing the cluster name is a tricky thing as describe in the documentation, so i won’t probably help on a cluster facing an issue.

The shard (or shards if your cluster have many nodes, please provide the full cluster state) is not started, may be your file system is full ?

from elassandra.

ddorian avatar ddorian commented on May 25, 2024

Still single node in virtualbox x86. There is freespace, about 13GB.
I recreated all stuff after I changed the cluster-name, but the error is still the same (meaning no error, just red).

from elassandra.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.