Comments (11)
Trifecta is looking for the Kafka brokers under "/brokers/ids"; however, in your case it's "/kafka/brokers/ids". I guess I need to create a property for specifying the root of the tree; in your case it would be "/kafka" instead of "/". I'll do that and let you know when it's checked in.
from trifecta.
Could you issue the following commands in Trifecta:
zcd /kafka
zls
And send me the results?
from trifecta.
Please try the code in branch scala_2.11-0.8.2-beta and add the following property to your config:
trifecta.zookeeper.kafka.brokers.path = /kafka/brokers
from trifecta.
still is not picking up the brokers / topics after setting:
trifecta.zookeeper.kafka.brokers.path = /kafka/brokers
| path creationTime |
| consumers 01/18/15 08:52:53 CST |
| config 01/18/15 08:52:53 CST |
| controller 03/03/15 01:23:20 CST |
| brokers 01/18/15 08:52:53 CST |
| admin 01/18/15 08:52:53 CST |
| controller_epoch 01/18/15 08:52:53 CST |
zk:/kafka> zcd /kafka/brokers
zk:/kafka/brokers> zls
| path creationTime |
| topics 01/18/15 08:52:53 CST |
| ids 01/18/15 08:52:53 CST |
zk:/kafka/brokers> zcd /kafka/brokers/ids
zk:/kafka/brokers/ids> zls
| path creationTime |
| 642 03/03/15 01:23:20 CST |
| 643 03/03/15 01:23:20 CST |
| 641 03/03/15 01:23:20 CST |
zk:/kafka/brokers/ids>
from trifecta.
Okay, I've updated the branch and I think this version will work for you. Set the following in your config and let me know if you have any issues:
trifecta.zookeeper.kafka.root.path = /kafka
from trifecta.
For your convenience, I've published a pre-released binary version (v0.18.16-beta1) with the multi-tenant support you require.
https://github.com/ldaniels528/trifecta/releases
from trifecta.
Im stilling hitting an issue in changing the path.
2015-03-03 17:27:00 ERROR WebContentActor:47 - Resource '/rest/getTopicSummaries' failed unexpectedly
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/ids
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1590)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:214)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:200)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38)
at com.ldaniels528.trifecta.io.zookeeper.ZkProxyCurator.getChildren(ZkProxyCurator.scala:68)
at com.ldaniels528.trifecta.io.kafka.KafkaMicroConsumer$.getBrokerList(KafkaMicroConsumer.scala:355)
at com.ldaniels528.trifecta.rest.KafkaRestFacade.com$ldaniels528$trifecta$rest$KafkaRestFacade$$brokers$lzycompute(KafkaRestFacade.scala:65)
at com.ldaniels528.trifecta.rest.KafkaRestFacade.com$ldaniels528$trifecta$rest$KafkaRestFacade$$brokers(KafkaRestFacade.scala:65)
at com.ldaniels528.trifecta.rest.KafkaRestFacade$$anonfun$getTopicSummaries$1.apply(KafkaRestFacade.scala:491)
at com.ldaniels528.trifecta.rest.KafkaRestFacade$$anonfun$getTopicSummaries$1.apply(KafkaRestFacade.scala:507)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2015-03-03 17:27:00 ERROR WebContentActor:47 - Resource '/rest/getConsumerDetails' failed unexpectedly
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /consumers
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1590)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:214)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:200)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38)
at com.ldaniels528.trifecta.io.zookeeper.ZkProxyCurator.getChildren(ZkProxyCurator.scala:68)
at com.ldaniels528.trifecta.io.kafka.KafkaMicroConsumer$.getConsumerDetails(KafkaMicroConsumer.scala:371)
at com.ldaniels528.trifecta.rest.KafkaRestFacade$$anonfun$getConsumerGroupsNative$1.apply(KafkaRestFacade.scala:276)
at com.ldaniels528.trifecta.rest.KafkaRestFacade$$anonfun$getConsumerGroupsNative$1.apply(KafkaRestFacade.scala:276)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
from trifecta.
Is this issue happening for both the command line interface and the web application?
from trifecta.
actually, I was using the wrong param, when I used the latest one, it appears to work!
trifecta.zookeeper.kafka.root.path
thanks !
from trifecta.
:-) Great! I'll close the issue. Enjoy!
from trifecta.
Hello Im also facing the issue
From commandline, this is working
curl localhost:9000/api/broker
[{"host":"XX.XX.X.XX","port":9092,"brokerId":0},{"host":"XX.XX.X.XX","port":9092,"brokerId":0}]
But in the UI (Screenshot also attached)
################
No brokers were found.
This usually means that either:
Kafka has not been setup on the Zookeeper node for which you are pointing.
Or, Trifecta has not been configured to point to the Zookeeper instance that is running Kafka.
#################
###########################
cat config.properties
trifecta.web.host = 0.0.0.0
trifecta.web.port = 9000
trifecta.zookeeper.host = XX.XX.X.XX:2181
trifecta.web.push.interval.consumer = 15
trifecta.web.push.interval.sampling = 2
trifecta.web.push.interval.topic = 15
trifecta.zookeeper.kafka.root.path = /logging
trifecta.web.actor.concurrency = 10
##############################
from trifecta.
Related Issues (20)
- trifecta.web.port setting is not working HOT 6
- Trifecta Console unable to connect to Kafka enable with Kerberos
- Trifecta with two way SSL
- Native consumer groups support in v0.22 RC's HOT 4
- Query window default should enclose topic names in quotes when the name contains non-alphanumeric characters HOT 1
- Custom port not working HOT 2
- Errors encountered while loading the project
- batch script update HOT 2
- In Observe panel ,some offsets display same content as offset before HOT 4
- Cannot connect to brokers from remote server
- [kafka-avro]no content to map due to end-of-input at source line 1 column 1 HOT 1
- Support for plain text messages in KQL
- Support for partition and offset in KQL queries
- Ability to change http server port from default 9000 HOT 1
- Message count does not consider offset 0 (v0.21.2)
- [UI] searching data with return 404
- How to export all messages from topic by UI?
- Support for custom pluggable custom decoders
- Support kafka 2.0.0
- Can't stop streaming. "No streaming session found"
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from trifecta.