Comments (6)
Here's my writeup, thanks again for sharing these steps with the community!
http://www.willgorman.com/?p=61
from pentaho-kafka-consumer.
Hi Will,
Thank you for you interest and for the great article!
I've just pushed an update to the Marketplace repository, but it will take some time until it's available on the Marketplace itself.
The problem you describe regarding the need to copy jar files into the Kettle's lib/ directory is weird, I've never encountered it before. I guess it has something to do with the version of Kettle that you're using.
I'll try to run consumer/producer plug-ins with Kettle 6 soon.
Thanks!
Michael
from pentaho-kafka-consumer.
I noticed in the "plugin.xml" file for the Consumer Plugin that you had lib/kafka_2.10-0.8.1.jar in the xml file, but lib/kafka_2.10-0.8.1.1.jar in the actual folder. Notice the extra ".1" at the end of the file name. Correcting the entry in plugin.xml fixed this for me. However, as with others, I am having trouble getting data using the Consumer plugin. I'll keep an eye out for the updates in the Marketplace.
Thanks,
Greg
from pentaho-kafka-consumer.
New plugin version depends on kafka_2.10-0.8.2.1.jar
Can you grab the latest version?
Thanks,
Michael
On Mon, Jan 4, 2016 at 11:16 PM Greg Hayes [email protected] wrote:
I noticed in the "plugin.xml" file for the Consumer Plugin that you had
lib/kafka_2.10-0.8.1.jar in the xml file, but lib/kafka_2.10-0.8.1.1.jar in
the actual folder. Notice the extra ".1" at the end of the file name.
Correcting the entry in plugin.xml fixed this for me. However, as with
others, I am having trouble getting data using the Consumer plugin. I'll
keep an eye out for the updates in the Marketplace.Thanks,
Greg—
Reply to this email directly or view it on GitHub
#11 (comment)
.
from pentaho-kafka-consumer.
Thanks for updating the marketplace! I just tried out the latest version in my environment. I am still encountering the jar issue, maybe this is a windows only issue? Also, there now is a conflict with the xml-apis in Kettle 6.0, Kettle ships with version 2.0.2 of the jar and the plugin has an older version. Once I commented out the older version from the plugin.xml the consumer worked. The producer doesn't have an issue with it even though the jar is included in that as well.
from pentaho-kafka-consumer.
Please try the newer version, it uses annotation-based registration.
from pentaho-kafka-consumer.
Related Issues (20)
- does it work with pentaho 6.1? HOT 6
- Controlling Offsets HOT 4
- Kafka 0.10 support is missing HOT 3
- Apache Kafka Consumer - using variables HOT 2
- Sub-transforms HOT 2
- Using consumer with pdi 6.1.0.3 enterprise - java.lang.linkageError: loader constraint violation HOT 1
- Kafka Consumer Step Question HOT 3
- SSL Encryption HOT 3
- Kafka reprocess messages HOT 3
- kafka 2.11.010 err HOT 3
- Kafka Consumer doesn't allow parameters in the properties section... HOT 3
- New client access for new versions of Kafka HOT 3
- after kafka connect JavaScript have question HOT 2
- does the zookeerper server parameter allow to have multiple nodes ? HOT 1
- process parition specific data HOT 1
- Testing in JDK 9 is not supported
- consumer can't work?
- Consumer reads messages more than once HOT 2
- I want to connect bootstrap.servers , but there are no parameters HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pentaho-kafka-consumer.