Some questions about pentaho-kafka-consumer HOT 6 CLOSED

Here's my writeup, thanks again for sharing these steps with the community!
http://www.willgorman.com/?p=61

from pentaho-kafka-consumer.

Hi Will,

Thank you for you interest and for the great article!
I've just pushed an update to the Marketplace repository, but it will take some time until it's available on the Marketplace itself.

The problem you describe regarding the need to copy jar files into the Kettle's lib/ directory is weird, I've never encountered it before. I guess it has something to do with the version of Kettle that you're using.
I'll try to run consumer/producer plug-ins with Kettle 6 soon.

Thanks!
Michael

from pentaho-kafka-consumer.

I noticed in the "plugin.xml" file for the Consumer Plugin that you had lib/kafka_2.10-0.8.1.jar in the xml file, but lib/kafka_2.10-0.8.1.1.jar in the actual folder. Notice the extra ".1" at the end of the file name. Correcting the entry in plugin.xml fixed this for me. However, as with others, I am having trouble getting data using the Consumer plugin. I'll keep an eye out for the updates in the Marketplace.

Thanks,
Greg

from pentaho-kafka-consumer.

New plugin version depends on kafka_2.10-0.8.2.1.jar
Can you grab the latest version?

Thanks,
Michael

On Mon, Jan 4, 2016 at 11:16 PM Greg Hayes [email protected] wrote:

I noticed in the "plugin.xml" file for the Consumer Plugin that you had
lib/kafka_2.10-0.8.1.jar in the xml file, but lib/kafka_2.10-0.8.1.1.jar in
the actual folder. Notice the extra ".1" at the end of the file name.
Correcting the entry in plugin.xml fixed this for me. However, as with
others, I am having trouble getting data using the Consumer plugin. I'll
keep an eye out for the updates in the Marketplace.

Thanks,
Greg

—
Reply to this email directly or view it on GitHub
#11 (comment)
.

from pentaho-kafka-consumer.

Thanks for updating the marketplace! I just tried out the latest version in my environment. I am still encountering the jar issue, maybe this is a windows only issue? Also, there now is a conflict with the xml-apis in Kettle 6.0, Kettle ships with version 2.0.2 of the jar and the plugin has an older version. Once I commented out the older version from the plugin.xml the consumer worked. The producer doesn't have an issue with it even though the jar is included in that as well.

from pentaho-kafka-consumer.

Please try the newer version, it uses annotation-based registration.

from pentaho-kafka-consumer.