Unknown setting 'message_format' for webhdfs about logstash-output-webhdfs HOT 7 CLOSED

And also want to reflect the parameters in the document:https://www.elastic.co/guide/en/logstash/2.3/plugins-outputs-webhdfs.html#plugins-outputs-webhdfs-message_format

from logstash-output-webhdfs.

Hello langke93 !

Thanks for your feedback and problem report. I will have a look at this problem in the next couple of days and get back to you as soon as I have some news.

Take care,
Björn

from logstash-output-webhdfs.

Hi again!

The configuration option 'message_format' was removed in commit 8f1cf04#diff-d807ea36853d4e0b3acf6ef50b87c259.
Please use the format option of the line output codec instead. E.g.:
output { webhdfs { host => ... .... codec => { line { format => "custom format: %{message}" } } } }

Still, we need to check why the documentation does not reflect the current code and sorry for the confusion, caused by this!

So thank you very much for pointing this out and for your commit! Still, as the default way should be to use the line codec with the format parameter, I will not merge your commit. Not because it's bad or anything ;)

Take care and all the best,
Björn

I will leave this issue open until we found out, why the documentations is not up to date.

from logstash-output-webhdfs.

output{
webhdfs{
host => "sea2"
standby_host => "sea3"
codec => {line { format => "custom format: %{message}"}}
}
}
tips:
The given configuration is invalid. Reason: Expected one of #, => at line 35, column 20 (byte 1427) after output {
webhdfs{
host => "sea2"
standby_host => "sea3"
codec => {line {:level=>:fatal}

And then I modify:
codec => {line =>{ format => "custom format: %{message}"}}
Then prompt :

Pipeline aborted due to error {:exception=>#<NoMethodError: undefined method `on_event' for ["line", {"format"=>"custom format: %{message}"}]:Array>

from logstash-output-webhdfs.

My bad ;)

The example I gave was invalid, as you correctly pointed out.
Correct example:

webhdfs{
host => "sea2"
standby_host => "sea3"
codec => line { format => "custom format: %{message}"}
}

Sorry for this mistake!

Take care,
Björn

from logstash-output-webhdfs.

Hello langke93 !

Could you please let me know if this new configuration does work for you?
If so, this issue could be closed.

Take care and have a nice weekend,
Björn

from logstash-output-webhdfs.

thanks,is ok

from logstash-output-webhdfs.