Logix should reconnect to AMQP in case of a disconnection, instead of just quitting.
Especially in daemon mode.

Removing logix ...
dpkg (subprocess): unable to execute installed post-removal script (/var/lib/dpkg/info/logix.postrm): Exec format error
dpkg: error processing logix (--remove):
subprocess installed post-removal script returned error exit status 2
Processing triggers for ureadahead ...
Errors were encountered while processing:
logix
E: Sub-process /usr/bin/dpkg returned an error code (1)

Hey,

It would be great if you could add a little more context in the readme about why sending syslog over AMQP is better/different than TCP or UDP. It seems like it has security benefits, and reliability benefits, the possibility to fan-out and send messages to different places, etc, but I'd love to hear your reasons, and I think it would give the Graylog community some good context to this project. Thanks!

-Nick

Please add a [configurable] TTL to the message publish opts.

Hey ncode

There's a typo in your README.md. Second heading under 'Usage' is
Add to your grailog2.conf
while it should be
Add to your graylog2.conf

Just for your information :)

Cheers,
Air

Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/gevent/greenlet.py", line 390, in run
result = self._run(_self.args, *_self.kwargs)
File "/usr/sbin/logix", line 60, in parse_and_queue_datagram
with conn.SimpleQueue(queue) as queue:
File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 494, in SimpleQueue
channel = self.channel()
File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 159, in channel
chan = self.transport.create_channel(self.connection)
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 235, in create_channel
return connection.channel()
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 144, in channel
return Channel(self, channel_id)
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 183, in init
super(Channel, self).init(_args, *_kwargs)
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/channel.py", line 82, in init
self._x_open()
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/channel.py", line 471, in _x_open
(20, 11), # Channel.open_ok
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/abstract_channel.py", line 89, in wait
self.channel_id, allowed_methods)
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/connection.py", line 218, in _wait_method
self.wait()
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/abstract_channel.py", line 105, in wait
return amqp_method(self, args)
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/connection.py", line 367, in _close
raise AMQPConnectionException(reply_code, reply_text, (class_id, method_id))
AMQPConnectionException: (320, u"CONNECTION_FORCED - broker forced connection closure with reason 'shutdown'", (0, 0), '')
<Greenlet at 0x26578d0: parse_and_queue_datagram('<78>Mar 28 11:30:01 fenix1 CRON[10593]: (root) CM, ('127.0.0.1', 41144), 'graylog2', <BrokerConnection: amqp://[email protected]:)> failed with AMQPConnectionException

~/logix# grep -ri "loggix" *
debian/logix/usr/sbin/logix: daemon = Daemon(name='loggix', catch_all_log="/var/log/logix.log")
src/bin/logix: daemon = Daemon(name='loggix', catch_all_log="/var/log/logix.log")

É intencional ncode?

Att:

Please add a local queue (msg-buffer) between mainThread and greenlets (workers)

O logix só reconecta depois de um restart.

Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/gevent/greenlet.py", line 390, in run
result = self._run(_self.args, *_self.kwargs)
File "/usr/sbin/logix", line 60, in parse_and_queue_datagram
with conn.SimpleQueue(queue) as queue:
File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 494, in SimpleQueue
channel = self.channel()
File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 159, in channel
chan = self.transport.create_channel(self.connection)
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 235, in create_channel
return connection.channel()
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 144, in channel
return Channel(self, channel_id)
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 183, in init
super(Channel, self).init(_args, *_kwargs)
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/channel.py", line 82, in init
self._x_open()
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/channel.py", line 469, in _x_open
self._send_method((20, 10), args)
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/abstract_channel.py", line 70, in _send_method
method_sig, args, content)
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/method_framing.py", line 233, in write_method
self.dest.write_frame(1, channel, payload)
File "/usr/lib/pymodules/python2.7/amqplib/client_0_8/transport.py", line 125, in write_frame
frame_type, channel, size, payload, 0xce))
File "/usr/lib/python2.7/dist-packages/gevent/socket.py", line 504, in sendall
data_sent += self.send(_get_memory(data, data_sent), flags)
File "/usr/lib/python2.7/dist-packages/gevent/socket.py", line 478, in send
return sock.send(data, flags)
error: [Errno 32] Broken pipe
<Greenlet at 0x1eb1f30: parse_and_queue_datagram('<22>Apr 16 12:00:12 falange1 postfix/smtpd[22721], ('127.0.0.1', 53611), 'graylog2', <BrokerConnection: amqp://[email protected]:)> failed with error

Hi,

I'm using logix on central syslog server to send all logs to graylog. Unfortunately logix uses too many RAM with time. In 2 days uses circa 400MB.

Some idea? Thx

O servidor da fila fica acumulando conexões estabelecidas até estourar o limite de conexões.

Com 51 hosts, demora em media duas semanas para o servidor do rabbit atingir o total de 5 mil conexões (limites setados por mim).

Aparentemente, cada maquina abre varias conexões com o server, e não a fecha depois de usar.

netstat -ntp |grep 5672 |wc -l

5002

netstat -ntp |grep 5672 | grep 215.13 |wc -l

167

netstat -ntp |grep 5672 | grep 171.98 |wc -l

41