ceph-dovecot / imaptest Goto Github PK

building imaptest against dovecot master 2.3 and performing tests
with custom mailbox with mails > 500kb.

panic occurs:

Panic: file ostream.c: line 394 (o_stream_send_istream): assertion failed: (!_outstream->finished)
Error: Raw backtrace: /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(+0xcd731) [0x7fec7849c731] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(+0xcd786) [0x7fec7849c786] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(i_fatal+0) [0x7fec7840bd68] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(o_stream_send_istream+0x218) [0x7fec784c3458] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(smtp_client_command_send_more+0x1a7) [0x7fec78415787] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(+0x4c292) [0x7fec7841b292] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(+0xf6120) [0x7fec784c5120] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(io_loop_call_io+0x69) [0x7fec784b4769] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(io_loop_handler_run_internal+0x12e) [0x7fec784b602e] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7fec784b486c] -> /home/jan/projects/dovecot.2.3/dovecot/src/lib-dovecot/.libs/libdovecot.so.0(io_loop_run+0x38) [0x7fec784b4a78] -> /home/jan/projects/tests/imaptest/src/.libs/imaptest(main+0xa87) [0x55bb1c27e6e7] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7fec778271c1] -> /home/jan/projects/tests/imaptest/src/.libs/imaptest(_start+0x2a) [0x55bb1c27eb7a]
Aborted (core dumped)

setting username_start_index should skip the lines < index.

The get metadata queries sometimes lead to.
NO MAILBOX SELECTED OR INVALID FETCH.

Out of memory exception after several days running imaptest with profile.

0 0 0 0 1 8 8 1 1 0 8 2 12 2 5Fatal: block_alloc(1073741824): Out of memory
Error: Raw backtrace: ./imaptest() [0x456460] -> ./imaptest() [0x4564a1] -> ./imaptest(i_error+0) [0x419675] -> ./imaptest() [0x465e5a] -> ./imaptest() [0x465ebb] -> ./imaptest() [0x4519fc] -> ./imaptest(buffer_create_dynamic+0x39) [0x451c79] -> ./imaptest(mailbox_state_handle_fetch+0xc00) [0x4257f0] -> ./imaptest(imap_client_handle_untagged+0x336) [0x420c26] -> ./imaptest(imap_client_profile_handle_untagged+0x13) [0x428bc3] -> ./imaptest() [0x4213b4] -> ./imaptest() [0x41c201] -> ./imaptest(io_loop_call_io+0x61) [0x45f451] -> ./imaptest(io_loop_handler_run_internal+0xef) [0x460b6f] -> ./imaptest(io_loop_handler_run+0x56) [0x45f546] -> ./imaptest(io_loop_run+0x38) [0x45f768] -> ./imaptest(main+0x832) [0x41a162] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f694f5c16e5] -> ./imaptest(_start+0x29) [0x41a8b9]

During the imaptest a lot of mailbox not selected Errors occured also.

Already performed valgrind tests on imaptest "without errors" without any memory leak.

profile supports definition of lmtp_port but not of
lmtp_host. default is localhost!

• user_file only applies to "regular" imaptest run.

support username file in profile.conf.

user_file= full path to username file format (list of usernames)
support for: username_start_index= (will start at line...)

• 6196 stalled for 19 secs in command: 2 LIST "" *
• 6014 stalled for 17 secs in command: 7 UID FETCH 13 (RFC822.SIZE BODY[] x-guid)
• 6067 stalled for 17 secs in command: 7 UID FETCH 17 (RFC822.SIZE BODY[] x-guid)
• 5182 stalled for 28 secs in command: 10 UID FETCH 8 (RFC822.SIZE BODY[] x-guid)
• 5492 stalled for 28 secs in command: 15 UID FETCH 13 (RFC822.SIZE BODY[] x-guid)
• 6158 stalled for 28 secs in command: 2 LIST "" *
• 6117 stalled for 36 secs in command: 2 LIST "" *
• 5538 stalled for 17 secs in command: 15 UID FError: t480[6102]: BAD reply for command: UID FETCH 12 (RFC822.SIZE BODY[] x-guid): 6102.3 BAD No mailbox selected (0.001 + 0.000 secs) .
  ETCH 14 (BODYSTRUCTURE BODY.PEEK[] x-guid)

dovecot.log
t480.log.gz
t480-info.log.gz

==24694==
==24694== HEAP SUMMARY:
==24694== in use at exit: 328 bytes in 4 blocks
==24694== total heap usage: 83,321 allocs, 83,317 frees, 63,177,232 bytes allocated
==24694==
==24694== Searching for pointers to 4 not-freed blocks
==24694== Checked 726,104 bytes
==24694==
==24694== 6 bytes in 1 blocks are definitely lost in loss record 1 of 4
==24694== at 0x4C2FB0F: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==24694== by 0x13291B: profile_parse_line_root (profile-parse.c:218)
==24694== by 0x13291B: profile_parse (profile-parse.c:345)
==24694== by 0x122593: main (imaptest.c:726)
==24694==
==24694== 10 bytes in 1 blocks are definitely lost in loss record 2 of 4
==24694== at 0x4C2FB0F: malloc (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==24694== by 0x132A67: profile_parse_line_root (profile-parse.c:215)
==24694== by 0x132A67: profile_parse (profile-parse.c:345)
==24694== by 0x122593: main (imaptest.c:726)
==24694==
==24694== LEAK SUMMARY:
==24694== definitely lost: 16 bytes in 2 blocks
==24694== indirectly lost: 0 bytes in 0 blocks
==24694== possibly lost: 0 bytes in 0 blocks
==24694== still reachable: 312 bytes in 2 blocks
==24694== suppressed: 0 bytes in 0 blocks
==24694== Reachable blocks (those to which a pointer was found) are not shown.
==24694== To see them, rerun with: --leak-check=full --show-leak-kinds=all
==24694==
==24694== ERROR SUMMARY: 2 errors from 2 contexts (suppressed: 0 from 0)
==24694== ERROR SUMMARY: 2 errors from 2 contexts (suppressed: 0 from 0)

Replace lmtp with smtp protocol.

• create rpm

• configure influx db host and port in profile.conf
• send imaptest total messages/sec for each STATE in one message to influxdb.
  e.g.:
  influx_db_host=192.168.176.22
  influx_db_port=8086

currently no ts is added to the influx_db outfile.