I'm not sure if this is the right place for bugs, but twice I've managed to get a JVM dump when running a distributed stress against my very thing jzmq bound app. I'll start here and if I need to move it down the stack to zmq, please let me know.
I'm writing a handler for mongrel2, which basically just calls my zero-mq socket when there is an http connection. I reply with an "OK" or "ERROR" message. I run this at about 3000 requests per second in a single jvm (driving traffic from two sources). After about a half million hits, the jvm spits out this stack trace which, to be frank, i don't find very helpful. There is no other error info that i can find. Hopefully someone can help me interpret this.
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007fd0dee9933c, pid=21909, tid=140535053760256
#
# JRE version: 6.0_20-b20
# Java VM: OpenJDK 64-Bit Server VM (19.0-b09 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea6 1.9.5
# Distribution: Ubuntu 10.10, package 6b20-1.9.5-0ubuntu1
# Problematic frame:
# C [libzmq.so.0+0x2333c] _ZN3zmq8reader_t4readEP9zmq_msg_t+0xc
#
# If you would like to submit a bug report, please include
# instructions how to reproduce the bug and visit:
# https://bugs.launchpad.net/ubuntu/+source/openjdk-6/
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
--------------- T H R E A D ---------------
Current thread (0x00007fd0d8046000): JavaThread "pool-1-thread-1" [_thread_in_native, id=21928, stack(0x00007fd0dde53000,0x00007fd0ddf54000)]
siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x0000000000000035
Registers:
RAX=0x00007fd0d8038d30, RBX=0x00007fd0d80217c0, RCX=0x00007fd0e6588f8c, RDX=0x0000000000000025
RSP=0x00007fd0ddf524d0, RBP=0x0000000000000000, RSI=0x00007fd0ddf52560, RDI=0x00007fd0d80217c0
R8 =0x0000000000000000, R9 =0x0000000000000000, R10=0x0000000000000040, R11=0x0000000000000000
R12=0x00007fd0ddf52560, R13=0x0000000000000002, R14=0x0000000000000000, R15=0x00007fd0ddf536a8
RIP=0x00007fd0dee9933c, EFL=0x0000000000010202, CSGSFS=0x0000000000000033, ERR=0x0000000000000004
TRAPNO=0x000000000000000e
Register to memory mapping:
RAX=0x00007fd0d8038d30
0x00007fd0d8038d30 is pointing to unknown location
RBX=0x00007fd0d80217c0
0x00007fd0d80217c0 is pointing to unknown location
RCX=0x00007fd0e6588f8c
0x00007fd0e6588f8c: recv+0x6c in /lib/libpthread.so.0 at 0x00007fd0e657a000
RDX=0x0000000000000025
0x0000000000000025 is pointing to unknown location
RSP=0x00007fd0ddf524d0
0x00007fd0ddf524d0 is pointing into the stack for thread: 0x00007fd0d8046000
"pool-1-thread-1" prio=10 tid=0x00007fd0d8046000 nid=0x55a8 runnable [0x00007fd0ddf52000]
java.lang.Thread.State: RUNNABLE
RBP=0x0000000000000000
0x0000000000000000 is pointing to unknown location
RSI=0x00007fd0ddf52560
0x00007fd0ddf52560 is pointing into the stack for thread: 0x00007fd0d8046000
"pool-1-thread-1" prio=10 tid=0x00007fd0d8046000 nid=0x55a8 runnable [0x00007fd0ddf52000]
java.lang.Thread.State: RUNNABLE
RDI=0x00007fd0d80217c0
0x00007fd0d80217c0 is pointing to unknown location
R8 =0x0000000000000000
0x0000000000000000 is pointing to unknown location
R9 =0x0000000000000000
0x0000000000000000 is pointing to unknown location
R10=0x0000000000000040
0x0000000000000040 is pointing to unknown location
R11=0x0000000000000000
0x0000000000000000 is pointing to unknown location
R12=0x00007fd0ddf52560
0x00007fd0ddf52560 is pointing into the stack for thread: 0x00007fd0d8046000
"pool-1-thread-1" prio=10 tid=0x00007fd0d8046000 nid=0x55a8 runnable [0x00007fd0ddf52000]
java.lang.Thread.State: RUNNABLE
R13=0x0000000000000002
0x0000000000000002 is pointing to unknown location
R14=0x0000000000000000
0x0000000000000000 is pointing to unknown location
R15=0x00007fd0ddf536a8
0x00007fd0ddf536a8 is pointing into the stack for thread: 0x00007fd0d8046000
"pool-1-thread-1" prio=10 tid=0x00007fd0d8046000 nid=0x55a8 runnable [0x00007fd0ddf52000]
java.lang.Thread.State: RUNNABLE
Top of Stack: (sp=0x00007fd0ddf524d0)
0x00007fd0ddf524d0: 00007fd0d80410c0 0000000000000005
0x00007fd0ddf524e0: 00007fd0d803e6e0 00007fd0dee939fb
0x00007fd0ddf524f0: 000000000159dc08 00007fd0d803e580
0x00007fd0ddf52500: 00000000ffffffff 000000000000000b
0x00007fd0ddf52510: 00007fd0ddf52560 00007fd0deea0f12
0x00007fd0ddf52520: 000000000000002e 000000000000002e
0x00007fd0ddf52530: 00007fd0d80461c8 00007fd0ddf536a8
0x00007fd0ddf52540: 00007fd0d803e580 0000000000000000
0x00007fd0ddf52550: 0000000000000000 00007fd0df0b9c31
0x00007fd0ddf52560: 0000000000000020 00007fd0e0e10000
0x00007fd0ddf52570: 00000001f05c264a 0000001500000046
0x00007fd0ddf52580: 00000007d6a10a08 40c7ebc702ee4a00
0x00007fd0ddf52590: 000000000000002e 000000000000002e
0x00007fd0ddf525a0: 00007fd0ddf52610 0000000000000000
0x00007fd0ddf525b0: 000000000000002e 00000007d6a109f0
0x00007fd0ddf525c0: 00007fd0d8046000 00007fd0e0dfa148
0x00007fd0ddf525d0: 0000000782e0b8a0 0000000000000070
0x00007fd0ddf525e0: 0000000700000001 00000007d6a0f5ac
0x00007fd0ddf525f0: 0000000778aabd20 00007fd0e0e4f5ec
0x00007fd0ddf52600: 00007fd0e0e4f6d0 00007fd0ddf52658
0x00007fd0ddf52610: 0000000778aabd20 00007fd0e0e4f8dc
0x00007fd0ddf52620: 00000007d6a0fdb0 0000000000000000
0x00007fd0ddf52630: 00007fd0ddf52658 00007fd0ddf526a0
0x00007fd0ddf52640: 00007fd0ddf526a0 00007fd0e0da1d34
0x00007fd0ddf52650: 00000007d74383f8 0000000782e1c160
0x00007fd0ddf52660: 00007fd0ddf52660 0000000778b583d6
0x00007fd0ddf52670: 00007fd0ddf52708 0000000778b5fea8
0x00007fd0ddf52680: 0000000000000000 0000000778b584e0
0x00007fd0ddf52690: 00007fd0ddf52658 00007fd0ddf52700
0x00007fd0ddf526a0: 00007fd0ddf52750 00007fd0e0da185a
0x00007fd0ddf526b0: 0000000000000000 0000000000000000
0x00007fd0ddf526c0: 0000000000000000 0000000000000000
Instructions: (pc=0x00007fd0dee9933c)
0x00007fd0dee9932c: 90 90 90 90 53 48 89 fb 48 83 ec 10 48 8b 57 28
0x00007fd0dee9933c: 8b 7a 10 48 8b 4a 08 4c 8b 4a 48 4c 63 c7 4b 8d
Stack: [0x00007fd0dde53000,0x00007fd0ddf54000], sp=0x00007fd0ddf524d0, free space=1021k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libzmq.so.0+0x2333c] _ZN3zmq8reader_t4readEP9zmq_msg_t+0xc
[error occurred during error reporting (printing native stack), id 0xb]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J org.zeromq.ZMQ$Socket.recv(I)[B
J com.doapps.services.metrics.RequestMetricHandler$1.run()V
j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+46
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x00007fd0d8049800 JavaThread "pool-1-thread-3" [_thread_in_native, id=21930, stack(0x00007fd0ddc51000,0x00007fd0ddd52000)]
0x00007fd0d8047800 JavaThread "pool-1-thread-2" [_thread_in_native, id=21929, stack(0x00007fd0ddd52000,0x00007fd0dde53000)]
=>0x00007fd0d8046000 JavaThread "pool-1-thread-1" [_thread_in_native, id=21928, stack(0x00007fd0dde53000,0x00007fd0ddf54000)]
0x000000000159c000 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=21925, stack(0x00007fd0df3ce000,0x00007fd0df4cf000)]
0x0000000001599800 JavaThread "CompilerThread1" daemon [_thread_blocked, id=21924, stack(0x00007fd0df4cf000,0x00007fd0df5d0000)]
0x0000000001596800 JavaThread "CompilerThread0" daemon [_thread_blocked, id=21923, stack(0x00007fd0df5d0000,0x00007fd0df6d1000)]
0x0000000001595000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=21922, stack(0x00007fd0df6d1000,0x00007fd0df7d2000)]
0x0000000001570000 JavaThread "Finalizer" daemon [_thread_blocked, id=21920, stack(0x00007fd0dfa76000,0x00007fd0dfb77000)]
0x000000000156e000 JavaThread "Reference Handler" daemon [_thread_blocked, id=21919, stack(0x00007fd0dfb77000,0x00007fd0dfc78000)]
0x0000000001501000 JavaThread "main" [_thread_blocked, id=21910, stack(0x00007fd0e6aab000,0x00007fd0e6bac000)]
Other Threads:
0x0000000001567800 VMThread [stack: 0x00007fd0dfc78000,0x00007fd0dfd79000] [id=21914]
0x00007fd0d8004800 WatcherThread [stack: 0x00007fd0df2cd000,0x00007fd0df3ce000] [id=21926]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
PSYoungGen total 7168K, used 5998K [0x00000007d64b0000, 0x00000007d6bd0000, 0x0000000800000000)
eden space 7040K, 84% used [0x00000007d64b0000,0x00000007d6a7bbb8,0x00000007d6b90000)
from space 128K, 50% used [0x00000007d6b90000,0x00000007d6ba0000,0x00000007d6bb0000)
to space 128K, 0% used [0x00000007d6bb0000,0x00000007d6bb0000,0x00000007d6bd0000)
PSOldGen total 85376K, used 384K [0x0000000782e00000, 0x0000000788160000, 0x00000007d64b0000)
object space 85376K, 0% used [0x0000000782e00000,0x0000000782e60070,0x0000000788160000)
PSPermGen total 21248K, used 3820K [0x0000000778800000, 0x0000000779cc0000, 0x0000000782e00000)
object space 21248K, 17% used [0x0000000778800000,0x0000000778bbb0e0,0x0000000779cc0000)
Dynamic libraries:
00400000-00409000 r-xp 00000000 08:17 786398 /usr/lib/jvm/java-6-openjdk/jre/bin/java
00608000-00609000 r--p 00008000 08:17 786398 /usr/lib/jvm/java-6-openjdk/jre/bin/java
00609000-0060a000 rw-p 00009000 08:17 786398 /usr/lib/jvm/java-6-openjdk/jre/bin/java
014f8000-01d1a000 rw-p 00000000 00:00 0 [heap]
778800000-779cc0000 rw-p 00000000 00:00 0
779cc0000-782e00000 rw-p 00000000 00:00 0
782e00000-788160000 rw-p 00000000 00:00 0
788160000-7d64b0000 rw-p 00000000 00:00 0
7d64b0000-7d6bd0000 rw-p 00000000 00:00 0
7d6bd0000-7d8e60000 ---p 00000000 00:00 0
7d8e60000-800000000 rw-p 00000000 00:00 0
7fd0d8000000-7fd0d8bd1000 rw-p 00000000 00:00 0
7fd0d8bd1000-7fd0dc000000 ---p 00000000 00:00 0
7fd0ddc51000-7fd0ddc54000 ---p 00000000 00:00 0
7fd0ddc54000-7fd0ddd52000 rw-p 00000000 00:00 0
7fd0ddd52000-7fd0ddd55000 ---p 00000000 00:00 0
7fd0ddd55000-7fd0dde53000 rw-p 00000000 00:00 0
7fd0dde53000-7fd0dde56000 ---p 00000000 00:00 0
7fd0dde56000-7fd0ddf54000 rw-p 00000000 00:00 0
7fd0ddf54000-7fd0ddf55000 ---p 00000000 00:00 0
7fd0ddf55000-7fd0de755000 rw-p 00000000 00:00 0
7fd0de755000-7fd0de758000 r-xp 00000000 08:17 539833 /lib/libuuid.so.1.3.0
7fd0de758000-7fd0de958000 ---p 00003000 08:17 539833 /lib/libuuid.so.1.3.0
7fd0de958000-7fd0de959000 r--p 00003000 08:17 539833 /lib/libuuid.so.1.3.0
7fd0de959000-7fd0de95a000 rw-p 00004000 08:17 539833 /lib/libuuid.so.1.3.0
7fd0de95a000-7fd0de96f000 r-xp 00000000 08:17 524064 /lib/libgcc_s.so.1
7fd0de96f000-7fd0deb6e000 ---p 00015000 08:17 524064 /lib/libgcc_s.so.1
7fd0deb6e000-7fd0deb6f000 r--p 00014000 08:17 524064 /lib/libgcc_s.so.1
7fd0deb6f000-7fd0deb70000 rw-p 00015000 08:17 524064 /lib/libgcc_s.so.1
7fd0deb70000-7fd0dec58000 r-xp 00000000 08:17 528473 /usr/lib/libstdc++.so.6.0.14
7fd0dec58000-7fd0dee57000 ---p 000e8000 08:17 528473 /usr/lib/libstdc++.so.6.0.14
7fd0dee57000-7fd0dee5f000 r--p 000e7000 08:17 528473 /usr/lib/libstdc++.so.6.0.14
7fd0dee5f000-7fd0dee61000 rw-p 000ef000 08:17 528473 /usr/lib/libstdc++.so.6.0.14
7fd0dee61000-7fd0dee76000 rw-p 00000000 00:00 0
7fd0dee76000-7fd0deeb5000 r-xp 00000000 08:17 587726 /usr/local/lib/libzmq.so.0.0.0
7fd0deeb5000-7fd0df0b4000 ---p 0003f000 08:17 587726 /usr/local/lib/libzmq.so.0.0.0
7fd0df0b4000-7fd0df0b7000 r--p 0003e000 08:17 587726 /usr/local/lib/libzmq.so.0.0.0
7fd0df0b7000-7fd0df0b8000 rw-p 00041000 08:17 587726 /usr/local/lib/libzmq.so.0.0.0
7fd0df0b8000-7fd0df0bc000 r-xp 00000000 08:17 590598 /usr/local/lib/libjzmq.so.0.0.0
7fd0df0bc000-7fd0df2bb000 ---p 00004000 08:17 590598 /usr/local/lib/libjzmq.so.0.0.0
7fd0df2bb000-7fd0df2bc000 r--p 00003000 08:17 590598 /usr/local/lib/libjzmq.so.0.0.0
7fd0df2bc000-7fd0df2bd000 rw-p 00004000 08:17 590598 /usr/local/lib/libjzmq.so.0.0.0
7fd0df2bd000-7fd0df2c1000 r--s 0007c000 08:17 688768 /usr/lib/jvm/java-6-openjdk/jre/lib/jsse.jar
7fd0df2c1000-7fd0df2c2000 r--s 00002000 08:17 590604 /usr/local/share/java/zmq.jar
7fd0df2c2000-7fd0df2c5000 r--s 0000f000 08:17 688746 /usr/lib/jvm/java-6-openjdk/jre/lib/ext/pulse-java.jar
7fd0df2c5000-7fd0df2cd000 r--s 00066000 08:17 2580 /usr/share/java/gnome-java-bridge.jar
7fd0df2cd000-7fd0df2ce000 ---p 00000000 00:00 0
7fd0df2ce000-7fd0df3ce000 rw-p 00000000 00:00 0
7fd0df3ce000-7fd0df3d1000 ---p 00000000 00:00 0
7fd0df3d1000-7fd0df4cf000 rw-p 00000000 00:00 0
7fd0df4cf000-7fd0df4d2000 ---p 00000000 00:00 0
7fd0df4d2000-7fd0df5d0000 rw-p 00000000 00:00 0
7fd0df5d0000-7fd0df5d3000 ---p 00000000 00:00 0
7fd0df5d3000-7fd0df6d1000 rw-p 00000000 00:00 0
7fd0df6d1000-7fd0df6d4000 ---p 00000000 00:00 0
7fd0df6d4000-7fd0df7d2000 rw-p 00000000 00:00 0
7fd0df7d2000-7fd0dfa76000 r--p 00000000 08:17 523290 /usr/lib/locale/locale-archive
7fd0dfa76000-7fd0dfa79000 ---p 00000000 00:00 0
7fd0dfa79000-7fd0dfb77000 rw-p 00000000 00:00 0
7fd0dfb77000-7fd0dfb7a000 ---p 00000000 00:00 0
7fd0dfb7a000-7fd0dfc78000 rw-p 00000000 00:00 0
7fd0dfc78000-7fd0dfc79000 ---p 00000000 00:00 0
7fd0dfc79000-7fd0e017d000 rw-p 00000000 00:00 0
7fd0e017d000-7fd0e017f000 r--s 0001d000 08:17 688784 /usr/lib/jvm/java-6-openjdk/jre/lib/plugin.jar
7fd0e017f000-7fd0e0184000 r--s 00044000 08:17 688783 /usr/lib/jvm/java-6-openjdk/jre/lib/netx.jar
7fd0e0184000-7fd0e01b6000 rw-p 00000000 00:00 0
7fd0e01b6000-7fd0e0345000 r--s 038bb000 08:17 688807 /usr/lib/jvm/java-6-openjdk/jre/lib/rt.jar
7fd0e0345000-7fd0e036d000 rw-p 00000000 00:00 0
7fd0e036d000-7fd0e036e000 ---p 00000000 00:00 0
7fd0e036e000-7fd0e046e000 rw-p 00000000 00:00 0
7fd0e046e000-7fd0e046f000 ---p 00000000 00:00 0
7fd0e046f000-7fd0e056f000 rw-p 00000000 00:00 0
7fd0e056f000-7fd0e0570000 ---p 00000000 00:00 0
7fd0e0570000-7fd0e067b000 rw-p 00000000 00:00 0
7fd0e067b000-7fd0e06c3000 rw-p 00000000 00:00 0
7fd0e06c3000-7fd0e06ed000 rw-p 00000000 00:00 0
7fd0e06ed000-7fd0e095f000 rw-p 00000000 00:00 0
7fd0e095f000-7fd0e096a000 rw-p 00000000 00:00 0
7fd0e096a000-7fd0e09b2000 rw-p 00000000 00:00 0
7fd0e09b2000-7fd0e09dc000 rw-p 00000000 00:00 0
7fd0e09dc000-7fd0e0c4d000 rw-p 00000000 00:00 0
7fd0e0c4d000-7fd0e0c51000 rw-p 00000000 00:00 0
7fd0e0c51000-7fd0e0c63000 ---p 00000000 00:00 0
7fd0e0c63000-7fd0e0d9b000 rw-p 00000000 00:00 0
7fd0e0d9b000-7fd0e0d9c000 rw-p 00000000 00:00 0
7fd0e0d9c000-7fd0e100c000 rwxp 00000000 00:00 0
7fd0e100c000-7fd0e3d9c000 rw-p 00000000 00:00 0
7fd0e3d9c000-7fd0e3da3000 r-xp 00000000 08:17 786435 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libzip.so
7fd0e3da3000-7fd0e3fa2000 ---p 00007000 08:17 786435 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libzip.so
7fd0e3fa2000-7fd0e3fa3000 r--p 00006000 08:17 786435 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libzip.so
7fd0e3fa3000-7fd0e3fa4000 rw-p 00007000 08:17 786435 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libzip.so
7fd0e3fa4000-7fd0e3fb0000 r-xp 00000000 08:17 540405 /lib/libnss_files-2.12.1.so
7fd0e3fb0000-7fd0e41af000 ---p 0000c000 08:17 540405 /lib/libnss_files-2.12.1.so
7fd0e41af000-7fd0e41b0000 r--p 0000b000 08:17 540405 /lib/libnss_files-2.12.1.so
7fd0e41b0000-7fd0e41b1000 rw-p 0000c000 08:17 540405 /lib/libnss_files-2.12.1.so
7fd0e41b1000-7fd0e41bb000 r-xp 00000000 08:17 539862 /lib/libnss_nis-2.12.1.so
7fd0e41bb000-7fd0e43ba000 ---p 0000a000 08:17 539862 /lib/libnss_nis-2.12.1.so
7fd0e43ba000-7fd0e43bb000 r--p 00009000 08:17 539862 /lib/libnss_nis-2.12.1.so
7fd0e43bb000-7fd0e43bc000 rw-p 0000a000 08:17 539862 /lib/libnss_nis-2.12.1.so
7fd0e43bc000-7fd0e43c4000 r-xp 00000000 08:17 540402 /lib/libnss_compat-2.12.1.so
7fd0e43c4000-7fd0e45c3000 ---p 00008000 08:17 540402 /lib/libnss_compat-2.12.1.so
7fd0e45c3000-7fd0e45c4000 r--p 00007000 08:17 540402 /lib/libnss_compat-2.12.1.so
7fd0e45c4000-7fd0e45c5000 rw-p 00008000 08:17 540402 /lib/libnss_compat-2.12.1.so
7fd0e45c5000-7fd0e45cd000 r-xp 00000000 08:17 786463 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/native_threads/libhpi.so
7fd0e45cd000-7fd0e47cc000 ---p 00008000 08:17 786463 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/native_threads/libhpi.so
7fd0e47cc000-7fd0e47cd000 r--p 00007000 08:17 786463 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/native_threads/libhpi.so
7fd0e47cd000-7fd0e47ce000 rw-p 00008000 08:17 786463 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/native_threads/libhpi.so
7fd0e47ce000-7fd0e47e5000 r-xp 00000000 08:17 540404 /lib/libnsl-2.12.1.so
7fd0e47e5000-7fd0e49e4000 ---p 00017000 08:17 540404 /lib/libnsl-2.12.1.so
7fd0e49e4000-7fd0e49e5000 r--p 00016000 08:17 540404 /lib/libnsl-2.12.1.so
7fd0e49e5000-7fd0e49e6000 rw-p 00017000 08:17 540404 /lib/libnsl-2.12.1.so
7fd0e49e6000-7fd0e49e8000 rw-p 00000000 00:00 0
7fd0e49e8000-7fd0e4a13000 r-xp 00000000 08:17 786434 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libjava.so
7fd0e4a13000-7fd0e4c12000 ---p 0002b000 08:17 786434 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libjava.so
7fd0e4c12000-7fd0e4c13000 r--p 0002a000 08:17 786434 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libjava.so
7fd0e4c13000-7fd0e4c16000 rw-p 0002b000 08:17 786434 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libjava.so
7fd0e4c16000-7fd0e4c24000 r-xp 00000000 08:17 786419 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libverify.so
7fd0e4c24000-7fd0e4e23000 ---p 0000e000 08:17 786419 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libverify.so
7fd0e4e23000-7fd0e4e25000 r--p 0000d000 08:17 786419 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libverify.so
7fd0e4e25000-7fd0e4e26000 rw-p 0000f000 08:17 786419 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/libverify.so
7fd0e4e26000-7fd0e4e2d000 r-xp 00000000 08:17 539171 /lib/librt-2.12.1.so
7fd0e4e2d000-7fd0e502c000 ---p 00007000 08:17 539171 /lib/librt-2.12.1.so
7fd0e502c000-7fd0e502d000 r--p 00006000 08:17 539171 /lib/librt-2.12.1.so
7fd0e502d000-7fd0e502e000 rw-p 00007000 08:17 539171 /lib/librt-2.12.1.so
7fd0e502e000-7fd0e50b0000 r-xp 00000000 08:17 539860 /lib/libm-2.12.1.so
7fd0e50b0000-7fd0e52af000 ---p 00082000 08:17 539860 /lib/libm-2.12.1.so
7fd0e52af000-7fd0e52b0000 r--p 00081000 08:17 539860 /lib/libm-2.12.1.so
7fd0e52b0000-7fd0e52b1000 rw-p 00082000 08:17 539860 /lib/libm-2.12.1.so
7fd0e52b1000-7fd0e5b25000 r-xp 00000000 08:17 786437 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/server/libjvm.so
7fd0e5b25000-7fd0e5d24000 ---p 00874000 08:17 786437 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/server/libjvm.so
7fd0e5d24000-7fd0e5d9a000 r--p 00873000 08:17 786437 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/server/libjvm.so
7fd0e5d9a000-7fd0e5db5000 rw-p 008e9000 08:17 786437 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/server/libjvm.so
7fd0e5db5000-7fd0e5dee000 rw-p 00000000 00:00 0
7fd0e5dee000-7fd0e5f68000 r-xp 00000000 08:17 539849 /lib/libc-2.12.1.so
7fd0e5f68000-7fd0e6167000 ---p 0017a000 08:17 539849 /lib/libc-2.12.1.so
7fd0e6167000-7fd0e616b000 r--p 00179000 08:17 539849 /lib/libc-2.12.1.so
7fd0e616b000-7fd0e616c000 rw-p 0017d000 08:17 539849 /lib/libc-2.12.1.so
7fd0e616c000-7fd0e6171000 rw-p 00000000 00:00 0
7fd0e6171000-7fd0e6173000 r-xp 00000000 08:17 540407 /lib/libdl-2.12.1.so
7fd0e6173000-7fd0e6373000 ---p 00002000 08:17 540407 /lib/libdl-2.12.1.so
7fd0e6373000-7fd0e6374000 r--p 00002000 08:17 540407 /lib/libdl-2.12.1.so
7fd0e6374000-7fd0e6375000 rw-p 00003000 08:17 540407 /lib/libdl-2.12.1.so
7fd0e6375000-7fd0e6379000 r-xp 00000000 08:17 786417 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/jli/libjli.so
7fd0e6379000-7fd0e6578000 ---p 00004000 08:17 786417 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/jli/libjli.so
7fd0e6578000-7fd0e6579000 r--p 00003000 08:17 786417 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/jli/libjli.so
7fd0e6579000-7fd0e657a000 rw-p 00004000 08:17 786417 /usr/lib/jvm/java-6-openjdk/jre/lib/amd64/jli/libjli.so
7fd0e657a000-7fd0e6592000 r-xp 00000000 08:17 539851 /lib/libpthread-2.12.1.so
7fd0e6592000-7fd0e6791000 ---p 00018000 08:17 539851 /lib/libpthread-2.12.1.so
7fd0e6791000-7fd0e6792000 r--p 00017000 08:17 539851 /lib/libpthread-2.12.1.so
7fd0e6792000-7fd0e6793000 rw-p 00018000 08:17 539851 /lib/libpthread-2.12.1.so
7fd0e6793000-7fd0e6797000 rw-p 00000000 00:00 0
7fd0e6797000-7fd0e67ad000 r-xp 00000000 08:17 527679 /lib/libz.so.1.2.3.4
7fd0e67ad000-7fd0e69ad000 ---p 00016000 08:17 527679 /lib/libz.so.1.2.3.4
7fd0e69ad000-7fd0e69ae000 r--p 00016000 08:17 527679 /lib/libz.so.1.2.3.4
7fd0e69ae000-7fd0e69af000 rw-p 00017000 08:17 527679 /lib/libz.so.1.2.3.4
7fd0e69af000-7fd0e69cf000 r-xp 00000000 08:17 539861 /lib/ld-2.12.1.so
7fd0e69eb000-7fd0e69f5000 rw-p 00000000 00:00 0
7fd0e69f5000-7fd0e6aab000 rw-p 00000000 00:00 0
7fd0e6aab000-7fd0e6aae000 ---p 00000000 00:00 0
7fd0e6aae000-7fd0e6bb1000 rw-p 00000000 00:00 0
7fd0e6bc2000-7fd0e6bc3000 r--s 00003000 00:14 2509151 /home/ncampion/.m2/repository/com/googlecode/json-simple/json-simple/1.1/json-simple-1.1.jar
7fd0e6bc3000-7fd0e6bcb000 rw-s 00000000 08:17 658761 /tmp/hsperfdata_ncampion/21909
7fd0e6bcb000-7fd0e6bcc000 rw-p 00000000 00:00 0
7fd0e6bcc000-7fd0e6bcd000 r--p 00000000 00:00 0
7fd0e6bcd000-7fd0e6bcf000 rw-p 00000000 00:00 0
7fd0e6bcf000-7fd0e6bd0000 r--p 00020000 08:17 539861 /lib/ld-2.12.1.so
7fd0e6bd0000-7fd0e6bd1000 rw-p 00021000 08:17 539861 /lib/ld-2.12.1.so
7fd0e6bd1000-7fd0e6bd2000 rw-p 00000000 00:00 0
7fff73b15000-7fff73b36000 rw-p 00000000 00:00 0 [stack]
7fff73b37000-7fff73b38000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
VM Arguments:
jvm_args: -Djava.library.path=/usr/local/lib -Dfile.encoding=UTF-8
java_command: com.doapps.services.metrics.RequestMetricHandler
Launcher Type: SUN_STANDARD
Environment Variables:
PATH=/usr/local/lib/android/android-sdk-linux_x86/tools:/usr/local/lib/android/android-sdk-linux_x86/platform-tools:/home/ncampion/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games
USERNAME=ncampion
LD_LIBRARY_PATH=/usr/lib/jvm/java-6-openjdk/jre/lib/amd64/server:/usr/lib/jvm/java-6-openjdk/jre/lib/amd64:/usr/lib/jvm/java-6-openjdk/jre/../lib/amd64:/usr/lib/xulrunner-1.9.2.13
SHELL=/bin/bash
DISPLAY=:0.0
Signal Handlers:
SIGSEGV: [libjvm.so+0x712740], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGBUS: [libjvm.so+0x712740], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGFPE: [libjvm.so+0x5d4060], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGPIPE: [libjvm.so+0x5d4060], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGXFSZ: [libjvm.so+0x5d4060], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGILL: [libjvm.so+0x5d4060], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x5d3770], sa_mask[0]=0x00000004, sa_flags=0x10000004
SIGHUP: [libjvm.so+0x5d61e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGINT: [libjvm.so+0x5d61e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGTERM: [libjvm.so+0x5d61e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGQUIT: [libjvm.so+0x5d61e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
--------------- S Y S T E M ---------------
OS:Ubuntu 10.10 (maverick)
uname:Linux 2.6.35-25-generic #44-Ubuntu SMP Fri Jan 21 17:40:44 UTC 2011 x86_64
libc:glibc 2.12.1 NPTL 2.12.1
rlimit: STACK 8192k, CORE 0k, NPROC infinity, NOFILE 1024, AS infinity
load average:2.77 1.94 1.51
/proc/meminfo:
MemTotal: 8193500 kB
MemFree: 51960 kB
Buffers: 368260 kB
Cached: 3264692 kB
SwapCached: 0 kB
Active: 5131028 kB
Inactive: 2411276 kB
Active(anon): 3920368 kB
Inactive(anon): 80592 kB
Active(file): 1210660 kB
Inactive(file): 2330684 kB
Unevictable: 32 kB
Mlocked: 32 kB
SwapTotal: 0 kB
SwapFree: 0 kB
Dirty: 5252 kB
Writeback: 0 kB
AnonPages: 3909364 kB
Mapped: 247864 kB
Shmem: 91632 kB
Slab: 296720 kB
SReclaimable: 249276 kB
SUnreclaim: 47444 kB
KernelStack: 4832 kB
PageTables: 44748 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 4096748 kB
Committed_AS: 7036200 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 333620 kB
VmallocChunk: 34359400592 kB
HardwareCorrupted: 0 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 140160 kB
DirectMap2M: 8247296 kB
DirectMap1G: 0 kB
CPU:total 3 (3 cores per cpu, 1 threads per core) family 16 model 4 stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext, 3dnow, 3dnowext, lzcnt, sse4a
Memory: 4k page, physical 8193500k(51960k free), swap 0k(0k free)
vm_info: OpenJDK 64-Bit Server VM (19.0-b09) for linux-amd64 JRE (1.6.0_20-b20), built on Jan 27 2011 21:59:04 by "buildd" with gcc 4.4.5
time: Wed Feb 23 14:02:58 2011
elapsed time: 1159 seconds