i am running the opennms application server on a physical server and the database on an ESXi VM. Recently the opennms webconsole has been very slow to load as such i deleted most of the events from the database table, now both servers have no load at all, and the psql connection from the application server to the database server is also very fast, but somehow opennms webconsole is still slow.
this is the strace from the opennms process id:
18629 futex(0x2aaac77d8a84, FUTEX_WAIT_PRIVATE, 453, NULL <unfinished ...>
3015 futex(0x2aaabc4a2ee4, FUTEX_WAIT_PRIVATE, 323, NULL <unfinished ...>
10863 futex(0x2aaabbebaa94, FUTEX_WAIT_PRIVATE, 395, NULL <unfinished ...>
25260 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
10859 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
10982 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
3011 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
25260 futex(0x2aaae098fc28, FUTEX_WAKE_PRIVATE, 1 <unfinished ...>
10982 futex(0x2aaac0eaf928, FUTEX_WAKE_PRIVATE, 1 <unfinished ...>
3011 futex(0x2aaab0cb1728, FUTEX_WAKE_PRIVATE, 1 <unfinished ...>
10859 futex(0x2aaac062c328, FUTEX_WAKE_PRIVATE, 1 <unfinished ...>
25260 <... futex resumed> ) = 0
10982 <... futex resumed> ) = 0
3011 <... futex resumed> ) = 0
10859 <... futex resumed> ) = 0
25260 futex(0x2aaabc38b6b4, FUTEX_WAIT_PRIVATE, 443, NULL <unfinished ...>
10982 futex(0x2aaabc5d7b94, FUTEX_WAIT_PRIVATE, 99, NULL <unfinished ...>
3011 futex(0x2aaac7c55334, FUTEX_WAIT_PRIVATE, 183, NULL <unfinished ...>
10859 futex(0x2aaabbb8c9d4, FUTEX_WAIT_PRIVATE, 347, NULL <unfinished ...>
10846 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
10846 futex(0x2aaae9022428, FUTEX_WAKE_PRIVATE, 1) = 0
10846 futex(0x2aaabe0030b4, FUTEX_WAIT_PRIVATE, 251, NULL <unfinished ...>
20281 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
14100 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
2925 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
10843 <... futex resumed> ) = -1 ETIMEDOUT (Connection timed out)
20281 futex(0x2aaac7e93628, FUTEX_WAKE_PRIVATE, 1 <unfinished ...>
14100 futex(0x2aaac04e8c28, FUTEX_WAKE_PRIVATE, 1 <unfinished ...>
2925 futex(0x2aaaec085528, FUTEX_WAKE_PRIVATE, 1 <unfinished ...>
10843 futex(0x2aaab20b0528, FUTEX_WAKE_PRIVATE, 1 <unfinished ...>
and shows lots of connection timeout??? i think its the connection between the java application and database which is causing issues.
any ideas how to troubleshoot this???