[03:37] *** timothyv has quit IRC (Read error: 104 (Connection reset by peer)) [06:22] *** franck has quit IRC () [06:53] *** timothyv has joined #tikiwiki-monitor [06:55] *** timothyv has left [07:01] *** timothyv1 has joined #tikiwiki-monitor [07:16] *** jasprit has quit IRC ("Leaving.") [08:24] *** marclaporte has joined #tikiwiki-monitor [08:53] 2009/09/22 10:50 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [09:04] 2009/09/22 11:03 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 8.904 second response time [10:44] *** franck_ has joined #tikiwiki-monitor [10:44] *** ChanServ sets mode: +o franck_ [11:17] *** epeli_e has joined #tikiwiki-monitor [11:17] *** timothyv1 has quit IRC ("Leaving.") [11:33] *** franck_ has quit IRC (Read error: 113 (No route to host)) [12:00] *** franck_ has joined #tikiwiki-monitor [12:00] *** ChanServ sets mode: +o franck_ [13:10] *** franck_ has quit IRC (Read error: 113 (No route to host)) [13:46] 2009/09/22 15:43 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [14:39] web2 features page is is not loading and is taking too long to respond [14:56] *** rupeni has left [15:17] hi Amette [15:17] dev.tw.o page is not loading [15:36] 2009/09/22 17:36 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 9.370 second response time [15:52] amette: : ping [16:05] 2009/09/22 18:02 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [16:20] 2009/09/22 18:20 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 8.979 second response time [16:33] 2009/09/22 18:30 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [17:08] 2009/09/22 19:08 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 9.834 second response time [17:16] 2009/09/22 19:13 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [17:27] 2009/09/22 19:26 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 9.401 second response time [18:01] 2009/09/22 19:57 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [18:25] *** Epeli has joined #tikiwiki-monitor [18:26] *** Epeli has left [18:26] *** Epel1 has joined #tikiwiki-monitor [18:26] *** Epel1 has quit IRC (Remote closed the connection) [18:27] *** epeli_1 has joined #tikiwiki-monitor [18:31] 2009/09/22 20:30 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 7.050 second response time [18:43] *** jasprit has joined #tikiwiki-monitor [18:46] *** epeli_e has quit IRC (Read error: 113 (No route to host)) [18:50] 2009/09/22 20:46 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [18:53] *** franck has joined #tikiwiki-monitor [18:53] *** ChanServ sets mode: +o franck [18:55] 2009/09/22 20:54 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 7.503 second response time [19:01] *** epeli_1 has quit IRC (Remote closed the connection) [19:02] *** epeli_e has joined #tikiwiki-monitor [19:17] *** epeli_1 has joined #tikiwiki-monitor [19:20] *** franck_ has joined #tikiwiki-monitor [19:20] *** ChanServ sets mode: +o franck_ [19:27] amette [19:28] http critical on dev.tikiwiki.org. the site does not load [19:34] 2009/09/22 21:30 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [19:36] *** epeli_e has quit IRC (Read error: 113 (No route to host)) [19:39] *** franck has quit IRC (Read error: 113 (No route to host)) [19:39] *** franck_ is now known as franck [20:04] 2009/09/22 22:03 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 8.307 second response time [20:45] jasprit: pong [20:46] what did you do alreadyto fix it? [20:46] restarted the apache [20:46] and then? [20:46] checked the database? [20:47] it cleared and its been up and down [20:48] sounds like database to me [20:48] ooh ok] [20:50] you know how to handle it? [20:51] is it to kill the process ID that appeared on top?? [20:51] \ mysqladmin processlist [20:51] ok [20:54] 2009/09/22 22:50 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [21:02] are you on it? [21:02] have done it [21:03] but i dont know why its not clearing [21:03] there's still a query hanging since 28484 seconds [21:03] *** marclaporte has quit IRC ("Miranda IM! Smaller, Faster, Easier. http://miranda-im.org") [21:05] thats the one that i worked on [21:06] kill it again [21:06] ok [21:08] I killed it - died nicely - even closing tables first [21:08] which command did you use for killing? [21:08] and please shut down the apache on web1 - otherwise it will immediately die under the load [21:09] mysql -e [21:09] mysql -e "kill 2846594;" [21:09] yes [21:09] maybe it was two different processes [21:10] oh ok [21:10] and dev died already under the load, hm? [21:11] yes [21:11] I still have a session open - shutting down apache [21:11] load 82 [21:12] you need to be more aware of the hanging mysql processes - that's our biggest enemy [21:12] 2846594 is a long time... [21:12] *** franck has quit IRC () [21:12] ok [21:13] err, bullshit - that was the process id :P [21:13] ;) [21:14] 2009/09/22 23:13 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 8.865 second response time [21:14] I started writing a nagios check for the hanging query today - that will help identify the problem [21:15] that'll be good [21:16] :) [21:19] *** franck has joined #tikiwiki-monitor [21:19] *** ChanServ sets mode: +o franck [21:20] *** franck has quit IRC (Read error: 54 (Connection reset by peer)) [21:20] *** franck has joined #tikiwiki-monitor [21:20] *** ChanServ sets mode: +o franck [21:21] I wonder why nagios doesn't go green... [21:22] it is green from our side [21:25] ya still some criticals on web1 [21:26] n Disk warning on web2 [21:43] 2009/09/22 23:39 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [21:48] *** jasprit has left [21:58] *** jasprit has joined #tikiwiki-monitor [22:22] *** jasprit has quit IRC (Remote closed the connection) [22:25] *** jasprit has joined #tikiwiki-monitor [22:27] 2009/09/23 00:26 OK web1 HTTP HTTP OK - HTTP/1.1 302 Found - 0.133 second response time [22:27] 2009/09/23 00:26 OK web1 TikiWiki HTTP OK HTTP/1.1 200 OK - 0.778 second response time [22:29] me idiot - yesterday I tried to fix apache by making it bind to the external IP only and didn't roll back the change [22:29] the check goes to the internal ip [22:29] room for improvement... ;) [22:29] :L [22:29] :) [22:44] 2009/09/23 00:43 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 9.881 second response time [23:10] *** jasprit has left [23:11] 2009/09/23 01:07 CRIT web2 Features Page CRITICAL - Socket timeout after 10 seconds [23:11] *** jasprit has joined #tikiwiki-monitor [23:12] *** epeli_1 has left [23:13] *** epeli_e has joined #tikiwiki-monitor [23:21] 2009/09/23 01:20 OK web2 Features Page HTTP OK HTTP/1.1 200 OK - 8.292 second response time