Author |
|
ryankemp1978
Joined: 17 Jan 2013 Posts: 5 Location: UK
|
Posted: Fri 18 Jan '13 12:59 Post subject: Isse with HTTPD.EXE Hanging & Crashing |
|
|
Hi
We have the following error in the Application Event Log on a number of Load Balanced Windows 2008 R2 Servers 64-Bit (VMWare) running Apache Tomcat 2.2.21.0
Errors / Logs / Dumps
Event Type: Error
Event Source: Application Error
Event Category: (100)
Event ID: 1000
Date: 21/11/2012
Time: 12:18:53
User: N/A
Computer:
Description:
Faulting application httpd.exe, version 2.2.21.0, faulting module 4e6a3015, version KERNELBASE.dll, fault address 0x6.1.7601.17651.
Faulting application name: httpd.exe, version: 2.2.21.0, time stamp: 0x4e6a3015
Faulting module name: KERNELBASE.dll, version: 6.1.7601.17651, time stamp: 0x4e211319
Exception code: 0xc0000005
Fault offset: 0x00006a6d
Faulting process id: 0x18f8
Faulting application start time: 0x01cdf2b032fe66aa
Faulting application path: C:\platform\software\Apache2.2_21\bin\httpd.exe
Faulting module path: C:\Windows\syswow64\KERNELBASE.dll
Report Id: 5c882d1c-5f1e-11e2-b3db-005056977ad8
Windows Error Report (15/01/2013 18:54:24):
Fault bucket , type 0
Event Name: APPCRASH
Response: Not available
Cab Id: 0
Problem signature:
P1: httpd.exe
P2: 2.2.21.0
P3: 4e6a3015
P4: KERNELBASE.dll
P5: 6.1.7601.17651
P6: 4e211319
P7: c0000005
P8: 00006a6d
P9:
P10:
Attached files:
These files may be available here:
C:\Users\loluser\AppData\Local\Microsoft\Windows\WER\ReportArchive\AppCrash_httpd.exe_d9f1db107dec2a0f038c0e4e2b153adc164fe9_1acfcb58
Analysis symbol:
Rechecking for solution: 0
Report Id: 5c882d1c-5f1e-11e2-b3db-005056977ad8
Report Status: 0
Windows Dump (as mentioned in the above log located at: C:\Users\loluser\AppData\Local\Microsoft\Windows\WER\ReportArchive\AppCrash_httpd.exe_d9f1db107dec2a0f038c0e4e2b153adc164fe9_1acfcb58)
Version=1
EventType=APPCRASH
EventTime=130027330792809762
ReportType=2
Consent=1
ReportIdentifier=5c882d1d-5f1e-11e2-b3db-005056977ad8
IntegratorReportIdentifier=5c882d1c-5f1e-11e2-b3db-005056977ad8
WOW64=1
Response.type=4
Sig[0].Name=Application Name
Sig[0].Value=httpd.exe
Sig[1].Name=Application Version
Sig[1].Value=2.2.21.0
Sig[2].Name=Application Timestamp
Sig[2].Value=4e6a3015
Sig[3].Name=Fault Module Name
Sig[3].Value=KERNELBASE.dll
Sig[4].Name=Fault Module Version
Sig[4].Value=6.1.7601.17651
Sig[5].Name=Fault Module Timestamp
Sig[5].Value=4e211319
Sig[6].Name=Exception Code
Sig[6].Value=c0000005
Sig[7].Name=Exception Offset
Sig[7].Value=00006a6d
DynamicSig[1].Name=OS Version
DynamicSig[1].Value=6.1.7601.2.1.0.274.10
DynamicSig[2].Name=Locale ID
DynamicSig[2].Value=2057
DynamicSig[22].Name=Additional Information 1
DynamicSig[22].Value=0a9e
DynamicSig[23].Name=Additional Information 2
DynamicSig[23].Value=0a9e372d3b4ad19135b953a78882e789
DynamicSig[24].Name=Additional Information 3
DynamicSig[24].Value=0a9e
DynamicSig[25].Name=Additional Information 4
DynamicSig[25].Value=0a9e372d3b4ad19135b953a78882e789
UI[2]=C:\platform\software\Apache2.2_21\bin\httpd.exe
UI[3]=Apache HTTP Server has stopped working
UI[4]=Windows can check online for a solution to the problem.
UI[5]=Check online for a solution and close the program
UI[6]=Check online for a solution later and close the program
UI[7]=Close the program
LoadedModule[0]=C:\platform\software\Apache2.2_21\bin\httpd.exe
LoadedModule[1]=C:\Windows\SysWOW64\ntdll.dll
LoadedModule[2]=C:\Windows\syswow64\kernel32.dll
LoadedModule[3]=C:\Windows\syswow64\KERNELBASE.dll
LoadedModule[4]=C:\platform\software\Apache2.2_21\bin\libapr-1.dll
LoadedModule[5]=C:\Windows\syswow64\ADVAPI32.dll
LoadedModule[6]=C:\Windows\syswow64\msvcrt.dll
LoadedModule[7]=C:\Windows\SysWOW64\sechost.dll
LoadedModule[8]=C:\Windows\syswow64\RPCRT4.dll
LoadedModule[9]=C:\Windows\syswow64\SspiCli.dll
LoadedModule[10]=C:\Windows\syswow64\CRYPTBASE.dll
LoadedModule[11]=C:\Windows\syswow64\WS2_32.dll
LoadedModule[12]=C:\Windows\syswow64\NSI.dll
LoadedModule[13]=C:\Windows\system32\MSWSOCK.dll
LoadedModule[14]=C:\Windows\syswow64\user32.dll
LoadedModule[15]=C:\Windows\syswow64\GDI32.dll
LoadedModule[16]=C:\Windows\syswow64\LPK.dll
LoadedModule[17]=C:\Windows\syswow64\USP10.dll
LoadedModule[18]=C:\Windows\syswow64\SHELL32.dll
LoadedModule[19]=C:\Windows\syswow64\SHLWAPI.dll
LoadedModule[20]=C:\platform\software\Apache2.2_21\bin\libaprutil-1.dll
LoadedModule[21]=C:\platform\software\Apache2.2_21\bin\libapriconv-1.dll
LoadedModule[22]=C:\platform\software\Apache2.2_21\bin\libhttpd.dll
LoadedModule[23]=C:\Windows\system32\IMM32.DLL
LoadedModule[24]=C:\Windows\syswow64\MSCTF.dll
LoadedModule[25]=C:\Windows\System32\wshtcpip.dll
LoadedModule[26]=C:\Windows\system32\NLAapi.dll
LoadedModule[27]=C:\Windows\system32\napinsp.dll
LoadedModule[28]=C:\Windows\system32\DNSAPI.dll
LoadedModule[29]=C:\Windows\System32\winrnr.dll
LoadedModule[30]=C:\Windows\system32\IPHLPAPI.DLL
LoadedModule[31]=C:\Windows\system32\WINNSI.DLL
LoadedModule[32]=C:\Windows\System32\fwpuclnt.dll
LoadedModule[33]=C:\Windows\system32\rasadhlp.dll
LoadedModule[34]=C:\platform\software\Apache2.2_21\modules\mod_actions.so
LoadedModule[35]=C:\platform\software\Apache2.2_21\modules\mod_alias.so
LoadedModule[36]=C:\platform\software\Apache2.2_21\modules\mod_asis.so
LoadedModule[37]=C:\platform\software\Apache2.2_21\modules\mod_auth_basic.so
LoadedModule[38]=C:\platform\software\Apache2.2_21\modules\mod_authn_default.so
LoadedModule[39]=C:\platform\software\Apache2.2_21\modules\mod_authn_file.so
LoadedModule[40]=C:\platform\software\Apache2.2_21\modules\mod_authz_default.so
LoadedModule[41]=C:\platform\software\Apache2.2_21\modules\mod_authz_groupfile.so
LoadedModule[42]=C:\platform\software\Apache2.2_21\modules\mod_authz_host.so
LoadedModule[43]=C:\platform\software\Apache2.2_21\modules\mod_authz_user.so
LoadedModule[44]=C:\platform\software\Apache2.2_21\modules\mod_autoindex.so
LoadedModule[45]=C:\platform\software\Apache2.2_21\modules\mod_cgi.so
LoadedModule[46]=C:\platform\software\Apache2.2_21\modules\mod_dir.so
LoadedModule[47]=C:\platform\software\Apache2.2_21\modules\mod_env.so
LoadedModule[48]=C:\platform\software\Apache2.2_21\modules\mod_include.so
LoadedModule[49]=C:\platform\software\Apache2.2_21\modules\mod_isapi.so
LoadedModule[50]=C:\platform\software\Apache2.2_21\modules\mod_log_config.so
LoadedModule[51]=C:\platform\software\Apache2.2_21\modules\mod_mime.so
LoadedModule[52]=C:\platform\software\Apache2.2_21\modules\mod_negotiation.so
LoadedModule[53]=C:\platform\software\Apache2.2_21\modules\mod_setenvif.so
LoadedModule[54]=C:\platform\software\Apache2.2_21\modules\mod_jk.so
LoadedModule[55]=C:\Windows\system32\WSOCK32.dll
FriendlyEventName=Stopped working
ConsentKey=APPCRASH
AppName=Apache HTTP Server
AppPath=C:\platform\software\Apache2.2_21\bin\httpd.exe
The above errors are produced when the Apache TomCat process crashes unexpectantly on the Server.
Has anyone seen this issue before? It bis causing our usiness major haadaches.
Thanks in Advance Ryan |
|
Back to top |
|
James Blond Moderator
Joined: 19 Jan 2006 Posts: 7371 Location: Germany, Next to Hamburg
|
Posted: Tue 22 Jan '13 21:51 Post subject: |
|
|
Is there anything about it in your error.log from apache? |
|
Back to top |
|
ryankemp1978
Joined: 17 Jan 2013 Posts: 5 Location: UK
|
Posted: Wed 23 Jan '13 11:30 Post subject: Apache Logs for HTTPD.EXE HANG / CRASH |
|
|
[Tue Jan 15 14:17:52 2013] [error] [client 78.124.190.200] File does not exist: C:/platform/Lol_v2/assets/jar/images
[Tue Jan 15 18:54:24 2013] [notice] Parent: child process exited with status 3221225477 -- Restarting.
[Tue Jan 15 18:54:24 2013] [notice] Apache/2.2.21 (Win32) mod_jk/1.2.26 configured -- resuming normal operations
[Tue Jan 15 18:54:24 2013] [notice] Server built: Sep 9 2011 10:26:10
[Tue Jan 15 18:54:24 2013] [notice] Parent: Created child process 1444
[Tue Jan 15 18:54:24 2013] [notice] Disabled use of AcceptEx() WinSock2 API
Apache server shutdown initiated...
Child 1444: Child process is running
[Tue Jan 15 18:54:24 2013] [notice] Child 1444: Acquired the start mutex.
[Tue Jan 15 18:54:24 2013] [notice] Child 1444: Starting 1000 worker threads.
[Tue Jan 15 18:54:24 2013] [notice] Child 1444: Listening on port 80.
[Tue Jan 15 18:54:34 2013] [notice] Parent: Received shutdown signal -- Shutting down the server.
[Tue Jan 15 18:54:34 2013] [notice] Child 1444: Exit event signaled. Child process is ending.
[Tue Jan 15 18:54:35 2013] [notice] Child 1444: Released the start mutex
[Tue Jan 15 18:54:42 2013] [notice] Child 1444: All worker threads have exited.
[Tue Jan 15 18:54:42 2013] [notice] Child 1444: Child process is exiting |
|
Back to top |
|
ryankemp1978
Joined: 17 Jan 2013 Posts: 5 Location: UK
|
Posted: Wed 23 Jan '13 12:50 Post subject: |
|
|
Hi I have been informed that we are running the 32-Bit Version of Apache on a 64-Bit Server Windows 2008, is there a 64-Bit version of apache available? |
|
Back to top |
|
James Blond Moderator
Joined: 19 Jan 2006 Posts: 7371 Location: Germany, Next to Hamburg
|
Posted: Wed 23 Jan '13 23:38 Post subject: |
|
|
Well running a 32 bit version of apache on a 64 bit system is not an issue.
However a 64 bit version can be found on apache lounge http://www.apachelounge.com/download/win64/
how did you configure mod_jk since some file requests are not forwarded to your tomcat. |
|
Back to top |
|
ryankemp1978
Joined: 17 Jan 2013 Posts: 5 Location: UK
|
Posted: Fri 25 Jan '13 12:42 Post subject: JK_MODULE Config |
|
|
Hi please see config og JK_MODULE as requested.
#
# httpd.conf mod_jk setting (comments removed)
#
LoadModule jk_module modules/mod_jk.so
JkWorkersFile c:/Apache2.2_21/conf/workers.properties
JkLogFile logs/mod_jk.log
JkLogLevel info
JkLogStampFormat "[%a %b %d %H:%M:%S %Y] "
JkRequestLogFormat "%w %V %T"
JkMount /*.html ajp13
JkMount /*.jsp ajp13
JkMount /*.json ajp13
... Other Mounts....
#
# From worker.properties (comments removed)
#
#
worker.ajp13.port=8009
worker.ajp13.host=localhost
worker.ajp13.type=ajp13
worker.ajp13.lbfactor=50
worker.ajp13.socket_keepalive=False
worker.ajp13.socket_timeout=300
worker.ajp13.connection_pool_timeout=300
worker.inprocess.cmd_line=start
worker.inprocess.jvm_lib=$(workers.java_home)$(ps)jre$(ps)bin$(ps)classic$(ps)jvm.dll
worker.inprocess.stdout=$(workers.tomcat_home)$(ps)logs$(ps)inprocess.stdout
worker.inprocess.stderr=$(workers.tomcat_home)$(ps)logs$(ps)inprocess.stderr
Thanks in Advance
Ryan |
|
Back to top |
|
ryankemp1978
Joined: 17 Jan 2013 Posts: 5 Location: UK
|
Posted: Tue 29 Jan '13 10:47 Post subject: |
|
|
Hi,
Have you managed to review the requested file yet?
Thanks in Advance
Ryan |
|
Back to top |
|
James Blond Moderator
Joined: 19 Jan 2006 Posts: 7371 Location: Germany, Next to Hamburg
|
Posted: Tue 29 Jan '13 15:10 Post subject: |
|
|
I have no clue why that happens. The configure options seem to be fine in my eyes. However I'm not an export for Tomcat.
I have no mod_jk, but use mod_proxy_ajp for my jenkins.
What I have tried with apache 2.4.3 and it worked for me
Code: |
ProxyPass /test balancer://jenkiscluster/ stickysession=JSESSIONID|jsessionid scolonpathdelim=On
<Proxy balancer://jenkiscluster>
BalancerMember ajp://192.168.100.50:8009/ route=node1 lbset=1 retry=10
BalancerMember ajp://192.168.100.51:8009/ route=node2 lbset=2 retry=10 status=+H
ProxySet lbmethod=bytraffic
</Proxy>
|
Code: |
java -jar jenkins.war --httpPort=-1 --ajp13ListenAddress=192.168.100.50
|
Code: |
java -jar jenkins.war --httpPort=-1 --ajp13ListenAddress=192.168.100.51
|
See also http://httpd.apache.org/docs/2.4/mod/mod_proxy_balancer.html
For sure that is different from mod_jk, but I did had no mod_jk available at that time. |
|
Back to top |
|