logo
Apache Lounge
Webmasters

 

About Forum Index Downloads Search Register Log in RSS X


Keep Server Online

If you find the Apache Lounge, the downloads and overall help useful, please express your satisfaction with a donation.

or

Bitcoin

A donation makes a contribution towards the costs, the time and effort that's going in this site and building.

Thank You! Steffen

Your donations will help to keep this site alive and well, and continuing building binaries. Apache Lounge is not sponsored.
Post new topic   Forum Index -> Apache View previous topic :: View next topic
Reply to topic   Topic: Referer and UserAgent missing from some log entries
Author
Glenn Peterson



Joined: 18 Aug 2008
Posts: 1
Location: MN, US

PostPosted: Mon 18 Aug '08 19:24    Post subject: Referer and UserAgent missing from some log entries Reply with quote

I'm trying to figure out why the referer and useragent are missing from some (about 15%) of my log entries. No placeholder, they're just missing. This is causing errors when I try to analyze the logs with analog and WebTrends.

This problem seems to have appeared with Apache 2.2 (I'm on 2.2.8 on Windows) Am I missing something?

I'm using the combined format:

Code:
LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined


Sample lines from the log.

Missing data:
Code:
66.249.71.237 - - [10/Aug/2008:00:00:28 -0500] "GET /pub/bookspace/discuss/?bib=735609 HTTP/1.1" 200 21038


OK with placeholder for referer:
Code:
74.6.17.151 - - [10/Aug/2008:00:00:17 -0500] "GET /pub/bookspace/discuss/?bib=805589&Tab=Reviews HTTP/1.0" 200 25029 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"


OK full data:
Code:
206.162.192.39 - - [10/Aug/2008:16:17:30 -0500] "GET /pub/bookspace/discuss/?bib=1055128&Tab=Reviews HTTP/1.0" 200 24709 "http://search.yahoo.com/search?p=book+review%3A+%22Little+Rabbit+Goes+to+School%22+by+Harry+Horse&ei=UTF-8&fr=yfp-t-501&xargs=0&pstart=1&b=51" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322)"
Back to top
PipoDeClown



Joined: 20 Dec 2005
Posts: 77

PostPosted: Wed 20 Aug '08 10:43    Post subject: Reply with quote

http://google.com/search?q=googlebot+referer
Back to top


Reply to topic   Topic: Referer and UserAgent missing from some log entries View previous topic :: View next topic
Post new topic   Forum Index -> Apache