Log Analyzer Tools for Iis Webserver Logs
I Used Deep Log Analyzer to Monitor My Site Visits. What I Noticed Now, Is That There Is Way Too Much Traffic Reported Than It Actually Should Be Reported...
I used Deep Log Analyzer to monitor my site visits. What I noticed now, is that there is way too much traffic reported than it actually should be reported based on google analytics. I started to use GA now but I need to create a clean report from April 2017 until November 2017 based on the iis logs.
I got all of the log files from IIS. But now I'm looking for a way to filter spam like /wp-admin Brute-Force stuff and to monitor just the 'real' visitors data without bots and internal refferers.
Is there any better tool for that kind of log reporting or is there a way to achieve that goal in Deep Log Analyzer?
I tried to filter the reports but It still seems to have too much hits.
I just need the following information:
Total Visits, Amount of users, average session time, and device (if mobile or desktop)
thanks for recommendations and help
EDIT: best solution I found:
2 Answers
I would look at Log Parser Studio:
It allows SQL like log querying and filtering.
Edit: Possible new link:
You could do this with the free edition of SpectX. Download and point it to your IIS log folder. Tutorials and sample queries:
Analyzing IIS logs: Microsoft Exchange, OWA and ActiveSync Activities
A very basic way of filtering out bots is to configure SpectX to access Maxmind's GeoIP databases and then use the filter_out command. For example:
| filter_out(asname(c_ip) = ‘AS15169 Google LLC’ and cs_user_agent like ‘%Googlebot/%‘)
| filter_out(asname(c_ip) = ‘AS8075 Microsoft Corporation’ and cs_user_agent like ‘%BingPreview/%‘)
| filter_out(asname(c_ip) = ‘AS8075 Microsoft Corporation’ and cs_user_agent like ‘%bingbot/%‘)
| filter_out(asname(c_ip) = ‘AS32934 Facebook, Inc.’ and cs_user_agent like ‘%facebookexternalhi%‘)
| filter_out(asname(c_ip) = ‘AS14618 Amazon.com, Inc.’ and cs_user_agent like ‘%SMTBot/%‘)
| filter_out(asname(c_ip) = ‘AS714 Apple Inc.’ and cs_user_agent like ‘%Applebot/%‘)
| filter_out(asname(c_ip) = ‘AS13238 YANDEX LLC’ and cs_user_agent like ‘%YandexBot/%‘)
| filter_out(asname(c_ip) = ‘AS13238 YANDEX LLC’ and cs_user_agent like ‘%YandexMobileBot/%’)