This is a discussion on MSNBot? 207.46.98.39 within the osCMax v1.7 Installation forums, part of the osCMax v1.7 Forums category; I have had this spider on my site for last 17 hours...started at 1:59AM and is still going. IP address ...
| |||||||
| Register | FAQ | Members List | Calendar | Mark Forums Read |
|
#1
| |||
| |||
| I have had this spider on my site for last 17 hours...started at 1:59AM and is still going. IP address is 207.46.98.39 which when I looked up in WHOIS found out it belongs to MSN. I have the spider on in admin and forced cookies. All other bots etc are in and out very quickly. This one has pulled 4300+ pages so far and over 135MB bandwidth. Is this normal? Any thoughts?
__________________ True Meaning of Lost: Building a web site without knowledge or skill True Meaning of Crazy: Building a web site anyhow The Net Results: Never needing a comb again www.MakeMeThis.com |
|
#2
| |||
| |||
| After 21 hours, 5000+ pages and 150+MB, I emailed Microsoft and questioned the situation. Within a few minutes, I got an email back appologizing and a couple minutes later the bot stopped. What I don't know is whether the bot was really digging that deep or whether it was caught in some loop on the site. Hopefully Microsoft will answer...if they do I will pass it along so we all know.
__________________ True Meaning of Lost: Building a web site without knowledge or skill True Meaning of Crazy: Building a web site anyhow The Net Results: Never needing a comb again www.MakeMeThis.com |
|
#3
| ||||
| ||||
| Not normal, but if you are using session ID's instead of cookies, the spider could have been caught spawning all kinds of new sessions, which it thinks are unique pages...
__________________ Michael Sasek osCMax Developer
|
|
#4
| |||
| |||
| correct settings then for cookies...forced cookies true? and spider true? should have stop the looping |