Details
-
Type:
Bug
-
Status: Reopened
-
Priority:
Major
-
Resolution: Unresolved
-
Affects Version/s: unspecified
-
Fix Version/s: None
-
Component/s: Spider
-
Labels:None
-
Environment:
Operating System: Windows XP
Platform: PC
-
Bugzilla Id:3592
Description
Test Env: client-pc.ri.thesearchagency.com
Prerequisites:
Create a page
"http://pvwb-of1pvd0010.ri.thesearchagency.com/gurpreet/Spider/googlelink.htm"
with link to page
"http://pvwb-of1pvd0010.ri.thesearchagency.com/gurpreet/Spider/googlenoindex_nofollow.htm"
which has the meta tag
"<META NAME="GOOGLEBOT" CONTENT="NOINDEX, NOFOLLOW">"
Steps:
1. Log into AdMax application.
2. Navigate to SEO section, click on "Spider"
3. Enter a valid URL to spider say
"http://pvwb-of1pvd0010.ri.thesearchagency.com/gurpreet/Spider/googlelink.htm"
4. In "custom spider options", ensure "Honor NoIndex" and "Honor No Follow"
check box is checked and spider it
Expected Result:
In "ADR - Spidered Urls_1", the page
"http://pvwb-of1pvd0010.ri.thesearchagency.com/gurpreet/Spider/googlenoindex_nofollow.htm"
should not be listed
Actual Result:
In "ADR - Spidered Urls_1", Observed that the page
"http://pvwb-of1pvd0010.ri.thesearchagency.com/gurpreet/Spider/googlenoindex_nofollow.htm"
is listed
