Uploaded image for project: 'AdMax'
  1. AdMax
  2. ADMAX-2918

Cloud Spider: Selecting "Crawl Any Subdomain Of the Requested Subdomain" option fails to crawl subdomain urls

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Cloud Spider 3.03
    • Component/s: Cloud Spider
    • Labels:
      None
    • Environment:

      Test Env: (192.168.70.86)

      AWS - CSA #2 - Bug Fix Build - 19

      Services - CS #2 - Bug Fix Build - 29

      UI - AdMax-Trunk Build - 85 (client-pc)

      Description

      1. Login to Admax- spider application

      2. Enter the valid url to spider as "http://money.cnn.com/"

      3. select max number of pages to crawl as "1000" and ADR for generation

      4. Open Custom Crawl Options pane

      => select "Crawl Any Subdomain Of The Requested Subdomain" option button

      5. Select the spider to generate ADR, open the generated ADR and observe

      Actual Result:

      Found that the spider crawls only the "http://money.cnn.com/xxxx" urls and doesn't crawls any other subdomain urls of the requested subdomain

      Expected Result:

      The spider should crawl the subdomain urls of "http://money.cnn.com/" and below are some of the expected urls

      http://realestate.money.cnn.com/

      http://cgi.money.cnn.com/

      http://jobsearch.money.cnn.com/

      http://markets.money.cnn.com/

        Attachments

          Activity

            People

            • Assignee:
              antony Antony Rajiv (Inactive)
              Reporter:
              saravanan.t Saravanan (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: