Start a conversation

Crawling Control and Settings

  • Start crawling

    1. Default settings by tabs: 1.1. General settings 1.2. Advanced settings 1.3. User Agent settings 1.4. Restrictions settings 2. Crawling: 2.1. Crawling process 2.2. Changes in settings during crawlin...

  • How to audit hreflang on a website with multiple languages

    The validation of hreflang has been implemented in Netpeak Spider 3.5. This feature includes: two new parameters (in the ‘Head tags’ group) nine issue reports related to hreflang configuration two ext...

  • Custom HTTP Headers

    In Netpeak Spider 3.6 we’ve implemented a support of custom HTTP headers for a flexible program configuration. It allows you to solve more advanced tasks like checking SEO issues on websites that use ...

  • Multi-Domain Crawling

    Function assignment How to enable multi-domain crawling in Netpeak Spider Work with crawling results Usage example 1. Function assignment Multi-domain crawling is a feature that allows you to simultan...

  • Netpeak Spider Settings

    One of the key Netpeak Spider advantages is agile configurations of the program to make it perfectly match your requirements. To simplify the crawling settings, we have implemented the following featu...

  • Export Settings

    1. Export file format. 2. Regional settings. 3. Export all issues. 4. Report name settings. 5. Additional options in export settings. Netpeak Spider allows exporting almost any report in a few clicks ...

  • User Agent Settings

    User Agent is an identification representing a part of HTTP request and containing information about the device, from which the connection to a server will be established. By default, Netpeak Spider c...

  • Scraping Settings

    Types of scraping parameters. Applying data extraction feature. Scraping parameters configuration. Displaying of scraping parameter on a sidebar Data extraction results. Scraping represents an inbuilt...

  • General Settings in Netpeak Spider

    Language. Crawling speed. Basic сrawling settings. On the ‘General’ settings tab, you can change the interface language, crawling speed, and basic crawling settings. 1. Language It is possible to choo...

  • Advanced settings

    Considering crawling and indexing instructions. Crawling links from the link tag. Automatic stop of crawling. Additional settings. You can find the advanced settings under ‘Settings → Advanced‘. They ...

Still Thinking?

Thousands of specialists around the world use Netpeak Spider and Checker for daily SEO-tasks. Register to start your 14-day free trial right now!