Semrush logo
  • Products

    Start Here

    • Semrush One
    • Enterprise
    • Features
    • Request a Demo
    • Talk to Sales

    Find the Right Tools

    • AI Visibility Toolkit
    • SEO Toolkit
    • Traffic & Market Toolkit
    • Content Toolkit
    • Local Toolkit
    • Social Toolkit
    • Advertising Toolkit
    • PR Toolkit

    Platform

    • Integrations
    • App Center
    • API
    • Data Sources

    Top Apps

    • AdClarity
    • Exploding Topics
    • Other apps
  • Pricing
  • Resources

    Grow with Semrush

    • Blog
    • Knowledge Base
    • Academy
    • Success Stories
    • AI Visibility Index
    • Webinars
    • News

    Explore Free Tools

    • AI Visibility Checker
    • SEO Checker
    • Website Traffic Checker
    • Keyword Tool
    • Backlink Checker
    • Top Websites by Traffic
    • Explore Other Free Tools

    About Semrush

    • About Us
    • Stats and Facts
    • Integrations
    • Affiliate Program
    • Contact us
  • Enterprise
Log InSign Up
  • News
  • Data & Insights
  • Company News
  • Product News
  • Press Kit
Search icon
Semrush logo
  • Products
  • Pricing
  • Resources
  • Enterprise
  • News
  • Data & Insights
  • Company News
  • Product News
  • Press Kit
Log InSign Up

Start Here

  • Semrush One
  • Enterprise
  • Features
  • Request a Demo
  • Talk to Sales

Find the Right Tools

  • AI Visibility Toolkit
  • SEO Toolkit
  • Traffic & Market Toolkit
  • Content Toolkit
  • Local Toolkit
  • Social Toolkit
  • Advertising Toolkit
  • PR Toolkit

Platform

  • Integrations
  • App Center
  • API
  • Data Sources

Top Apps

  • AdClarity
  • Exploding Topics

Grow with Semrush

  • Blog
  • Knowledge Base
  • Academy
  • Success Stories
  • AI Visibility Index
  • Webinars
  • News

Explore Free Tools

  • AI Visibility Checker
  • SEO Checker
  • Website Traffic Checker
  • Keyword Tool
  • Backlink Checker
  • Top Websites by Traffic
  • Explore Other Free Tools

About Semrush

  • About Us
  • Stats and Facts
  • Integrations
  • Affiliate Program
  • Contact us
Main page /Product News

Site Audit: New Features for Site Migration

August 2, 2019
Site Audit: New Features for Site Migration
Site migration is without a doubt a very important stage in the life cycle of a website. You have to pay attention to many details in order to keep your SEO machine running and to avoid damaging anything. Site Audit, SEMrush’s unique multi-tool for technical SEO, now provides you with everything you need to relocate your site safe and sound.

But there’s more. Site move is a very complex process and you’re going to need a good checklist to keep everything under control. Following the recommendations of Google, we have developed a complete site migration checklist for each type of site migration with tips from the top SEO experts. You can use it along with SEMrush tools. Check it out!

Now let’s take a closer look at the new Site Audit features.

Crawled Pages export

We’ve added an option to export the Crawled Pages report data, taking into account filtering and sorting applied. You can also export relative URLs instead of absolute ones.
1.gif

Crawling by URL list

We’ve added a new option for indicating a crawl source – List of URLs. The tool works with both absolute and relative URLs. You can now upload your list using .txt or .csv formats from Google Analytics, Google Search Console, Backlink Analytics, or Position Tracking. A file, which we’ll crawl all URLs (based on your limits) from, should be less than 100 Mb.
2.png

Crawling of a password-protected site

It’s now possible to crawl your site with Site Audit if you have to protect it with a password and login for security reasons.
3.gif

Crawling of a site closed for robots

Previously, it was impossible to crawl a site, closed to robots.txt file. From now on, you can easily crawl your site after confirming your rights to it (as we’re concerned about the legitimacy of the robots.txt circumvent).

4.gif
What do you think of this update? Your comments, thoughts and ideas are priceless to us. Please send them to site-audit-feedback@semrush.com. 
Try out the new features for site migration
Go to Site Audit

Download as

PDF
DOCX

Share

Relevant news

Semrush for Enterprise Unifies Content Optimization Capabilities Across SEO and AI Search

New workflows shared between Enterprise SEO and AI Optimization enable teams to grow brand visibility through high-performing content for both search channels.
Product News
May 27, 2026

Semrush Expands AI Visibility Database To 32 Countries, With 17 New Regional Markets

Global coverage expansion now provides international teams with real AI search data for previously unmeasured markets, growing the Semrush prompt database to more than 261 million LLM prompts.
Product News
May 14, 2026

Semrush Announces Partnership With Lovable, Bringing Search Intelligence Into The Building Experience

In a new partnership with Semrush, all Lovable users will have access to Semrush’s search intelligence natively inside the building experience, so founders can create projects for brand visibility and growth from the outset.
Product News
May 13, 2026

Get started with Semrush today

Try Semrush free for seven days. Cancel anytime.

Start free trial
  • Semrush One
  • Features
  • Pricing
  • Free Trial
  • Compare Semrush
  • Success Stories
  • Stats and Facts
  • Affiliate Program
  • Enterprise SEO
  • Enterprise AIO
  • Enterprise SI
  • Insights24
  • Mfour
  • App Center
  • Top Websites
  • Free Tools
  • Sensor
  • About Us
  • News
  • Careers
  • Partners
  • Semrush Select
  • Global Issues Index
  • Contact us
  • Knowledge Base
  • Academy
  • API
Community
  • Semrush Blog
  • Webinars
  • Ambassador Program
LinkedInInstagramTikTokYouTubeFacebookX
Adobe logo© 2026 Semrush Holdings. All rights reserved.
Privacy PolicyTerms of ServiceCookies Settings
Semrush