Skip to main content

Wordpress Hosting | How to enable the litespeed cache crawler

LiteSpeed Cache is a powerful caching plugin for WordPress that significantly improves your website's performance. One of its advanced features is the Crawler Cache, which primes the WordPress cache by visiting pages on your site automatically. This ensures that visitors experience better load times even if the page wasn't previously cached.

This guide will show you how to enable and configure the Crawler Cache in LiteSpeed Cache for your WordPress site.

Prerequisites​

Before you proceed, ensure you meet the following requirements:

  • You have installed and activated the LiteSpeed Cache plugin.
  • You have the appropriate access to modify plugin settings in your WordPress admin.
info

Make sure to also setup caching with litespeed here

Enable the Crawler Feature​

  1. Log in to your WordPress Admin interface.
  2. Navigate to LiteSpeed Cache in the sidebar menu and click on Settings.

  1. Open the Crawler tab.

  1. Go to the Sitemap Settings tab

tip

To add your sitemap for yoast SEO you can do the following:

  1. Go to https://yourdomain.com/sitemap_index.xml
  2. Copy all the URL's from the sitemap index and paste it in the Custom Sitemap field.

If you make use of All in One SEO you can do the following:

  1. Go to https://yourdomain.com/sitemap.xml
  2. Copy all the URL's from the sitemap index and paste it in the Custom Sitemap field.
  1. It will look like this if you have multiple URL's

  1. Click Save Changes.

  2. You can now go to the General tab and set the crawler to ON and click save changes.

  1. Now navigate to the Map tab and click on Refresh Crawler Map button.

  1. Lastly, head to the Summary tab and select Manually Run to start the first crawl straight away.

  1. You are now done!

The LiteSpeed crawler begins by performing an initial pass across all pages on the site to ensure they are cached. This first pass can take several hours to complete, so its benefits may not be immediately noticeable.

After the initial pass is finished, subsequent passes will focus exclusively on pages that are either not yet cached or nearing cache expiration. This ensures that every page remains pre-warmed and ready to deliver optimal performance for human visitors.

info

Make sure to also setup caching with litespeed here

Last updated on