Pages with technical problems
The URLs in this list could not be retrieved by the Seobility crawler due to technical problems.
Why you should avoid technical issues:
Technical problems are not only frustrating for your visitors, but they can also cause search engines to miss potentially important content or to stop crawling your site. Avoid these errors at all costs to ensure that all of your important content can be crawled and indexed by search engines.
Most common error messages (in the column "Problem"):
- Request failed: The Seobility crawler could not reach the server when requesting this URL. Common causes: server performance issues, Seobility bot is blocked from accessing the page.
- Timeout: Your web server was reached but failed to respond within 10 seconds. Common cause: server performance issues.
- HTTP status code: When the page was requested, the server sent an error code in response. For an overview of the meaning and causes of various HTTP status codes, click here.
- Filesize too big: The page could not be retrieved because the HTML file is too large (more than 5MB).
- Invalid HTML: The page could not be crawled because the HTML code contains serious errors.
- Bot error (unknown): The page could not be retrieved due to an unknown error. Common cause: JavaScript crawling issues.
Here's how to fix the most common problems:
A common cause of technical problems is poor server performance. This can lead to error messages such as "Request failed" and "Timeout" and often occurs in combination with long response times (see the "Distribution of response times" analysis in the Tech & Meta section). You can find tips for improving server response times here.
Another common cause is that the Seobility bot is blocked from accessing your site, which can lead to error messages such as "Request failed" or "HTTP status 403". In these cases, make sure that the Seobility bot is allowed to access your site. A list of user agents and Seobility IP addresses is available here.
In case of 404 errors: correct or remove all internal links pointing to the broken URL. You can find these links by clicking on the URL in the list and then checking the "Elements" tab. If the 404 error is caused by URL changes, you should also set up a 301 redirect from the old to the new URL.
Why does Seobility find these pages?
In general, a page can appear here for three reasons:
- There are internal links on your site pointing to the URL.
- The URL is ranking on Google.
- The URL has backlinks from external sites.
To find out how Seobility discovered the URL, click on the URL and check the "Elements" tab.