Can you ever have your crawles?
Crawling assumes that the search engines’ “spiders” will be included on your page and follow the links on the website from one page to another to find new and updated content. That your page can crawles is therefore the very basis for being able to be indexed and ranked in the search engines.
Therefore, the first item of the checklist should be to ensure that google and other search engines have access to crawling important pages on your website.
Let up the robots.txt file for your site. You can usually find this by adding robots.txt behind your domain:
https://dit-domain.no/robots.txt
In the INEVO's robots.txt file we see that all search engines (user-agents) are given the same message; they are not allowed access to or need to visit and crash internal pages. If you have content that doesn't have to appear in the search engines, you can save your crew budget and mark these as “disallow”. If, on the other hand, you have pages that should rank and are marked as “disallow”, you should correct this immediately.
Tips: Use Coverage Report in Google Search Console to check if any of your pages have problems with crawling.
Is since your indexable?
Indexing is the way your content is read, sorted and organized when it is found through the curling process. Now you know that Google can crawle since yours, but is it indexed? As soon as a page is indexed, it has the potential to display for relevant search within the search engine.
Test indexing using site:search Google
There are several ways to test how many and which pages are indexed on your website. A quick way to get an overview is to perform a site search in Google. Google will then list all indexed URLs from your website. Search for the site:
Google can tell us here that it has 210 search results available under our domain. This may indicate that they have indexed 210 pages from our website. If you experience a major deviation from the pages Google says they have and how many pages you actually think you have, you should look into more.
If Google shows too many people, it may indicate that you have challenges with an HTTP version of the page being indexed or other duplicate problems. However, Google shows fewer pages than you think it might indicate that large parts of your page are not indexed as it should.
Test Indexing in Google Search Console
Another easy way to get an overview of which pages are indexed is to use the Coverage report in Google Search Console. This number should match the number you get in Google when you complete the site search. There is, however, some additional information in the GSC.
In this report you will find out which pages are indexed (green) and which pages are excluded from being indexed (gray). You will also be able to see it if you have pages with errors (red) or warnings on pages that have potential problems related to them (yellow).
Test Indexing in Screaming Frog
Another way to test the indexation of a page is to download the crash tool. Screaming FrogSo let's say that this is the same thing as that. This comes in a free version and in paid version.
Indexability shows whether or not a URL is indexable. It is shown as “Indexable” or “Not-Indexable”.
Indexability Status shows why the page is not indexed. This may be because it is marked with a noindex tag, because it is canonicalized, blocked by robots.txt file or similar.
Optimize Sitemap
When it's going to crawle, prioritize and understand since yours is a well structured sitemap invaluable.
Each website is awarded a crawl budget of a certain size that says something about how much resources (the number of pages and the amount of time) Google will spend on crawling website pages. For larger websites, such site maps are an appropriate way to tell search engines which pages should be the highest priority.
Another obvious advantage of using is the sitemap is that you can easier help search engines find and crop your content
Using a site map, we also have the possibility to give search engines information about how to prioritise the pages in relation to each other – which pages are most important and should crawler first. You can also give information about how often the pages change and when they were last modified.
Use a few minutes to check that you have a site map and that this is best practice. Sitemaps are usually found by adding sitemap.xml behind your domain:
https://dit-domain.no/sitemap.xml
Sitemap Checklist
- Follow the correct configuration in an XML file
- Always update sitemap with new URLs
- Do not include now-index URLs in sitemap
- Do not include URLs in the site as you also list as ouncelow in the robot.txt file
- Submit your site to Google via Google Search Console
- Prioritize your main and best pages
- Include only the cannonical version of a page in sitemap
- Remember to add a link to the sitemap.xml file at the bottom of the robots.txt file
Test your mobile friendliness on the page
In 2018, Google introduced “mobile first indexing” or “mobile first indexing”. Several websites are constantly being indexed from the mobile version, and from July 1, 2019, mobile first indexing via smartphone Googlebot defaults for all new websitesSo let's say that this is the same thing as that.
Tips: Do you wonder how Google indexes your website? You can check this in the URL Inspection in Google Search Console.
Mobile Friendly Test is a free Google tool you can use to test if your page is mobile. Enter your URL and run a test. Here you will quickly see if Google classifies your website as mobile or not. If it is not mobile, you will get improvement potential.
It is, however, as important to test the page on an actual mobile phone as well as in a tool. Test your mobile phone website to see how easy it is to navigate.
Tips: Please take a few minutes to review the data in Google Analytics under Audio -> Mobile report. Here you can discover traffic patterns and user data that say something about how good your mobile page is.
Test the speed of your website
Not only is the speed an important ranking factor in 2019 but it is also essential for a good user experience.
Not only will you be punished when Google rank its results, but you will also probably fall from as an alternative to your customers the next time they are going to make a purchase. Testing the speed of your side is therefore an essential part of an SEO-audit.
Google PageSpeed Insights
Google PageSpeed Insights is another free tool from Google. The tool gives you insight into how your page is performing when it comes to speeding up both mobile and desktop, as well as what steps you can take to improve speed. Test the front page and your main focus pages to see how they perform on Speed and experience of usersSo let's say that this is the same thing as that.
Google Analytics
Google Analytics can provide a good indication of which parts of your website are dragging up or down when it comes to the total speed. If you visit the Behavior -> Site Speed you will be able to see which speed of your page and which subpages, for example, slow down significantly during the average etc.
Test My Site
Large amounts of traffic to since yours is likely to come from mobile devices. A key point when it comes to this traffic is that it can often come from 3G or 4G networks. Test My Site from Google lets you test how your page performs at speed when someone visits it from mobile devices on just 3G and 4G networks.
Conduct measures by audit
Now that you've completed the five checkpoints within the SEO technical SEO, you probably have a better picture of how your website does it based on five absolutely essential points. The sound is just the top of the iceberg when it's going to work with SEO, but necessary to compete in general for organic visibility. Perhaps you have already developed a list of actions to improve your website in the last hour?
If you need help implementing the actions, a more comprehensive SEO audit of your website or will discuss how we can help you with search engine optimisation Can You Contact us for an uncommitted chat.