XML Sitemap Analysis – Crawl an XML Sitemap independently or part of a crawl, to find missing, non-indexable and orphan pages.AMP Crawling & Validation – Crawl AMP URLs and validate them, using the official integrated AMP Validator.Store & View HTML & Rendered HTML – Essential for analysing the DOM.Rendered Screen Shots – Fetch, view and analyse the rendered pages crawled.Custom robots.txt – Download, edit and test a site’s robots.txt using the new custom robots.txt.XML Sitemap Generation – Create an XML sitemap and an image sitemap using the SEO spider.External Link Metrics – Pull external link metrics from Majestic, Ahrefs and Moz APIs into a crawl to perform content audits or profile links.PageSpeed Insights Integration – Connect to the PSI API for Lighthouse metrics, speed opportunities, diagnostics and Chrome User Experience Report (CrUX) data at scale.Google Search Console Integration – Connect to the Google Search Analytics and URL Inspection APIs and collect performance and index status data in bulk.Google Analytics Integration – Connect to the Google Analytics API and pull in user and conversion data directly during a crawl.Custom Extraction – Scrape any data from the HTML of a URL using XPath, CSS Path selectors or regex.Custom Source Code Search – Find anything you want in the source code of a website! Whether that’s Google Analytics code, specific text, or code etc.Custom HTTP Headers – Supply any header value in a request, from Accept-Language to cookie.User-Agent Switcher – Crawl as Googlebot, Bingbot, Yahoo! Slurp, mobile user-agents or your own custom UA. Images over 100kb, missing alt text, alt text over 100 characters.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |