Hi,
I have set up my site with Pinpoint and I keep getting the following error in Google Webmaster Tools:
“Google couldn’t crawl your site because we were unable to access your site’s robots.txt file.”
I have done the following to try and fix the error:
1. Authenticating the url in Google Webmaster Tools
2. Set the Word Press address and Site Address in Word Press General Settings
3. Unchecked “Discourage search engines from indexing this site
4. Set Permalink settings to Post name – /sample-post/
5. Installed Yoast SEO plugin
6. Installed Google XML Sitemap generator
7. Searched for a robots.txt file in the site’s files (couldn’t find one)
8. Manually added a robots.txt file giving full permission to all bots
To date, nothing has changed the crawl error message and my site remains unsearchable. Any suggestions?