Find out more about the newest bot, which will crawl your websites in the following year – the Googlebot-News. Learn how to control it with the robots.txt file.

Read the rest of New Googlebot-News agent

In order to always stay in control, and even control the way search engines look at your site, you need to know more about the robots.txt file.

Read the rest of Control the Search engine bots using the robots.txt file