# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: Twitterbot Disallow: Allow: /post/ User-agent: facebookexternalhit Disallow: Allow: /post/ User-agent: facebot Disallow: Allow: /post/ User-agent: * Disallow: /post/ Sitemap: https://www.primetimer.com/google-news-sitemap.xml