User-agent: * Disallow: / User-agent: Google Allow: / User-agent: Twitterbot Allow: / User-agent: Facebookexternalhit/1.1 Allow: /