# robots.txt for http://www.algurgstationery.com/ # Disallow all crawlers access to Profile (Admin + Customer) pages. User-agent: * Disallow: /Profile/ Disallow: /bin/ Disallow:/App_Browsers/ Disallow:/Order/ Disallow:/App_Themes/ Disallow:/Scripts/ # Allow all crawlers access to Profile (Admin + Customer) pages. Allow:/Profile/TermsAndConditions.aspx Allow:/Profile/Customer/SiteContactUs.aspx Allow:/Profile/Customer/UserLogin.aspx Allow:/Profile/Customer/RegistrationTerms.aspx # Sitemap files Sitemap: http://www.algurgstationery.com/Site-Common.XML