14 lines
352 B
Plaintext
14 lines
352 B
Plaintext
# robots.txt for Midrand Books (LiteCharms (PTY) Ltd)
|
|
User-agent: *
|
|
Allow: /
|
|
Disallow: /admin/
|
|
Disallow: /api/
|
|
Disallow: /checkout/success
|
|
Disallow: /checkout/cancel
|
|
|
|
# Host configuration
|
|
Host: https://www.midrandbooks.co.za
|
|
|
|
# XML Sitemap link for all search engine bots and AI scrapers (AEO & SEO)
|
|
Sitemap: https://www.midrandbooks.co.za/sitemap.xml
|