Can I read Robots on EtoBox?

Robots is a document available to read on EtoBox.

What is Robots about?

This document provides instructions for a web crawler on which pages of a website to index and which to exclude from indexing. It allows the sitemap.php page and disallows the /tmp/, /site, /assets, /common-ext, /passkey, and /register directories and their contents from being crawled or indexed.

Language

EN