diff options
| author | mandar1jn <[email protected]> | 2022-10-12 11:30:20 +0200 |
|---|---|---|
| committer | GitHub <[email protected]> | 2022-10-12 11:30:20 +0200 |
| commit | 6783f0122bca630b432a92aee29a9aa7c0f53daf (patch) | |
| tree | 94f132b8eaf7c702c51becf32e9411f1ad736873 /robots.txt | |
| parent | 18304165380c4da0c83ccae144924c717bc02618 (diff) | |
| download | raylib.com-6783f0122bca630b432a92aee29a9aa7c0f53daf.tar.gz raylib.com-6783f0122bca630b432a92aee29a9aa7c0f53daf.zip | |
Update robots.txt
The old robots.txt didn't disallow any pages and didn't specifically allow any. Its contents had no effect. This removes all the useless content and adds a Sitemap statement to direct web crawlers to the sitemap
Diffstat (limited to 'robots.txt')
| -rw-r--r-- | robots.txt | 5 |
1 files changed, 1 insertions, 4 deletions
@@ -1,6 +1,3 @@ # robotstxt.org/ -User-agent: Twitterbot -Disallow: - -User-agent: * +Sitemap: https://raylib.com/sitemap.xml |