ItsDrike/itsdrike.com
1
0
Fork 0
mirror of https://github.com/ItsDrike/itsdrike.com.git synced 2025-11-03 19:56:36 +00:00
Code Issues Projects Releases Packages Wiki Activity

Improve robots.txt

Browse source
This commit is contained in:
ItsDrike 2022-06-01 20:04:23 +02:00
parent 55ea1f48f5
commit 6c2a21f37b
No known key found for this signature in database
GPG key ID: B014E761034AF742
1 changed files with 10 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

11
layouts/robots.txt
View file

@ -1,4 +1,13 @@
User-agent: * User-agent: *
Allow: / Disallow: /img/
Disallow: /js/
Disallow: /css/
Disallow: /scss/
Disallow: /webfonts/
Disallow: /error/
Disallow: /files/
Disallow: /extra/
Disallow: /special
Sitemap: {{ absURL "sitemap.xml" }} Sitemap: {{ absURL "sitemap.xml" }}