itsdrike.com/layouts/robots.txt

mirror of https://github.com/ItsDrike/itsdrike.com.git synced 2024-11-09 21:49:41 +00:00
User-agent: *
Disallow: /img/
Disallow: /js/
Disallow: /css/
Disallow: /scss/
Disallow: /webfonts/
Disallow: /error/

Disallow: /files/
Disallow: /extra/
Disallow: /special

Sitemap: {{ absURL "sitemap.xml" }}
Add robots.txt 2021-08-25 08:54:17 +00:00			`User-agent: *`
Improve robots.txt 2022-06-01 18:04:23 +00:00			`Disallow: /img/`
			`Disallow: /js/`
			`Disallow: /css/`
			`Disallow: /scss/`
			`Disallow: /webfonts/`
			`Disallow: /error/`

			`Disallow: /files/`
			`Disallow: /extra/`
			`Disallow: /special`
Add robots.txt 2021-08-25 08:54:17 +00:00
			`Sitemap: {{ absURL "sitemap.xml" }}`