curben
/
blog
mirror of https://gitlab.com/curben/blog
1
0
Fork 0
Code Issues Releases Wiki Activity
blog/source/robots.txt

5 lines
89 B
Plaintext
Raw Normal View History

feat: add robots.txt
2019-05-27 02:11:51 +00:00
User-agent: *
fix(404): remove from sitemap and web crawler
2020-06-30 13:34:37 +00:00
Disallow: /404
Disallow: /404.html
fix(sitemap): add sitemap location to <head> and robots.txt * https://github.com/h5bp/html5-boilerplate/pull/1918
2019-06-26 06:54:19 +00:00
chore: mdleom.com sitemap
2020-02-18 23:34:33 +00:00
Sitemap: https://mdleom.com/sitemap.xml