Commit Graph

6 Commits

Author SHA1 Message Date
Ming Di Leom 5cf1d8c96b
build: add note to robots.txt 2021-02-26 21:40:11 +00:00
Ming Di Leom 7d249110cf
build: exclude mirrors from web crawlers 2021-02-26 11:10:54 +00:00
MDLeom 791f845ca3
fix(404): remove from sitemap and web crawler 2020-06-30 14:34:37 +01:00
MDLeom 2aa157d853
chore: mdleom.com sitemap 2020-02-18 23:34:33 +00:00
curben 6b9395cebc fix(sitemap): add sitemap location to <head> and robots.txt
* https://github.com/h5bp/html5-boilerplate/pull/1918
2019-06-26 16:24:19 +09:30
curben 5def92d738 feat: add robots.txt 2019-05-27 11:58:48 +09:30