curben
/
blog
mirror of https://gitlab.com/curben/blog
1
0
Fork 0
Code Issues Releases Wiki Activity
blog/source/robots.txt

4 lines
91 B
Plaintext
Raw Normal View History

build: add note to robots.txt
2021-02-26 21:40:11 +00:00
# This file only applies to mirrors, see "robots-mdleom.com.txt"
feat: add robots.txt
2019-05-27 02:11:51 +00:00
User-agent: *
build: exclude mirrors from web crawlers
2021-02-26 11:10:54 +00:00
Disallow: /