curben
/
blog
mirror of https://gitlab.com/curben/blog
1
0
Fork 0
Code Issues Releases Wiki Activity

build: exclude mirrors from web crawlers

This commit is contained in:
Ming Di Leom 2021-02-26 11:10:54 +00:00
parent 0640fbd8f7
commit 7d249110cf
No known key found for this signature in database
GPG Key ID: 32D3E28E96A695E8
1 changed files with 1 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
source/robots.txt
View File

@ -1,5 +1,2 @@
User-agent: * User-agent: *
Disallow: /404 Disallow: /
Disallow: /404.html
Sitemap: https://mdleom.com/sitemap.xml