build: temporary allow web crawler to netlify

- for web crawler to see X-Robots-Tag header
- https://www.bing.com/webmasters/help/?topicid=37c07477
This commit is contained in:
Ming Di Leom 2021-02-26 22:13:48 +00:00
parent 5cf1d8c96b
commit e79f9c044e
No known key found for this signature in database
GPG Key ID: 32D3E28E96A695E8
1 changed files with 1 additions and 0 deletions

View File

@ -4,3 +4,4 @@
# /screenshot/* https://cdn.statically.io/screenshot/device=mobile/curben.netlify.app/:splat 200 # /screenshot/* https://cdn.statically.io/screenshot/device=mobile/curben.netlify.app/:splat 200
/screenshot/* https://cdn.statically.io/screenshot/curben.netlify.app/:splat 200 /screenshot/* https://cdn.statically.io/screenshot/curben.netlify.app/:splat 200
/files/* https://gitlab.com/curben/blog/-/raw/site/:splat 200 /files/* https://gitlab.com/curben/blog/-/raw/site/:splat 200
/robots.txt /robots-mdleom.com.txt 200