mirror of https://gitlab.com/curben/blog
build: temporary allow web crawler to netlify
- for web crawler to see X-Robots-Tag header - https://www.bing.com/webmasters/help/?topicid=37c07477
This commit is contained in:
parent
5cf1d8c96b
commit
e79f9c044e
|
@ -4,3 +4,4 @@
|
||||||
# /screenshot/* https://cdn.statically.io/screenshot/device=mobile/curben.netlify.app/:splat 200
|
# /screenshot/* https://cdn.statically.io/screenshot/device=mobile/curben.netlify.app/:splat 200
|
||||||
/screenshot/* https://cdn.statically.io/screenshot/curben.netlify.app/:splat 200
|
/screenshot/* https://cdn.statically.io/screenshot/curben.netlify.app/:splat 200
|
||||||
/files/* https://gitlab.com/curben/blog/-/raw/site/:splat 200
|
/files/* https://gitlab.com/curben/blog/-/raw/site/:splat 200
|
||||||
|
/robots.txt /robots-mdleom.com.txt 200
|
||||||
|
|
Loading…
Reference in New Issue