NixNet/robots.txt

---
layout: null
sitemap:
  exclude: 'yes'
---
User-agent: *
Disallow: /search

User-agent: ia_archiver
Disallow: /

Sitemap: {{ site.url }}/sitemap.xml
initial commit 2018-12-14 05:47:01 +00:00			`---`
			`layout: null`
			`sitemap:`
			`exclude: 'yes'`
			`---`
			`User-agent: *`
modify robots.txt 2018-12-21 19:25:54 +00:00			`Disallow: /search`

			`User-agent: ia_archiver`
			`Disallow: /`
initial commit 2018-12-14 05:47:01 +00:00
			`Sitemap: {{ site.url }}/sitemap.xml`