NixNet/robots.txt

---
layout: null
sitemap:
  exclude: 'yes'
---
User-agent: ia_archiver
Disallow: /

User-agent: GPTBot
Disallow: /

Sitemap: {{ site.url }}/sitemap.xml
initial commit 2018-12-14 05:47:01 +00:00			`---`
			`layout: null`
			`sitemap:`
			`exclude: 'yes'`
			`---`
modify robots.txt 2018-12-21 19:25:54 +00:00			`User-agent: ia_archiver`
			`Disallow: /`
initial commit 2018-12-14 05:47:01 +00:00
add gptbot to robots.txt 2023-08-08 18:30:08 +00:00			`User-agent: GPTBot`
			`Disallow: /`

initial commit 2018-12-14 05:47:01 +00:00			`Sitemap: {{ site.url }}/sitemap.xml`