blankie
/
nitter
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
nitter/public/robots.txt

6 lines
74 B
Plaintext
Raw Blame History

User-agent: *
Disallow: /
Crawl-delay: 1
User-agent: Twitterbot
Disallow:
Reference in New Issue View Git Blame Copy Permalink