6 lines
83 B
Plaintext
6 lines
83 B
Plaintext
User-agent: *
|
|
Disallow: /*/embed
|
|
Disallow: /embed
|
|
# bingbot moment
|
|
Crawl-Delay: 30
|