forked from mirrors/amputoma
3dadaa4432
Add default robots.txt that allows bots access to all paths. Add mix task to generate robots.txt taht allows bots access to no paths. Document custom emojis, MRF and static_dir static_dir documentation includes docs for the robots.txt Mix task.
2 lines
25 B
Text
2 lines
25 B
Text
User-Agent: *
|
|
Disallow:
|