Robots.txt: Difference between revisions
From DWIKI
Tag: wikieditor |
m →Links Tag: wikieditor |
||
| Line 1: | Line 1: | ||
=Links= | =Links= | ||
*[https://stopbadbots.com/http-tools/ List of tool/bots you might want to block] | |||
==Documentation== | ==Documentation== | ||
*[https://yoast.com/ultimate-guide-robots-txt/ The ultimate guide to robots.txt] | *[https://yoast.com/ultimate-guide-robots-txt/ The ultimate guide to robots.txt] | ||
