block robots from /search
This commit is contained in:
parent
4b768e2f42
commit
ce8eb45008
|
@ -14,3 +14,6 @@ Disallow:
|
||||||
|
|
||||||
User-agent: Baiduspider
|
User-agent: Baiduspider
|
||||||
Disallow: /
|
Disallow: /
|
||||||
|
|
||||||
|
User-agent: *
|
||||||
|
Disallow: /search
|
||||||
|
|
Loading…
Reference in a new issue