Improve robots disallow
This commit is contained in:
parent
1886970363
commit
45f97d5665
|
@ -1,4 +1,5 @@
|
||||||
User-agent: *
|
User-agent: *
|
||||||
Disallow: /lib/
|
Disallow: /lib/epubs/
|
||||||
|
Disallow: /lib/cache/
|
||||||
|
|
||||||
Sitemap: https://comlib.encryptionin.space/sitemap.xml
|
Sitemap: https://comlib.encryptionin.space/sitemap.xml
|
||||||
|
|
Loading…
Reference in a new issue