15308555518/ mirror-web
1
0
Fork 0
mirror of https://github.com/tuna/mirror-web.git synced 2025-12-26 05:02:48 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

update robots.txt

This commit is contained in:
bigeagle 2016-08-13 22:38:28 +08:00
parent 36f0899eab
commit e7dd9a83ad
1 changed files with 9 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
robots.txt
View File

@ -6,6 +6,7 @@ Disallow: /CRAN
Disallow: /CTAN
Disallow: /CocoaPods
Disallow: /ELK
Disallow: /NetBSD
Disallow: /OpenBSD
Disallow: /alpine
Disallow: /anaconda
@ -40,15 +41,19 @@ Disallow: /gentoo
Disallow: /gitlab-ce
Disallow: /gitlab-ci-multi-runner
Disallow: /gnu
Disallow: /grafana
Disallow: /hackage
Disallow: /homebrew-bottles
Disallow: /homebrew
Disallow: /influxdata
Disallow: /ius
Disallow: /jenkins
Disallow: /kali-images
Disallow: /kali-security
Disallow: /kali
Disallow: /kernel
Disallow: /kodi
Disallow: /lede
Disallow: /linux.git
Disallow: /linuxmint-cd
Disallow: /linuxmint
@ -59,17 +64,21 @@ Disallow: /manjaro
Disallow: /mariadb
Disallow: /mongodb
Disallow: /msys2
Disallow: /mysql
Disallow: /neurodebian
Disallow: /nodesource
Disallow: /opensuse
Disallow: /openwrt
Disallow: /osmc
Disallow: /packman
Disallow: /parrot
Disallow: /percona
Disallow: /puppy
Disallow: /pybombs
Disallow: /pypi
Disallow: /qt
Disallow: /raspbian
Disallow: /redhat
Disallow: /remi
Disallow: /repo-ck
Disallow: /repoforge