Очень много noref

[Nikso]

На сидже 1.5к равов от трейдеров и 5.5к норефов.
В основном идет с трех айпишников, проверил, айпи сиджев некоторых моих трейдов.

В логах сервера в основном такая картина для этих Ипов

Code: Select all

38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55575 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55397 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55906 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55896 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55673 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET / HTTP/1.1" 200 55703 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:25 -0500] "GET / HTTP/1.1" 200 55725 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:25 -0500] "GET / HTTP/1.1" 200 55406 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:25 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:25 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:31 -0500] "GET / HTTP/1.1" 200 55798 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:31 -0500] "GET / HTTP/1.1" 200 55663 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:31 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:31 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:33 -0500] "GET / HTTP/1.1" 200 55785 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:33 -0500] "GET / HTTP/1.1" 200 55846 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:33 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:33 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:35 -0500] "GET / HTTP/1.1" 200 55794 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:35 -0500] "GET / HTTP/1.1" 200 55673 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:36 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:36 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:02 -0500] "GET / HTTP/1.1" 200 55835 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:02 -0500] "GET / HTTP/1.1" 200 55578 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:03 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:03 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:05 -0500] "GET / HTTP/1.1" 200 55627 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:05 -0500] "GET / HTTP/1.1" 200 55701 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:06 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:06 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:08 -0500] "GET / HTTP/1.1" 200 55818 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:08 -0500] "GET / HTTP/1.1" 200 55828 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:08 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:08 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"

[admin]

Судя по логу crystal trader чекает терйдеров.

[magdan]

Тема старая но для меня актуальная
Так что же делать с этими кристалами ?
как сделать так что бы не видеть в стате этих чекеров ? ,кроме бана трейдеров на кристале
в час по 200 по 300 приходят , когда сетка в 50 сайтов , очень не удобно делать анализ трафика , все путает этот Ноуреф

[magdan]

Нашел
Cj Seting/admin area/admin option/ поставить не считать noref
может кому пригодиться

[admin]

В сетттиингах есть списко ботов - можно туда вписать crystal и будет его считать в боты

[magdan]

сюда ? в Spiders UA , верно ?

[admin]

Да