Page 1 of 1

Очень много noref

Posted: Fri Jul 26, 2013 2:00 am
by Nikso
На сидже 1.5к равов от трейдеров и 5.5к норефов.
В основном идет с трех айпишников, проверил, айпи сиджев некоторых моих трейдов.

В логах сервера в основном такая картина для этих Ипов

Code: Select all

38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55575 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55397 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55906 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55896 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:19 -0500] "GET / HTTP/1.1" 200 55673 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET / HTTP/1.1" 200 55703 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:20 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:25 -0500] "GET / HTTP/1.1" 200 55725 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:25 -0500] "GET / HTTP/1.1" 200 55406 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:25 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:25 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:31 -0500] "GET / HTTP/1.1" 200 55798 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:31 -0500] "GET / HTTP/1.1" 200 55663 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:31 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:31 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:33 -0500] "GET / HTTP/1.1" 200 55785 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:33 -0500] "GET / HTTP/1.1" 200 55846 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:33 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:33 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:35 -0500] "GET / HTTP/1.1" 200 55794 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:35 -0500] "GET / HTTP/1.1" 200 55673 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:05:36 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:05:36 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:02 -0500] "GET / HTTP/1.1" 200 55835 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:02 -0500] "GET / HTTP/1.1" 200 55578 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:03 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:03 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:05 -0500] "GET / HTTP/1.1" 200 55627 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:05 -0500] "GET / HTTP/1.1" 200 55701 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:06 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:06 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:08 -0500] "GET / HTTP/1.1" 200 55818 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:08 -0500] "GET / HTTP/1.1" 200 55828 "-" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) crystal trader"
38.72.xxx.xxx - - [25/Jul/2013:00:06:08 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"
38.72.xxx.xxx - - [25/Jul/2013:00:06:08 -0500] "GET /scj/thumbs/2/090_targetblank_a.jpg HTTP/1.1" 200 45770 "http://www.mydomain.com" "Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0)"

Re: Очень много noref

Posted: Fri Jul 26, 2013 6:45 am
by admin
Судя по логу crystal trader чекает терйдеров.

Re: Очень много noref

Posted: Sat Apr 26, 2014 7:30 pm
by magdan
Тема старая но для меня актуальная :)
Так что же делать с этими кристалами ?
как сделать так что бы не видеть в стате этих чекеров ? ,кроме бана трейдеров на кристале :)
в час по 200 по 300 приходят , когда сетка в 50 сайтов , очень не удобно делать анализ трафика , все путает этот Ноуреф

Re: Очень много noref

Posted: Sat Apr 26, 2014 8:12 pm
by magdan
Нашел :)
Cj Seting/admin area/admin option/ поставить не считать noref
может кому пригодиться
Image

Re: Очень много noref

Posted: Sat Apr 26, 2014 8:19 pm
by admin
В сетттиингах есть списко ботов - можно туда вписать crystal и будет его считать в боты

Re: Очень много noref

Posted: Sat Apr 26, 2014 8:58 pm
by magdan
Image
сюда ? в Spiders UA , верно ?

Re: Очень много noref

Posted: Sun Apr 27, 2014 2:02 pm
by admin
Да