Active To grab
Re: Active To grab
папка сама удаляется,создаешь новою и она удаляется.
Re: Active To grab
Build 201705061033 (Lastest build: 201705061033 )
cj.log
2017-05-08 14:41 Can not create folder ../tmp/1036492 (0.083965063095093, 0.00025796890258789)
2017-05-08 14:41 Something went wrong, mark gallery_id 1036492 as grab_error (0.08445405960083, 0.0004889965057373)
2017-05-08 14:41 Delete gallery 1036492 from (0.084687948226929, 0.00023388862609863)
2017-05-08 14:41 Delete gallery content 1036/492 (0.20217394828796, 0.11748600006104)
2017-05-08 14:42 Process traffic (0.053219079971313, 0.053219079971313)
2017-05-08 14:42 Process traders (0.067312955856323, 0.01409387588501)
2017-05-08 14:42 Check timed forces (0.14898586273193, 0.08167290687561)
2017-05-08 14:42 Calculate priority (0.14948201179504, 0.00049614906311035)
2017-05-08 14:42 Soft force (0.16269707679749, 0.013215065002441)
2017-05-08 14:42 Write config (0.16296887397766, 0.00027179718017578)
2017-05-08 14:42 Cron job :: finished (0.17447185516357, 0.011502981185913)
gallery_grabber.log
2017-05-08 14:38:12: Can not create folder ../tmp/1033957 (0.055649042129517, 0.0023519992828369)
2017-05-08 14:38:12: Something went wrong, mark gallery_id 1033957 as grab_error (0.05613112449646, 0.00047802925109863)
2017-05-08 14:38:12: Delete gallery 1033957 from (0.056421041488647, 0.00028705596923828)
2017-05-08 14:38:12: Delete gallery content 1033/957 (0.06001615524292, 0.0035910606384277)2017-05-08 14:39:11: Processing http://www.pornerbros.com/videos/beauti ... ock_815732 (1034756) (0.014333009719849, 0.014339923858643)
2017-05-08 14:39:11: Can not create folder ../tmp/1034756 (0.016546010971069, 0.0022099018096924)
2017-05-08 14:39:11: Something went wrong, mark gallery_id 1034756 as grab_error (0.017040014266968, 0.00049090385437012)
2017-05-08 14:39:11: Delete gallery 1034756 from (0.017280101776123, 0.00023508071899414)
2017-05-08 14:39:11: Delete gallery content 1034/756 (0.032816886901855, 0.015533924102783)2017-05-08 14:40:11: Processing http://www.pornerbros.com/videos/ass-dr ... ase_814668 (1035603) (0.014809846878052, 0.014815807342529)
2017-05-08 14:40:11: Can not create folder ../tmp/1035603 (0.017104864120483, 0.0022919178009033)
2017-05-08 14:40:11: Something went wrong, mark gallery_id 1035603 as grab_error (0.017602920532227, 0.00049495697021484)
2017-05-08 14:40:11: Delete gallery 1035603 from (0.017838954925537, 0.00023198127746582)
2017-05-08 14:40:11: Delete gallery content 1035/603 (0.02155590057373, 0.0037140846252441)
cj.log
2017-05-08 14:41 Can not create folder ../tmp/1036492 (0.083965063095093, 0.00025796890258789)
2017-05-08 14:41 Something went wrong, mark gallery_id 1036492 as grab_error (0.08445405960083, 0.0004889965057373)
2017-05-08 14:41 Delete gallery 1036492 from (0.084687948226929, 0.00023388862609863)
2017-05-08 14:41 Delete gallery content 1036/492 (0.20217394828796, 0.11748600006104)
2017-05-08 14:42 Process traffic (0.053219079971313, 0.053219079971313)
2017-05-08 14:42 Process traders (0.067312955856323, 0.01409387588501)
2017-05-08 14:42 Check timed forces (0.14898586273193, 0.08167290687561)
2017-05-08 14:42 Calculate priority (0.14948201179504, 0.00049614906311035)
2017-05-08 14:42 Soft force (0.16269707679749, 0.013215065002441)
2017-05-08 14:42 Write config (0.16296887397766, 0.00027179718017578)
2017-05-08 14:42 Cron job :: finished (0.17447185516357, 0.011502981185913)
gallery_grabber.log
2017-05-08 14:38:12: Can not create folder ../tmp/1033957 (0.055649042129517, 0.0023519992828369)
2017-05-08 14:38:12: Something went wrong, mark gallery_id 1033957 as grab_error (0.05613112449646, 0.00047802925109863)
2017-05-08 14:38:12: Delete gallery 1033957 from (0.056421041488647, 0.00028705596923828)
2017-05-08 14:38:12: Delete gallery content 1033/957 (0.06001615524292, 0.0035910606384277)2017-05-08 14:39:11: Processing http://www.pornerbros.com/videos/beauti ... ock_815732 (1034756) (0.014333009719849, 0.014339923858643)
2017-05-08 14:39:11: Can not create folder ../tmp/1034756 (0.016546010971069, 0.0022099018096924)
2017-05-08 14:39:11: Something went wrong, mark gallery_id 1034756 as grab_error (0.017040014266968, 0.00049090385437012)
2017-05-08 14:39:11: Delete gallery 1034756 from (0.017280101776123, 0.00023508071899414)
2017-05-08 14:39:11: Delete gallery content 1034/756 (0.032816886901855, 0.015533924102783)2017-05-08 14:40:11: Processing http://www.pornerbros.com/videos/ass-dr ... ase_814668 (1035603) (0.014809846878052, 0.014815807342529)
2017-05-08 14:40:11: Can not create folder ../tmp/1035603 (0.017104864120483, 0.0022919178009033)
2017-05-08 14:40:11: Something went wrong, mark gallery_id 1035603 as grab_error (0.017602920532227, 0.00049495697021484)
2017-05-08 14:40:11: Delete gallery 1035603 from (0.017838954925537, 0.00023198127746582)
2017-05-08 14:40:11: Delete gallery content 1035/603 (0.02155590057373, 0.0037140846252441)
Re: Active To grab
Максимально 3 часа папка сегодня продержалась, но опять каким-то образом пропала
Re: Active To grab
Идей нет, видимо на этом серваке есть что-то хитрое ..
скидывайте шел.
скидывайте шел.
Don't forget to run script update
Re: Active To grab
Полагаю это какие то ньюансы лока таблиц в mariadb которая у вас стоит.
Добавил в скрипте просто обработку таких моментов, с самой maria db надо разбираться плотнее конечно
Добавил в скрипте просто обработку таких моментов, с самой maria db надо разбираться плотнее конечно
Don't forget to run script update
Re: Active To grab
Спасибо, папка больше не пропадает. Но с последнего ее удаления ни одна галлерея не добавилась в active, только грабятся.
Re: Active To grab
gallery_grabber.log
2017-05-09 14:58:27: No thumbs were created (15.272654056549, 0.00012111663818359)
2017-05-09 14:58:27: Cleanup tmp folder ../tmp/1202273 (15.272733211517, 7.5817108154297E-5)
2017-05-09 14:58:27: Deleting gallery (15.272958993912, 0.00022387504577637)
2017-05-09 14:58:27: Delete gallery 1202273 from /var/www/www-root/data/www/domain.com/scj/bin/gallery_grabber.php (15.273001194, 3.7908554077148E-5)
2017-05-09 14:58:27: Delete gallery content 1202/273 (15.276406049728, 0.0034029483795166)
2017-05-09 14:58:27: Processing http://www.pornerbros.com/videos/blonde ... ged_814975 (1202274) (15.279515028, 0.0031058788299561)
2017-05-09 14:58:27: Gallery description is empty: Update with 'admin added' (15.280588150024, 0.0010700225830078)
2017-05-09 14:58:27: Content type: 1 (15.286204099655, 0.0056130886077881)
2017-05-09 14:58:27: Creating thumb (240x180) (Crop profile: 1) (15.286667108536, 0.00045990943908691)
2017-05-09 14:58:27: Downloading img http://cdn1.ht.thumbnails.pornerbros.co ... 80/15.jpeg (../tmp/1202274/tmp//148614.jpeg) (15.286768198013, 9.7990036010742E-5)
2017-05-09 14:58:27: Dupe check 31e55b44c0ce469ed05f7c0b774dc6f1 (15.296501159668, 0.009735107421875)
2017-05-09 14:58:27: Grab: http://www.pornerbros.com/videos/blonde ... ged_814975 : Looks like we already have this thumb (id: 470303 md5: 31e55b44c0ce469ed05f7c0b774dc6f1), skip... (15.297102212906, 0.00059413909912109)
2017-05-09 14:58:27: Can not create thumb from http://cdn1.ht.thumbnails.pornerbros.co ... 80/15.jpeg () (15.320612192154, 0.02350902557373)
2017-05-09 14:58:27: No thumbs were created (15.320743083954, 0.00012612342834473)
2017-05-09 14:58:27: Cleanup tmp folder ../tmp/1202274 (15.320840120316, 9.4175338745117E-5)
2017-05-09 14:58:27: Deleting gallery (15.321060180664, 0.00022006034851074)
2017-05-09 14:58:27: Delete gallery 1202274 from /var/www/www-root/data/www/domain.com/scj/bin/gallery_grabber.php (15.321102142334, 3.7193298339844E-5)
2017-05-09 14:58:27: Delete gallery content 1202/274 (15.324528217316, 0.003425121307373)
2017-05-09 14:58:27: Processing http://www.pornerbros.com/videos/hot-su ... ean_815363 (1202275) (15.327373027802, 0.0028419494628906)
2017-05-09 14:58:27: Gallery description is empty: Update with 'admin added' (15.32840013504, 0.0010240077972412)
2017-05-09 14:58:27: Updating gallery slug (15.328431129456, 2.7179718017578E-5)
2017-05-09 14:58:27: Content type: 1 (15.337020158768, 0.0085880756378174)
2017-05-09 14:58:27: Creating thumb (240x180) (Crop profile: 1) (15.337503194809, 0.00048017501831055)
2017-05-09 14:58:27: Downloading img http://cdn1.ht.thumbnails.pornerbros.co ... 80/25.jpeg (../tmp/1202275/tmp//964209.jpeg) (15.337602138519, 9.608268737793E-5)
2017-05-09 14:58:27: Dupe check e238ea8eb817d423bfb62b01e0d8a022 (15.350082159042, 0.012480020523071)
2017-05-09 14:58:27: Grab: http://www.pornerbros.com/videos/hot-su ... ean_815363 : Looks like we already have this thumb (id: 470304 md5: e238ea8eb817d423bfb62b01e0d8a022), skip... (15.35452413559, 0.0044379234313965)
2017-05-09 14:58:27: Can not create thumb from http://cdn1.ht.thumbnails.pornerbros.co ... 80/25.jpeg () (15.385823011398, 0.031296968460083)
2017-05-09 14:58:27: No thumbs were created (15.385954141617, 0.00012612342834473)
2017-05-09 14:58:27: Cleanup tmp folder ../tmp/1202275 (15.386034011841, 7.7009201049805E-5)
2017-05-09 14:58:27: Deleting gallery (15.386249065399, 0.0002138614654541)
2017-05-09 14:58:27: Delete gallery 1202275 from /var/www/www-root/data/www/domain.com/scj/bin/gallery_grabber.php (15.386290073395, 3.6954879760742E-5)
2017-05-09 14:58:27: Delete gallery content 1202/275 (15.389685153961, 0.0033941268920898)
2017-05-09 14:58:27: Processing http://www.pornerbros.com/videos/hot-bl ... ock_815493 (1202173) (15.392626047134, 0.002938985824585)
2017-05-09 14:58:27: Gallery description is empty: Update with 'admin added' (15.393681049347, 0.0010519027709961)
2017-05-09 14:58:27: Content type: 1 (15.399324178696, 0.005640983581543)
2017-05-09 14:58:27: Creating thumb (240x180) (Crop profile: 1) (15.39980006218, 0.00047206878662109)
2017-05-09 14:58:27: Downloading img http://cdn1.ht.thumbnails.pornerbros.co ... 80/11.jpeg (../tmp/1202173/tmp//57028.jpeg) (15.399902105331, 9.8943710327148E-5)
2017-05-09 14:58:27: Dupe check e21dac6070d813b8166d5a00ce975ca8 (15.409213066101, 0.0093131065368652)
2017-05-09 14:58:27: Grab: http://www.pornerbros.com/videos/hot-bl ... ock_815493 : Looks like we already have this thumb (id: 470202 md5: e21dac6070d813b8166d5a00ce975ca8), skip... (15.409795999527, 0.00057601928710938)
2017-05-09 14:58:27: Can not create thumb from http://cdn1.ht.thumbnails.pornerbros.co ... 80/11.jpeg () (15.433630228043, 0.023832082748413)
2017-05-09 14:58:27: No thumbs were created (15.433760166168, 0.00012516975402832)
2017-05-09 14:58:27: Cleanup tmp folder ../tmp/1202173 (15.433854103088, 9.1075897216797E-5)
2017-05-09 14:58:27: Deleting gallery (15.434075117111, 0.00022006034851074)
2017-05-09 14:58:27: Delete gallery 1202173 from /var/www/www-root/data/www/domain.com/scj/bin/gallery_grabber.php (15.434116125107, 3.6954879760742E-5)
2017-05-09 14:58:27: Delete gallery content 1202/173 (15.437403202057, 0.0032849311828613)
2017-05-09 14:58:27: Batch done (101) (15.437530040741, 0.00012493133544922)
2017-05-09 14:58:27: No thumbs were created (15.272654056549, 0.00012111663818359)
2017-05-09 14:58:27: Cleanup tmp folder ../tmp/1202273 (15.272733211517, 7.5817108154297E-5)
2017-05-09 14:58:27: Deleting gallery (15.272958993912, 0.00022387504577637)
2017-05-09 14:58:27: Delete gallery 1202273 from /var/www/www-root/data/www/domain.com/scj/bin/gallery_grabber.php (15.273001194, 3.7908554077148E-5)
2017-05-09 14:58:27: Delete gallery content 1202/273 (15.276406049728, 0.0034029483795166)
2017-05-09 14:58:27: Processing http://www.pornerbros.com/videos/blonde ... ged_814975 (1202274) (15.279515028, 0.0031058788299561)
2017-05-09 14:58:27: Gallery description is empty: Update with 'admin added' (15.280588150024, 0.0010700225830078)
2017-05-09 14:58:27: Content type: 1 (15.286204099655, 0.0056130886077881)
2017-05-09 14:58:27: Creating thumb (240x180) (Crop profile: 1) (15.286667108536, 0.00045990943908691)
2017-05-09 14:58:27: Downloading img http://cdn1.ht.thumbnails.pornerbros.co ... 80/15.jpeg (../tmp/1202274/tmp//148614.jpeg) (15.286768198013, 9.7990036010742E-5)
2017-05-09 14:58:27: Dupe check 31e55b44c0ce469ed05f7c0b774dc6f1 (15.296501159668, 0.009735107421875)
2017-05-09 14:58:27: Grab: http://www.pornerbros.com/videos/blonde ... ged_814975 : Looks like we already have this thumb (id: 470303 md5: 31e55b44c0ce469ed05f7c0b774dc6f1), skip... (15.297102212906, 0.00059413909912109)
2017-05-09 14:58:27: Can not create thumb from http://cdn1.ht.thumbnails.pornerbros.co ... 80/15.jpeg () (15.320612192154, 0.02350902557373)
2017-05-09 14:58:27: No thumbs were created (15.320743083954, 0.00012612342834473)
2017-05-09 14:58:27: Cleanup tmp folder ../tmp/1202274 (15.320840120316, 9.4175338745117E-5)
2017-05-09 14:58:27: Deleting gallery (15.321060180664, 0.00022006034851074)
2017-05-09 14:58:27: Delete gallery 1202274 from /var/www/www-root/data/www/domain.com/scj/bin/gallery_grabber.php (15.321102142334, 3.7193298339844E-5)
2017-05-09 14:58:27: Delete gallery content 1202/274 (15.324528217316, 0.003425121307373)
2017-05-09 14:58:27: Processing http://www.pornerbros.com/videos/hot-su ... ean_815363 (1202275) (15.327373027802, 0.0028419494628906)
2017-05-09 14:58:27: Gallery description is empty: Update with 'admin added' (15.32840013504, 0.0010240077972412)
2017-05-09 14:58:27: Updating gallery slug (15.328431129456, 2.7179718017578E-5)
2017-05-09 14:58:27: Content type: 1 (15.337020158768, 0.0085880756378174)
2017-05-09 14:58:27: Creating thumb (240x180) (Crop profile: 1) (15.337503194809, 0.00048017501831055)
2017-05-09 14:58:27: Downloading img http://cdn1.ht.thumbnails.pornerbros.co ... 80/25.jpeg (../tmp/1202275/tmp//964209.jpeg) (15.337602138519, 9.608268737793E-5)
2017-05-09 14:58:27: Dupe check e238ea8eb817d423bfb62b01e0d8a022 (15.350082159042, 0.012480020523071)
2017-05-09 14:58:27: Grab: http://www.pornerbros.com/videos/hot-su ... ean_815363 : Looks like we already have this thumb (id: 470304 md5: e238ea8eb817d423bfb62b01e0d8a022), skip... (15.35452413559, 0.0044379234313965)
2017-05-09 14:58:27: Can not create thumb from http://cdn1.ht.thumbnails.pornerbros.co ... 80/25.jpeg () (15.385823011398, 0.031296968460083)
2017-05-09 14:58:27: No thumbs were created (15.385954141617, 0.00012612342834473)
2017-05-09 14:58:27: Cleanup tmp folder ../tmp/1202275 (15.386034011841, 7.7009201049805E-5)
2017-05-09 14:58:27: Deleting gallery (15.386249065399, 0.0002138614654541)
2017-05-09 14:58:27: Delete gallery 1202275 from /var/www/www-root/data/www/domain.com/scj/bin/gallery_grabber.php (15.386290073395, 3.6954879760742E-5)
2017-05-09 14:58:27: Delete gallery content 1202/275 (15.389685153961, 0.0033941268920898)
2017-05-09 14:58:27: Processing http://www.pornerbros.com/videos/hot-bl ... ock_815493 (1202173) (15.392626047134, 0.002938985824585)
2017-05-09 14:58:27: Gallery description is empty: Update with 'admin added' (15.393681049347, 0.0010519027709961)
2017-05-09 14:58:27: Content type: 1 (15.399324178696, 0.005640983581543)
2017-05-09 14:58:27: Creating thumb (240x180) (Crop profile: 1) (15.39980006218, 0.00047206878662109)
2017-05-09 14:58:27: Downloading img http://cdn1.ht.thumbnails.pornerbros.co ... 80/11.jpeg (../tmp/1202173/tmp//57028.jpeg) (15.399902105331, 9.8943710327148E-5)
2017-05-09 14:58:27: Dupe check e21dac6070d813b8166d5a00ce975ca8 (15.409213066101, 0.0093131065368652)
2017-05-09 14:58:27: Grab: http://www.pornerbros.com/videos/hot-bl ... ock_815493 : Looks like we already have this thumb (id: 470202 md5: e21dac6070d813b8166d5a00ce975ca8), skip... (15.409795999527, 0.00057601928710938)
2017-05-09 14:58:27: Can not create thumb from http://cdn1.ht.thumbnails.pornerbros.co ... 80/11.jpeg () (15.433630228043, 0.023832082748413)
2017-05-09 14:58:27: No thumbs were created (15.433760166168, 0.00012516975402832)
2017-05-09 14:58:27: Cleanup tmp folder ../tmp/1202173 (15.433854103088, 9.1075897216797E-5)
2017-05-09 14:58:27: Deleting gallery (15.434075117111, 0.00022006034851074)
2017-05-09 14:58:27: Delete gallery 1202173 from /var/www/www-root/data/www/domain.com/scj/bin/gallery_grabber.php (15.434116125107, 3.6954879760742E-5)
2017-05-09 14:58:27: Delete gallery content 1202/173 (15.437403202057, 0.0032849311828613)
2017-05-09 14:58:27: Batch done (101) (15.437530040741, 0.00012493133544922)
Last edited by Moss on Tue May 09, 2017 3:59 pm, edited 1 time in total.
Re: Active To grab
Так пишет же про дупы в логGrab: http://www.pornerbros.com/videos/blonde ... ged_814975 : Looks like we already have this thumb (id: 470303 md5: 31e55b44c0ce469ed05f7c0b774dc6f1), skip..е
Don't forget to run script update