Page 2 of 3

Re: Import Big CSV

Posted: Tue Aug 09, 2016 11:49 am
by admin
I think you cut most of it testing w\o &test parameter
Try again plz to see if the issue persists.

Re: Import Big CSV

Posted: Tue Aug 09, 2016 3:44 pm
by happydg
1) If i readd the same csv which already added galleries, will it check for duplicate galleries in sets?

2) Do i need to create a cut.php and tmp.file per csv or i can use the same for all csv files?

Thank you.

Re: Import Big CSV

Posted: Tue Aug 09, 2016 9:38 pm
by admin
1. yes
2. You can use the same

Re: Import Big CSV

Posted: Sat Aug 13, 2016 5:22 pm
by happydg
In rotation - import, how to set more time before it times out after importing gals?

Re: Import Big CSV

Posted: Sun Aug 14, 2016 7:43 am
by admin
No way, it depends on browser
Add it as importset

Re: Import Big CSV

Posted: Mon Sep 19, 2016 2:22 pm
by happydg
I did multiple tests with this script.

1) It's not a good idea to use the same tmp.file and cut.php for all sets. At some point, it will mix galleries and you will end up with xhamster galleries in pornsharing csv...

2) This script has a bug. For example i had a dump with 60K galleries. This dump went to 0kb ( the tmp file also ) but only imported 20k galleries. About the same problem with xhamster dump. It magically went from 1500mb to 29mb dump file in one update set but when i check my xhamster galleries it only has 70k galleries. At this point the dump file should be at at least 1300mb.

Re: Import Big CSV

Posted: Tue Sep 20, 2016 5:22 am
by admin
1. yes, a new feature was added to the nest version to import large bumps w\u cut.php

2. The script is just 5 lines long and really easy to understand I think ..
There's no place to make a mistake
most likely you\some other scripts\whatever runs cut.php at the same time

Re: Import Big CSV

Posted: Tue Sep 20, 2016 11:40 am
by happydg
1. I updated script to latest version. Could you please let me know where this new feature is?

Thank you.

Re: Import Big CSV

Posted: Tue Sep 20, 2016 5:28 pm
by admin
Last version is branch 2, not 1.x

Re: Import Big CSV

Posted: Tue Sep 20, 2016 5:55 pm
by happydg
What ssh command to run this upgrade?