Site with big db

happydg
Posts: 368
Joined: Mon Jul 08, 2013 2:22 pm

Site with big db

Post by happydg » Mon Jul 23, 2018 2:02 pm

Hello,

I would like to run a tube like nudevista.com with a dozen millions of videos and 10 thumbs each.

The problem with smartcj if you have millions of galleries is the database weight a lot of gigabytes and even big servers can't handle it.

I want to add 10 thumbs per gallery ( just for mouseover like nudevista.com ) but don't want to have stats for those 10 thumbs, just the main thumb.

Could you please add an option to only have stats for 1 main thumb even if i import 10 thumbs per gallery?

So the database would be 10 times smaller.

Thank you.

admin
Site Admin
Posts: 25849
Joined: Wed Sep 10, 2008 11:43 am

Re: Site with big db

Post by admin » Wed Jul 25, 2018 12:41 pm

Ok, here's what we can do if you don't want to add any extra info into the DB

1. update script

2. when import - add all extra thumbs into the field called 'User thumbs'

3. when gallery_grabber.php processes those galleries it will grab all extra thumbs and save it into the folder called /user_thumbs/gallery_id/..
so if grabber settings - PATH to data = /home/user/domain.com/thumbs/ - then those user thumbs will be saved as (for example)
/home/user/domain.com/thumbs/user_thumbs/123/456/1.jpg /home/user/domain.com/thumbs/user_thumbs/123/456/2.jpg and so on

4. in your template you can get a path to the folder as <!--USER_THUMBS_FOLDER-->

Note, that as we don't have any info about those thumbs in DB - we don't know how many thumbs there are, so you basically have 2 options

1. add 10 thumbs exactly for each gallery and then in your JS thumb rotation script roll thru 10 thumbs for each gallery
or
2. in your JS thumb rotation script preload rotation thumbs to detect how many you actually have

Anyway, as you wanted it - script saves those thumbs and adds no additional info into the DB.

Please, lemme know if you have any issues w it.
Have you done script update ?

happydg
Posts: 368
Joined: Mon Jul 08, 2013 2:22 pm

Re: Site with big db

Post by happydg » Tue Aug 07, 2018 3:41 pm

Hello,

I Added for example:

Custom Var|thumb|URL|Desc|Tags|Model|User thumbs

But when i check in the thumbs folder there is no user_thumbs folder. The gallery is active and the main thumb is added though.

admin
Site Admin
Posts: 25849
Joined: Wed Sep 10, 2008 11:43 am

Re: Site with big db

Post by admin » Wed Aug 08, 2018 11:35 am

send me admin area and an import string plz, i'll check it
Have you done script update ?

happydg
Posts: 368
Joined: Mon Jul 08, 2013 2:22 pm

Re: Site with big db

Post by happydg » Wed Aug 08, 2018 1:44 pm

Pm sent.

admin
Site Admin
Posts: 25849
Joined: Wed Sep 10, 2008 11:43 am

Re: Site with big db

Post by admin » Wed Aug 08, 2018 1:57 pm

I don't see it ..
Have you done script update ?

happydg
Posts: 368
Joined: Mon Jul 08, 2013 2:22 pm

Re: Site with big db

Post by happydg » Wed Aug 08, 2018 2:06 pm

I resent it.

happydg
Posts: 368
Joined: Mon Jul 08, 2013 2:22 pm

Re: Site with big db

Post by happydg » Thu Aug 09, 2018 3:21 pm

The problem with this solution is there must be two columns with thumbs: thumb|userthumbs

All the big csv provided by tubes like xhamster only have one column with all thumbs. And edit a 4gb csv file is really complicated.

An option to add first thumb as main thumb and also all thumbs ( including first thumb ) as user thumbs would be easier.

Thank you.

admin
Site Admin
Posts: 25849
Joined: Wed Sep 10, 2008 11:43 am

Re: Site with big db

Post by admin » Thu Aug 09, 2018 4:47 pm

Ok, fixed
now you can add as

URL|user thumbs

How Many Thumbs from each gallery ? = X

and script will take X thumbs from user_thumbs
Have you done script update ?

happydg
Posts: 368
Joined: Mon Jul 08, 2013 2:22 pm

Re: Site with big db

Post by happydg » Mon Aug 13, 2018 1:14 pm

I updated to latest version but it doesn't seem to work correctly if i Don't add a thumb column.

If i add only a user thumbs column, it creates the user thumbs but not the "stats thumb".

I did put 1 as How Many Thumbs from each gallery

Post Reply