Php photo gallery TWG | JFUploader | TWG Flash upload | WFU | Forum

I made the site to catalogue the worst of pornography and to ruin an individual's childhood, one memory at a time. I've got a rudamentary system in place for a user to register, and upload their own files as well, and the gallery is free to browse, and save all pictures on it.

I'm going to push the limits of this system, as in finality, it should reach approximately 100,000 files, or more, and have a grand total of about 35 gigabytes worth of pictures files.

*Disclaimer: site contains both animated, and live action pornographic images, viewer discresion is advised.

Check the dev build once in a while - I have optimized the gallery especially for large galleries.
Especially the topx will be much faster there . Right now only the 1st level is cached - but I will extend this till the final to more levels.

I think you will like the new 1 | 2 | 3 - because it's now optimized - for e.g 30 pages it's shown like 1 | 2 | 3 | 4 | 10 | 20 | 30

/Michael

I saw that the 1.7 was in release 3, well done!

I'm thinking about installing the latest release before I do the massive 100,000 file upload.

I'm just dreading watching the cache go forever, and ever. I'm going to HAVE to make it go faster, because I can't just sit around and wait for half a second at a time for all those images to cache. ... or are the cached files transferrable? hmm.. I image they would be, so long as I transfer the xml files along with it, it should work out alright.

And yea, as it is right now, for some reason the "top X" aren't working for top level categories, only on sub categories will it display them.

I have seen this with the topx - I don't know why this can happen - I would have to debug this.

About the update - yes - you can simply copy the whole cache and even the xml folder. you only have to set the permissions right again.

Have you read the howto about optimization for speed? I would actually recommend to show only one image and not a collage. You have only 1/4 th of the traffic on the folder pages.

do you have access to your log files? because below your 1st big folder the images cannot be shown (where 3400 images are in). Another user had this problem too with big folder over 1000 images - But I have a folder with 3000 images as well but no problems at all.

/Michael

Nah, actually, I hadn't read the optimization guide.. had been considering seeking out other things to improve load times, but it wasn't that high of a priority as much as me trying to gather as much content as possible.

As it is, it's running about as I'd of expected, and am please with it's current performance. I'm the kind of person that refrains from tinkering if I don't think I have as much to gain, as I do to lose.

<.<;;

any you should disable the preloading of xml - The problem is that is uses a lot of memory. And you have big folders = big xml files.

Once you don't have enough memory to load the xml files the folder cannot displayed anymore. The "problem" of xml is that is uses a lot of space while parsing xml files. i'll try to get a linux box installed at home because my windows dev. system does ignore the memory limit and therefore I never run i nthis problem at home - and on my servers in the web I don't have access to the config and log files I would need.

Therefore I think you should try not to have folders with too many images (I don't have a number yet - have to try on the linux system first)- many folders are no problem.

/Michael

I would think that the number of files you would need (or the size of the .xml file) that would create a noticible speed loss would have to be pretty high, in the millions, or something.

I tried to find the .xml file that stores the data for the main folder, but my ftp broswer limits the returned results to like 2000 files, or some such, so I can't locate it. But I wouldn't think it'd encounter a problem until the file exceeded ... oh wait... now I see.

It does an initial load doesn't it, that's why the site bogs for the user in the first moments upon entering the site, but doesn't bog later on..?

I do a lot of caching in the beginning - and in 1.7 I move this caching more and more to the 1 day cache (temp files that are only valid for one day). Then only the first user a day has to wait a little but the others can browse without almost no delay.
My 1st page does now load in 1-2 sec instead of 7 before . the counting of the images at the beginning takes some time - once this is done and cached ...

the xml is in the xml folder. There shoudn't be more than 2000 files. (3-4 files for one folder)
it would be interesting to get the file of the 1st big folder.
should start with the album name. try to sort it by size.

I have right now a folder with 4500 images on my testsystem. I'm currently have a deamon browsing it that the view xml is generated to the max. Right now it has ~ 500 kb and every thing is still working fine.

/Michael

Am I the only one that has a problem when using an ftp server that it cuts off before reaching the total number of files..?

I swear, it'll only read files up to the letter "B" then will time out or something.

Did you want the "Image_counter.xml" file for that directory?

edit: the image counter for the main picture folder is 386Kb

yes. should be one of the biggest files .

about the limit - maybe you have set a limit at your ftp software?

and if you rename this file - does the folder than work again?

/Michael

Actually, there really isn't a single folder that houses that many images, I think the main folder houses around 2000 files, but ... wait, I just need to do a little math.

...

the singularly largest image folder has 3484 files in it currently, the remainder of the rest are already pre-sorted into different subfolders

The one with the 3484 can be displayed? because when was at your site this one was not working - the other ones are fine.

/Michael

Yes, it's always been able to be displayed, the main folder is behind the "Rule 34" button, followed by three additional folders

Rule 34 (3484 in folder) (33446 total)

-->Animated Gifs (84)

-->Mangas (27112)
---->bajillions of folder

-->Galleries (2766)
----> around 10-20 folders

i'm talkin about this folder

#removed_broken_linkindex ... 3267370104

click on an image (not a folder). Only the breadcrumb is displayed - this normally is the case if the xml is loaded and fail because php suddendly crashes (maybe memory).

This is why I wanted to see the counter xml of this folder.

/Michael