I'm having some problems with the software that syncs images from the server that handles the uploaded files to the 2 primary servers that generate the forum pages. I'm manually running a re-sync now from the master server to the 2 slaves. This should fix it. The sync could take a few hours. There's about 200GB of data. I've been working on generating alternate versions of images for browsers that specify that they want to save data. And I'm generating 100 x 100 thumbnails for all 475k images on the server to support the site redesign that's in-process.
Broken images in topics
Страница: 1
Сообщений 1 страница 15 из 15
Поделиться2Сб 21:03:49
Thanks for the notification.
Поделиться3Сб 21:03:56
There's a little over 2.8 million files that need to be synced up. Each image that's uploaded can end up being processed into to 6 to 10 different images depending on the height x width of the original. This will take a while. I'm guessing 7 or 8 hours.
Поделиться4Сб 21:04:03
The full re-sync has been running almost 9 hours and is 46 percent complete at the moment.
added:
11.5 hours into it and the process is at 76%.
Поделиться5Сб 21:04:09
This problem should be fixed now.
Отредактировано Story (Сб 21:04:13)
Поделиться6Сб 21:04:38
Yep, looks like it. Thanks again!
Поделиться7Сб 21:04:45
Hi Drew. It may be acting up again. A pic I posted in the Remy Lacroix ADT Thread didn't post.
Поделиться8Сб 21:05:34
Yep, I can see it made it to one of the 2 replication servers. I've started a manual replication again to re-sync everything.
Поделиться9Сб 21:05:47
Thank you Drew.
Поделиться10Сб 21:05:58
It will likely take about an hour to 90 mins. 12% done now.
Поделиться11Сб 21:06:03
The folder that stores the image uploads is getting too large for the synchronizing process to copy the files quickly. The sync used to take about 8 to 10 seconds top copy a dozen or so files. Not it's taking 1:30 to 2 mins. I added some behind the scenes features recently to support mobile browsers that use the "Data Saver" option. It doubled the number of images on the server.
I will get to work on fixing this on Sunday. I'll split up the folders into something more manageable for the synchronizing software. There will be some period where images are broken as I move data around.
Поделиться12Сб 21:06:10
I'm working on a plan to permanently fix this issue. It's going to involve updates to every page and background that deals with uploaded images. It's going to take a few days to implement. I have tested the sync process I plan to use with the new system and it runs in 8 to 10 seconds which should be sufficient.
Поделиться13Сб 21:06:17
I'm testing the program that restructures the storage paths. Trying to get a feel for how long this will take to reshuffle things into smaller bins.
Поделиться14Сб 21:06:24
The restructuring of user uploads should be complete. I need to do some more testing and monitoring but things appear OK.
The old system had everything in 1 "bin" for syncing to the other servers. I've set it up so there are 99 bins each with a subset of user's uploaded files. The syncing should complete within 10 seconds now.
Поделиться15Ср 15:48:24
Sorry, but it's broken again. The "Favorite Big Natural Breasts" and "Perfect fake tits - pornstars, models and studios" are 2 examples.
Страница: 1
