> New Feature: Resample Archives, Itty bitty

 
post Aug 5 2016, 18:09
Post #21
Tenboro

Admin




Resample Archives

The archiver can now also be used to download the 1280 horizontal resolution resamples that are used by default on the site. Initially, this is limited to galleries that have 25% or more resampled files at this resolution.

Because of these changes, clicking on the Archive Download button for an archive you have previously unlocked will now take you to the archive selector instead of straight to the archive link, unless you have selected Auto Select Original or Auto Select Resample under My Settings.


Retired H@H Downloader

Since the archiver is now capable of generating a download with resampled files, the H@H Downloader has been retired. The addition of static ranges has made that suboptimal, and with resampled archives it also no longer has a unique function. Therefore, it has instead been replaced with a free archiver quota. (See below)


Donation/H@H Archiver Quotas

The old free archiver downloads for donators was changed from a fixed number of archives to use a quota based on archiver size. This also allows us to use this system for people who run H@H, to replace the retired H@H Downloader system.

For donators, each free archive from the old system now instead adds +50MB/day to the archiver quota. Tiers above gold were changed from +5 (250 MB/day) to +10 (500 MB/day) per tier. (See; Donation Archiver Quota in the MFP section below)

For people who run H@H, the archiver quota is now increased by +1000 MB/day for running at least one qualifying client, in addition to +10 MB/day per total adjusted avghit. H@H clients will only qualify if they have been running for more than 24 hours and have a hitrate of at least 1. (See; H@H Archiver Quota in the MFP section below)

Like the old system, the "daily" quota is measured over a 7-day window. You can spend up to 7 days worth of quota in a day, but you would obviously then have to wait a week for it to cool down.


Math For Pedants

Whenever we change from one system to another, there is always a heated discussion about the exact numbers used, so I pasted in the math and reasoning used below.

Donation Archiver Quota:

Average archive size calculated from 77215 files for a total of 3775 GB cached on one archiver:
3775 * 1024 / 77215 = 50.06 MB

H@H Archiver Quota:

Average size per resampled 1280x file sampled from a million files = 199156 bytes
Old H@H downloader rate was limited by each individual client's average hitrate, at floor(1 + avghits/25) files per minute, capped to 5
This gives 199156 bytes per minute per avghits/25 for 10.94 MB/day per avghit, plus 273.5 MB/day per client
Hard cap per client was removed. We instead calculate a global adjusted avghits from the sum of avghits for all clients on the account, set as min(avghits, log(1.003 + (avghits / 200), 1.003))
This is effectively a soft cap, linear up to about 300 avghits, increasing to ~600 at 1000 avghits and ~800 at 2000 avghits.
User is offlineProfile CardPM
Report PostGo to the top of the page
+Quote Post


Posts in this topic
Tenboro   New Feature: Resample Archives   Aug 5 2016, 18:09
rawrpies   Explains why I couldn't find the H@H download ...   Aug 5 2016, 18:13
Tenboro   [quote name='rawrpies' post='4562698' date='Aug 5 ...   Aug 5 2016, 18:19
preaction   This is great, but I run the H@H on my home comput...   Aug 5 2016, 18:59
rodrick   [quote name='preaction' post='4562732' date='Aug 5...   Aug 5 2016, 19:46
Tenboro   [quote name='rodrick' post='4562780' date='Aug 5 2...   Aug 5 2016, 20:03
rodrick   [quote name='Tenboro' post='4562788' date='Aug 5 2...   Aug 5 2016, 20:17
Tenboro   [quote name='rodrick' post='4562803' date='Aug 5 2...   Aug 5 2016, 20:22
rodrick   [quote name='Tenboro' post='4562806' date='Aug 5 2...   Aug 5 2016, 20:36
Tenboro   [quote name='rodrick' post='4562819' date='Aug 5 2...   Aug 5 2016, 21:01
mikehawk1   [quote name='Tenboro' post='4562851' date='Aug 5 2...   Aug 6 2016, 11:51
rodrick   [quote name='WuvviDuvvi' post='4563123' date='Aug ...   Aug 6 2016, 15:35
blue penguin   [quote name='Tenboro' post='4562694' date='Aug 5 2...   Aug 5 2016, 19:05
Tenboro   [quote name='preaction' post='4562732' date='Aug 5...   Aug 5 2016, 19:23
blue penguin   [quote name='rodrick' post='4562819' date='Aug 5 2...   Aug 5 2016, 21:27
WuvviDuvvi   [quote name='blue penguin' post='4562863' date='Au...   Aug 6 2016, 02:37
tiap   Can you add the size (or an approximation thereof)...   Aug 5 2016, 22:15
blue penguin   [quote name='tiap' post='4562900' date='Aug 5 2016...   Aug 5 2016, 22:33
Tenboro   [quote name='blue penguin' post='4562915' date='Au...   Aug 5 2016, 22:47
Fudo Masamune   So.. Is there any way to see the remaining quota I...   Aug 6 2016, 00:12
Scremaz   [quote name='rawrpies' post='4562698' date='Aug 5 ...   Aug 6 2016, 02:02
zxwecrt   The old system was a lot more fire and forget. Wha...   Aug 6 2016, 02:42
Chunga   Maybe I misunderstanding something, but are the H@...   Aug 6 2016, 02:49
WindWT   [quote name='Chunga' post='4563143' date='Aug 6 20...   Aug 6 2016, 07:02
cs987987   can show the Resampled Gallery Size in the archive...   Aug 6 2016, 05:46
kmplayer0   [quote name='Tenboro' post='4562694' date='Aug 6 2...   Aug 6 2016, 09:51
bota_nik   So uncomfortable ... :(   Aug 6 2016, 13:01
Luna_Flina   To people complaining about the changes: Let...   Aug 6 2016, 14:51
djagito   I'd rather have the old system back, this was ...   Aug 6 2016, 15:26
Tenboro   If you read the thread about removing the H@H Down...   Aug 6 2016, 16:31
rodrick   OK, I guess I'll need to search for another au...   Aug 6 2016, 16:59
zxwecrt   I never used the old archive system. I download r...   Aug 6 2016, 17:06
blue penguin   [quote name='rodrick' post='4563784' date='Aug 6 2...   Aug 6 2016, 18:24
rodrick   [quote name='blue penguin' post='4563995' date='Au...   Aug 6 2016, 23:04
aiwotorimodose   [quote name='Tenboro' post='4562694' date='Aug 5 2...   Aug 6 2016, 20:36
moonflow   Since I've never used up my freebies, I have ...   Aug 6 2016, 23:07
blue penguin   [quote name='rodrick' post='4564222' date='Aug 6 2...   Aug 6 2016, 23:17
rodrick   [quote name='blue penguin' post='4564232' date='Au...   Aug 7 2016, 00:51
karyl123   YES YES YES YES THANKYOU !!!!...   Aug 7 2016, 01:55
FrogLog   Nice   Aug 7 2016, 06:59
SeaGrace   Who uses H@H at what point begins a free download ...   Aug 7 2016, 11:57
Maximum_Joe   [quote name='SeaGrace' post='4564765' date='Aug 7 ...   Aug 7 2016, 14:12
G Just G   Will Galleryinfo.txt files be coming back? They we...   Aug 7 2016, 13:38
Dander19   For anyone else that was mildly confused, if you h...   Aug 7 2016, 16:18
Tenboro   Some more improvements; - The archiver is now als...   Aug 7 2016, 18:26
Chunga   [quote name='Tenboro' post='4565049' date='Aug 7 2...   Aug 7 2016, 20:36
dis astranagant   [quote name='Tenboro' post='4565049' date='Aug 7 2...   Aug 8 2016, 07:30
karyl123   [quote name='dis astranagant' post='4565619' date=...   Aug 8 2016, 12:33
Tenboro   [quote name='karyl123' post='4565766' date='Aug 8 ...   Aug 8 2016, 14:45
karyl123   [quote name='Tenboro' post='4565846' date='Aug 8 2...   Aug 9 2016, 14:02
dlactionn   I'm always amused at how this site does things...   Aug 8 2016, 00:48
mathwizi2005   My only confusion is that the Downloader was disab...   Aug 8 2016, 05:02
PoohTheBear   good   Aug 8 2016, 15:00
blue penguin   Tenb, once upon a time I did some image stats on m...   Aug 8 2016, 18:26
Tenboro   [quote name='blue penguin' post='4566011' date='Au...   Aug 8 2016, 21:03
Jagmyre   What happens to the galleries whose hathdls we...   Aug 9 2016, 08:01
dis astranagant   [quote name='Jagmyre' post='4566538' date='Aug 9 2...   Aug 9 2016, 08:23
tetron   Cool. Now @TenB, please answer this question:[quot...   Aug 9 2016, 12:42
Tenboro   [quote name='Jagmyre' post='4566538' date='Aug 9 2...   Aug 9 2016, 15:07
Jay Low   How can I use the API to create the galleryinfo.tx...   Aug 9 2016, 20:57
Applejacku   Where do I put the file after I download it with a...   Aug 9 2016, 22:34
blue penguin   [quote name='Jay Low' post='4567042' date='Aug 9 2...   Aug 9 2016, 23:02
tetron   [quote name='Tenboro' post='4566797' date='Aug 9 2...   Aug 10 2016, 11:09
TennoujiSaburou   I just noticed the update today. I want to ask sin...   Aug 10 2016, 19:19
Tenboro   [quote name='tetron' post='4567649' date='Aug 10 2...   Aug 10 2016, 23:59
hzqr   https://gist.github.com/anonymous/d7c995536...b2f6...   Aug 11 2016, 01:21
G Just G   VBScript to call the API - prompts for Gallery ID ...   Aug 12 2016, 15:32
mathwizi2005   I'd still like to add new releases to my cache...   Aug 12 2016, 20:59
Tenboro   [quote name='mathwizi2005' post='4569924' date='Au...   Aug 12 2016, 21:01
mathwizi2005   Still doesn't solve my issue of a lack of the ...   Aug 13 2016, 01:27
Tenboro   [quote name='mathwizi2005' post='4570082' date='Au...   Aug 13 2016, 01:52
blue penguin   [quote name='mathwizi2005' post='4570082' date='Au...   Aug 13 2016, 01:50
Jay Low   I've been trying to find this but I'm real...   Aug 13 2016, 10:45
EsotericSatire   [quote name='Tenboro' post='4562694' date='Aug 5 2...   Aug 14 2016, 03:35
tongkai   Update always good, but I'm the one who miss t...   Aug 16 2016, 12:21
lollos   tenboro, any chance to reintroduce h@h (hathdl fil...   Aug 17 2016, 17:22
Tenboro   [quote name='lollos' post='4574556' date='Aug 17 2...   Aug 18 2016, 00:42
Maximum_Joe   The proxy still exists.   Aug 18 2016, 00:07
EsotericSatire   Lord Tenboro, can we get 50mb download limit per a...   Aug 18 2016, 14:28
Tenboro   [quote name='EsotericSatire' post='4575298' date='...   Aug 18 2016, 18:46
EsotericSatire   [quote name='Tenboro' post='4575470' date='Aug 18 ...   Aug 20 2016, 05:53
Amalyne   How strict is this thing with the 24 hour thing an...   Aug 19 2016, 04:58
Tenboro   [quote name='Amalyne' post='4575815' date='Aug 19 ...   Aug 19 2016, 14:49
karyl123   [quote name='Tenboro' post='4576133' date='Aug 19 ...   Aug 20 2016, 03:21
Amalyne   [quote name='Tenboro' post='4576133' date='Aug 19 ...   Aug 20 2016, 03:56
Nataniel   Well, now I found out where did the H@HDL link go....   Aug 19 2016, 12:42
Maximum_Joe   [quote name='Nataniel' post='4576074' date='Aug 19...   Aug 19 2016, 15:16
Tenboro   [quote name='karyl123' post='4576599' date='Aug 20...   Aug 20 2016, 16:56
Maximum_Joe   [quote name='Tenboro' post='4577209' date='Aug 20 ...   Aug 20 2016, 19:28
Tenboro   [quote name='Maximum_Joe' post='4577342' date='Aug...   Aug 20 2016, 20:56
Amalyne   [quote name='Tenboro' post='4577398' date='Aug 20 ...   Aug 28 2016, 21:47
Jay Low   Tenboro, how do I do partial gallery downloads? I....   Aug 20 2016, 19:40
Maximum_Joe   [quote name='Jay Low' post='4577351' date='Aug 20 ...   Aug 20 2016, 20:01
Jay Low   [quote name='Maximum_Joe' post='4577367' date='Aug...   Aug 20 2016, 20:34
lollos   "H@H Archiver Quota: 1010 MB / day. This valu...   Aug 23 2016, 08:28
Jay Low   My H@H client tells me it is on for more than 24h ...   Aug 23 2016, 21:44
Maximum_Joe   Is it actually doing anything?   Aug 24 2016, 02:21
Jay Low   It is. It is receiving requests and it is showing ...   Aug 24 2016, 19:50
Jay Low   [quote name='Maximum_Joe' post='4580630' date='Aug...   Aug 28 2016, 15:17
Maximum_Joe   I mean, what's the hitrate? Total bytes sent?   Aug 28 2016, 15:43
2 Pages V  1 2 >


Closed TopicStart new topic
1 User(s) are reading this topic (0 Guests and 0 Anonymous Users)
1 Members: Ahappyzyj1

 


Lo-Fi Version Time is now: 5th January 2023 - 02:47