> Frontend server migration

 
post Nov 11 2020, 12:36
Post #21
Tenboro

Admin




We will be migrating various frontend services to a set of shiny new servers* over the next several days. This post will be updated as the various stuff is moved.

If you encounter any new issues after the moves, please post about it here.


2020-11-11

- Thumbnails and static content has been (mostly) migrated.

The primary thumbnail servers now have a lot more capacity and all storage is now local, which means they no longer have to fetch any content from backend servers. This simplifies things a lot, and also improves performance.

Full IPv6 support has also been added for this.


2020-11-12

- Redirected all the remaining thumbnail server dependencies.

- Restored failover functionality for the bits that haven't had it since last summer.


2020-11-16

- The RPC/API frontends and failovers have been swapped over. (These are used for AJAX/inline loading requests.)


2020-11-17

- The main EH frontends and failovers have been swapped over.

This completes the migration from the old frontends, but there are still a couple of other services (archiving and the tracker) that will be moved.


2020-11-19

- The new archive servers have gone live.

The new archivers have both HTTPS and IPv6 support, and also have an order of a magnitude more bandwidth available.

Note that previously generated archives will still be served from the old servers for some time.

(While the available bandwidth is much larger, it is also shared with the rest of the frontend services in the new setup, so we may add a restriction that free downloads are not available around the peak traffic hours (at least during weekends) - this is however not currently active.)


2020-11-23

- The new tracker servers are now live.

The new trackers also add IPv6 support both on the network as well as on the tracker software itself, and should (hopefully) comply with the spec in [bittorrent.org] BEP7.

(Update: There were some issues with stats gathering after the update due to some changes in default behavior in new versions of underlying software, this should be fixed now.)

This completes the deployment of the new frontends, at least for now.


2020-11-29

- The old archiver servers have now been fully phased out.


* For the technically minded, there are four new physical servers that run 12 VMs each, with the following specs:

Dual Xeon Gold 5118
192 GB RAM
6 TB SSD storage
36TB HDD storage
10 Gbps uplinks
User is offlineProfile CardPM
Report PostGo to the top of the page
+Quote Post


Posts in this topic
Tenboro   Frontend server migration   Nov 11 2020, 12:36
darkknightx2   I feel this site like a home for me... thankyou ...   Nov 11 2020, 16:21
moonflow   Wow, didn't expect that many changes in such a...   Nov 11 2020, 16:29
hellweekdays   Nice work!   Nov 11 2020, 17:27
Shana   Great work!   Nov 11 2020, 17:35
blue penguin   Ooooh, it explains the long DNS waits I'm gett...   Nov 12 2020, 02:02
lestion   [quote name='Tenboro' post='5795877' date='Nov 11 ...   Nov 12 2020, 02:07
Tenboro   [quote name='lestion' post='5796276' date='Nov 12 ...   Nov 12 2020, 10:01
Drawer L   Nice work!   Nov 12 2020, 16:26
Forth_Lancer   Just wondering, where the money comes from... :D   Nov 12 2020, 23:56
Tenboro   [quote name='Forth_Lancer' post='5796925' date='No...   Nov 13 2020, 11:34
DDavid   [quote name='Tenboro' post='5797252' date='Nov 13 ...   Nov 14 2020, 04:53
TkzcM   [quote name='Tenboro' post='5797252' date='Nov 13 ...   Nov 18 2020, 14:22
NerfThis   wow   Nov 14 2020, 15:38
nasu_sensei   [quote name='Tenboro' post='5795877' date='Nov 11 ...   Nov 17 2020, 18:16
Wayward_Vagabond   It's been said before, but thanks Tenboro, for...   Nov 17 2020, 20:37
derpderp2   thanks for all the work tenboro :)   Nov 22 2020, 17:12
Tenboro   As mentioned in the updated first post, the archiv...   Nov 23 2020, 15:15
uareader   I don't know what happened, but something is w...   Nov 28 2020, 01:13
nasu_sensei   [quote name='uareader' post='5805466' date='Nov 27...   Nov 28 2020, 01:24
POTATO47784   do this move has any relation with coonection issu...   Nov 28 2020, 13:47
Mayriad   [quote name='POTATO47784' post='5805813' date='Nov...   Nov 28 2020, 13:52
Grandmasters   Thanks for your great work. Maybe it has nothing t...   Nov 28 2020, 21:16
Zxion   Nice work   Nov 29 2020, 12:55
forneus_zero   Cool, can we get the updated version of Anatomy of...   Nov 29 2020, 21:44
Robin235   I've been unable to access to the gallery sinc...   Nov 30 2020, 20:27
Mayriad   [quote name='Robin235' post='5807247' date='Nov 30...   Nov 30 2020, 23:34
Ryan WolF Thepram   past moth i notice a long page load time now its w...   Dec 10 2020, 02:20
The Muhka   I'm still unable to access the webpage. I get ...   Dec 23 2020, 14:41
TheRealYooJohn2   Just wanted to say thanks   Jan 10 2021, 16:13
George C.Barnes   Great :D   Jan 18 2021, 10:48
ssadff   thanks for all the work :)   Jan 23 2021, 11:26
Lostlight4   Thank you for the info   Jan 25 2021, 04:57


Closed TopicStart new topic
1 User(s) are reading this topic (0 Guests and 0 Anonymous Users)

 


Lo-Fi Version Time is now: 27th September 2022 - 11:29