Author Topic: New Server Setup  (Read 6141 times)

0 Members and 1 Guest are viewing this topic.

Offline Will@Drop

  • GH Admin & MD Co-Founder
  • * Administrator
  • Thread Starter
  • Posts: 56
  • Location: SF Bay Area
    • Massdrop
New Server Setup
« on: Thu, 06 December 2018, 11:35:04 »
Hello Friends,

It’s been a few months since we spoke, hope you’re doing well and having some luck in the clack sales : )

When we purchased GH we said we wouldn’t change anything big... we lied, I’m sorry. We changed everything about the hosting and server structure for GH to make it as fast and reliable as Massdrop.

Before MD, GH was run on a single server, beside other services and personal projects. Today GH runs on a distributed set of servers and systems described here:

208430-0

  • Federated Services - ultimately what we have done is taken all of the required services it takes to run geekhack and silo into their own instances. This allows us to quickly diagnose issues in the backend, should geekhack be experiencing any.
  • Fully Redundant Backend - all of the required services which we broke apart during the federation, are now fully redundant. This helps us to strive towards 100% uptime by knowing we have instances in hot standby waiting to replace any failure that is detectable.
  • Load Balanced Across Multiple Web Servers - previously geekhack was run on a single instance, we have taken steps to ensure that geekhack is capable of running on multiple instances, so we can have little to no downtime.
  • Content Delivery Network - previously all static content for geekhack was served back by the webserver. Now we leverage a Content Delivery Network (CDN) to move those assets closer to the edge so our users can retrieve them faster; a happy side effect of this is that it also reduces contention on the geekhack web servers.
  • Code / Request Optimizations - we have taken steps to ensure some code flaws and requests which were exhibiting high failure rates, are no longer doing so. One such example would be a broken attachment url, that was held over from a long time ago and would generate 5XXs around the clock as people looked at old threads or crawlers scraped us.
  • Operational Overhaul - upon taking over geekhack, we wanted to make sure we conformed to some of the same standards we do at Massdrop, when it comes to instance provisioning / configuration / lifecycles. We have taken the time to create operational recipes so we can quickly and easily, replace or add infrastructure as needed.
  • Security Lifting - we have done a few things to help with security as well; the biggest thing we have done, is to do our due diligence to ensure the instances or our users’ data isn’t accessible to the internet except through the geekhack. This has allowed us to properly internalize and protect geekhack’s datastores and the data they contain, which has allowed me to sleep better at night. ;)

This transition required a lot of work from our team, and Matt_MD in particular. Feel free to PM him your compliments.

Thanks for your time and contributions to the geekhack community!

Offline Computer-Lab in Basement

  • The needs of the many outweigh the needs of the few.
  • * Elevated Elder
  • Posts: 3025
  • Location: NCC-1701, USS Enterprise
  • Live long and prosper
Re: New Server Setup
« Reply #1 on: Thu, 06 December 2018, 11:48:30 »
very impressive
tp thread is tp thread
Sometimes it's like he accidentally makes a thread instead of a google search.

IBM Model M SSK | IBM Model F XT | IBM Model F 122 | IBM Model M 122 | Ducky YOTD 2012 w/ blue switches | Poker II w/ Blue switches | Royal Kludge RK61 w/ Blue switches

Offline switchnollie

  • sleever supreme
  • * Exquisite Elder
  • Posts: 1631
  • Location: 白い帽子
  • greyhat co-leader
Re: New Server Setup
« Reply #2 on: Thu, 06 December 2018, 11:50:49 »
My man :cool:


Keyboards: HHKB Pro 1 & OTD 356CL Dark Greyhat Edition, baybee!

Offline SpAmRaY

  • NOT a Moderator
  • * Certified Spammer
  • Posts: 14667
  • Location: ¯\(°_o)/¯
  • because reasons.......
Re: New Server Setup
« Reply #3 on: Thu, 06 December 2018, 15:19:53 »
Fancy :spam2:

Sent from my SM-G930V using Tapatalk

Offline Puddsy

  • nice
  • * Elated Elder
  • Posts: 12275
  • Location: RSTLN E
  • "Do you shovel to survive, or survive to shovel?"
Re: New Server Setup
« Reply #4 on: Thu, 06 December 2018, 16:08:03 »
i don't know what a lot of this means but it seems good so i like it

still upset that i lost like 10 pages of PMs in the hardware failure though

but that was pre md
QFR | MJ2 TKL | "Bulgogiboard" (Keycon 104) | ctrl.alt x GON 60% | TGR Alice | Mira SE #29 | Mira SE #34 | Revo One | z | Keycult No. 1 | AIS65 | First CW87 prototype | Mech27v1 | Camp C225 | Duck Orion V1 | LZ CLS sxh | Geon Frog TKL | Hiney TKL One | Geon Glare TKL



"Everything is worse, but in a barely perceptible and indefinable way" -dollartacos, after I came back from a break | "Is Linkshine our Nixon?" -NAV | "Puddsy is the Puddsy of keebs" -ns90

Offline livingspeedbump

  • * Exquisite Elder
  • Posts: 1552
  • Location: Seattle
  • Gentlemen, a bobsled is a simple thing.
    • KeyChatter
Re: New Server Setup
« Reply #5 on: Thu, 06 December 2018, 16:08:51 »
damn, nice. Things just got real serious. :thumb:
<- My Collection (so far)

Offline pwade3

  • Posts: 482
  • Location: Ohio
Re: New Server Setup
« Reply #6 on: Thu, 06 December 2018, 16:09:21 »

Offline NAV

  • Formerly A_Vicarious_Death
  • Posts: 68
  • Location: Maryland, US
Re: New Server Setup
« Reply #7 on: Thu, 06 December 2018, 16:12:29 »
nice

Offline LightningXI

  • * Elevated Elder
  • Posts: 4280
  • Location: New York
  • PPD
    • ArtisanMacro
Re: New Server Setup
« Reply #8 on: Thu, 06 December 2018, 16:14:16 »
So this means the site can tolerate the traffic on Clackvents right?

Offline mbsurfer

  • Posts: 114
  • Location: South Carolina, USA
Re: New Server Setup
« Reply #9 on: Thu, 06 December 2018, 16:18:34 »
Nice to see some updates happening!

Offline romevi

  • Formerly romevi
  • * Exalted Elder
  • Posts: 8941
  • Location: The Windy City
Re: New Server Setup
« Reply #10 on: Thu, 06 December 2018, 16:22:28 »
beep beep

Offline xtrafrood

  • formerly csmertx
  • * Elevated Elder
  • Posts: 2715
  • Location: Gainesville, FL
  • wildling
Re: New Server Setup
« Reply #11 on: Thu, 06 December 2018, 16:37:46 »
Seems legit  :)

Offline HoffmanMyster

  • HOFF, smol MAN OF MYSTERY
  • * Senior Moderator
  • Posts: 11450
  • Location: WI
Re: New Server Setup
« Reply #12 on: Thu, 06 December 2018, 17:00:57 »
So this means the site can tolerate the traffic on Clackvents right?

The site seems to be holding up, sadly the thread updates are falling behind still.  :'(

Offline Puddsy

  • nice
  • * Elated Elder
  • Posts: 12275
  • Location: RSTLN E
  • "Do you shovel to survive, or survive to shovel?"
Re: New Server Setup
« Reply #13 on: Thu, 06 December 2018, 17:16:20 »
So this means the site can tolerate the traffic on Clackvents right?

The site seems to be holding up, sadly the thread updates are falling behind still.  :'(

noticed that one today, that's for sure
QFR | MJ2 TKL | "Bulgogiboard" (Keycon 104) | ctrl.alt x GON 60% | TGR Alice | Mira SE #29 | Mira SE #34 | Revo One | z | Keycult No. 1 | AIS65 | First CW87 prototype | Mech27v1 | Camp C225 | Duck Orion V1 | LZ CLS sxh | Geon Frog TKL | Hiney TKL One | Geon Glare TKL



"Everything is worse, but in a barely perceptible and indefinable way" -dollartacos, after I came back from a break | "Is Linkshine our Nixon?" -NAV | "Puddsy is the Puddsy of keebs" -ns90

Offline LightningXI

  • * Elevated Elder
  • Posts: 4280
  • Location: New York
  • PPD
    • ArtisanMacro
Re: New Server Setup
« Reply #14 on: Thu, 06 December 2018, 17:36:01 »
So this means the site can tolerate the traffic on Clackvents right?

The site seems to be holding up, sadly the thread updates are falling behind still.  :'(

Emails are difficult. Source: Real Life

Offline rowdy

  • HHKB Hapster
  • * Erudite Elder
  • Posts: 21175
  • Location: melbourne.vic.au
  • Missed another sale.
Re: New Server Setup
« Reply #15 on: Thu, 06 December 2018, 19:49:39 »
At least it's not Azure :))

Good job guys :thumb:
"Because keyboards are accessories to PC makers, they focus on minimizing the manufacturing costs. But that’s incorrect. It’s in HHKB’s slogan, but when America’s cowboys were in the middle of a trip and their horse died, they would leave the horse there. But even if they were in the middle of a desert, they would take their saddle with them. The horse was a consumable good, but the saddle was an interface that their bodies had gotten used to. In the same vein, PCs are consumable goods, while keyboards are important interfaces." - Eiiti Wada

NEC APC-H4100E | Ducky DK9008 Shine MX blue LED red | Ducky DK9008 Shine MX blue LED green | Link 900243-08 | CM QFR MX black | KeyCool 87 white MX reds | HHKB 2 Pro | Model M 02-Mar-1993 | Model M 29-Nov-1995 | CM Trigger (broken) | CM QFS MX green | Ducky DK9087 Shine 3 TKL Yellow Edition MX black | Lexmark SSK 21-Apr-1994 | IBM SSK 13-Oct-1987 | CODE TKL MX clear | Model M 122 01-Jun-1988

Ị̸͚̯̲́ͤ̃͑̇̑ͯ̊̂͟ͅs̞͚̩͉̝̪̲͗͊ͪ̽̚̚ ̭̦͖͕̑́͌ͬͩ͟t̷̻͔̙̑͟h̹̠̼͋ͤ͋i̤̜̣̦̱̫͈͔̞ͭ͑ͥ̌̔s̬͔͎̍̈ͥͫ̐̾ͣ̔̇͘ͅ ̩̘̼͆̐̕e̞̰͓̲̺̎͐̏ͬ̓̅̾͠͝ͅv̶̰͕̱̞̥̍ͣ̄̕e͕͙͖̬̜͓͎̤̊ͭ͐͝ṇ̰͎̱̤̟̭ͫ͌̌͢͠ͅ ̳̥̦ͮ̐ͤ̎̊ͣ͡͡n̤̜̙̺̪̒͜e̶̻̦̿ͮ̂̀c̝̘̝͖̠̖͐ͨͪ̈̐͌ͩ̀e̷̥͇̋ͦs̢̡̤ͤͤͯ͜s͈̠̉̑͘a̱͕̗͖̳̥̺ͬͦͧ͆̌̑͡r̶̟̖̈͘ỷ̮̦̩͙͔ͫ̾ͬ̔ͬͮ̌?̵̘͇͔͙ͥͪ͞ͅ

Offline xtrafrood

  • formerly csmertx
  • * Elevated Elder
  • Posts: 2715
  • Location: Gainesville, FL
  • wildling
Re: New Server Setup
« Reply #16 on: Thu, 06 December 2018, 20:26:56 »
At least it's not Azure :))

Good job guys :thumb:

 :)) :))