Keep Server Online
If you find the Apache Lounge, the downloads and overall help useful, please express your satisfaction with a donation.
or
A donation makes a contribution towards the costs, the time and effort that's going in this site and building.
Thank You! Steffen
Your donations will help to keep this site alive and well, and continuing building binaries. Apache Lounge is not sponsored.
| |
|
 Topic: What Software & Hardware Use Major Websites |
|
| Author |
|
jimski
Joined: 18 Jan 2014
Posts: 196
Location: USSA
|
 Posted: Sun 09 Aug '15 1:05 Post subject: What Software & Hardware Use Major Websites |
 |
|
This thread is to discuss and share findings about what hardware and software is being used by major websites and what loads they have per server in terms of requests and users per server. And if you run a busy website with more than 50,000 users then please share your experiences as well.
Here is the first one:
What it takes to run Stack Overflow
http://nickcraver.com/blog/2013/11/22/what-it-takes-to-run-stack-overflow/
24 hour stats
148,084,883 HTTP requests to load balancer
36,095,312 of those are page loads
833,992,982,627 bytes (776 GB) of HTTP traffic sent
286,574,644,032 bytes (267 GB) total received
1,125,992,557,312 bytes (1,048 GB) total sent
334,572,103 SQL Queries (from HTTP requests alone)
412,865,051 Redis hits
3,603,418 Tag Engine requests
558,224,585 ms (155 hours) spent running SQL queries
99,346,916 ms (27 hours) spent on redis hits
132,384,059 ms (36 hours) spent on Tag Engine requests
2,728,177,045 ms (757 hours) spent processing in ASP.Net
4 MS SQL Servers
11 IIS Web Servers
2 Redis Servers
3 Tag Engine servers (anything searching by tag hits this, e.g. /questions/tagged/c++)
3 elasticsearch servers
2 Load balancers (HAProxy)
2 Networks (each a Nexus 5596 + Fabric Extenders)
2 Cisco 5525-X ASAs (think Firewall)
2 Cisco 3945 Routers
When you remove redundancy here’s what Stack Exchange needs to run (while maintaining the current level of performance):
2 SQL servers (SO is on one, everything else on another…they could run on a single machine still having headroom though)
2 Web Servers (maybe 3, but I have faith in just 2)
1 Redis Server
1 Tag Engine server
1 elasticsearch server
1 Load balancer
1 Network
1 ASA
1 Router
My Comment: Their pages are relatively light and have no multimedia content and very little graphics.
What is interesting that they use IIS and ASP.NET.
Not counting MS, I know at least one other very large website which uses ASP.net. http://plentyoffish.com |
|
| Back to top |
|
jimski
Joined: 18 Jan 2014
Posts: 196
Location: USSA
|
| Posted: Sun 09 Aug '15 2:11 Post subject: PlentyofFish.com |
|
|
PlentyofFish.com
https://plentyoffish.wordpress.com/2009/06/14/upgrades-themes-date-night/
Microsoft Windows
ASP.NET
IIS
Akamai CDN
Foundry ServerIron Load Balancer
Some older stats when they were serving only 1.2 Billion pages per month 
Revenue $10 million per year working 2 hours per day.
http://highscalability.com/plentyoffish-architecture
2 load balanced web servers with 2 Quad Core Intel Xeon X5355 @ 2.66Ghz), 8 Gigs of RAM (using about 800 MBs), 2 hard drives, runs Windows x64 Server 2003.
3 DB servers.
64,000 simultaneous connections, 2 million page views per hour.
Internet connection 1Gbps with only 200Mbps used.
1 TB/day serving 171 million images through Akamai.
6TB storage array to handle millions of full sized images being uploaded every month.
When traffic grew to 200,000,000 page views and 1 billion images per day they upgraded to SQLserver 2008 on Windows 2008 HP ProLiant DL785 with 512 GB of ram and 32 cores. |
|
| Back to top |
|
|
|
|
|
|
