Two and a half months back I had an interesting bet with Alok 'Rodinhood' Kejriwal to double the web traffic of koimoi.com. The traffic has been quite steady ever since and I hope to win the bet real soon.
However, the problem with increased traffic is hosting. Right now, Koimoi is running on instances from Rackspace but we have occasional downtime. The problem is quite acute as we enjoy quite some reputation as a Bollywood Portal. Even a small downtime is pretty bad for our reputation, not to mention the traffic we lose.
Now I know Rackspace is a famous name in Hosting Solutions but they have failed to impress me so far. Seems they are themselves confused as to the reason behind their downtime. They tell my system administrator it's coz of a DDOS attack and in 2 minutes contradict their own statement saying it's coz of excessive load. And it just keeps getting better. The latest is an error in their load balancer twice in the interval of less than an hour.
We have already doubled the Rackspace instances and RAM owing to a surge in traffic last week. However, there has been no difference and we are still getting downtimes quite often.
I understand if it's once in a while but it really becomes irritating when I keep hearing the same stuff every week. The best part (thankfully): The downtime usually happens not when the traffic is at its peak which rules out the excessive load excuse of Rackspace.
Has any one here faced a similar issue before? If yes did you find a solution to the same. If no can anyone recommend a better hosting solution which can scale upto 100,000 visitors a day?
I really got to win this one.
Thanks Kunal. Will ask my tech team to look into it.
I think if you can include caching at application level, and also at webserver level, and load-balancer. You can get a good deal at AWS. Since you are getting connectivity issues at non-peak times, try getting a snapshot of pings from 3-4 continents as well memory profiling during those periods. I suspect that rackspace has issues with BGP layers, if memory usage doesnt show any spikes.
I think instead of cloud hosting you should go with dedicated server concentrating on location the traffic generated from or if target traffic is global you can buy small dedicated server sync the dedi's best so that result would be better from any location many problem of cloud is if one chain breaks latency take a big hit
Indian traffic will be better managed with an Indian Datacenter but my experience with godaddy over the past 10 years has been good, I have never seen a major outage till date. Not even with my mails per say. Yes, we do not have such a loadful of traffic but just sharing my experiences.