|
Quote:
|
Quote:
Quote:
We also had an offsite backup locally but its only done monthly and the data is useless. Hindsight is always 20/20 |
rcn should release small bits of information they have on the hacker,
im sure someone on gfy would find him... |
Quote:
Quote:
Quote:
Quote:
Quote:
|
Quote:
Not to mention that even after it is restored, there are configuration problems and setup issues that need to be attended to as the servers are not backed up bit for bit... Doesn't take knowledge of a tape drive to figure out why this is going to take a while. 4000 man hours is a very conservative estimate, not considering ongoing support to fix small configuration issues. Do some math: 4000 man hours at tech costs + overtime + contracts, say avg $25/hr and that is conservative... $100k plus a month worth of refunds (1000 servers at ~450$ a piece, $450,000) and lost business (say a very conservative 20%) makes this a pretty impossible situation financially but despite that, it is being done. From what I understand backups are actually being restored and support is being offered so maybe just lighten up and let the bits transfer at whatever speed they may. I agree that with a proper disaster plan this could have been much smoother but either way you look at it... I can't think of another host that would come back from having every single one of their servers corrupted at once. |
Quote:
you should try getting them on the case |
Quote:
A properly set up data centre should be able to replicate it's operations in the event of a 100% failure in a reasonable length of time. RCN was charging top dollar for what eventually turned out to be zero effective disaster recovery contingencies and now the customers are paying. However people who are running a $60k a month operation should probably have their own contingencies in place as well. |
can anyone post their new updates, how fast were you treated with isprime support?
|
Quote:
A simple 500/month machine with someone like mojo, natnet or us would easily run you 2k/month+ under sungard. If you look at your average adult focused hosting company and then look at a mainstream focused management company. The two extremes are different than what you would think. A simple dual quad with raid and 100Mbps in adult will run you 400-700/month. Rackspace/another higher end mainstream focused management company will charge 400-700 just for the box and in many cases 1k+, and then your looking at easily 10-40Mbps on banwdith on top of it. What a lot of users fail to realize is the true cost behind the scenes that is involved in running a managed services company. People cost money, equipment and software costs money and building/space costs money. As RCN mentioned the backup system they have in place, much like many other providers have in place are probably built around 50-100 machines per back up node, depending on hardware involved, and even then with 100 machines hitting that box each night you better schedule them carefully. These systems are not designed to mass restore dozens of machines at once. No way no how. If someone ever wants to see how DR is done and the real costs involved. Just go lookup on google DR services and ask for a quote and see whats involved. |
order a shit
|
ISprime was less than enthusiastic about my call to them setting up my box, the guy there sounded just as jaded and hectic as the RCN techs except this guy was in the sales dept. which really freaks me out. Could tell by the way this guy talked to me it's going to be a long time before I get my other box restored. :disgust
|
Why din't they take Mojohost Brad's offer to fly in some techs at his own expense to help restore the boxses. RNC did say they needed all the manpower they could get.
So here's Brads chance to prove weather he is the man of his word. |
Quote:
Honestly, I think this is the first time in several years that I've seen downtime with an RCN server. You can bet your ass that what doesn't break you will make you stronger... I still have a lot of faith in RCN despite the recent events. ISPRIME are really a pain to deal with already, "send an email here, contact so and so, contact us back after, no eta", typical left hand not talking to the right hand. RCN you hop on icq, ask them to set up lighttpd and a new domain on a new ip and you get a message back 5 minutes later when it's done. |
Quote:
|
Quote:
if you are who i think you are, it's better that your sites are offline. warez anyone? |
I wasn't too thrilled with my call to them either. Seems too hectic and I don't like not having an answer. I was just told to send them an email with my server details and they will respond. It's been about 8 hours with no response :(
I would prefer mojohost to step in as well. |
Quote:
|
Quote:
|
isprime never needed customer service
|
Quote:
|
Quote:
Zagi, I would personally like to say that the post you made earlier was that of a true leader. It took a lot of heart to stand up and refer clients to their best option in getting their business / sites back up and running, even if it meant telling them to change hosts! For a company to lose it's clients / business with the stroke of a keyboard is unimaginable to me. Years of hard work, blood, sweat, tears and passion for the company is immeasurable. If there is anything we can do to help, please do not hesitate to contact us. Best to all. M |
Quote:
|
Quote:
|
how come you hosting companies are always so goddamn lovey-dovey with each other?! :mad:
|
Quote:
|
Quote:
|
Quote:
|
Ugh, after looking around at new hosts and their offerings I can say I know why we are with RCN. Bunch of "2-3 days" for setups and only "email" support after hours... :\
:\ If anybody is going to pull through on customer loyalty alone despite this, RCN would be it. |
Quote:
I laugh at the idiots spamming webair in this thread who don't have a clue about a proper hosting. And before anyone says "haha look where they ended up now", to you I answer: it could happen to anyone. |
Fucking hackers, why do they have to destroy stuff? Ok if they change the index-pages but I dont see the point of doing something like what happened to RCN.
|
Quote:
I rarely spam the boards for Webair, but if someone asks I do recommend them, as I think their support is pretty decent, especially the live support is great to have. |
Quote:
|
Quote:
|
Quote:
|
Quote:
|
i thought rcn had monitors and file alteration monitors and shit like that in place. I was under the impression something like this would have been impossible. I mean isnt there something monitoring the servers for mass deletions or injections or shit like that? how is it even possible that an exploit can come out and wipe out 1,000 servers in 2010 on a managed hosting situation like RCN. I am telling you this was preventable and they just got complacent after all these years. You live, you learn RCN. I am sure we have all learned valuable leasons from this.
|
whom to contact about getting backup data?
|
Quote:
Or it could have possibly been a single windows webserver that never logged out of it's own account, and always had pageant open with it's ssh key loaded in so that the attacker wouldn't even need to know the ssh key pass. Or it could have been a single server with a text file that contained every root password for every box. Regardless, I don't think any 'fully managed' host is actually secure, as each employee workstation will usually have access to a shit load of of boxes via a single ssh key phrase. Ideally, I would have each server setup with a unique ssh key, and have the 'management box' have a new user account for each box they manage, and from there have an unique ssh key & ssh key passphrase. Let this be a lesson in liability. |
Quote:
:( |
Quote:
|
so, now I decided to move away from rcn and cant wait for isprime to have time for my business. Anyone can suggest solid managed hosting for me pls?
|
yeah isprime is solid but they are pretty slow with setting up new boxes
|
We are working overtime and tirelessly to recover and migrate RCN clients that wish to transition to ISPRIME. There are some major limitations in the recovery rate. All content was compressed and encrypted on the backup servers, and the Disk I/O limitations further complicate matters. We’ve brought in additional manpower, and employees have been working extra hours to try and move this along as quickly as possible. Of course we are faced with a difficult task and are doing our best to set up clients as fast as we can. As mentioned before we are limited by the existing RCN backups and Disk I/O.
I know a lot of you have questions that you’d like to get answered; please understand that by calling our sales line and asking questions such as the “what’s the ETA” will not get you a definite answer. Our sales guys are there to give you a quote on a setup. Once that’s done and you've decided to move forward, you would get an invoice with a payment link. Once you are signed up, our sales guys will forward the setup details to the Support team, who will begin your setup. We ask that you contact us via email to [email protected] with the following information: Your RCN customer # Server Alias First and Last Name Please do not ICQ or call in, as this will only slow down the account creation process. We ask for some understanding due to the highly difficult circumstances of this situation. We are working as fast as possible to restore accounts of customers who are migrating to ISPRIME, and again asking you to keep in mind that we are limited by the existing RCN backup servers and disk I/O limitations. Please understand that this is not only a new server setup, but also a data recovery process -- which does require extra time. |
Quote:
|
rcn is not replying me anymore, hugh
and isprime is : signup if you want more infos hugh i have been paying for backups for several years... and it has been 3 days now i have been waiting those backups, that's crazy |
yeah, the situation is worst than yesterday,
RCN ignore me too and dont answer 4 days down & no good news - actually no news |
Quote:
|
Here´s an example of how "excellent" the icq-support at ISPrime is.
Me 13:17 I´m wondering how the progress with restoring my sites is going... isprime13:23 one min please isprime13:37 should work now *I went ahead and changed DNS setting at this time. Me 15:41 Hi! The DNS changes have now taken place where I´m located, but my sites are down... you said that it should work... isprime15:45 one moment Me 16:02 so how is it going? will the sites be online soon or shall I change back dns? I´m sorry if I´m nagging, but it´s very important that my sites get online... and if I can help in any way, please let me know. isprime16:03 51 |
Quote:
|
Quote:
|
| All times are GMT -7. The time now is 06:35 AM. |
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc