since 6am i believe

What a nightmare scenario, I wish them and clients luck and perseverance through this situation. That said, if more hands on deck would be helpful I will put myself and a couple techs in a plane to come out and help in any way we can. Fuck. I'll bring redbull. Call me on my cell if we can do anything to help, seriously. Everyone that's a client- sit tight, pray, be patient - go drink heavily - RCN is surely working it systematically and phone/email/icq requests don't help them get this done any quicker. :(

Brad

Brad,you are too good for this business :1orglaugh

RCN guys are solid ... This is the 1st downtime I have had in years. They'll be back in the game in no time ...

I'm on it...

Oops, har du alt hos RCN? :Oh crap

yeah and then what, going to serve a 500gb site off your cable modem?

they just told me:

we are still working
right now we are checking/verifying backups
which will take
maybe 1-2 hours
then they start to restore boxes

I'm one of the victims ... :disgust

They should at least bring back realitychecknetwork.com online and post some news there. We are all in the dark.

Still 1-2 hours ? I don't believe it ... we will see. :upsidedow

I'd rep you but I can't. Solid offer.

some sites have been up for awhile (cliphunter)

I would think they are worried about making sure the whole is patched before bringing anything online, including the main page.

message from RCN for those who are affedted:

I panic if my site is down for more than a minute. I can only imagine the horror some people are going through right now.

Sending good vibes to restore everything back to normal.

Mail from rcn to customers:

We are writing this letter to inform you that a very targeted
malicious attack took place on our network this morning at 6AM EST.
As a result, most of our server operating systems have been corrupted
resulting in the current downtime. However, we have access to all
backups and have already figured out a strategy for bringing your
servers back up, and have all hands on deck working to restore
service. We will continue sending progress updates, and will be
notifying you personally once your service is restored. We would like
to thank everyone for being so understanding and patient as we work to
bring everything back to normal.

We have updated the call in number to go to cell phones so if you are
calling into the support line: 866-726-4678 you should be reaching
someone most of the time.

If not please wait 5 mins and try again.

Currently we have backups for the majority of the content and are
working to finalize the restore process. At which point we will be able
to provide more accurate ETAs on service restoration.

Thank you,
Moisey Uretsky
President
Reality Check Network

where did you get that message? They email it to you? I'd check my mail, but it's nuked along with the server :disgust

probably not using an email address hosted by rcn - i got the email and i use my isp email address

what he said

the email announcement was sent from a gmail account

I wonder if any cardholder data was compromised?

Imagine how much data needs to be restored for xvideos.com

that must be several terabytes of flv files

I'm sure they have well over 100 servers just for them.

Ugh FML...this really sucks :(

Sorry to all our affiliates...it's out of our hands obviously.

it's not out of your hands since you own the domains but guess you didn't have an off-site backup with another online company.

We do keep off-site backups but they only backup once per month (in case of something catastrophic like RCN blows up) and it's not as easy as flicking a switch to get them running. We're better off waiting for RCN.

I'm seeing a lot of these sites/domains going nowhere, you should set something up and redirect your domains. Seems crazy to just leave your sites/domains dead for this amount of time.

Just wanted to add, as mentioned, do you think its a good idea to host a legit site on a server hosting illegal tubes, seems risky these days considering.

The consequences will never be the same.

Wonder if this has exposed any user data/customer data, credit card data, etc. That would be uber shitty.

Yeah between 300 - 400 servers for hosting those clips only

WTF? Are you kidding? What are so many servers for?

Are they the next google? :helpme

you can't cause as soon as switch the dns it will start propagating to another server, can take 2 days for then when it's restored it will take just as long to switch back so instead of 24 to 36 hours downtime you end up doubling it.

dis is so year 2000. respectable hosts shouldn't go down like this now-days. not to mention dis is why with my host i have redundancy to all my shizz on the cloud, if my shits in ny goes down it autofails to my servers located in amsterdam, my host has multiple datacenters.

if yer shits is critical to your livlihoods like mine host it wit established professionals

say what you want but my shitz up!

:pimp

If i am not wrong dns update can be drastically speed up if you set very low TTL in your dns records.

so they have to reconfigure every single server and email account for every single client of theirs? that will take months! I am so fucked here.

I'm serious, you really need that many servers to host their enormous sites

They have xvideos, xnxx.com and many other sites.

Several of them are in alexa top 1000 and xvideos is around #50 site of the world

then it's worthless. you should be backing up to a company online that can turn you back on at the flick of a switch :thumbsup

Sounds really serious, stuff like that makes me think...

what the shit? That shit is the shit. i'm not shitting you. No shit!

Gonna start calling you Bad Ass Brad. If you would do that for another company, it speaks volumes of how excellent your own support is. :2 cents:

Imagine how worried they would have to be if they actually paid for all of those videos. :1orglaugh