NetBilling Down from over 12 hours now!
 

NetBilling has been down for over 12 hours now.. hope all ok with them... what sort of issue that they can't fix in 12 hours.....

Where is MITCH?

netbilling.com loads fine for me.

Not sure what's going on. Netbilling uses Ezic for their backend and they are down too http://ezic.com/

They must have known it would take a long time because they wrote "Please make the necessary changes on your signup and checkout methods". The email came about 25 minutes after they went down.

Only thing I can think of is maybe there was a hack or critical system issue or PCI issue and they had to shut everything down?

https://netbilling.com works since it's not hosted on the Ezic network, but everything that is on Ezic like the api and backend is down. So it's not just Netbilling, but Ezic itself and all other Ezic clients are down as well.

17 hours and counting. Not very happy, but didn't know about the EZIC issue until your post. Whatever's going on, hopefully it's resolved soon.

Ezic's traffic went to almost nothing lately:

https://traffic.alexa.com/graph?o=lt...340&u=ezic.com

18 hours now

Damn. did not get any notice about this. I would have switched billers fast.

Just spoke to NetBilling team and ask for support and they forward me to voice mail... Where is Mitch Farber... From last night its down and he should come and let us know what is going on and how loing it will take.. should give eta....

Business is already down because of Google and now these thing killing us...

Just leave a voice mail would you?


Mitch is busy right now, spending all the winnings from the MrSkin party.

https://scontent-atl3-1.xx.fbcdn.net...42&oe=5B21A68C

JK, love Mitch, real nice guy!

A lot of money are being lost, that's all im gonna say.

if true, what a fucking disgrace

Ouch, just hang tight I'm sure it will be fine soon!

Hey man, hope you get this resolve. Goodluck!

time is ticking up and counting and no update from NetBilling...

Hi all,

A network outage announcement was sent out 20 minutes after we discovered that the problem was not going to be immediately resolved. We have been in contact with many merchants and our network engineers are working nonstop to fix the issues. I will post more and we will notify everyone once resolved.

Thank you, Mitch Farber

Hi Mitch,

Good luck getting the problem fixed.

Dear Mitch,

huge amount of money has been wasted I beleive... I hope your system can recover it.. before we discuss thsi further... please give us proper information because its not just network outage... this is what I am thinking... may be i am wrong but please keep us updated... no point ringing office and listen recorded message.

I just want to give you some props man. I've been following your posts and you are always so helpful, clear and knowledgeable. It's very refreshing (especially around here lately). We met in person in Amsterdam I think along with Mitch (not Farber) and I didn't get a chance then to thank you for always posting such helpful info. :thumbsup

Mitch at NETbilling is great people so he will get this resolved as fast as humanly possible I am certain. But while it's going on it sure sucks and I hope most have alternate billers they can use while this is being fixed.

ditto.. now should I have those join pages sent to ibill ?

I have alot of rebills that come on the 1st of each Month, I wonder how that will work.

They said to us a couple of days
 

"Hello Phillip,

We will have a network re-port put together in the next couple of days
once things are resolved and we're very sorry for the trouble. We'll let
you know as soon as it's back up and running.

Regards"

There is a typo in the email you received " We will have a network report " not a network re-port. Meaning we will be able to provide everyone with a detailed incident report of what has happened.

:thumbsup

Logged into my merchant bank account and see no rebills processed for the 1st and now 2nd.

I figure once NB is back online you'll see them processed all then and there. This makes me wonder if those subscribers are getting bonus days.

Also another issue: nobody can cancel their subscriptions right now. This could lead to chargebacks if NB doesn't get their back-end up soon.

We're pushing 26 hours of downtime now.

well, this explains a lot. NB's tech provider http://ezic.com/

= Totally down.

Error message:

This site can?t be reached
ezic.com took too long to respond.
ERR_CONNECTION_TIMED_OUT

Not sure why I never received this announcement. And, since I was out of town, I had no idea that it was down. :(

A note from Ezic (4 hours ago):

Dear Ezic Customers,

We have been working round the clock since the outage yesterday to
determine the cause of the outage and to troubleshoot possible solutions.
This outage has also affected our email and ticket system making
communication more difficult. And although we have not been able to
identify the initial cause, in the process of troubleshooting, there were
multiple other networking related issues that were corrupt (data
corruption) that needed to be repaired, which has unfortunately, taken a
significant amount of time. We are currently in the process of attempting
another reboot, while also exploring other options if this reboot fails. We
never would have anticipated the amount of time it has taken thus far so
we hesitate to provide a time frame for completion at this time.

We sincerely apologize and understand your concerns and frustrations as
we work to get back online. We will follow up with updates as they come
in from our engineering team.

Sincerely,

Katie Rudolph
Reseller Development
CELL: 847-915-8546

Hi Wendy! Thanks for coming in and look at this thread as well... Hope you remember me ;)

Thanks for the info!



Thanks Wendy!

sigh. I would sincerely hope that if a ransom is involved that could mitigate the downtime, you guys would take that up. I cannot emphasize this enough.

sigh. You're not as stealth as you think

wow wtf?

Fantastic

https://gfy.com/fucking-around-and-pr...-gateways.html

Orbitalpay has been down for about the same amount of time as netbilling.

Seems too coincidental not to be related I would think.

oh well. All you can do is wait at this point.

.

Its not Orbital or Netbilling that's down, it's their backend provider EZIC. Once EZIC is up Netbilling and Orbital should both be fine, hope they fix it soon, I have neither the time nor the resources to switch gateways right now.

sounds like it could be a data center problem, but this is why I have a US based server and a backup in the Netherlands. just a change in the DNS to switch it to backup.

this is almost comical

clearly no risk management plan

no redundancy?

pure fucking amateur

As soon we we received the email from them about the outage we switch Epoch to the front as our primary processor. It does bother me that Netbilling has been down for so long now. We have a lot of rebills with them.

Hope they get it sorted out soon. I pull my hair out if we are down more the 20 minutes!!

Brandon
FGE, LLC
Catalina Cruz - Cam Porn - Official PornStar Website CatalinaCruz.com

Wow both Companies work hand an hand

sounds like you need a reliable host like the one in my sig.

I always liked you and your posts but honestly you have no idea and it's really not fair to put that out there. I don't use netbilling I've never used netbilling but they have been solid for 20 years in this business and this is a first.

It's comical how one of the few solid businesses in our industry is brought to it's knees for the first time in 20 years and every fucking cunt and her warts logs in with posts hanging them out to dry yet a "bro" can fuck people over multiple times and still post here like they're family. Shameful.

Nothing against you it's just that this situation bothers me and I feel netbilling has earned a ton of good karma points over the years in addition to them being rock solid.

I?ve heard what?s going on with Ezic and their whitelabels and I empathize, truly. MobiusPay puts our community first and we want to help everyone we can and guide them through this uncertainty.

We believe in diversification and we?ll never put all your processing eggs in one gateway basket.hahaLet us help you create and maintain contingencies to head off end-of-the-world-level catastrophic events like not being able to conduct business, processes sales, and make money with no light at the end of the tunnel.

Contact me and I?ll get you setup on another gateway ASAP and if you like what I do for you, we can talk adding a backup MID to your portfolio.

I have been with Netbilling for something like ten years and don't want to leave them, but at some point I'm gonna have to do something here..We are heading towards day 3. The Netbilling people are good people and I want to give them as long as possible to resolve this.

I switched my cascade so CCBill is my primary but 90% of my rebills come from Netbilling.

Here's a question for you experts though: Is it possible to move my rebills to another payment processor?

Glenn King
MeanBitch Productions

As long as it's your merchant account, yes. I have assisted many clients moving from one gateway to another.

In fact, I've done it with my own paysites.

Although, with one gateway completely off-line, that creates a new issue.

We're more like 33 hours into this give or take but I feel your pain.
I think NB has enough positive history that it may make more sense to remain where you are though I do hope we get a full and way-above-satisfactory rundown of what happened, how it was resolved, and how it will not happen again.

From Ezic's linked in page: https://www.linkedin.com/company/ezic-inc-/

11h
"Dear Ezic Customers,

We have been working round the clock since the outage yesterday to
determine the cause of the outage and to troubleshoot possible solutions.
This outage has also affected our email and ticket system making
communication more difficult. And although we have not been able to
identify the initial cause, in the process of troubleshooting, there were
multiple other networking related issues that were corrupt (data
corruption) that needed to be repaired, which has unfortunately, taken a
significant amount of time. We are currently in the process of attempting
another reboot, while also exploring other options if this reboot fails. We
never would have anticipated the amount of time it has taken thus far so
we hesitate to provide a time frame for completion at this time.

We sincerely apologize and understand your concerns and frustrations as
we work to get back online. We will follow up with updates as they come
in from our engineering team.

Sincerely,

Katie Rudolph
Reseller Development
CELL: 847-915-8546"

8h
"As the outage continues our engineers are working diligently to get us back online. We again apologize for any inconvenience and appreciate your patience."

5h
"In regards to my last update our engineers are still making slow progress on getting the equipment back online and a time frame is still not available. As more information on the progress becomes available I will keep providing updates via email and Linkedin."

damn this has to hurt for all. gl cleaning up

This is really crazy.

"multiple other networking related issues that were corrupt (data corruption) that needed to be repaired"

sounds very serious....

Luckily we have third party processors that we could switch to for most of our sites but we are definitely going to set up with Rocketgate for redundancy asap

I've been with Netbilling for 7 years. Last time they went belly up (their own fault) and we found out the hard way 7-8 hours later, I suggested to Mitch they have some sort of a emergency email list different from their newsletters one (which I have unsubscribed from). So at least this time we could switch to secondary quickly. Sorry for all of you who don't have one, but this is mainly your fault.

Netbilling having NO redundancy for cases like this is truly baffling.

Rebills could be re-run at a later date. Cancellations are a problem.

get an account at pingdom.com and set up an alert for secure.netbilling.com
we got the alert 25 mins before their announcement