usually when you switch over to https google has to re-index everything again. It's like creating a brand new website so you lose most of your traffic.
That's why many didn't want to switch over to https man years ago. You're way late.
You'll just have to wait. If most of your traffic is your normal customers then its not big deal. If not, then you're screwed for a long while
|