Hi,
Forget about W3 Total Cache, breaks more things than it helps. What kind of hosting are you on?
Please test your loading time here first
https://gtmetrix.com and please open a ticket and put your answer there with your domain and creds (or create a user for me) I will check your settings and test those.
Bottom line whats important is the loading time, i have seen plenty of site with scores around 10 and below ranking super high coz their loading time were super fast. Don't focus too much on those test only on the loading time...
Regards,
Nick