I totally know the feeling....
Phone conversation:
THEM: Hey, what are you doing?
ME: Working.
THEM: So you didn't finish painting that room today? Are you going to do it soon? I thought you were going to be done. You should get on that.
ME:
I've started not answering the phone while I'm working. That helps sometimes.