I've gotten that too, and my dogs are small. 5 pounds, 6 pounds, and 3 pounds. I think people are just ignorant and don't mean it as a put down.
I think next time you should just respond - "oh, I'm sorry", walk away and they will be left wondering what the heck that meant.
