Not a reading, but some advice. Sigh, I've worked in situations where the owners are a couple, or family members.
My advice, put your nose to the grind stone and focus on the work. If you think the comments are coming from are about your work performance, ask about it. If it's personality, ignore it. From experience, I know how frustrating it is to hear rumors/comments made about you. If your work performance is great, focus on that.
Owners/bosses are under a lot of pressure and tend to snap, so if it is something that rubs you the wrong way, they may not have meant it and just said it because they are stressed.
But it sounds like it's time to look for another job.. but don't quit this one unless it is in your best interest.