“Whoever told you life is fair?” My grandmother used to say this to me. She was right.One of the joys and sorrows of “swinging,” or polyamory, or whatever you wa…