It may be nothing at all, just two friends catching up but the fact that he is more concerned with how it will look to her if he cuts contact, rather than your feelings being hurt by the continued contact, is the problem. If you’re an otherwise rational thinker and not jealous, he should stop contacting her. It’s not hard to put one’s marriage first. It’s only hard if you don’t want to.