If I say the Catholic priest married me in 1980 somewhere... would it be mistaken as I got married with the priest? I know in common sense, it will not be the case.
Perhaps I should have asked if "the priest married me" is a correct usage?
Kevin in Hong Kong
I got married by a Catholic priest would solve your problem. Yes if you got married with, you married them!

Or I got married in the Catholic Church! Tis means in the eyes of the Church rather than a church.