It seems that in "men's toilet" and "teachers' seminar," whom it's for takes precedence over what it's for, therefore, possession. I think in both cases the nouns adaquately describe the purposes (toilet/seminar), although the second is probably more...