By Simple past, would rather

I seem to have noticed that, when the object is not a person, "would rather" is often followed by the subjunctive mood instead of the simple past or the pluperfect. For instance, we say "I'd rather you joined me", but I rarely see: "I'd rather the meeting was...