Whew! I can hear it that way if I try hard, but I like the surface subject of a passive sentence to be as much a nominative as the surface subject of an active one.
Accusative: *Whom was invited? Dative: *Whom was given the book?
And also: *To whom was given the book? But "To whom was the...