Book is the object of the verb
have, but
which is the subject of the verb
is.
Do you remember the man
who(m)/that/- we met?
Do you remember the man
who spoke to us?
In both these sentences
man is the object of remember, but the relative pronoun is the object of
met in one case and the subject of
spoke in the other.