Hello Paco
'To + whom?' as 'clarification where object and indirect pronouns are indistinguishable' is quite persuasive.
Your comment on the fact that 'whom?' originally derives from the dative (rather than 'hwane'/'hwone') makes me wonder whether that's why English native speakers have such...