Friend: I always wanted a baby.
Mine was taken away.
Me: "by whom?"
By whom is correct grammar, but less formal and much, much more common is Who by?