I agree, N2G, it will depend on context.
It took me two hours to feed the baby! - Yes, that would be actually putting the food in the baby's mouth.
I'm having company unexpectedly for dinner, and I have no idea what I will feed them! - That refers, of course, to the food you will put on the table. It is expected that they will perform the actual act of eating without assistance from me.