Hi Bn77,
Logically, it's a perfectly good answer, but as an idiom it has a different meaning. "You're asking me to do something which is beyond my capabilities, or my willingness to comply, or what would be reasonable for a prudent person to ask me to do."
Best wishes, - A.