There is one in particular concerning a disagreement or agreement: `I hate to agree with..`
I don't see 'I hate to agree with . . . ' as idiomatic in the sense of having a special meaning.
It means what it says.
People are waiting to help.
Related forum topics: