The problem you have is that quotation marks are supposed to indicate an exact quote, not a general rehash of what was said or thought. Maybe you could have your character talk to himself, as "Oh Brother," he said too himself, wondering what was coming next. I wouldn't get into this sort of thing very much.