The first set require a captial letter at the start of the sentence, but either way is fine.
In the second set, "he said" is more normal, but "said he" can be used for literary purposes. People just learning English may want to stick with "he said" but there's nothing incorrect about reversing the order. In American punctuation the comma would go inside the quotation mark.