Hi Huxley,
Welcome to the forum.
Yes, you are correct. Question marks (?) and exclamation marks (!) always show that the sentence (not clause) has ended, in the same way as a full stop. Therefore, you need to start the next word, which is the first word of a new sentence, with a capital...