Vowels are sounds, not letters. Every word has a vowel sound. 'Y' is used to represent that vowel sound in some words, like 'by', 'my'', 'rhythm', etc.
PS: This-- 'There is no word in English that has not a vowel in it'-- hardly came from an English grammar book written by a native speaker.