Hi, Andrei
"He looks up the word in the dictionary" is a grammatically correct sentence in the simple present tense.
"He look up..." is incorrect because there is no tense or modality implied in the verb. You are using the 'base' form of the verb, the infinitive. In other words, the verb is...