The correct version is "He began to close the door".
"Began" is the finite verb, which agrees with the pronoun "he".
"Close" is the auxiliary verb, which stays in its infinitive form, "close".
Kooyeen is right, it could also be written "He began by closing the door". Here, the auxiliary verb...