If you know the name of the person you are addressing - e.g. if you started the letter Dear Mr... then you should end the letter Yours sincerely,...
If you do not know the letter of the person you are addressing - e.g. if you started the letter Dear Sir or Madam or To Whom It May Concern, you...