Yes.
But it's not very professional and often said when you're about to go into a string of complaints. "First off, you're always late. Secondly, you dress like a slob. Third, ... etc."
For example, you would say "At the party, first off, we'll play a game, and then we'll have cake."