Going by the voting pattern so far... = OK. This views all of the voting for this specific election as a whole
Going by the voting patterns so far... = OK. This might be used if the writer is viewing the voting in terms of individual states, for example.
Going by voting patterns so far... = This is also possible, but the omission of 'the' makes 'voting patterns' less specific.