Hi,
When the meaning is 'intelligence', the word 'wit' is often used in the plural.
I've always considered the correct form of the expression to be at my wits' end or at the end of my wits.
However, my dictionary says at my wit's end is also acceptable. It sounds odd to me.
Best wishes, Clive