Everywhere I've seen it, they call them 'mice', as I believe is the correct form.
'Walkman' is a complex word that means something entirely different than its constituent words, i.e. it does not refer to a man who is walking. In this case, 'man' doesn't carry its original meaning any more, but it simply a part of a larger word, whose plural should therefore end with a regular suffix '-s'.
A computer mouse, even if it isn't a real live walking cheese-gnawing animal, is still two separate words, one of which ('mouse') denotes something we unanimously call a mouse. Since it is a very much individual word, it will follow its irregular pattern and become mice when we want to talk about 'computer mice'.
Sony evades the issue by talking about 'Walkman Personal Stereos', and some companies do the same thing by referring to 'mouse devices' instead of mice (e.g. Microsoft, on the right-hand side of
this page). Other companies however (e.g. MicroDirect, on the product headers on
this page) choose the easier way and just call them what they are - mice.