I think "coming around here" implies a certain attitude - a familiarity - a presumption - an audacity - some kind of intention.
It need not be something bad. "Why don't you come around any more?" (You used to be a familiar sight here.)
It's like the difference between "coming here" and "coming here like this."
Absent special context, "to come here" would not carry any of this implication.