If you say "I've been working with him in the same company for years", it is perfectly fine.
But the verb "know", is among the many verbs that do not work well in perfect tense.
Google information is good for a rough comparison but not completely accurately trustworthy in my opinion.
Sometimes, even a native website could post grammaticlly questionable writing.
<< I started to know it two years ago...>> by the way, this looks completely grammatical but sounded really strange!