We're planning a trip to San Diego next week so we're not in SD yet:

Is he coming with us? Or

Is he going with us?
Both are fine. Do you picture him coming toward you, following closely as you progress, or do you picture the group of you moving together toward SD?
Site Hint: Check out our list of pronunciation videos.
going with us as a group.
Then you would use 'going'.