Isn't "to have met you" a noun phrase (an infinitive phrase)? A clause requires a finite verb, and an infinitive ("to have") is a nonfinite verb.
Anyway, "to have met you" modifies the adjective "glad", so I guess it could be seen as a kind of adverb. Unfortunately, these grammatical terms can...