You're all that's left me.

Hi all,  I have a question to ask. 

I heard a song titled "IF" by Bread the other day and found out that lyric goes something like this.

If a picture paints a thousand words,
then why can't I paint you?
The words will never show the you I've come to know.

if a face could launch a thousand ships,
then where am I to go?
There's no one home but you,
You're all that's left me too.

And when my love for life is running dry,
you come and pour yourself on me.
...

I don't quite get the meaing of the blue colored sentence.

I don't think the word 'left' in the sentence mean "go away from someplace or someone."

Rather, it should mean 'remain.' Then, in my little knowledge of English, the sentence must go like "You're all that's left to me."

I googled "* that's left me" and there are some sentences such as  "This book is all that's left me now."

I am confused. Could anyone clarify me on this?

Yes, this is it.  

--

leave 

  Function: verb
Inflected Form(s): left \left\; left; leaving; leaves

(4) : to have as a remainder after consuming or utilizing <did away with the whole pie, leaving nothing for me> <only one ton of coal is left> -- often used with over <give what is left over to the dog> <too hungry to leave anything over> (5) : to allow to remain in the possession of after taking a part away <how much does that leave you> :

http://unabridged.merriam-webster.com (3 Jun. 2008).