This is taken from the New Oxford American Dictionary:
Granted = admittedly; it is true (used to introduce a factor that is opposed to the main line of argument but is not regarded as so strong as to invalidate it), e.g. "Granted, sitting around the house may not be your idea of the perfect retirement, but what's your choice when inflation is eroding the value of your nest egg?"