In all fairness,
I can understand your point however.
Take this example,
I bought apps on iTunes for my iPad.
Once they downloaded and installed on my iPad, I have deleted them few months later.
I still own the licence to the said apps despite them on being physically on my device itself. I can re download and re-install them again if I wish to do so.
That isn't illegal.