Never even thought about that one, but it is a good one.
Have a look at this site (it's a bit old and I haven't checked it, but it does say that it gives locations where Tax Free LPG can be purchased.
Hope it works.
http://www.arunautogas.co.uk/road_duty_tax_free_lpg.htm
Cheers
Mike