I got out of running a few years ago and I reckon it took me two months to lose virtually all the aerobic fitness I built over the year leading up to that point. It's only a few weeks lost IMO and not the end of the world - anything like swimming will help and it's also better to look at the longer term picture than risk getting injured.
