I don't really know the difference, and I don't really mind being called a jogger (I've been called much worse).
I know of some serious running clubs called "xxxxxxxxxx joggers", so I guess a lot of other people don't mind either.