Yup, my advice will be just do it!
Yes, depending where you are you 'might' get heckled by some mindless person but I very much doubt you will. Non runners? well they are non runners so you shouldn't care what they think (though it's probably all in your head) and fellow runners will understand if your slow at first 
I mainly run on single track roads/trails so need to be seen, tomorrow I'll be in bright orange shoes, capris, lime green knee length shorts, a flu yellow jacket and Orange beanie - so I don't care what people think
As for being concerned if people see you I'd like to think an oncoming motorist would be able to see you