I'm not an ultra runner, the only thing I've got to compare it too is going on a 6hr bike ride and over that time (when working @70-75%HR) I'd expect to see at least 10BPM drift.
Make sure you are drinking lots, (e.g. 750ml per hour ?).
cardiac drift is not a problem per se, you just need to know its there and adjust your pace appropriately. For example if you have twice the distance to cover and you are already hitting 160 (87% ?) at half way, then its probably a good idea to slow down even more at the start. Either that or wait for your body to slow you down naturally later (this is probably gonna be painful!).
all that said, if thats your first really long slow run, then over the next few you should see a pretty big improvment.