There are only a few things that can limit you. Aerobic capacity, absolute power/strength, endurance/strength, bike handling and to some extent cadence.
What is your limiter?
Bike handling would be poor lines through corners resulting in speed loss etc. Power has to be reapplied to accelerate. Two bikers of equal power output can have different ride times. Think how many corners you can lose speed on, pot holes you can hit, or swerve. It is not the time lost that is the issue it is the power used to reaccelerate that results in slower speeds overall.
Power/Strength - capability to turn a big gear. I can out bike some skinny folk who are much better than me at running. I have big strong legs that let me turn big gears. Gym work will add pure strength
Endurance/Strength - ability to use above for as long as you need. Just plain biking.
Aerobic Capacity - can the heart/lungs meet the demands of the legs. In my case yes easily. Rarely out of breath but legs just won't do any more - my theory is running stresses the heart/lungs more and therefore I am OK on the bike.
Work out your limiter and then seek to improve it. It is probable this can be done by amending bike workouts but may be weights/plyometircs involved if absolute strength.
Big gear workouts, high rpm workouts, intervals all help. It is not just crank out as many miles as you can on the turbo trainer in the time you have. Sometimes you have to use gears you don't want. (I hate everything above 80 RPM and am happiest at 70 RPM - so I do schedule in workouts that try to up RPM - just not very often).
Hope this helps.