Fix open-loop odometry in case of ref timeout (backport #1454)

Fix open-loop odometry in case of ref timeout (backport #1454) #495