On Value Iteration Convergence in Connected MDPs [2406.09592]