We need 2.5 in order to prove 2.4 (because we rely on Q* satisfying the Bellman equation)

But we also need 2.4 in order to prove 2.5! (because we must know that there is a single optimal policy pi* for all the s' states)

Can you please point to what I'm missing?

thanks!