Because you're not editing the real view angles.
You're updating the angles that are updated when a new snapshot comes in.
You need to edit the local view matrix to change the angles.
Same shit with CoD games.
Additionally, you may simply update your user commands during the network sending.