You can change your appearance at any time by clicking on your avatar and selecting "Change Appearance" which will appear in a pop-up.
This will launch the edit avatar screen where you can change your appearance.
When you change your avatar appearance, other players in the room will notice your change immediately, without requiring a game reload.