Its very simple dress according to the risk you are willing to take....
1) if your boots do not have ankle armor in them they are nothing but high top leather tennis shoes anyway.
2) if heavy armored gloves prevent you from handling the bike well then you have a choice to make 1) take the risk...