I used to do karate. When I started to practise boxing, I felt very slow, because boxing cloves felt heavy. Now I think that it is a good drill to punch fast pare nuckles/with out cloves and mix it with sessions with cloves. Just for training speed and relaxation.
How do you work your speed?