Well it will change the length of pull and it will increase the felt recoil. Oh yes, and it will cost money and likely devalue the rifle somewhat if you decide to sell it because the buyer may want a rubber recoil pad. However, if it please you - why not do it.
drover
Right now it is slightly modified with a flip flop recoil pad.
Not woried about resell value since I bought the rifle for a excellent price