I have to do exactly what you are thinking of trying. I went to the hardware store and bought some 3M "sidewalk" tape. It has a rough texture to prevent slipping on wet sidewalks and has a super-strong adhesive backing. I run a narrow (1/4" or so) strip lengthwise on all of my IWB kydex holsters. Works great and I've never had the tape come off.