The connector looks like it is sprung out a little more than required. The only part that "drags" on the connector is the tallest part (rounded head). This piece engages the cam in the slide. Other than engaging the cam, it should not tough any other part of the slide.
Basically pretty hard to wear out but pretty easy to bend out of shape by improperly removing or installing.