If it is still early in the season, and the plant sends up new, green foliage, then it is safe to remove the damaged leaves. I then use the mulched leaves as a protective covering in my flower beds, or add it to my compost bins), or pine needles and branches.