chip away at

to gradually make something weaker, smaller, or less effective by taking away little pieces of it over time.