Method for quantizing digital filter coefficients