Depository institutions saw their combined agency servicing shrink 2.5% from the third to the fourth quarter, squeezing their share of the market to 42.2%.