It hasnt been an easy time for due diligence firms that make their living off the mortgage business, at least not this year. Firms like Allonhill LLC, which bulked up on staff to handle the rush of work on investor buyback demands, have been cutting back in recent months as those contracts run their natural course.