Mortgage bankers have been complaining loudly about escalating compliance costs since the CFPB opened its doors in 2011. Some smaller nonbanks have cited those rising costs as one reason they might be forced to merge with better capitalized institutions.