As the Federal Housing Finance Agency ponders possible improvements to the government’s Home Affordable Refinance Program, calls from different corners of the industry are growing louder for the FHFA to end fees charged to borrowers who refinance Fannie Mae and Freddie Mac mortgages.