Increasingly worried about withering loan production and declining profitability of the mortgage industry at large, Ginnie Mae recently sent a letter to its 14 largest nonbank counterparties, asking them to develop strategies to right-size their operations.