By terminating its management agreement with PRCM for cause, Two Harbors will avoid paying a $144 million fee.