More than $ 100 million in payments due to JPMorgan Chase & Co. and Bank of America Corp. for modifications completed under the Home Affordable Modification Program could be withheld — possibly permanently.

The government claims that it held up HAMP incentive payments to the two mortgage servicers because they haven’t complied with HAMP guidelines.

Both BofA and Chase each stand to lose more than $ 60 million in HAMP incentives if the withholding becomes permanent.