Organizations that enforce the federal Fair Housing Act say they are struggling to operate with the sudden elimination of annual grants.