Rep. Michael Grimm (R-NY) will voluntarily give up his seat in Congress after pleading guilty to felony tax fraud, MSNBC reported.

Grimm had originally said that he would not be resigning from the House, ensuring that the new GOP majority would have to deal with him immediately after returning to Washington next year.

Watch MSNBC’s coverage of Grimm’s resignation.