Amid Kevin McCarthy’s struggles to become House speaker, a top McCarthy ally and Republican congressman from Alabama “promised” to ban any Republican who don’t vote for the California representative from sitting on committees.

U.S. Rep. Mike Rogers, R-Saks, a member of the House Steering Committee, which makes recommendations for committee chairmen, said his warning was more than a threat.

“I promised it,” the Alabama Republican said after a meeting of the House Republican Caucus, according to Politico.

While having a plurality of support among Republicans, including all six GOP members from the Alabama delegation, McCarthy has twice failed to garner the 218 votes needed to become speaker as hardline Republicans have withheld their support.

Tuesday’s vote marked the first time in 100 years that the vote for House speaker has gone to more than one ballot.

A third round of voting is expected later Tuesday afternoon.