“So we are in the winner's circle, friends, we are in the winner's circle, but we have to deliver a couple of things and one of those we've got to deliver before too long is marriage equality in this country,” Mr Pyne said at a private function.
Audio of the speech from the function on June 23 reportedly captures him saying the federal government could take action on same-sex marriage sooner than everyone thinks.
'I said that two years ago, it didn't go so well, we've got to be honest about that, but we are working on it,” he said of delivering on the policy of legalising same-sex marriage.
“We're going to get it, I think it might be sooner than everybody thinks, your friends in Canberra are working on that outcome.”
But former prime minister Tony Abbott was more angered by Mr Pyne allegedly hailing the success of moderates in the Liberal Party.
And he was particularly angry that the Minister allegedly revealed he had always voted for Prime Minister Malcolm Turnbull in leadership ballots.
Mr Abbott has told Radio 2GB he expected more loyalty from Mr Pyne, whom he once considered an ally in his leadership team.
"If you are a member of a cabinet, you've got to be loyal. And Christopher Pyne was not just a member of my cabinet, he was actually in the leadership team. And it's important that you show loyalty. But if he's to be believed on Friday night, that loyalty was never there, which is incredibly disappointing."
The Government's plan for a plebiscite was defeated in the Senate last year.
Malcolm Turnbull says Labor should have supported the bill when it had the chance.
"The reason there is not gay marriage lawful in Australia at the moment is because no plebiscite has been held. I believe, if a plebiscite had been held, it would have been carried," he said.
"But the reason the plebiscite has not been held is because Bill Shorten blocked it. So let's be very, very clear about this. I can understand the disappointment of those who are frustrated that the gay-marriage issue has not been resolved, but the reason it has not been resolved is because of Bill Shorten."
Labor helped to vote down the plebiscite, arguing a well-funded campaign against gay marriage could be hurtful for same-sex couples.
Mr Shorten has, instead, repeated calls for Mr Turnbull to allow a free vote in parliament.
