He said Acosta suffered "irreparable harm" by the decision to bar him.
The journalist thanked Judge Kelly for the ruling, before adding: "Let's get back to work".
CNN said in a statement on Friday that it "looked forward to a full resolution in the coming days". "Our honest thanks to all who have supported not just CNN, but a free, strong and independent American press".
The judge did not rule on the First Amendment question, though, because he found that Acosta's Fifth Amendment rights were likely violated as it appears he was given no due process.
Earlier this week, Fox News announced that it would support CNN's effort to restore Acosta's White House credential and filed an amicus brief with the U.S. District Court. Kelly said he agreed with the government's argument that there was no First Amendment right to come onto the White House grounds.
New Zealand wins hosting rights for Women's Rugby World Cup 2021
New Zealand's prime minister, Jacinda Ardern, said it was a proud moment for Kiwis and rugby fans all around the world. New Zealand Rugby Union head Steve Tew, a good friend of Castle's, said Australia had an excellent bid.
The White House had argued the President has broad authority to decide. We will also further develop rules and process to ensure fair and orderly press conferences in the future.
Trump cut off Acosta as he tried to press a point over refugees marching through Mexico toward the US border. "It's not a big deal and if he misbehaves, we'll throw him out or we'll stop the news conference", Trump said.
"Whether the news of the day concerns national security, the economy or the environment, reporters covering the White House must remain free to ask questions", the media groups said in a joint statement ahead of Wednesday's hearing.
CNN sued Trump and other White House officials on Tuesday over the revocation. He threatened that when reporters interrupt, "we'll just leave and then you won't be very happy".
"President Trump wants it to be a free-for-all", CNN's lawyer said.
Trump claims video distributed by White House wasn't altered
The video proved otherwise. "This unprecedented decision is a threat to our democracy and the country deserves better", CNN said. You know, he gets paid to burst in. "The most powerful man in the free world is verbally abusing journalists", she said.
In fact, Trump himself frequently speaks harshly to reporters, for example last week telling another CNN correspondent several times that her question was "stupid".
In an interview with Fox News's Chris Wallace conducted shortly after a federal judge ruled the White House had to return Acosta's press badge, per Trump-appointed federal judge Timothy Kelly, "we have to create rules and regulations for conduct, etc., etc". Last week, the Trump administration yanked the White House reporter's credential following a silly spat with an intern over a microphone.
Media organisations have been alarmed by the White House's treatment of Acosta, saying that revoking his "hard pass" to enter the White House is a threat to other journalists who might be similarly banned.
"In response to the court, we will temporarily reinstate the reporter's hard pass", she said. Another got proof that Uncle Sam wants him behind bars.
However, BuzzFeed reporter Paul McLeod noted: "The judge did rule no one has an absolute First Amendment right to have access to the White House". Just reported that, despite the tremendous success we are having with the economy & all things else, 91% of the Network News about me is negative (Fake).
Trump clashes with CNN reporter
From the moment Acosta began asking Trump about the migrant caravan heading towards the United States, Trump was visibly angry. Meanwhile, other politically active stars vowed to keep working post-election. "Not at all, no".
"I was confident ... that our rights would be protected to continue to cover our government and hold our leaders accountable", he said.