Chief Justice John Roberts was the lone conservative to vote against continuing Trump's White House ballroom.