U.S. District Senior Judge Richard Leon said the case “has more holes in it than a piece of Swiss cheese.”