Patel accused the Marine combat veteran of “poor judgement” and a “lack of impartiality” in an scathing letter.