A top Pence aide abruptly withdrew from his unusual White House role after Trump criticised him