Black-box distillation (herein referred to as distillation) is a common technique used by AI developers and researchers. 2 It has traditionally been used to compress knowledge and capabilities into ...