Published onApril 30, 2022Contrastive Learning in Distilled Modelsdeep-learningnlpOMSCS Deep Learning Final project for Deep Learning course for Masters. Non peer reviewed. Application of contrastive learning on DistilBERT.