Python, Transformers, PyTorch Lightning | GitHub Link

• Understand current concepts in NLP like Self-Attention, Pretraining and Language Models
• Perform literature review on State-of-the-Art models like T5, GPT and BERT
• FineTune t5-small on different tasks like Sentiment Analysis and Emotion Classification