cv

General Information

Full Name Srijan Bansal
Email srijanb [at] cs [dot] cmu [dot] edu
Languages English, Hindi

Education

  • 2021 - 2023
    M.S. in Language Technologies (Research Track)
    Carnegie Mellon University
  • 2016 - 2020
    B. Tech. in Electronics and Electrical Communication Engineering (Major) & Computer Science (Minor)
    Indian Institute of Technology, Kharagpur

Interests & Skills

Academic Interests Large Language Models (LLMs), Model Compression, Parameter Efficient Learning, Question Answering, Information Retrieval, Conversational AI, Multimodal ML, Multilingual NLP, Code-Switching
Skills Research, NLP, Prompt Engineering, Deep Learning, Machine Learning, Transformers, Neural Networks, Hugging Face, PyTorch, Python

Experience

  • May - Aug 2023
    Applied Scientist Intern
    Amazon AWS (Lex Team)
    • Adaptation-aware Large Language Model (LLM) compression using low-rank attention-head factorization
  • May - Aug 2022
    Research Intern
    Salesforce Research
    • Thorough examination of soft prompt tuning towards unified question answering under a low-resource setting
  • Aug 2021 - Aug 2023
    Graduate Research Assistant
    Carnegie Mellon University
    • Knowledge-grounded conversational question answering in open-domain setting; parameter-efficient training methods
  • Apr 2020 - July 2021
    Data Scientist
    Hitachi Vantara
    • Designed platform to assist DevOps teams to optimize and localize the root cause of issues in containerized applications
  • May - July 2019
    Research Intern
    EPFL (Machine Learning and Optimization Lab)
    • Designed momentum-based learning rate scheduler for black-box (zero-order) stochastic convex optimization
  • Dec 2018 - Jan 2019
    Research Intern
    Hitachi Ltd., R&D Team (Centre for Technology Innovation)
    • Explored the applicability of multi-layered capsule neural networks for object recognition and semantic disentanglement
  • Jun - July 2018
    Research Intern
    IIIT-Allahabad
    • Flexible framework to implement stacked bi-directional LSTM models for image captioning with ResNet architecture

Teaching

  • Spring 2023
    Teaching Assistant
    11797 Question Answering (CMU)
    • Designed & graded course assignments
    • Mentored course projects for several teams

Academic Achievements

  • First place in the Multidoc2dial shared task (unseen-setting) at the Dialdoc Workshop in ACL 2022.
  • Research fellowship provided by CMU includes full tuition coverage and a stipend for the Master’s program. (2021-2023) ◦ Awarded for best student of B.Tech (ECE) having a mix of academic and research potential at the end of 4 years.
  • Young Researchers’ Symposium Special Mention Award for short paper at CoDS-COMAD 2019 Conference
  • Scholarship recipient for Kishore Vaigyanik Protsahan Yojana-2016 and National Talent Search Exam-2014