Hello, this is Amit.

I am a PhD student at Purdue Computer Science, investigating the capabilities of transformer/LLMs.

In recent times, I have been interested in LLM reasoning-based concepts via post-training, e.g., scaling test-time compute, preference-based optimization algorithms e.g. DPO/PPO/GRPO, knowledge distillation, the mixture of experts, RAG, chain-of-thought, etc., and how we can improve them for different applications involving graph reasoning, information retrieval and knowledge editing. I am experienced in developing deep learning architectures for real-life applications involving LLMs and GNNs. I worked with Prof. Pan Li for a while on the Graph Anomaly Detection problem, funded by Sony, Belgium.

I am available for applied science research internships for Summer 2025 to work on LLM Reasoning (May 2025-August 2025).

📰 News

• [Dec 2024] LKD4DyTAG got accepted in the AAAI 2025 AI for Time Series Analysis (AI4TS) Workshop.
• [Oct 2023] GAD-EBM got accepted in the NeurIPS 2023 GLFRONTIERS Workshop.
• [Oct 2023] GAD-NR got accepted in the WSDM-2024.
• [Aug 2022] Started my grad school at Purdue Computer Science.
• [Apr 2022] Received Ross Fellowship and selected for Research Assistantship (RA) position by the Purdue University - Computer Science.

📝 Publications

AI4TS AAAI '25



LLM-driven Knowledge Distillation for Dynamic Text-Attributed Graphs
Amit Roy, Ning Yan, Masood S. Mortazavi
AI4TS: AI for Time Series Analysis, AAAI2025
March 4th, 2025, Philadelphia, Pennsylvania, USA
[ Paper ] [ Poster ] [ BibTex ]

WSDM '24



GAD-NR: Graph Anomaly Detection via Neighborhood Reconstruction
Amit Roy, Juan Shu, Jia Li, Carl Yang, Olivier Elshocht, Jeroen Smeets, Pan Li
The 17th ACM International Conference on Web Search and Data Mining (WSDM-2024)
March 4th-8th, 2024, Mérida, Yucatán, Mexico
[ Proceedings ] [ Paper ] [ Poster ] [ Presentation ] [ Code ] [ Video ] [ PyGod ] [ BibTex ]

NuerIPS GLFrontiers '23



GAD-EBM: Graph Anomaly Detection using Energy-Based Models
Amit Roy, Juan Shu, Olivier Elshocht, Jeroen Smeets, Ruqi Zhang, Pan Li
New Frontiers in Graph Learning (GLFrontiers), NeurIPS Workshop 2023
New Orleans, Louisiana, USA
[ Paper ] [ Poster ] [ Code ] [ BibTex ]

Before joining Purdue CS:

IJCNN '21



Unified Spatio-Temporal Modeling for Traffic Forecasting using Graph Neural Network
Amit Roy^*, Kashob Kumar Roy^*, Amin Ahsan Ali, M Ashraful Amin and A K M Mahbubur Rahman
The International Joint Conference on Neural Networks (IJCNN-2021), Publisher: IEEE,
Virtual Event, July 18-22, 2021
[ Proceedings ] [ Paper ] [ Code ] [ Video ] [ BibTex ]

PAKDD '21



SST-GNN: Simplified Spatio-temporal Traffic Forecasting Model using Graph Neural Network
Amit Roy^*, Kashob Kumar Roy^*, Amin Ahsan Ali, M Ashraful Amin and A K M Mahbubur Rahman,
The 25th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD-2021),
Publisher: Springer, May 11-14, 2021, Delhi, India (Virtual).
[ Proceedings ] [ Paper ] [ Code ] [ Video ] [ BibTex ]

IJCNN '21



Node Embedding using Mutual Information and Self-Supervision based Bi-level Aggregation
Kashob Kumar Roy^*, Amit Roy^*, Amin Ahsan Ali, M Ashraful Amin and A K M Mahbubur Rahman,
The International Joint Conference on Neural Networks (IJCNN-2021), Publisher: IEEE,
Virtual Event, July 18-22, 2021
[ Proceedings ] [ Paper ] [ Code ] [ Video ] [ BibTex ]

IJCNN '21



Structure-Aware Hierarchical Graph Pooling using Information Bottleneck
Kashob Kumar Roy^*, Amit Roy^*, Amin Ahsan Ali, M Ashraful Amin and A K M Mahbubur Rahman
The International Joint Conference on Neural Networks (IJCNN-2021), Publisher: IEEE,
Virtual Event, July 18-22, 2021
[ Proceedings ] [ Paper ] [ Code ] [ Video ] [ BibTex ]

APIN Journal '22



UGMINE: Utility-based Graph Mining
Md. Tanvir Alam, Amit Roy, Chowdhury Farhan Ahmed, Md. Ashraful Islam, Carson K. Leung,
Applied Intelligence Journal, Impact Factor: 5.086 , Publisher: Springer, April 12, 2022
[ Proceedings ] [ Paper ] [Code] [ BibTex ]

ICDM UDML '21



Mining High Utility Subgraphs
Md. Tanvir Alam, Amit Roy, Chowdhury Farhan Ahmed, Md. Ashraful Islam, Carson K. Leung,
UDML 2021: 4th Workshop on Utility Driven Mining and Learning @ICDM 2021, Publisher: IEEE
December 7, 2021, Auckland, New Zealand (Virtual)
[ Proceedings ] [ Paper ] [Code] [ BibTex ]

IEMIS '19 (Poster)



iGest Recognito : Mobile App for sign language based communication
Amit Roy, Saif Mahmud, Tauhid Tanjim, Sarker Tanveer Ahmed Rumee, Md. Mofijul Islam
International conference on Emerging technologies in data Mining and Information Security (IEMIS), 2018,
Kolkata, India. [ Poster ] [Code]

^* indicates Equal Contribution

🎓 Education

• Graduate Student in Department of Computer Science
  Purdue University - West Lafayette, IN, USA
  August, 2022 - Present
  (MS Requirements fulfilled on May 2024)
  Grad School Webpage
• B.Sc in Computer Science and Engineering
  January, 2016 - January, 2020
  CGPA: 3.96 out of 4.00 (Class Rank: 1^st)
  University of Dhaka, Dhaka, Bangladesh
  Undergraduate Curriculum

💻 Experience

Teaching Experience

Teaching Assistant, Department of Computer Science, Purdue University

• CS37300: Data Mining and Machine Learning, Spring 2025
  Instructor: Prof. Tianyi Zhang and Prof. Steve Hanneke
• CS37300: Data Mining and Machine Learning, Fall 2024
  Instructor: Prof. Dan Goldwasser
• CS37300: Data Mining and Machine Learning, Spring 2024
  Instructor: Prof. Steve Hanneke and Prof. Ruqi Zhang
• CS57800: Statistical Machine Learning, Fall 2023
  Instructor: Prof. Ruqi Zhang

Industry Experience

• Software Engineer [December 2020 - August 2022]
  Tiger IT Bangladesh Limited
  Dhaka, Bangladesh

Research Experience

• ML Algorithm Intern [May 2024 - Aug 2024]
  Futurewei Technologies
  Santa Clara, CA, USA
• Research Assistant [Feb 2020 - June 2022]
  Artificial Intelligence and Cybernetics Lab,
  Independent University, Bangladesh (AGenCy Lab @ IUB)
  Dhaka, Bangladesh

🎖️ Honors and Awards

• Professor Dr. M. Lutfar Rahman Award
  Department of CSE, University of Dhaka
  For securing the highest CGPA in the Bachelor of Science Final Examination of 2019 [ Credentials ]
  
• University Grants Commission, Bangladesh Scolarship
  For holding the first position in the Bachelor of Science Final Examination of 2019 in the
  Faculty of Engineering and Technology, University of Dhaka. [ Credentials ]
  

📚 Reviewing Services

• Reviewer at AI4Time Series Workshop, AAAI 2025

Misc

• Enjoy following and analyzing cricket, watching movies/tv-series, playing badminton, and card games.