Abhay Nandiraju

I am a second year PhD student in the Intelligent Systems program at the University of Pittsburgh's School of Computing and Information. My research primarily focuses on developing AI models that use multimodal healthcare data to improve patient care. Broadly, I work on multimodal learning, multi-agent systems, vision and vision-language models. I am fortunate to be advised by Dr. Shandong Wu. In addition to this, I also work on visual reasoning agent systems that can understand and interpret medical images.

Some research questions I am exploring are:

• How can multimodal data be integrated to build robust models to improve patient care?
• How to optimally adapt foundation model representations for healthcare domain?
• How to effectively fuse information from multiple modalities?

I did my Master's in Information Scince: Machine Learning from University of Arizona and worked in the Deep Target NLP research group led by Dr. Gondy Leroy. During this time, I developed an automated feedback loop to tackle information loss in generative-AI text simplification.

I did my Bachelor's in Electrical Engineering at the Indian Institute of Technology(IIT), Tirupati with a focus on machine learning and computer vision. During this time, I researched data augmentation techniques and developed edge models for real-time drone detection under the guidance of Dr. Rama Krishna Sai Gorthi.