Jitesh Jain

Jitesh Jain

Ph.D. Student

Georgia Tech


I am a 1st Year Ph.D. student (advised by Professor Humphrey Shi) in the School of Interactive Computing at Georgia Tech. I worked with the same advisor during my undergrad years as a part of SHI Labs. I earned my Bachelor’s in Computer Science and Engineering in 2023 from IIT Roorkee.

My current research interests broadly revolve around developing multimodal vision systems. I have led several projects in image segmentation and inpainting during my undergraduate years. Reach out if you are interested in my research or would like to discuss any ideas. I am looking for Internship Opportunities starting Summer 2024.

I spend my free time reading books (Goodreads) or watching web series. I also keep a log of my books. Every once in a while, I write blogs based on my experiences on Medium and pen down some of my thoughts. In the sports column, I like to stay updated about the happenings in the Formula 1 and Cricket worlds.

  • Deep Learning
  • Computer Vision
  • Multimodal Vision Systems
  • Visual Perception
  • Ph.D. in Computer Science, Exp. 2028

    School of Interactive Computing, Georgia Tech

  • B.Tech in Computer Science and Engineering, 2023

    Indian Institute of Technology Roorkee


  • [August 2023]: SeMask is accepted to NIVT Workshop at ICCV 2023!

  • [July 2023]: Graduated from IIT Roorkee with a Bachelor’s in Computer Science and Engineering!

  • [June 2023]: I will be joining Georgia Tech as a Ph.D. student in Computer Science in Fall 2023!

  • [June 2023]: New PrePrint Matting Anything out!

  • [February 2023]: OneFormer is accepted to CVPR 2023!

  • [January 2023]: Will be attending Research Week with Google 2023 in Bangalore!

  • [August 2022]: FcF-Inpainting is accepted to WACV 2023!


SHI Labs
Research Intern
Nov 2020 – Jun 2023 Eugene (OR)
  • Released a work proposing a multi-task universal image segmentation framework (OneFormer) that outperforms existing specialized models on all three image (panoptic, semantic, and instance) segmentation tasks.
  • Published a work proposing an inpainting framework (FcF‑Inpainting) using Fast Fourier Convolutionswhich works equally well on structure and texture images and is competitive with the state‑of‑the‑art methods.
Research Intern
Jun 2021 – Sep 2022 Remote (California, US)
  • Released a work (SeMask) proposing to add semantic context inside vision transformer‑based encoders of any existing semantic segmentation framework to obtain considerable performance improvement. The first open‑source project by Picsart.
  • Worked partly on OneFormer during my internship.
ML Engineer Intern
Jul 2020 – Sep 2020 Remote (New Delhi)
  • FilterPixel aims at automating the photo culling process to aid professional photographers.
  • Developed ML models for classifying images based on their exposure and blurriness.



Neural Style Transfer: A Technical Report

An experimental study of the Neural Style Transfer task

AOT-GAN Experiments

Experiments conducted with AOT-GAN


Object Level Image Editing using Instance Segmentation Maps


A Python Package for graph plotting using Manim Engine

BackBone Profile

Inference stats for various backbone networks


A Flutter App to help people keep track of their research papers

IITR ChatBot

Chatbot for the IITR Website

IITR Security App

A Flutter Application developed for digitizing the entry-exit process of visitors at IIT Roorkee.

Paper Summaries

Summaries of a papers published at Deep Learning Conferences

ChatBot with Pytorch

ChatBot made using Pytorch


Pytorch Implementation for VQ-VAE on MNIST dataset.

Time Tracer

A flutter app to help people keep track of their time


An android app for connecting people


A Flutter Application providing the location-based file sharing service.



Bronze Medalist
Awarded the Bronze Medal under Bosch’s Age and Gender Detection Track at Inter IIT Tech Meet 10.0. The competition is held every year among all the IITs.
See certificate
All India Rank 252
Achieved AIR 252 in Joint Entrance Exam (JEE) Advanced which is attempted by more than 230,000 students across India for admission into the IITs.
See certificate
All India Rank 454
Achieved AIR of 454 in Joint Entrance Exam (JEE) Main which is attempted by more than 1,000,000 students across India to gain eligibility for attempting JEE Advanced.
See certificate
KVPY Fellowship Awardee
KVPY is a highly prestigious National Fellowship awarded by the Indian Institute of Science to students showing high aptitude in research.
See certificate
NTSE Scholarship Awardee
NTSE is a national level examination for the secondary school level to identify and recognize students with high intellect and skills.
See certificate