About me

I am currently a Postdoc at INRIA Sophia Antipolis. I am working with Dr. Konstantin Avrachenkov in group NEO. I reveived my PhD (2015-2019) from the Department of Telecommunication and Information Processing (TELIN) at Ghent University. My dissertation is titled ``Stochastic Modelling of Wireless sensor Networks" and was carried under the supervision of prof. Dieter Fiems and Dr. Koen De Turck. Prior to that, I obtained my masters degree in Industrial engineering and opreations research (IEOR) (2012-2014) from Indian institute of Technology (IIT Bombay).

My research interests broadly lie in

  • Reinforcement Learning ( and Deep Q-Networks : DQN)
  • Markov Decision Process (and POMDPS)
  • Optimal Control Theory
  • Queueing Systems
  • Stochastic Modelling and Game theory
  • Fluid approximations

I am currently working on applications of reinforcement learning, in particular, adaptive web crawling and influenece maximisation in complex networks. My recent focus is on designing the optimal scheduling policy for dynamic Web crawlers. I am using stochastic aprroximations, Q-learning, deep learning and, restless bandits to develope mathematical models and provide detailed analysis on their performance. For more details, feel free to browse my Publications page.