Fabien Pesquerel

INRIA, CentraleSupelec Rennes

Cesson-Sevigné, FRANCE

I am interested in the problem of sequential learning in which an agent interacts with an environment in order to achieve a goal. The agent must adapt to the information obtained from its observations. The sequential processing of information make this problem a difficult and interesting one, in particular when applied to machine translation, recommender systems, physics, or even cybersecurity.

What makes such problems interesting to me is that you learn about the problem you want to solve as you solve it!

I am as motivated by the mathematical and computational aspects of the problem (What is an optimal strategy/decision?) than I am by the modelling aspects (How can we model a human decision-making? How to model and incroporate expert knowledge?).

Outside of work, I really enjoy cooking and doing calisthenics. I have a blog AnalySthenics that is mainly dedicated to the analysis of calisthenics and gymnastics data.

news

Oct 22, 2024	I am starting to learn Japanese. Hope to progress steadily and quickly !
Apr 01, 2024	I am starting a postdoc in the PIRAT team at INRIA, CentraleSupelec Rennes!
Dec 25, 2023	It is Christmas and I recently sucessfully defended my PhD ! Read the manuscript here!

selected publications

NeurIPS

IMED-RL: Regret optimal learning of ergodic Markov decision processes

Fabien Pesquerel, and Odalric-Ambrym Maillard

In Advances in Neural Information Processing Systems, 2022

Bib HTML PDF

@inproceedings{pesquerel_imedrl_2022,
  author = {Pesquerel, Fabien and Maillard, Odalric-Ambrym},
  booktitle = {Advances in Neural Information Processing Systems},
  editor = {Koyejo, S. and Mohamed, S. and Agarwal, A. and Belgrave, D. and Cho, K. and Oh, A.},
  pages = {26363--26374},
  publisher = {Curran Associates, Inc.},
  title = {IMED-RL: Regret optimal learning of ergodic Markov decision processes},
  url = {https://proceedings.neurips.cc/paper_files/paper/2022/file/a8c9f9ccc45771d2fd06bcd04ff3442e-Paper-Conference.pdf},
  volume = {35},
  year = {2022},
}

PhD thesis

Information per unit of interaction in stochastic sequential decision making

Fabien Pesquerel

Dec 2023

Bib HTML PDF

@book{pesquerel_phd_thesis_information_per_unit_of_interaction_2023,
  title = {Information per unit of interaction in stochastic sequential decision making},
  author = {Pesquerel, Fabien},
  year = {2023},
  month = dec,
  url = {https://cnrs.hal.science/tel-04501905/},
}