Daniel Furelos-Blanco

I am a recent Ph.D. graduate in Computing from the SPIKE Research Group at Imperial College London, where I was advised by Alessandra Russo, Krysia Broda, Mark Law and Anders Jonsson. My research focused on the learning and exploitation of (hierarchies of) finite-state machines in reinforcement learning, using them as a means for task decomposition and temporal abstraction.

During my Ph.D. studies I interned at InstaDeep, where I worked on solving combinatorial optimization problems using reinforcement learning. Before starting my Ph.D., I was a research assistant in the Artificial Intelligence and Machine Learning Group at Universitat Pompeu Fabra, where I worked on enabling action concurrency in multiagent planning and temporal planning.

Selected Publications

ICML

Hierarchies of Reward Machines

Daniel Furelos-Blanco, Mark Law, Anders Jonsson, Krysia Broda, and Alessandra Russo

International Conference on Machine Learning (ICML), 2023

Bib PDF Code Poster Slides

@inproceedings{FurelosBlancoLJBR23,
  author = {Furelos-Blanco, Daniel and Law, Mark and Jonsson, Anders and Broda, Krysia and Russo, Alessandra},
  title = {{Hierarchies of Reward Machines}},
  booktitle = {International Conference on Machine Learning (ICML)},
  pages = {10494--10541},
  year = {2023},
}

NeurIPS

Winner Takes It All: Training Performant RL Populations for Combinatorial Optimization

Nathan Grinsztajn, Daniel Furelos-Blanco, Shikha Surana, Clément Bonnet, and Thomas D. Barrett

Neural Information Processing Systems (NeurIPS), 2023

Bib PDF Video Code

@inproceedings{GrinsztajnFSBB23,
  author = {Grinsztajn, Nathan and Furelos-Blanco, Daniel and Surana, Shikha and Bonnet, Cl{\'{e}}ment and Barrett, Thomas D.},
  title = {{Winner Takes It All: Training Performant RL Populations for Combinatorial Optimization}},
  booktitle = {Neural Information Processing Systems (NeurIPS)},
  pages = {48485--48509},
  year = {2023},
}

JAIR

Induction and Exploitation of Subgoal Automata for Reinforcement Learning

Daniel Furelos-Blanco, Mark Law, Anders Jonsson, Krysia Broda, and Alessandra Russo

Journal of Artificial Intelligence Research (JAIR), 2021

Bib PDF Code Poster Slides

@article{FurelosBlancoLJBR21,
  author = {Furelos-Blanco, Daniel and Law, Mark and Jonsson, Anders and Broda, Krysia and Russo, Alessandra},
  title = {{Induction and Exploitation of Subgoal Automata for Reinforcement Learning}},
  journal = {Journal of Artificial Intelligence Research (JAIR)},
  volume = {70},
  pages = {1031--1116},
  year = {2021},
}

AAAI

Solving Multiagent Planning Problems with Concurrent Conditional Effects

Daniel Furelos-Blanco, and Anders Jonsson

AAAI Conference on Artificial Intelligence (AAAI), 2019

Bib PDF Code Poster Slides

@inproceedings{FurelosBlancoJ19,
  author = {Furelos-Blanco, Daniel and Jonsson, Anders},
  title = {{Solving Multiagent Planning Problems with Concurrent Conditional Effects}},
  booktitle = {{AAAI} Conference on Artificial Intelligence (AAAI)},
  pages = {7594--7601},
  year = {2019},
}