CV

Education

• B.S. in Telecommunication Engineering, University of the Basque Country, 2017
• M.S. in Telecommunication Engineering, University of the Basque Country, 2019
  • Eastern New Mexico University, Data Analysis, Aug 2018 - Dec 2018
• Deep Reinforcement Learning Nanodegree, Udacity, March 2020
• Ph.D in Reinforcement Learning, University of the Basque Country, 2019 - 2023
  • Supervisors: Javier Del Ser,Esther Villar-Rodriguez

Work experience

• Sep 2015 - Sep 2017: Control & Telemetry Manager at Formula Student Bizkaia
  • Duties included: Program the control and communication systems of the electric vehicle
  • Supervisor: Asier Zubizarreta Pico
• Dec 2017 - Jul 2018: Cybersecurity Internship
  • University of the Basque Country & TECNALIA
  • Data anonymization/pseudonymization, Post-quantum algorithms, Quantum Key Distribution

Skills

• Programming (Python, C, LabVIEW, Matlab, Java)
• Data Analysis
• Deep Learning
• Linux

Publications

Collaborative exploration and reinforcement learning between heterogeneously skilled agents in environments with sparse rewards

An Evaluation Study of Intrinsic Motivation Techniques Applied to Reinforcement Learning over Hard Exploration Environments

Collaborative training of heterogeneous reinforcement learning agents in environments with sparse rewards: what and when to share?

Towards Improving Exploration in Self-Imitation Learning using Intrinsic Motivation

Using Offline Data to Speed-up Reinforcement Learning in Procedurally Generated Environments

Enhanced Generalization through Prioritization and Diversity in Self-Imitation Reinforcement Learning over Procedural Environments with Sparse Rewards