A local assistant that answers programming questions from a code corpus, reviews its own answers and retries when they fall short.


Machine Learning & AI Engineer · Zaragoza, Spain
Abstract. I am a machine learning engineer with a research background in reinforcement learning and robotics. I hold an MSc in Computer Science from the University of Innsbruck, have published on reinforcement learning for robot navigation, and have put models in front of real users, from eye-tracking diagnostics validated with over 4,000 patients to LLM solutions for industry clients.
Most of my recent work is on LLMs, retrieval and agents, where I care as much about measuring a system as about building it.
A local assistant that answers programming questions from a code corpus, reviews its own answers and retries when they fall short.


A Llama-style language model written from scratch in PyTorch, small enough to pre-train on a laptop, then fine-tuned with reinforcement learning.


A reimplementation of the MOReL offline reinforcement learning framework with the improvements I proposed in my MSc thesis. It outperforms the original on the D4RL HalfCheetah benchmark.


An end-to-end machine learning system, from Spark data processing to a public forecasting app on Google Cloud.


Multiverse Computing
Aragón Health Research Institute (IIS Aragón)
University of Zaragoza, Graphics & Imaging Lab
Hiberus Tecnología
University of Innsbruck
Specialisation in Robotics, Perception and Interaction. Final grade: Excellent, 96/100.
University of Zaragoza
Specialisation in Computing.
A. K. Mackay, L. Riazuelo, L. Montano. Sensors 22(10), 3847, 2022.
A reinforcement learning planner for service robots that navigate among people moving unpredictably. Instead of learning from raw lidar or camera data, the agent sees the scene as a dynamic object velocity space (DOVS): which velocities are safe for the robot, given its kinodynamic constraints and the obstacles’ motion. This representation makes training faster than learning from raw sensors.
@article{mackay2022rldovs,
title = {{RL-DOVS}: Reinforcement Learning for Autonomous Robot Navigation in Dynamic Environments},
author = {Mackay, Andrew K. and Riazuelo, Luis and Montano, Luis},
journal = {Sensors},
volume = {22},
number = {10},
pages = {3847},
year = {2022},
doi = {10.3390/s22103847}
}MSc thesis, University of Innsbruck. Awarded the highest grade.
Learns a model of the environment’s dynamics from offline data with neural-network ensembles, then uses it to choose actions while penalising predictions the ensemble disagrees on. The work is public as three projects: J-MOReL, an improved reimplementation of the MOReL offline RL framework; MBiCEM, a trajectory planner that runs iCEM on learned models; and the dynamics ensembles both are built on.
BEng thesis, University of Zaragoza. Extended into the RL-DOVS journal article.
Looking for hands-on ML and AI engineering roles. The quickest way to reach me is by email at andrewkm210@gmail.com. My code is on GitHub, and I am also on LinkedIn.