Debugging a new RL manipulation environment
March 3, 2026
Training a simple manipulation policy in sim with RL, and the trials and tribulations of bringing up a new environment
Blog
March 3, 2026
Training a simple manipulation policy in sim with RL, and the trials and tribulations of bringing up a new environment
February 16, 2026
Training an end-to-end locomotion policy that can use depth sensor input, with RL
December 22, 2024
What's the best way to cut a straight line to fit a curve?
October 22, 2024
Reimplementing the VINN paper, a non-parametric way of behaviour cloning direct from data.
September 6, 2024
I created a basic imitation learning policy from the ground up to see what it could learn. Spoiler - not much.
August 11, 2024
How to start with a robot arm - from first motions in simulation to the real world. Inverse kinematics, trajectories, position control, velocity control, in MuJoCo and on an Ufactory Lite 6.