I'm not sure the authors realize this is way more than "just a cool demo": if this holds up, it's going to be huge for game QA work.

Instrument your game to output properties of entities near the player and the output is the various control inputs - moment to moment gameplay gets solved. Maybe augment with a tick-by-tick controlled stepping mode if particularly twitchy - an LLM can take care of the higher level reasoning then.