Technically they know how sentences about leaves, throwing, and guards might be constructed in their training material, and it probably doesn’t actually know that very well, since throwing leaves to distract people is not a normal thing.
As a quick experiment I tried asking ChatGPT about the following:
You are standing in an otherwise empty park in autumn. Leaves litter the ground. A guard is blocking the path you need to take. Describe a non-violent way you could get past the guard.
and it told me a nice story about how I engaged the guard in conversation about how beautiful autumn was. I asked again about specifically using the leaf, and it had me engage the guard in conversation about the leaf which had him so distracted staring at it, that I walked past him.
I think I’ll stand by the suggestion that, for a general LLM at least, a physics engine would produce far better emergent behaviour than this
I also tried the same scenario where you explicitly playing an IF parser game
Summary
> look
You stand in an otherwise empty park, the ground scattered with fallen leaves. The cool autumn breeze stirs them gently. Ahead of you, a guard stands at the path, blocking your way. His eyes are fixed ahead, and his posture is rigid, clearly intent on his task. A few steps to your left, a bright red maple leaf lies on the ground.
> pick up leaf
You bend down and gently pluck a brilliant red maple leaf from the ground. Its vibrant color stands out against the brown and gold of the fallen leaves around you.
> approach guard
You walk toward the guard, holding the leaf in your hand. He doesn’t notice you approaching at first, his attention focused elsewhere.
> show leaf to guard
You hold the leaf up in front of the guard. “Excuse me, I found this beautiful leaf,” you say, offering it to him. “Isn’t it amazing how vibrant the colors are this time of year?”
The guard’s eyes flicker to the leaf, and his stern expression softens slightly. He reaches out, taking the leaf from your hand with a slight nod. “Yes, it’s quite stunning,” he replies, his gaze lingering on the leaf for a moment. “I haven’t seen one like it today.”
> move past guard
As the guard examines the leaf, you step around him, careful not to draw attention. He doesn’t notice you slipping past, absorbed by the delicate pattern of the leaf in his hands.
> look
You’ve successfully passed the guard. Ahead of you, the path stretches into the park, now free of obstruction. The quiet beauty of the autumn scene invites you forward.
Summary … it really likes showing the leaf to the guard!