Yes, and I think authors are already starting to make some headway (see DetectivesGame, for example, which makes some interesting architectural and design choices to keep the LLMs “on rails”).
Although (IMO) that project also illustrates an unfortunate reality of LLMs in IF—for every heartfelt, creative, human experience that effectively harnesses LLMs, there are also going to be acres of slop.