Pocket FM is working on making AI better at keeping long stories consistent. And this is super interesting:
The research behind Sherpa introduces a Narrative World Model that tracks what characters know, how their relationships change, and which storylines are still unresolved.
In the team’s tests, it answered 89.8% of 176 questions requiring information from multiple chapters correctly. Graphiti, another AI memory system, scored 57.4%. Both used the same AI model to answer, with different systems supplying the story information.
On a separate public set of 576 questions, the scores were 62.5% versus 51.6%.
These results show better recall of story details. Whether that translates into better writing still needs to be tested.