This paper presents first results from an ongoing research initiative to develop an interactive storytelling application to support teaching English as a second language for children in schools. Considering the necessity to accommodate to both students’ and teachers’ needs, we provide a summarized review of relevant systems and discuss the envisioned challenges concerning the specific aim we are addressing. Furthermore, we present different usage scenarios closely related to the concept of role playing and its application within this problem space.