UserSimCRS 0.0.1 documentation¶
UserSimCRS is an extensible user simulation toolkit for evaluating conversational recommender systems.
It is built on top of the DialogueKit library, which provides basic dialogue management functionalities.
UserSimCRS follows the architecture of a typical task-based dialogue system, which consists of natural language understanding, response generation, and natural language generation components. Additionally, there is a dedicated user modeling component in order to make simulation more human-like.
This toolkit offers repeatable and reproducible means of evaluation that can complement human evaluation. UserSimCRS is designed to work with existing conversational recommender systems, without needing access to source code or knowledge of their inner workings. UserSimCRS can also be extended with other simulation approaches and more advanced user modeling capabilities.