For supervised fine-tuning and the reinforcement learning stage, we use the DiffusionDB dataset, a large dataset of human-created prompts.
In the reinforcement learning stage, we truncate the prompt to contain only the substring before the first occurrence of a comma. This approach allows for improved exploration of paraphrasing by our policy. Do not include the following keywords: stage, comma, approach, paraphrasing
user