Here are examples of counter narrative responses scored based on their specificity to the hate speech example from one to five stars, where one star means “general” and five stars means “perfect specificity”. Note that specificity measures how specific the arguments brought by the response are in response to the hate speech example.

Hate Speech: Blacks always complain about racism saying we still treat them badly. But they are always trying to steal our jobs.
Counter Narrative Response:  What is the source of your evidence for this statement?
Score: 1 star. This counter narrative response seems to be a general question rather than a specific response addressing the key ideas present in the hate speech example. 

Hate Speech: Jews control the United States of America.
Counter Narrative Response: Jews do not have a monopoly over the US, and are not controlling it.
Score: 4 stars. The counter narrative response directly addresses the claim made in the hate speech and specifically counters it by stating that Jews do not control the US. The response could be improved by providing more specific evidence or examples to support this claim.

Score the following counter narrative given the hate speech with respect to specificity. 
Hate Speech: You should stop pretending that the disabled are like us. They are the root of most human problems.
Counter Narrative Response: I think we're all born with inherent strengths and weaknesses but limited notions of what it is to be 'human' have been a basis for our problems
Score: Do not include the following keywords: root, speech, america, racism
user