private Token token(TokenKind tokenkind, String data, int start, int end) {
		return new Token(tokenkind, data.toCharArray(), start, end);
	}
Check the tokenizer breaks strings up into correct token streams.

@author Andy Clement
spring-xd-dirt/src/test/java/org/springframework/xd/dirt/stream/dsl/TokenizerTests.java