@Test
	public void dirtyTap() {
		Tokenizer t = new Tokenizer("tap one.foo");
		checkTokens(t, token_id("tap", 0, 3), token_id("one", 4, 7), token(DOT, 7, 8), token_id("foo", 8, 11));
	}
Check the tokenizer breaks strings up into correct token streams.

@author Andy Clement
spring-xd-dirt/src/test/java/org/springframework/xd/dirt/stream/dsl/TokenizerTests.java