EWBTokenFactory for PHP
License: Free File size: N/A
Users Rating: 5.0/5 - 1 votes
Please wait ... Your download link is being verified for malicious content.
You'll be able to download in 5 seconds.
You'll be able to download in 5 seconds.
ABOUT EWBTokenFactory for PHP
EWBTokenFactory for PHP is a whitespace inclusive tokenizer. Most tokenizers will grab each word as a token and drop the whitespace. This tokenizer will also tokenize the spaces in between into their own tokens. Also supports associated token data.