EWBTokenFactory for PHP

License: Free ‎File size: N/A
‎Users Rating: 5.0/5 - ‎1 ‎votes

EWBTokenFactory for PHP is a whitespace inclusive tokenizer. Most tokenizers will grab each word as a token and drop the whitespace. This tokenizer will also tokenize the spaces in between into their own tokens. Also supports associated token data.

VERSION HISTORY

  • Version files posted on 2009-12-12
    Several fixes and updates
  • Version N/A posted on 2009-12-12

Program Details