CTokenizer

License: Free ‎File size: N/A
‎Users Rating: 3.0/5 - ‎1 ‎votes

CTokenizer accepts C++ syntax as input and outputs a vector of CToken objects, which contain a token string and a(n enumerated) token type, which can then be used to parse the input.

VERSION HISTORY

  • Version N/A posted on 2009-06-21
    Several fixes and updates
  • Version N/A posted on 2009-06-21

Program Details