PROGRAMS BY ctokenizer.sf.net

CTokenizer accepts C++ syntax as input and outputs a vector of CToken objects, which contain a token string and a(n enumerated) token type, which can then be used to parse the input.