PHP Classes

File: tokenizer.php

Recommend this page to a friend!
  Classes of Domenico Pontari   Tokenizer   tokenizer.php  
File: tokenizer.php
Role: Class source
Content type: text/plain
Description: source code
Class: Tokenizer
Tokenizer split strings into tokens
Author: By
Last change: New algorithm for the generation of tokens: using "explode" function instead of "preg_split". So that it is easier to manage special chars. Performances improvement expected.
Date: 12 years ago
Size: 13,263 bytes

You need to be a registered user and login to get this file.

Login Immediately with your account on: