Stanford Tokenizer


Stanford Tokenizer is an ancillary tool that uses tokenization to provide the ability to split text into sentences. PTBTokenizer mainly targets formal English writing rather than SMS-speak.

Work for Stanford Tokenizer?

Learning about Stanford Tokenizer?

We can help you find the solution that fits you best.

Stanford Tokenizer Reviews

Chat with a G2 Advisor
Write a Review
Filter Reviews
Filter Reviews
Company Size
Showing 1 Stanford Tokenizer review
LinkedIn Connections
Stanford Tokenizer review by G2 Crowd User
G2 Crowd User
Validated Reviewer
Review Source

"favorite tokenizer"

What do you like best?

I have been using Stanford tokenizer for six years and I love it. It's easy to integrate with any application and can recognize special character like ",", "$" etc. It also has the functionality of removing token matched with some regex. It also has a variety of configuration according to the user's requirements.

What do you dislike?

It converts bracket to other symbols e.g. LCB-, -LRB-, -RCB-, -RRB which sometimes require extra processing later.

What business problems are you solving with the product? What benefits have you realized?

NLP related problems.

Sign in to G2 Crowd to see what your connections have to say about Stanford Tokenizer

What Natural Language Processing (NLP) solution do you use?

Thanks for letting us know!
Kate from G2 Crowd

Learning about Stanford Tokenizer?

I can help.
* We monitor all Stanford Tokenizer reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. Validated reviews require the user to submit a screenshot of the product containing their user ID, in order to verify a user is an actual user of the product.