StringTokenizer : Java Glossary

home page go to the Java Glossary Home go to the Computer Buyer’s Glossary up jump to foot of page Google search web for more information on this topic
punctuation 0-9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z (all)
©1996-2013 Roedy Green, Canadian Mind Products
StringTokenizer
java.util.StringTokenizer breaks up Strings into chunks at delimiters and hands them to you one at a time. See this StringTokenizer code example. Watch the American spelling. Make sure files you use with StringTokenizer have a final CrLf. The long form of the constructor lets you specify the characters to use as delimiters, and whether you want those delimiters themselves considered as tokens and returned to you, or just ignored. If you are trying to parse source code with embedded comments and quoted strings, then java.util.StreamTokenizer will be more appropriate. With Java version 1.3 the meaning of StreamTokenizer.nextToken was redefined without renaming the method or even changing the docs. This means old code won’t work on 1.3 and vice versa! Phht.

Reading Numeric Data From an ASCII (American Standard Code for Information Interchange) file

Java has no built-in methods for reading data of the form: 123 456,-4.

You have to roll your own method. Use java.io.StreamTokenizer or java.util.StringTokenizer, perhaps in combination with readLine to get your data into strings. StreamTokenizer has bells and whistles to deal with parsing source code, including white space, comments and numbers. StringTokenizer just splits the text up based on delimiter characters. Then use the conversion methods in the conversion table to convert to integers etc.

StringTokenizer Method of Reading Integers From An ASCII file

Learning More

Oracle’s Javadoc on StringTokenizer class : available:
file I/O amanuensis
Files & directories
regex
Scanner
StreamTokenizer
StringTokenizer clone with lookahead
CMP homejump to top

available on the web at:

 http://mindprod.com/jgloss/stringtokenizer.html
  

optional Replicator mirror
of mindprod.com
on local hard disk J:

 J:\mindprod\jgloss\stringtokenizer.html
logo
Please email your , letters to the editor, errors, omissions, typos, formatting errors, ambiguities, unclear wording, broken/redirected link reports, suggestions to improve this page or comments to Roedy Green : feedback email. If you want your message, your name or email kept confidential, not considered for public posting, please explicitly specify that. Unless you state otherwise, I will treat your message as a letter to the editor that I may or may not publish in the feedback section. After that, it will be too late to retract it. If you disagree with something I said, especially when sending an ad-hominem attack, a rant composed mainly of obscenities or a death threat, please quote the offending passage and cite the web page where you found it, tell me why you think it is wrong, and, if possible, provide some supporting evidence. I can’t very well fix erroneous or ambiguous text if I can’t find it.
Blog
IP:[65.110.21.43]
Your face IP:[54.242.188.217]
You are visitor number 51,298.