How to add delimiters from the StringTokenizers to a seperate string?

Question

I am inputting a string and I want to add the delimeters in that string to a different string and I was wondering how you would do that. This is the code I have at the moment.

StringTokenizer tokenizer = new StringTokenizer(input, "'.,><-=[]{}+!@#$%^&*()~`;/?"); while (tokenizer.hasMoreTokens()){ //add delimeters to string here }

Any help would be greatly appreciated(:

you mean you want to use any of this characters as delimiter? — Nikolay Kuznetsov
– Nikolay Kuznetsov, Commented Jan 4, 2013 at 5:04
question is not clear; can u give some example on your expected output — Deepak Singhal
– Deepak Singhal, Commented Jan 4, 2013 at 5:06
yes, I want to use all of those punctuation marks as delimiters. An example of my output would be a string that is "!!@#.." if input = "2!3!ab@#gh.hhhh." — user1755178
– user1755178, Commented Jan 4, 2013 at 5:09

Karthik T · Accepted Answer · 2013-01-04 05:14:51Z

If you want StringTokenizer to return the delimiters it parses, you would need to add a flag to the constructor as shown here

StringTokenizer tokenizer = new StringTokenizer(input, "'.,><-=[]{}+!@#$%^&*()~`;/?", true);

But if you are searching only for delimiters I dont think this is the right approach.

If I add a flag, then how do I ask it to return the delimiter? And I am searching for both delimiters and the letters that are not delimiters in the string

Evgeniy Dorofeev · Accepted Answer · 2013-01-04 05:18:34Z

1

I don't think StringTokenizer is good for this task, try

 StringBuilder sb = new StringBuilder(); for(char c : input.toCharArray()) { if ("'.,><-=[]{}+!@#$%^&*()~`;/?".indexOf(c) >= 0) { sb.append(c); } }

answered Jan 4, 2013 at 5:18

Evgeniy Dorofeev

137k31 gold badges209 silver badges288 bronze badges

2 Comments

user1755178 Over a year ago

I've never used StringBuilder before...can you construct one that is of unknown size? Since the initial capacity is 16 characters, can it hold more than that if you keep adding characters to the string?

Evgeniy Dorofeev Over a year ago

You can, eg new StringBuilder(32), but in our case the length is not known. We should not worry about it, StringBuilder will increase capacity when need be. And finally you make a String of it as sb.toString();

Aditya · Accepted Answer · 2013-01-04 05:25:18Z

I'm guessing you want to extract all the delimiters from the string and process them

String allTokens = "'.,><-=[]{}+!@#$%^&*()~`;/?"; StringTokenizer tokenizer = new StringTokenizer(input, allTokens, true); while(tokenizer.hasMoreTokens()) { String nextToken = tokenizer.nextToken(); if(nextToken.length()==1 && allTokens.contains(nextToken)) { //this token is a delimiter //append to string or whatever you want to do with the delimiter processDelimiter(nextToken); } }

Create a processDelimiter method in which you add the delimiter to a different string or perform any action you want.

If the previous answer does not work for me, I will try this out. Thank you!

Shiva Komuravelly · Accepted Answer · 2013-01-04 05:30:47Z

This would even take care of repeated usage of delimeters

String input = "adfhkla.asijdf.';.akjsdhfkjsda"; String compDelims = "'.,><-=[]{}+!@#$%^&*()~`;/?"; String delimsUsed = ""; for (char a : compDelims.toCharArray()) { if (input.indexOf(a) > 0 && delimsUsed.indexOf(a) == -1) { delimsUsed += a; } } System.out.println("The delims used are " + delimsUsed);

Collectives™ on Stack Overflow

How to add delimiters from the StringTokenizers to a seperate string?

4 Answers 4

1 Comment

2 Comments

1 Comment

Comments

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

1 Comment

2 Comments

1 Comment

Comments

Related