hi. i need to read csv files which will come as input. I am not able to do this using String tokenizer for two reasons: First StringTokenizer
doesn't handle empty strings and second it doesn't have a way to easily get Strings in quotes that have commas inside them. So, if few entries are blank, then they are not read as "" but are ignored. Please suggest a way to capture the "" also. Thanks
mayank_03_arora 0 Newbie Poster
thekashyap 193 Practically a Posting Shark
Write your own tokenizer.. should be easy enough..
mayank_03_arora 0 Newbie Poster
Write your own tokenizer.. should be easy enough..
Hi, Thanks for this but i was thinking if there is something existing that i can re-use rather than creating my own tokenizer from scratch just to bypass ignoring of "" while tokenizing?? Any idea which method of string tokenizer i should overwrite to inco-operate this functionality.
Ezzaral 2,714 Posting Sage Team Colleague Featured Poster
The code below may work for you. I can't guarantee it won't give you some mistaken replacements, since I don't know the details of your potential inputs, but you should be able to tweak it to your needs.
I made a small test file "csv.txt" that consisted of the following entries:
1,"Bob","Just Bob"
2,"Mike","Not Bob, but Mike, a different guy"
3,,"Unknown,, two commas there"and used the following code for parsing the entries:
try {
BufferedReader reader = new BufferedReader(new FileReader("c:/temp/csv.txt"));
Pattern pat = Pattern.compile(",(\".+?\")");
String line=null;
while ((line=reader.readLine())!=null){
Matcher matcher = pat.matcher(line);
StringBuffer sb = new StringBuffer();
while (matcher.find()){
matcher.appendReplacement(sb,","+matcher.group(1).replaceAll(",","&comm"));
}
matcher.appendTail(sb);
String[] fields = sb.toString().split(",");
for (int i=0;i<fields.length;i++){
String out = fields[i]!=null ? fields[i].replaceAll("&comm",",") : "";
System.out.println(out);
}
}
} catch (FileNotFoundException ex) {
ex.printStackTrace();
} catch (IOException ex) {
ex.printStackTrace();
}My example just prints each separate field to System.out, but I'm sure you can see how you would pipe them to whatever destination you needed.
Hope that helps a bit.
jwenting 1,889 duckman Team Colleague
StringTokenizer is deprecated and should not be used. There are excellent alternatives.
String has a split method, or you can use regular expressions.
iamthwee
To echo what ezz and jwenting said all you need to search for is how to use regular expressions with csv files. I bet this is a common question.
It is also useful to know about.
mayank_03_arora 0 Newbie Poster
Thanks guys.... m finding a way using regular expressions....:)
Ezzaral 2,714 Posting Sage Team Colleague Featured Poster
Regular expressions can be tricky to learn, but they are very powerful once you get the hang of them.
I wrote up a small reg ex testing form that I often use to help me test and tune the behavior of a particular pattern. I'll post it here and perhaps it will help in your learning and testing. The numbered fields at the bottom contain the match groups returned by the Matcher that is generated when you click "Test":
/*
* RegExTest.java
*/
import java.awt.Dimension;
import java.util.regex.Matcher;
import java.util.regex.Pattern;
import javax.swing.UIManager;
public class RegExTest extends javax.swing.JFrame {
/** Creates new form RegExTest */
public RegExTest() {
try {
UIManager.setLookAndFeel("com.sun.java.swing.plaf.windows.WindowsLookAndFeel");
} catch (Exception ex) { }
Dimension screenDim = getToolkit().getScreenSize();
initComponents();
setBounds((screenDim.width-getBounds().width)/2, (screenDim.height-getBounds().height)/2, getBounds().width, getBounds().height);
getRootPane().setDefaultButton(btnTest);
}
private javax.swing.JButton btnTest;
private javax.swing.JLabel jLabel1;
private javax.swing.JLabel jLabel2;
private javax.swing.JLabel jLabel3;
private javax.swing.JLabel jLabel4;
private javax.swing.JLabel jLabel5;
private javax.swing.JLabel jLabel6;
private javax.swing.JLabel jLabel7;
private javax.swing.JLabel jLabel8;
private javax.swing.JLabel jLabel9;
private javax.swing.JLabel lblResult;
private javax.swing.JTextField txt0;
private javax.swing.JTextField txt1;
private javax.swing.JTextField txt2;
private javax.swing.JTextField txt3;
private javax.swing.JTextField txt4;
private javax.swing.JTextField txt5;
private javax.swing.JTextField txtPattern;
private javax.swing.JTextField txtText;
private void initComponents() {
java.awt.GridBagConstraints gridBagConstraints;
jLabel1 = new javax.swing.JLabel();
jLabel2 = new javax.swing.JLabel();
txtPattern = new javax.swing.JTextField();
txtText = new javax.swing.JTextField();
lblResult = new javax.swing.JLabel();
btnTest = new javax.swing.JButton();
txt0 = new javax.swing.JTextField();
txt1 = new javax.swing.JTextField();
txt2 = new javax.swing.JTextField();
jLabel3 = new javax.swing.JLabel();
jLabel4 = new javax.swing.JLabel();
jLabel5 = new javax.swing.JLabel();
jLabel6 = new javax.swing.JLabel();
txt3 = new javax.swing.JTextField();
jLabel7 = new javax.swing.JLabel();
txt4 = new javax.swing.JTextField();
jLabel8 = new javax.swing.JLabel();
txt5 = new javax.swing.JTextField();
jLabel9 = new javax.swing.JLabel();
getContentPane().setLayout(new java.awt.GridBagLayout());
setTitle("RegEx Test");
addWindowListener(new java.awt.event.WindowAdapter() {
public void windowClosing(java.awt.event.WindowEvent evt) {
exitForm(evt);
}
});
jLabel1.setText("Pattern");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 0;
gridBagConstraints.gridy = 0;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(jLabel1, gridBagConstraints);
jLabel2.setText("Text");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 0;
gridBagConstraints.gridy = 2;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(jLabel2, gridBagConstraints);
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 1;
gridBagConstraints.gridy = 0;
gridBagConstraints.gridwidth = 6;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.weightx = 1.0;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(txtPattern, gridBagConstraints);
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 1;
gridBagConstraints.gridy = 2;
gridBagConstraints.gridwidth = 6;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.weightx = 1.0;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(txtText, gridBagConstraints);
lblResult.setText("(matches)");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 1;
gridBagConstraints.gridy = 4;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(lblResult, gridBagConstraints);
btnTest.setText("Test");
btnTest.addActionListener(new java.awt.event.ActionListener() {
public void actionPerformed(java.awt.event.ActionEvent evt) {
btnTestActionPerformed(evt);
}
});
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 0;
gridBagConstraints.gridy = 4;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(btnTest, gridBagConstraints);
txt0.setMinimumSize(new java.awt.Dimension(50, 19));
txt0.setPreferredSize(new java.awt.Dimension(60, 19));
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 1;
gridBagConstraints.gridy = 6;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.weightx = 0.1;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(txt0, gridBagConstraints);
txt1.setMinimumSize(new java.awt.Dimension(50, 19));
txt1.setPreferredSize(new java.awt.Dimension(60, 19));
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 3;
gridBagConstraints.gridy = 6;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.weightx = 0.1;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(txt1, gridBagConstraints);
txt2.setMinimumSize(new java.awt.Dimension(50, 19));
txt2.setPreferredSize(new java.awt.Dimension(60, 19));
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 5;
gridBagConstraints.gridy = 6;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.weightx = 0.1;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(txt2, gridBagConstraints);
jLabel3.setHorizontalAlignment(javax.swing.SwingConstants.RIGHT);
jLabel3.setText("0");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 0;
gridBagConstraints.gridy = 6;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.EAST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 0);
getContentPane().add(jLabel3, gridBagConstraints);
jLabel4.setHorizontalAlignment(javax.swing.SwingConstants.RIGHT);
jLabel4.setText("1");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 2;
gridBagConstraints.gridy = 6;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.EAST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 0);
getContentPane().add(jLabel4, gridBagConstraints);
jLabel5.setHorizontalAlignment(javax.swing.SwingConstants.RIGHT);
jLabel5.setText("2");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 4;
gridBagConstraints.gridy = 6;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.EAST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 0);
getContentPane().add(jLabel5, gridBagConstraints);
jLabel6.setHorizontalAlignment(javax.swing.SwingConstants.RIGHT);
jLabel6.setText("3");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 0;
gridBagConstraints.gridy = 8;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.EAST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 0);
getContentPane().add(jLabel6, gridBagConstraints);
txt3.setMinimumSize(new java.awt.Dimension(50, 19));
txt3.setPreferredSize(new java.awt.Dimension(60, 19));
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 1;
gridBagConstraints.gridy = 8;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.weightx = 0.1;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(txt3, gridBagConstraints);
jLabel7.setHorizontalAlignment(javax.swing.SwingConstants.RIGHT);
jLabel7.setText("4");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 2;
gridBagConstraints.gridy = 8;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.EAST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 0);
getContentPane().add(jLabel7, gridBagConstraints);
txt4.setMinimumSize(new java.awt.Dimension(50, 19));
txt4.setPreferredSize(new java.awt.Dimension(60, 19));
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 3;
gridBagConstraints.gridy = 8;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.weightx = 0.1;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(txt4, gridBagConstraints);
jLabel8.setHorizontalAlignment(javax.swing.SwingConstants.RIGHT);
jLabel8.setText("5");
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 4;
gridBagConstraints.gridy = 8;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.EAST;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 0);
getContentPane().add(jLabel8, gridBagConstraints);
txt5.setMinimumSize(new java.awt.Dimension(50, 19));
txt5.setPreferredSize(new java.awt.Dimension(60, 19));
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 5;
gridBagConstraints.gridy = 8;
gridBagConstraints.fill = java.awt.GridBagConstraints.HORIZONTAL;
gridBagConstraints.anchor = java.awt.GridBagConstraints.NORTHWEST;
gridBagConstraints.weightx = 0.1;
gridBagConstraints.insets = new java.awt.Insets(5, 5, 5, 5);
getContentPane().add(txt5, gridBagConstraints);
gridBagConstraints = new java.awt.GridBagConstraints();
gridBagConstraints.gridx = 6;
gridBagConstraints.gridy = 9;
gridBagConstraints.fill = java.awt.GridBagConstraints.BOTH;
gridBagConstraints.weightx = 0.9;
gridBagConstraints.weighty = 1.0;
getContentPane().add(jLabel9, gridBagConstraints);
pack();
}
private void btnTestActionPerformed(java.awt.event.ActionEvent evt) {
try{
txt0.setText("");
txt1.setText("");
txt2.setText("");
txt3.setText("");
txt4.setText("");
txt5.setText("");
Pattern p = Pattern.compile(txtPattern.getText());
Matcher m = p.matcher(txtText.getText());
boolean result = m.matches();
lblResult.setText(String.valueOf(result));
txt0.setText(m.group(0));
txt1.setText(m.group(1));
txt2.setText(m.group(2));
txt3.setText(m.group(3));
txt4.setText(m.group(4));
txt5.setText(m.group(5));
} catch (Exception e){}
}
/** Exit the Application */
private void exitForm(java.awt.event.WindowEvent evt) {
System.exit(0);
}
/**
* @param args the command line arguments
*/
public static void main(String args[]) {
new RegExTest().show();
}
}It's certainly nothing special (fixed number of group fields, no error handling, nothing you would ever want to put in production!), just a quick-and-dirty test harness, but perhaps it will help :)
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.