EN
Java - how to read CSV file into java object with list of numbers using Jackson CSV library
6 points
In this post we will read CSV file into java pojo object with list of numbers using Jackson CSV processor.
This example contains 2 lists. First list contains Integers, second list contains Doubles.
Lists of Integer and Double in UserWithListsDto class:
- List<Integer> numbers
- List<Double> floatingPointNumbers
To use Jackson CSV library we need to add jackson-dataformat-csv dependency to pom.xml.
xxxxxxxxxx1
<dependency>2
<groupId>com.fasterxml.jackson.dataformat</groupId>3
<artifactId>jackson-dataformat-csv</artifactId>4
<version>2.9.9</version>5
</dependency>Below we have all classes we need to read csv file.
Ensure to create csv file on your disc and set correct path in UserWithListsCsvReader class.
To run this example copy to your project those 3 files:
- UserWithListsCsvReader
- UserWithListsDto
- users_with_numbers_list.csv
How does it work?
- UserWithListsDto has constructor with 'List<String> csvRow'.
- In UserWithListsCsvReader we read all lines from csv file and invoke constructor of UserWithListsDto with list of all columns of single line of our csv line.
I didn't find any better solution with this library, so if anyone know better way to do it, post it in comment.
2.1 Logic - UserWithListsCsvReader
Logic which reads CSV file into java UserWithListsDto pojo object with Jackson CSV library.
Usage of classes:
CsvMapper + CsvParser from jackson CSV library
MappingIterator from jackson databind library
xxxxxxxxxx1
import com.fasterxml.jackson.databind.MappingIterator;2
import com.fasterxml.jackson.dataformat.csv.CsvMapper;3
import com.fasterxml.jackson.dataformat.csv.CsvParser;4
5
import java.io.File;6
import java.io.IOException;7
import java.util.List;8
import java.util.stream.Collectors;9
10
public class UserWithListsCsvReader {11
12
public static void main(String[] args) throws IOException {13
14
// set correct path to csv file on your disc15
File csvFile = new File("C:\\csv_tests\\users_with_numbers_list.csv");16
17
CsvMapper csvMapper = new CsvMapper();18
csvMapper.enable(CsvParser.Feature.WRAP_AS_ARRAY);19
20
MappingIterator<List<String>> rows = csvMapper.readerFor(List.class)21
.readValues(csvFile);22
List<List<String>> lists = rows.readAll();23
24
List<UserWithListsDto> users = lists.stream().skip(1) // skip header25
.map(UserWithListsDto::new)26
.collect(Collectors.toList());27
28
users.forEach(System.out::println);29
}30
}Output:
xxxxxxxxxx1
UserWithListsDto{id=1, name='Ann', age=30, numbers=[100, 200, 300], floatingPointNumbers=[4.14, 2.134]}2
UserWithListsDto{id=2, name='Seth', age=25, numbers=[333, 444, 555], floatingPointNumbers=[92.123, 123.123]}3
UserWithListsDto{id=3, name='Tom', age=27, numbers=[99, 88, 77], floatingPointNumbers=[3.14, 2.71]}2.2 User Pojo object - UserWithListsDto
xxxxxxxxxx1
import java.util.ArrayList;2
import java.util.List;3
4
public class UserWithListsDto {5
6
private Long id;7
private String name;8
private Integer age;9
private List<Integer> numbers;10
private List<Double> floatingPointNumbers;11
12
public UserWithListsDto() {13
14
}15
16
public UserWithListsDto(List<String> csvRow) {17
int csvColumnIndex = 0;18
this.id = Long.valueOf(csvRow.get(csvColumnIndex++));19
this.name = csvRow.get(csvColumnIndex++);20
this.age = Integer.valueOf(csvRow.get(csvColumnIndex++));21
22
// read 3 numbers23
this.numbers = new ArrayList<>();24
for (int i = 0; i < 3; i++) {25
Integer num = Integer.valueOf(csvRow.get(csvColumnIndex++));26
numbers.add(num);27
}28
29
// read 2 double numbers30
this.floatingPointNumbers = new ArrayList<>();31
for (int i = 0; i < 2; i++) {32
Double num = Double.valueOf(csvRow.get(csvColumnIndex++));33
floatingPointNumbers.add(num);34
}35
}36
37
public Long getId() {38
return id;39
}40
41
public void setId(Long id) {42
this.id = id;43
}44
45
public String getName() {46
return name;47
}48
49
public void setName(String name) {50
this.name = name;51
}52
53
public Integer getAge() {54
return age;55
}56
57
public void setAge(Integer age) {58
this.age = age;59
}60
61
public List<Integer> getNumbers() {62
return numbers;63
}64
65
public void setNumbers(List<Integer> numbers) {66
this.numbers = numbers;67
}68
69
public List<Double> getFloatingPointNumbers() {70
return floatingPointNumbers;71
}72
73
public void setFloatingPointNumbers(List<Double> floatingPointNumbers) {74
this.floatingPointNumbers = floatingPointNumbers;75
}76
77
78
public String toString() {79
return "UserWithListsDto{" +80
"id=" + id +81
", name='" + name + '\'' +82
", age=" + age +83
", numbers=" + numbers +84
", floatingPointNumbers=" + floatingPointNumbers +85
'}';86
}87
}2.3 User with numbers list - CSV file
Save this file on disc as 'users_with_numbers_list.csv' and change location in UserWithListsCsvReader class.
xxxxxxxxxx1
id,name,age,numbers,floatingPointNumbers2
1,Ann,30,100,200,300,4.14,2.1343
2,Seth,25,333,444,555,92.123,123.1234
3,Tom,27,99,88,77,3.14,2.715
2.4 Csv reader util
UserWithListsCsvReaderUtil allows us to read csv from line or convert csv in String to java pojo objects.
xxxxxxxxxx1
import com.fasterxml.jackson.databind.MappingIterator;2
import com.fasterxml.jackson.dataformat.csv.CsvMapper;3
import com.fasterxml.jackson.dataformat.csv.CsvParser;4
5
import java.io.File;6
import java.io.IOException;7
import java.nio.file.Files;8
import java.util.Arrays;9
import java.util.List;10
import java.util.stream.Collectors;11
12
public class UserWithListsCsvReaderUtil {13
14
public static List<UserWithListsDto> readCsvFromFile(File csvFile) {15
try {16
CsvMapper csvMapper = new CsvMapper();17
csvMapper.enable(CsvParser.Feature.WRAP_AS_ARRAY);18
19
MappingIterator<List<String>> rows = csvMapper.readerFor(List.class)20
.readValues(csvFile);21
List<List<String>> lists = rows.readAll();22
23
return lists.stream().skip(1)24
.map(UserWithListsDto::new)25
.collect(Collectors.toList());26
27
} catch (IOException e) {28
throw new RuntimeException(e);29
}30
}31
32
// input - csv as 1 string - each line separated by new line '\n'33
public static List<UserWithListsDto> readCsvFromString(String csvString) {34
35
String[] csvLines = csvString.split("\n"); // 5 lines36
37
return Arrays.stream(csvLines)38
.skip(1) // skip header39
.map(csvLine -> Arrays.stream(csvLine.split(","))40
.collect(Collectors.toList()))41
.map(UserWithListsDto::new)42
.collect(Collectors.toList());43
}44
45
public static void main(String[] args) throws IOException {46
47
// set correct path to csv file on your disc48
File csvFile = new File("C:\\csv_tests\\users_with_numbers_list.csv");49
50
System.out.println("Example 1 - from file");51
List<UserWithListsDto> userWithListsDtos = readCsvFromFile(csvFile);52
userWithListsDtos.forEach(System.out::println);53
54
System.out.println();55
56
System.out.println("Example 2 - from csv line as String");57
// we can get csv via linux command line eg cat or just read all lines58
List<String> allLines = Files.readAllLines(csvFile.toPath());59
String csvInString = String.join("\n", allLines);60
61
List<UserWithListsDto> userWithListsDtos1 = readCsvFromString(csvInString);62
userWithListsDtos1.forEach(System.out::println);63
}64
}Output:
xxxxxxxxxx1
Example 1 - from file2
UserWithListsDto{id=1, name='Ann', age=30, numbers=[100, 200, 300], floatingPointNumbers=[4.14, 2.134]}3
UserWithListsDto{id=2, name='Seth', age=25, numbers=[333, 444, 555], floatingPointNumbers=[92.123, 123.123]}4
UserWithListsDto{id=3, name='Tom', age=27, numbers=[99, 88, 77], floatingPointNumbers=[3.14, 2.71]}5
6
Example 2 - from csv line as String7
UserWithListsDto{id=1, name='Ann', age=30, numbers=[100, 200, 300], floatingPointNumbers=[4.14, 2.134]}8
UserWithListsDto{id=2, name='Seth', age=25, numbers=[333, 444, 555], floatingPointNumbers=[92.123, 123.123]}9
UserWithListsDto{id=3, name='Tom', age=27, numbers=[99, 88, 77], floatingPointNumbers=[3.14, 2.71]}