[root@LV-NDCNS-DPI-ALITY Step4]# cat 20170228-NS_workflow9999_step4_job1-SPB-LVI\

[2\].log
[2017-03-03 03:50:57,200] SV-ETL-JOB_PROCESS 000001: Start processing
/usr/local/sandvine/var/etl/jobrunningqueue/20170228-NS_workflow9999_step4_job1-
SPB-LVI[2].xml
[03:50:57,200] Load configuration
[03:50:57,520] Working directory: /usr/local/sandvine/var/etl
[03:50:57,682] Create table SubscriberList
[03:50:57,947] Process CSV file: DimSubscriber
[03:50:57,962] loading NS_WF0030_S10_J1.csv.gz ...
[03:50:59,821] 1 million lines
[03:51:01,346] 2 million lines
[03:51:02,452] 3 million lines
[03:51:03,572] 4 million lines
[03:51:04,728] 5 million lines
[03:51:07,572] 6 million lines
[03:51:09,897] 7 million lines
[03:51:10,892] 8 million lines
[03:51:12,078] 9 million lines
[03:51:13,319] 10 million lines
[03:51:14,708] 11 million lines
[03:51:16,480] 12 million lines
[03:51:17,836] 13 million lines
[03:51:19,260] 14 million lines
[03:51:20,851] 15 million lines
[03:51:22,865] 16 million lines
[03:51:25,344] 17 million lines
[03:51:29,048] 18 million lines
[03:51:29,062] [com.sandvine.etl.task.TaskExecuteException]: A CSV file error
occurred while executing a task - A parse exception occurred while handling CSV
line - Cannot insert into memory table 'SubscriberList' because it is full with
'18,000,000' elements
Trace:
com.sandvine.etl.task.transform.ProcessCSVFileTask.processOneFile(ProcessCSVFileTas
k.java:101)
com.sandvine.etl.task.transform.ProcessCSVFileTask.execute(ProcessCSVFileTask.java:
133)
com.sandvine.etl.jobprocessor.JobApplication.mainline(JobApplication.java:243)
com.sandvine.etl.application.Application.run(Application.java:258)
java.lang.Thread.run(Thread.java:745)
Caused By:
[com.sandvine.etl.csv.CSVLineHandlerException]: A parse exception occurred while
handling CSV line - Cannot insert into memory table 'SubscriberList' because it is
full with '18,000,000' elements
Trace:
com.sandvine.etl.task.transform.CreateMemoryTableRowCSVLineHandler.handleLineImpl(C
reateMemoryTableRowCSVLineHandler.java:77)
com.sandvine.etl.task.transform.FilteredMemoryTableRowCSVLineHandler.handleLine(Fil
teredMemoryTableRowCSVLineHandler.java:65)
com.sandvine.etl.task.transform.LoadMemoryTableCSVLineHandler.handleLineImpl(LoadMe
moryTableCSVLineHandler.java:175)
com.sandvine.etl.task.transform.FilteredJobCSVLineHandler.handleLine(FilteredJobCSV
LineHandler.java:83)
com.sandvine.etl.task.transform.ProcessCSVFileTask$ProcessCSVLineHandler.handleLine
Impl(ProcessCSVFileTask.java:365)
com.sandvine.etl.task.transform.FilteredJobCSVLineHandler.handleLine(FilteredJobCSV
LineHandler.java:83)
com.sandvine.etl.csv.CSVParser.handleEndOfLine(CSVParser.java:168)
com.sandvine.etl.csv.CSVParser.processBuffer(CSVParser.java:385)
com.sandvine.etl.csv.CSVParser.load(CSVParser.java:522)
com.sandvine.etl.csv.CSVParser.loadCompressedFile(CSVParser.java:540)
com.sandvine.etl.csv.CSVParser.load(CSVParser.java:595)
com.sandvine.etl.csv.CSVInputFile.load(CSVInputFile.java:24)
com.sandvine.etl.task.transform.ProcessCSVFileTask.processOneFile(ProcessCSVFileTas
k.java:83)
com.sandvine.etl.task.transform.ProcessCSVFileTask.execute(ProcessCSVFileTask.java:
133)
com.sandvine.etl.jobprocessor.JobApplication.mainline(JobApplication.java:243)
(2 lines more.)
Caused By:
[com.sandvine.etl.table.MemoryTableException]: Cannot insert into memory table
'SubscriberList' because it is full with '18,000,000' elements
Trace: com.sandvine.etl.table.MemoryTable.createRow(MemoryTable.java:174)
com.sandvine.etl.task.transform.CreateMemoryTableRowCSVLineHandler.handleLineImpl(C
reateMemoryTableRowCSVLineHandler.java:72)
com.sandvine.etl.task.transform.FilteredMemoryTableRowCSVLineHandler.handleLine(Fil
teredMemoryTableRowCSVLineHandler.java:65)
com.sandvine.etl.task.transform.LoadMemoryTableCSVLineHandler.handleLineImpl(LoadMe
moryTableCSVLineHandler.java:175)
com.sandvine.etl.task.transform.FilteredJobCSVLineHandler.handleLine(FilteredJobCSV
LineHandler.java:83)
com.sandvine.etl.task.transform.ProcessCSVFileTask$ProcessCSVLineHandler.handleLine
Impl(ProcessCSVFileTask.java:365)
com.sandvine.etl.task.transform.FilteredJobCSVLineHandler.handleLine(FilteredJobCSV
LineHandler.java:83)
com.sandvine.etl.csv.CSVParser.handleEndOfLine(CSVParser.java:168)
com.sandvine.etl.csv.CSVParser.processBuffer(CSVParser.java:385)
com.sandvine.etl.csv.CSVParser.load(CSVParser.java:522)
com.sandvine.etl.csv.CSVParser.loadCompressedFile(CSVParser.java:540)
com.sandvine.etl.csv.CSVParser.load(CSVParser.java:595)
com.sandvine.etl.csv.CSVInputFile.load(CSVInputFile.java:24)
com.sandvine.etl.task.transform.ProcessCSVFileTask.processOneFile(ProcessCSVFileTas
k.java:83)
com.sandvine.etl.task.transform.ProcessCSVFileTask.execute(ProcessCSVFileTask.java:
133)
(3 lines more.)

[03:51:29,078] Execution time: 0:00:31.879

[03:51:29,079] Table statistics
[03:51:29,079] Table 'SubscriberList' contains 18,000,000 items in 928 MB
allocated memory with 424 MB still available
[03:51:29,080] Index: 20,700,000 available, used: 18,000,000
[03:51:29,081] Inserts: 18,000,000 duplicates: 0
[03:51:29,081] Lookups: hits 0 misses 18,000,001