Delimited Got XX columns, but expected only 1?
Originally posted by: jchartrand
I'm not sure what I'm doing wrong here... I have a very large .TXT file with 3M rows of data that I'm trying to load into lavastorm.
Input Tab
File: Filepath
Filename Expr: Blank
FieldDelimiter: "|" (no quotations)
RecordDelimiter: \n
It's telling me that it Got 32 columns, but expected only 1.
Below is a sample of some of my records that I'm able to view by adding a second pin to capture errors.
Period Type|Period|Mfr Name|Distributor Name|Distributor ID|Oper Org Group ID|Oper Org Group Name|Oper Org Level 2 ID|Oper Org Level 2 Name|Oper Org Level 3 ID|Oper Org Level 3 Name|Oper Org Level 4 ID|Oper Org Level 4 Name|Operator Name|Operator ID|Active Operator|Financial Code|MIN|Brand|Item Description|Expected Ship UOM|Dist Quantity|Dist Item ID|Dist Mfr. Item ID|Dist Txn. Date|Dist Txn. Month|Total Vol|Case Qty|Finalized Trans|Mfr Rebates|Period From|Period To
Processing|September 2013|Rich Products of Canada|Sysco Central Ontario|DC-2006-00017|FC-2003-06014|Company Name|FC-2003-06019|Eurest Dining Services Sector 03|FC-2004-00464|Region 03 Eurest - Central Ont|FC-2003-06568|Enbridge Consumer Gas - 23053|Company Name|FC-2003-06014|Y|23053|00750903034991|Rich's|Cupcakes Chocolate Uniced 144/1.15 Oz|CA|1|7101963|750903034991|09-20-2013|Sep - 2013|48.66|1|Y|.25|September 2014|Aug 2015
Processing|September 2013|Unilever Best Foods|Sysco Central Ontario|DC-2006-00017|FC-2003-06014|Company Name|FC-2003-06019|Eurest Dining Services Sector 03|FC-2004-00461|Region 03 Eurest - Eastern Ont|FC-2004-00133|City of Ottawa - Constellation - 23972|Company Name|FC-2003-06014|Y|23972|10063350061814|Hellmann's|Mayonnaise 1/20 Lt|CA|1|2389450|10063350061814|09-23-2013|Sep - 2013|57.32|1|Y|8.04|September 2014|Aug 2015
Processing|September 2013|International Paper|Sysco Central Ontario|DC-2006-00017|FC-2003-06014|Company Name|FC-2003-06019|Eurest Dining Services Sector 03|FC-2004-00461|Region 03 Eurest - Eastern Ont|FC-2004-00133|City of Ottawa - Constellation - 23972|Company Name|FC-2003-06014|Y|23972|50794297687598|International Paper|Cup Hot 16 Oz Plain White Paper 1/1000 Ct (SMR-16)|CA|1|7300892|50794297687598|09-20-2013|Sep - 2013|98.37|1|Y|33.79|September 2014|Aug 2015
Processing|September 2013|Victory's Kitchen LTD|Sysco Victoria|DC-2006-00018|FC-2003-06014|Company Name|FC-2003-06031|Morrison's Health Care Sector 13|FC-2005-00344|Region 13 Morrison - SSD BC LM|FC-2004-00546|VIHA - Royal Jubilee Patient - 65108|Company Name|FC-2003-06014|Y|65108|10056610120741|Victory's Kitchen|Soup Cream of Tomato 6/2.27 Kg|CA|2|1894171|10056610120741|09-06-2013|Sep - 2013|78.42|2|Y|11.88|September 2014|Aug 2015
Processing|September 2013|Sysco Produce|Sysco Victoria|DC-2006-00018|FC-2003-06014|Company Name|FC-2003-06031|Morrison's Health Care Sector 13|FC-2005-00344|Region 13 Morrison - SSD BC LM|FC-2004-00546|VIHA - Royal Jubilee Patient - 65108|Company Name|FC-2003-06014|Y|65108|00074865906951|Sysco Fresh Produce|Tomato 6X7 Bulk Ready 1/25 Lb|CA|1|9912130|74865906951|09-16-2013|Sep - 2013|37.19|1|Y|0|September 2014|Aug 2015
Processing|September 2013|High Liner Foods|Sysco Calgary|DC-2003-00213|FC-2003-06014|Company Name|FC-2003-06019|Eurest Dining Services Sector 03|FC-2010-00829|Region 03 Eurest - AB Corrections|FC-2006-00080|Lethbridge Correctional - 60564|Company Name|FC-2003-06014|Y|60564|10061763028707|High Liner Foodservice**|Cod Cakes Breaded 1/4.54 Kg|CA|6|2728491|10061763028707|09-09-2013|Sep - 2013|127.26|6|Y|19.8|September 2014|Aug 2015
Processing|September 2013|Mission Food|Sysco Lakeside|DC-2003-00206|FC-2003-06014|Company Name|FC-2003-06015|Chartwells K-12 Sector 01|FC-2009-00030|Region 01 Chartwells K-12 - NS|FC-2010-00705|Brookside Junior High School - 71436|Company Name|FC-2003-06014|Y|71436|00073731310830|Mission|Tortilla Flour Hearty Grain 6 In 24/12 Ct|CA|1|1960604|73731310830|09-19-2013|Sep - 2013|32.42|1|Y|0|September 2014|Aug 2015
Processing|October 2013|MacGregors Meat and Seafood|Sysco Mount Pearl|DC-2003-00208|FC-2003-06014|Company Name|FC-2003-06015|Chartwells K-12 Sector 01|FC-2009-00037|Region 01 Chartwells K-12 - NFLD|FC-2003-06968|Gonzaga High School - 71633|Company Name|FC-2003-06014|Y|71633|10776578956526|MacGregors|Beef Ground Patty Premium FC 80/2 Oz 1/10 Kg|CA|1|2350153|10776578956526|10-21-2013|Oct - 2013|39.29|1|Y|7.58|September 2014|Aug 2015
Processing|October 2013|Rich Products of Canada|Sysco Edmonton|DC-2003-00216|FC-2003-06014|Company Name|FC-2003-06015|Chartwells K-12 Sector 01|FC-2010-00824|Region 01 Chartwells K-12 - AB|FC-2003-07292|Memorial Composite High School - 61517|Company Name|FC-2003-06014|Y|61517|00049800088030|Rich's|Dough Wheat Sub Roll 60/6 Oz|CA|1|1281377|49800088030|10-31-2013|Oct - 2013|23.78|1|Y|3.25|September 2014|Aug 2015
I'm not sure what I'm doing wrong here... I have a very large .TXT file with 3M rows of data that I'm trying to load into lavastorm.
Input Tab
File: Filepath
Filename Expr: Blank
FieldDelimiter: "|" (no quotations)
RecordDelimiter: \n
It's telling me that it Got 32 columns, but expected only 1.
Below is a sample of some of my records that I'm able to view by adding a second pin to capture errors.
Period Type|Period|Mfr Name|Distributor Name|Distributor ID|Oper Org Group ID|Oper Org Group Name|Oper Org Level 2 ID|Oper Org Level 2 Name|Oper Org Level 3 ID|Oper Org Level 3 Name|Oper Org Level 4 ID|Oper Org Level 4 Name|Operator Name|Operator ID|Active Operator|Financial Code|MIN|Brand|Item Description|Expected Ship UOM|Dist Quantity|Dist Item ID|Dist Mfr. Item ID|Dist Txn. Date|Dist Txn. Month|Total Vol|Case Qty|Finalized Trans|Mfr Rebates|Period From|Period To
Processing|September 2013|Rich Products of Canada|Sysco Central Ontario|DC-2006-00017|FC-2003-06014|Company Name|FC-2003-06019|Eurest Dining Services Sector 03|FC-2004-00464|Region 03 Eurest - Central Ont|FC-2003-06568|Enbridge Consumer Gas - 23053|Company Name|FC-2003-06014|Y|23053|00750903034991|Rich's|Cupcakes Chocolate Uniced 144/1.15 Oz|CA|1|7101963|750903034991|09-20-2013|Sep - 2013|48.66|1|Y|.25|September 2014|Aug 2015
Processing|September 2013|Unilever Best Foods|Sysco Central Ontario|DC-2006-00017|FC-2003-06014|Company Name|FC-2003-06019|Eurest Dining Services Sector 03|FC-2004-00461|Region 03 Eurest - Eastern Ont|FC-2004-00133|City of Ottawa - Constellation - 23972|Company Name|FC-2003-06014|Y|23972|10063350061814|Hellmann's|Mayonnaise 1/20 Lt|CA|1|2389450|10063350061814|09-23-2013|Sep - 2013|57.32|1|Y|8.04|September 2014|Aug 2015
Processing|September 2013|International Paper|Sysco Central Ontario|DC-2006-00017|FC-2003-06014|Company Name|FC-2003-06019|Eurest Dining Services Sector 03|FC-2004-00461|Region 03 Eurest - Eastern Ont|FC-2004-00133|City of Ottawa - Constellation - 23972|Company Name|FC-2003-06014|Y|23972|50794297687598|International Paper|Cup Hot 16 Oz Plain White Paper 1/1000 Ct (SMR-16)|CA|1|7300892|50794297687598|09-20-2013|Sep - 2013|98.37|1|Y|33.79|September 2014|Aug 2015
Processing|September 2013|Victory's Kitchen LTD|Sysco Victoria|DC-2006-00018|FC-2003-06014|Company Name|FC-2003-06031|Morrison's Health Care Sector 13|FC-2005-00344|Region 13 Morrison - SSD BC LM|FC-2004-00546|VIHA - Royal Jubilee Patient - 65108|Company Name|FC-2003-06014|Y|65108|10056610120741|Victory's Kitchen|Soup Cream of Tomato 6/2.27 Kg|CA|2|1894171|10056610120741|09-06-2013|Sep - 2013|78.42|2|Y|11.88|September 2014|Aug 2015
Processing|September 2013|Sysco Produce|Sysco Victoria|DC-2006-00018|FC-2003-06014|Company Name|FC-2003-06031|Morrison's Health Care Sector 13|FC-2005-00344|Region 13 Morrison - SSD BC LM|FC-2004-00546|VIHA - Royal Jubilee Patient - 65108|Company Name|FC-2003-06014|Y|65108|00074865906951|Sysco Fresh Produce|Tomato 6X7 Bulk Ready 1/25 Lb|CA|1|9912130|74865906951|09-16-2013|Sep - 2013|37.19|1|Y|0|September 2014|Aug 2015
Processing|September 2013|High Liner Foods|Sysco Calgary|DC-2003-00213|FC-2003-06014|Company Name|FC-2003-06019|Eurest Dining Services Sector 03|FC-2010-00829|Region 03 Eurest - AB Corrections|FC-2006-00080|Lethbridge Correctional - 60564|Company Name|FC-2003-06014|Y|60564|10061763028707|High Liner Foodservice**|Cod Cakes Breaded 1/4.54 Kg|CA|6|2728491|10061763028707|09-09-2013|Sep - 2013|127.26|6|Y|19.8|September 2014|Aug 2015
Processing|September 2013|Mission Food|Sysco Lakeside|DC-2003-00206|FC-2003-06014|Company Name|FC-2003-06015|Chartwells K-12 Sector 01|FC-2009-00030|Region 01 Chartwells K-12 - NS|FC-2010-00705|Brookside Junior High School - 71436|Company Name|FC-2003-06014|Y|71436|00073731310830|Mission|Tortilla Flour Hearty Grain 6 In 24/12 Ct|CA|1|1960604|73731310830|09-19-2013|Sep - 2013|32.42|1|Y|0|September 2014|Aug 2015
Processing|October 2013|MacGregors Meat and Seafood|Sysco Mount Pearl|DC-2003-00208|FC-2003-06014|Company Name|FC-2003-06015|Chartwells K-12 Sector 01|FC-2009-00037|Region 01 Chartwells K-12 - NFLD|FC-2003-06968|Gonzaga High School - 71633|Company Name|FC-2003-06014|Y|71633|10776578956526|MacGregors|Beef Ground Patty Premium FC 80/2 Oz 1/10 Kg|CA|1|2350153|10776578956526|10-21-2013|Oct - 2013|39.29|1|Y|7.58|September 2014|Aug 2015
Processing|October 2013|Rich Products of Canada|Sysco Edmonton|DC-2003-00216|FC-2003-06014|Company Name|FC-2003-06015|Chartwells K-12 Sector 01|FC-2010-00824|Region 01 Chartwells K-12 - AB|FC-2003-07292|Memorial Composite High School - 61517|Company Name|FC-2003-06014|Y|61517|00049800088030|Rich's|Dough Wheat Sub Roll 60/6 Oz|CA|1|1281377|49800088030|10-31-2013|Oct - 2013|23.78|1|Y|3.25|September 2014|Aug 2015
-
Originally posted by: stonysmith
Your file has column names (a header) as row 1.
Look on the 3rd tab of the Delimited File node. There should be nothing in the "FieldNames" parameter.
This happens if you drag the text file onto the BRE canvas and allow it to create the Delimited File node for you.
Just blank that field out and you'll be fine.
Please sign in to leave a comment.
Comments
1 comment