Re: Re: failed to import record too long: Loading 1.5 Terabyte table

You need to use the correct record delimiter i.e. newline instead of space. -------- Original message --------From: Mahmoud Mohsen <mmohsen35@gmail.com> Date: 8/18/17 19:40 (GMT+01:00) To: users-list@monetdb.org Subject: Re: Re: failed to import record too long: Loading 1.5 Terabyte table Dear Stefan, Thank you very much for your quick reply, so this is the first line of the file "lineitem.tbl", so no need to use an offset I think 1|310378689|15378705|1|17|29786.89|0.04|0.02|N|O|1996-03-13|1996-02-12|1996-03-22|DELIVER IN PERSON|TRUCK|egular courts above the| as for the version, I am using: MonetDB Database Server Toolkit v1.1 (Dec2016-SP5). So can this may be the cause of the error... an old version? I am looking forward hearing from you, Best regards, Mahmoud Mohsen

In fact, the record delimier must be pipe plus newline, i.e., '|\n' . Hence, your copy into command should look as follows: COPY INTO lineitem FROM '/vol1/tpch-dbgen/2000/lineitem.tbl' USING DELIMITERS '|', '|\n' LOCKED; Best, Stefan ----- On Aug 18, 2017, at 8:18 PM, Stefan Manegold stefan.manegold@cwi.nl wrote:
-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

Unfortunately input files often contain errors. They are collected in a predefined table that contains a copy of the failed line and line number in the source file. The rejects table should be explicitly cleared before you load a new file. Just issue the following instructions after your bulk load. SELECT * from sys.rejects; CALL sys.clearrejects(); On 18/08/2017 21:28, Stefan Manegold wrote:
participants (2)
-
Martin Kersten
-
Stefan Manegold