[MonetDB-users] Bulk-Load Problem
I am using MonetDB 5.0.0 and 1GB Ram on Windows XP. I am trying to use the TPC-H benchmark. With 1GB of test data everything worked fine, but if I try to load a table with more than 1GB of data the server crashes. Does this happen due to the 1GB of RAM? Also, when I use the number of records with the COPY command it copies more records. Any pointers? Thanks -- View this message in context: http://www.nabble.com/Bulk-Load-Problem-tf4702911.html#a13442730 Sent from the monetdb-users mailing list archive at Nabble.com.
On Sat, Oct 27, 2007 at 05:45:56AM -0700, algatt wrote:
I am using MonetDB 5.0.0 and 1GB Ram on Windows XP. I am trying to use the TPC-H benchmark.
With 1GB of test data everything worked fine, but if I try to load a table with more than 1GB of data the server crashes. Does this happen due to the 1GB of RAM?
how does the server crash? Segfault? any error message? ...?
Also, when I use the number of records with the COPY command it copies more records.
more than you specify with the COPY command or more than there are in the file that you copy/load from? Stefan
Any pointers?
Thanks
-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |
It does not show any message just "Connection Terminated" in the client window (shown below) read_line:##TRIMSCAN: 13810 120=tmp_462 (#0) fetch next block: start at:8200 MAPI = monetdb@localhost:50000 ACTION= read_line QUERY = COPY 15000000 RECORDS INTO orders FROM 'C:/tpch/orders.tbl' USING DELIMITERS '|'; ERROR = Connection terminated closing result set Timer 589110.000 msec Also I specified the exact number of records in the COPY statement in this case 15,000,000 (around 1.7GB). On 27/10/2007, Stefan Manegold <Stefan.Manegold@cwi.nl> wrote:
On Sat, Oct 27, 2007 at 05:45:56AM -0700, algatt wrote:
I am using MonetDB 5.0.0 and 1GB Ram on Windows XP. I am trying to use
TPC-H benchmark.
With 1GB of test data everything worked fine, but if I try to load a
with more than 1GB of data the server crashes. Does this happen due to
the table the
1GB of RAM?
how does the server crash? Segfault? any error message? ...?
Also, when I use the number of records with the COPY command it copies more records.
more than you specify with the COPY command or more than there are in the file that you copy/load from?
Stefan
Any pointers?
Thanks
-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |
------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
participants (3)
-
Alan Gatt -
algatt
-
Stefan Manegold