- users-list - monetdb.org

Re: [MonetDB-users] Database dump does not support schemas
by McKennirey.Matthew 26 Mar '08

26 Mar '08

3 5

[MonetDB-users] Clustered Index and Merge Join
by Michael Schmidt 26 Mar '08

26 Mar '08

I have two tables of the form R1(x INTEGER, y INTEGER) R2(x INTEGER, y INTEGER) where x and y both are NOT NULL and may both contain duplicate values (however, the combination (a,b) is unique). My questions are the following: a.) Is there a possibility to create a /clustered/ index on the x-column (or a clustered combined x-y index?). I could also create a PRIMARY KEY on (x,y). Would this result in a clustered index? Is there any command to find out which indices are clustered? b.) Does MonetDB support MergeJoins? I.e., assume I have a clustered index on columns R1.a and R2.a and perform a join on these columns, will this join be realized by an efficient merge join? Best regards, Michael

3 6

[MonetDB-users] MonetDB XQuery Server Startup Error
by Sprattling, Roderick L. 24 Mar '08

24 Mar '08

After installing the Win32 version of MonetDB XQuery as single-user, making no changes to MonetDB.conf, and attempting to run MXQserver.bat, I get this output: C:\Program Files\CWI\MonetDB4>MXQserver.bat # MonetDB Server v4.22.0 # based on GDK v1.22.0 # Copyright (c) 1993-2008, CWI. All rights reserved. # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ <http://monetdb.cwi.nl/> for further information. # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah <http://dbappl.cs.utwente.nl/pftijah> !ERROR: MAPIlisten:creation of stream socket failed !OS: A blocking operation is currently executing. Since MXQserver.bat simply issues the command "Mserver.bat --dbinit='module(pathfinder);'", I ran that command directly, and to my surprise the server makes it to its own command line: # MonetDB Server v4.22.0 # based on GDK v1.22.0 # Copyright (c) 1993-2008, CWI. All rights reserved. # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. MonetXDB> In this second case, the mclient cannot connect (even when I set server and client ports to something other than 50000,) nor is the admin GUI available on port 50001. So my questions are: Why does the server report a socket creation failure from the MXQserver.bat script? Why is no failure reported when the Mserver.bat script is run directly? And why is the server instance that comes up with Mserver.bat unconnective? I've sought answers from the documentation, Googleverse and the MonetDB-users archive, but found nothing. Thanks in advance for any help you can provide. Rod

1 0

[MonetDB-users] Database dump does not support schemas
by McKennirey.Matthew 24 Mar '08

24 Mar '08

1 0

[MonetDB-users] COPY INTO using a schema fails
by McKennirey.Matthew 21 Mar '08

21 Mar '08

I was wondering if the COPY command does not support schemas? CREATE TABLE test ( column1 VARCHAR(32), column2 VARCHAR(32) ); COPY INTO test FROM '/location/file.csv' USING DELIMITERS ',', '\n'; works fine CREATE SCHEMA abc; CREATE TABLE abc.test ( column1 VARCHAR(32), column2 VARCHAR(32) ); COPY INTO abc.test FROM '/location/file.csv' USING DELIMITERS ',', '\n'; fails with !SQLException:sql:table test not found !SQLException:importTable:failed to import table INSERT into abc.test VALUES(one,two) works fine

2 1

[MonetDB-users] Sending an XML document via JDBC
by Richard Eckart 19 Mar '08

19 Mar '08

Hi again, is there some way to send a XML document to the server through the JDBC connection? That is (because of the <enter> problem on OS X) I need to have my MonetDB/XQuery server running on a remote machine and I want to load an XML document locally and store it on the machine via JDBC. The 'pf:add-doc()' functions do not really help be since the only connection over to the remote machine is the MonetDB connection. Setting up a facility for MonetDB to 'call back to' to fetch the XML document via http would be overkill. Also, the XML-DB API does no longer exist, does it? Cheers, Richard

2 1

[MonetDB-users] MonetDB Error Message
by Michael Schmidt 17 Mar '08

17 Mar '08

Hi, I am trying to run the following SQL query on the lates nightly build: SELECT T1.subject AS inproc, T2.object AS author, T3.object AS booktitle, T4.object AS title, T5.object AS proc, T6.object AS ee, T7.object AS page, T8.object AS URL, T9.object AS yr, AB.object AS abstract FROM Triples T1 JOIN Triples T2 ON T1.subject=T2.subject JOIN Triples T3 ON T1.subject=T3.subject JOIN Triples T4 ON T1.subject=T4.subject JOIN Triples T5 ON T1.subject=T5.subject JOIN Triples T6 ON T1.subject=T6.subject JOIN Triples T7 ON T1.subject=T7.subject JOIN Triples T8 ON T1.subject=T8.subject JOIN Triples T9 ON T1.subject=T9.subject LEFT JOIN ( SELECT * FROM Triples T10 WHERE T10.property='bench:abstract' ) AB ON T1.subject=AB.subject WHERE T1.property='rdf:type' AND T2.property='dc:creator' AND T3.property='bench:booktitle' AND T4.property='dc:title' AND T5.property='dcterms:partOf' AND T6.property='rdfs:seeAlso' AND T7.property='swrc:pages' AND T8.property='foaf:homepage' AND T9.property='dcterms:issued' AND T1.object='bench:Inproceedings' ORDER BY T9.object; on a single table "Triples(subject VARCHAR(50),predicate VARCHAR(20),object VARCHAR(20000))" with only 1000 entries. This query results in the following error message: ##GDKmmap(702808064) fail => BBPtrim(enter) usage[mem=101947960,vm=1505614392] # #mallinfo.arena = 11571200 ##mallinfo.ordblks = 1177 ##mallinfo.smblks = 102 ##mallinfo.hblkhd = 94076928 ##mallinfo.hblks = 12 ##mallinfo.usmblks = 0 ##mallinfo.fsmblks = 4080 ##mallinfo.uordblks = 9619432 ##mallinfo.fordblks = 1951768 ##BBPTRIM_ENTER: memsize=101947960,vmsize=1505614392 ##BBPTRIM: memtarget=0 vmtarget=1073741824 ##TRIMSCAN: mem=0 vm=1, start=1, limit=1 ##TRIMSCAN: 63756* 0=tmp_1462 (#0) ##TRIMSCAN: 63887* 1=tmp_1472 (#0) ##TRIMSCAN: 64223* 2=tmp_1473 (#0) ##TRIMSCAN: 64286* 3=tmp_1477 (#0) ##TRIMSCAN: 64301* 4=tmp_1500 (#0) ##TRIMSCAN: 64362* 5=tmp_1501 (#0) ##TRIMSCAN: 64438* 6=tmp_1502 (#0) ##TRIMSCAN: 64447* 7=tmp_1505 (#0) [...] // many many more entries of this form ##TRIMSCAN: 63994 235=tmp_2275 (#455647) ##TRIMSCAN: 63998 236=tmp_2304 (#3980331) ##TRIMSCAN: 64002 237=tmp_2305 (#3980331) ##TRIMSCAN: end at 1 (size=1234) ##TRIMSELECT: dirty = 0 ##TRIMSELECT: candidate=tmp_1462 BAT*=0x848fc28 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51285,63756,-2147419892) ##TRIMSELECT: keep tmp_1462 [228,0] bytes [228,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1472 BAT*=0x84964f8 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51294,63887,-2147419761) ##TRIMSELECT: keep tmp_1472 [228,0] bytes [228,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1473 BAT*=0x8496b18 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51313,64223,-2147419425) ##TRIMSELECT: keep tmp_1473 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1477 BAT*=0x84a6770 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51321,64286,-2147419362) ##TRIMSELECT: keep tmp_1477 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1500 BAT*=0x84a6d20 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51323,64301,-2147419347) ##TRIMSELECT: keep tmp_1500 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1501 BAT*=0x84a7318 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51325,64362,-2147419286) ##TRIMSELECT: keep tmp_1501 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1502 BAT*=0x84a7920 [...] // many many more entries of this form ##TRIMSELECT: candidate=tmp_2234 BAT*=0x871d5b0 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63975,63975,63975) ##TRIMSELECT: delete tmp_2234 from trimlist (does not match trim needs) ##TRIMSELECT: candidate=tmp_2235 BAT*=0x871e7e8 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63976,63976,63976) ##TRIMSELECT: delete tmp_2235 from trimlist (does not match trim needs) ##TRIMSELECT: candidate=tmp_2236 BAT*=0x871fa20 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63977,63977,63977) ##TRIMSELECT: delete tmp_2236 from trimlist (does not match trim needs) ##TRIMSELECT: end ##BBPTRIM: no more unload candidates! ##BBPTRIM_EXIT: memsize=11583488,vmsize=1505614392 ##GDKmmap(702808064) fail => BBPtrim(ready) usage[mem=101947960,vm=1505614392] # #mallinfo.arena = 11571200 ##mallinfo.ordblks = 1177 ##mallinfo.smblks = 102 ##mallinfo.hblkhd = 94076928 ##mallinfo.hblks = 12 ##mallinfo.usmblks = 0 ##mallinfo.fsmblks = 4080 ##mallinfo.uordblks = 9619432 Seems like a memory allocation problem to me. Any ideas what the problem could be? Best Regards, Michael

2 1

[MonetDB-users] Trouble connecting
by Richard Eckart 16 Mar '08

16 Mar '08

Hi everybody, I am completely new to MonetDB and have just compiled the latest SuperBall release on OS X. I set mapi_open to true in the config file /etc/monetdb5.conf because for some reason MonetDB would not use "localhost" but the machine name of my box as an address to listen on. I had to manually add that to /etc/hosts in order for it to refer to 127.0.0.1 at least. Maybe an OS X oddity. I start the merovingian process which seems to run fine. After that the only time I can connect successfully to a database using mclient (or any other client) is the first time I try to connect (if it works at all). For example ./mclient -lsql --database demo !InvalidCredentialsException:checkCredentials:Invalid credentials for user 'monetdb' Sometimes it would work just once but the second time with the same command line I would not be able to log in. The merovingian.log does not seem to contain any helpful messages. Any hints would be very helpful as currently I can not use MonetDB at all. Cheers, Richard

3 8

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by McKennirey.Matthew 14 Mar '08

14 Mar '08

2 1

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by McKennirey.Matthew 14 Mar '08

14 Mar '08

2 1

[MonetDB-users] Can not allocate memory, MonetDB5
by forte712 14 Mar '08

14 Mar '08

Hi I've just downloaded a new version of MonetDB a few days ago and started testing it.. I tried inserting a 2.6G data file (12 columns, 32 million rows) and it works fine. But when I added 4 more columns of data to that data file (of type bigint, bringing the file size up to 3.9G), it fails saying !SQLException:importTable:failed to import table !ERROR: GDKload: cannot mmap(): name=20/2023, ext=tail.priv !OS: Cannot allocate memory !ERROR: GDKload failed: name=20/2023, ext=tail.priv I tried searching for similar problem, but only found it for older versions of MonetDB. Is this still an issue in the current version? Thank you. -- View this message in context: http://www.nabble.com/Can-not-allocate-memory%2C-MonetDB5-tp16019364p160193… Sent from the monetdb-users mailing list archive at Nabble.com.

4 4

[MonetDB-users] Table space/size
by Iftikharn 14 Mar '08

14 Mar '08

Hi How to check that how much space a particular table has taken or what is the current size of a given tables in bytes etc. Because I am interested in writing a trigger when a particular table reaches a given size then the oldest of all rows, based on a time attribute should be deleted (I like to do it without counting the rows). Regards, Iftikhar -- View this message in context: http://www.nabble.com/Table-space-size-tp16040486p16040486.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Developing in MAL!
by Erik Holstad 13 Mar '08

13 Mar '08

Hi, I'm new to MonetDB, but are looking to develop my own interface towards the database, not using SQL, but just sticking with MAL or if possible C and just want to know what my options are? Is it, for example, possible to load you own MAL-files into the client, just for a test run or do you have to type in the commands line by line? And on the server side, how to you setup your own modules and libraries? Regards Erik Holstad

5 24

[MonetDB-users] JDBC insert performance
by chinarinde 11 Mar '08

11 Mar '08

Hi all, I am new to monetDB and ran into the following problem (I'll try to be as verbose as I can, perhaps it helps helping me): I've installed MonetDB server 5.0.0, clients and commons 1.18.2 and sql 2.18.2 on Ubuntu Feisty. Then I've taken the JDBC example which is available online and modified it to be able to insert data into a test database. More specifically I'm using prepared statements and executeBatch() together with the monetdb-1.6 JDBC driver. Which is quite successful until about 5 million records are inserted - afterwards the speed of the inserts drops dramatically. I've experimented with different batch sizes (10000 records seems to work ok), and I've tried to understand the chapter about memory tuning for MonetDB (not sure yet about how to use mem_cursize() though). In any case at first inserting 2 million records only takes about 5 minutes (measured with Javas System.timemillis), later on this time increases and the server gets rather unresponsive. I found only two posts concerning the speed of JDBC inserts (from January 2007 I think) and I would be interested if a solution or explanation has been found off-list. Thank you -- View this message in context: http://www.nabble.com/JDBC-insert-performance-tf4589411.html#a13100422 Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Help me,please
by ssoor 05 Mar '08

05 Mar '08

Dear MonetDB's Group, I am a school student in china. I want to compile the Source code of MonetDB on WindowsXP. I have read your Documentations. But I lost. Can you send me the particular how to compile it with the MS visual studio 2005. Thanks you very much . And forgive my poor English. I hope your answer. Lin Mailing Address: ssoor(a)126.com Tianjin University 92 Wei Jin Rd, Nan Kai District TianJin 300072 ssoor 2008-03-05

2 1

[MonetDB-users] Windows binary + Python2.4
by Pawel Lewicki 26 Feb '08

26 Feb '08

Hi, Is there any chance for Python extensions compiled for Python 2.4 for Windows? Paweł Lewicki

1 0

[MonetDB-users] Blacklisting certain XML elements
by jz＠uva 26 Feb '08

26 Feb '08

Dear all, I am wondering whether it is possible with MonetDB4/XQuery, PF/Tijah, to blacklist certain XML element names from being "shredded", and thus being indexed? If so, could someone tell me how? I hope this is the correct mailinglist for asking this question... Best, Junte

2 1

Re: [MonetDB-users] COPY TO corrupting data
by mobigital-nbl＠yahoo.com 26 Feb '08

26 Feb '08

Stefan Manegold wrote: > 32-bit system on 8 GB machines does not make much sense, does it? > A 32-bit systems can (at least per process) address at most 4 GB, usually > only 2 GB in practice... True, but doesn't seem like I am hitting the maximum process memory limit (not even approaching 1.5GB). > With 9M+ records of >= 438 byte each, your data is >=3.9 GB in size. > I'm not completely sure whether MonetDB temprarily need to hold all data > concurrently in its address sapce during bulk loading; but if so, your data > size might simply exceed the 32-bit address space. > (Obviously, MonetDB should better give an error than crash ...) I am bulk loading only 250K rows at a time, at which point they are copied from staging table into permament final table. am I allowed to have a table with total data size larger than max process memory size? > Did you try on a 64-bit systems using 64-bit MonetDB? I have, but hitting another - higher limit - 100M rows ending with corruption on 64 bits, see first message on this thread.

1 0

Re: [MonetDB-users] COPY TO corrupting data
by bunninge 25 Feb '08

25 Feb '08

-----Original Message----- From: Martin Kersten <Martin.Kersten(a)cwi.nl> Sent: Friday, February 22, 2008 17:07 To: Communication channel for MonetDB users <monetdb-users(a)lists.sourceforge.net> Subject: Re: [MonetDB-users] COPY TO corrupting data mobigital1 wrote: > FYI, i am using 500K rows at a time. > > I've seen the mserver5.exe process memory utilization go up to 13GB (free > memory was around 1.5 GB). > but then it winds down pretty quickly. > > > > Thanks. This means that the expected database chunk size is topped at 500K * (7 * 8+ 2*20+6 *10+15+144*8 ) bytes i.e. 500K* 1323= 0.670Gb chucksize wise there does not seem a problem. However, virtual memory footprint quickly increases and I am wondering if we hit a limit in OS regaring memory mapped files. I would check a single batch for consistency. Then built a merge table over the smaller batches. In a later stage you can then glue together the pieces until we hit another limit thanks for the info and help in improving MonetDB ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

1 0

[MonetDB-users] COPY TO corrupting data
by mobigital1 25 Feb '08

25 Feb '08

I am trying to load about 500M rows into a table with about 160 columns: column types: 7 columns of type "int" 2 columns of type "varchar(20)" 6 columns of type "varchar(10)" 1 columns of type "varchar(15)" 144 columns of type "real" on a system with 16 GB RAM , 64 bit windows server 2003 SP2. it takes some 20 hours to load the 100M rows, but when I reach that boundary, the server seems to crash and database becomes corrupt so that about 95M rows have 0 in numeric columns, blanks in varchars. The remaining 5M rows have real data. does anyone have any suggestions on what can be done to make it possible to load this data? -- View this message in context: http://www.nabble.com/COPY-TO-corrupting-data-tp15634267p15634267.html Sent from the monetdb-users mailing list archive at Nabble.com.

4 7

[MonetDB-users] MonetDB mserver5 crash
by Michael Schmidt 21 Feb '08

21 Feb '08

Hi, I'm trying to run a benchmark using the latest February stable (on an Ubuntu 7.04 - Feisty Fawn), and want to cleanup the database entirely between two single runs. Basically, my benchmark script is as follows: //////////////////// START CODE // kill all processes and remove databases) // (I know this is not the intended way, but using // > monetdb stop test // > monetdb destroy -f test // while not restarting merovingian basically results in // in the same error) > killall -9 merovingian > killall -9 mserver5 > killall -9 mclient > rm -Rf /usr/local/src/MonetDB/var/MonetDB5/dbfarm/* // start the merovingian server > merovingian > sleep 2 // wait until ports 50000 and 50001 are free, // as they might still be blocked (I inserted this piece // of code because I thought busy port allocation might // be the cause of failure) > [code works fine (ommited)] // create and start the database > monetdb create test; > sleep 2; > monetdb start test; > sleep 2; // load the document into the database (this part tends to fail) > mclient -lsql -dtest < document.sql //////////////////// END CODE The strange thing is that every second run fails due to a "Connection terminated" error when loading the document, i.e. mserver5 crashes away. Did anyone experience similar problems? Any hints would be appreciated. Thanks in advance, Michael

2 9

[MonetDB-users] Storing UUID, column of type Binary?
by McKennirey.Matthew 21 Feb '08

21 Feb '08

2 3

[MonetDB-users] Problem with View definition
by Michael Schmidt 21 Feb '08

21 Feb '08

Hi, I am running the latest (February) release of MonetDB, and I have a question concerning MonetDB view definitions. I have defined a schema consisting of simple triple-column tables, defined as follows CREATE TABLE bench_booktitle (subject INTEGER,object INTEGER,FOREIGN KEY (subject) REFERENCES Dictionary(ID),FOREIGN KEY (object) REFERENCES Dictionary(ID)); CREATE TABLE bench_cdrom (subject INTEGER,object INTEGER,FOREIGN KEY (subject) REFERENCES Dictionary(ID),FOREIGN KEY (object) REFERENCES Dictionary(ID)); ... using a simple Dictionary lookup table CREATE TABLE Dictionary (ID INTEGER,val VARCHAR(20000),PRIMARY KEY (ID)); Now, I'm trying to create a view ranging over all these tables. The problem with the view definition is that it takes a very long time and consumes large main memory resources (I aborted after 10 minutes, where the mserver5 process uses more than 1.2GB of main memory). It might be of interest that view creation takes place even before loading any data in the tables, i.e. all tables are empty. Maybe someone has an idea what's going on when creating the View. Why does it require so much memory and why does it take so long? Any idea how to fix this problem? Here is the view definition (which is rather straightforward): CREATE VIEW Triples AS ( SELECT subject,'bench:booktitle' AS predicate,object FROM bench_booktitle ) UNION ( SELECT subject,'bench:cdrom' AS predicate,object FROM bench_cdrom ) UNION ( SELECT subject,'swrc:pages' AS predicate,object FROM swrc_pages ) UNION ( SELECT subject,'foaf:homepage' AS predicate,object FROM foaf_homepage ) UNION ( SELECT subject,'swrc:editor' AS predicate,object FROM swrc_editor ) UNION ( SELECT subject,'swrc:number' AS predicate,object FROM swrc_number ) UNION ( SELECT subject,'dc:creator' AS predicate,object FROM dc_creator ) UNION ( SELECT subject,'rdfs:seeAlso' AS predicate,object FROM rdfs_seeAlso ) UNION ( SELECT subject,'dcterms:partOf' AS predicate,object FROM dcterms_partOf ) UNION ( SELECT subject,'dcterms:references' AS predicate,object FROM dcterms_references ) UNION ( SELECT subject,'dcterms:issued' AS predicate,object FROM dcterms_issued ) UNION ( SELECT subject,'swrc:volume' AS predicate,object FROM swrc_volume ) UNION ( SELECT subject,'dc:publisher' AS predicate,object FROM dc_publisher ) UNION ( SELECT subject,'swrc:note' AS predicate,object FROM swrc_note ) UNION ( SELECT subject,'swrc:chapter' AS predicate,object FROM swrc_chapter ) UNION ( SELECT subject,'swrc:address' AS predicate,object FROM swrc_address ) UNION ( SELECT subject,'swrc:series' AS predicate,object FROM swrc_series ) UNION ( SELECT subject,'swrc:month' AS predicate,object FROM swrc_month ) UNION ( SELECT subject,'foaf:name' AS predicate,object FROM foaf_name ) UNION ( SELECT subject,'rdf:type' AS predicate,object FROM rdf_type ) UNION ( SELECT subject,'dc:title' AS predicate,object FROM dc_title ) UNION ( SELECT subject,'swrc:journal' AS predicate,object FROM swrc_journal ) UNION ( SELECT subject,'bench:abstract' AS predicate,object FROM bench_abstract ) UNION ( SELECT subject,'swrc:isbn' AS predicate,object FROM swrc_isbn ); Kind regards, Michael Schmidt

2 4

Re: [MonetDB-users] New MonetDB Release
by Rahul Chopra 20 Feb '08

20 Feb '08

> > On Tue, Feb 19, 2008 at 11:35:14PM +0800, Rahul Chopra wrote: > > Congratulations on the release. > > > > I ran a TPC-H test on it. The majority of queries now seem slower > > Example: Query 21: 119 sec (was 18 sec), while others are closer, > > example: Query 13: 21 sec (was 18 sec). > > Which scale factor of TPC-H did you run? > Factor 10. The system has 24 GB of RAM, running SuSe 10 64-bit. The test system has been taken away from me, and the drives rebuilt, so I can't further help at the moment, but wanted to give you the heads up in case you folks did not have time to do much performance testing before this release. If you did, then there was probably just an issue in my environment for some reason. Thanks. > Niels > > > > Did you verify performance for this release? It could be > > something I misconfigured for the new release, so take this with > > a grain of salt. Thanks. > > > > > > > ----- Original Message ----- > > > From: "Stefan Manegold" <Stefan.Manegold(a)cwi.nl> > > > To: monetdb-announce(a)lists.sourceforge.net > > > Subject: [MonetDB-users] New MonetDB Release > > > Date: Tue, 19 Feb 2008 13:51:24 +0100 > > > > > > The MonetDB team at CWI is pleased to announce the new > > "Feb2008" release of > > > the MonetDB suite of programs. > > > > This release marks the roll forward of the binary storage > > layout to a single > > > column storage layout. This involved a major overhaul of the > > MonetDB Server > > > code. > > > > IMPORTANT NOTE: > > > The database format of this release is not compatible with that of any > > > previous release. Before installing this release, make a dump of your > > > database, and do a restore afterwards. > > > > Further changes include: > > > > SQL: The functional extensions to SQL are limited. The mostly concern > > > minor bugs and some of the optimizers have been improved to better exploit > > > re-occurring joins. The core cracker code has been cleaned up for better > > > inspection and sharing in the community. > > > > XQuery: Next to the original Pathfinder compiler (nick-named > > > "milprint_summer" or simply "MPS"), the development of the new improved and > > > enhanced Algebra-based Pathfinder compiler ("ALG") is progressing quickly. > > > While the original MPS version remains the default in this release of > > > MonetDB/XQuery, a preview of the new ALG version is now available without > > > recompilation. > > > > JDBC & XRPC: The Java code (JDBC driver & XRPC wrapper) has > > been moved from > > > the clients and pathfinder source trees to a dedicated java source tree in > > > CVS, which can simply be compiled using "ant". > > > > Apart from this, many bugs have been fixed, and many speed > > improvements have > > > been made. See > > > http://monetdb.cwi.nl/Development/Releases/Version4.22/ > > > for more details. > > > > The new release consists of the following packages: > > > > MonetDB Common 1.22.0 > > > MonetDB Clients 1.22.0 > > > MonetDB4 Server 4.22.0 > > > MonetDB XQuery 0.22.0 > > > MonetDB5 Server 5.4.0 > > > MonetDB SQL 2.22.0 > > > monetdb-1.7-jdbc.jar > > > > There is of course also a new "Super Source Ball", a tarball > > containing the > > > combined sources. > > > > All this is available on our SourceForge project page. See > > > https://sourceforge.net/project/showfiles.php?group_id=56967 for the > > > downloadable files. > > > > -- > > > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > > > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > > > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > > > | The Netherlands | Fax : +31 (20) 592-4312 | > > > > ------------------------------------------------------------------------- > > > This SF.net email is sponsored by: Microsoft > > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > > _______________________________________________ > > > MonetDB-users mailing list > > > MonetDB-users(a)lists.sourceforge.net > > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > > > > > > > > > > = > > Fishing Vacation Deals at Hyatt? > > Book Your Hyatt Fishing Vacation Now. Best Rates Online Guaranteed. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a0e62a460a6115c26a11780… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Search for products and services at: http://search.mail.com -- Powered by Outblaze

1 0

[MonetDB-users] New MonetDB Release
by Stefan Manegold 20 Feb '08

20 Feb '08

The MonetDB team at CWI is pleased to announce the new "Feb2008" release of the MonetDB suite of programs. This release marks the roll forward of the binary storage layout to a single column storage layout. This involved a major overhaul of the MonetDB Server code. IMPORTANT NOTE: The database format of this release is not compatible with that of any previous release. Before installing this release, make a dump of your database, and do a restore afterwards. Further changes include: SQL: The functional extensions to SQL are limited. The mostly concern minor bugs and some of the optimizers have been improved to better exploit re-occurring joins. The core cracker code has been cleaned up for better inspection and sharing in the community. XQuery: Next to the original Pathfinder compiler (nick-named "milprint_summer" or simply "MPS"), the development of the new improved and enhanced Algebra-based Pathfinder compiler ("ALG") is progressing quickly. While the original MPS version remains the default in this release of MonetDB/XQuery, a preview of the new ALG version is now available without recompilation. JDBC & XRPC: The Java code (JDBC driver & XRPC wrapper) has been moved from the clients and pathfinder source trees to a dedicated java source tree in CVS, which can simply be compiled using "ant". Apart from this, many bugs have been fixed, and many speed improvements have been made. See http://monetdb.cwi.nl/Development/Releases/Version4.22/ for more details. The new release consists of the following packages: MonetDB Common 1.22.0 MonetDB Clients 1.22.0 MonetDB4 Server 4.22.0 MonetDB XQuery 0.22.0 MonetDB5 Server 5.4.0 MonetDB SQL 2.22.0 monetdb-1.7-jdbc.jar There is of course also a new "Super Source Ball", a tarball containing the combined sources. All this is available on our SourceForge project page. See https://sourceforge.net/project/showfiles.php?group_id=56967 for the downloadable files. -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 8