- users-list - monetdb.org

[MonetDB-users] 64bit MonetDB, JDBC Insert via RJDBC, >300 million rows
by Yue Sheng 17 Mar '09

17 Mar '09

I'm been trying to insert from file for over 322 files, totally 12GB with over 600 million rows. The RJDBC connection hangs after 350 million row. I noticed the VSIZE in Activity Monitor is 30.85GB, closer to 32GB system memory. Is this the reason that I cannot connect to the database? What should I do? Error message I get from MonetDB server: # MonetDB server v5.8.4, based on kernel v1.26.4 # Serving database 'bigdata', using 8 threads # Compiled for i386-apple-darwin9.6.0/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008- MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /Users/someuser/MonetDB64/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.26.4 loaded >!ERROR: GDKsave: failed name=24/2460, ext=tail, mode 0 !ERROR: GDKsave: failed name=23/2317, ext=tail, mode 0 !ERROR: GDKsave: failed name=25/2503, ext=tail, mode 0 !ERROR: GDKsave: failed name=26/2657, ext=tail, mode 0 !ERROR: GDKsave: failed name=22/2274, ext=tail, mode 0 !ERROR: GDKsave: failed name=22/2224, ext=tail, mode 0 !ERROR: GDKsave: failed name=01/112, ext=head, mode 0 !ERROR: logger_exit: could not open /Users/someuser/MonetDB64/var/MonetDB5/sql_logs/bigdata/sql/log System:MacPro Dual Quad Xenon Leopard OS X 32GB RAM R 2.8.1 32Bit MonetDB v5.8.4 complied for i386-apple-darmin9.6.0/64bit Many thanks. Yuesheng

4 28

[MonetDB-users] Apples and oranges
by Nils Grimsmo 17 Mar '09

17 Mar '09

Hi! I have some questions as to how MonetDB/XQuery should be compared fairly to other systems. If I re-run a query multiple times in a single call to `mclient`, is any calculation re-used? How about if I run multiple similar queries in a single call? Example: $ cat www.xq count(doc("dblp")//www) $ cat www_s10.xq (count(doc("dblp")//www), count(doc("dblp")//www), count(doc("dblp")//www), count(doc("dblp")//www), count(doc("dblp")//www), count(doc("dblp")//www), count(doc("dblp")//www), count(doc("dblp")//www), count(doc("dblp")//www), count(doc("dblp")//www)) $ cat www_s100.xq (count(doc("dblp")//www), ... count(doc("dblp")//www)) $ mclient --language=xquery --time < www.xq 11760 Timer 22.552 msec (Assert we are running hot.) $ mclient --language=xquery --time < www.xq 11760 Timer 21.661 msec $ mclient --language=xquery --time < www_s10.xq 11760, [snip] 11760 Timer 33.063 msec $ mclient --language=xquery --time < www_s100.xq 11760, [snip] 11760 Timer 252.414 msec So the average execution times are 22, 3.3 and 2.5 milliseconds. Is the extra cost for the first query just starting up the client program, or is some calculation re-used? If we now look at more expensive queries: $ cat dblp_authors.xq count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]) Just repeating the same: $ cat dblp_authors_s10.xq (count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"])) Different but related queries: $ cat dblp_authors_x10.xq (count(doc("dblp")/dblp//author[text()="Grzegorz Rozenberg"]), count(doc("dblp")/dblp//author[text()="Wen Gao"]), count(doc("dblp")/dblp//author[text()="Irith Pomeranz"]), count(doc("dblp")/dblp//author[text()="Hector Garcia-Molina"]), count(doc("dblp")/dblp//author[text()="Moshe Y. Vardi"]), count(doc("dblp")/dblp//author[text()="Joseph Y. Halpern"]), count(doc("dblp")/dblp//author[text()="Noga Alon"]), count(doc("dblp")/dblp//author[text()="Wei Li"]), count(doc("dblp")/dblp//author[text()="Ming Li"]), count(doc("dblp")/dblp//author[text()="Donald F. Towsley"]) ) $ mclient --language=xquery --time < dblp_authors.xq 351 Timer 1238.436 msec $ mclient --language=xquery --time < dblp_authors.xq 351 Timer 1253.927 msec $ mclient --language=xquery --time < dblp_authors_s10.xq 351, ... 351 Timer 1284.191 msec $ mclient --language=xquery --time < dblp_authors_x10.xq 351, 347, 346, 341, 334, 334, 330, 320, 320, 317 Timer 2610.589 msec Here the average times are 1238, 128 and 261 milliseconds. Here the difference is clearly not just startup of the client. If this was not a client-server architecture, I would guess the difference came from opening files, getting stuff into cache, etc.. Are there similar reasons here? What parts of the calculations are actually done inside the client, if any? If the answer is none, why is this behavior seen? In conclusion: When running multiple queries, what would be the most fair way to compare MonetDB/XQuery to other client/server architectures in your view? Concatenating the queries in a single call to `mclient`, or multiple calls? When timing a single query, can it be repeated multiple times in a single call, and the average taken, without being unfair? If I use for example MS SQL Server 2008, there is no gain from a single invocation of the client, whether I have multiple SQL statements SELECT x.query('$q) FROM t; ..., SELECT x.query('$q) FROM t; Or a single SQL statement with a list of XPath queries SELECT x.query('($q, ..., $q)') FROM t; Klem fra Nils -- http://www.idi.ntnu.no/~nilsgri/ Why is this thus? What is the reason of this thusness? - Artemus Ward

4 4

[MonetDB-users] owner of files in dbfarm changed
by Ross Bates 16 Mar '09

16 Mar '09

Hi All - I've been running an Feb2009 nightly install for a few weeks now with no issues. Tried to start the database this morning and was getting tons of errors about the BACKUP directory, SQL Catalog, etc... It turns out that somehow various files dbfarm directory were changed to root ownership. Checked the system logs, bash history, etc.... and root hasn't been used to start any monetdb services or anything else related to monetdb. I know it sounds far fetched but is there something internal to the db which could have done this? Anyone seen mysterious ownership changes like this before? As for a solution, should I be ok just doing a chown on everything below my monetdb home back to the installation user? Thanks, Ross

2 1

[MonetDB-users] [Fwd: making the server accessible from other machines]
by Martin Kersten 16 Mar '09

16 Mar '09

-------- Original Message -------- Subject: making the server accessible from other machines Date: Mon, 16 Mar 2009 11:59:29 +0100 From: francois guérin <replonk(a)gmail.com> To: monet(a)cwi.nl Hi, (i'm francois, this is not the first time i come to ask you some questions about monetdb...) i've tried to make the server accessible from another machine, but it dont work... when i launch the server, and enter the statement " xprc_trusted.delete(); ", everything's fine and i can access to my server with another machine. but, when i edit the MonetBD.conf file, as it's preconized in http://monetdb.cwi.nl/projects/monetdb/XQuery/Documentation/Security.html nothing change a quick look at my monetDB.conf file: # if not set port to address the HTTP server for pathfinder = mapi_port+1 xrpc_port="" # xrpc daemon is open for outside connections by default xrpc_open=yes # Additional options to be passed to the XRPC server, currently only # "timing". xrpc_options="" # IP addresses or hostname separated by ';' who can execute scripts in # <datadir>/MonetDB/xrpc/admin/ xrpc_admin="" # IP addresses or hostname separated by ';' who can retrieve XML # documents stored in the database using a URL of the form: # http://<host>[:port]/xrpc/<name>.xml xrpc_user="" # url prefixes of trusted modules separated by ';' xrpc_trusted="" As you can see, all slots are either open, either empty (that should mean any url/modules/user are allowed)

1 0

Re: [MonetDB-users] import error in python script
by Ranadeeran 16 Mar '09

16 Mar '09

Yes i did that but didn't work.. > You should set PYTHONPATH to something like > /prefix/lib/python2.5/site-packages > > Can you confirm? > > Thanx, > Lazaros. > > On Thu, Mar 12, 2009 at 08:36:08PM +0530, Ranadeeran wrote: >> hi all >> i use MonetDB Database Server Toolkit v0.4 and ubuntu 8.10. >> im unable to issue any of the monetdb commands without prefixing them >> with >> a ./ >> that is instead of mserver5,it works only when i give ./mserver5 >> >> And im able to issue these commands only when im in the bin directory >> though i ve permanantly set the PATH variable in .bash_profile >> >> when i try to connect to monetdb using the sample python script that is >> given in the docs,i get an import error telling unable to import >> MonetDbSQL,though i ve set the PYTHONPATH variable to >> /prefix/lib/python2.5/site-packages/MonetDb directory >> >> the script is >> import MonetSQLdb >> # Let the cursor return dictionaries instead of tuples: >> # x = MonetSQLdb.connect(cursorclass = MonetSQLdb.cursors.DictCursor) >> x = MonetSQLdb.connect(host = 'localhost', user = 'monetdb',password = >> 'monet\db', lang = 'sql') >> #x = MonetSQLdb.connect(lang='sql') >> c = x.cursor() >> c.execute('select * from test') >> #print c.fetchone() >> print c.fetchall() >> x.close() >> >> But the script works fine on Debian Etch. >> >> i need to overcome these two issues... >> >> Thanks in advance, >> Mahesh >> ----------------------------------------- This email was sent using TCEMail Service. Thiagarajar College of Engineering Madurai - 625015 (India)

1 0

[MonetDB-users] import error in python script
by Ranadeeran 13 Mar '09

13 Mar '09

hi all i use MonetDB Database Server Toolkit v0.4 and ubuntu 8.10. im unable to issue any of the monetdb commands without prefixing them with a ./ that is instead of mserver5,it works only when i give ./mserver5 And im able to issue these commands only when im in the bin directory though i ve permanantly set the PATH variable in .bash_profile when i try to connect to monetdb using the sample python script that is given in the docs,i get an import error telling unable to import MonetDbSQL,though i ve set the PYTHONPATH variable to /prefix/lib/python2.5/site-packages/MonetDb directory the script is import MonetSQLdb # Let the cursor return dictionaries instead of tuples: # x = MonetSQLdb.connect(cursorclass = MonetSQLdb.cursors.DictCursor) x = MonetSQLdb.connect(host = 'localhost', user = 'monetdb',password = 'monet\db', lang = 'sql') #x = MonetSQLdb.connect(lang='sql') c = x.cursor() c.execute('select * from test') #print c.fetchone() print c.fetchall() x.close() But the script works fine on Debian Etch. i need to overcome these two issues... Thanks in advance, Mahesh ----------------------------------------- This email was sent using TCEMail Service. Thiagarajar College of Engineering Madurai - 625015 (India)

4 3

[MonetDB-users] Random errors and segfaults executing concurrent queries
by Dominique Prunier 12 Mar '09

12 Mar '09

Hi, I'm experiencing a lot of instabilities using MonetDB-Feb2009 on a moderately big database (70GB) with 3 concurrent (read only) connections. In my test setup, i have 3 identical tables which i query in parallel (from 3 jdbc connections). Almost every time, i get some weird errors: TypeException:user.s213_7[16]:'io.s13_4' undefined in: _26:any := io.s13_4() TypeException:user.s244_2[18]:'io.s14_6' undefined in: _31:any := io.s14_6() TypeException:user.s236_8[31]:'io.s18_3' undefined in: _47:any := io.s18_3() .... Finally, at some point, the server often segfault. Is there anything i can do to improve this ? Thanks,

1 0

[MonetDB-users] Strange performance behavior on bulk import with / without sequences
by Cimballi 11 Mar '09

11 Mar '09

Hi, I have a strange behavior with MonetDB and the JDBC driver, maybe you have an explanation. Here is what I do : I import about 100 000 rows in MonetDB using the JDBC driver and simple SQL statements (not prepared) with Spring JDBC API. I made the test a first time using sequences, so before inserting the data I query for the next sequence number and then I insert the data. The second time, I generate the sequence number on the application side, using a simple increment, so I directly insert the data. And the strange result : In the first test, it took 7:30 minutes for the whole insert. In the second test, it took only 30 seconds for the whole insert. So, it seems there is a problem with the select performance, and in fact I saw this problem for another select operation. Do you have any idea about where it can come from ? Is there any configuration option or the way I use the JDBC API ? Thanks, Cimballi

2 3

[MonetDB-users] writing out all fields
by dariuszs 11 Mar '09

11 Mar '09

Hi, Selecting 50 fields out of 300 takes almost no time to write out to csv file, but selecting everything takes forever - is there any setting that can improve the speed to write out all fields from a table? Thanks. Dariusz.

2 1

[MonetDB-users] MonetDB-MAL usage questions
by Maria 10 Mar '09

10 Mar '09

Hi, I am having some problems using mal. firstly, I want to find bats of a table 'st' I loaded. I created a table 'st' using sql. > ./mclient -lsql -ddemo > \<simpletable.sql ==> it creates table 'st' with two columns 'id' and 'name' > \q then, I try to use mal. > ./mclient -lmal -ddemo > bbp.open(); > bbp.prelude(); > a := bbp.bind("st", "id"); then, I got following error msg > ERROR = !MALException:bbp.find:BAT not found I thought when a table is created using sql, it stored as number of bats and I can find it through bat buffer pool. but it seems that there is nothing in the bbp ( I tried bbp.getObjects(), and printed returns which contains no bats). Where can I get bats of table 'st'? What can be the logical name of each bat? (same as column name?? or tablename_columnname??) Second question) Although I've read all documents in MonetDB site, I'm still quite confused the way to use mal. For example, if I want to create table using mal, how could it be done? sql statement: "create table st ("id" integer not null, "name" varchar(30));" To understand mal, I think I need number of examples. Is there any documents I can study about mal? Is there any way to see system generated mal when I run sql statement? If I can, it can be good example code for me. I really hope that any one could help me. Thanks.

3 2

Re: [MonetDB-users] too deep recursion
by Nils Grimsmo 09 Mar '09

09 Mar '09

Hi, I just upgraded from the Augst to the Noveber super-ball, and the performance has worsened badly. Example queries on dblp.xml (441 MB): Q0: count(/dblp//author[text()="Michael Stonebraker"]) Q1: count(/dblp/*/author[text()="Michael Stonebraker"]) Query time in milliseconds: August November Q0 1100 4867 Q1 3993 17999 I have compiled with --enable-optimise both times. I query with: mclient --language=xquery --algebra --time < $QUERYFILE Is this performance degradation expected? If so, why? BTW: Is there any way of finding how much disk space a collection uses? Thank you for contributing free software! Klem fra Nils -- http://www.idi.ntnu.no/~nilsgri/ Why is this thus? What is the reason of this thusness? - Artemus Ward

3 4

[MonetDB-users] Kettle and MonetDB
by denvro 09 Mar '09

09 Mar '09

Hello, I have just installed Kettle 3.1 on my Archlinux machine. I wanted to use it with MonetDB but when i try to create a JDBC connection i get the following message: Error connecting to database [MonetDB] : org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: (using class nl.cwi.monetdb.jdbc.MonetDriver) Server challenge string unusable! Challenge contains too few tokens: !an internal error has occurred, please try again later I have merovingian running in the back and created a database "pentaho". See status below: bash-3.2# monetdb status -l pentaho pentaho: location: /usr/local/MonetDB/var/MonetDB5/dbfarm/pentaho database name: pentaho state: running locked: no scenarios: mal sql msql connections: mapi:monetdb://myhost:50001/ start count: 3 stop count: 2 crash count: 0 current uptime: 51m 10s average uptime: 13m 12s maximum uptime: 14m 42s minimum uptime: 11m 41s last crash: (unknown) last start: 2009-02-21 13:03:00 average of crashes in the last start attempt: 0 average of crashes in the last 10 start attempts: 0.00 average of crashes in the last 30 start attempts: 0.00 Can anybody help me with this. I already use the lates .jar (monetdb-1.9-jdbc). Kind Regards, Dennis -- View this message in context: http://www.nabble.com/Kettle-and-MonetDB-tp22141036p22141036.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] Not working xquery
by Hans van Rijswijk (DT) 06 Mar '09

06 Mar '09

Hi all, Why does this xquery work: let $result := doc("document.xml")//*[properties] let $astypes := distinct-values(for $n in $result/ancestor-or-self::*[properties] return name($n)) return $astypes <> Whereas these xqueries don't: let $result := doc("document.xml")//properties/.. let $astypes := distinct-values(for $n in $result/ancestor-or-self::*[properties] return name($n)) return $astypes <> let $result := doc("document.xml")//properties/parent::* let $astypes := distinct-values(for $n in $result/ancestor-or-self::*[properties] return name($n)) return $astypes <> The latter two xqueries return an error: MAPI = monetdb@host:50000 QUERY = let $result := doc("document.xml")//properties/parent::* ERROR = !ERROR: ancestor-or-self: illegal data in size column or context list. !ERROR: PFll_ancestor_or_self: operation failed. Which MonetDB expert can explain? Regards, Hans v R

2 1

[MonetDB-users] vertically fragment a table manually
by Brightwin 05 Mar '09

05 Mar '09

hi all, Is it possible to vertically fragment a table manually in MonetDB,instead of the Binary Association Table which is automatically created by it. thanks in advance Brightwin. ----------------------------------------- This email was sent using TCEMail Service. Thiagarajar College of Engineering Madurai - 625015 (India)

3 2

[MonetDB-users] implementing high performance time series schemas in monetDB
by Tom H 05 Mar '09

05 Mar '09

Hi, I have recently been using the TSdbi/MySQL library in R, which allows mapping between time series matrices and data stored in a mysql backend - its actually pretty good, I've made loads of progress in a few days... However I now now looking at scaling it up to many parallel sources of time series data, and my limited understanding of implementing this type of schema suggests that column orientated databases like monetDB should perform better than MySQL for this type of data. (?) The schema suggested as the default for storing irregular time series is as follows; create table T ( id VARCHAR(40), date DATETIME, v double DEFAULT ); with an index on the ident and the DATETIME field; CREATE INDEX Tindex_id ON T (id); CREATE INDEX Tindex_date ON T (date); So I am looking to support 500+ writes per second, while entertaining a whole bunch of queries of time periods like; SELECT date, v FROM T WHERE id = 'series1' order by date select date, v from T WHERE date > NOW() - INTERVAL 1 WEEK AND date < NOW(); I was hoping for some advice on whether monetDB is suitable for this type of data, and performance suggestions to get it blisteringly fast!! Thanks, Tom

1 0

[MonetDB-users] too deep recursion
by Lazaros Koromilas 02 Mar '09

02 Mar '09

Hi all, We are trying to annotate some XML data with MonetDB/XQuery. For this I run some big queries, that contain unions of many Xpath expressions (say 100). I get the following error: ERROR = !fatal error: aborted too deep recursion Tried to use the option declare option pf:recursion-depth "<number>"; I see no difference in bahaviour. I also call mclient with -G, though I don't know if it's needed. MonetDB Server is v4.26.2 and default back-end is 'algebra'. Any help with this? Thank you, Lazaros. -- http://www.ics.forth.gr/~koromil

3 4

[MonetDB-users] SUM of NULLs is 0?
by kelas 01 Mar '09

01 Mar '09

Dear MonetDB-users, a complete newbie to MonetDB, I can't really tell whether it is a bug, feature or I'm just getting it all wrong. A script below illustrates some weird NULL handling behaviour found in Nov2008-SP2: -- years under audit CREATE TABLE BUDGET_PERIOD (BP smallint NOT NULL); INSERT INTO BUDGET_PERIOD VALUES (1998); INSERT INTO BUDGET_PERIOD VALUES (1999); INSERT INTO BUDGET_PERIOD VALUES (2000); INSERT INTO BUDGET_PERIOD VALUES (2001); INSERT INTO BUDGET_PERIOD VALUES (2002); INSERT INTO BUDGET_PERIOD VALUES (2003); INSERT INTO BUDGET_PERIOD VALUES (2004); INSERT INTO BUDGET_PERIOD VALUES (2005); -- annual expenditure data CREATE TABLE EXPENDITURE (BP smallint NOT NULL, AMOUNT DECIMAL(15,2)); INSERT INTO EXPENDITURE VALUES (1999, 0.00); INSERT INTO EXPENDITURE VALUES (2000, 1.00); INSERT INTO EXPENDITURE VALUES (2001, 2.00); INSERT INTO EXPENDITURE VALUES (2002, 3.00); INSERT INTO EXPENDITURE VALUES (2003, 4.00); INSERT INTO EXPENDITURE VALUES (2004, NULL); -- calculate past years expenditure as of year: expected to be NULL for 1998, returns 0 SELECT A.BP, SUM( B.AMOUNT ) AS TOTAL_EXPD_ASOF FROM BUDGET_PERIOD A LEFT JOIN EXPENDITURE B ON (A.BP >= B.BP) GROUP BY A.BP ORDER BY A.BP -- same as above using CASE: returns all nulls (?!) SELECT A.BP, SUM( CASE WHEN A.BP >= B.BP THEN B.AMOUNT ELSE NULL END ) FROM BUDGET_PERIOD A, EXPENDITURE B GROUP BY A.BP go Regards, Vladimir

2 1

[MonetDB-users] [Fwd: Re: monetdb, xquery and perl]
by Martin Kersten 01 Mar '09

01 Mar '09

-------- Original Message -------- Subject: Re: monetdb, xquery and perl Date: Fri, 27 Feb 2009 10:35:15 +0100 From: francois guérin <replonk(a)gmail.com> To: Martin.Kersten(a)cwi.nl References: <31b3364e0902230836l140c9d0cs932937c392e8e9d(a)mail.gmail.com> <49A2EBEC.4050306(a)cwi.nl> ok! I'll then try the xrpc requests... is there a way to delete a collection in the database? (deleting documents one by one in a given collection is quite fastidious) and a way to delete a database created by the command Mserver --dbname=<...> ? (the only way i found was to physically delete directories with that same name) Thanks, francois. 2009/2/23 Martin Kersten <Martin.Kersten(a)cwi.nl>: > francois guérin wrote: >> >> Hi, >> I am about to develop an app using monetdb and its xquery part. >> My app will essentially be made of perl code. >> But it seems that perl is only used in monetdb's sql part, isn't? like >> using sql statements to access arrays and rows, but there's no way to >> access xml collections. >> >> Am i right or haven't i read enough of monetdb's documentation? > > You are right. The PHP, Perl, JDBC application interfacing to > the XML/XQuery part is less developed. > > regards, Martin >> >> Thanks a lot, >> >> francois. > >

2 1

[MonetDB-users] [Fwd: Re: Monet DB for RDF databases, BLOB]
by Martin Kersten 26 Feb '09

26 Feb '09

1 0

[MonetDB-users] Set the user of MonetDB in Windows
by Xiaofang Tao 23 Feb '09

23 Feb '09

Hello, I intend to know how can I specify the user of one database on the Monet. Hoping for your reply. Thank you very much. TaoXiaofang

2 1

[MonetDB-users] external functions
by dariuszs 21 Feb '09

21 Feb '09

Hi, Does anybody have an example of how to call external functions written in C? Thank you. Dariusz.

2 1

[MonetDB-users] Corrupt DB - missing bat files
by David Svenson 19 Feb '09

19 Feb '09

Hi, When importing date with 'COPY INTO' I reached a database corruption state. When I open the server, it comes up fine, but immediately when I start a client the server crashes with this message: # Listening for connection requests on mapi:abacusdb://127.0.0.1:50000/ # AbacusDB/SQL module v2.27.0 loaded >!ERROR: GDKload: cannot open: name=01\106, ext=head !OS: The system cannot find the path specified. !ERROR: GDKload: failed name=01\106, ext=head The bat files for 01\106 that are mentioned in the error message are missing from the dbfarm. Does the fact that they are supposed to be in folder 01 mean that these are system tables? Can I recover from this state, or has my current database become unrecoverably corrupt? -- View this message in context: http://www.nabble.com/Corrupt-DB---missing-bat-files-tp22096097p22096097.ht… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Please, HELP me!
by Xiaofang Tao 18 Feb '09

18 Feb '09

Hello, my friends： I have just installed the latest version of MonetDB5 (SQL) on windows, 32bit system. When I start the client (start-programs-MonetDB5-MonetDB SQL Client), after I start the server (start-programs-MonetDB5-MonetDB SQL Server), the client window prompted start with sql, and I can not use the command like -d. -f, -H, -u and so on, moreover, I can not specify the user or the schema. If I want to use these commands and to specify the user and the schema, what I should do. Hoping for your reply! Best regards. Tao Xiaofang

1 0

[MonetDB-users] Please, HELP me!
by taoxiaofang 18 Feb '09

18 Feb '09

Hello, my friends： I have just installed the latest version of MonetDB5 (SQL) on windows, 32bit system. When I start the client (start-programs-MonetDB5-MonetDB SQL Client), after I start the server (start-programs-MonetDB5-MonetDB SQL Server), the client window prompted start with sql, and I can not use the command like -d. -f, -H, -u and so on, moreover, I can not specify the user or the schema. If I want to use these commands and to specify the user and the schema, what I should do. Hoping for your reply! Best regards. 2009-02-18 taoxiaofang

1 0

[MonetDB-users] Java 1.6 and MonetDB JDBC driver
by Fabian Groffen 17 Feb '09

17 Feb '09

http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6795561 The MonetDB JDBC driver is affected by above bug, which manifests itself as an IndexOutOfBoundsException thrown somewhere deep from the heart of the driver in the mcl StartOfHeaderParser. The only workaround is to use JDK 1.4 or 1.5 if you hit this problem.

2 1

[MonetDB-users] sql - division
by dariuszs 13 Feb '09

13 Feb '09

Hello, How do I modify this sql to get correct answer? sql> select 10/100; I got 0 instead of 0.10 Thanks. Dariusz.

2 2

[MonetDB-users] Challenge string is not valid
by David Svenson 12 Feb '09

12 Feb '09

Hi, While working with MonetDB, I suddenly reached some sort of state in which I constantly get: "Challenge string is not valid" Whenever I try to connect to MonetDB. I am using the Mapi libraries, and get the same error if I use mclient.exe. I can't figure out how I reached this state and how I'm supposed to get out of it. Please help. Thanks, David. -- View this message in context: http://www.nabble.com/Challenge-string-is-not-valid-tp21976173p21976173.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] copy/select * from /into - very slow
by dariuszs 09 Feb '09

09 Feb '09

Hi, Could you please help me here. I've got 300 fields, 100 million records, 800 bytes per row in a table. Exporting 60 fields into a table takes about 1 minute and selecting * from table takes very long time, and I don't see lots of cpu usage when exporting all records. Thanks. Dariusz.

2 9

[MonetDB-users] Algebra Mode vs sql debug 16384
by Ross Bates 06 Feb '09

06 Feb '09

Hi All - can someone help me clarify the difference between Algebra "-G" mode and setting SQL debug equal to 16384 in the monetdb config file? With an older version of MonetDb I set the sql_debug=16384 in the config file so I could take advantage of Algebra mode when starting the server via mero. Today I compiled the Nov08-SP2 release and ran some tests using sql_debug=0 vs sql_debug=16384. I assumed they would do the exact same since Algebra mode is now the default. They returned very different results however. For SQL statements with a large number of predicates (100+), performance is about the same. But for anything smaller the query speed is much worse (10x avg) when I don't have sql_debug=16384 turned on. The query trace files are also different when I run the exact same query with and without the 16384 flag. I made sure to restart the server process in between. Also, below is the latest output from mserver --version: Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008- MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Configured for prefix: /home/ross/monetNov08sp2 Libraries: openssl: OpenSSL 0.9.8g 19 Oct 2007 (compiled with OpenSSL 0.9.8g 19 Oct 2007) Compiled by: ross@home Compilation: gcc -O2 -std=c99 -fgnu89-inline -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize Linking : /usr/bin/ld Any thoughts? Best Regards, Ross

5 4

[MonetDB-users] sql - string functions
by dariuszs 06 Feb '09

06 Feb '09

Hi, Just wondering why - strings functions seem to be very slow eg. 'select substring(field1,1,10) || substring(field2,1,20) as field3 from table1'. Thanks for help. Dariusz.

1 0

[MonetDB-users] Fedora 9 RPMs in Stable DailyBuild directory
by Hans van Rijswijk (DT) 06 Feb '09

06 Feb '09

Dear MonetDB users, In the release directories (http://monetdb.cwi.nl/downloads/Fedora/9/x86_64/) I can find RPMs for Fedora 9. Why can't I find Fedora 9 RPMs in the Stable DailyBuild directory (http://monetdb.cwi.nl/testing/projects/monetdb/Stable/.DailyBuilds./200 90206/RPMs/) ? I needs to make a distribution including the latest Stable MonetDB and including Fedora 9 RPMs. Regards, Hans van Rijswijk

2 1

[MonetDB-users] Re naming a column via MAL/SQL
by Alfred Nordman 03 Feb '09

03 Feb '09

Hi guys, Is there a way to rename an existing column within a table via SQL? (the RENAME COLUMN syntax is not supported as it seems) and if not, can i do it via MAL? I tried to use MAL as follows, but after i do, the DB seems to get corrupt when i try to access the specific table. include sql; sql.init(); bat1 := sql.bind("sys","t1","Field1",0); bat.setName(bat1,"Field2"); bat.setPersistent(bat1,true); bot.commit; Thanks & Best Regards... -- View this message in context: http://www.nabble.com/Renaming-a-column-via-MAL-SQL-tp21807788p21807788.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Logs & Corrupt databases
by David Svenson 02 Feb '09

02 Feb '09

Hi, Every once in a while I get this message in the server: !ERROR: Please move away <log folder> and its corresponding dbfarm. !mvc_init: unable to create system tables When I delete the logs from the log folder, the server starts normally and the database is ok. Any ideas on what the reason for that might be? Is it possible to disable logging altogether? Thanks, David. -- View this message in context: http://www.nabble.com/Logs---Corrupt-databases-tp21792046p21792046.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Searching for possibilities to reduce the fluctuation in insertion times.
by John van Schie (DT) 02 Feb '09

02 Feb '09

Hi, We use MonetDB v4.26.4 (Nov 2008-sp2) for our application with the XQuery frontend. Often, queries are executed very fast, but sometimes, execution of the same query takes significantly more time. For example: We insert a XML document of 1.4Mb. with a maximum depth of 4. The document is structured as follows: <rootelement> <item> <child1> <sha1>sha1-value</sha1> <md5>md5-value</md5> </child1> </item> ... </rootelement> We have 8k 'item' elements. Often the insertion of this document is performed in ~0.5s, which is fine. But when the system is performing IO (e.g. copying a large file), the insertion can take up to 6 minutes. So I have two questions: 1) What is the cause of this large difference in execution times; 2) Is there a way to configure MonetDB (or the server) in such a way that the difference between the 'fast' and 'slow' is smaller. Regards, John van Schie

3 7

[MonetDB-users] sql performance - in vs between
by dariuszs 01 Feb '09

01 Feb '09

Hi, I know it's probably a trivial question but after looking at the following trace - is there a way to make sql 'in' behave like sql 'between', make *algebra.semijoin behave like **algebra.uselect*? Thanks for you help. Dariusz. :0[0]:W Strace select f25,count(*) from trw100 where f25 in ('F','M') group by f25; :13172[0]:R [ 0 usec mdb.setTimer(true); ] [ 15000 usec _3 := sql.bind("sys","trw100","f25",0); ] [ 16000 usec _8 := sql.bind("sys","trw100","f25",1); ] [ 16000 usec _10 := algebra.kunion(<tmp_5213>:bat[:oid,:str][96240405],<tmp_20266>:bat[:oid,:str][0]); ] [ 0 usec _3 := nil; ] [ 15000 usec _8 := nil; ] [ 16000 usec _11 := sql.bind("sys","trw100","f25",2); ] [ 15000 usec _13 := algebra.kdifference(<tmp_20616>[96240405],<tmp_61>:bat[:oid,:str][0]); ] [ 0 usec _10 := nil; ] [ 16000 usec _14 := algebra.kunion(<tmp_20617>[96240405],<tmp_61>:bat[:oid,:str][0]); ] [ 16000 usec _13 := nil; ] [ 0 usec _11 := nil; ] [ 15000 usec _15 := sql.bind_dbat("sys","trw100",1); ] [ 16000 usec _16 := bat.reverse(<tmp_20253>:bat[:oid,:oid][0]); ] [ 16000 usec _15 := nil; ] [ 0 usec _17 := algebra.kdifference(<tmp_20616>[96240405],<~tmp_20253>[0]); ] [ 15000 usec _16 := nil; ] [ 16000 usec _18 := bat.reverse(<tmp_20617>[96240405]); ] [ 0 usec _17 := nil; ] [ 15000 usec _19 := bat.new(nil,nil); ] [ 16000 usec bat.append(<tmp_20506>:bat[:oid,:str][1],"F",true); ] [ 0 usec bat.append(<tmp_20506>:bat[:oid,:str][2],"M",true); ] [ 16000 usec _25 := bat.reverse(<tmp_20506>:bat[:oid,:str][2]); ] [ 15000 usec _19 := nil; ] [ 10782000 usec _26 := *algebra.semijoin(<~tmp_20617>[96240405],<~tmp_20506>[2]); *] [ 15000 usec _18 := nil; ] [ 16000 usec _25 := nil; ] [ 15000 usec _27 := bat.reverse(<tmp_20620>[93838869]); ] [ 0 usec _26 := nil; ] [ 16000 usec _29 := algebra.markT(<~tmp_20620>[93838869],0@0); ] [ 16000 usec _27 := nil; ] [ 0 usec _30 := bat.reverse(<tmp_20617>[93838869]); ] [ 15000 usec _29 := nil; ] [ 453000 usec _31 := algebra.join(<~tmp_20617>[93838869],<tmp_20616>[96240405]); ] [ 63000 usec _30 := nil; ] [ 0 usec _14 := nil; ] [ 953000 usec (ext37,grp35) := group.new(<tmp_20621>[93838869]); ] [ 16000 usec _34 := bat.mirror(<tmp_20542>[2]); ] [ 15000 usec ext37 := nil; ] [ 0 usec _35 := algebra.join(<tmp_20620>[2],<tmp_20621>[93838869]); ] [ 47000 usec _31 := nil; ] [ 344000 usec _36 := aggr.count(<tmp_20616>[93838869],<tmp_20616>[93838869],<tmp_20620>[2]); ] [ 31000 usec grp35 := nil; ] [ 16000 usec _34 := nil; ] [ 15000 usec _37 := sql.resultSet(2,1,<tmp_20544>[2]); ] [ 0 usec sql.rsColumn(0,"sys.trw100","f25","varchar",1,0,<tmp_20544>[2]); ] [ 16000 usec _35 := nil; ] [ 16000 usec sql.rsColumn(0,"sys.trw100","count_f25","wrd",64,0,<tmp_20545>:bat[:oid,:wrd][2]); ] [ 15000 usec _36 := nil; ] [ 0 usec _45 := io.stdout(); ] &1 0 2 2 2 % sys.trw100, sys.trw100 # table_name % f25, count_f25 # name % varchar, wrd # type % 1, 8 # length [ "F", 29577383 ] [ "M", 64261486 ] [ 16000 usec sql.exportResult(137554336,0,""); ] [ 13172000 usec user.s0_2("F","M"); ] :13203[0]:R :39062[0]:W Strace select f25,count(*) from trw100 where f25 between 'F' and 'M' group by f25; :43156[0]:R [ 0 usec mdb.setTimer(true); ] [ 16000 usec _3 := sql.bind("sys","trw100","f25",0); ] [ 1750000 usec _8 := *algebra.uselect(<tmp_5213>:bat[:oid,:str][96240405],"F","M",true,true);* ] [ 15000 usec _10 := sql.bind("sys","trw100","f25",1); ] [ 0 usec _12 := algebra.uselect(<tmp_20266>:bat[:oid,:str][0],"F","M",true,true); ] [ 16000 usec _13 := algebra.kunion(<tmp_20620>[93838869],<tmp_20621>[0]); ] [ 16000 usec _8 := nil; ] [ 15000 usec _12 := nil; ] [ 0 usec _14 := sql.bind("sys","trw100","f25",2); ] [ 16000 usec _16 := algebra.kdifference(<tmp_20616>[93838869],<tmp_61>:bat[:oid,:str][0]); ] [ 16000 usec _13 := nil; ] [ 0 usec _17 := algebra.uselect(<tmp_61>:bat[:oid,:str][0],"F","M",true,true); ] [ 15000 usec _18 := algebra.kunion(<tmp_20621>[93838869],<tmp_20617>[0]); ] [ 16000 usec _16 := nil; ] [ 15000 usec _17 := nil; ] [ 0 usec _19 := sql.bind_dbat("sys","trw100",1); ] [ 16000 usec _20 := bat.reverse(<tmp_20253>:bat[:oid,:oid][0]); ] [ 16000 usec _19 := nil; ] [ 0 usec _21 := algebra.kdifference(<tmp_20616>[93838869],<~tmp_20253>[0]); ] [ 15000 usec _18 := nil; ] [ 16000 usec _20 := nil; ] [ 16000 usec _23 := algebra.markT(<tmp_20617>[93838869],0@0); ] [ 0 usec _21 := nil; ] [ 15000 usec _24 := bat.reverse(<tmp_20616>[93838869]); ] [ 16000 usec _23 := nil; ] [ 0 usec _25 := algebra.kunion(<tmp_5213>:bat[:oid,:str][96240405],<tmp_20266>:bat[:oid,:str][0]); ] [ 15000 usec _3 := nil; ] [ 16000 usec _10 := nil; ] [ 16000 usec _26 := algebra.kdifference(<tmp_20617>[96240405],<tmp_61>:bat[:oid,:str][0]); ] [ 0 usec _25 := nil; ] [ 15000 usec _27 := algebra.kunion(<tmp_20621>[96240405],<tmp_61>:bat[:oid,:str][0]); ] [ 16000 usec _26 := nil; ] [ 0 usec _14 := nil; ] [ 453000 usec _28 := algebra.join(<~tmp_20616>[93838869],<tmp_20617>[96240405]); ] [ 31000 usec _24 := nil; ] [ 16000 usec _27 := nil; ] [ 922000 usec (ext34,grp32) := group.new(<tmp_20621>[93838869]); ] [ 15000 usec _31 := bat.mirror(<tmp_20542>[2]); ] [ 16000 usec ext34 := nil; ] [ 0 usec _32 := algebra.join(<tmp_20620>[2],<tmp_20621>[93838869]); ] [ 47000 usec _28 := nil; ] [ 344000 usec _33 := aggr.count(<tmp_20617>[93838869],<tmp_20617>[93838869],<tmp_20620>[2]); ] [ 31000 usec grp32 := nil; ] [ 16000 usec _31 := nil; ] [ 15000 usec _34 := sql.resultSet(2,1,<tmp_20544>[2]); ] [ 16000 usec sql.rsColumn(1,"sys.trw100","f25","varchar",1,0,<tmp_20544>[2]); ] [ 0 usec _32 := nil; ] [ 15000 usec sql.rsColumn(1,"sys.trw100","count_f25","wrd",64,0,<tmp_20545>:bat[:oid,:wrd][2]); ] [ 16000 usec _33 := nil; ] [ 16000 usec _42 := io.stdout(); ] &1 1 2 2 2 % sys.trw100, sys.trw100 # table_name % f25, count_f25 # name % varchar, wrd # type % 1, 8 # length [ "F", 29577383 ] [ "M", 64261486 ] [ 15000 usec sql.exportResult(137554336,1,""); ] [ 4094000 usec user.s1_2("F","M"); ] :43187[0]:R :253953[0]:W Connection closed

3 3

[MonetDB-users] Building 64 bits
by David Svenson 01 Feb '09

01 Feb '09

Hi, I followed the instructions for building MonetDB in 64-bit, however, after finishing the build process and trying to run the server, I get this error message: !FATAL: BBPinit: database created with incompatible server: expected pointer size 8, got 4, expected OID size 4, got 4. I added "bits=64" to all my nmakes, but I guess something is still missing. Are there any other flags I need to raise in the build process that I might have missed? Thanks, David. -- View this message in context: http://www.nabble.com/Building-64-bits-tp21772757p21772757.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] mclient - copy into problem
by dariuszs 31 Jan '09

31 Jan '09

Hi, Please verify this - when you output a file from the table with 'copy... into...' and terminate that client - the output file is still being created even though the client was terminated. Thanks. Dariusz.

5 16

[MonetDB-users] Running into swap during large dataset loading
by Ukyo Virgden 30 Jan '09

30 Jan '09

Hi, I'm tring to build a database with around 1B rows. I'm testing on a 64bit AMD Opteron 2200 dual core x 2 CPU system with 16GB mem and 16G swap connected to an external fiber storage. I've got a set of datafiles around 8GB. each with 100M records. I'm running the following commands. copy 300000000 records into test_table from 'datafile-1.csv','datafile-2.csv','datafile-3.csv'; copy 300000000 records into test_table from 'datafile-4.csv','datafile-5.csv','datafile-6.csv'; copy 300000000 records into test_table from 'datafile-7.csv','datafile-8.csv','datafile-9.csv'; The first command completes around 15mins. The second also completes around 15min. However the the third command forces the system to swap and at some point cause the system to crash. I've also tried by NOT giving the record count i.e. copy into test_table from 'datafile-X.csv' which were not only slowe but also resulted in the same swap outage crash. I need to load around 3 billion records. Any thoughts on what might be the problem here? Thanks in advance, Regards, Ukyo

1 0

[MonetDB-users] sql_logs
by dariuszs 29 Jan '09

29 Jan '09

Hi, How do I read what's in the sql_logs directory files? Thanks. Dariusz.

3 5

[MonetDB-users] server crash/sql prompt
by dariuszs 29 Jan '09

29 Jan '09

Hi, Can somebody help me with this one. I was running a very long query, decided to terminate that job. Now when I try to get the client all I see is blinking prompt. How do I get back the sql prompt? Thanks. Dariusz.

5 26

[MonetDB-users] distinct values limit
by dariuszs 26 Jan '09

26 Jan '09

Hi, Is there a limit on how many distinct values you can have in a column. I've created a table with 100,000,000 records and one column (varchar (16)) has 2,600,000 distinct values so when I run the count on that column - it runs forever. When I watch memory usage it goes to few gigabytes and then it drops to almost nothing, then it goes to few gigs and then it drops. Thanks. Dariusz.

1 0

Re: [MonetDB-users] predictable crashes of MonetDB5 SQL server under Win32bit
by Jens Oehlschlägel 26 Jan '09

26 Jan '09

Thanks Stefan, > with loading ~1.5 GB on a 32 bit machine, there is a reasonable chance that > the loading process (that needs to be able to address all data concurrently) > comes close to or even hits the 32-bit (i.e., max. 4 GB, possibly only 2 GB) > address space limit. Does this limitation refers to the size of the data that I am adding per COPY INTO (was 0.2 GB) or the final size of the table (was at 1.9). Assuming the latter this would give a hard limit for table size under Win32. If this is the case, a workaround could be partioning the data into several tables. What is more efficient in MonetDB: chunks of rows at full columns width or chunks of columns at full row length? > Would it be possible that you could provide us with your data? > That would help us a lot to analyze, locate and hopefully fix the crash... I give you access by seperate mail, you can also create the test data file using the R script snippet in my previous mail. Have a nice weekend Jens

5 5

[MonetDB-users] memory release
by dariuszs 26 Jan '09

26 Jan '09

Hi, MonetDB-SQL server does not release the memory after loading data into table (loaded 40GB) terminating client session (closed the window waiting for count to complete) Also after restarting the server it takes very long time for the client to get the prompt Why is that? Thanks. Dariusz.

1 0

[MonetDB-users] Announcement: New bug fix release of MonetDB suite
by Sjoerd Mullender 23 Jan '09

23 Jan '09

The MonetDB team at CWI is pleased to announce the Nov2008-SP2 bug fix release of the MonetDB suite of programs. This is a bug fix release of the Nov2008 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Nov2008/#Nov200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[MonetDB-users] predictable crashes of MonetDB5 SQL server under Win32bit
by Jens Oehlschlägel 23 Jan '09

23 Jan '09

Hi, I experience predictable crashes of MonetDB5 SQLserver under Win32bit when COPY INTO in batches of 1 Mio more than ~9Mio rows, which is ~1.5 GB DB size. Any settings to avoid that? Is this a bug? Is MonetDB size limited to available RAM? Or is this a known limit just under Win32? Logs of sql client error messages and details for replication below. Regards Jens Oehlschlägel Lenovo Thinkcentre with 3 GB RAM under Windows XP Professional SP2 RAM consumption of m5server.exe during load ~300MB according to task manager Free RAM 2.1 GB Size of dbfarm finally 1.9 GB DiskFreeSpace 1.8 TB [System Summary] Item Value OS Name Microsoft Windows XP Professional Version 5.1.2600 Service Pack 2 Build 2600 OS Manufacturer Microsoft Corporation System Name GEMUN-38396-10- System Manufacturer LENOVO System Model 6073AA7 System Type X86-based PC Processor x86 Family 6 Model 15 Stepping 11 GenuineIntel ~2992 Mhz Processor x86 Family 6 Model 15 Stepping 11 GenuineIntel ~2992 Mhz BIOS Version/Date LENOVO 2RKT41AUS, 3/20/2008 SMBIOS Version 2.5 Windows Directory C:\WINDOWS System Directory C:\WINDOWS\system32 Boot Device \Device\HarddiskVolume1 Locale Germany Hardware Abstraction Layer Version = "5.1.2600.3023 (xpsp_sp2_qfe.061030-0020)" Time Zone W. Europe Standard Time Total Physical Memory 3,072.00 MB Available Physical Memory 1.70 GB Total Virtual Memory 2.00 GB Available Virtual Memory 1.96 GB Page File Space 5.79 GB Page File D:\pagefile.sys sql>START TRANSACTION; 0 tuples Timer 0.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 67515.000 msec 0 rows sql>COMMIT; 0 tuples Timer 1255.000 msec 0 rows sql>START TRANSACTION; 0 tuples Timer 0.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 79141.000 msec 0 rows sql>COMMIT; 0 tuples Timer 6041.000 msec 0 rows sql>START TRANSACTION; 0 tuples Timer 0.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 74227.000 msec 0 rows sql>COMMIT; 0 tuples Timer 6943.000 msec 0 rows sql>START TRANSACTION; 0 tuples Timer 0.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 73084.000 msec 0 rows sql>COMMIT; 0 tuples Timer 6599.000 msec 0 rows sql>START TRANSACTION; 0 tuples Timer 0.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 67158.000 msec 0 rows sql>COMMIT; 0 tuples Timer 6520.000 msec 0 rows sql>START TRANSACTION; 0 tuples Timer 18529.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 65106.000 msec 0 rows sql>COMMIT; 0 tuples Timer 5184.000 msec 0 rows sql>START TRANSACTION; 0 tuples Timer 0.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 71136.000 msec 0 rows sql>COMMIT; 0 tuples Timer 9104.000 msec 0 rows sql>START TRANSACTION; 0 tuples Timer 21021.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 69761.000 msec 0 rows sql>COMMIT; 0 tuples !MALException: MT_mmap: MapViewOfFileEx(1558, 2, 0, 0, 14680064, 0) failed !OS: Not enough storage is available to process this command. !ERROR: MT_mmap: MapViewOfFileEx(1554, 2, 0, 0, 14680064, 0) failed !OS: Not enough storage is available to process this command. !ERROR: GDKload: cannot mmap(): name=15\1511, ext=tail !OS: Not enough storage is available to process this command. !ERROR: GDKload: failed name=15\1511, ext=tail !ERROR: MT_mmap: MapViewOfFileEx(1558, 2, 0, 0, 14680064, 0) failed !OS: Not enough storage is available to process this command. !ERROR: MT_mmap: MapViewOfFileEx(1554, 2, 0, 0, 14680064, 0) failed !OS: Not enough storage is available to process this command. !ERROR: GDKload: cannot mmap(): name=15\1511, ext=tail !OS: Not enough storage is available to process this command. !ERROR: GDKload: failed name=15\1511, ext=tail !ERROR: MT_mmap: MapViewOfFileEx(1558, 2, 0, 0, 14680064, 0) failed !OS: Not enough storage is available to process this command. !ERROR: MT_mmap: MapViewOfFileEx(1554, 2, 0, 0, 14680064, 0) failed !OS: Not enough storage is available to process this command. !ERROR: GDKload: cannot mmap(): name=15\1511, ext=tail !OS: Not enough storage is available to process this command. !ERROR: GDKload: failed name=15\1511, ext=tail !ERROR: MT_mmap: MapViewOfFileEx(1558, 2, 0, 0, 34603008, 0) failed !OS: Not enough storage is available to process this command. !ERROR: MT_mmap: MapViewOfFileEx(1554, 2, 0, 0, 34603008, 0) failed !OS: Not enough storage is available to process this command. !ERROR: GDKload: cannot mmap(): name=11\1117, ext=tail !OS: Not enough storage is available to process this command. !ERROR: GDKload: failed name=11\1117, ext=tail !ERROR: MT_mmap: MapViewOfFileEx(1558, 2, 0, 0, 69206016, 0) failed !OS: Not enough storage is available to process this command. !ERROR: MT_mmap: MapViewOfFileEx(1554, 2, 0, 0, 70254592, 0) failed !OS: Not enough storage is available to process this command. !ERROR: MT_mmap: MapViewOfFileEx(1558, 2, 0, 0, 70254592, 0) failed !OS: Not enough storage is available to process this command. !ERROR: MT_mmap: MapViewOfFileEx(1554, 2, 0, 0, 70254592, 0) failed !OS: Not enough storage is available to process this command. !ERROR: GDKload: cannot mmap(): name=15\1534, ext=tail !OS: Not enough storage is available to process this command. !ERROR: GDKload: failed name=15\1534, ext=tail 0 tuples Timer 9276.000 msec 0 rows sql>START TRANSACTION; 0 tuples Timer 0.000 msec 0 rows sql>COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/d atabasetest1mio.csv' USING DELIMITERS ','; Rows affected 1000000 Timer 96373.000 msec 0 rows sql>COMMIT; MAPI = voc@localhost:50000 ACTION= read_line QUERY = COMMIT; ERROR = Connection terminated Timer 44089.000 msec 0 rows -- restarting the crashed server looks good, but # MonetDB server v5.8.2, based on kernel v1.26.2 # Serving database 'demo', using 1 thread # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008- MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see D:\MonetDB\MonetDB5\etc\monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.26.2 loaded -- when starting mclient the server says >!ERROR: MT_mmap: MapViewOfFileEx(1528, 2, 0, 0, 69206016, 0) failed !OS: Not enough storage is available to process this command. #GDKmmap(69206016) fail => BBPtrim(enter) usage[mem=165285248,vm=1495793664] #GDKmmap(69206016) fail => BBPtrim(ready) usage[mem=165284840,vm=574619648] #GDKmmap: recovery ok. Continuing.. -- replication instructions -- log in to freshly installed MonetDB and create user CREATE USER "voc" WITH PASSWORD 'voc' NAME 'VOC Explorer' SCHEMA "sys"; CREATE SCHEMA "voc" AUTHORIZATION "voc"; ALTER USER "voc" SET SCHEMA "voc"; -- log in as voc and execute the following statements CREATE TABLE databasetest ( "id" INTEGER , "ubyte1" SMALLINT , "ubyte2" SMALLINT , "ubyte3" SMALLINT , "ubyte4" SMALLINT , "ubyte5" SMALLINT , "ubyte6" SMALLINT , "ubyte7" SMALLINT , "ubyte8" SMALLINT , "ubyte9" SMALLINT , "ubyte10" SMALLINT , "ubyte11" SMALLINT , "ubyte12" SMALLINT , "ubyte13" SMALLINT , "ubyte14" SMALLINT , "ubyte15" SMALLINT , "smallint1" SMALLINT , "smallint2" SMALLINT , "smallint3" SMALLINT , "smallint4" SMALLINT , "smallint5" SMALLINT , "smallint6" SMALLINT , "smallint7" SMALLINT , "smallint8" SMALLINT , "smallint9" SMALLINT , "smallint10" SMALLINT , "smallint11" SMALLINT , "smallint12" SMALLINT , "smallint13" SMALLINT , "smallint14" SMALLINT , "smallint15" SMALLINT , "float1" DOUBLE , "float2" DOUBLE , "float3" DOUBLE , "float4" DOUBLE , "float5" DOUBLE , "float6" DOUBLE , "float7" DOUBLE , "float8" DOUBLE , "float9" DOUBLE , "float10" DOUBLE , "float11" DOUBLE , "float12" DOUBLE , "float13" DOUBLE , "float14" DOUBLE , "float15" DOUBLE , "float16" DOUBLE , "float17" DOUBLE , "float18" DOUBLE , "float19" DOUBLE , "float20" DOUBLE ) ; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; START TRANSACTION; COPY 1000000 OFFSET 2 RECORDS INTO "voc"."databasetest" FROM 'F:/Periscope/databasetest1mio.csv' USING DELIMITERS ','; COMMIT; -- the file databasetest1mio.csv can be created with the following R script # this is an R comment and you find R at CRAN.r-project.org filename <- "F:/Periscope/databasetest1mio.csv" # create 1Mio rows in 100 batches of 10,000, total of 174MB csv file, takes ~2 minutes system.time({ b <- 1000L # number of batches n <- 1000L # batch size csvfile <- file(filename, open="w") for (i in 1:b){ x <- data.frame( id = ((i-1L)*n+1L):(i*n) # 4-byte integer record identifier , ubyte1 = sample(0:35, n, TRUE, prob=NULL) # unsigned byte columns (1 byte) , ubyte2 = sample(0:1, n, TRUE, prob=NULL) , ubyte3 = sample(0:3, n, TRUE, prob=NULL) , ubyte4 = sample(0:9, n, TRUE, prob=NULL) , ubyte5 = sample(0:24, n, TRUE, prob=NULL) , ubyte6 = sample(0:99, n, TRUE, prob=NULL) , ubyte7 = sample(-127:127, n, TRUE, prob=NULL) , ubyte8 = sample(0:1, n, TRUE, prob=c(0.75, 0.25)) , ubyte9 = sample(0:1, n, TRUE, prob=c(0.9,0.1)) , ubyte10 = sample(0:1, n, TRUE, prob=c(0.96,0.04)) , ubyte11 = sample(0:1, n, TRUE, prob=c(0.99,0.01)) , ubyte12 = sample(0:1, n, TRUE, prob=c(0.996,0.004)) , ubyte13 = sample(0:1, n, TRUE, prob=c(0.999,0.001)) , ubyte14 = sample(0:1, n, TRUE, prob=c(0.9996,0.0004)) , ubyte15 = sample(0:1, n, TRUE, prob=c(0.9999,0.0001)) , smallint1 = sample(1:4000, n, TRUE, prob=NULL) # smallint columns (2 bytes) , smallint2 = sample(1:2, n, TRUE, prob=NULL) , smallint3 = sample(1:4, n, TRUE, prob=NULL) , smallint4 = sample(1:10, n, TRUE, prob=NULL) , smallint5 = sample(1:25, n, TRUE, prob=NULL) , smallint6 = sample(1:100, n, TRUE, prob=NULL) , smallint7 = sample(1:256, n, TRUE, prob=NULL) , smallint8 = sample(1:1000, n, TRUE, prob=NULL) , smallint9 = sample(1:32000, n, TRUE, prob=NULL) , smallint10 = sample(0:1, n, TRUE, prob=c(0.75, 0.25)) , smallint11 = sample(0:1, n, TRUE, prob=c(0.9,0.1)) , smallint12 = sample(0:1, n, TRUE, prob=c(0.96,0.04)) , smallint13 = sample(0:1, n, TRUE, prob=c(0.99,0.01)) , smallint14 = sample(0:1, n, TRUE, prob=c(0.996,0.004)) , smallint15 = sample(0:1, n, TRUE, prob=c(0.999,0.001)) , float1 = round(runif(n, 0, 100), 1) # float columns (4 bytes) , float2 = round(runif(n, 0, 100), 1) , float3 = round(runif(n, 0, 100), 1) , float4 = round(runif(n, 0, 100), 1) , float5 = round(runif(n, 0, 100), 1) , float6 = round(runif(n, 0, 100), 1) , float7 = round(runif(n, 0, 100), 1) , float8 = round(runif(n, 0, 100), 1) , float9 = round(runif(n, 0, 100), 1) , float10 = round(runif(n, 0, 100), 1) , float11 = round(runif(n, 0, 100), 1) , float12 = round(runif(n, 0, 100), 1) , float13 = round(runif(n, 0, 100), 1) , float14 = round(runif(n, 0, 100), 1) , float15 = round(runif(n, 0, 100), 1) , float16 = round(runif(n, 0, 100), 1) , float17 = round(runif(n, 0, 100), 1) , float18 = round(runif(n, 0, 100), 1) , float19 = round(runif(n, 0, 100), 1) , float20 = round(runif(n, 0, 100), 1) ) write.table(x, file=csvfile, row.names=FALSE, col.names=(i==1L), append=i!=1L, dec=".", sep=",") } close(csvfile) })

3 2

Re: [MonetDB-users] copy into table
by Jens Oehlschlägel 22 Jan '09

22 Jan '09

A related feature for bulk import/export that would indeed make sense AND should be easy to implement is: exchange with flat binary files. This requires - the file to be set up with the correct byte-order - the file to contain only data types that have a fixed-width binary representation (like FLOAT, SINGLE, INTEGER, SMALLINT etc) but not variable widths (like VARCHAR) Such file would neither require record_seperator nor tuple_seperator. The only challenge is how to represent NULL, and for this you could turn to the definitions of NA (Not Available atomic value) used in the popular statistical interpreter R (www.r-project.org) for its native data types (double, integer) and for other data types you could use the NA conventions implemented in R's flat file package 'ff' (single, signed and unsigned integers, smallints, bytes, etc, see documentation for 'vmode'). Even dates could be represented unambiguously using the double representation of the POSIXct class in R. For the SQL interface you could simply define binary files by setting tuple_seperator and record_seperator to '' the empty string. If you use a trick and allow COPY INTO not only to accept a table_name but also a view_name - where the view represents a subset of the columns of one table - such an interface could even be used to populate a table that has columns which are not in the binary file, say the table has a varchar column or, exchange data column by column with systems that cannot work with mixed-type binary files (such as ff which currently can only handle homogeneous atomic files). Beside the obvious benefits - for example exporting large data to R for analysis purposes - such a file interface could also be used to create artifical data in R with certain statistical features for datawarehouse test loads (say exploring MonetDBs 'indexing' performance for distributions with certain entropy etc). Greetings Jens Oehlschlägel (one of the ff authors)

1 0

[MonetDB-users] copy into table
by dariuszs 21 Jan '09

21 Jan '09

Hello, Is there any way to copy flat file into the table not using delimiters? Thanks. Dariusz.

4 11

[MonetDB-users] SQL server crash
by dariuszs 20 Jan '09

20 Jan '09

Hi, The SQL server crashes when I try to join 3 tables using 27 bytes key? Can you help me? Thanks. Dariusz.

6 16

[MonetDB-users] Changing locale to support various Datetime formats
by David Svenson 20 Jan '09

20 Jan '09

Is there any recommended way to format dates according to different locales in Windows? I try to do COPY INTOs with dates, but get parsing errors, and I can't find any solution for it because I can't use mtime.str_to_date and such in Windows. Thanks, David. -- View this message in context: http://www.nabble.com/Changing-locale-to-support-various-Datetime-formats-t… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Python3.0
by Kees Varekamp 20 Jan '09

20 Jan '09

Hello, Does anyone know if the Python bindings are working with Python 3.0? Thanks

1 0

[MonetDB-users] MonetDb comparison Data Load
by Prometheus WillSurvive 19 Jan '09

19 Jan '09

Dear Developers-Users, First of all I would like to thanks all of your afforts to birng us these DB technologies and a platform for openly discussion. We are consulting big sized customers and deploying their data search technologies. Total size is around 1 petabytes daily . (total of our customers number ) . Their data size starts 1 TB (9.000.000.000 lines cvs) to 100 TB. so we have different size of customer base. We are looking opensource db solutions for a while due to lack of support and technological cumbersome of the current commercial solutions. We have 3 test customer now : 1-1 TB data dailiy read only purposes. 9.000.000.000 cvs file should be load to database . Data should be load to the database max 2 hours. after that comlex crm analitic queries. max 10 concurrent user/queries. database will be daily and wil not grow dailiy. so limit is 1 TB data load. 2-10 TB data daily. same as above .. 3-50 TB data stabil. will not grow. So we are looking for a solutions: *Fast data loading. How fast we load data to the MonetDB ? Is it could be multithreaded data loading possible ? *Is it possible to MPP ? can we add more server to share cpu resources and decrease the load time ? what is the best HW solution for above first customer ? Do we need still fat enterrprise servers or what ? We are also looking for InfoBright, Vertica and also Luciddb. VErtica is not opensource so out of the list. Infobright seems not giving its full power in the opensource.. Also we heard about the MonetDB X100 and interested. After 3 months succefully test we will support monetDB developer if its solved our problems. We can pay . Best Regards W.S

1 0

[MonetDB-users] Are there binary rpm install files for Red Hat Enterprise Linux?
by 小波顾 17 Jan '09

17 Jan '09

_________________________________________________________________ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/windows/windowslive/

1 0

[MonetDB-users] Copy from file which contains Chinese characters failed.
by 小波顾 17 Jan '09

17 Jan '09

Copy from file which contains Chinese characters failed. My test table is create table t1(a int not null primary key, b varchar(1024)); My test file d:\data.txt contains two lines1,测试12,测试2 I have tried to save the data file using ANSI and UTF8 encoding using Notepad on windows,and tried to start mclient with -Ecp437, -Ecp936 and -Eutf-8 option, neither combination of thefile encoding and mclient encoding can load the file correctlly. When both using utf-8 the following error messages appears:sql>copy into t1 from 'd:\\data.txt' using delimiters ',', '\r\n';!SQLException:importTable:failed to import table!ERROR: value 'ï»?' while parsing 'ï»?,é¡¾å°æ³?!ERROR: 2,è¦ƒæ€? from line 0 field 0 not inserted, expecting type int!ERROR: TABLETload_bulk: read error (after loading 0 records)0 tuples When using other combinations, the following messages appears:sql>copy into t1 from 'd:\\data.txt' using delimiters ',', '\r\n';0 tupleswrite errorsql> The following steps works, but the exported data.txt isn't readable by human. mclient XXXXX -Ecp437 delete from t1;insert into t1 values(1,'²âÊÔ1');insert into t1 values(2,'²âÊÔ2'); copy select * from t1 into 'd:\\data.txt' using delimiters ',' ,'\r\n'; delete from t1;copy into t1 from 'd:\\data.txt' using delimiters ',' ,'\r\n'; _________________________________________________________________ News, entertainment and everything you care about at Live.com. Get it now! http://www.live.com/getstarted.aspx

3 8

[MonetDB-users] Can't connect to remote MonetDB5-SQL Server.
by 小波顾 17 Jan '09

17 Jan '09

I have installed all the rpms in my Fedora9 virtual machine: 2009-01-17 12:07 3,339,229 MonetDB-1.26.2-1.fc9.oid32.i386.rpm2009-01-17 12:07 84,115 MonetDB-client-1.26.2-1.fc9.oid32.i386.rpm2009-01-17 12:37 7,988 MonetDB-SQL-2.26.2-1.fc9.oid32.i386.rpm2009-01-17 12:36 873,636 MonetDB-SQL-server5-2.26.2-1.fc9.oid32.i386.rpm2009-01-14 22:07 5,054,522 MonetDB5-server-5.8.2-1.fc9.oid32.i386.rpmAnd using the following steps recreated the demo database: shell>merovingian ###Start the proxy damo shell>monetdb destroy demo shell>monetdb create demo shell>monetdb start demo Now I can connect to the demo database using mclient -lsql -d demo from the local machine, then I changed "mapi_open=true" in the file /etc/monetdb5.conf and restarted all the server processes, but I still can't connect to databases from remote machines. BTW, how to stop the merovingian process, I used kill:( _________________________________________________________________ Show them the way! Add maps and directions to your party invites. http://www.microsoft.com/windows/windowslive/events.aspx

1 1

[MonetDB-users] SIGBUS on mserver5 after large load.
by Schwarz, Omri 16 Jan '09

16 Jan '09

I have a large database that loads nicely on MonetDB from MySQL when it'd done with INSERTs with one row at a time. But when I group them in sets of 300 or so, for any reason, i.e. INSERT INTO TABLE VALUES (FOO), (BAR) ... ; it develops a memory leak which is not helped by setting gdk_mem_bigsize or gdk_vm_minsize. And when that makes me abort the load, the result is that backend data are corrupted. I can start the database server, but on the first connection attempt, this happens: [pid 18878] read(19, "\0\0", 2) = 2 [pid 18878] close(19) = 0 [pid 18878] stat("bat/02/224.tail", {st_mode=S_IFREG|0600, st_size=254, ...}) = 0 [pid 18878] stat("bat/02/224.tail.new", 0x416d9b00) = -1 ENOENT (No such file or directory) [pid 18878] open("bat/02/224.tail", O_RDONLY) = 19 [pid 18878] read(19, "\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1\1"..., 254) = 254 [pid 18878] close(19) = 0 [pid 18878] --- SIGBUS (Bus error) @ 0 (0) --- Process 18878 detached [pid 18877] +++ killed by SIGBUS +++ +++ killed by SIGBUS +++ So, a couple questions: 1. how hard would it be to write a backend integritiy checker for the binary association tables? 2. what more can I do to make sure all the changes in the backend are truly atomic ? 3. Are there good prospects for this memory leak being traced and addressed? 4. Can the BAT file format be changed to have more checks on its integrity? (checksums, sentinel variables, etc) 5. Might it make sense for the backend files to have a format relying on existing database libraries? BDB? Denham Quantitative Management LP 200 Clarendon Street, 25th Floor Boston, MA 02216 T: 617-587-5812 M: 617-909-7786 omri.schwarz(a)denhamcapital.com NOTICE: This e-mail message is intended for the named recipient(s) above and may contain confidential information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. NO REPRESENTATION OR WARRANTY IS MADE TO ANY PERSON AS TO THE ACCURACY OR COMPLETENESS OF THE INFORMATION CONTAINED HEREIN. Denham Capital Management(sm) is a trademark of Denham Capital Management LP.

1 0

[MonetDB-users] Python client strangeness.
by Schwarz, Omri 15 Jan '09

15 Jan '09

when you set "gdk_debug" to 4 (for memory debugging), it causes the server to give empty lists to "select * from tables;" queries coming from Python DB API clients, but not when they come from mclient. Denham Quantitative Management LP 200 Clarendon Street, 25th Floor Boston, MA 02216 T: 617-587-5812 M: 617-909-7786 omri.schwarz(a)denhamcapital.com NOTICE: This e-mail message is intended for the named recipient(s) above and may contain confidential information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. NO REPRESENTATION OR WARRANTY IS MADE TO ANY PERSON AS TO THE ACCURACY OR COMPLETENESS OF THE INFORMATION CONTAINED HEREIN. Denham Capital Management(sm) is a trademark of Denham Capital Management LP.

1 0

[MonetDB-users] Building clients - php and perl dependencies
by David Svenson 15 Jan '09

15 Jan '09

Hi, I am trying to build MonetDB on windows, and so far I have successfully built 'buildtoos' and 'MonetDB' from the CVS. Now I'm trying to build 'clients' without PHP or PERL, but I'm having difficulties. The documentation says that only Phyton is required, however, I still get build errors related to perl and php dependencies. I do not set HAVE_PERL=1 or HAVE_PHP=1, and therefor expect the build not to rely on them. Am I missing something? Is there something else I need to do in order to build this project? -- View this message in context: http://www.nabble.com/Building-clients---php-and-perl-dependencies-tp214802… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] MALException:MAL.getAddress:address of 'bat.BKChasReadMode' not found (followup)
by Schwarz, Omri 15 Jan '09

15 Jan '09

I found the problem: the linker was silently balking at creating the .sos and not telling 'make' about it, so a full build was done without the shared libraries. It's a GNU linker/autoconf issue that the MonetDB team can't do much about besides posting this email where Google will find it, but thank you all for helping me diagnose the issue. Now I just have to work with the memory leak I'm seeing. I see I can log all memory operations, but where can I set memory usage to be limited altogether? Denham Quantitative Management LP 200 Clarendon Street, 25th Floor Boston, MA 02216 T: 617-587-5812 M: 617-909-7786 omri.schwarz(a)denhamcapital.com NOTICE: This e-mail message is intended for the named recipient(s) above and may contain confidential information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. NO REPRESENTATION OR WARRANTY IS MADE TO ANY PERSON AS TO THE ACCURACY OR COMPLETENESS OF THE INFORMATION CONTAINED HEREIN. Denham Capital Management(sm) is a trademark of Denham Capital Management LP.

1 0

[MonetDB-users] MALException:MAL.getAddress:address of 'bat.BKChasReadMode' not found (followup)
by Schwarz, Omri 14 Jan '09

14 Jan '09

Making some progress. Starting with a fresh merovingian process, I did an "strace -fe file,process -p PID] on it. "monetdb create test" did nothing, but "start test" shows it opens the dbfarm directory, and mal_init.mal, but then fails to find any of the MonetDB5 .sos [excriciating scroll included below] because only the .a and .la files got installed there. The build tree is also stripped of .sos. [root@mork MonetDBFast]# ls lib/MonetDB5/lib lib_aggr.a lib_batifthen.la lib_clients.a lib_inet.la lib_mal_scheduler.a lib_pqueue.la lib_streams.la lib_aggr.la lib_batmath.a lib_clients.la lib_inspect.a lib_mal_scheduler.la lib_profiler.a lib_str.la [...] and then gets this for a segfault: [pid 9810] rename("bat/BBP.dir", "bat/BACKUP/BBP.dir") = 0 [pid 9810] open("/usr/local/MonetDBFast/lib/MonetDB5/mal_init.mal", O_RDONLY) = 15 [pid 9810] open("/usr/local/MonetDBFast/lib/MonetDB5/mal_init.mal", O_RDONLY) = 15 [pid 9810] open("/usr/local [...] [pid 9810] open("/usr/local/MonetDBFast/lib/MonetDB5/bin/lib_blob.so", O_RDONLY) = -1 ENOENT (No such file or directory) [pid 9810] open("/usr/local/MonetDBFast/lib/MonetDB5/blob.mal", O_RDONLY) = 16 [pid 9810] open("/usr/local/MonetDBFast/lib/MonetDB5/blob.mal", O_RDONLY) = 16 [pid 9810] --- SIGSEGV (Segmentation fault) @ 0 (0) --- Process 9810 detached [pid 9811] +++ killed by SIGSEGV +++ [pid 9800] --- SIGCHLD (Child exited) @ 0 (0) --- [pid 9800] wait4(-1, Process 9800 suspended Denham Quantitative Management LP 200 Clarendon Street, 25th Floor Boston, MA 02216 T: 617-587-5812 M: 617-909-7786 omri.schwarz(a)denhamcapital.com NOTICE: This e-mail message is intended for the named recipient(s) above and may contain confidential information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. NO REPRESENTATION OR WARRANTY IS MADE TO ANY PERSON AS TO THE ACCURACY OR COMPLETENESS OF THE INFORMATION CONTAINED HEREIN. Denham Capital Management(sm) is a trademark of Denham Capital Management LP.

1 0

Re: [MonetDB-users] PF: "Group By" work-around no longer working?
by Jan Rittinger 14 Jan '09

14 Jan '09

On Jan 14, 2009, at 11:53, jz@uva wrote: > Hi Jan, > > I was also using the GROUP BY construct. > This is my query: ... > let $qid := tijah:queryall-id($query_nexi, $options) > let $nodes := tijah:nodes($qid) > let $result := for $node in $nodes > return > typeswitch ($node) > case $elem-node as element(*) > return > <result> > <num> { (count($node/$elem-node/preceding::*) + 1) + This snippet of XQuery is to complex: 'count($node/$elem-node/...'. Both $node and $elem-node contain the tijah-result nodes (with type node() and element(*), respectively). What you want to write is 'count($elem-node/...'. > > > string-length(tijah:getINEXPath($node)) } </num> > <file> { data($node/$elem-node/ancestor-or-self::EAD/@FILE) } </ > file> > <title> { data($node/$elem-node/ancestor-or-self::EAD/@TITLE) } > </title> ... > > <score> { tijah:score($qid, $node/$elem-node) } </score> > </result> > default return error ("unexpected node") > > let $total := count($result) > return <results total="{$total}"> { > for $res at $rankGlobal in distinct-values($result/file) > let $cs-group := $result[file = $res] > for $cs-group2 at $rank in $cs-group > where exists($cs-group2) this line is unnecessary as there is always exactly one item bound to $cs-group2. > > and $rank >= 1 this line is unnecessary as the positional variable always starts from 1 (and can never be less). > > and $rank <= 8 > and $rankGlobal >= $start > and $rankGlobal <= $end > order by $cs-group2 cast as xs:integer what do you want here? I very much doubt that you are able to atomize an XML snippet, then cast the string-value into a number and still get something meaningful out. > > return > <out id="{$res}">{ $cs-group2 }</out> > } </results> > > With this query, I get different results in MPS and Alg. I guess MPS treats your order by differently---read incorrectly---by ignoring every character data after the first number which accidently is the content of element num. Perhaps your query already works the way you expect it by replacing the ORDER BY by the following snippet: 'order by number($cs-group2/ num)'. Jan -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

3 3

[MonetDB-users] Monetdb source rpm install failed on Fedora 6.
by 小波顾 14 Jan '09

14 Jan '09

Now I am trying to install MonetDB5 on a Fedora 6 virtual machine, the source rpm I am using is MonetDB5-server-5.8.2-1.src.rpm, The following error messages was thrown when I enter rpm -i MonetDB5-server-5.8.2-1.src.rpm as root: [root@host01 monetdb5]# rpm -i MonetDB5-server-5.8.2-1.src.rpm warning: MonetDB5-server-5.8.2-1.src.rpm: Header V3 DSA signature: NOKEY, key ID 0583366fwarning: user sjoerd does not exist - using rootwarning: group sjoerd does not exist - using rootwarning: user sjoerd does not exist - using rootwarning: group sjoerd does not exist - using root Is there a step by step installation guide? _________________________________________________________________ News, entertainment and everything you care about at Live.com. Get it now! http://www.live.com/getstarted.aspx

3 2

[MonetDB-users] MALException:MAL.getAddress:address of 'bat.BKChasReadMode' not found
by Schwarz, Omri 14 Jan '09

14 Jan '09

I am trying to do a straight install of Monet's latest SuperBall (SP!) on Centos 5 (64 bits) and so here is the prologue to the build log: called with arguments: --enable-sql --enable-optimise --prefix=/var/tmp/TEST Copying /root/MonetDB-Nov2008-SuperBall-SP1/MonetDB to /var/tmp/MonetDB-1231879854 Copying /root/MonetDB-Nov2008-SuperBall-SP1/MonetDB-client to /var/tmp/MonetDB-1231879854 Copying /root/MonetDB-Nov2008-SuperBall-SP1/MonetDB5-server to /var/tmp/MonetDB-1231879854 Copying /root/MonetDB-Nov2008-SuperBall-SP1/MonetDB-SQL to /var/tmp/MonetDB-1231879854 * Processing MonetDB ./configure --prefix='/var/tmp/TEST' --enable-optimize --disable-debug --disable-assert --disable-strict --with-python-libdir=lib64/python2.5 --with-p ython-library=/usr/local/lib64/ --with-python-incdir=/usr/local/include/python2.5 The process completes and installs, but when merovingian tries to start a database, it logs this: MSG merovingian[17999]: refresh from mork.denhamcapital.corp for database TEST2 MSG merovingian[17999]: refresh from mork.denhamcapital.corp for database TEST MSG merovingian[17999]: starting database TEST due to control signal MSG TEST[18007]: executing '/usr/local/bin/mserver5' for database 'TEST' MSG merovingian[17999]: starting database 'TEST', up min/avg/max: 10/10/10, crash average: 0.00 0.00 0.00 (2-2=0) MSG TEST[18007]: # MonetDB server v5.8.0, based on kernel v1.26.0 MSG TEST[18007]: # Serving database 'TEST', using 8 threads MSG TEST[18007]: # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs statically linked MSG TEST[18007]: # Copyright (c) 1993-July 2008 CWI. MSG TEST[18007]: # Copyright (c) August 2008- MonetDB B.V., all rights reserved MSG TEST[18007]: # Visit http://monetdb.cwi.nl/ for further information MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:mdb: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:bat5: loader error /usr/local/lib/MonetDB5/lib/lib_bat5.so: undefined symbol: BATconvert MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:batExtensions: loader error lib_bat5.so.0: cannot open shared object file: No such file or dire ctory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:algebraExtensions: loader error lib_xml.so.0: cannot open shared object file: No such file or d irectory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:pqueue: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:factory: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:const: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:bbp: loader error lib_bat5.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:box: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:mat: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:bpm: loader error lib_bat5.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:inspect: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:manual: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:language: loader error lib_xml.so.0: cannot open shared object file: No such file or directory MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:constraints: loader error lib_xml.so.0: cannot open shared object file: No such file or directo ry MSG TEST[18007]: #WARNING: LoaderException:loadLibrary:mal_mapi: loader error /usr/local/lib/MonetDB5/lib/lib_mal_mapi.so: undefined symbol: ssl_rastr eam (and so on). I've tried both November and Novermber-SP1, with and without xquery, in misceleaneous and sundry combinations, and I wonder if it's a lib64 vesus lib issue, or whether mserver5/Mserver are failing to find some MAL files as well as thse so's. They have wound up in strange places like /usr/local/lib/MonetDB5/lib/lib_xml.so. What's the best way to tidy up this situation ? Denham Quantitative Management LP 200 Clarendon Street, 25th Floor Boston, MA 02216 T: 617-587-5812 M: 617-909-7786 omri.schwarz(a)denhamcapital.com NOTICE: This e-mail message is intended for the named recipient(s) above and may contain confidential information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. NO REPRESENTATION OR WARRANTY IS MADE TO ANY PERSON AS TO THE ACCURACY OR COMPLETENESS OF THE INFORMATION CONTAINED HEREIN. Denham Capital Management(sm) is a trademark of Denham Capital Management LP.

2 1

[MonetDB-users] PF: "Group By" work-around no longer working?
by jz＠uva 14 Jan '09

14 Jan '09

Hi all, I am using MonetDB Nov2008-SP1 release with XQuery. I need to group the results that I retrieve by file. Since XQuery does not have a 'group by' function as in SQL, I was using the workaround of Borkar and Carey, see http://www.idealliance.org/proceedings/xml04/papers/229/XQueryExtensionsFin… This was working fine for the version of half year ago, but with the latest release the trick with 'distinct-values' is no longer working. The results are returned not grouped by file, e.g. {A,A,A}, {B,B}, {C,C,C,C}, etc. Is this true for other users as well? Am I going crazy? ;) Could someone please test whether this still works? Thanks and regards, junte

2 2

[MonetDB-users] Glusterfs db backend: MonetDB
by Mark V 13 Jan '09

13 Jan '09

Hi, It seems that glusterfs can be sensitive to the DB backend used in some cases. Has MonetDB been considered/contemplated as a back end? http://monetdb.cwi.nl/ http://monetdb.cwi.nl/projects/monetdb/SQL/Benchmark/TPCH/index.html Given MonetDB is still being developed this would be more of a 'roadmap' item. Mark

1 0

[MonetDB-users] Optimizer exceptions when working with Mapi Interface
by David Svenson 08 Jan '09

08 Jan '09

Hi all, I am encountering strange exceptions that are related to the optimizer when working with the MAPI interface. I seem to be getting them when I use a few parallel threads to query the database (Always with the same query). However, I don't get them in a consistent way - I can't reproduce an exact scenario. The exception messages I get also vary - but they are always related to the optimizer. Here are a few of the exception messages I got: 'optimizer.rsColumn' undefined in: _50:any := optimizer.rsColumn() 'calc.opt_remoteQueries' undefined in: _16:any := calc.opt_remoteQueries(_17:oid) 'optimizer.inc_parts' undefined in: _39:any := optimizer.inc_parts() Sometimes, once I get one of these, any following query will give me an exception too, unless I restart MonetDB. In these cases I tried to run the query through mclient, and got the exception too, but followed by the expected query result. Any idea where this is coming from and what I can do to prevent it? Thanks, David. -- View this message in context: http://www.nabble.com/Optimizer-exceptions-when-working-with-Mapi-Interface… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] large COPY INTO jobs vs. INSERT
by David Svenson 08 Jan '09

08 Jan '09

Hi, I am working with MonetDB v 5.8.2 on a 32 bit machine with 2GB of RAM. I have a 20 CSV files, each containing 200,000 rows and 59 columns. I want to import all of them into one table. When I start running 'COPY INTO's to do that, everything goes well untill the 15th file (which should bring the table up from 2.8 million rows up to 3 million). The 15th file fails. When working with the MAPI interface, the database ends up being corrupt - but works again if I remove the logs. When trying the same directly through mclient.exe, it also fails at around the 15th file, and gives this error: !SQLException:sql.bind:Cannot access descriptor !ERROR: GDKload: cannot read: name=11\1100, ext=tail, 400000 bytes missing. !OS: The operation completed successfully. !ERROR: GDKload: failed name=11\1100, ext=tail 0 tuples I tried two things: 1. I ran 16 'COPY INTO', but this time into 16 different tables. Then I ran INSERT sqls on all of them into one target table. That worked fine, and I passed the 3 Million barrier I ran into with COPY INTO. 2. I tried the same on a 64 bit machine - Everything worked just fine with 'COPY INTO' So what does all of this mean? How do I interpret the error message? Can I / Should I expect from a 32 bit machine to be able to handle what I wanted it to? And if it's a memory issue - then how come everything worked with INSERTs but not with COPY INTOs. Thanks, David. -- View this message in context: http://www.nabble.com/large-COPY-INTO-jobs-vs.-INSERT-tp21351353p21351353.h… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] copy data from postgresql to monetdb?
by Chris Curvey 08 Jan '09

08 Jan '09

Hi! Newbie here! Before I go about trying to re-invent the wheel, has anyone written scripts to reverse-engineer a PostgreSQL database, convert the SQL to MonetDB's dialect and copy in the data? (I've Google and I can't seem to find such an animal.) -Chris -- Corruptissima republica plurimae leges

2 1

[MonetDB-users] Function errors
by David Svenson 08 Jan '09

08 Jan '09

Hi there... I've been trying to export the mtime. str_to_date function to the sql interface by calling the following script from the sql client: create function str_to_date(s string, format string) returns date external name mtime."str_to_date"; After the function was created, I am trying to use it in the following way: select str_to_date('6 Dec 2001 12:33:45', '%d %b %Y %H:%M:%S'); But, I always get an error: "mtime.str_to_date:strptime support missing" Am I supposed to load some extra module into the server that is not loaded into the monet server on startup? Thanks for everthing… -- View this message in context: http://www.nabble.com/Function-errors-tp21336686p21336686.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

Re: [MonetDB-users] Hello. some questions about XRPC...
by Ying Zhang 07 Jan '09

07 Jan '09

Hello Nicolas, I need some more information about your problems to be able to help. First of all, some general questions: - which version of MonetDB/XQuery do you use? - which OS? - some hardware specifications On Jan 06, 2009, at 14:45 , Nicolas James wrote: > Hello Ying, > > Thanks for all these responses, they have been very helpful to me > (the real problem I had, and now resolved, was about the call to the > functions of pathfinder). > > I've coded a Java client for indexing my data (image descriptions > and annotations in XML files) in MonetDB/XQuery, 46,557 XML > documents / 181.1Mo and I use XRPC. Is 181.1MB the size of one document (then the total size is > 8TB!) or the size of all 46557 documents? Do I understand it correctly that you have a Java client which send XRPC request messages to MonetDB/XQuery server to add documents? How does your Java client exactly work, i.e.: - does it add one document at a time, or all 46557 documents in one request? - is your Java client and MonetDB/XQuery server on the same machine? - do you use pf:add-doc() or fn:put() to add the documents? > My client works well but I don't understand some MonetDB behaviors. > My first tests created collections like my dataset and his > directories structure, I don't understand what you mean here. As far as I know, it is not possible to create nested collections in MonetDB/XQuery, and it is not possible to create empty collections (without adding a document). So, how did you create the collections? > but I've some directories with over that 900 documents, and I think > that MonetDB doesn't like that (i.e. 900 documents in one > collections), because the indexation failed. I don't know the exact max nr. of documents a collection may have, I think it is limited by if you are using a 32bits system or a 64bits system. Using mlcient, adding 46,557 documents of 11k each on a Fedora machine was no problem; adding > 900 documents of 200MB each is still processing (disk usage is still growing) when I'm writing this e-mail :) Did you add your documents using your Java client? Have you tried to add your documents without using XRPC, e.g., using mclient? What do you mean with "indexation failed"? Is there any error message? > Then, I try to split my dataset, I create collections of 128 > documents, but my problem is that in MonetDB all my collections does > not contain 128 doc, some 128 others a number between 5 and 128... > It's a little strange because I don't think the reason is my client... For this problem, I have similar questions, i.e.: - how large are the documents? - how are they added _exactly_? - Did you get any error message? Kind regards, Jennie > > Have you ever heard about a similar problem in MonetDB? > > Thanks previous responses, > > best regards, > > Nicolas James > > > Ying Zhang wrote: >> Hello Nicolas, >> >> First of all, thanks for trying MonetDB. I will try to answer your >> XRPC >> questions. >> >> >> On Tue, Dec 16, 2008 at 04:35:33PM +0100, Nicolas James wrote: >> >>> Hello MonetDB, >>> >>> I have some questions about the writing of a client for MonetDB in >>> Java using the XRPC, and It could be very very helpful for my >>> research if you could answer to some questions. >>> >>> I'm a PhD student in the MAS laboratory, Ecole Centrale Paris, >>> France, and I work on image automatic annotation. >>> I think MonetDB is extremely powerful and I want to use it in my >>> research, I would to store some images annotations under the form >>> of XML file in MonetDB since my application (a Java application). >>> >>> So, with your documentation I coded a light client using the JDBC >>> driver for adding my documents in MonetDB, but this way don't >>> satisfy me, the XRPC method is very attractive, but I've some >>> problems. >>> >>> 1) how add a document using the XRPCWrapper (using the pf:add-doc, >>> it's considered like an updating function, I've read the document, >>> but I don't understand...). >>> >> >> XRPC has several components. >> The XRPC protocol is a way of communicating with MonetDB/XQuery to >> run >> XQuery queries. An XRPC server is integrated in MonetDB/XQuery to >> handle requests speaking the XRPC protocol. >> >> Hence, to communicate with MonetDB/XQuery using XRPC, you only need >> to >> send requests according to the XRPC protocol. For Java, there are >> several API functions for creating request messages, sending and >> receiving messages, and handling response messages. The Java doc of >> these APIs could be found here: >> http://homepages.cwi.nl/~fabian/MonetDB/Java%20Package.html/index.html?nl/c… >> The Java package of the APIs could be found under the directory where >> you have installed MonetDB: share/MonetDB/lib/xrpcapi.jar >> In the same directory there is an xrpcclient.jar package, which gives >> an example of how to use the APIs. It's source could found in: >> java/src/nl/cwi/monetdb/xquery/xrpc/client >> >> You don't need the XRPCWrapper, in your case. XRPCWrapper is >> needed if >> you want to handle (simple) XRPC requests using another XQuery engine >> than MonetDB/XQuery. >> >> >> >>> 2) Is-it possible to create collections using the XRPC (and add >>> files in this collection) ? >>> >> >> I'm not sure if I understand you correctly. >> >> With XRPC, you can execute the pf:add-doc() function (you need to >> put it >> into an user-defined-function). with pf:add-doc(), you could specify >> the name of the collection to which you want to add your document. >> If >> such collection doesn't exist, it is created. Otherwise, your >> document >> will be added to the existing collection. >> >> >>> 3) and with the JDBC driver ? >>> 4) using the JDBC driver, is it possible to specify the reference >>> id for the file (for instance indexing the file "foobar.xml" and >>> referenced "foobar.xml" in the database ? >>> >> >> What do you mean with 'indexing the file "foobar.xml"'? >> (Disclaimer: I don't know much about the JDBC driver) >> >> >> Hope this helps a bit. If you have any problem with using the XRPC >> API, >> please don't hesitate to ask. >> >> >> >> Regards, >> >> Jennie >> >> >>> These answers could help me, hope you could have time to answer! >>> >>> best regards, >>> >>> -- >>> Nicolas James >>> PhD student MAS / ECP >>> Phone: +33.1.41.13.17.37 >>> Office: Lab, C 441A >>> Laboratoire MAS - Ecole Centrale Paris >>> Grande Voie des Vignes >>> 92295 CHATENAY MALABRY Cedex >>> France >>> >>> >> >> > > > -- > Nicolas James > PhD student MAS / ECP > Phone: +33.1.41.13.17.37 > Office: Lab, C 441A > Laboratoire MAS - Ecole Centrale Paris > Grande Voie des Vignes > 92295 CHATENAY MALABRY Cedex > France >

1 0

[MonetDB-users] what is monet_vault_key used for?
by 小波顾 05 Jan '09

05 Jan '09

_________________________________________________________________ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/windows/windowslive/

3 2

[MonetDB-users] Is there any way to run MonetDB as a Windows Service?
by 小波顾 05 Jan '09

05 Jan '09

Thanks. _________________________________________________________________ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/windows/windowslive/

3 2

[MonetDB-users] COPY INTO on aggregate queries crashes MonetDB
by Peter Farkash 04 Jan '09

04 Jan '09

Hi, When I use COPY INTO with a count query, monetDB crashes. For example: copy select count (*) into 'C:\\copyinto.txt' using delimiters ','; Gives me the following result and kills the server: MAPI = monetdb@localhost:50000 ACTION= read_line QUERY = copy select count (*) into 'C:\\copyinto.txt' using delimiters ','; ERROR = Connection terminated The same happens if I use sum, average, etc. On normal queries the copy into works just fine. I am using v5.8.2, and am getting the crash both when using mclient and the MAPI programming interface. Any ideas? -- View this message in context: http://www.nabble.com/COPY-INTO-on-aggregate-queries-crashes-MonetDB-tp2127… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] What code page does Monetdb currentlly use?
by 小波顾 03 Jan '09

03 Jan '09

We are Chinese users, and hoping Monetdb will support multi-byte character encodings like UTF-8 and GBK. _________________________________________________________________ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/windows/windowslive/

5 6

[MonetDB-users] Monetdb5 threading question.
by 小波顾 02 Jan '09

02 Jan '09

When I start the default demo database (or a new created one) process on Windows XP, the following messaged appears in the command window : # Serving databse 'demo', using 1 thread Does it mean the whole database process is single-threaded? The following section in the monetdb5.config file shows we can config multiple threads # Mserver 5 recognizes a series of command line names instead:# --threads ( 1 | PARMASK)# --memory (MEMMASK )# --properties (CHECKMASK | PROPMASK | BATMASK )# --io (IOMASK | PERFMASK )# --transactions ( TMMASK | DELTAMASK | TEMMASK)# --modules (DLMASK | LOADMASK)# --algorithms (ALGOMASK | ESTIMASK)# --xproperties (XPROPMASK )# --performance (JOINPROPMASK | DEADBEEFMASK) What does 'parmsk' mean, and how to config monetdb to use multiple threads? _________________________________________________________________ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/windows/windowslive/

3 4

[MonetDB-users] Multiple database question.
by 小波顾 02 Jan '09

02 Jan '09

I have created a customed version of the MServer5.bat and MClient.bat to serve multiple databases. MServer5.bat : set MONETHOME=D:\Amber\Program\MonetDB\MonetDB5 set MONETDATAROOT=%1set MONETDATAROOT=%MONETDATAROOT:~0,-1%set MONETDBNAME=%2 if "%MONETDATAROOT%" == "" pauseif "%MONETDBNAME%" == "" pause set PATH=%MONETHOME%\bin;%MONETHOME%\lib;%MONETDB%\lib\MonetDB5;%PATH% set MONETDBFARM=--dbfarm="%MONETDATAROOT%\dbfarm"set SQLLOGDIR=--set "sql_logdir=%MONETDATAROOT%\sql_logs"set XQUERYLOGDIR=--set "xquery_logdir=%MONETDATAROOT%\xquery_logs" rem start the real server"%MONETHOME%\bin\mserver5.exe" --set "prefix=%MONETHOME%" --set "exec_prefix=%MONETHOME%" %MONETDBFARM% %SQLLOGDIR% --dbname=%MONETDBNAME% --dbinit="include sql;" MClient5.bat @set MONETHOME=D:\Amber\Program\MonetDB\MonetDB5 @set DBNAME=%1if "%DBNAME%" == "" pause @rem extend the search path with our EXE and DLL folders@rem we depend on pthreadVCE.dll having been copied to the lib folder@set PATH=%MONETHOME%\bin;%MONETHOME%\lib;%MONETHOME%\lib\bin;%PATH% @rem start the real client@"%MONETHOME%\bin\mclient.exe" -lsql -d %DBNAME% @if ERRORLEVEL 1 pause Using "MServer5.bat D:\MONETDB amber" I am able to start a new server process, ant it successfully created a new database in D:\MONETDB directory, but with the new server and default demo server process all running, I can't use mclient connect to the new database. MClient5.bat amber D:\>mclient.exe -E GB2312 -lsql -d amber!database 'amber' does not exist But the demo database can be connected to, and the new database can be connected to only when I close the demo database process. The netstat -a command shows there are two processes listening on port 50000. _________________________________________________________________ Invite your mail contacts to join your friends list with Windows Live Spaces. It's easy! http://spaces.live.com/spacesapi.aspx?wx_action=create&wx_url=/friends.aspx…

2 2

[MonetDB-users] Is there any load speed measurements of MonetDB?
by 小波顾 30 Dec '08

30 Dec '08

_________________________________________________________________ Drag n’ drop—Get easy photo sharing with Windows Live™ Photos. http://www.microsoft.com/windows/windowslive/photos.aspx

1 0

[MonetDB-users] Can someone point to me some resources about memory and storage model of MonenDB.
by 小波顾 30 Dec '08

30 Dec '08

Thanks. _________________________________________________________________ Invite your mail contacts to join your friends list with Windows Live Spaces. It's easy! http://spaces.live.com/spacesapi.aspx?wx_action=create&wx_url=/friends.aspx…

1 0

[MonetDB-users] Copy Into problem
by Alfred Nordman 30 Dec '08

30 Dec '08

Hi there, I'm trying to use the copy into with csv file (utf-8 encoded) and I encounter some problem. The create statement is: CREATE TABLE "sa3e7e9f4d666429ea2c5bb61a532f5b9" ("A" DATE ,"B" VARCHAR (22) ,"C" DECIMAL (12, 5) ,"D" DECIMAL (12, 5) ,"E" DECIMAL (12, 5) ,"F" DECIMAL (12, 5) ) The copy into statement is: COPY INTO "sa3e7e9f4d666429ea2c5bb61a532f5b9" FROM 'T:\\Prism\\Applications\\Desktop\\PrismDesktop\\bin\\Debug\\LocalRepository\\ImportedCSV\\ImportedCSV0.csv' USING DELIMITERS '|' NULL AS 'A56A9FC261A143a48F6019F602ABF409'; And csv is attached. Any advice?!?!?! tnx, Alfred. http://www.nabble.com/file/p21200441/ImportedCSV0.csv ImportedCSV0.csv -- View this message in context: http://www.nabble.com/Copy-Into-problem-tp21200441p21200441.html Sent from the monetdb-users mailing list archive at Nabble.com.

6 13

[MonetDB-users] COPY INTO problem
by Alfred Nordman 30 Dec '08

30 Dec '08

Hi there, I'm trying to use the copy into with csv file (utf-8 encoded) and I encounter some problem. The create statement is: CREATE TABLE "sa3e7e9f4d666429ea2c5bb61a532f5b9" ("A" DATE ,"B" VARCHAR (22) ,"C" DECIMAL (12, 5) ,"D" DECIMAL (12, 5) ,"E" DECIMAL (12, 5) ,"F" DECIMAL (12, 5) ) The copy into statement is: COPY INTO "sa3e7e9f4d666429ea2c5bb61a532f5b9" FROM 'T:\\Prism\\Applications\\Desktop\\PrismDesktop\\bin\\Debug\\LocalRepository\\ImportedCSV\\ImportedCSV0.csv' USING DELIMITERS '|' NULL AS 'A56A9FC261A143a48F6019F602ABF409'; And csv is attached. Any advice?!?!?! tnx, Alfred. http://www.nabble.com/file/p21193416/ImportedCSV0.csv ImportedCSV0.csv -- View this message in context: http://www.nabble.com/COPY-INTO-problem-tp21193416p21193416.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] Announcement: New bug fix release of MonetDB suite
by Sjoerd Mullender 22 Dec '08

22 Dec '08

The MonetDB team at CWI is pleased to announce the Nov2008-SP1 bug fix release of the MonetDB suite of programs. This is a bug fix release of last month's Nov2008 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Nov2008/#Nov200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

3 2

[MonetDB-users] multi-users and memory problems
by Loredana Afanasiev 21 Dec '08

21 Dec '08

Dear developers, I'm currently running the CVS head of Dec 11, 2008. I apologies in advance for missing on details. If needed I'll provide more. Thank you, and lots of wonderful wishes for Xmas and for the New Year!!! (this is the last email you'll get from me this year, I promise :)) l. Observation 1: When trying to run big numbers of clients simultaneously, the server crushes. For me it crushed with 70 and 100 clients fired at the same time. Observation 2: After running one query in a multi-user scenario (N clients/threads simultaneously) the memory footprint of mserver (% of the memory that the server occupies) grew. After repeating the experiment M times the memory grew each time with a constant. Running the same query sequentially the same number of times leaves the footprint of mserver constant. Could it be a faulty memory cleaning? Query: q3.xq let $col := fn:collection("MotiesTweedeKamer") let $years := fn:distinct-values( for $date in $col//hiddendatum return fn:substring(fn:string($date),1,4)) for $y in $years order by $y ascending return <result year="{$y}" count="{ count($col//document[fn:substring(fn:string(.//hiddendatum),1,4) = $y]) }"/> N=50 M=1 $ perl runNclients.pl N=50 $ top PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 28563 lafanasi 20 0 6266m 5.1g 100m S 0 26.0 10:50.71 Mserver M=2 PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 28563 lafanasi 20 0 7546m 5.9g 100m S 0 30.1 21:42.67 Mserver ... N=60 M=10 PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 31182 lafanasi 20 0 17.3g 8.3g 100m S 0 42.3 263:45.37 Mserver ... M=30 PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 31182 lafanasi 20 0 22.7g 9.6g 100m S 0 48.8 395:08.87 Mserver Sequential run: N=1 M=50 times PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 28372 lafanasi 20 0 839m 430m 100m S 1 2.1 6:26.65 Mserver M=100 times PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 28372 lafanasi 20 0 839m 430m 100m S 1 2.1 6:26.65 Mserver Observation 3: The times it takes to run 10 Tijah search queries simultaneously is the same as the time it takes to run them sequentially. The percentage of CPU used in both cases by mserver is also similar. Does tijah support multi-users? Query: q2.xq let $opt := <TijahOptions ft-index="polietiekedata" ir-model="NLLR"/> let $c := collection("HAN") let $qid := tijah:query-id($c, "//spreker[about(.,%KEYWORD%)]", $opt) for $res in tijah:nodes($qid) return <pair>{( string($res/@naam), tijah:score($qid, $res))}</pair> 20 users/threads stopMserver,startMserver (to make sure that the server freed the memory) $time Run20Threads(mclient -lx q2.xq) 0.134u 0.118s 0:20.01 1.1% 0+0k 0+8io 0pf+0w sequential run, 20 times stopMserver, startMserver $ time for i in `seq 1 10`; do mclient -lx q2.xq; done 0.060u 0.067s 0:19.74 0.6% 0+0k 0+8io 0pf+0w Observation 4: The mserver memory footprint grows very fast when running Tijah queries. When the footprint reaches 98% the query processing time gets really slow or the server crushes. Query: the same as above Sequential run, M=90 times $stopMserver, startMserver $for i in `seq 1 10`; do mclient -lx q2.xq; done $ top PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 24527 lafanasi 20 0 26.2g 19g 80m S 66 98.0 4:24.57 Mserver

2 1

[MonetDB-users] mserver memory grows, system thrashes and hangs
by Bostr 18 Dec '08

18 Dec '08

Hello MonetDB Nov2008 release, built with all standard options on RedHat EL 5 (2.6.18-92.el5 #1 SMP), on HP Proliant DL380 8-way, 16GB RAM / 16GB swap, with dbfarm on a RAID0 internal 7-disk array. I'm doing bulk load tests (using mclient to run COPY INTO table FROM file), repeatedly loading 500,000 row (68M) CSV files into a fact table, while periodically running a suite of test queries in a separate process to test query times as the fact table grows. The problem is that as the fact table grows to around 80Million records, the database starts to consume all available system memory and swap, the system thrashes and comes to its knees. I also get database corruption causing foreign key violations. (More details below) Has anyone else seen this? Any ideas if it's a bug, memory leak? Or could this be caused by operator error? Suggestions? Cheers Bob PS More detailed account of the problem below: Everything starts off fine, files load in 8-10 seconds, queries quite fast. As the table starts to fill, the queries (not unexpectedly) start to slow. But (unexpectedly) the memory consumption of the mserver5 process steadily increases. At some point, around 80Million records, the system performance rapidly starts to degrade. Query times dramatically increase, load time also dramatically increases, and the entire system thrashes and becomes unusable. Running 'top' shows that mserver5 has consumed vurtually all physical memory, and most of the swap too. top - 16:33:34 up 28 days, 23:52, 8 users, load average: 1.68, 1.51, 1.96 Tasks: 224 total, 1 running, 223 sleeping, 0 stopped, 0 zombie Cpu(s): 0.1%us, 1.5%sy, 0.0%ni, 85.9%id, 12.4%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 16439196k total, 16298404k used, 140792k free, 2300k buffers Swap: 18876364k total, 13315960k used, 5560404k free, 9824352k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 32380 monetdb 18 0 54.6g 14g 9.4g S 12 94.9 107:19.46 mserver5 29217 bostr 15 0 290m 5552 2264 S 1 0.0 12:01.37 gnome-terminal The first time this happened, I stopped the load scripts, restarted the database, and that helped things for a little while, but it wasn't long before the memory was all consumed again, and performance went to the dogs. Then loads started failing with foreign-key violation errors.. Inspection showed a corrupted dimension table that somehow ended up with a bunch of bad values in it.. So I blew away, and recreated the database. This time I tried adding the line 'gdk_nr_threads=1' to the monetdb5.conf file - having seen a defect report related to 'COPY INTO ' being buggy and this being the solution. But the same thing happened again.. it ran fine again until I had about 100Million rows, then memory problems/thrashing. Restarted the server again, and shortly after the data loads failed again with foreign-key violations and a corrupted dimension table.. -- View this message in context: http://www.nabble.com/mserver-memory-grows%2C-system-thrashes-and-hangs-tp2… Sent from the monetdb-users mailing list archive at Nabble.com.

4 5

[MonetDB-users] Again: Mserver fails on Fedora 9 - 32 bit
by Hans van Rijswijk (DT) 11 Dec '08

11 Dec '08

Hi MonetDB users, I downloaded Monet Fedora RPMs from: http://monetdb.cwi.nl/testing/projects/monetdb/Stable/.DailyBuilds./2008 1209/RPMs/Fedora9.i386.oid32/ I installed these with yum on my Fedora fc9 installation, running within VMWare on my Windows XP 32 bit machine. When I startup Mserver everything seems to work well. I start with an empty dbfarm. Then I run the following scenario: - Add 3 XML documents with pf:add-doc() (some of them updatable) - Add 2 more XML documents with pf:add-doc() - Update one of these docs: do insert <something/> into doc("a.xml")/rootelement - Send a sync() command with mclient mil. - Check the content of the database with pf:documents() (is OK) - Knock down Mserver: kill <pid> - Startup Mserver again (don't ask me why I do it like this) After this scenario I cannot gain access to Mserver with mclient: !xchange_challenge: frontend xquery not found If I wait half an hour before killing Mserver this works fine. Questions: - Does sync() do what it is supposed to do? - Why is shutdown() not implemented? - What is the right way to shutdown Mserver when it is started as a daemon in the background? - How do I guarantee the database to remain intact with the abovementioned scenario? Regards, Hans van Rijswijk Netherlands Forensic Institute

4 7

[MonetDB-users] crash on Windows with local install
by Bryan Lewis 11 Dec '08

11 Dec '08

If I install MonetDB in the normal way on a Windows machine, it installs the C runtime library dlls in a location like C:\WINDOWS\WinSxS\x86_Microsoft.VC80.CRT... However, we want to install MonetDB along with our product, in a single installation procedure that doesn't require the user to have administrative rights. That means we need to install the CRT directory as "private assemblies", copying it to the MonetDB application directories. I've almost gotten this to work by copying the CRT directory to MonetDB5/lib, bin and lib/MonetDB5. I can run MSQLServer.bat and mclient.bat in separate console windows. But when I try to run some SQL commands (my test case is a 'create table' and a 'copy into' from a CSV file), mclient dies with a Windows exception. The event in Event Viewer shows: Faulting application mclient.exe, version 0.0.0.0, faulting module ntdll.dll In theory the private assemblies are all that Windows needs, and in fact the programs run which implies that the libraries are being found. I don't understand why the crash happens later. I'm hoping someone else has tried this. The exception happens with the last official Windows release as well as with our built-from-cvs version. Thanks, Bryan Lewis

3 2

[MonetDB-users] Mserver fails on Fedora 9 - 32 bit
by Hans van Rijswijk (DT) 09 Dec '08

09 Dec '08

Hi MonetDB users, I downloaded Monet Fedora RPMs from: http://monetdb.cwi.nl/testing/projects/monetdb/Stable/.DailyBuilds./2008 1209/RPMs/Fedora9.i386.oid32/ I installed these with yum on my Fedora fc9 installation, running within VMWare on my Windows XP 32 bit machine. I got the following messages when starting Mserver: # MonetDB Server v4.26.1 # based on GDK v1.26.1 # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-, MonetDB B.V.. All rights reserved. # Compiled for i686-redhat-linux-gnu/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah !ERROR: logger: could not use bat (209) for 1000000000_map_pid !ERROR: logger: could not use bat (210) for 1000000000_rid_size !ERROR: logger: could not use bat (442) for 1000000000_rid_level !ERROR: logger: could not use bat (392) for 1000000000_rid_prop !ERROR: logger: could not use bat (441) for 1000000000_rid_kind !ERROR: logger: could not use bat (412) for 1000000000_rid_nid !ERROR: logger: could not use bat (418) for 1000000000_nid_rid !ERROR: logger: could not use bat (211) for 1000000000_qn_histogram !ERROR: logger: could not use bat (451) for 1000000000_qn_prefix_uri_loc !ERROR: logger: could not use bat (452) for 1000000000_qn_uri_loc !ERROR: logger: could not use bat (453) for 1000000000_qn_prefix !ERROR: logger: could not use bat (454) for 1000000000_qn_uri !ERROR: logger: could not use bat (455) for 1000000000_qn_loc !ERROR: logger: could not use bat (456) for 1000000000_prop_text !ERROR: logger: could not use bat (457) for 1000000000_prop_com !ERROR: logger: could not use bat (458) for 1000000000_prop_ins !ERROR: logger: could not use bat (459) for 1000000000_prop_tgt !ERROR: logger: could not use bat (460) for 1000000000_prop_val !ERROR: logger: could not use bat (379) for 1000000000_attr_own !ERROR: logger: could not use bat (406) for 1000000000_attr_qn !ERROR: logger: could not use bat (427) for 1000000000_attr_prop !ERROR: logger: could not use bat (245) for 1000000001_map_pid !ERROR: logger: could not use bat (246) for 1000000001_rid_size !ERROR: logger: could not use bat (423) for 1000000001_rid_level !ERROR: logger: could not use bat (384) for 1000000001_rid_prop !ERROR: logger: could not use bat (436) for 1000000001_rid_kind !ERROR: logger: could not use bat (421) for 1000000001_rid_nid !ERROR: logger: could not use bat (100) for 1000000001_nid_rid !ERROR: logger: could not use bat (247) for 1000000001_qn_histogram !ERROR: logger: could not use bat (391) for 1000000001_qn_prefix_uri_loc !ERROR: logger: could not use bat (471) for 1000000001_qn_uri_loc !ERROR: logger: could not use bat (383) for 1000000001_qn_prefix !ERROR: logger: could not use bat (478) for 1000000001_qn_uri !ERROR: logger: could not use bat (479) for 1000000001_qn_loc !ERROR: logger: could not use bat (480) for 1000000001_prop_text !ERROR: logger: could not use bat (481) for 1000000001_prop_com !ERROR: logger: could not use bat (482) for 1000000001_prop_ins !ERROR: logger: could not use bat (483) for 1000000001_prop_tgt !ERROR: logger: could not use bat (484) for 1000000001_prop_val !ERROR: logger: could not use bat (414) for 1000000001_attr_own !ERROR: logger: could not use bat (103) for 1000000001_attr_qn !ERROR: logger: could not use bat (102) for 1000000001_attr_prop !ERROR: logger: could not use bat (380) for 1000000002_map_pid !ERROR: logger: could not use bat (425) for 1000000002_rid_size !ERROR: logger: could not use bat (438) for 1000000002_rid_level !ERROR: logger: could not use bat (378) for 1000000002_rid_prop !ERROR: logger: could not use bat (279) for 1000000002_rid_kind !ERROR: logger: could not use bat (399) for 1000000002_rid_nid !ERROR: logger: could not use bat (416) for 1000000002_nid_rid !ERROR: logger: could not use bat (405) for 1000000002_qn_histogram !ERROR: logger: could not use bat (431) for 1000000002_qn_prefix_uri_loc !ERROR: logger: could not use bat (443) for 1000000002_qn_uri_loc !ERROR: logger: could not use bat (229) for 1000000002_qn_prefix !ERROR: logger: could not use bat (472) for 1000000002_qn_uri !ERROR: logger: could not use bat (498) for 1000000002_qn_loc !ERROR: logger: could not use bat (499) for 1000000002_prop_text !ERROR: logger: could not use bat (500) for 1000000002_prop_com !ERROR: logger: could not use bat (501) for 1000000002_prop_ins !ERROR: logger: could not use bat (502) for 1000000002_prop_tgt !ERROR: logger: could not use bat (503) for 1000000002_prop_val !ERROR: logger: could not use bat (433) for 1000000002_attr_own !ERROR: logger: could not use bat (327) for 1000000002_attr_qn !ERROR: logger: could not use bat (468) for 1000000002_attr_prop !ERROR: logger: could not use bat (555) for 1000000003_map_pid !ERROR: logger: could not use bat (238) for 1000000003_rid_size !ERROR: logger: could not use bat (388) for 1000000003_rid_level !ERROR: logger: could not use bat (239) for 1000000003_rid_prop !ERROR: logger: could not use bat (386) for 1000000003_rid_kind !ERROR: logger: could not use bat (556) for 1000000003_rid_nid !ERROR: logger: could not use bat (557) for 1000000003_nid_rid !ERROR: logger: could not use bat (206) for 1000000003_qn_histogram !ERROR: logger: could not use bat (487) for 1000000003_qn_prefix_uri_loc !ERROR: logger: could not use bat (512) for 1000000003_qn_uri_loc !ERROR: logger: could not use bat (510) for 1000000003_qn_prefix !ERROR: logger: could not use bat (509) for 1000000003_qn_uri !ERROR: logger: could not use bat (508) for 1000000003_qn_loc !ERROR: logger: could not use bat (507) for 1000000003_prop_text !ERROR: logger: could not use bat (506) for 1000000003_prop_com !ERROR: logger: could not use bat (283) for 1000000003_prop_ins !ERROR: logger: could not use bat (409) for 1000000003_prop_tgt !ERROR: logger: could not use bat (393) for 1000000003_prop_val !ERROR: logger: could not use bat (465) for 1000000003_attr_own !ERROR: logger: could not use bat (204) for 1000000003_attr_qn !ERROR: logger: could not use bat (474) for 1000000003_attr_prop !ERROR: logger: could not use bat (489) for 1000000004_map_pid !ERROR: logger: could not use bat (370) for 1000000004_rid_size !ERROR: logger: could not use bat (428) for 1000000004_rid_level !ERROR: logger: could not use bat (546) for 1000000004_rid_prop !ERROR: logger: could not use bat (419) for 1000000004_rid_kind !ERROR: logger: could not use bat (196) for 1000000004_rid_nid !ERROR: logger: could not use bat (537) for 1000000004_nid_rid !ERROR: logger: could not use bat (470) for 1000000004_qn_histogram !ERROR: logger: could not use bat (511) for 1000000004_qn_prefix_uri_loc !ERROR: logger: could not use bat (396) for 1000000004_qn_uri_loc !ERROR: logger: could not use bat (390) for 1000000004_qn_prefix !ERROR: logger: could not use bat (382) for 1000000004_qn_uri !ERROR: logger: could not use bat (426) for 1000000004_qn_loc !ERROR: logger: could not use bat (387) for 1000000004_prop_text !ERROR: logger: could not use bat (518) for 1000000004_prop_com !ERROR: logger: could not use bat (532) for 1000000004_prop_ins !ERROR: logger: could not use bat (569) for 1000000004_prop_tgt !ERROR: logger: could not use bat (562) for 1000000004_prop_val !ERROR: logger: could not use bat (515) for 1000000004_attr_own !ERROR: logger: could not use bat (539) for 1000000004_attr_qn !ERROR: logger: could not use bat (224) for 1000000004_attr_prop # MonetDB/XQuery module v0.26.1 loaded (default back-end is 'algebra') # XRPC administrative console at http://127.0.0.1:51241/admin This is not all: also mclient could not communicate with Mserver: $ mclient -p51240 -lx !xchange_challenge: frontend xquery not found The same applies when running this distribution on Fedora 10. Did anyone encounter a similar problem; Does anyone know a workaround? Hope to hear from one of you soon.. Regards, Hans van Rijswijk Netherlands Forensic Institute

2 1

[MonetDB-users] Announcement: New feature release of MonetDB suite
by Sjoerd Mullender 08 Dec '08

08 Dec '08

The MonetDB team at CWI is pleased to announce the new "Nov2008" release of the MonetDB suite of programs. This is a feature release, involving, among other things, a change in the database format, so be sure to dump your databases before attempting an upgrade. More information on the new release is available at <https://sourceforge.net/forum/forum.php?forum_id=892621>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[MonetDB-users] Mclient exit value
by Floris Ouwendijk (DT) 04 Dec '08

04 Dec '08

Dear users, While investigating a problem where a collection-query returns invalid data, I ran into problems with mclient seemingly not generating a proper exit value. If I run: $ mclient -lxq -p49980 -s"element { \"log\" } { pf:collection(\"cons02_log.xml\")//run }" -removed a lot of xml- </stdout> <fault!ERROR: XML Generation: tmp_3265 BAT does not have a 24 head. MAPI = monetdb@botswana.xiraf:49980 QUERY = element { "log" } { pf:collection("cons02_log.xml")//run } ERROR = !ERROR: !ERROR: XML Generation: NULL BAT has a 24 head, but tail is NULL. !ERROR: !ERROR: xquery_print_result_main: operation failed. $ echo $? 0 The above returns a lot of correct XML, then dumps an error to stderr, but returns error code 0. In contrast, the following works as expected: $ mclient -lxq -p49980 -s"eelement { \"log\" } { pf:collection(\"cons02_log.xml\")//run }" >/dev/null MAPI = monetdb@server:49980 QUERY = eelement { "log" } { pf:collection("cons02_log.xml")//run } ERROR = !parse error: syntax error, unexpected {, expecting $end on line 1, column 10 (next token is `{') !parse error: XQuery parsing failed !# halted in parser.tab.c (PFparse), line 5716 $ echo $? 1 Which is the expected result for a flawed query. Do you agree this is a problem that should be reported, or is there a better way of finding out whether there were problems running the query? Kind regards, Floris

2 1

[MonetDB-users] Building the nightly build on Centos 5
by Schwarz, Omri 01 Dec '08

01 Dec '08

Hi, all. I am trying to do a build on Centos 5 and am getting this bizarre issue which a web search shows has propped up with many other autoconf-based builds, but which does not have an easy resolution: /bin/sh ../../libtool --tag=CC --mode=link gcc -DLIBGDK -O2 -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -fu nroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize -D_REENTRANT -o libbat.la -rpath /root/MonetDB/l ib libbat_la-gdk_scanselect.lo libbat_la-gdk_scanselect_defs.lo libbat_la-gdk_batop.lo libbat_la-gdk_search.lo libbat_la -gdk_tm.lo libbat_la-gdk_align.lo libbat_la-gdk_bbp.lo libbat_la-gdk_heap.lo libbat_la-gdk_setop.lo libbat_la-gdk_utils.l o libbat_la-gdk_atoms.lo libbat_la-gdk_qsort.lo libbat_la-gdk_ssort.lo libbat_la-gdk_storage.lo libbat_la-gdk_bat.lo libb at_la-gdk_delta.lo libbat_la-gdk_relop.lo libbat_la-gdk_system.lo libbat_la-gdk_value.lo libbat_la-gdk_rangejoin.lo libba t_la-gdk_posix.lo libbat_la-gdk_logger.lo ../common/libmutils.la ../common/libstream.la -lz -lpthread -ldl gcc -shared .libs/libbat_la-gdk_scanselect.o .libs/libbat_la-gdk_scanselect_defs.o .libs/libbat_la-gdk_batop.o .libs/lib bat_la-gdk_search.o .libs/libbat_la-gdk_tm.o .libs/libbat_la-gdk_align.o .libs/libbat_la-gdk_bbp.o .libs/libbat_la-gdk_he ap.o .libs/libbat_la-gdk_setop.o .libs/libbat_la-gdk_utils.o .libs/libbat_la-gdk_atoms.o .libs/libbat_la-gdk_qsort.o .lib s/libbat_la-gdk_ssort.o .libs/libbat_la-gdk_storage.o .libs/libbat_la-gdk_bat.o .libs/libbat_la-gdk_delta.o .libs/libbat_ la-gdk_relop.o .libs/libbat_la-gdk_system.o .libs/libbat_la-gdk_value.o .libs/libbat_la-gdk_rangejoin.o .libs/libbat_la-g dk_posix.o .libs/libbat_la-gdk_logger.o -Wl,--rpath -Wl,/var/tmp/test/MonetDB/MonetDB/src/common/.libs -Wl,--rpath -Wl,/ root/MonetDB/lib -L/var/tmp/test/MonetDB/MonetDB/src/common/.libs ../common/.libs/libmutils.so ../common/.libs/libstream. so -lz -lpthread -ldl -Wl,-soname -Wl,libbat.so.0 -o .libs/libbat.so.0.0.0 .libs/libbat_la-gdk_scanselect_defs.o: In function `__strcspn_c1': gdk_scanselect_defs.c:(.text+0x0): multiple definition of `__strcspn_c1' .libs/libbat_la-gdk_scanselect.o:gdk_scanselect.c:(.text+0x0): first defined here .libs/libbat_la-gdk_scanselect_defs.o: In function `__strcspn_c2': gdk_scanselect_defs.c:(.text+0x34): multiple definition of `__strcspn_c2' .libs/libbat_la-gdk_scanselect.o:gdk_scanselect.c:(.text+0x34): first defined here .libs/libbat_la-gdk_scanselect_defs.o: In function `__strcspn_c3': gdk_scanselect_defs.c:(.text+0x78): multiple definition of `__strcspn_c3' .libs/libbat_la-gdk_scanselect.o:gdk_scanselect.c:(.text+0x78): first defined here .libs/libbat_la-gdk_scanselect_defs.o: In function `__strspn_c1': gdk_scanselect_defs.c:(.text+0xd4): multiple definition of `__strspn_c1' .libs/libbat_la-gdk_scanselect.o:gdk_scanselect.c:(.text+0xd4): first defined here .libs/libbat_la-gdk_scanselect_defs.o: In function `__strspn_c2': gdk_scanselect_defs.c:(.text+0xf0): multiple definition of `__strspn_c2' .libs/libbat_la-gdk_scanselect.o:gdk_scanselect.c:(.text+0xf0): first defined here .libs/libbat_la-gdk_scanselect_defs.o: In function `__strspn_c3': gdk_scanselect_defs.c:(.text+0x108): multiple definition of `__strspn_c3' .libs/libbat_la-gdk_scanselect.o:gdk_scanselect.c:(.text+0x108): first defined here .libs/libbat_la-gdk_scanselect_defs.o: In function `__strpbrk_c2': gdk_scanselect_defs.c:(.text+0x128): multiple definition of `__strpbrk_c2' .libs/libbat_la-gdk_scanselect.o:gdk_scanselect.c:(.text+0x128): first defined here .libs/libbat_la-gdk_scanselect_defs.o: In function `__strpbrk_c3': [... and so ad nauseam, containing redefinitions of amy low level LibC functions like toupper, tolower, fstat, et cetera. ] What do I do to dodge this? Thanks, all Denham Quantitative Management LP 200 Clarendon Street, 25th Floor Boston, MA 02216 T: 617-587-5812 M: 617-909-7786 omri.schwarz(a)denhamcapital.com NOTICE: This e-mail message is intended for the named recipient(s) above and may contain confidential information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. NO REPRESENTATION OR WARRANTY IS MADE TO ANY PERSON AS TO THE ACCURACY OR COMPLETENESS OF THE INFORMATION CONTAINED HEREIN. Denham Capital Management(sm) is a trademark of Denham Capital Management LP.

1 0

[MonetDB-users] Records disappear in prepared statement insterts via JDCB and ODBC if using autocommit or batch commit
by Jens Oehlschlägel 01 Dec '08

01 Dec '08

Dear monetdb community, I am new to monetdb and I am very impressed about its speed and nice features like its csv bulk load command. I have a question on prepared statements: I noticed that when using prepared statements via ODBC or JDBC strange things happened: when inserting 1000 rows, not only insert statements became very slow, also many inserts silently never reached MonetDB, i.e. a random number of records passes and suddenly - observed with ODBC debugging activated - execs are responded with errors. I tried via ODBC (writing from R's RODBC package) and via JDBC (writing from DBVizualizer). I found out that deactivating autocommit will help (verified for ODBC and JDBC), but the problem reappears - again randomly - if the client tool sends batch commits each x records (verified only in DBVizualizer / JDBC, now with explicit errors). Is that a known limitation or a bug or am I doing wrong? Further down you find information for replication. Thanks for any help Kind regards Dr. Jens Oehlschlägel Munich P.S. Details I run MonetDB under WindowsProfessionalXP with 3 GB RAM. I installed: MonetDB5-SQL-Installer-i386-20080624.msi MonetDB-ODBC-Installer-i386-20080812.msi monetdb-1.8-jdbc.jar Then - as recommended - I created CREATE USER "voc" WITH PASSWORD 'voc' NAME 'VOC Explorer' SCHEMA "sys"; CREATE SCHEMA "voc" AUTHORIZATION "voc"; ALTER USER "voc" SET SCHEMA "voc"; and added my test table CREATE TABLE databasetest ( "id" INTEGER , "ubyte1" SMALLINT , "ubyte2" SMALLINT , "ubyte3" SMALLINT , "ubyte4" SMALLINT , "ubyte5" SMALLINT , "ubyte6" SMALLINT , "ubyte7" SMALLINT , "ubyte8" SMALLINT , "ubyte9" SMALLINT , "ubyte10" SMALLINT , "ubyte11" SMALLINT , "ubyte12" SMALLINT , "ubyte13" SMALLINT , "ubyte14" SMALLINT , "ubyte15" SMALLINT , "smallint1" SMALLINT , "smallint2" SMALLINT , "smallint3" SMALLINT , "smallint4" SMALLINT , "smallint5" SMALLINT , "smallint6" SMALLINT , "smallint7" SMALLINT , "smallint8" SMALLINT , "smallint9" SMALLINT , "smallint10" SMALLINT , "smallint11" SMALLINT , "smallint12" SMALLINT , "smallint13" SMALLINT , "smallint14" SMALLINT , "smallint15" SMALLINT , "float1" DOUBLE , "float2" DOUBLE , "float3" DOUBLE , "float4" DOUBLE , "float5" DOUBLE , "float6" DOUBLE , "float7" DOUBLE , "float8" DOUBLE , "float9" DOUBLE , "float10" DOUBLE , "float11" DOUBLE , "float12" DOUBLE , "float13" DOUBLE , "float14" DOUBLE , "float15" DOUBLE , "float16" DOUBLE , "float17" DOUBLE , "float18" DOUBLE , "float19" DOUBLE , "float20" DOUBLE ) ; The test data contains positive and negative numbers, and the following R script (to be executed with R from www.r-project.org) allows to replicate the problem # R-script commands for replication of problem with prepared statement inserts in MonetDB # You find the installer for the R interpreter under http://cran.at.r-project.org (windows version 2.8.0) # (linux and sourcecode versions also available) # just install and start R # then install the RODBC package (version 1.2-4) install.packages("RODBC") # then paste the following lines # activate ODBC package library(RODBC) # only if we deactivate autocommit the prepared statement inserts work correctly (and much faster) # this variable switches autocommit of and sends standard commit at end of prepared statements. noAutoCommit <- TRUE channel <- odbcDriverConnect(connection = "DSN=MonetDB;UID=voc;PWD=voc;DATABASE=demo;host=localhost;port=50000;" , case="tolower" , believeNRows = TRUE , colQuote='"' , tabQuote = '"' , DBMSencoding = "" , rows_at_time = 1000 , bulk_add = "yes" ) if (noAutoCommit) odbcSetAutoCommit(channel, autoCommit=FALSE) # test connection #sqlTables(channel) #sqlColumns(channel, "databasetest") b <- 1L # number of batches n <- 10000L # batch size system.time({ for (i in 1:b){ cat("i=", i, "\n") x <- data.frame( id = ((i-1L)*n+1L):(i*n) # 4-byte integer record identifier , ubyte1 = sample(0:35, n, TRUE, prob=NULL) # signed byte columns (1 byte) , ubyte2 = sample(0:1, n, TRUE, prob=NULL) , ubyte3 = sample(0:3, n, TRUE, prob=NULL) , ubyte4 = sample(0:9, n, TRUE, prob=NULL) , ubyte5 = sample(0:24, n, TRUE, prob=NULL) , ubyte6 = sample(0:99, n, TRUE, prob=NULL) , ubyte7 = sample(0:127, n, TRUE, prob=NULL) , ubyte8 = sample(0:1, n, TRUE, prob=c(0.75, 0.25)) , ubyte9 = sample(0:1, n, TRUE, prob=c(0.9,0.1)) , ubyte10 = sample(0:1, n, TRUE, prob=c(0.96,0.04)) , ubyte11 = sample(0:1, n, TRUE, prob=c(0.99,0.01)) , ubyte12 = sample(0:1, n, TRUE, prob=c(0.996,0.004)) , ubyte13 = sample(0:1, n, TRUE, prob=c(0.999,0.001)) , ubyte14 = sample(0:1, n, TRUE, prob=c(0.9996,0.0004)) , ubyte15 = sample(0:1, n, TRUE, prob=c(0.9999,0.0001)) , smallint1 = sample(1:4000, n, TRUE, prob=NULL) # smallint columns (2 bytes) , smallint2 = sample(1:2, n, TRUE, prob=NULL) , smallint3 = sample(1:4, n, TRUE, prob=NULL) , smallint4 = sample(1:10, n, TRUE, prob=NULL) , smallint5 = sample(1:25, n, TRUE, prob=NULL) , smallint6 = sample(1:100, n, TRUE, prob=NULL) , smallint7 = sample(1:256, n, TRUE, prob=NULL) , smallint8 = sample(1:1000, n, TRUE, prob=NULL) , smallint9 = sample(1:32000, n, TRUE, prob=NULL) , smallint10 = sample(0:1, n, TRUE, prob=c(0.75, 0.25)) , smallint11 = sample(0:1, n, TRUE, prob=c(0.9,0.1)) , smallint12 = sample(0:1, n, TRUE, prob=c(0.96,0.04)) , smallint13 = sample(0:1, n, TRUE, prob=c(0.99,0.01)) , smallint14 = sample(0:1, n, TRUE, prob=c(0.996,0.004)) , smallint15 = sample(0:1, n, TRUE, prob=c(0.999,0.001)) , float1 = round(runif(n, 0, 100), 1) # float columns (4 bytes) , float2 = round(runif(n, 0, 100), 1) , float3 = round(runif(n, 0, 100), 1) , float4 = round(runif(n, 0, 100), 1) , float5 = round(runif(n, 0, 100), 1) , float6 = round(runif(n, 0, 100), 1) , float7 = round(runif(n, 0, 100), 1) , float8 = round(runif(n, 0, 100), 1) , float9 = round(runif(n, 0, 100), 1) , float10 = round(runif(n, 0, 100), 1) , float11 = round(runif(n, 0, 100), 1) , float12 = round(runif(n, 0, 100), 1) , float13 = round(runif(n, 0, 100), 1) , float14 = round(runif(n, 0, 100), 1) , float15 = round(runif(n, 0, 100), 1) , float16 = round(runif(n, 0, 100), 1) , float17 = round(runif(n, 0, 100), 1) , float18 = round(runif(n, 0, 100), 1) , float19 = round(runif(n, 0, 100), 1) , float20 = round(runif(n, 0, 100), 1) ) sqlSave(channel, x, tablename="databasetest", rownames=FALSE, append=TRUE, fast=TRUE) if (noAutoCommit) odbcEndTran(channel, commit=TRUE) print(sqlQuery(channel, 'SELECT count(*) as cc, min(id) as minid, max(id) as maxid from databasetest;')) } }) sqlQuery(channel, 'SELECT count(*) as cc, min(id) as minid, max(id) as maxid from databasetest;') close(channel)

1 0

[MonetDB-users] a couple of questions
by Loredana Afanasiev 20 Nov '08

20 Nov '08

(I might have send this first to the wrong email address. Here's a repetition.) Hi team, I have a couple of small questions and remarks: * mclient timer doesn't work when running mclient with -s option. [lafanasi@zookst4 stats]$ mclient -t -lx -s "count(doc('xmark01.xml'))" 1 [lafanasi@zookst4 stats]$ mclient -lx -t q1.xq 1 Timer 5.606 msec * does mclient option -I (capital i) work? For example, the following command doesn't execute in 1 min. [lafanasi@zookst4 stats]$ mclient -lx -I xmark01.xml -s "count(.)" * Recently I couldn't access my db created with the latest release after recompilation from HEAD. Do I need to back-up my db (by dumping the tables) when I recompile a new version from HEAD? A new release? * Mserver crushes on XMark of 11GB (-f 100). The query is: "find the maximum length of the root to leaf paths, i.e., the tree depth". My specs: Linux zookst4 2.6.24.3-50.fc8 #1 SMP Thu Mar 20 13:39:08 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux, Mem 19GB. Do you have any tips on how to make it run? Thanks for your help! l.

2 1

[MonetDB-users] MonetDB binary distribution question
by Hans van Rijswijk (DT) 14 Nov '08

14 Nov '08

Dear MonetDB users, Our install procedure for MonetDB currently consists of unpacking MonetDB-Aug2008-SuperBall.tar.bz2 and running the monetdb-install.sh script. This takes a long time to complete. We would like to get or create a binary distribution for a Linux system (Ubuntu 8.04 / Fedora). For this, we like to know the following: - Is the Monet binary dependent on the system where it is built? - Can we pack the generated binaries and install them on a different Linux (Ubuntu/Fedora) computer? - Can we even install this binary in a different directory? - What external dependencies are used? - Which paths are used and which paths settings are assumed in the binary? In other words: what is necessary for a copied distribution to work correcly on a different computer and/or a different directory as for which it was built. Thanks in advance for your explanatory answer. Regards, Hans van Rijswijk Netherlands Forensic Institute Tel: 070-8886638

3 2

[MonetDB-users] Table trace in file system
by Alfred Nordman 13 Nov '08

13 Nov '08

Hi there, Is there any way to export\import tables between machines by only coping files and\or folders Thanks, Alfred -- View this message in context: http://www.nabble.com/Table-trace-in-file-system-tp20478519p20478519.html Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] MonetDB install script problem.
by Hans van Rijswijk (DT) 13 Nov '08

13 Nov '08

Dear monetdb-users, When installing MonetDB (compile from MonetDB-Aug2008-SuperBall.tar.bz2) we encountered a problem. We had Java JDK installed, but no Internet connection. The monetdb-install.sh script stopped with an error message: fetching MonetDB-java failed! After some investigation we found what the problem might be: In line 209 and following lines the monetdb-install.sh script tests whether a java compiler and ant are present. If present the fetch() procedure tries to get the Java sources from the tarball. Since the Java code is not included in the tarball, fetch() tries to get the Java sources from the Internet, with wget. Since we have no Internet connection this action fails too, and makes it fatal. In other runs with only JRE installed the monetdb-install.sh script did not complain, and just skipped the Java code. Our questions: - Is the Java code deliberately omitted in the source tarball. - Can someone at the CWI fix it: either include the Java code or make the script less dependent on Internet connection. Regards, Hans van Rijswijk Netherlands Forensic Institute Tel: 070-8886638

2 1

[MonetDB-users] More timing information in MonetDB/XQuery
by pitro55 13 Nov '08

13 Nov '08

Hi, I am running some XQuery queries on MonetDB/XQuery (june release) and I cannot get all timing information like trans, fetch, shred, print time. All I can get is one time ofomration Timer, which I guess is overall information about how much time did the query take. I tried to run queries both in session and from shell: 1. xquery>\t xquery>\<test.xq 2. mclient -lx -t test.xq My OS is MAC OS 10.5 (Leopard). When I tried it on Windows, I will get all the timing information. Thank you for your time and help. Peter -- View this message in context: http://www.nabble.com/More-timing-information-in-MonetDB-XQuery-tp20475840p… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] JDBC Support
by nori 11 Nov '08

11 Nov '08

Hi, Is there a plan to support JDK(JRE)6 in JDBC driver? Regards. Nori.

2 2

[MonetDB-users] MonetDB server thread architecture
by xxiao 28 Oct '08

28 Oct '08

Hi, does anyone know whether there is any doc on how the server is implemented in Pthreads, such as how many threads are forked and what job each different thread is responsible for? Thanks a lot. -- View this message in context: http://www.nabble.com/MonetDB-server-thread-architecture-tp20134440p2013444… Sent from the monetdb-users mailing list archive at Nabble.com.

2 9

[MonetDB-users] How to print a BAT with MIL?
by Chaojing Yang 26 Oct '08

26 Oct '08

Dear all, I'm using MonetDB/XQuery. After i have added a few XML-files into MonetDB, i want to check out how their BATs looks like. /MonetDB>ls(); #---------------------------------------------------------------------------------------------------------------------------------# # name htype ttype count heat dirty status kind refcnt lrefcnt # # str str str lng int str str str int int # #---------------------------------------------------------------------------------------------------------------------------------# [ "1000000001_attr_own", "void", "oid", 5, 0, "clean", "disk", "pers", 0, 2 ] [ "1000000001_attr_prop", "void", "oid", 5, 0, "clean", "disk", "pers", 0, 2 ] [ "1000000001_attr_qn", "void", "oid", 5, 0, "clean", "disk", "pers", 0, 2 ] [ "1000000001_frag_root", "oid", "oid", 1, 0, "clean", "disk", "pers", 0, 1 ] [ "1000000001_map_pid", "void", "oid", 1, 0, "clean", "disk", "pers", 0, 2 ] [ "1000000001_nid_rid", "void", "oid", 25, 0, "clean", "disk", "pers", 0, 2 ] [ "1000000001_prop_com", "void", "str", 0, 0, "clean", "disk", "pers", 0, 2 ] [ "1000000001_prop_ins", "void", "str", 0, 0, "clean", "disk", "pers", 0, 2 ]/ *I get a list of BAT-data summary. But i cann't figure out how to use print functions from buildin module as listed:* / / 231 .COMMAND print(ANY value) = CMDprint_val; 232 "Print a MIL value between square brackets." 233 234 .COMMAND print(BAT[ANY::1,ANY], ...BAT[ANY::1,ANY]...) = CMDprint_table; 235 "BATs are printed with '#' for legend lines, and the BUNs on seperate 236 lines between brackets, containing each to comma separated values 237 (head and tail). 238 If multiple BATs are passed for printing, print() performs an implicit 239 natural join, producing a multiattribute table." 240 241 .COMMAND print(INT order, BAT[ANY::1,ANY], ...BAT[ANY::1,ANY]...) 242 = CMDprint_otable; 243 "The same as normal table print, but enforces to use the order of 244 BAT number [1..argc] to do the printing." 245 246 .COMMAND table(BAT[any::1,any], ...BAT[any::1,any]...) = print_table_default; 247 "Print an n-ary table. Like print(n-ary) but does not print oid column" 248 249 .COMMAND table(INT order, BAT[any::1,any], ...BAT[any::1,any]...) = print_table; 250 "Print an n-ary table. Use the ordering of param [1..argc]" 251 252 .COMMAND multitable(BAT[any,bat]) = CMDprint_multitable; 253 "Print an n-ary table contained within a BAT of BATs" 254 255 .COMMAND printf(str format, ...) = print_format; 256 "Print a formatted string on the standard client output." 257 258 .COMMAND sprintf(str format, ...) : str = print_str; 259 "Print a formatted string on the standard client output." 260 261 262 .END builtin; One single example may help me out of this trap. Best regards, Chaojing ------------------------------------------------------------------------------------------------------------------------------------------ Email: chaojing.yang(a)gmail.com Blog: http://goethe-ist-taoist.blogspot.com/ §1 Ich widerspreche der Nutzung oder Übermittlung meiner Daten für Werbezwecke oder sowie andere unbefugte Verwendungszwecke. (§ 28 Abs. 4 BDSG=Bundesdatenschutzgesetz). §2 Durch die Datenübertragung bzw. Kommunikation per E-Mail liegt ein Verstoß gegen das BDSG vor, da ihre Daten insoweit nicht ausreichend geschützt sind. Ich bitte Sie daher, mir schriftlich zu bestätigen, dass Sie mit dem Verstoß gegen das BDSG einverstanden sind und keine Schadensersatzanspräche bzw. Unterlassungsanspräche mir gegenüber geltend machen. §3 Der Inhalt dieser Nachricht ist vertraulich und nur für den oben angegebenen Empfänger bestimmt.

3 3

[MonetDB-users] Using MonetDB on Windows X64
by Daniel Murray 24 Oct '08

24 Oct '08

Hi all, I am trying to use MonetDB on a 32bit Windows XP SP2, but am having a lot of trouble given the size of my tables. Is there any experience in regards to using MOnetDB on a "virtual" server set up on Windows 2003 Server and configuring it with "X64" inlieu of a true "64bit". Thanks you in advance for your support. Daniel Murray G.

1 0

[MonetDB-users] Use cases for monetdb
by steve 24 Oct '08

24 Oct '08

What are the use cases for monetdb?

3 3

[MonetDB-users] MonetDB5 Server crashes and shuts-down
by Daniel Murray 22 Oct '08

22 Oct '08

Hi All, I am working with Windows XP SP2 (32-bit), with 2Gb RAM; am using Java 1.5. I downloaded MonetDB5-SQL-Installer-i386-20080624.msi; Squirell has been update to use monetdb-1.8-jdbc.jar. I am trying to upload data from MySQL to MonetDB5, using the MonetDB Bulk Loader that comes with Pentaho Kettle 3.1. I am using a MySQL table with a little over 9 millon rows & 7 columns (2 BIGINT, 2 INT and 3 FLOAT, consequently I understand no encoding issues are involved). After a number of failed transformation attempts to load my data to MonetDB, on all attempts the Monetdb Server is suddenly shutting down after some 20,000 records are processed. When trying to review the data -that I understand to be in MonetDB- using Squirell, the following server console screen out is shown (I had to modify the .config file to "gdk_debug=1") and as likewise, the MonetDB Server shuts down: ***console output start*** C:\MONETDB\CWI\MonetDB5>MSQLServer.bat # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see C:\MONETDB\CWI\MonetDB5\etc\monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.24.0 loaded >!01 ERROR: MT_mmap: MapViewOfFileEx(150c, 1, 0, 0, 196885248, 0) failed !01 OS: Espacio de almacenamiento insuficiente para procesar este comando. #01 #GDKmmap(196885248) fail => BBPtrim(enter) usage[mem=4583848,vm=1158283264] #01 #mallinfo.arena = 5927701 #01 #mallinfo.ordblks = 61996 #01 #mallinfo.smblks = 383 #01 #mallinfo.hblkhd = 0 #01 #mallinfo.hblks = 0 #01 #mallinfo.usmblks = 1768421 #01 #mallinfo.fsmblks = 345928 #01 #mallinfo.uordblks = 3811784 #01 #mallinfo.fordblks = 1568 #01 #BBPTRIM_ENTER: memsize=4583848,vmsize=1158283264 #01 #BBPTRIM: memtarget=0 vmtarget=1073741824 #01 #TRIMSCAN: mem=0 vm=1, start=1, limit=1 #01 #TRIMSCAN: 92596* 0=tmp_2143 (#20500000) #01 #TRIMSCAN: 92598* 1=tmp_2144 (#20510000) #01 #TRIMSCAN: 92599* 2=tmp_2145 (#20510000) #01 #TRIMSCAN: 92600* 3=tmp_2146 (#20510000) #01 #TRIMSCAN: 92601* 4=tmp_2147 (#20510000) #01 #TRIMSCAN: 92602* 5=tmp_2151 (#20500000) #01 #TRIMSCAN: end at 1 (size=1197) #01 #TRIMSELECT: dirty = 0 #01 #TRIMSELECT: candidate=tmp_2143 BAT*=454e700 #01 # (cnt=20500000, mode=4096, refs=0, wait=0, parent=0,0, lastused= 92598,92596,-2147391052) #01 #TRIMSELECT: delete tmp_2143 from trimlist (has been touched since last scan ) #01 #TRIMSELECT: candidate=tmp_2144 BAT*=454e7f8 #01 # (cnt=20510000, mode=4096, refs=0, wait=0, parent=0,0, lastused= 92599,92598,-2147391050) #01 #TRIMSELECT: delete tmp_2144 from trimlist (has been touched since last scan ) #01 #TRIMSELECT: candidate=tmp_2145 BAT*=454e8f0 #01 # (cnt=20510000, mode=4096, refs=0, wait=0, parent=0,0, lastused= 92600,92599,-2147391049) #01 #TRIMSELECT: delete tmp_2145 from trimlist (has been touched since last scan ) #01 #TRIMSELECT: candidate=tmp_2146 BAT*=454e9e8 #01 # (cnt=20510000, mode=4096, refs=0, wait=0, parent=0,0, lastused= 92601,92600,-2147391048) #01 #TRIMSELECT: delete tmp_2146 from trimlist (has been touched since last scan ) #01 #TRIMSELECT: candidate=tmp_2147 BAT*=454eae0 #01 # (cnt=20510000, mode=4096, refs=0, wait=0, parent=0,0, lastused= 92602,92601,-2147391047) #01 #TRIMSELECT: delete tmp_2147 from trimlist (has been touched since last scan ) #01 #TRIMSELECT: candidate=tmp_2151 BAT*=454ecd0 #01 # (cnt=20500000, mode=4096, refs=0, wait=0, parent=0,0, lastused= 92596,92602,-2147391046) #01 #TRIMSELECT: keep tmp_2151 [82035748,82035520] bytes [82035748,82035520] dir ty target(mem=0 vm=1073741824) #01 #TRIMSELECT: end #01 #TRIMSELECT: dirty = 1 #01 #TRIMSELECT: candidate=tmp_2151 BAT*=454ecd0 #01 # (cnt=20500000, mode=4096, refs=0, wait=0, parent=0,0, lastused= 92596,92602,-2147391046) #01 #TRIMSELECT: unload tmp_2151 [82035748,82035520] bytes [82035748,82035520] d irty #01 #TRIMSELECT: end #01 #BBPTRIM: lastused batid name #01 #BBPTRIM: -2147391046 1129 tmp_2151 #01 #BBPTRIM_EXIT: memsize=114688,vmsize=1076232192 #01 #GDKmmap(196885248) fail => BBPtrim(ready) usage[mem=4583792,vm=1076232192] #01 #mallinfo.arena = 5927717 #01 #mallinfo.ordblks = 61993 #01 #mallinfo.smblks = 384 #01 #mallinfo.hblkhd = 0 #01 #mallinfo.hblks = 0 #01 #mallinfo.usmblks = 1768421 #01 #mallinfo.fsmblks = 346232 #01 #mallinfo.uordblks = 3811728 #01 #mallinfo.fordblks = 1336 !01 ERROR: MT_mmap: MapViewOfFileEx(1510, 1, 0, 0, 196885248, 0) failed !01 OS: Espacio de almacenamiento insuficiente para procesar este comando. !01 ERROR: GDKload: cannot mmap(): name=21\2150, ext=tail !01 OS: Espacio de almacenamiento insuficiente para procesar este comando. !01 ERROR: GDKload failed: name=21\2150, ext=tail ***console output ends*** Furthermore, I have tried to find the folders holding \var\MonetDB5\dbfarm with no luck. Ie, they are not in the MonetDB folders that are installed when using the Windows Installer referenced above. I would very much appreciate any asisstance you can provide, as my interest is to actively use MonetDb in my DW / BI projects. Kind Regards, Daniel Murray

1 0

[MonetDB-users] (no subject)
by Richard Wesley 20 Oct '08

20 Oct '08

Hi All - I am trying to evaluate MonetDB on Windows by loading up some large data sets. I'm not having much luck and I'm hoping someone can help me out. The first set of problems revolve around the ODBC driver. It seems to not be able to report errors or even return the results of queries reliably. Most errors come back as a generic error message although we occasionally run into strange messages involving UTF-16 conversions when no string columns are involved (e.g. a count distinct of a numeric column). We are using the July 2008 version from the web site. Are these known issues and is there a more recent build we could try? This is not in production yet, we are simply trying to evaluate the system. I have managed to work around the ODBC problems very slowly and have got to a point where I can load small data sets. But when I then try to do a large insert using the COPY FROM syntax, my client got a "connection terminated" error. When I take the COPY FROM statement and paste it into the client, the MonetDB server crashes. The only log files I can find have a few (mostly unprintable) characters in them. Restarting the server and trying again produces the same problem. The insert query is COPY 6568253 RECORDS INTO "Airlines"."_2005_On_Time_Performance" FROM 'C:\\DOCUME~1\\hawkfish\\LOCALS~1\\Temp\\1\\7A.tmp\\table.tbl' USING DELIMITERS '\t', '\n', '\''; Is there some limit on the COPY INTO syntax? Is there some log file somewhere that could point me in the right direction? TIA, ________________________________________________________ Richard Wesley Senior Software Developer Tableau Software Visit: http://www.trytableau.com/now.html

4 13

[MonetDB-users] MonetDB with Pentaho and Kettle
by Tom Barber 17 Oct '08

17 Oct '08

Hi Guys, As of 3.1 Kettle now has a connector built in for Monet so I thought I'd give it another go after not getting too far earlier in the year. Anyway I have it up and running on a Quad Core Xeon box running Centos x86_64 and it seems pretty happy, but when I try to copy sizable amounts of data into it, kettle stops with an error: 2008/10/17 12:29:22 - Table output.0 - Prepared statement : INSERT INTO voc.d_budgets3 (entity_anl_code, trad_code, Cost, Sales, CostMTD, SalesMTD) VALUES ( ?, ?, ?, ?, ?, ?) 2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826 from 2008/09/30 11:32:36) : Because of an error, this step can't continue: 2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826 from 2008/09/30 11:32:36) : org.pentaho.di.core.exception.KettleException: 2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826 from 2008/09/30 11:32:36) : Error inserting row into table [d_budgets3] with values: [19], [A09], [0], [0], [0], [0] 2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826 from 2008/09/30 11:32:36) : 2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826 from 2008/09/30 11:32:36) : Error inserting/updating row 2008/10/17 12:29:27 - Table output.0 - ERROR (version 3.1.0, build 826 from 2008/09/30 11:32:36) : current transaction is aborted (please ROLLBACK) But to my untrained eye the data looks fine(coming from a mysql database) and I don't know where to start debugging this or what settings I could change. The monet table is 2 Strings, 2 Int, 2 Big Num and it always inputs a load of data before stopping. What can I look at to resolve the issues? otherwise, rocking database and keep up the good work. Thanks Tom CONFIDENTIALITY NOTICE This e-mail is confidential and may also be privileged. Please notify us immediately if you are not the intended recipient. You should not copy it, forward it or use it for any purpose or disclose the contents to any person. If you have received this e-mail in error, please notify us as soon as possible and destroy your copy. Unless otherwise expressly stated, this e-mail is not intended to constitute a business letter, order form or other offer or invitation to you, nor does this e-mail form the basis of any contract. Contracts may not be concluded by e-mail and any contract or agreement attached is subject to contract and shall not and is not intended to create a legally binding relationship. This e-mail is sent by or on behalf of Encon Limited or the relevant subsidiary undertaking of Encon Limited with which you are dealing. Encon Limited is registered in England and Wales with company number 3411533 registered office at The Wolseley Center, Harrison Way, Leamington Spa, CV31 3HH, United Kingdom. VAT No 362 0233 93. Encon Ireland is registered in Ireland with company number 262605 registered office at Wolseley Ireland Moydrum Road, Athlone, Co Westmeath. Save a Tree ! - Please think before you print.

3 3

[MonetDB-users] Commercial Support
by Rick Spickelmier 17 Oct '08

17 Oct '08

Hi! Are there companies that are providing commercial support for MonetDB? The home page for MonetDB seems to imply that. If so, can somebody send me a pointer and does anybody have any experience with it? Thanks! Rick Rick Spickelmier | CTO | Success Metrics, Inc. | w (415) 738-2078 | ricks(a)successmetricsinc.com <mailto:ricks@successmetricsinc.com> | www.successmetricsinc.com | www.birst.com

3 2

[MonetDB-users] CREATE INDEX syntax?
by Richard Wesley 14 Oct '08

14 Oct '08

Hi Sjored - I have a lot of questions, so I thought I start a few threads if that is all right. What is the CREATE INDEX syntax? According to the manual it is CREATE [UNIQUE] INDEX <index_name> ON <table_name> ( <column_name>, ...) ; But whey I use this syntax, I get strange errors: sql>CREATE INDEX "_tidx_usernames_2a" ON "Performance"."usernames" ("username"); !CREATE INDEX: no such table 'usernames' sql>select count(*) from "Performance"."usernames"; +--------+ | count_ | +========+ | 5 | +--------+ sql> ________________________________________________________ Richard Wesley Senior Software Developer Tableau Software Visit: http://www.trytableau.com/now.html

1 0

[MonetDB-users] MonetDB on Windows
by bryan rasmussen 07 Oct '08

07 Oct '08

Hi, I haven't looked at monetdb for a while, but now for a new project I have I think it would be a really good solution. I downloaded the current windows installers yesterday (I want to develop this project on Windows for various reasons, specifically related to demos of another component part of the project I need to get up and running quickly that will need to run on Windows) anyway the installers did not install. I don't necessarily want to compile the source etc. since I didn't want to spend a lot of time on getting the database to work in the demo phase, so the question is: what is the last working Windows MSI version so I can download that version and worry about building a new one later? The main problem in the installed servers are a hard coded path to a config file, according to the following error message I get: Could not open file c:\Documents and Settings\sjoerd\My Documents\src\stable\vs32\NT32\etc\monetdb5.conf I guess I could create that path for the purposes of testing but I would rather get a working version. Thanks, Bryan Rasmussen

3 6

[MonetDB-users] Reusing index on another computer
by jz＠uva 07 Oct '08

07 Oct '08

Hi all, I have built an index on a server. I would like to reuse that index on my desktop for testing purposes. However, when I copy the demo directory (consisting of the index), and I restart MServer Mserver --dbinit='module(pathfinder);' --set xquery_backend=milprint_summer then I discover this error: !ERROR: database created with incompatible Mserver So my question is: can I, and if yes, how do I reuse/transfer an index from one computer to another one? Thanks, junte

6 13

[MonetDB-users] allocate timing and deallocate timing of memory
by gashi gashi 07 Oct '08

07 Oct '08

Hi, All I'm working with MonetDB Server v5.6.0, based on kernel 1.24.0 over RedHat Linux Enterprise 5.2. Would you tell me timing which in the memory is allocated and timing in which the memory is deallocated, or is there an instruction that deallocate the memory? Regards, gashi

2 1

[MonetDB-users] merovingian locking up - port issue?
by Ross Bates 07 Oct '08

07 Oct '08

I'm having an issue with merovingian locking up. This is the typical scenario. - Start mero and my db with ./merovingian sobi - Everything works great for anywhere between 50 & 100 queries, then mero stops responding (I'm using python, jdbc & php) - I can still connect to the db from the command line using ./mclient -d sobi -lsql -p 50001 - both merovingian and mserver5 processes continue to run, but mero will end up dying within 1-2 minutes by itself leaving the mserver5 process running - even when mero dies, it appears that all the ports are still in use. This is the result of netstat -a AFTER mero is dead: tcp 0 0 *:50000 *:* LISTEN tcp 0 0 *:50001 *:* LISTEN tcp 0 0 mayfair.local:50000 mayfair.local:48973 ESTABLISHED tcp 0 0 mayfair.local:48973 mayfair.local:50000 ESTABLISHED udp 0 0 *:50000 *:* - when I try to restart mero to reattach it to the database it fails with this error: ./merovingian: binding to stream socket port 50000 failed: Address already in use - stopping the db doesn't work becase mero isn't running. ./monetdb stop sobi warning: MonetDB Database Server is not running stop: cannot perform: MonetDB Database Server (merovingian) is not running - the only thing left to do is kill the mserver5 process and restart both mero and the db. Unfortunately the merovingian.log file doesn't tell me anything. Any other tips for helping troubleshoot this issue? The version is 5.7.0 and was built from the Aug 23rd nightly. Many Thanks, Ross

2 8

[MonetDB-users] Can I copy a local txt file into a remote MonetDB table
by Li Xiaohua 07 Oct '08

07 Oct '08

Hi: I want to copy a txt file into a remote MonetDB table. When I use the copy into command. what should I use after the "into"? using servername.database.schema.tablename? does it work?

1 0

[MonetDB-users] running the monetdb MSI installers on Windows
by bryan rasmussen 06 Oct '08

06 Oct '08

Hi, Is there anyone that has managed to run any particular Monet MSI installer with a resulting successful install of MonetDB (successful implying the database server will start afterwards)? If yes, which version did you use? The problems I have run into so far with the current stable release: Can not find DLLs when starting. Dlls do not seem to have proper entry points (when I try to run them) the server is expecting to find a config file under documents and Settings\Sjoerd\..... I tried uninstalling and installing one release earlier for the sql database, got the first problem again, didn't check if it had all the other problems. Best Regards, Bryan Rasmussen

1 0

Re: [MonetDB-users] best practices with connection pool
by gashi gashi 01 Oct '08

01 Oct '08

Hi,All I found this subject in the archives, and I am having the same problem. ---------------------------------------------------------------------- >> What is currently the best practice of connecting to MonetDB5/SQL? Is >> there much overhead in the connection phase (thus: cache the connection) >> or can a developer just reconnect each time the database connection is >> required without much overhead? >> >> The target platform is extremely demanding in requests and memory, so I >> would like to design it good from the start. >Then go for connection pooling. Logging in requires a handshake, which >is expensive on large scale. Beware that using >1 connection at the >same time to an SQL server is a challenge that is only minimally tested. >My practical experiences with that boils down to signal 11. ---------------------------------------------------------------------- Would you let me know more detail? Your meaning of "Beware that using >1 connection at the same time..." is which case? Case 1. : 2 or more process try to connect at the same. Case 2. : 1 process is connecting, and other process try to connect. I appreciate your kindly support. gashi

2 3

[MonetDB-users] billions rows ?
by eric Gtep 28 Sep '08

28 Sep '08

Hello, I'm testing for store large collections of genotypes on Monetdb. In few words, a genotype is a little piece of information ( about 3 or 4 char ) related to an individual and a dna marker. So a genotypes looks like contents of cell of sheet. Sometime we need to access them by individuals (cross marker), sometime by dna marker (cross individual). Today genotyping technologies provide to get 600, 000,0000 genotypes by run. Is MonetDB able to manage efficiently tables with several billions of rows ? have you any example of application with lot ( > 1 billion) of rows in only one table ? I' ve compiled and installed monetDB/SQL on a Dell PE2950 with 2 quadcores intel xeon 2.66 Ghz and 4 GB RAM with success I 've created a very basic table to store genotype : Create table genotypes ( ind char(10), mark char(10), alleles(char3) ) after I've populated this table with the "copy into table" statement About 370 millions rows have been loaded after 7 minutes. I haven't defined any index. >From mclient I sent the query below : select * from genotypes where alleles ="A A"; Immediatly the server became frozen and after about ten minutes a w unix command showed : load average 16 !!!! I stopped the query Could you explain to me what has appended ? Is this behaviour normal ? Is it possible to restrict the cpu ressources allowed to monetDB ? Thank you in advance for your advices and your help Eric

4 3

[MonetDB-users] How to declare a bug ?
by Pierre BOIZOT 27 Sep '08

27 Sep '08

Hi All, Somebody can explain me how i can submit a bug ? Regards. Pierre -- Pierre Boizot Chemin des Ecureuils, 8 CH-1009 PULLY Mobile : +41 795713660

2 1

[MonetDB-users] Perl DBD
by Pierre BOIZOT 26 Sep '08

26 Sep '08

Hi all, I install on a ubuntu monetdb , i began to test sql , insert , update and select . very nice performance. But when i try to use Perl DBD to access at the database . nothing work :( the CPAN is not update. the perl DBD in the source have no test no example :( what programming interface work with monetdb ? perl ? perhaps i jump something. python ? Where can i find small examples? Thank you for your help Regards. Pierre - Pierre Boizot Rue des philosophes , 13 1400 Yverdon les bains Mobile : +41 795713660

3 2

[MonetDB-users] Installation Problems
by Scott Stephens 25 Sep '08

25 Sep '08

I've been attempting to install MonetDB by compiling the Aug. 2008 superball. My system is 64-bit linux, specifically the Ubuntu Intrepid Ibex alpha . It appears that the installation is failing while compiling the JDBC driver, with the error message: BUILD FAILED java.lang.UnsupportedClassVersionError: Bad version number in .class file I'm using the Sun Java 1.5.0 JRE and JDK. You can look at my full installation log here: http://docs.google.com/Doc?id=dhqbmd8x_6fqdnn7c3 Can somebody help me out? I'm hoping I've just made an easily corrected newbie mistake, but I'm out of things to try. Thanks, Scott

3 8

[MonetDB-users] basic math error?
by Kirk Abbott 24 Sep '08

24 Sep '08

Hello All, sql>select 585.0 / 635.0; +----------------------+ | sql_div_single_value | +======================+ | 0 | +----------------------+ and sql>select cast(585.0 / 635.0 as numeric(10,4)); +----------------------+ | sql_div_single_value | +======================+ | 0.0000 | +----------------------+ Is not what I was expecting. Ideas? Kirk.

4 5

[MonetDB-users] Bug....
by Pierre BOIZOT 23 Sep '08

23 Sep '08

Hi all, a test with the gold data .... no errors on the load if i stop and restart the database errors is allways here. sql>select age,gender, count(*), avg(price) from car group by age, gender; +-----+-------+-------------+-----------------------+ | age |gender |count_gender |avg_price | +=====+=======+=============+=======================+ | 19 |f | 110025 | -1449.6788093615087 | | 41 |m | 97200 | -6411.6489300411522 | ........ 52 |f | 95940 | -6467.6865332499483 | +-----+-------+-------------+-----------------------+ Timer 2694.008 msec 92 rows sql>select count(*) from car where price = 0; +--------+ | count_ | +========+ | 0 | +--------+ Timer 2502.145 msec 1 rows sql>select count(*) from car where price < 0; +--------+ | count_ | +========+ | 0 | +--------+ Timer 148.724 msec 1 rows see the trace file . Regards Pierre -- Pierre Boizot Rue des philosophes , 13 1400 Yverdon les bains Mobile : +41 795713660

1 0

[MonetDB-users] Several newbie questions: Performance and plans
by Mark V 23 Sep '08

23 Sep '08

Hi, I am more of an end user, new to column store DB's in general and MonetDB in particular. I'm thinking of using MonetDB in a context where CRUD would be done using SQL statements (as much as possible). I have some questions that I'd appreciate some feedback on: It seems that in column stores single insert/update/delete are much slower than reads. In LucidDB this can be in the order of seconds. Q1) In MonetDB are single insert/update/delete in the order of seconds? Comparable to LucidDB? Q2) If so, when might this change/improve and by how much? On comparative performance. I've seen the Goggle tech talk (2008/01) on MonetDB/X100 indicating some incredible performance: Q3) When might those improvements be incorporated into the stable/released MonetDB? Q4) How does MonetDB compare to Kdb and Vertica? Finally, I'm toying with writing a MonetSQL adapter for Ruby's Sequel ORM, hence the reliance on SQL statements. I have seen the MonetDB ActiveRecord library, which uses SWIG to make the Ruby MonetDB-mapi library. Q5) Will MonetDB be implementing something like MySQL's Information_Schema? Q6) What is the relative performance of the JDBC and SWIG-MAPI interfaces? Thanks Mark

2 1

[MonetDB-users] Ubuntu packages and launchpad PPA for MonetDB
by Gijs Molenaar 12 Sep '08

12 Sep '08

Hello everyone, I'm working on precompiled Ubuntu packages for MonetDB, which can be found here: https://launchpad.net/~monetdb/+archive These packages are meant for Ubuntu users who don't want to compile monetdb on every Ubuntu system where they want to use this software. You can install the packages and automatically update to new released packages by adding the following to /etc/apt/sources.list: --- 8< cut here --- deb http://ppa.launchpad.net/monetdb/ubuntu hardy main deb-src http://ppa.launchpad.net/monetdb/ubuntu hardy main ------------------- These packages are quite 'fresh' and not fully tested and completed, but the basics should work fine. If you want to test them out or/and you have some comments, feel free to contact me. Note that these packages are not signed due to a limitation in launchpad. -- Gijs Molenaar http://gijs.pythonic.nl

3 5

Re: [MonetDB-users] I'm looking for a fast way to write data to the DB from a scripting language.
by Michalis Polakis 07 Sep '08

07 Sep '08

Good morning Jay, you can use the Ruby MAPI Wrapper => MAPI calls through Ruby. It's elegant and simple and was used to implement the Ruby on Rails adapter for MonetDB. Plus, from what I see in the SWIG input file, the insert and copy_from functions should be implemented in the Ruby MAPI Wrapper. If you want to go the Ruby way, you may find the files in the MonetDB clients package or at http://rubyforge.org/projects/monetdb-ror/ as part of the Ruby on Rails MonetDB adapter. Regards, Michalis ----------------------------------------------------------------------------------------------- Hi, I have 50 million rows and 15 columns that I'd like to put into one table. My first attempt to transfer them was through PHP using the monetdb_query method. This is causing a lot of disk thrashing and my throughput is about 100 rows/sec. I get an "undefined function" error for both monetdb_insert and monetdb_copy_from. I would like to find a fast method, but from inside a common scripting language. Thanks, Jay

3 3

[MonetDB-users] I'm looking for a fast way to write data to the DB from a scripting language.
by JJ Jakosky 07 Sep '08

07 Sep '08

Hi, I have 50 million rows and 15 columns that I'd like to put into one table. My first attempt to transfer them was through PHP using the monetdb_query method. This is causing a lot of disk thrashing and my throughput is about 100 rows/sec. I get an "undefined function" error for both monetdb_insert and monetdb_copy_from. I would like to find a fast method, but from inside a common scripting language. Thanks, Jay

1 0

[MonetDB-users] Dual instances of MonetDB for 1 dbfarm - is it possible?
by McKennirey.Matthew 04 Sep '08

04 Sep '08

3 4

[MonetDB-users] Monetdb - User defined functions
by Kirk Abbott 04 Sep '08

04 Sep '08

Hello, We are trying to move some data over to Monetdb and are finding that we are missing some of our favorite formatting functions (to_date, to_char etc.). Does Monetdb have a user defined functions extension framework? If so, we would try to mimic these functions there. Thanks, Kirk.

3 8

Re: [MonetDB-users] ERROR 404 /~monet/tars/latest/stable/MonetDB.tar.gz.md5sum
by McKennirey.Matthew 04 Sep '08

04 Sep '08

3 2

[MonetDB-users] Incorrect SQL update result
by Christophe Galerne 03 Sep '08

03 Sep '08

Hi, I am running: # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'clg' # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.24.0 loaded I am copying some sample SQL which illustrates what I believe is a bug: ################################################################################ CREATE TABLE SOURCE ( TOTO VARCHAR(5), TITI VARCHAR(5), VALUE DOUBLE ); INSERT INTO SOURCE VALUES('1', '1', 5.0) , ('1', '2', 4.0), ('2', '1', 5.0), ('2', '2', 5.0), ('2', '3', 5.0); INSERT INTO SOURCE VALUES('1', '1', 5.0) , ('1', '2', 4.0), ('2', '1', 5.0), ('2', '2', 5.0), ('2', '3', 5.0); CREATE TABLE TARGET ( TOTO VARCHAR(5), TITI VARCHAR(5), VALUE DOUBLE ); INSERT INTO TARGET VALUES('1', '1', 0) , ('1', '2', 0), ('2', '1', 0), ('2', '2', 0), ('2', '3', 0); UPDATE TARGET SET VALUE = ( SELECT SUM(VALUE) FROM SOURCE WHERE TOTO=SOURCE.TOTO and TITI=SOURCE.TITI); CREATE TABLE TARGETOS ( TATA VARCHAR(5), TUTU VARCHAR(5), VALUE DOUBLE ); INSERT INTO TARGETOS VALUES('1', '1', 0) , ('1', '2', 0), ('2', '1', 0), ('2', '2', 0), ('2', '3', 0); UPDATE TARGETOS SET VALUE = ( SELECT SUM(VALUE) FROM SOURCE WHERE SOURCE.TOTO=TATA and SOURCE.TITI=TUTU); ################################################################################ The expected results is for the tables TARGET and TARGETOS to contain the same result since they only differ by the name of their columns. It seems that monetdb gets confused by the fact that table SOURCE and table TARGET have the column names. Thanks, Christophe

2 2

[MonetDB-users] SyntaxException in "monetdb create demo" statement
by rmaadil 03 Sep '08

03 Sep '08

I have installed MnetDB by downloading the file "MonetDB-ODBC-Installer-i386-20080812.msi". Then I opened MonetDB SQL Server. The last message that I got on the command prompt was "MonetDB/SQL module v2.24.0 loaded". Then I tried the statement "monetdb create demo", but I got the following error SyntaxException:parseError:monetdb create demo SyntaxException:parseError ^';' expected Can anybody tell me that where I was going wrong. -- View this message in context: http://www.nabble.com/SyntaxException-in-%22monetdb-create-demo%22-statemen… Sent from the monetdb-users mailing list archive at Nabble.com.

2 5

[MonetDB-users] ERROR 404 /~monet/tars/latest/stable/MonetDB.tar.gz.md5sum
by McKennirey.Matthew 03 Sep '08

03 Sep '08

2 1

Re: [MonetDB-users] [ADT] bug report?
by Stefan Manegold 02 Sep '08

02 Sep '08

On Mon, Sep 01, 2008 at 11:22:10PM +0200, Ying Zhang wrote: > Hi, > > I have just updated my monet source from souceforge and did a from > scratch compilation on my leopard. > > Fabian's fix gets rid of the error "implicit declaration of..." (thanks!) > However, the other error "ISO C90 forbids.." is still there. With the > following patch, I was able to compile the module MonetDB (a complete > rebuild of monet modules is still ongoing). > > I simply moved the definition of len to the begin of the function: > > $ cvs diff src/gdk/gdk_system.mx > Index: src/gdk/gdk_system.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_system.mx,v > retrieving revision 1.115 > diff -r1.115 gdk_system.mx > 570a571,574 > > #if defined(__FreeBSD__) || defined(__NetBSD__) || > defined(__OpenBSD__) || defined(__MACH__) > > size_t len = sizeof(int); > > #endif > > > 578d581 > < size_t len = sizeof(int); Thanks. I just checked in (my version of ;-)) your patch. Stefan > Jennie > > > On Sep 01, 2008, at 22:35 , Hendrike Peetz wrote: > >> nope. still the same problem. I checked out from the svn right after I >> got your mail. >> >> On Sep 1, 2008, at 10:13 PM, Fabian Groffen (Project Account) wrote: >> >>> I tried to fix the issue. Please report if it works. >>> >>> On 01-09-2008 22:01:01 +0200, Fabian Groffen (Project Account) wrote: >>>> On 01-09-2008 21:57:13 +0200, Fabian Groffen wrote: >>>>>>> cc1: warnings being treated as errors >>>>>>> ../../../MonetDB/src/gdk/gdk_system.mx: In function >>>>>>> 'MT_check_nr_cores': >>>>>>> ../../../MonetDB/src/gdk/gdk_system.mx:575: warning: ISO C90 >>>>>>> forbids mixed declarations and code >>>>>>> ../../../MonetDB/src/gdk/gdk_system.mx:576: error: implicit >>>>>>> declaration of function 'sysctlbyname' >>>>> >>>>> No. The MonetDB sources aren't tested on Leopard on a daily >>>>> basis, and >>>>> this change/code in particular isn't at all. I tried it on >>>>> Tiger, but >>>>> didn't care to check on Leopard. >>>> >>>> Actually, the actual code was never tested, as it's just missing an >>>> include ;) >> > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[MonetDB-users] PF: (new) compilation problem on Mac OS 10.5
by Ying Zhang 02 Sep '08

02 Sep '08

Hello, On Mac OS 10.5, source code just checked out from sourceforge. rebuild (debootstrap, boostrap, configure, make, make install) monet and its modules ends with some errors in pathfinder: Putting files in AC_CONFIG_AUX_DIR, `conf'. /opt/local/share/aclocal/audiofile.m4:12: warning: underquoted definition of AM_PATH_AUDIOFILE /opt/local/share/aclocal/audiofile.m4:12: run info '(automake)Extending aclocal' /opt/local/share/aclocal/audiofile.m4:12: or see http://sources.redhat.com/automake/automake.html#Extending-aclocal configure.in:85: warning: macro `AM_MONETDB_JAVA' not found in library patching file aclocal.m4 Hunk #1 succeeded at 428 (offset -5958 lines). configure.in:183: installing `conf/compile' configure.in:37: installing `conf/install-sh' configure.in:37: installing `conf/missing' configure.in:85: error: possibly undefined macro: AM_MONETDB_JAVA If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. This problem does not occur on my cwi desktop. Does anyone have an idea? Thanks! Jennie

2 3

Re: [MonetDB-users] [ADT] bug report?
by Stefan Manegold 01 Sep '08

01 Sep '08

On Mon, Sep 01, 2008 at 10:08:09PM +0200, Hendrike Peetz wrote: > Ok, I assume I should have set compiler options to --disable-strict. well, for us, it should also work with --enable-strict (default in CVS version as that is meant for developers --- and as a reminder to us to produce clean code ... ;-)) --- but for "users", --disable-strict (default in tarballs) is indeed just fine. > But now I can still not check, because it says: > > $ make check > make check-recursive > Making check in src > make check-recursive > Making check in common > make check-am > make[5]: Nothing to be done for `check-am'. > Making check in gdk > make check-am > make[5]: Nothing to be done for `check-am'. > Making check in testing > make check-am > rm -f Mapprove.py > ln -s Mtest.py Mapprove.py > make[4]: Nothing to be done for `check-am'. > Making check in conf > make check-am > make[3]: Nothing to be done for `check-am'. for which part did you call `make check`? for "MonetDB" (Common) there are indeed not tests; neither for (MonetDB/)"java"; only for clients, MonetDB4, MonetDB5, sql, geom, pathfinder, template there are tests and `make check` should work --- be aware though, that some tests are known to fail on some platforms ... > Sorry for bothering you, but we were two people (who do know the basics > of working with unix) trying to get this running today and couldn't make > it work. No problem --- in fact, `make check` is not "mendatory" for getting it to work --- just `make && make install` (or use monetdb-install.sh) and then try to run `Mserver` (MonetDB4) or `mserver5` (MonetDB5) as a very basic "sanitycheck". Stefan > Hendrike > > > Begin forwarded message: > >> From: Hendrike Peetz <hendrike(a)peetz-intelligence.com> >> Date: September 1, 2008 9:27:37 PM GMT+02:00 >> To: Monet(a)cwi.nl >> Subject: [ADT] bug report? >> >> Dear people in charge, >> >> I have been spending a lot of time today trying to install Monet on >> Leopard 10.5.4, 64 bit, core 2 duo. >> >> Before I did anything with the cvs, I tried to work with the Super >> tarball version. Compiling was not a problem but the tests were not >> installed and I was not too sure wether everything is working. I thus >> wanted to install it properly: >> >> I checked out the latest version (friday I assume) from the cvs. >> bootstrap and configure worked fine, but I had problems with the >> compiling. >> >> I tried gcc4.1 (apple) and gcc4.2 (apple) (Yes, I recompiled my c- >> compiler!). Both of them returned the attached error. >> I am not sure wether this is my mistake or some weird code, but as I >> was able to compile the tarball version I assume its something in the >> code. >> >> Best regards, >> >> Hendrike >> >> >> >> >> >> > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [MonetDB-users] [ADT] bug report?
by Stefan Manegold 01 Sep '08

01 Sep '08

Dear Hendrike, thank you very much for your detailed report. I suppose you sucessfully compiled the latest released "Stable" "Aug2008" version of the Super tarball, right? Then, indeed the compilation problems seem to be triggered by the (our) code in the latest "cutting-edge" "Current" development version from the CVS heads. Although we do quite some testing (cf. http://monetdb.cwi.nl/Development/TestWeb/) we do not (yet?) have a "Leopard" machine in our testing pool (we actually also lost access to the "Tiger" machine we used to have...). We will look into the problem ASAP and try to fix it. Could you please also file your problem as bug report in the MonetDB bug tracker at SF: http://sourceforge.net/tracker/?atid=482468&group_id=56967&func=browse ? For the time being you might want to try the latest "Stable" version from the CVS branches as listed at http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Version4.24/ind… . What puzzles me, though, is your initial point that no tests were included in the tests were not included in the Super tarball. They should actaully be in there. I'll check again ... Stefan On Mon, Sep 01, 2008 at 09:27:37PM +0200, Hendrike Peetz wrote: > Dear people in charge, > > I have been spending a lot of time today trying to install Monet on > Leopard 10.5.4, 64 bit, core 2 duo. > > Before I did anything with the cvs, I tried to work with the Super > tarball version. Compiling was not a problem but the tests were not > installed and I was not too sure wether everything is working. I thus > wanted to install it properly: > > I checked out the latest version (friday I assume) from the cvs. > bootstrap and configure worked fine, but I had problems with the > compiling. > > I tried gcc4.1 (apple) and gcc4.2 (apple) (Yes, I recompiled my c- > compiler!). Both of them returned the attached error. > I am not sure wether this is my mistake or some weird code, but as I was > able to compile the tarball version I assume its something in the code. > > Best regards, > > Hendrike > > > $ make > make all-recursive > Making all in src > make all-recursive > Making all in common > make all-am > make[5]: Nothing to be done for `all-am'. > Making all in gdk > make all-am > /bin/sh ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -I../../../MonetDB/src/gdk -I../../../MonetDB/src/gdk -I../common -I../../../MonetDB/src/gdk/../common -DLIBGDK -Wall -Wextra -std=c99 -g -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -Wno-uninitialized -D_REENTRANT -c -o libbat_la-gdk_system.lo `test -f 'gdk_system.c' || echo '../../../MonetDB/src/gdk/'`gdk_system.c > gcc -DHAVE_CONFIG_H -I. -I../.. -I../../../MonetDB/src/gdk -I../../../MonetDB/src/gdk -I../common -I../../../MonetDB/src/gdk/../common -DLIBGDK -Wall -Wextra -std=c99 -g -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -Wno-uninitialized -D_REENTRANT -c gdk_system.c -fno-common -DPIC -o .libs/libbat_la-gdk_system.o > cc1: warnings being treated as errors > ../../../MonetDB/src/gdk/gdk_system.mx: In function 'MT_check_nr_cores': > ../../../MonetDB/src/gdk/gdk_system.mx:575: warning: ISO C90 forbids mixed declarations and code > ../../../MonetDB/src/gdk/gdk_system.mx:576: error: implicit declaration of function 'sysctlbyname' > make[5]: *** [libbat_la-gdk_system.lo] Error 1 > make[4]: *** [all] Error 2 > make[3]: *** [all-recursive] Error 1 > make[2]: *** [all] Error 2 > make[1]: *** [all-recursive] Error 1 > make: *** [all] Error 2 > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

4 4

[MonetDB-users] batcalc.ifThenElse:requires bats of identical size
by Rick Spickelmier 28 Aug '08

28 Aug '08

Hi! I am running into this error: batcalc.ifThenElse:requires bats of identical size My server (running on Windows XP 64): # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-win32/64bit with 32bit OIDs dynamically linked The following recreates the problem: CREATE TABLE test1 (col1 INTEGER); INSERT INTO test1 VALUES (null); INSERT INTO test1 VALUES (null); SELECT CASE WHEN col1=1 THEN 'ONE' END AS "pc1" FROM test1 GROUP BY "pc1"; Any ideas? Obviously the above isn't too interesting, but it a simplified test case from a more complex query on a much larger dataset. Seems to be related to GROUP BY on a CASE... Thanks! Rick +----------------------------------------------------------------------- ------+ | mal | +======================================================================= ======+ | function user.s0_3():void; | | _1:bat[:oid,:int]{rows=1:lng} := sql.bind("voc","test2","col1",0); | | _6:bat[:oid,:int]{rows=1:lng} := sql.bind("voc","test2","col1",1); | | _8{rows=2:lng} := algebra.kunion(_1,_6); | | _1:bat[:oid,:int]{rows=1:lng} := nil; | | _6:bat[:oid,:int]{rows=1:lng} := nil; | | _9:bat[:oid,:int]{rows=1:lng} := sql.bind("voc","test2","col1",2); | | _11{rows=2:lng} := algebra.kdifference(_8,_9); | | _8{rows=2:lng} := nil; | | _12{rows=3:lng} := algebra.kunion(_11,_9); | | _11{rows=2:lng} := nil; | | _9:bat[:oid,:int]{rows=1:lng} := nil; | | _13:bat[:oid,:oid]{rows=1:lng} := sql.bind_dbat("voc","test2",1); | | _14{rows=1:lng} := bat.reverse(_13); | | _13:bat[:oid,:oid]{rows=1:lng} := nil; | | _15{rows=3:lng} := algebra.kdifference(_12,_14); | | _14{rows=1:lng} := nil; | | _17{rows=3:lng,tlb>=0@0:oid,tub<1@0:oid} := algebra.markT(_15,0@0); | | _15{rows=3:lng} := nil; | | _18{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := bat.reverse(_17); | | _17{rows=3:lng,tlb>=0@0:oid,tub<1@0:oid} := nil; | | _19{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := algebra.join(_18,_12); | | _12{rows=3:lng} := nil; | | _20:bat[:oid,:bit]{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := | : batcalc.==(_19,1); | | _23{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := algebra.project(_18,nil:str); | | _24:bat[:oid,:str]{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := | : batcalc.ifthenelse(_20,"ONE",_23); | | _20:bat[:oid,:bit]{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _23{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | (ext36,grp34):= group.new(_24); | | _24:bat[:oid,:str]{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _27 := bat.mirror(ext36); | | ext36 := nil; | | _28 := algebra.join(_27,_19); | | _27 := nil; | | _19{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _29:bat[:oid,:bit] := batcalc.==(_28,1); | | _28 := nil; | | _30{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := algebra.project(_18,nil:str); | | _18{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _31:bat[:oid,:str] := batcalc.ifthenelse(_29,"ONE",_30); | | _29:bat[:oid,:bit] := nil; | | _30{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _32 := sql.resultSet(1,1,_31); | | sql.rsColumn(_32,"voc.","pc1","char",0,0,_31); | | _31:bat[:oid,:str] := nil; | | _37 := io.stdout(); | | sql.exportResult(_37,_32,""); | | end s0_3; | +----------------------------------------------------------------------- ------+ Rick Spickelmier | CTO | Success Metrics, Inc. | w (415) 738-2078 | ricks(a)successmetricsinc.com

3 3

[MonetDB-users] upgrading ...
by ewilde 24 Aug '08

24 Aug '08

hi, i have updated my monet installtion from "june 2008" to "current" on Aug 19, using YAM on fedora 9. i tried to run monet-server: mserver5 --dbinit="include sql;" --set gdk_vm_minsize=1000000000000 and i have got: # MonetDB server v5.7.0, based on kernel v1.25.0 # Serving database 'demo', using 2 threads # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ #WARNING: LoaderException:loadLibrary:sql: loader error lib_logger.so.0: cannot open shared object file: No such file or directory !MALException:MAL.getAddress:address of 'sql.SQLsession' not found !MALException:MAL.getAddress:address of 'sql.SQLsession2' not found !MALException:MAL.getAddress:address of 'sql.SQLinitEnvironment' not found !MALException:MAL.getAddress:address of 'sql.SQLcommit' not found !MALException:MAL.getAddress:address of 'sql.SQLrollback' not found !MALException:MAL.getAddress:address of 'sql.SQLstatement' not found !MALException:MAL.getAddress:address of 'sql.SQLstatementOut' not found !MALException:MAL.getAddress:address of 'sql.SQLassert' not found !MALException:MAL.getAddress:address of 'sql.SQLassertInt' not found !MALException:MAL.getAddress:address of 'sql.SQLassertLng' not found !MALException:MAL.getAddress:address of 'sql.setVariable' not found !MALException:MAL.getAddress:address of 'sql.getVariable' not found !MALException:MAL.getAddress:address of 'sql.mvc_logfile' not found !MALException:MAL.getAddress:address of 'sql.mvc_next_value' not found !MALException:MAL.getAddress:address of 'batsql.mvc_bat_next_value' not found !MALException:MAL.getAddress:address of 'sql.mvc_get_value' not found !MALException:MAL.getAddress:address of 'sql.mvc_restart_seq' not found !MALException:MAL.getAddress:address of 'sql.mvc_bind_dbat_wrap' not found !MALException:MAL.getAddress:address of 'sql.mvc_bind_idxbat_wrap' not found !MALException:MAL.getAddress:address of 'sql.mvc_bind_wrap' not found . . .[lines were removed because the message would not been sent otherwise] . . !MALException:MAL.getAddress:address of 'mat.mat_bind_idxbat_wrap' not found !MALException:MAL.getAddress:address of 'mat.inc_parts_wrap' not found !MALException:MAL.getAddress:address of 'mat.send_part_wrap' not found !MALException:MAL.getAddress:address of 'mat.get_part_wrap' not found !MALException:MAL.getAddress:address of 'mat.print_part_wrap' not found !MALException:MAL.getAddress:address of 'constraints.Cparts' not found !TypeException:user.main[1]:'sql.prelude' undefined in: _1:void := sql.prelude() > this file lib_logger.so.0 (which is actually a link to lib_logger.so.0.0.0) exists in: /usr/lib64/MonetDB5/lib thanks in advanced for any help, ewilde.

3 2

[MonetDB-users] test 2
by ewilde 24 Aug '08

24 Aug '08

1 0

[MonetDB-users] C# odbc connection
by Aviad Harell 21 Aug '08

21 Aug '08

Hi there, I'm playing here with MonetDB. I've downloaded the monetDb sql DB and the odbc driver. With the console I succeeded to connect and query the voc sample db, which is great. I also succeeded to import data to excel from the MonetDb via odbc as shown on the website. Now, I want to connect to the monetDB via C# and odbc driver. How can I do that? Thanks, Aviad

2 1

[MonetDB-users] C# odbc connection
by Aviad Harell 21 Aug '08

21 Aug '08

Hi there, I'm playing here with MonetDB. I've downloaded the monetDb sql DB and the odbc driver. With the console I succeeded to connect and query the voc sample db, which is great. I also succeeded to import data to excel from the MonetDb via odbc as shown on the website. Now, I want to connect to the monetDB via C# and odbc driver. How can I do that? Thanks, Aviad

1 0

[MonetDB-users] C# odbc connection
by Aviad 20 Aug '08

20 Aug '08

Hi there, I'm playing here with MonetDB. I’ve downloaded the monetDb sql DB and the odbc driver. With the console I succeeded to connect and query the voc sample db, which is great. I also succeeded to import data to excel from the MonetDb via odbc as shown on the website. Now, I want to connect to the monetDB via C# and odbc driver. How can I do that? Thanks, Aviad -- View this message in context: http://www.nabble.com/C--odbc-connection-tp19073114p19073114.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

Re: [MonetDB-users] Order of WHERE clause has significant performance impact
by Ross Bates 15 Aug '08

15 Aug '08

On Tue, Aug 12, 2008 at 08:31:22PM -0500, Ross Bates wrote: > Hi All - I have 2 queries which run very different based on how I > order the WHERE clause. > > When I put the larger filter first, it runs for 3.5 seconds. > > Query 1: > > select c5, c6, sum(sale) from sobi.sample > where > c5 in (5253,5110,5375,5268,5257,5266,5243,5256,5252,5361,5379,5363,5386,5367,5240,5241,5261,5249,5245,5260,5247,5264,5354,5250,5373,5366,5246,5356,5365,5255,5262,5259,5251,5369,5357,5269,5364,5380,5244,5248,5242,5254,5358,5360,5263,5362,5374,5378,5370,5294,5339,5272,5277,5275,5295,5340,5273,5276,5270,5061,5081,5079,5080,5066,5056,5073,5060,5070,5099,5101,5100,5067,5063,5077,5072,5062,5075,5083,5086,5071,5095,5058,5087,5090,5102,5084,5098,5076,5059,5074,5094,5091,5065,5069,5068,5104,5109,5107,5108,5013,5019,5022,5010,5009,5023,5011,5024,5012,5021,5007,5008,5025,5020,5055,5006,5036,5038,5054,5032,5033,5031,5039,5035,5026,5027,5030,5200,5043,5005,5041,5049,5042,5052,5040,5053,5045,5047,5048,5050,5051,5044,5046) > and c6 in (5182) > group by c5, c6; > > > When I reverse the order of the WHERE clause, it runs in about .4 seconds. > > > Query 2: > > c5, c6, sum(sale) from sobi.sample > where > c6 in (5182) > and > c5 in (5253,5110,5375,5268,5257,5266,5243,5256,5252,5361,5379,5363,5386,5367,5240,5241,5261,5249,5245,5260,5247,5264,5354,5250,5373,5366,5246,5356,5365,5255,5262,5259,5251,5369,5357,5269,5364,5380,5244,5248,5242,5254,5358,5360,5263,5362,5374,5378,5370,5294,5339,5272,5277,5275,5295,5340,5273,5276,5270,5061,5081,5079,5080,5066,5056,5073,5060,5070,5099,5101,5100,5067,5063,5077,5072,5062,5075,5083,5086,5071,5095,5058,5087,5090,5102,5084,5098,5076,5059,5074,5094,5091,5065,5069,5068,5104,5109,5107,5108,5013,5019,5022,5010,5009,5023,5011,5024,5012,5021,5007,5008,5025,5020,5055,5006,5036,5038,5054,5032,5033,5031,5039,5035,5026,5027,5030,5200,5043,5005,5041,5049,5042,5052,5040,5053,5045,5047,5048,5050,5051,5044,5046) > group by c5, c6; > > This in on MonetDB server v5.6.0, based on kernel v1.24.0 which I > built from the super tarball. > > I can attach the entire trace files for each query if appropriate for the list. > > While I am still learning to read the trace, it looks like most of the > time spent in the first query on a series of algebra.semijoin > operations. Here are the excerpted lines: > > Query 1: > > [2320345 usec # _461 := > algebra.semijoin(_167=<~tmp_2116>bat[:str,:oid]{8280020}, > _460=<~tmp_2016>bat[:str,:oid]{142}) ] > [776017 usec # _463 := > algebra.semijoin(_158=<tmp_2130>bat[:oid,:str]{8280020}, > _462=<~tmp_1572>bat[:oid,:str]{5135708}) ] > [253551 usec # _470 := > algebra.semijoin(_464=<~tmp_2116>bat[:str,:oid]{5135708}, > _469=<~tmp_2016>bat[:str,:oid]{1}) ] > > > Query 2: > > [412122 usec # _179 := > algebra.semijoin(_167=<~tmp_2076>bat[:str,:oid]{8280020}, > _178=<~tmp_2016>bat[:str,:oid]{1}) ] > [ 194 usec # _181 := > algebra.semijoin(_158=<tmp_2070>bat[:oid,:str]{8280020}, > _180=<~tmp_1572>bat[:oid,:str]{304}) ] > [ 0 usec # _470 := > algebra.semijoin(_182=<~tmp_2076>bat[:str,:oid]{304}, > _469=<~tmp_2016>bat[:str,:oid]{142}) ] > > > Any assistance would be greatly appreciated. Indeed the optimizer isn't smart enough to use the correct (most selective) in first. Could you send the create statement for the sobi.sample table? If possible could you try this on the 'current' and with mclient -lsql -G. That last -G enables the new implementation which first translates sql into a relational algebra and then in binary algebra. Niels > > -Ross Niels - thanks for the response. I tried using the -G switch and the performance time was the same for both versions of the query. The table is pretty simple (see below). I've tried the query against the table using both int and varchar for the columns being used in the WHERE clause. When c6 and C7 are declared as ints the queries run faster, but the order of the WHERE clause still creates a difference. 3.3 vs .4 when varchar 1.9 vs .2 when int CREATE TABLE "sobi"."sample" ( c1 char(1), c2 varchar(24), c3 varchar(12), c4 varchar(12), c5 varchar(12), c6 int, c7 int, c8 varchar(12), c9 varchar(12), sale int ) CREATE TABLE "sobi"."sample" ( c1 char(1), c2 varchar(24), c3 varchar(12), c4 varchar(12), c5 varchar(12), c6 varchar(12), c7 varchar(12), c8 varchar(12), c9 varchar(12), sale int ) Would it introduce any issues or risks to have the optimizer reorder the execution of each WHERE clause based on the number of predicates specified? I am still learning about the optimizer, but would changing any steps in the default SQL optimization sequence help in this situation? Thanks again, Ross

4 9

[MonetDB-users] Newbie question about XML / SQL capabilities
by Bill Walton 14 Aug '08

14 Aug '08

Greetings all, I just became aware of MonetDB via a post to the Ruby on Rails list about a new connection adapter for MonetDB (thanks Michalis). I'm intrigued by what looks like a very impressive capability. If I'm reading the site right, MonetDB can import an XML file using the XQuery client and then query that same data using the SQL client. Is that a correct reading? TIA, Bill

2 1

[MonetDB-users] Order of WHERE clause has significant performance impact
by Ross Bates 13 Aug '08

13 Aug '08

Hi All - I have 2 queries which run very different based on how I order the WHERE clause. When I put the larger filter first, it runs for 3.5 seconds. Query 1: select c5, c6, sum(sale) from sobi.sample where c5 in (5253,5110,5375,5268,5257,5266,5243,5256,5252,5361,5379,5363,5386,5367,5240,5241,5261,5249,5245,5260,5247,5264,5354,5250,5373,5366,5246,5356,5365,5255,5262,5259,5251,5369,5357,5269,5364,5380,5244,5248,5242,5254,5358,5360,5263,5362,5374,5378,5370,5294,5339,5272,5277,5275,5295,5340,5273,5276,5270,5061,5081,5079,5080,5066,5056,5073,5060,5070,5099,5101,5100,5067,5063,5077,5072,5062,5075,5083,5086,5071,5095,5058,5087,5090,5102,5084,5098,5076,5059,5074,5094,5091,5065,5069,5068,5104,5109,5107,5108,5013,5019,5022,5010,5009,5023,5011,5024,5012,5021,5007,5008,5025,5020,5055,5006,5036,5038,5054,5032,5033,5031,5039,5035,5026,5027,5030,5200,5043,5005,5041,5049,5042,5052,5040,5053,5045,5047,5048,5050,5051,5044,5046) and c6 in (5182) group by c5, c6; When I reverse the order of the WHERE clause, it runs in about .4 seconds. Query 2: c5, c6, sum(sale) from sobi.sample where c6 in (5182) and c5 in (5253,5110,5375,5268,5257,5266,5243,5256,5252,5361,5379,5363,5386,5367,5240,5241,5261,5249,5245,5260,5247,5264,5354,5250,5373,5366,5246,5356,5365,5255,5262,5259,5251,5369,5357,5269,5364,5380,5244,5248,5242,5254,5358,5360,5263,5362,5374,5378,5370,5294,5339,5272,5277,5275,5295,5340,5273,5276,5270,5061,5081,5079,5080,5066,5056,5073,5060,5070,5099,5101,5100,5067,5063,5077,5072,5062,5075,5083,5086,5071,5095,5058,5087,5090,5102,5084,5098,5076,5059,5074,5094,5091,5065,5069,5068,5104,5109,5107,5108,5013,5019,5022,5010,5009,5023,5011,5024,5012,5021,5007,5008,5025,5020,5055,5006,5036,5038,5054,5032,5033,5031,5039,5035,5026,5027,5030,5200,5043,5005,5041,5049,5042,5052,5040,5053,5045,5047,5048,5050,5051,5044,5046) group by c5, c6; This in on MonetDB server v5.6.0, based on kernel v1.24.0 which I built from the super tarball. I can attach the entire trace files for each query if appropriate for the list. While I am still learning to read the trace, it looks like most of the time spent in the first query on a series of algebra.semijoin operations. Here are the excerpted lines: Query 1: [2320345 usec # _461 := algebra.semijoin(_167=<~tmp_2116>bat[:str,:oid]{8280020}, _460=<~tmp_2016>bat[:str,:oid]{142}) ] [776017 usec # _463 := algebra.semijoin(_158=<tmp_2130>bat[:oid,:str]{8280020}, _462=<~tmp_1572>bat[:oid,:str]{5135708}) ] [253551 usec # _470 := algebra.semijoin(_464=<~tmp_2116>bat[:str,:oid]{5135708}, _469=<~tmp_2016>bat[:str,:oid]{1}) ] Query 2: [412122 usec # _179 := algebra.semijoin(_167=<~tmp_2076>bat[:str,:oid]{8280020}, _178=<~tmp_2016>bat[:str,:oid]{1}) ] [ 194 usec # _181 := algebra.semijoin(_158=<tmp_2070>bat[:oid,:str]{8280020}, _180=<~tmp_1572>bat[:oid,:str]{304}) ] [ 0 usec # _470 := algebra.semijoin(_182=<~tmp_2076>bat[:str,:oid]{304}, _469=<~tmp_2016>bat[:str,:oid]{142}) ] Any assistance would be greatly appreciated. -Ross

2 1

[MonetDB-users] Announcement: new minor release of MonetDB Clients package
by Sjoerd Mullender 12 Aug '08

12 Aug '08

The MonetDB team at CWI is pleased to announve a bug fix release for the MonetDB Clients package. A number of bugs in the ODBC driver have been fixed: - fixes for the handling of UTF-8 encoded queries and query parameters; - fixes for dealing with wide characters. There is also a fix for mclient: - the timer (-t/--time option) could overflow. There are new Windows installers for the ODBC driver, and there are new RPMs for Fedora 8 and 9. All of this for both 32 and 64 bit architectures. There is also a new Super Source Ball. -- Sjoerd Mullender

1 0

Re: [MonetDB-users] MonetDB rpm issues
by Stefan Manegold 11 Aug '08

11 Aug '08

On Mon, Aug 11, 2008 at 10:52:34AM +0100, John Baxter wrote: > Stefan, > > Sorry about the html format, it is just the default, i've changed it to > plain text now. Thanks! > cenos == centos, my mistake. > > CentOS is basically the same as Red Hat Enterprise server but rebranded. > I feel it is more stable than fedora core and as it is also open source > it is just as usable. > > I'm sorry, i didn't realise i would have to compile it first, i'll do > that today, thank you for the tips about what order to do it in. > > One last thing, i'm sure i read somewhere that the sql implementation is > the same as postgresql. Is this still correct, and is the implementation > exactly the same or are there some exceptions? Well, we do not follow or copy any other SQL implementation (in particular not their modification and/or extensions of the standard), but rather (try to) stick to teh standard. For details see http://monetdb.cwi.nl/SQL/Documentation/index.html and in particular http://monetdb.cwi.nl/SQL/Documentation/SQL-Reference.html Stefan > Thanks again for your assistance. > > Kind Regards > > John > > > Stefan Manegold wrote: >> Hi John, >> >> On Fri, Aug 08, 2008 at 04:26:09PM +0100, John Baxter wrote: >> >>> <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> >>> <html> >>> <head> >>> <meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type"> >>> </head> >>> <body bgcolor="#ffffff" text="#000000"> >>> Stefan, >>> >>> Thanks very much for replying, i really appreciate it. >>> >>> These are the RPM's i have tried: >>> >>> MonetDB5-server-5.6.0-4.src.rpm >>> MonetDB-SQL-2.24.0-4.src.rpm >>> >>> I'm only installing this on a local centos install. I downloaded the >>> RPM's to the root of the filesystem and ran them from there. >>> I'm running cenos from it's GUI at the moment so it would be the GUI >>> >> ^^^^^ >> Typo (i.e., "cenos" == "centos") or is that the application/tools you use to >> install RPMs? >> I don't know CentOS and/or it's adminstrative tools at all. Sorry. >> >> However, the "platform independent" RPMs are *source* RPMs that cannot be >> installed directly using, e.g., `rpm -i`. Instead, they have to be compiled >> (into platform-specific binary RPMs, first, e.g., via `rpmbuild --rebuild` >> or `rpmbuild --recompile`. >> >> See your systems RPM documentation (e.g., `man rpm` / `man rpmbuild` and/or >> http://www.rpm.org/ for a detailed documentation of RPM. >> >> >> Before compiling/building and installing >> MonetDB5-server-5.6.0-4.src.rpm >> and MonetDB-SQL-2.24.0-4.src.rpm >> >> you first need to compile/build and install >> MonetDB-1.24.0-4.src.rpm >> and MonetDB-client-1.24.0-4.src.rpm >> >> >> Stefan >> >> >> ps: We would greatly apprechiate if you would not sedn HTML(-only) >> emails/postings --- plain text is more than sufficient (and much easier >> to handle) ... >> >> >> >>> that gave me the error messages. >>> >>> Thanks >>> >>> John >>> >>> Stefan Manegold wrote: >>> <blockquote cite="mid:20080808151929.GA10101@cwi.nl" type="cite"> >>> <pre wrap="">Hi John, >>> >>> which "platform independent RPM's" are you refering to? >>> >>> On our download page on SF we only provide Fedora 8 & 9 (binary) RPMs as >>> well as source-RPMs --- only the latter are platform independent, except >>> that the target OS need to obviously provide RPM support in general. >>> >>> How exactly do you try to install the (source?) RPMs? >>> >>> And who (i.e., which program) give the error messages? >>> >>> Stefan >>> >>> On Fri, Aug 08, 2008 at 03:49:45PM +0100, John Baxter wrote: >>> </pre> >>> <blockquote type="cite"> >>> <pre wrap="">Stefan, >>> >>> I hope you don't mind me e-mailing you. You were kind enough to help >>> me once before when i was having trouble installing MonetDB and i'm >>> having trouble again. >>> >>> I'm trying to install the platform independent RPM's on centos 5.2 >>> but it is saying that it "cannot install source packages" and then >>> "no packages were given for installation" >>> >>> Are the RPM's usable at the moment? >>> >>> If you can offer any advice that would be great. >>> >>> Thank you >>> >>> Kind Regards >>> >>> John Baxter >>> </pre> >>> </blockquote> >>> <pre wrap=""> >>> </pre> >>> </blockquote> >>> >>> <pre class="moz-signature" cols="72">-- Co: Baxter Designs >>> >>> Web: <a class="moz-txt-link-freetext" href="http://www.baxterdesigns.co.uk">http://www.baxterdesigns.co.uk</a> >>> >>> Mail: <a class="moz-txt-link-abbreviated" href="mailto:john@baxterdesigns.co.uk">john(a)baxterdesigns.co.uk</a> >>> >>> Tel: 07968754215</pre> >>> </body> >>> </html> >>> >>> >> >> >>> ------------------------------------------------------------------------- >>> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge >>> Build the coolest Linux based applications with Moblin SDK & win great prizes >>> Grand prize is a trip for two to an Open Source event anywhere in the world >>> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >>> _______________________________________________ >>> MonetDB-users mailing list >>> MonetDB-users(a)lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/monetdb-users >>> >> >> >> > > -- > Co: Baxter Designs > > Web: http://www.baxterdesigns.co.uk > > Mail: john(a)baxterdesigns.co.uk > > Tel: 07968754215 -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 5

[MonetDB-users] (no subject)
by Matt Magoffin 11 Aug '08

11 Aug '08

Hello, I am interested in evaluating MonetDB/XQuery. I have some XML collections for a project I work on that are of 1-2 million individual XML documents for which I use XQuery to access for OLAP style reporting operations. This is a Java-based project, and while working on this project I developed a thin XQuery-centric API so that I could evaluate/use many different XQuery implementations, which my company released as an open source project called Xaj (http://sourceforge.net/projects/xaj) Currently I am using a Berkeley DB XML implementation, but am interested in exploring other options. I'd like to implement a MonetDB version of this API now, but I am having some difficulty finding out how to effectively access MonetDB through Java. So far I was able to use the MonetDB JDBC driver to construct XQuery statements and get XML results, and also I was able to construct MonetDB pf:add-doc() statements to add documents, but I am wondering if this is the best approach (and if so, how to add documents to a remote MonetDB server using the pf:add-doc() mechanism). The API I am trying to implement you can view here, to give you an idea what I'm trying to do: http://xaj.svn.sourceforge.net/viewvc/xaj/xaj/src/net/sf/xaj/XmlDb.java?rev… It was somewhat modeled after the defunct XML:DB API, but focused just on add/store/XQuery operations. Any help/advise would be greatly appreciated! -- m@

2 3

Re: [MonetDB-users] MonetDB rpm issues
by Stefan Manegold 11 Aug '08

11 Aug '08

Hi John, which "platform independent RPM's" are you refering to? On our download page on SF we only provide Fedora 8 & 9 (binary) RPMs as well as source-RPMs --- only the latter are platform independent, except that the target OS need to obviously provide RPM support in general. How exactly do you try to install the (source?) RPMs? And who (i.e., which program) give the error messages? Stefan On Fri, Aug 08, 2008 at 03:49:45PM +0100, John Baxter wrote: > Stefan, > > I hope you don't mind me e-mailing you. You were kind enough to help me > once before when i was having trouble installing MonetDB and i'm having > trouble again. > > I'm trying to install the platform independent RPM's on centos 5.2 but > it is saying that it "cannot install source packages" and then "no > packages were given for installation" > > Are the RPM's usable at the moment? > > If you can offer any advice that would be great. > > Thank you > > Kind Regards > > John Baxter -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

[MonetDB-users] Announcing MonetDB support for Ruby on Rails
by Michalis Polakis 10 Aug '08

10 Aug '08

Hello folks, I developed the MonetDB adapter for Rail's ActiveRecord. It will enable you to work with MonetDB databases in Ruby on Rails. You are more than welcome to try the code, give me some feedback, and maybe help me maintain it. To get the code visit : http://rubyforge.org/projects/monetdb-ror Thanks, Michalis Polakis

1 0

[MonetDB-users] MonetDB Indexes and Data Types
by Ross Bates 09 Aug '08

09 Aug '08

Hi All - I'm new to MonetDB and just getting my feet wet. Quick question for the experts. Does the data type of the column impact the performance of the indexes created on the fly by MonetDB? In other words, should I expect WHERE clauses on INT columns to perform faster than VARCHAR like I would in a tradtional row store? Many Thanks, Ross

2 1

[MonetDB-users] full text search?
by mark 09 Aug '08

09 Aug '08

hi, i am beginning with monetdb. is there any support for full text search on monet-db via plugin or natively? thanks a lot

2 1

[MonetDB-users] COPY INTO on Ubuntu 64bit is slow
by Cronje Fourie 08 Aug '08

08 Aug '08

Hi guys.... I've got to machines running Monet. 1. Quad core Intel with 4GB RAM, Ubuntu 8.04 32BIT (server ed) 2. AMD64 Quad Core, 4GB RAM, KUbuntu 8.04 64BIT (kde 3.5.9) On system 1 I can do a "copy into" of 6million records in no time at all :) On system 2 the same function, with the exact same data takes forever. Any thoughts on the reason? Is this a memory related issue? Cronje

7 12

[MonetDB-users] [XQuery] Communicate with Java?
by Chaojing Yang 08 Aug '08

08 Aug '08

Dear all, I'm a totally newbie and try to implements an LDAP-application over MonetDB/XQuery due to efficient search performance of column-store. Like the example XQueryLoad.java does i have succeed to import a XML-file and now come my questions: * How can i manipulate my XML-files with JAVA? Like doing searches and changes over XML-files. * How is the performance of Subtree-search? Like doing searchs over the whole tree or any subtrees. As once discussed in http://comments.gmane.org/gmane.comp.db.monetdb.user/1027, i'm in the same situation. Best regards, Chaojing Yang -- ------------------------------------------------------------------------------------------------------------------------------------------ Email: chaojing.yang(a)gmail.com Blog: http://goethe-ist-taoist.blogspot.com/ §1 Ich widerspreche der Nutzung oder Übermittlung meiner Daten für Werbezwecke oder sowie andere unbefugte Verwendungszwecke. (§ 28 Abs. 4 BDSG=Bundesdatenschutzgesetz). §2 Durch die Datenübertragung bzw. Kommunikation per E-Mail liegt ein Verstoß gegen das BDSG vor, da ihre Daten insoweit nicht ausreichend geschützt sind. Ich bitte Sie daher, mir schriftlich zu bestätigen, dass Sie mit dem Verstoß gegen das BDSG einverstanden sind und keine Schadensersatzanspräche bzw. Unterlassungsanspräche mir gegenüber geltend machen. §3 Der Inhalt dieser Nachricht ist vertraulich und nur für den oben angegebenen Empfänger bestimmt.

5 8

[MonetDB-users] Does MonetDB's JDBC Driver support CachedRowSet??
by sateesh 07 Aug '08

07 Aug '08

Hi All, I am wondering what JDBC Spec does the MonetDB's JDBC Driver conform to ? (is it JDBC3.0 ,4.0) We would like to use the pagination at the Database level and hence i want to know whether the JDBC Driver has any implementation of CachedRowSet.. Thanks Sateesh -- View this message in context: http://www.nabble.com/Does-MonetDB%27s--JDBC-Driver-support-CachedRowSet---… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] protocol violation: unexpected line in data block
by toshiki.shiga＠alsi.co.jp 07 Aug '08

07 Aug '08

Hi, All Please explain this message? "protocol violation: unexpected line in data block: #02 #GDKmemchk (memcur=16870976,memmax=1741950382) (vmcur=1047527424,vmmax=1610612736)" Regards, Shiga

3 5

[MonetDB-users] Update statement to update from other table
by Cronje Fourie 05 Aug '08

05 Aug '08

Hi all... I'm testing MonetDB and evaluating all functionality. One item I've not been able to find much info on is updating table A from table B. ie... UPDATE PERSON SET SALARY = sal.newval FROM PERSON P, SAL_DATA sal WHERE p.id = sal.p_id Or something to that effect :) Is it possible? Thanks Cronje

2 1

[MonetDB-users] Is there a recommended OS for MonetDB?
by McKennirey.Matthew 04 Aug '08

04 Aug '08

2 1

[MonetDB-users] monetdb copy command
by ashokguruswamy 01 Aug '08

01 Aug '08

my seasonal compliments.. this is ashok. i am using monetdb for my application with java. just i need to copy the monetdb table to a csv file.. in an sql manual i read the syntax for copying from table to csvfile is Syntax: COPY <subquery> INTO <file_name> [ [USING] DELIMITERS tuple_separator [’,’ record_separator [ ’,’ string_quote ]]] [ NULL AS null_string ]; Operating System: Windows XP My query: copy select * from table_name into 'D:/file_name.csv' using delimiters '|'; but if i execute this, am facing the following problem.. any suggestion? asap... Error: Syntax error, unexpected SELECT, expecting INTO in: “copy select”.. Also the query specified below which having --with null as 'null_String"-- is not working.. copy select * from table_name into 'D:/file_name.csv' using delimiters '|' with null as ' '; I want a way to copy monetdb tables to csv files.. -- View this message in context: http://www.nabble.com/monetdb-copy-command-tp18752294p18752294.html Sent from the monetdb-users mailing list archive at Nabble.com.

4 4

Re: [MonetDB-users] [Questions] Shredding 1GB XML File and Query Performance
by John 31 Jul '08

31 Jul '08

Thank you for your response! > Were you able to see any (error-) message in the server window? I could not see any message in the server window as it was directly closed. > On you 64-bit hardware, are you running 64-bit or 32-bit windows? > If 64-bit, did you install the 64-bit or 32-bit MonetDB/XQuery? I am using 32-bit windows. > The serialized size ("1 GB") does not say much about the actual complexity > of the XML document, e.g., how many nodes, attributes, etc. does the > document contain? > Do you know these statistics, or could you share your document with us for > testing? I tested using XBench DCSD. The total numbers of nodes and attributes were almost 22-23 millions and 1.5 millions, respectively. Thanks! John

1 0

[MonetDB-users] constant bulk inserts to monetdb
by uriel katz 30 Jul '08

30 Jul '08

i have a application where i have constant bulk inserts(about 50000 rows of 1Kbyte each) every 1 minute,i am wondering which is the fastest and most efficient way to insert data. i am using now the COPY command but it is kind of awkward since i need to dump my data as csv and then execute COPY to insert it,is there any streaming method or a special api for bulk inserts? also when i issue a copy command it uses a little bit of cpu aroud 2%(it is a quad core setup with windows so i guess this means 8% of one cpu) and keep loading and releasing memory(i have 8GB of ram) even that it doesn`t get near 2GB. is this ok,what it is actually doing? P.S.: are insert/selects multi threaded? thanks for this awsome peace of software! -Uriel

4 3

[MonetDB-users] constant bulk inserts to monetdb
by uriel katz 30 Jul '08

30 Jul '08

>>>> >>>> ok,but why it don`t utilize one core to the max,it seem to keep using 8% >>>> of >>>> the core and takes about 17 seconds to insert 200,000 record of 1Kb each >>>> (the actual file is 64MB). >>>> >>>> >>> >>> That depends on the total setup. Especially, when you are exceeding >>> memory then Linux >>> is not the best operating system. One of the issues is that dirty pages >>> are not properly flushed. >>> A BATsave in the new bulk loader at critical points helped to avoid this >>> case. >>> if you do a COPY into a clean bat, then the log overhead is neglectable. >>> >>>> >>>> can i some how skip the logs and make it insert right into the bat >>>> files? >>>> also how can i stream the tuples programaticlly from C mapi or ODBC? >>>> >>>> >>> >>> See the C Mapi library. Or you might look at the Stethoscope, which >>> streams tuples >>> from server to an application. >>> >> >> i am running MonetDB on windows with a 8GB of ram. >> > > That should be more then enough ; ) > >> what is Stethoscope? >> > > it is part of the source distribution and a Linux utility that picks up a > stream of tuples from the server. does it work on windows,and how it works,using a special mil/mal syntax or does it is a plugin in the server for fast loads? also how you guys load data into benchmark databases which are(according to papers i have seen) 1-100GB of data. > > The information you provide is hard to track down to a possible cause. > a COPY operation most likely reads the complete file into its buffers > before processing it. > > One pitfall you may have stumbled upon is the following. > Did you indicate the number of records that you are about to copy into the > table? > If not, then the system has to guess and will repeatedly adjust this guess, > which > involves quite some overhead. > Pleae use, COPY 50000 RECORDS INTO ..... even if i want to read all the file? >>> >>> Do you happen to be a Ruby-on-Rails expert? >>> >> >> i am not a ruby on rails expert,sorry i am python guy :) >> >>>> >>>> thanks again. >>>> >>>> Martin Kersten wrote: >>>> >>>> >>>>> >>>>> uriel katz wrote: >>>>> >>>>> >>>>>> >>>>>> i have a application where i have constant bulk inserts(about 50000 >>>>>> rows of 1Kbyte each) every 1 minute,i am wondering which is the fastest and >>>>>> most efficient way to insert data. >>>>>> >>>>>> >>>>> >>>>> COPY into is the fastest >>>>>

2 1

Re: [MonetDB-users] constant bulk inserts to monetdb
by Martin Kersten 30 Jul '08

30 Jul '08

uriel katz wrote: >>> ok,but why it don`t utilize one core to the max,it seem to keep using 8% of >>> the core and takes about 17 seconds to insert 200,000 record of 1Kb each >>> (the actual file is 64MB). >>> >>> >> That depends on the total setup. Especially, when you are exceeding memory then Linux >> is not the best operating system. One of the issues is that dirty pages are not properly flushed. >> A BATsave in the new bulk loader at critical points helped to avoid this case. >> if you do a COPY into a clean bat, then the log overhead is neglectable. >> >>> can i some how skip the logs and make it insert right into the bat files? >>> also how can i stream the tuples programaticlly from C mapi or ODBC? >>> >>> >> See the C Mapi library. Or you might look at the Stethoscope, which streams tuples >> from server to an application. >> > i am running MonetDB on windows with a 8GB of ram. > That should be more then enough ; ) > what is Stethoscope? > it is part of the source distribution and a Linux utility that picks up a stream of tuples from the server. The information you provide is hard to track down to a possible cause. a COPY operation most likely reads the complete file into its buffers before processing it. One pitfall you may have stumbled upon is the following. Did you indicate the number of records that you are about to copy into the table? If not, then the system has to guess and will repeatedly adjust this guess, which involves quite some overhead. Pleae use, COPY 50000 RECORDS INTO ..... >> Do you happen to be a Ruby-on-Rails expert? >> > i am not a ruby on rails expert,sorry i am python guy :) > >>> thanks again. >>> >>> Martin Kersten wrote: >>> >>> >>>> uriel katz wrote: >>>> >>>> >>>>> i have a application where i have constant bulk inserts(about 50000 rows of 1Kbyte each) every 1 minute,i am wondering which is the fastest and most efficient way to insert data. >>>>> >>>>> >>>> COPY into is the fastest >>>> >>>> >>>>> i am using now the COPY command but it is kind of awkward since i need to dump my data as csv and then execute COPY to insert it,is there any streaming method or a special api for bulk inserts? >>>>> >>>>> >>>>> >>>> I think it is possible to inline the tuples into the sql stream as well. The SQL developer will answer this one. >>>> >>>> >>>>> also when i issue a copy command it uses a little bit of cpu aroud 2%(it is a quad core setup with windows so i guess this means 8% of one cpu) and keep loading and releasing memory(i have 8GB of ram) even that it doesn`t get near 2GB. >>>>> is this ok,what it is actually doing? >>>>> >>>>> >>>> We have recently upgraded our bulk loader to utilize as many cores as possible >>>> This is not yet in the release. >>>> The preview of effects you can see in http://monetdb.cwi.nl/projects/monetdb//SQL/Benchmark/TPCH/ >>>> >>>> >>>>> P.S.: are insert/selects multi threaded? >>>>> >>>>> thanks for this awsome peace of software! >>>>> >>>>> -Uriel >>>>> >>>>> >>>

1 0

[MonetDB-users] [Questions] Shredding 1GB XML File and Query Performance
by John 30 Jul '08

30 Jul '08

I just installed MonetDB/XQuery 0.24.0 (released on 30 June 2008) and wanted to store some XML documents. When I tried to shred an XML document with almost 1GB filesize, I received the following error message. > MAPI = monetdb@localhost:50000 > ACTION= read_line > QUERY = pf:add-doc("C:/Data/TestData-10.xml","TestData-10.xml") > ERROR = Connection terminated After receiving this error on my mclient window, I noticed that the MonetDB XQuery Server and MClient were terminated. FYI, I used a Windows XP Pro SP3 PC with Intel Core2 Duo E6550 processor and 3.25GB of RAM. The size of my hard disk is 232 GB. May I know how I can shred this file? Another question is about to test the query performance. I tried to execute an XQuery using the following command. > mclient.bat -lxq -t -G XQuery-1.xq This command will print out the query result and return the "Timer". a. Can I hide the result? I tried to add "-f none" to the above command, but it did not work. b. What is the "Timer"? How can I get only the query time? Thanks John

3 3

[MonetDB-users] [Question]How to change the format of datetime?
by chenhao333333 28 Jul '08

28 Jul '08

Are there any functions like date_format in MonetDB, I want to do something like date_format(zncsrq, '%Y%m%d', that is Mysql's function, in MonetDB. Best regards!

2 1

[MonetDB-users] JESUS LOPEZ LOPEZ - F009939R está ausente de la oficina.
by jesus.lopez＠correo.aeat.es 28 Jul '08

28 Jul '08

Estaré ausente de la oficina desde el 28/07/2008 y no volveré hasta el 08/08/2008. Responderé a su mensaje cuando regrese.

1 0

[MonetDB-users] MonetDB/XQuery XQTS results available?
by Richard Eckart 28 Jul '08

28 Jul '08

Hello everybody, are there any results of the official XML Query Test Suite on MonetDB/ XQuery available or is there an easy way to generate them? Regards, Richard

1 0

[MonetDB-users] Is there Function likes TRUNCATE ?
by nori 25 Jul '08

25 Jul '08

Hi, All. Is there the function such as "TRUNCATE TABLE" in other DB? Regards, Nori. -- Nori tunohiko(a)gmail.com

4 4

[MonetDB-users] Cannot compile MonetDB_4-24
by Stefan Klinger 23 Jul '08

23 Jul '08

Thanks for your help, however I still cannot compile. Actually, I just need to work with most current versions of Pathfinder, and maybe try some other branches of that one as well, until I find out where the fixes end up, and which one works for me. Unortunately I was unable to find a detailed description of which branches of what modules are required to build which other branches of whatever modules I need anyway. If someone would be so kind as to show me how I can achieve this without touching CVS, I would be deeply grateful. Until then, I'll try to follow the CVS trail. On 17 July 2008, Stefan Manegold wrote with possible deletions: > In case you prefer to use the CVS sources, and you do not require the latest > cutting-edge (potentially instable) development version we recommend to > checkout the latest Stable branches. > I ust realize that the respective branch tags are not (yet?) listed on the > MonetDB web site, hence I'll share them here: > > buildtools: MonetDB_1-24 > MonetDB: MonetDB_1-24 > clients: Clients_1-24 > MonetDB4: MonetDB_4-24 > MonetDB5: MonetDB_5-6 > pathfinder: XQuery_0-24 > sql: SQL_2-24 > geom: Geom_0-4 Thank you for this information, but compilation fails for MonetDB4 on the 'make' command with the following error message: /home/sk/opt/MonetDB/include/MonetDB/gdk/gdk_system.h:117: error: expected ‘)’ before ‘*’ token A detailed description of what I did is in the attached 'report' file, which actually is a bash script. The resulting logfile [1] from report 2>&1 | tee logfile is available for download. Kind regards Stefan ____________________ [1] logfile, link valid for one week, 409565 Bytes https://depot.uni-konstanz.de/get/72fwr6 -- Stefan Klinger o/klettern /\/ bis zum send plaintext only - max size 32kB - no spam \ Abfallen http://stefan-klinger.de

4 10

[MonetDB-users] Problems With CREATE TEMPORARY TABLE
by James Leigh 21 Jul '08

21 Jul '08

Hi all, I am having trouble using MonetDB, with dynamic temporary table creation. I have included a simple unit test to demonstrate the problem. These tests work fine on other JDBC SQL servers, but fail with the below exceptions when using MonetDB. Any ideas on how to make new tables available to other connections or keep new tables from interrupting other jdbc statements? Thanks, James ---%<--- java.sql.SQLException: INSERT INTO: no such table 'paints_2' at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2058) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1808) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at nl.cwi.monetdb.jdbc.MonetPreparedStatement.<init>(MonetPreparedStatement.java:102) at nl.cwi.monetdb.jdbc.MonetConnection.prepareStatement(MonetConnection.java:625) at nl.cwi.monetdb.jdbc.MonetConnection.prepareStatement(MonetConnection.java:586) at org.apache.commons.dbcp.DelegatingConnection.prepareStatement(DelegatingConnection.java:248) at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.prepareStatement(PoolingDataSource.java:302) at MonetDBJdbcTest.testDualCreateTable(MonetDBJdbcTest.java:28) ---%<--- java.sql.SQLException: Query did not produce a result set at nl.cwi.monetdb.jdbc.MonetPreparedStatement.executeQuery(MonetPreparedStatement.java:228) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93) at MonetDBJdbcTest.testSelectWhileCreateTable(MonetDBJdbcTest.java:77) ---%<--- import java.sql.Connection; import java.sql.PreparedStatement; import java.sql.ResultSet; import java.sql.SQLException; import java.sql.Statement; import junit.framework.TestCase; import org.apache.commons.dbcp.BasicDataSource; public class MonetDBJdbcTest extends TestCase { private BasicDataSource ds1; public void testDualCreateTable() throws Exception { Connection c4 = ds1.getConnection(); c4.setAutoCommit(true); Connection c76 = ds1.getConnection(); c76.setAutoCommit(false); Statement s93 = c76.createStatement(); s93.execute("CREATE TEMPORARY TABLE TRANSACTION_STATEMENTS (\n ctx INTEGER NOT NULL,\n subj INTEGER NOT NULL,\n pred INTEGER NOT NULL,\n obj INTEGER NOT NULL,\n expl BOOL NOT NULL\n)"); s93.close(); Statement s96 = c4.createStatement(); s96.execute("CREATE TABLE paints_2 (\n ctx INTEGER NOT NULL,\n subj INTEGER NOT NULL,\n obj INTEGER NOT NULL,\n expl BOOL NOT NULL\n)"); s96.close(); PreparedStatement ps102 = c76.prepareStatement("INSERT INTO paints_2\nSELECT DISTINCT ctx, subj, obj, expl FROM TRANSACTION_STATEMENTS tr\nWHERE NOT EXISTS (SELECT * FROM paints_2 st\nWHERE st.ctx = tr.ctx AND st.subj = tr.subj AND st.obj = tr.obj AND st.expl = tr.expl)"); ps102.close(); c76.close(); c4.close(); } public void testSelectWhileCreateTable() throws Exception { Connection c2 = ds1.getConnection(); c2.setAutoCommit(true); Statement s7 = c2.createStatement(); s7.execute("CREATE TABLE HASH_VALUES (\n id INTEGER NOT NULL,\n value BIGINT NOT NULL\n)"); s7.close(); PreparedStatement ps72 = c2.prepareStatement("SELECT id, value\nFROM HASH_VALUES\nWHERE value IN (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)"); ps72.setLong(1, 157585763729791056l); ps72.setLong(2, 1105705122070497121l); ps72.setLong(3, 940939309403574879l); ps72.setLong(4, 44738479624713631l); ps72.setLong(5, 93693228172326007l); ps72.setLong(6, 909856949769965718l); ps72.setLong(7, 388219017765868455l); ps72.setLong(8, 498326321060763331l); ps72.setLong(9, 917168269028472831l); ps72.setLong(10, 560146884310966732l); ps72.setLong(11, 178986943741094305l); ps72.setNull(12, -5); ps72.setNull(13, -5); ps72.setNull(14, -5); ps72.setNull(15, -5); ResultSet rs73 = ps72.executeQuery(); rs73.next(); rs73.close(); Statement s76 = c2.createStatement(); s76.execute("CREATE TABLE TRIPLES (\n ctx INTEGER NOT NULL,\n subj INTEGER NOT NULL,\n pred INTEGER NOT NULL,\n obj INTEGER NOT NULL,\n expl BOOL NOT NULL\n)"); s76.close(); ps72.setLong(1, 157585763729791056l); ps72.setLong(2, 93693228172326007l); ps72.setLong(3, 44738479624713631l); ps72.setLong(4, 909856949769965718l); ps72.setLong(5, 388219017765868455l); ps72.setLong(6, 917168269028472831l); ps72.setNull(7, -5); ps72.setNull(8, -5); ps72.setNull(9, -5); ps72.setNull(10, -5); ps72.setNull(11, -5); ps72.setNull(12, -5); ps72.setNull(13, -5); ps72.setNull(14, -5); ps72.setNull(15, -5); ResultSet rs88 = ps72.executeQuery(); rs88.close(); ps72.close(); c2.close(); } @Override protected void setUp() throws Exception { Class.forName("nl.cwi.monetdb.jdbc.MonetDriver"); ds1 = new BasicDataSource(); ds1.setUrl("jdbc:monetdb://localhost/jdbc_test"); ds1.setUsername("monetdb"); ds1.setPassword("monetdb"); } @Override protected void tearDown() throws Exception { Connection c106 = ds1.getConnection(); Statement s107 = c106.createStatement(); try { s107.execute("DROP TABLE HASH_VALUES"); s107.execute("DROP TABLE TRIPLES"); } catch (SQLException exc) { // ignore } try { s107.execute("DROP TABLE TRANSACTION_STATEMENTS"); s107.execute("DROP TABLE paints_2"); } catch (SQLException exc) { // ignore } s107.close(); c106.close(); ds1.close(); } }

2 6

Re: [MonetDB-users] [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures
by Martin Kersten 19 Jul '08

19 Jul '08

SOL ZADEH wrote: > > Thanks Martin; let me explain better: > > if table update are too costly (slow etc) then could try insertion > instead (having/including the timestamps as an index) > providing the server can cope with very frequent table insertions. > > Is there any benchmark tests in relation to table insertions? you can have a look at the TPCH loading figures. http://monetdb.cwi.nl/projects/monetdb//SQL/Benchmark/TPCH/ I have no hard figures in my head, but the DVD store benchmark we ran 2 years back came out directly after MySQL for high-volume business transactions. http://monetdb.cwi.nl/projects/monetdb/SQL/Benchmark/DVDstore/index.html so it all depends what you consider costly/slow. > > Regarding : > >> Concurrent transactions can freely read a consistent copy of the > database. > does this mean "dirty reads" ? no, only consistent reads > Regards > > > > ----- Original Message ---- > From: Martin Kersten <Martin.Kersten(a)cwi.nl> > To: SOL ZADEH <solzadeh(a)yahoo.com> > Cc: Niels Nes <Niels.Nes(a)cwi.nl>; monetdb-developers(a)lists.sourceforge.net > Sent: Saturday, July 19, 2008 2:22:16 PM > Subject: Re: [Monetdb-developers] tables/databases simultaneous > updates & extended-stored-procedures > > SOL ZADEH wrote: > > > > Thanks Neils for your prompt reply. > > > > Is there a quantified limitation on "insertions" on scenarios I > > mentioned below (multiple tables/database)? > > I.e. Does very frequent insertions on 2 or more tables (on same > > database or other database on the same server) > > in any way effect the performance of the other queries > > (select,insert,update) on the "same" > > or "other" tables (i.e. is parallel processing possible & locking > > performance etc). > > Regards > Trying to interpret you question what it means. > MonetDB does not lock tables or databases during update. Concurrent > transactions can > freely read a consistent copy of the database. > All interference comes from sharing the same CPU, memory and IO channels. > > > > ----- Original Message ---- > > From: Niels Nes <Niels.Nes(a)cwi.nl <mailto:Niels.Nes@cwi.nl>> > > To: SOL ZADEH <solzadeh(a)yahoo.com <mailto:solzadeh@yahoo.com>> > > Cc: monetdb-developers(a)lists.sourceforge.net > <mailto:monetdb-developers@lists.sourceforge.net> > > Sent: Saturday, July 19, 2008 8:49:55 AM > > Subject: Re: [Monetdb-developers] tables/databases simultaneous > > updates & extended-stored-procedures > > > > On Fri, Jul 18, 2008 at 05:13:54PM -0700, SOL ZADEH wrote: > > > Hi > > > > > > > > > I have a couple of questions and really appreciate if any one > > > could answer them or instruct me to the relevant forum topics: > > > > > > > > > 1- what is the limitations (speed, threshold etc) on > > > simultaneous tables /databases update i.e. via multiple odbc > > > connection lets say (also any other faster API to interface > > > with the MonetDB ?) > > MonetDB research concentrated mostly in low update/high query loads. The > > update implementation is still quite capable, but no reall performance > > experiments on updates have been conducted. Next to odbc we have > > mapi and jdbc APIs available. > > > > > > > > > 2- Is there a way to have the triggers to generate > > > real-world (non-db) events i.e. similar to the Extended Stored > > > Procedure in SqlServer or the way Oracle allows you to run Java > > > code inside the stored procedures. > > MonetDB can be extended using C-code and that code could be run within > > the triggers. > > > > Niels > > > > > > Thanks > > > > > > > > ------------------------------------------------------------------------- > > > This SF.Net email is sponsored by the Moblin Your Move Developer's > > challenge > > > Build the coolest Linux based applications with Moblin SDK & win > > great prizes > > > Grand prize is a trip for two to an Open Source event anywhere in > > the world > > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > <http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/>> > > > _______________________________________________ > > > Monetdb-developers mailing list > > > Monetdb-developers(a)lists.sourceforge.net > <mailto:Monetdb-developers@lists.sourceforge.net> > > <mailto:Monetdb-developers@lists.sourceforge.net > <mailto:Monetdb-developers@lists.sourceforge.net>> > > > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > > > > -- > > > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > > url: http://www.cwi.nl/~niels <http://www.cwi.nl/%7Eniels> > <http://www.cwi.nl/%7Eniels> e-mail: > > Niels.Nes(a)cwi.nl <mailto:Niels.Nes@cwi.nl> <mailto:Niels.Nes@cwi.nl > <mailto:Niels.Nes@cwi.nl>> > > > > ------------------------------------------------------------------------ > > > > > ------------------------------------------------------------------------- > > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > > Build the coolest Linux based applications with Moblin SDK & win > great prizes > > Grand prize is a trip for two to an Open Source event anywhere in > the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > ------------------------------------------------------------------------ > > > > _______________________________________________ > > Monetdb-developers mailing list > > Monetdb-developers(a)lists.sourceforge.net > <mailto:Monetdb-developers@lists.sourceforge.net> > > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > >

1 0

Re: [MonetDB-users] Range join question [MonetDB]
by Martin Kersten 18 Jul '08

18 Jul '08

Vasilis Vassalos wrote: > Hello again, > > for the student project I've told you about, we need to perform range > joins, so we tried some on MonetDB. > We're having trouble getting range joins on strings working properly. > > Michalis, my student, has looked into it and reports that > ALGrangejoin (algebra.c) calls BATrangejoin (gdk_rangejoin.c) that > performs the join and returns a BAT > as a result. BATrangejoin has a switch with a case for TYPE_chr that > compares strings You are really delving deep in the sources ; ) An area only meant for the brave at heart. > > When we try to perform a range join on a string attribute (char(n), > even for n=1, varchar(n)) we get > an exception: > !MALException:algebra.rangejoin:GDKerror > !ERROR: BATrangejoin: type not implemented > > The switch statement skips the TYPE_chr case and goes to the default. > For example, > >> sql>create table s1 (id int, v char(10)); >> sql>create table s2 (id int, v char(10)); >> sql>insert into s1 values (1,'s1'); >> sql>insert into s1 values (2,'s2'); >> sql>insert into s1 values (3,'s3'); >> sql>insert into s1 values (4,'s4'); >> sql>insert into s1 values (5,'s5'); >> sql>insert into s1 values (6,'s6'); >> sql>insert into s2 values (1,'s1'); >> sql>insert into s2 values (2,'s2'); >> sql>insert into s2 values (3,'s3'); >> sql>insert into s2 values (4,'s4'); >> sql>insert into s2 values (5,'s5'); >> sql>insert into s2 values (6,'s6'); >> sql>select s1.id from s1, s2 where s1.v between s2.v and s2.v||'c' ; >> !MALException:algebra.rangejoin:GDKerror >> !ERROR: BATrangejoin: type not implemented > This is an instance of the more general theta join. We will have a look into the issue.. It certainly should not have falled back to an error this low in the system. > whereas > >> sql>select s1.id from s1, s2 where s2.id=2 and s1.id between s2.id >> and s2.id+1 ; >> +----+ >> | id | >> +====+ >> | 2 | >> | 3 | >> +----+ > > Thanks! >

1 0

[MonetDB-users] Two questions with XQuery
by Andreas Meinl 17 Jul '08

17 Jul '08

Hi there, I'm currently porting some XQuery scripts to MonetDB/XQuery, and encountered two maybe simple obstacles. The first one is that I can't use fn:collection, but instead always have to apply pf:collection. The online documentation [1] states both alternatives should be practicable. For example in eXist and Sedna I can write: let $a := fn:collection("samples") return $a//id But this does not work for MonetDB/XQuery! Here I have to use: let $a := pf:collection("samples")/child::document-node() return $a//id My second question is that I cannot execute this kind of queries, which runs well in eXist and Sedna: <average> { fn:round(fn:avg( for $doc in fn:collection("samples") return $doc/example/@sum )) } </average> For MonetDB/XQuery I have to pull out pf:collection and add a second return statement: let $col := pf:collection("samples")/child::document-node() return <average> { fn:round(fn:avg( for $doc in $col return $doc/example/@sum )) } </average> So what am I doing wrong? Does MonetDB/XQuery by any chance comply more with any standards than eXist and Sedna do? Or ist fn:collection just not implemented in the current release of MonetDB/XQuery? I would be glad if someone could give me a hint! It's so confusing... Thank you! Regards, Andreas Meinl [1] http://monetdb.cwi.nl/projects/monetdb/XQuery/QuickTour/DOCMGT/ index.html#openall

4 10

[MonetDB-users] Compile: buildtools -> hard, MonetDB -> fails
by Stefan Klinger 17 Jul '08

17 Jul '08

Hello, it took me quite a while to compile the build tools, since the make process failed without any meaningful error messages, but I cannot build Monetdb. I'd expect the configure script to fail with a descriptive error message if required packages (in my case 'libtool', 'flex') are missing. > prefix="${HOME}/opt/MonetDB" > cvs -d:pserver:anonymous@monetdb.cvs.sourceforge.net:/cvsroot/monetdb checkout buildtools [...] > pushd buildtools > ./bootstrap [...] ./bootstrap: line 29: libtoolize: command not found [...] The message about a missing 'libtoolize' is easily overlooked, and configure was running fine anyway: > ./configure --prefix="${prefix}" [...] But the make fails > make [...] /tmp/sk/2/buildtools/mel/mel.yy:331: undefined reference to `mel_yyerror(char const*)' [...] make: *** [all] Error 2 In case you don't know that 'yyerror' hints at flex, you're lost. Well, I figured that out and went on: > make install > popd Then I tried to continue with MonetDB: > cvs -d:pserver:anonymous@monetdb.cvs.sourceforge.net:/cvsroot/monetdb checkout MonetDB > pushd MonetDB > ./bootstrap automake 1.10.1 is 1.7 or newer. Good. autoconf 2.61 is 2.57 or newer. Good. libtool 1.5.26Debian1.5.26-4 is 1.4 or newer. Good. Python 2.5.2 is 2.0.0 or newer. Good. Traceback (most recent call last): File "/home/sk/opt/MonetDB/bin/autogen.py", line 29, in <module> from autogen import am ImportError: No module named autogen Now this leaves me completely clueless... Any help wouldbe appreciated. Kind regards, Stefan -- Stefan Klinger o/klettern /\/ bis zum send plaintext only - max size 32kB - no spam \ Abfallen http://stefan-klinger.de

3 3

[MonetDB-users] mserver5 seg fault
by mark 14 Jul '08

14 Jul '08

i have over 6gb free space, but it crashes like this.. [mark@localhost ~]$ sudo mserver5 # MonetDB server v5.7.0, based on kernel v1.25.0 # Serving database 'demo' # Compiled for i686-redhat-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) !ERROR: BATSIGcrash: Mserver internal error (Segmentation fault), please restart. !ERROR: (One potential cause could be that your disk might be full...) [mark@localhost ~]$ df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup00-LogVol00 19G 12G 6.7G 63% / /dev/sda3 194M 19M 165M 10% /boot tmpfs 2.0G 1.1M 2.0G 1% /dev/shm /dev/sda2 50G 40G 9.9G 80% /mnt/c gvfs-fuse-daemon 19G 12G 6.7G 63% /home/mark/.gvfs

3 4

[MonetDB-users] creating database - monetdb not found
by mark 14 Jul '08

14 Jul '08

i installed MonetDB using yum and these packages were installed Installed: MonetDB.i686 0:1.25.0-1_Fedora9.oid32 MonetDB-client.i686 0:1.25.0-1_Fedora9.oid32 MonetDB-client-python.i686 0:1.25.0-1_Fedora9.oid32 MonetDB-testing.i686 0:1.25.0-1_Fedora9.oid32 MonetDB5-server.i686 0:5.7.0-1_Fedora9.oid32 Dependency Installed: MonetDB-python.i686 0:1.25.0-1_Fedora9.oid32 now i want to create a database like in the documentation shell> monetdb create demo successfully created database 'demo' [mark@localhost ~]$ monetdb bash: monetdb: command not found what other packages do i need to install? thanks

2 2

[MonetDB-users] Repeated database corruption - v2.24.0
by Kirk Abbott 13 Jul '08

13 Jul '08

Hello, I am using Monetdb on Windows XP (see the server specs below). Unfortunately, I seem to corrupt the database very frequently involving a complete removal of the MonetDB5 directory (and all associated work). Corruption seems to occur if I hit a Ctrl-C (say on a long running query). Questions: 1) Is this a problem only on Windows? or is it a problem with this version of the server? 2) Is there a better way to kill a long running query? Clearly, corrupting the entire database (it won't restart!) just by killing a query, does not confidence build Any ideas? Kirk. # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see C:\Program Files\CWI\MonetDB5\etc\monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.24.0 loaded >

2 2

[MonetDB-users] SQL Table partitioning in MonetDB
by Napoma 10 Jul '08

10 Jul '08

I have this problem... i have a table with 33.000.000 of records.. the table is named i_predicate with four columns as follows (oid, name, isubj, iobj)... i want to execute a physical partition on i-predicate respect to the values of name column.. in this way if i query i_predicate monetdb has to use only the respective partition with the respective value of name... does it exist a sql statement for creating partitions of i_predicate? does it exist a script for this partition on MonetDB? and if i create the partition... i have to define function to query correctly the partitions? Thanks -- View this message in context: http://www.nabble.com/SQL-Table-partitioning-in-MonetDB-tp18384206p18384206… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] PF: warning: query will always return an error
by Ying Zhang 10 Jul '08

10 Jul '08

Hello, In stable branch + milprint_summer, executing the following query (you need to have a "hello.xml" doc shredded in collection "hello"): let $path := 'backup/test/hello/' let $index := element documents { for $document at $pos in pf:documents('hello') let $uri := concat($path, string(10000 + (($pos div 10000)) cast as xs:integer), '/', string($pos) , '.xml') return (text { "
 " }, element document { attribute uri {$uri}, $document/text() }), text { "
" } } return (put($index, concat($path,'documents.xml')), for $document in $index/document return put(exactly-one(doc(string($document))), exactly-one($document/@uri))) Results in the first 'put' is done, while the second 'put' is not executed, actually, the MIL code generated by 'pf' contains only translation of (the first) one 'put'. Also, the query gives a warning: query will always return an error If I comment out the first 'put', the second 'put' in the for-loop get executed, *without* the warning. Executing a similar query: (put(<a/>, "a.xml"), for $n in ("b.xml", "c.xml") return put(exactly-one(doc("hello.xml")), $n) ) also results in the warning, however, the generated MIL code contains translation of both 'put' and three documents are put in dbfarm. I'd like to know why the first query fails, and what has triggered the warning. Thanks a lot! Kind regards, Jennie

6 11

Re: [MonetDB-users] MonetDB/XQuery - Bug 1899258
by Ying Zhang 10 Jul '08

10 Jul '08

On Wed, Jul 09, 2008 at 06:29:08PM +0200, Andreas Meinl wrote: > Hi Ying Zhang, > > regarding bug 1899258 "PF: Error message with Administrative Console": I > still have the same problem, even with the current release of > MonetDB/XQuery, which I downloaded just today. The package is called > MonetDB4-XQuery-Installer-i386-20080624.msi. You have closed this bug on 20 > June 2008. How can I check which version of libxml2 I have installed (or, > is bundled with this release of MonetDB/XQuery)? I've attached two > screenshots with similar error messages. Thanks a lot! Hello Andreas, Given the second screenshot, it indeed looks like you are still having this problem. Is it true that if you click on one of the buttons for the first time, it will first hang for about 30 seconds, before you get this error message? In the current release, the Windows installer contains (should contain) an older version of libxml2 (2.6.30) due to this problem. So, this error should actually not happen. You can find the libxml2 DLL file in the lib directory of your installation dir, which is typically 'program files\cwi'. So please check you have the correct version of libxml2 in your installation. Regards, Jennie > > Regards, > > Andreas Meinl > > > > > >

1 0

[MonetDB-users] ODBC + non-ascii
by Pawel Lewicki 08 Jul '08

08 Jul '08

Hi, I don't know if problem is related to used interface (ODBC) but I have a problem with inserting non-ascii data. All data I insert seems broken. I started with 'utf-8' but tested 'cp1250' and 'iso8859-2' as well. No luck. All data I take back has broken non-ascii characters. Any clues? (Windows 32-bit "Jun 2008" release) Pawel Lewicki

2 4

[MonetDB-users] Update using two (2) tables
by Kirk Abbott 04 Jul '08

04 Jul '08

Hello, I am having trouble with the syntax for doing an update using 2 tables. In postgres, one can do something like: update table1 set name = table2.name from table2 where table1.id = table2.id ; In oracle (it's something like) update table1 a set name = (select b.name from table2 b where a.id = b.id) ; What is the correct way to do this in MonetDb (as both of the above fail) Thanks, Kirk.

3 2

[MonetDB-users] XQ: inconsistency between fn:collection and pf:collection after a del-doc
by luc touraille 03 Jul '08

03 Jul '08

Hi, Currently working on a big project with MonetDB XQuery, I stumbled upon an awkward bug (unless it is a *very* perturbing feature): after deleting a document in a collection "myColl", using the function pf:del-doc, this document is still displayed when calling fn:collection("myColl"), and not when using pf:collection("myColl"). I assume the latter result is the expected one, so why is the first query displaying data that is not supposed to be in the database anymore ? Have I misunderstood something or is it a true bug (maybe related to the http://www.nabble.com/--monetdb-Bugs-1976341---XQ%3A-leftovers-after-deleti… bug #1976341 : leftovers after deleting a document ) ? N.B.: this problem occured with the Feb 2008 release; I tried to reproduce it with the Jun 2008 release, and this time it's the pf:collection() function that gave me the wrong results (the fn: one being unsupported yet). Greetings, Luc Touraille -- View this message in context: http://www.nabble.com/XQ%3A-inconsistency-between-fn%3Acollection-and-pf%3A… Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] New MonetDB Release
by Stefan Manegold 28 Jun '08

28 Jun '08

Dear MonetDB users and developers, The MonetDB team at CWI is pleased to announce the new "Jun2008" release of the MonetDB suite of programs. For MonetDB/XQuery, this release marks the roll forward from the old "milprint_summer"-based Pathfinder compiler to the new "Algebra"-based Pathfinder compiler. MonetDB/SQL has been extended with initial support for OpenGIS via the "Geom[etry]" extension module, aka. MonetDB/SQL/GIS. Additionally, the configure defaults for compilation from sources on Unix(-like) systems as well as the Windows installers have been cleaned-up. For more information, please see the detailed release notes at http://monetdb.cwi.nl/Development/Releases/Version4.24/ IMPORTANT NOTE: Before upgrading to the latest "Jun2008" release from any previous release of MonetDB, please make a dump of your database, and rename/move/backup the database directories (dbfarm, sql_logs, xquery_logs). After the upgrade, restore your database, again. Once you have checked and confirmed the correctness of the restore, you can delete the above renamed/moved/backed-up old database directories. For more information, please see the detailed release notes at http://monetdb.cwi.nl/Development/Releases/Version4.24/ The new release consists of the following packages: MonetDB Common 1.24.0 MonetDB Clients 1.24.0 MonetDB4 Server 4.24.0 MonetDB4 XQuery 0.24.0 MonetDB5 Server 5.6.0 MonetDB5 SQL 2.24.0 MonetDB5 Geom 0.4.0 monetdb-1.8-jdbc.jar There is of course also a new "Super Source Ball", a tarball containing the combined sources. All this is available on our SourceForge project page. See https://sourceforge.net/project/showfiles.php?group_id=56967 for the downloadable files. Enjoy! The MonetDB development team. -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[MonetDB-users] Python on Windows
by Kees Varekamp 27 Jun '08

27 Jun '08

Does anyone know how to get the Python libs running on Win XP? Tried it with latest trunk and release versions of Monet, and with Python 2.4 and 2.5 File "C:\Python25\lib\MonetDB\MapiLib.py", line 7, in <module> import _MapiLib ImportError: DLL load failed: The specified module could not be found. _MapiLib.pyd is there alright. Is this a version problem? Thanks, Kees

1 0

[MonetDB-users] MonetDB database size restrictions
by Sam Mason 19 Jun '08

19 Jun '08

Hi, I hope you don't get asked this question too often, I've had a look for FAQs but couldn't find anything obvious. I'm trying to load some data into MonetDB (built on a i386 Debian "etch" box from MonetDB-Feb2008-SuperBall.tar.bz2) and I'm getting strange problems. I've got a table with 11 columns (2 int, 5 varchar, 4 date) and about 38 million rows (the text file I want to pull in is 3.3GB). If I try COPYing the data in, Monet alternately stops making progress (the computer is reading from the disk slowly, so maybe it's just going to take a *long* time to finish) or crashes with the following message: !SQLException:importTable:failed to import table !ERROR: GDKload: cannot mmap(): name=24/2470, ext=tail.priv !OS: Cannot allocate memory !ERROR: GDKload failed: name=24/2470, ext=tail.priv If I try splitting the file into smaller pieces (about a gig each), things work and I end up with the data in the database. It would be nice to know why I needed to split the file up first. Now I've got the data in I tried running a few queries to make sure everything went OK. I'm getting some very strange results when doing aggregations. The following work: SELECT count(*) FROM source_livestock; +----------+ | count_ | +==========+ | 37898310 | +----------+ SELECT sex_code, count(*) FROM source_livestock GROUP BY sex_code; +----------+---------------+ | sex_code |count_sex_code | +==========+===============+ | M | 17505304 | | F | 20392997 | | null | 9 | +----------+---------------+ This last query came back amazingly quickly, about ten times faster than Postgres. Monet looks like a fairly amazing database if I can routinely expect queries to be this much faster. SELECT count(*); +--------------+ | single_value | +==============+ | 1 | +--------------+ but the following don't do what I'd expect: SELECT count(1); MAPI = monetdb@endemic:50001 ACTION= read_line QUERY = select count(1); ERROR = Connection terminated I'd expect to get a single row with a single value containing the number 1 from this query. And for the following query I'd expect to get the same, just with the result being zero. SELECT count(null); !syntax error, unexpected sqlNULL in: "select count(null" This is how I found the bug: SELECT sex_code, count(1) FROM source_livestock GROUP BY sex_code; !TypeException:user.s3_1[26]:'aggr.count_no_nil' undefined in: _36:bat[:any,:int] := aggr.count_no_nil(_35:bte, _31:bat[:oid,:oid], _32:bat[:oid,:oid]) !SQLException:sql.rsColumn:Cannot access descriptor !WARNING: BATdescriptor: range error 1 I've come to expect COUNT(*) and COUNT(1) as having the same semantics. But I may be missing something. SELECT sex_code, count(1+1) FROM source_livestock GROUP BY sex_code; !TypeException:user.s4_1[28]:'aggr.count_no_nil' undefined in: _39:bat[:any,:int] := aggr.count_no_nil(_38:bte, _32:bat[:oid,:oid], _33:bat[:oid,:oid]) +----------+---------------------+ | sex_code |sql_add_single_value | +==========+=====================+ | M | monetdb | +----------+---------------------+ This second one is particularly bad because I get an incorrect answer back. Any idea what I'm doing wrong? Thanks, Sam

2 13

[MonetDB-users] MonetDB Server dies on connect
by Robert Schumacher 17 Jun '08

17 Jun '08

Hello, i was evaluating MonetDB. Got the Server running finr on Windows XP x64. I created about 12 Tabled by using a JDBC Client, then the Server died instantly. Since then when I start the Server it dies asap when I either start the Windows Client or perform a JDBC connection. I get no error log, no message, nothing. Has anybody an idea how to get MonetDB to stop crashing on connect? Thanks, Robert Robert Schumacher, Senior Software Developer prevero Systems GmbH Landsberger Straße 154 80339 München Tel +49 89 455 77 - 0 Fax +49 89 455 77 - 200 Registergericht: Amtsgericht München, HRB 143809 -- Geschäftsführer: Matthias Thurner Bitte beachten Sie unsere Veranstaltungshinweise unter www.prevero.de

4 14

Re: [MonetDB-users] [Monetdb-developers] arrow keys not working in mclient in stable nightly
by Martin Kersten 16 Jun '08

16 Jun '08

Rt Ibmer wrote: > Hi - I use a SSH client to access my Fedora 8 core box. When I was using the RELEASE built I was able to use left/right/up/down/home/end keys within mclient to edit the line. For instance I could push up arrow to have it automatically cycle through the previous lines, and then use left arrow to move over to a part of the line and process to change it. > There have not been changes in that area. Running against the current also does not show the problem > That all worked fine under the RELEASE build. > > However now that I have built from source the nightly stable (as of a couple nights ago) I can no longer use these keys. For instance when I press UP arrow it simply adds "^[[A" to the line. Other arrow keys / home /end do something similar. > Nothing has changed in this area. I mostly use a Putty ssh client to access my machine and work with mclient. It works as expected. You may want to check the preference setting of the ssh client. > Not sure but I think something broke regarding this at some point between the released build and the stable nightly. Thanks. > > > > > > ------------------------------------------------------------------------- > Check out the new SourceForge.net Marketplace. > It's the best place to buy or sell services for > just about anything Open Source. > http://sourceforge.net/services/buy/index.php > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers >

2 1

Re: [MonetDB-users] replication in MonetDB
by Martin Kersten 15 Jun '08

15 Jun '08

Alexandru Toth wrote: > Hello, > > I'm the developer of Cubulus OLAP > (http://sourceforge.net/projects/cubulus/ ) . Hello Alexandru Welcome to the MonetDB user community. > > On the roadmap there is a hint about replication, coming in SQL 2.2 > (February 2008) release. Is it implemented ? If not, is it possible to use We have been experimenting with replication techniques. Some of the hooks have been included in the distribution. However, we are not yet satisfied and with the result. It remains on our R&D list to come up with a novel and efficient solution. > some existing software ex: http://dbreplicator.org/ Middleware solutions could potentially provide a short term solution. However, we don't know if they are powerful enough or require functionality currently not available in our JDBC driver. > > Or, is it possible to load data into "master", stop it, sync the > dbfarm to several slaves (into new directories), and re-start the > slaves with the new dbfarm path ? Of course, slaves are used as > read-only copies. ofcourse, provided you don't forget to copy the sql_logs as well. You can even instruct the server that the database is readonly. See the documentation : http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Storage-Modes.html regards, Martin > > -Alex > >

1 0

Re: [MonetDB-users] [Monetdb-developers] MonetDB Server dies on connect
by Martin Kersten 13 Jun '08

13 Jun '08

Sjoerd Mullender wrote: > Martin Kersten wrote: > >> Sjoerd, >> >> I was planning to try out the installers on my Vista machine. >> The previous version is v5.4.0 installed >> >> Uninstalling it gives the following error: >> There is a problem with this Windows Installer >> package. A program required for this install >> to complete could not be run. Contact your >> support personnel or package vendor. >> >> You want specific information, or should i manually >> remove the C:\Program Files\CWI/MonetDB5 >> > > Manually removing won't help unless you also edit the registry. > > My guess is that it complains about the uninstall of the ODBC driver. > Can you run > "C:\Program Files\CWI\MonetDB5\odbcinstall" /Uninstall > (I think that is the exact name) manually from a cmd window? > ran this program , which worked. However, uninstalling MonetDB still gives the same error.

2 1

[MonetDB-users] New default configure options for MonetDB
by Stefan Manegold 09 Jun '08

09 Jun '08

Dear MonetDB developer and users, For convenience of both developers and users as well as to comply even more with open source standards, we now set/use the following defaults for the configure options --enable-strict, --enable-assert, --enable-debug, --enable-optimize (Unless specified differently, the same defaults are used for both the "Stable" release branches and the "Current" development trunk.) When compiling from CVS sources (as mainly done by developers): strict=yes assert=yes debug=yes optimize=no (*) When compiling from packaged/distributed sources (i.e., tarballs) (as mainly done by users): strict=no assert=no debug=no optimize=no (*) For building binary distributions (RPMs, MSIs): strict=no assert=no debug=no optimize=yes With nightly testing for the "Stable" release branches: strict=yes assert=no debug=no optimize=yes With nightly testing for the "Current" development trunk: strict=yes assert=yes debug=no optimize=yes (*) IMPORTANT NOTE: Since "--enable-optimize=yes" is no longer the default for any case except binary packages, it is *strongly recommended* to (re)compile everything from scratch, *explicitly configured* with "--enable-debug=no --enable-optimize=yes", in case you want/need to run any performance experiments with MonetDB! (Please note: "--enable-X=yes" is equivalent to "--enable-X", and "--enable-X=no" is equivalent to "--disable-X".) Don't hesitate to ask in case you have any questions! Enjoy! Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [MonetDB-users] [Monetdb-developers] Fastest way to calculate median?
by Martin Kersten 08 Jun '08

08 Jun '08

Rt Ibmer wrote: > Hi - I have an int column with several million rows of data. What is the fastest way to write a query to get the median value of the column? Apparently there is no median() function in SQL. A web search revealed lots of various talk about using stored procedures and fancy functions. None of this looked like it would be very efficient. I searched these archives but didn't see a single mention of median. Thank you! > True, the complexity of the median() in essence requires a partial sort of the complete list. It is a member of a group of statistical functions. A feature request has been added to the list. > > > > > > ------------------------------------------------------------------------- > Check out the new SourceForge.net Marketplace. > It's the best place to buy or sell services for > just about anything Open Source. > http://sourceforge.net/services/buy/index.php > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers >

1 0

[MonetDB-users] Moving records from SQL Server to MonetDB
by Rt Ibmer 07 Jun '08

07 Jun '08

Hi All - I'm new to monetdb and it looks fantastic! I have about 2 millions rows of data that I'd like to export from SQL Server and import them into Monetdb so I can do some preliminary benchmarking. What is the best way to do this? The schemas are the same for SQL Server and MonetDB. So basically I'm looking for the best command to run on SQL Server to export the data in a format best suited for importing into MonetDB, and what is the command to then load the data into MonetDB? Thanks!

1 0

[MonetDB-users] [Fwd: RE: PROBLEM WITH MONETDB 5.0]
by Martin Kersten 07 Jun '08

07 Jun '08

-------- Original Message -------- Subject: RE: PROBLEM WITH MONETDB 5.0 Date: Sat, 7 Jun 2008 23:16:13 +0800 From: Tran Quoc Trung <tqtrung(a)comp.nus.edu.sg> To: 'Martin Kersten' <Martin.Kersten(a)cwi.nl> References: <38563.137.132.80.35.1212469981.squirrel(a)mysoc.nus.edu.sg> <4844E431.2090403(a)cwi.nl> <3363.137.132.80.35.1212475247.squirrel(a)mysoc.nus.edu.sg> <4844F364.70601(a)cwi.nl> Hi Mr. Martin, I have installed MonetDB both by using monetdb-install.h and following the document for expert in the website on Ubuntu 2.6 64-bits. I can use the MonetDB server and client. However, when writing a program (in C) to connect to MonetDB, I encounter the error that libMapi.so require libc-2.7.so (The libc in my system is libc-2.5.so). Are there any solution to handle this situation (b/c I restrict not to upgrade the libc due to using the common server with other project). Could you please help me to take a look at this. Thank you very much Trung. -----Original Message----- From: Martin Kersten [mailto:Martin.Kersten@cwi.nl] Sent: Tuesday, 3 June, 2008 3:32 PM To: tqtrung(a)comp.nus.edu.sg; Communication channel for MonetDB users Subject: Re: PROBLEM WITH MONETDB 5.0 tqtrung(a)comp.nus.edu.sg wrote: > Hi, > Thank you very much. I also guess the reason due to the size of the > operands. Currently, I am running on Linux Fedora Core 8, 32 bit. The > cardinality of the opearand s in the range 100,000 to 1,500,000 records. > the sizes themselves are not a problem, but the expected size of the join result could be. you could take a sample to see how it explodes (algebra.sample()) > Are there any other solutions if my machine could not play with those > queries. > Please help me to check it again. > > Thanks, > Trung > > > >> tqtrung(a)comp.nus.edu.sg wrote: >> >>> Dear all, >>> I am a PhD student at School of Computing, NUS, Singapore. Currently, I >>> used MonetDB as the DBMS to do some experiments. I issue a query with >>> about 10 joins, but the system responds with the following errors: >>> >>> >> Please inform us about the platform and distribution you are useing. >> >>> !MALException:algebra.join:GDKerror >>> !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv >>> !OS: Cannot allocate memory >>> >>> >> this typically is an error when the join algorithm can not allocated >> enough memory >> to hold the intermediate result. For example, on a 32-bit system this >> might cause >> a problem quickly. >> If the join result should fit in memory, then there might be a problem >> in the >> estimation of the intermediate size needed. For this we need more >> information, >> such as the cardinality of the operands and properties obtained by >> bat.info() >> >>> !ERROR: GDKload failed: name=45/4542, ext=head.priv >>> !ERROR: GDKload: cannot mmap(): name=45/4542, ext=tail.priv >>> !OS: Cannot allocate memory >>> !ERROR: GDKload failed: name=45/4542, ext=tail.priv >>> !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv >>> !OS: Cannot allocate memory >>> !ERROR: GDKload failed: name=45/4542, ext=head.priv >>> !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv >>> !OS: Cannot allocate memory >>> !ERROR: GDKload failed: name=45/4542, ext=head.priv >>> !ERROR: GDKload: cannot mmap(): name=44/4401, ext=tail.priv >>> !OS: Cannot allocate memory >>> !ERROR: GDKload failed: name=44/4401, ext=tail.priv >>> >>> I also try to change the parameter in monetdb5.conf about the memory: >>> gdk_maxsize and gdk_vm_minsize but it still does NOT work. >>> >>> >> please don't play with these settings. They only control a thread for >> flushing dirty pages to disk. >> >>> Could you please help me to figure out which parameters I could change >>> to >>> make it work. >>> >>> Thank you very much >>> Trung >>> >>> >>> >> > >

1 0

[MonetDB-users] [Fwd: Re: php extension]
by Martin Kersten 06 Jun '08

06 Jun '08

-------- Original Message -------- Subject: Re: php extension Date: Fri, 6 Jun 2008 11:20:39 +1200 From: Kees Varekamp <kees.varekamp(a)gmail.com> To: Sjoerd Mullender <sjoerd(a)acm.org> CC: Niels Nes <Niels.Nes(a)cwi.nl>, monet(a)cwi.nl, Sjoerd Mullender <Sjoerd.Mullender(a)cwi.nl> References: <d8981ee0806042218l13609c8an47065c5b9a8354e9(a)mail.gmail.com> <20080605054117.GA350(a)cwi.nl> <4847D4D4.8020608(a)acm.org> <d8981ee0806050543w19dd0028gbb9327c5378549b1(a)mail.gmail.com> <4847EEFD.8080102(a)acm.org> Tnx. Na een herstart doet ie het! Groeten, Kees 2008/6/6 Sjoerd Mullender <sjoerd(a)acm.org <mailto:sjoerd@acm.org>>: Kees Varekamp wrote: > Bedankt! Hij start nu, ik ben weer een stap verder. > > Krijg nu een *Warning*: monetdb_connect() [function.monetdb-connect > <http://localhost/monet/function.monetdb-connect>]: Unable to connect to > MonetDB server: gethostbyname failed > > Het voorbeeldje op de website > (http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/The-PHP-Library.ht…) > connect als volgt: > $db = monetdb_connect('sql', 'localhost', 50000, 'monetdb','monetdb') > > De synopsis eronder vermeldt echter: > monetdb_connect([string host [, string port [, string username [, string > password [, string language]]]]] > > Beide returnen bovenstaande foutmelding (zowel met localhost als met > 127.0.0.1 <http://127.0.0.1> <http://127.0.0.1>). Welke is juist? En klopt het dat ik in > principe de php_pgsql.dll functies kan vertalen naar Monet functies? > > Het is niet kritiek trouwens, if all else fails zet ik een Linux machine op. Het ziet ernaar uit dat de synopsis niet correct is en de volgorde van de argumenten inderdaad is zoals in dat voorbeeld. Ik heb dit ook net geprobeerd en het werkt. De hostnaam wordt met de C functie gethostbyname vertaald. Zowel de string 'localhost' als '127.0.0.1 <http://127.0.0.1>' zou moeten werken, maar het ligt aan je Windows installatie. Je kunt experimenteren met php -a (in een cmd window) en dan: php > print gethostbyname('localhost'); Dat zou 127.0.0.1 <http://127.0.0.1> moeten printen. Je kunt ook de file c:\windows\system32\drivers\etc\hosts bekijken om te zien of er een entry in staat voor localhost. -- Sjoerd Mullender

1 0

Re: [MonetDB-users] PROBLEM WITH MONETDB 5.0
by Martin Kersten 03 Jun '08

03 Jun '08

tqtrung(a)comp.nus.edu.sg wrote: > Hi, > Thank you very much. I also guess the reason due to the size of the > operands. Currently, I am running on Linux Fedora Core 8, 32 bit. The > cardinality of the opearand s in the range 100,000 to 1,500,000 records. > the sizes themselves are not a problem, but the expected size of the join result could be. you could take a sample to see how it explodes (algebra.sample()) > Are there any other solutions if my machine could not play with those > queries. > Please help me to check it again. > > Thanks, > Trung > > > >> tqtrung(a)comp.nus.edu.sg wrote: >> >>> Dear all, >>> I am a PhD student at School of Computing, NUS, Singapore. Currently, I >>> used MonetDB as the DBMS to do some experiments. I issue a query with >>> about 10 joins, but the system responds with the following errors: >>> >>> >> Please inform us about the platform and distribution you are useing. >> >>> !MALException:algebra.join:GDKerror >>> !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv >>> !OS: Cannot allocate memory >>> >>> >> this typically is an error when the join algorithm can not allocated >> enough memory >> to hold the intermediate result. For example, on a 32-bit system this >> might cause >> a problem quickly. >> If the join result should fit in memory, then there might be a problem >> in the >> estimation of the intermediate size needed. For this we need more >> information, >> such as the cardinality of the operands and properties obtained by >> bat.info() >> >>> !ERROR: GDKload failed: name=45/4542, ext=head.priv >>> !ERROR: GDKload: cannot mmap(): name=45/4542, ext=tail.priv >>> !OS: Cannot allocate memory >>> !ERROR: GDKload failed: name=45/4542, ext=tail.priv >>> !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv >>> !OS: Cannot allocate memory >>> !ERROR: GDKload failed: name=45/4542, ext=head.priv >>> !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv >>> !OS: Cannot allocate memory >>> !ERROR: GDKload failed: name=45/4542, ext=head.priv >>> !ERROR: GDKload: cannot mmap(): name=44/4401, ext=tail.priv >>> !OS: Cannot allocate memory >>> !ERROR: GDKload failed: name=44/4401, ext=tail.priv >>> >>> I also try to change the parameter in monetdb5.conf about the memory: >>> gdk_maxsize and gdk_vm_minsize but it still does NOT work. >>> >>> >> please don't play with these settings. They only control a thread for >> flushing dirty pages to disk. >> >>> Could you please help me to figure out which parameters I could change >>> to >>> make it work. >>> >>> Thank you very much >>> Trung >>> >>> >>> >> > >

1 0

Re: [MonetDB-users] PROBLEM WITH MONETDB 5.0
by Martin Kersten 03 Jun '08

03 Jun '08

tqtrung(a)comp.nus.edu.sg wrote: > Dear all, > I am a PhD student at School of Computing, NUS, Singapore. Currently, I > used MonetDB as the DBMS to do some experiments. I issue a query with > about 10 joins, but the system responds with the following errors: > Please inform us about the platform and distribution you are useing. > !MALException:algebra.join:GDKerror > !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv > !OS: Cannot allocate memory > this typically is an error when the join algorithm can not allocated enough memory to hold the intermediate result. For example, on a 32-bit system this might cause a problem quickly. If the join result should fit in memory, then there might be a problem in the estimation of the intermediate size needed. For this we need more information, such as the cardinality of the operands and properties obtained by bat.info() > !ERROR: GDKload failed: name=45/4542, ext=head.priv > !ERROR: GDKload: cannot mmap(): name=45/4542, ext=tail.priv > !OS: Cannot allocate memory > !ERROR: GDKload failed: name=45/4542, ext=tail.priv > !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv > !OS: Cannot allocate memory > !ERROR: GDKload failed: name=45/4542, ext=head.priv > !ERROR: GDKload: cannot mmap(): name=45/4542, ext=head.priv > !OS: Cannot allocate memory > !ERROR: GDKload failed: name=45/4542, ext=head.priv > !ERROR: GDKload: cannot mmap(): name=44/4401, ext=tail.priv > !OS: Cannot allocate memory > !ERROR: GDKload failed: name=44/4401, ext=tail.priv > > I also try to change the parameter in monetdb5.conf about the memory: > gdk_maxsize and gdk_vm_minsize but it still does NOT work. > please don't play with these settings. They only control a thread for flushing dirty pages to disk. > Could you please help me to figure out which parameters I could change to > make it work. > > Thank you very much > Trung > >

1 0

[MonetDB-users] Is it possible getting types IN params or result set?
by Marc Weber 29 May '08

29 May '08

Hi, I'd like to work on embedding query statements into the haskell language by using template haskell to automatically derive insert and select functions having proper types automatically. sqli for Java already does it. resulting in something as: (rows :: [ (Int, String) ]) = $( select "SELECT intV, stringV FROM table") $( ) means a function is automatically created returning a list of tules of type (Int, String). Because haskell is strongly typed the function select creating the the type safe function must get to know which type the query will return. When using INSERT statements it would be nice to also now which type of parameters have to be passed. Does MonetDB provide kind of query function WhichInOutTypesDoesQueryHave("SELECT ..") or WhichInOutTypesDoesQueryHave("INSERT INTO FOO (abc,def) VALUES (?,?)") This way syntax and semantics could be checked at compile time. Sincerly Marc Weber

3 5

[MonetDB-users] /bin/bash: ../Mx/Mx: No such file or directory
by Ying Zhang 28 May '08

28 May '08

Dear all, I'm trying to compile monet on my laptop But I already get a problem when I 'make' in buildtools: ../Mx/Mx -x C /home/jennie/monet/current/buildtools/mel/any_arg.mx /bin/bash: ../Mx/Mx: No such file or directory The directory Mx indeed contains too few files, but 'make' in Mx seems doing nothing: $ cd ../Mx $ ls config.log config.status Makefile mx_config.h stamp-h1 $ make make all-am make[1]: Entering directory `/home/jennie/scratch/monet-build/current/buildtools/build-debug/Mx' make[1]: Nothing to be done for `all-am'. make[1]: Leaving directory `/home/jennie/scratch/monet-build/current/buildtools/build-debug/Mx' $ ls config.log config.status Makefile mx_config.h stamp-h1 Sys. info: $ uname -a Linux 2.6.22-14-generic #1 SMP Tue Feb 12 07:42:25 UTC 2008 i686 GNU/Linux I did: bootstrap && configure && make && make install with the configure options: --prefix=$INSTALL_DIR --enable-strict --enable-assert --enable-debug --disable-optimize Does anyone have an idea why Mx is not generated by 'make'? Thanks! Jennie

2 1

Re: [MonetDB-users] (no subject)
by Martin Kersten 27 May '08

27 May '08

Yeo Yvonne wrote: > Dear Sir, > > I would like to find out more about MONETDB and the diffenerces > betwwen ORacle and MONETBD? Dear Yeo This is a question of comparing apples and oranges ;) There is no document available to compare the systems. Please have a look at the introductionary sections of the MonetDB manual. The rest is a study by itself. regards, Martin > > Thanks. > > With Regards, > Yvonne Yeo. >

3 2

[MonetDB-users] fedora core 9 repo or rpms?
by mobiledreamers＠gmail.com 23 May '08

23 May '08

Please share fc9 repos or how do we install monetdb in fc9 sudo yum -c /tmp/MonetDB-Stable-Fedora.repo resolvedep http://monetdb.cwi.nl/testing/projects/monetdb/Stable/.DailyBuilds./0_lates…: [Errno 14] HTTP Error 404: Not Found Trying other mirror. Error: Cannot retrieve repository metadata (repomd.xml) for repository: MonetDB-Stable. Please verify its path and try again *Forcing to use the 8 repo in 9 gives these errors* sudo yum -c /tmp/MonetDB-Release-Fedora.repo install MonetDB5-server MonetDB MonetDB-SQL-server5 Setting up Install Process Parsing package install arguments Resolving Dependencies --> Running transaction check ---> Package MonetDB.i386 0:1.22.0-1.fc8.oid32 set to be updated --> Processing Dependency: libssl.so.6 for package: MonetDB --> Processing Dependency: libcrypto.so.6 for package: MonetDB ---> Package MonetDB5-server.i386 0:5.4.0-1.fc8.oid32 set to be updated --> Processing Dependency: libssl.so.6 for package: MonetDB5-server --> Processing Dependency: MonetDB-client >= 1.22 for package: MonetDB5-server --> Processing Dependency: libcrypto.so.6 for package: MonetDB5-server --> Processing Dependency: libMapi.so.0 for package: MonetDB5-server ---> Package MonetDB-SQL-server5.i386 0:2.22.0-1.fc8.oid32 set to be updated --> Running transaction check ---> Package MonetDB-client.i386 0:1.22.0-1.fc8.oid32 set to be updated --> Processing Dependency: libssl.so.6 for package: MonetDB-client --> Processing Dependency: libcrypto.so.6 for package: MonetDB-client ---> Package MonetDB.i386 0:1.22.0-1.fc8.oid32 set to be updated --> Processing Dependency: libssl.so.6 for package: MonetDB --> Processing Dependency: libcrypto.so.6 for package: MonetDB ---> Package MonetDB5-server.i386 0:5.4.0-1.fc8.oid32 set to be updated --> Processing Dependency: libssl.so.6 for package: MonetDB5-server --> Processing Dependency: libcrypto.so.6 for package: MonetDB5-server --> Finished Dependency Resolution MonetDB-client-1.22.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libcrypto.so.6 is needed by package MonetDB-client-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB5-server-5.4.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libssl.so.6 is needed by package MonetDB5-server-5.4.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB5-server-5.4.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libcrypto.so.6 is needed by package MonetDB5-server-5.4.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB-1.22.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libssl.so.6 is needed by package MonetDB-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB-1.22.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libcrypto.so.6 is needed by package MonetDB-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB-1.22.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libcrypto.so.6 is needed by package MonetDB-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB5-server-5.4.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libssl.so.6 is needed by package MonetDB5-server-5.4.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB-client-1.22.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libssl.so.6 is needed by package MonetDB-client-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB5-server-5.4.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libcrypto.so.6 is needed by package MonetDB5-server-5.4.0-1.fc8.oid32.i386 (MonetDB-Release) MonetDB-1.22.0-1.fc8.oid32.i386 from MonetDB-Release has depsolving problems --> Missing Dependency: libssl.so.6 is needed by package MonetDB-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) Error: Missing Dependency: libcrypto.so.6 is needed by package MonetDB5-server-5.4.0-1.fc8.oid32.i386 (MonetDB-Release) Error: Missing Dependency: libssl.so.6 is needed by package MonetDB-client-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) Error: Missing Dependency: libssl.so.6 is needed by package MonetDB5-server-5.4.0-1.fc8.oid32.i386 (MonetDB-Release) Error: Missing Dependency: libcrypto.so.6 is needed by package MonetDB-client-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) Error: Missing Dependency: libcrypto.so.6 is needed by package MonetDB-1.22.0-1.fc8.oid32.i386 (MonetDB-Release) Error: Missing Dependency: libssl.so.6 is needed by package MonetDB-1.22.0-1.fc8.oid32.i386 (MonetDB-Release)

2 1

[MonetDB-users] MonetDB users
by Seth Grimes 23 May '08

23 May '08

Hello all, I've just joined the list to learn more about use of MonetDB. The DBMS looks quite interesting. Who's using it outside the research community at CWI? For what type and size of applications? Thanks, Seth -- Seth Grimes Alta Plana Corp, analytical computing & data management Intelligent Enterprise magazine (CMP), Contributing Editor grimes(a)altaplana.com http://altaplana.com 301-270-0795

1 0

[MonetDB-users] deep-equals function
by luc touraille 21 May '08

21 May '08

Hi everyone, I was wondering if the deep-equals function, described in the http://www.w3.org/TR/xpath-functions/#func-deep-equal W3C XQuery functions spec , was planned to be supported soon in MonetDB/XQuery. I saw on the CVS repository that the latest files of pathfinder included its signature, but I can't find its implementation. Can anyone enlighten me ? Thanks, Luc -- View this message in context: http://www.nabble.com/deep-equals-function-tp17364244p17364244.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Data Compression Algorithms
by Veneta Dobreva 20 May '08

20 May '08

Hello, I have the following question about MonetDB: does MonetDB implement some data compression algorithms? I would like to use an RLE (run-length encoding) algorithm for compression of my data. Is this already implemented in MonetDB? Thank you in advace for your help! Regards, Veneta Dobreva -- Dipl.-Inf. Veneta Dobreva Lehrstuhl Informatik III Tel.: ++49 (0)89 289-17288 Fakultät für Informatik Fax: ++49 (0)89 289-17263 TU München, Raum 02.11.041 MI veneta.dobreva(a)in.tum.de http://www-db.in.tum.de/~dobreva/

2 1

[MonetDB-users] MonetDB V 4.22 installation on Mac OS X 10.5.2 and Mac OS X 10.4.0.
by Irini Fundulaki 18 May '08

18 May '08

Hi, I have the following problems with MonetDB XQuery Release Feb 2008, V. 4.22 on Mac OS X 10.5.2 and Mac OS X 10.4.0. 1) Mac OS X 10.5.2: a) I was not able to install MonetDB from sources. I downloaded MonetDB-Feb2008-SuperBall.bz2 and followed the instructions in http://monetdb.cwi.nl/projects/monetdb//MonetDB/Documentation/Linux-Install…. I successfully installed MonetDB, clients and MonetDB4-server, but when installing MonetDB4-XQuery I had the following error: Undefined symbols: "_embedded_mil", referenced from: _main in prog.o ld: symbol(s) not found collect2: ld returned 1 exit status make[5]: *** [Mbeddedxq] Error 1 make[4]: *** [all] Error 2 make[3]: *** [all-recursive] Error 1 make[2]: *** [all] Error 2 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 b) by calling monetdb-install.sh. MonetDB was installed with no problems. Nevertheless, mclient with a simple query (e.g., <example>hello</example) stalled. Mserver stalled when executing xmldb_print(); 2) Mac OS X 10.4.0 a) I was able to install MonetDB XQuery Release Feb 2008, V. 4.22 using monetdb-install.sh. Mserver did not stall with xmldb_print(). mclient for the same query exhibited different behaviors: that is, sometimes it stalled, and others not (again, the same simple query as before). I had downloaded MonetDB on September 2007, and installed it on Mac OS X 10.4.0. I had no problem with that version. Thanks for looking into it, Irini

2 1