- users-list - monetdb.org

[MonetDB-users] Restore db on different platform / OID size
by Sander Kruseman 15 Apr '11

15 Apr '11

When attempting to restore a db dump, made on Windows 7 with 32 bits sized object ID's, on OSX with 64 bits sized object ID's, I run into errors. Like: CREATE FUNCTION: name 'env' already in use If I tweak the dump script by first dropping the functions that appear to exist, I get stuff like: ' from line 1 field 5 not inserted, expecting type real failed to import table Should what I try to do be possible anyway? Am I doing anything wrong? Thanks for your feedback. Sander Kruseman

2 1

[MonetDB-users] bulk upload data
by Nic Chidu 14 Apr '11

14 Apr '11

What way do you suggest for bulk uploading data? Thanks. Nic

3 2

[MonetDB-users] documentation on metadata statement
by Nic Chidu 13 Apr '11

13 Apr '11

Where can I find doc about metadata statements. Stuff like showing database, table, running environment. Thanks, Nic

2 1

[MonetDB-users] Series UPDATE statements will significantly decrease server performance
by Vladimir Vlach 13 Apr '11

13 Apr '11

Hi, We are experiencing performance issue with MonetDB when running UPDATE. We have a table with 1M rows and 3.000 columns. All columns except primary_id are FLOAT type. When I execute series of these statements the performance on first 30-35 statements is quite acceptable (less then 1s) but then suddenly it gets really slow. One UPDATE takes 30 seconds or more. After next 5-10 statements the performance decreases and one UPDATE takes 1 minute or longer. We run this with AutoCommit. The behavior is very persistent. UPDATE table SET column=column+1 WHERE primary_id='e1a7d7c7204c292e56e942dbdad118d3' ; Would you say MonetDB is not suitable for bulk UPDATE operations? Thanks, Vlad

1 0

[MonetDB-users] UPDATE INNER JOIN syntax
by Osmin Castillo 12 Apr '11

12 Apr '11

Hi guys: How can I to update a table field based on a inner join update? What's the syntax for MonetDB? thanks in advance Osmin Castillo

2 1

[MonetDB-users] How to recover Database after crash
by Vladimir Vlach 11 Apr '11

11 Apr '11

Hi, is there guide on how to recover DB after server crash? I get following error: root@monetdb:/var/monetdb5/dbfarm# monetdb release vlad_a-f taken database out of maintenance mode: vlad_a-f root@monetdb:/var/monetdb5/dbfarm# monetdb start vlad_a-f starting database 'vlad_a-f'... FAILED start: starting 'vlad_a-f' failed: database 'vlad_a-f' appears to shut itself down after starting, check merovingian's logfile for possible hints root@monetdb:/var/monetdb5/dbfarm# tail /var/log/monetdb/merovingian.log 2011-04-11 11:40:53 MSG merovingian[2477]: starting database 'vlad_a-f', up min/avg/max: 2s/1h/15h, crash average: 0.00 0.30 0.20 (18-12=6) 2011-04-11 11:40:53 MSG vlad_a-f[2783]: arguments: /usr/bin/mserver5 --config=/etc/monetdb5.conf --dbname=vlad_a-f --set merovingian_uri=mapi:monetdb://monetdb:50000/vlad_a-f --set mapi_open=false --set mapi_port=0 --set mapi_usock=/var/monetdb5/dbfarm/vlad_a-f/.mapi.sock --set monet_vault_key=/var/monetdb5/dbfarm/vlad_a-f/.vaultkey --set monet_daemon=yes 2011-04-11 11:40:53 ERR vlad_a-f[2783]: !FATAL: BBPinit: could not write bat/BBP.dir 2011-04-11 11:40:53 MSG merovingian[2477]: database 'vlad_a-f' (2783) has exited with exit status 1 2011-04-11 11:41:02 ERR control[2477]: (local): failed to fork mserver: database 'vlad_a-f' appears to shut itself down after starting, check merovingian's logfile for possible hints Is there a procedure how to recover this? Thanks, Vlad

3 3

[MonetDB-users] Temporary tables
by Charalampos Nikolaou 10 Apr '11

10 Apr '11

Hi, this page (http://monetdb.cwi.nl/SQL/Documentation/Table-Definition.html) states that only the LOCAL TEMPORARY scope of SQL is implemented. Considering the following interaction with in mclient, it does not seem that is implemented at all. Am I missing something here or it is a bug? sql>CREATE LOCAL TEMPORARY TABLE transaction_statements ( ctx INTEGER NOT NULL, subj INTEGER NOT NULL, pred INTEGER NOT NULL, obj INTEGER NOT NULL, expl BOOL NOT NULL ); operation successful sql>INSERT INTO transaction_statements (ctx, subj, pred, obj, expl) VALUES (0, 1, 2, 805306369, 1); 1 affected row (10.450ms) sql>SELECT * FROM transaction_statements; +-----+------+------+-----+------+ | ctx | subj | pred | obj | expl | +=====+======+======+ +-----+------+------+-----+------+ 0 tuples (1.490ms) sql>SELECT * FROM tmp.transaction_statements; +-----+------+------+-----+------+ | ctx | subj | pred | obj | expl | +=====+======+======+ +-----+------+------+-----+------+ 0 tuples (1.443ms) sql>SELECT * FROM tmp._tables; +------+------------------------+------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+------+-------+------+-------+ | id | name | sche | query | type | syste | comm | reado | : : : ma_i : : : m : it_a : nly : : : : d : : : : ctio : : : : : : : : : n : : +======+========================+======================================================================+======+=======+======+=======+ | 5678 | transaction_statements | 2103 | null | 0 | false | 1 | false | +------+------------------------+------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+------+-------+------+-------+ 1 tuple (2.013ms) Thanks, Babis

2 1

[MonetDB-users] build failed on undefined crypt references
by Sander Kruseman 10 Apr '11

10 Apr '11

Hi, Building from recent tar.bz2 (11.1.1) on Linux/x86_64 I get: libtool: link: gcc -g -O2 -Wno-declaration-after-statement -D_REENTRANT -o .libs/mclient mclient.o ReadlineTools.o -pthread -Wl,--export-dynamic ./.libs/libmcutil.a ../mapilib/.libs/libmapi.so /var/scratch/sander/MonetDB-11.1.1/common/stream/.libs/libstream.so ../../common/stream/.libs/libstream.so -lbz2 -lreadline -ltermcap -lcrypt -pthread -Wl,-rpath -Wl,/usr/local/lib ../mapilib/.libs/libmapi.so: undefined reference to `MD5' ../mapilib/.libs/libmapi.so: undefined reference to `SHA224' ../mapilib/.libs/libmapi.so: undefined reference to `RIPEMD160' ../mapilib/.libs/libmapi.so: undefined reference to `SHA512' ../mapilib/.libs/libmapi.so: undefined reference to `SHA384' ../mapilib/.libs/libmapi.so: undefined reference to `SHA256' ../mapilib/.libs/libmapi.so: undefined reference to `SHA1' What could be causing this? Any help is much appreciated. Sander Kruseman

2 1

[MonetDB-users] How to access MonetDB in Javascript without XRPC/XQuery?
by dsuh 09 Apr '11

09 Apr '11

Now that XRPC/XQuery is being removed from the MonetDB source, are there any options for client-side browser Javascript access to SQL queries? Would it end up looking like using the PHP interface in the web server side and passing the results to the client-side Javascript? Exactly how would this look like? I am interested in using HTML5/Javascript on the client-side to create a mashup of different data including GIS information from MonetDB. Can anyone suggest possible solutions? David Suh

2 1

[MonetDB-users] history support in mclient across sessions
by Charalampos Nikolaou 07 Apr '11

07 Apr '11

Hi, does mclient support saving of commands in a history file and accessing them again in a future mclient session? Currently, there is a -H option, but it doesn't seem to work (Mar2011 release). Thanks, Babis

2 1

[MonetDB-users] Killing long running queries
by Ramkumarlak 06 Apr '11

06 Apr '11

Is there any way to know the current running queries (like mysql's "show full processlist"). Also is there any way of killing long running queries. -- View this message in context: http://old.nabble.com/Killing-long-running-queries-tp31276295p31276295.html Sent from the monetdb-users mailing list archive at Nabble.com.

3 5

Re: [MonetDB-users] [expath] Kudos on CXAN
by Christian Grün 05 Apr '11

05 Apr '11

…time for MonetDB to join up ;) ___________________________ On Tue, Apr 5, 2011 at 12:04 AM, Florent Georges <fgeorges(a)gmail.com> wrote: > On 3 April 2011 14:31, Chris Maloney wrote: > >> Florent, I suddenly realized this morning why you have the >> image that you do on the CXAN site -- it's a pronunciation >> hint! > > Good catch! > > For the others, the picture on the home page of CXAN > <http://cxan.org/beta/> is a painting of Paul Cezanne > <http://en.wikipedia.org/wiki/Paul_C%C3%A9zanne>, a French > painter. > > I hesitated with a self-portrait (this one is a portrait of > Victor Chocquet, dont ask me who he is), but I liked this one. > The hint is that the X is actually pronounced like a Z, to make > the name fluent (either a la French, with a C like in sailer, or > English style, with a C like in sea). > > Very good catch :-) > > -- > Florent Georges > http://fgeorges.org/ > > -- > You received this message because you are subscribed to the Google Groups "EXPath" group. > To post to this group, send email to expath(a)googlegroups.com. > To unsubscribe from this group, send email to expath+unsubscribe(a)googlegroups.com. > For more options, visit this group at http://groups.google.com/group/expath?hl=en.

1 0

[MonetDB-users] query dit not produce result set
by Bas Kaptijn 04 Apr '11

04 Apr '11

Hi, with the MAR2010 release (x64 windows through installer) (and also the release Feb2010-SP2) I get an exception running a particular query, whilst a slightly modified one with the expected result (except for the naming of a result column) does not. I narrowed the problem down to this: sql>CREATE TABLE dbg (a INT, b INT); operation successful sql>INSERT INTO dbg (a,b) VALUES (10,10); 1 affected row (32.410ms) sql>SELECT a as d, SUM(b), (2 * (SUM(b) / (SELECT 2))) as f FROM dbg GROUP BY d; +------+------+------+ | d | L451 | f | +======+======+======+ | 10 | 10 | 10 | +------+------+------+ 1 tuple (8.841ms) sql>SELECT a as d, SUM(b) as e, (2 * (SUM(b) / (SELECT 2))) as f FROM dbg GROUP BY d; sql> The second select query does not produce a result set (as stated in the SQLException I get when doing this through JDBC). The monetdb client just shows a new prompt without stating any warning/error. The query works when I remove the "as e" ... or the "select 2" but in the real case I get this problem this select does much more than just selecting the number 2. I think this is a bug. Or am I doing something that is not (yet) supported in MonetDB? Thanks Bas Kaptijn

2 1

[MonetDB-users] for help(software information is added)
by Xianmin Liu 31 Mar '11

31 Mar '11

Hi, Sorry for missing the software information in last letter. I used MonetDB4-XQuery-Installer-x86_64-20110324 version, it seems to be the latest. If you have read my last letter, pls ignore followings. I am testing the performance of MonetDB/XQuery over large data. I use a HP xw8600 workstation, with Intel(R) Xeon(R) CPU X5482 3.20GHz, and 32GB RAM. I generate XMark data as large as 50GB, using standard XMark generator with 500 factor. When I tried to load it into database using "pf:add-doc", error message returned as following. ERROR = !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0@0. !ERROR: [shred_url]: first error was: !ERROR: strPut: string heaps gets larger than 15GB. !ERROR: shredBAT_append_str: APPEND-STR[_prop_text]( !ERROR: catch fain deserves liking knee katharine easy hand helms daughter corn hire amaz plainness curtains staying excuse since tom walls thirty goodman twice corrections flesh behold woundl ess cargo royally zwagger nuncle season repair govern piercing sighs ounce arrest ganymede balthasar perjury !ERROR: ), BUNappend fails !ERROR: CMDshred_url: operation failed. Timer 2633290.282 msec Can you help me? How can I fix it? Thanks a lot. -- Xianmin Liu

2 2

[MonetDB-users] DROP TABLE IF EXISTS <table>;
by Michael Sioutis 31 Mar '11

31 Mar '11

Hello, I want to prevent an SQLException from occurring for tables that do not exist in my database. For example: sql>DROP TABLE "locked"; SQLException:sql.catalog:DROP TABLE: no such table 'locked' It seems (and is documented) that there is no such thing like "IF EXISTS" in MonetDB. Is there a way to circumvent the SQLException? Mike

5 8

Re: [MonetDB-users] for help(software information is added)
by Peter Boncz 31 Mar '11

31 Mar '11

Xianmin, On Windows we only build with 32bits oids (even with 64bits pointers). When working with 32-bits offsets string heaps are restricted to 16GB. For large data, we recommend 64-bits linux. Then grab a oid64 rpm. Peter From: Xianmin Liu [mailto:xianmliu@gmail.com] Sent: donderdag 31 maart 2011 11:09 To: monetdb-users(a)lists.sourceforge.net; Peter Boncz Cc: Wenfei Fan; Gao Cong; Nan Tang; Anastasios (Tasos) Kementsietsidis Subject: for help(software information is added) Hi, Sorry for missing the software information in last letter. I used MonetDB4-XQuery-Installer-x86_64-20110324 version, it seems to be the latest. If you have read my last letter, pls ignore followings. I am testing the performance of MonetDB/XQuery over large data. I use a HP xw8600 workstation, with Intel(R) Xeon(R) CPU X5482 3.20GHz, and 32GB RAM. I generate XMark data as large as 50GB, using standard XMark generator with 500 factor. When I tried to load it into database using "pf:add-doc", error message returned as following. ERROR = !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0@0. !ERROR: [shred_url]: first error was: !ERROR: strPut: string heaps gets larger than 15GB. !ERROR: shredBAT_append_str: APPEND-STR[_prop_text]( !ERROR: catch fain deserves liking knee katharine easy hand helms daughter corn hire amaz plainness curtains staying excuse since tom walls thirty goodman twice corrections flesh behold woundl ess cargo royally zwagger nuncle season repair govern piercing sighs ounce arrest ganymede balthasar perjury !ERROR: ), BUNappend fails !ERROR: CMDshred_url: operation failed. Timer 2633290.282 msec Can you help me? How can I fix it? Thanks a lot. -- Xianmin Liu

1 0

[MonetDB-users] for help
by Xianmin Liu 31 Mar '11

31 Mar '11

Hi, I am testing the performance of MonetDB/XQuery over large data. I use a HP xw8600 workstation, with Intel(R) Xeon(R) CPU X5482 3.20GHz, and 32GB RAM. I generate XMark data as large as 50GB, using standard XMark generator with 500 factor. When I tried to load it into database using "pf:add-doc", error message returned as following. ERROR = !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0@0. !ERROR: [shred_url]: first error was: !ERROR: strPut: string heaps gets larger than 15GB. !ERROR: shredBAT_append_str: APPEND-STR[_prop_text]( !ERROR: catch fain deserves liking knee katharine easy hand helms daughter corn hire amaz plainness curtains staying excuse since tom walls thirty goodman twice corrections flesh behold woundl ess cargo royally zwagger nuncle season repair govern piercing sighs ounce arrest ganymede balthasar perjury !ERROR: ), BUNappend fails !ERROR: CMDshred_url: operation failed. Timer 2633290.282 msec Can you help me? How can I fix it? Thanks a lot. -- Xianmin Liu

2 1

[MonetDB-users] DROP TABLE IF EXISTS <table>;
by Michael Sioutis 30 Mar '11

30 Mar '11

Hello, I want to prevent an SQLException from occurring for tables that do not exist in my database. For example: sql>DROP TABLE "locked"; SQLException:sql.catalog:DROP TABLE: no such table 'locked' It seems (and is documented) that there is no such thing like "IF EXISTS" in MonetDB. Is there a way to circumvent the SQLException? Mike

1 0

[MonetDB-users] How to determine size of a table and its indexes
by Nekas 30 Mar '11

30 Mar '11

In Oracle and MySQL for example, we can obtain the space occupied in the DB by tables and indexes in the user space. Is this possible in MonetDB? If so, how can I do it? I often need it, so it would be quite helpful to me. Thanks you in advance, Ana T.

1 2

[MonetDB-users] Announcement: New Mar2011 feature release of MonetDB suite
by Sjoerd Mullender 28 Mar '11

28 Mar '11

The MonetDB team at CWI/MonetDB BV is pleased to announce the Mar2011 feature release of the MonetDB suite of programs. This release marks the last planned release of MonetDB4 and Pathfinder, and hence the last planned release of MonetDB/XQuery. Development of the Pathfinder compiler continues at the University of Tübingen. The next release, currently planned for April 2011, should be a smooth upgrade from this release, even if MonetDB/XQuery is installed (which will of course then not be upgraded). This release also marks the first release of the new way of building the MonetDB suite. For details on both these issues, and on the other features and bug fixes of this release, please see the release notes at <http://monetdb.cwi.nl/Development/Releases/Mar2011/>. As usual, the download location is <http://dev.monetdb.org/downloads/>. -- Sjoerd Mullender

1 0

[MonetDB-users] Recycler Optimizer
by Henry Addington 24 Mar '11

24 Mar '11

Hello: I understand some of the optimizers/pipelines are experimental as indicated in the monetdb5.conf file. Has anyone used the Recycle pipeline for Skyserver? Would you mind sharing your experience, in terms of performance improvement and whether it can bet used in a production environment? We are using the Oct2010-SP1 release for a db that is read-only. I would guess if there are issues, I would think the problems would likely show up in read/write systems. Any feedback would be appreciated.... It looks like the Recycle pipeline for Skyserver pipeline is based on the Nov-2009 pipeline. Has anyone tried the recycler optimizer with the Feb2010 default pipeline? I was going to add "recycle" between "deadcode" and "reduce" in the default pipeline and see if it would work. Thanks. Henry

3 4

[MonetDB-users] ask for help
by Xianmin Liu 23 Mar '11

23 Mar '11

Hi, It's me again. Recently, I was doing some experiments using MonetDB/XQuery. And I asked one question about errors when loading XML data some days ago, Peter solved my problem very kindly. Now, there is an error again, pls help me. Following is my setting, CPU:Intel Core2 Duo CPU 2.93GHz, RAM:2.00GB System: Ubuntu 10.04 64bits MonetDB: setup by deb, serverV4.40.3 GDKv1.40.3, MonetDB/XQuery module 0.40.3 loaded. I used pf:add-doc to add data, the data size is 3GB(generated by xmark generator with factor 30), error returned: ERROR: !xquery> -- Xianmin Liu

2 1

[MonetDB-users] User-defined MAL functions
by Petros Tsialiamanis 22 Mar '11

22 Mar '11

Hi, I have some questions about using user-defined MAL functions I would like to create a function in MAL. 1) Is it possible that the function can take variable number of BATs as argument like in the case of algebra.joinPath(l:bat[:any,:any]... ) ? 2) If yes, how I can get the number of BATs passed as argument and 3) how I can get the n-th element of the argument? Thank you in advance Petros

2 1

[MonetDB-users] Some questions
by Henning Grosch 22 Mar '11

22 Mar '11

Hi everyone, I have a some questions about using monetDB. First thing I noticed when using extract on a timestamp field I can only cast the timestamp as year, month, day and so on. Is it somehow possible to extract the week of the year? Week starts with monday. Another thing is, can i use if statements in a query like i could in mysql? And the last one, i already searched in the archiv and found a post about win 32 odbc driver and column names which appear as questionmarks or other symbols like when using a wrong encoding, does anybody has the same problem or knows a solution? Regards Henning

1 0

Re: [MonetDB-users] ask for help
by Peter Boncz 21 Mar '11

21 Mar '11

Hi, You cannot load the 1G of data in the 32-bits windows version on MXQ. Simply won’t fit the virtual address space. Use the 64-bits version (best: use the 64-bits Linux version). Peter From: Xianmin Liu [mailto:xianmliu@gmail.com] Sent: Monday, March 21, 2011 2:11 PM To: monetdb-users(a)lists.sourceforge.net Cc: Nan Tang; Wenfei Fan Subject: [MonetDB-users] ask for help Hi, I got some errors when using MonetDB/XQuery, could you pls give me some help? I was running experiments over large XML data using MonetDB/XQuery. My hardware: CPU:Intel Core2 Duo CPU 2.93GHz, RAM:2.00GB MonetDB: Server v4.32.0 based on GDK v1.32.0, Compiled for i686-pc-win32/32bit, MonetDB/XQuery module v0.28.3 loaded (default back-end is 'algebra') When I try to load xmark1G.xml (generated by xmark generator with factor 10) by command 'pf:add-doc("H:\lxm\1G\xmark1000M.xml","xmark1G.xml")<>' Return errors: ERROR = !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0@0. !ERROR: [shred_url]: first error was: !ERROR: HEAPextend: failed to extend to 278712278 for 03\373theap !ERROR: shredBAT_append_str: APPEND-STR[_prop_text]( !ERROR: CMDshred_url: operation failed. -- Xianmin Liu

1 0