- users-list - monetdb.org

[MonetDB-users] monetsql except
by Lazaros Koromilas 18 Dec '09

18 Dec '09

i get a weird behavior on sql except. i'm have attached the except.* files from: cat except.sql | mclient -lsql > except.txt notice the tuple: [ 425, 719, "people", "person", NULL ] is returned in all 3 queries; shouldn't except prevent this? any help? i'm runnig on: MonetDB server v5.6.0 (32-bit), based on kernel v1.24.0 (32-bit oids) Copyright (c) 1993-2008 CWI, all rights reserved Visit http://monetdb.cwi.nl/ for further information Configured for prefix: /usr/local Libraries: libpcre: 7.9 2009-04-11 (compiled with 7.9) openssl: OpenSSL 0.9.8k 25 Mar 2009 (compiled with OpenSSL 0.9.8k 25 Mar 2009) Compiled by: root@redrawn Compilation: gcc -O2 -std=c99 Linking : /usr/bin/ld thanx, lazaros. -- http://www.ics.forth.gr/~koromil

3 4

[MonetDB-users] Announcement: New Nov2009-SP1 bugfix release of MonetDB suite
by Sjoerd Mullender 18 Dec '09

18 Dec '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the Nov2009-SP1 bug fix release of the MonetDB suite of programs. More information on this release will be available at <http://monetdb.cwi.nl/Development/Releases/Nov2009/>. Fixes include: - The Windows installers for MonetDB/SQL in the Nov2009 release were incomplete. The missing files have been added. - Fixed performance issue with loading complex schemas in readonly mode in MonetDB/SQL. - Fixed performance issue with grouping in MonetDB/SQL when one of the columns is sorted. - Fixed problems with LIKE joins in MonetDB/SQL. - Load all files in a multi-file COPY INTO query. - Fix error reporting of unexpected input in XQuery queries to be Unicode aware. - Correctly handle circular dependencies in FD property check. (SF bug #2908615.) - Fixes throughout the code base to better cope with unexpected situations (such as memory shortage). -- Sjoerd Mullender

1 0

[MonetDB-users] ODBC Driver
by Nafees Ur Rehman 17 Dec '09

17 Dec '09

Hi, thanks for helping me in enabling history. I want to connect monetDB with Microsoft SQLServer DM tool. I tried to register ODBC driver for monetDB and followed the instructions but no luck. I would appreciate if you can guide me on that. Please note I am running win xp. Regards Nafees Ur Rehman

2 1

[MonetDB-users] commercial support
by Alfred Nordman 16 Dec '09

16 Dec '09

Hi, The home page of Monetdb implies that there is a commercial support. Is there a contact person or email address which I can use in order to learn about this service? Thanks. Alfred. -- View this message in context: http://old.nabble.com/commercial-support-tp26814876p26814876.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] MonetDB & memory issues on Windows
by Alex Bo. 16 Dec '09

16 Dec '09

Hi, I have been using MonetDB on windows for a while now, and I have consistent problems with all versions up to Nov2009 with memory handling. I don't know if it's because I'm running on Windows, or because I'm doing something wrong, or maybe the problem is in MonetDB, but I cannot work with Monet for long periods of time without routinely restarting the server to free up memory. It seems that over time, MonetDBs memory consumption goes up and up, and eventually when running a heavy query when there's not much memory left, the server crashes. If, however, I restart the server once in a while, all memory is freed, and I can work for longer periods without any problems. So it seems that Monet on Windows has a problem in freeing resources. Some recources are only cleaned on stopping the server. This is true both for COPY INTO operations and for querying. I would appreciate it if you could point out to me how I should approach this. Is this a problem in Monet? Is this because I'm running on Windows? If so, which files can I look into in order to look for problems? -- View this message in context: http://old.nabble.com/MonetDB---memory-issues-on-Windows-tp26808719p2680871… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Remote connections & "merovingian"
by Venks 15 Dec '09

15 Dec '09

Can I connect remotely via JDBC using "merovingian"? In short, how will i set mapi_open = true using "merovingian"? -Venks

2 2

[MonetDB-users] Bulk load problem
by Raghav Kumar Gautam 14 Dec '09

14 Dec '09

Hi, I am a new user and I am trying to bulk load a very largefile. The following is intended for testing only: $ 7z e -so data.7z | head -n 100 | query "copy 100 RECORDS into data_table FROM STDIN USING DELIMITERS tuple_seperator '\r\n' record_seperator '\t';" And am getting the following error: MAPI = rk@localhost:50000 QUERY = copy 100 RECORDS into data_table FROM STDIN USING DELIMITERS tuple_seperator '\r\n' record_seperator '\t'; ERROR = !syntax error, unexpected IDENT, expecting STRING in: "copy 100 records into data_table from stdin using delimiters tuple_seperator" Timer 0.278 msec Can you tell me where am I going wrong ? With Regards, Raghav.

5 5

[MonetDB-users] enabling history
by Nafees Ur Rehman 14 Dec '09

14 Dec '09

Hi, I tried set history=true; statement to enable history, but it throws an exception that two functions are missing.I want to load these two functions but I don't have them in any of the directory of monetdb. Please note that I am running monetdb SQL on windows xp. I would highly appreciate your kind help. Regards Nafees Ur Rehman

3 2

[MonetDB-users] COPY INTO in Nov2009
by Alex Bo. 14 Dec '09

14 Dec '09

Hi, I saw that in the Nov2009 release the COPY INTO now uses multiples CPU/cores. Is this enabled by default, or should I enable this somehow? I am running on windows, and I don't see any difference in CPU behavior nor do I get time improvements. Thanks. -- View this message in context: http://old.nabble.com/COPY-INTO-in-Nov2009-tp26778392p26778392.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Multi Query Optimizer/Drill Down Benchmark
by Martin Dürre 11 Dec '09

11 Dec '09

Hello monetDB-Users, after installing monetDB( see sourceforge's bug tracker ;), I'm finally going to use it. Is there anyone around how can give me a short feedback on following topics: - Multi Query Optimizer - Drill Down Benchmark described in papers found at http://monetdb.cwi.nl/Development/Research/Articles/index.html Concrete questions are 1. Are Multi-Query Optimizing Approaches implemented in current versions of MonetDB(4 or 5). 2. Is the drill down benchmark still to be found somewhere (google says no), Maybe these questions are way to general, but I have to start somewhere. Thanks, Martin

2 1

[MonetDB-users] Concurrent user threads
by Vashti_Ragoonath＠ibi.com 10 Dec '09

10 Dec '09

Hi, I read in the SQL Reference Manual that "The number of concurrent user threads is a configuration parameter.", but no information on the name or location or how to change it. Nor is there any info on what the default might be. I tried running multiple users and noticed that the performance degradation increased dramatically as the load increased. I looked at the Server and SQL manuals without luck. Thanks, Tah

3 3

[MonetDB-users] file system usage
by Matthew Jones 10 Dec '09

10 Dec '09

Hey folks, I'm wondering if you can tell me how MonetDB manages its on-disk database. During normal operation I was seeing the database hovering at around 55G, after I stopped it to take a backup it was at 70G, but immediately after the restart it dropped down to 35G. 73, Matthew W. Jones (KI4ZIB) http://matburt.net

1 0

[MonetDB-users] lib_replication
by Vashti_Ragoonath＠ibi.com 10 Dec '09

10 Dec '09

Hi, I was able to load up and run the MonetDB5-SQL-Installer-x86_64-20091023.msi. However, when I tried the MonetDB5-SQL-Installer-x86_64-20091119.msi I received an error about the server failing to start because it could not find lib_replication.dll. There is no indication in the Readme.html that this has to be built and it's not in the 1119 package. I tried using the 1119 because I created some compressed files (gz files created with gzip) that I wanted to load using COPY INTO and read that this is supported on Windows in the 1119 version. In the 1123 version it generated an error when loading the GZ files about not being able to locate the files - a bogus error it seems since the file path was correct. I looked on Google, forums etc but no other reports. I reloaded the 1123 to make sure that was still working and it is. I hope I did not miss a basic step or something in which case I apologize profusely! Thanks, Tah

2 1

Re: [MonetDB-users] monetsql python and blobs
by Gijs Molenaar 10 Dec '09

10 Dec '09

On 12/09/2009 11:49 AM, Lazaros Koromilas wrote: > just a problem i encountered. > see attachment. > Thanks for the patch. I will test and include it. One question, why is the monetdb python API is such a strange location in your installation? Did you manually move it to MonetSQLdb? - gijs

1 0

[MonetDB-users] monetsql python and blobs
by Lazaros Koromilas 09 Dec '09

09 Dec '09

just a problem i encountered. see attachment. thanx, lazaros. -- http://www.ics.forth.gr/~koromil

1 0

[MonetDB-users] enabling history
by Nafees Ur Rehman 02 Dec '09

02 Dec '09

Hi, I am enabling history (set history=true;) but it gives me an exception that two procedures are not available. Can someone guide me on that? Regards Nafees Ur Rehman University of Konstanz

3 2

[MonetDB-users] Announcement: New Nov2009 feature release of MonetDB suite
by Stefan Manegold 30 Nov '09

30 Nov '09

Dear all, The MonetDB team at CWI/MonetDB BV are pleased to announce the new "Nov2009" feature release of the MonetDB suite of programs. This feature release is backward compatible with the previous releases (Nov2008 through Aug2009-SP2). Caveat 1: In MonetDB/XQuery, we extended and improved the use of value indices on comparisions between a value and an XPath ending in text() or attribute access (e.g., doc(x)//x/y[z/text() = "foo"] and for $x in doc//x/y where $x/@z = "bar" return $x); such queries do not need scanning data, but start at the index and navigate backwards from there. This required a change in the physical database storage. While the Nov2009 release of MonetDB/XQuery can still read older (pre-Nov2009) databases, it is recommended to (back-up and) re-shred all documents to benefit from the new indices and achieve optimal performance. Caveat 2: When upgrading from a release older than May2009 (i.e., Nov2008 through Feb2009-SP2), you need to move your write-ahead log following the "recommended" instructions for SQL (<http://monetdb.cwi.nl/Development/Releases/May2009/#SQL>) and/or XQuery (<http://monetdb.cwi.nl/Development/Releases/May2009/#XQuery>). More information on the new release is available at <http://monetdb.cwi.nl/Development/Releases/Nov2009/>. The sources and binaries are available at <http://monetdb.cwi.nl/Download/>. Enjoy! The MonetDB team at CWI/MonetDB BV. -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[MonetDB-users] SABAOTHgetMyStatus Too many open files
by Matthew Jones 29 Nov '09

29 Nov '09

Hey Folks, we are continuing to get deadlocks about once a day and I've noticed this in the logfile: 2009-11-28 14:31:05 ERR reporting_primary[31485]: !SABAOTHgetMyStatus: IOException:sabaoth.getStatus:Unable to open directory /opt/MonetDB5/dbfarm: Too many open files Not sure how many open files it had when it went south, but immediately after a restart I saw this in files-nr: # cat /proc/sys/fs/file-nr 1408 0 3164775 That third number being the 'files-max' on the system currently... I think that must be being dynamically set. This is with the latest release August2009-SP2, the net effect is a deadlock on all connections to merovingian and a segfault of the mserver process. Neils, this is what led up to that 'log' file being truncated in sql_logs a few days ago... this message occurred just before this happened. I've restarted my database and should see the problem reproduce itself again within 24 hours. I am recording the number of file descriptors in use every minute by mserver, merovingian, and overall for the system so I can know what the numbers were leading up to it. Is this a file descriptor leak in Monet or is my files-max set too low (even though it appears to be dynamic)? 73, Matthew W. Jones (KI4ZIB) http://matburt.net

1 0

[MonetDB-users] COPY INTO memory issues
by Andreas Streichardt 26 Nov '09

26 Nov '09

Hi, i had a look at monetdb a while (a year or so) ago and stumbled upon a few crashes/memory issues back then. Apart from that it made a very promising impression to me. Today i thought i could give it a try again to see if these issues have been fixed and found out that copy into still seems to have memory issues and i wonder if i am the only one who hits such issues. I am experimeting with dummy data created by a script. Data is created the following way: 20 smallints: Values 1-10. 100 tinyints: Values 0-1 20 ints: Values 1-10000 40 varchars: md5 of some random value 20 floats: rand(1000000)/1000000 I created a CSV file with ~2.1 million rows and then tried to insert the data. My first attempt was: sql>copy into md_data FROM '/home/mop/performance/hans.csv' delimiters ',','\n' null as ''; MAPI = monetdb@localhost:50000 ACTION= read_line QUERY = copy into md_data FROM '/home/mop/performance/hans.csv' delimiters ',','\n' null as ''; ERROR = Connection terminated This was of course the quick and dirty way. What happened in the background was that monetdb consumed all memory. My system is a debian lenny 64bit. Server has 4GB and decent CPUs. Why does it need all my memory here? I then did the same but loaded only parts of the file (1000000 rows). sql>copy 1000000 records into md_data FROM '/home/mop/performance/hans.csv' delimiters ',','\n' null as '' ; This worked but the server used ~2-3GB of my RAM during the process and what's even more important it used the same amount even though the copy process finished. Why does it use the RAM even though it is not used anymore? Then i tried to insert 1000000 rows more and my expectation was that monetdb would reuse the memory it allocated (and didn't free) in the first loading process. This wasn't the fact. Again monetdb consumed all my memory and when loading finished it indicated that it was still doing something (CPU @ ~20%). When i tried a: sql>SELECT COUNT(*) FROM md_data; it hang completely. Same when trying to establish a new connection. I stopped the server and restarted again. Everything was fine again. I inserted the rest of the data (memory raised again but there were only 100000 rows left so there wasn't any problem this time). Am i the only one hitting such issues? One could argue that i should import less records at once but even then. There seems to be some nasty memleak in the background. Or is this a configuration issue? Or am i doing something completely wrong? I am using the .debs: http://monetdb.cwi.nl/downloads/Debian/ Thanks in advance, Andreas Streichardt

2 3

Re: [MonetDB-users] COPY INTO memory issues
by Jens Oehlschlägel 25 Nov '09

25 Nov '09

> > This wasn't the fact. Again monetdb consumed all my memory and when loading > > finished it indicated that it was still doing something (CPU @ ~20%). > log records have to be written, your OS may kick in to flush dirty pages, > reloading swapped out processes, .... The following might not apply to Linux, but still: under windows, suddenly flushing dirty pages from large memory mapped files can severly degrade the system performance ("stalled"). I know windows has settings to limit the amount of dirty pages that may accumulate without flushing. Maybe Linux has something similar and maybe this helps here. Please keep me in the loop if you try this route. Jens

1 0

[MonetDB-users] 'create table as select...' from union queries doesn't work
by Alex Bo. 25 Nov '09

25 Nov '09

Hi, If I do this: create table t1 (f1 int); create table t2 (f1 int); create table t_union as (select f1 from t1 union all select f1 from t2) with data; Then no table is created and no exception is thrown. Should I open a bug for this? (AugSP2 on Windows) -- View this message in context: http://old.nabble.com/%27create-table-as-select...%27-from-union-queries-do… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] create function
by Paul Phillips [ gmail ] 25 Nov '09

25 Nov '09

Thank you for the find piped help to the src documentation. I can make the following function using mclient from AUG2009SP2 well: create function f(i integer) returns bool begin return true; end; It seems that the create function is failing only in the SQL editor for SQuirreL client 3.0.2. I am using the compiled jdbc jar of MonetDB-AUG2009SP2 and have tried to use a compiled sourceball version of jar from 11NOV2009 current branch. both provide this error: Error: syntax error, unexpected $end, expecting WHILE in: "create function f(i integer) returns bool begin return true;" SQLState: null ErrorCode: 0 Error occured in: create function f(i integer) returns bool begin return true Should this then be a question for SQuirrel Client? Thanks Paul

1 0

[MonetDB-users] temporary tables
by Alex Bo. 24 Nov '09

24 Nov '09

Hi, How do temporary tables behave? Are they only stored in memory or are they written to the disk too like normal tables? What performance should I expect from using "create temporary table..." and then querying it in comparison to having a nested query? Thanks. -- View this message in context: http://old.nabble.com/temporary-tables-tp26504075p26504075.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Database Failure
by Matthew Jones 24 Nov '09

24 Nov '09

Hey folks, had a database running for several weeks without any problems but early this morning anytime a client would try to connect to it the connection would just hang. After shutting down and restarting I see this: 2009-11-23 09:38:06 MSG merovingian[28036]: starting Merovingian 1.1 for dbfarm /opt/MonetDB5/dbfarm 2009-11-23 09:38:06 MSG merovingian[28036]: listening for TCP connections on 0.0.0.0:50000 2009-11-23 09:38:06 MSG discovery[28036]: listening for UDP messages on 0.0.0.0:50000 2009-11-23 09:38:06 MSG merovingian[28036]: handling commands over UNIX socket /opt/MonetDB5/dbfarm/.merovingian_control 2009-11-23 09:38:06 MSG discovery[28036]: new neighbour 10.1.0.79 2009-11-23 09:38:07 MSG discovery[28036]: new database mapi:monetdb:// hsdw01:50000/reporting_primary (ttl=660s) 2009-11-23 09:39:45 MSG merovingian[28036]: starting database 'reporting_primary' due to control signal 2009-11-23 09:39:45 MSG merovingian[28036]: database 'reporting_primary' has crashed after start on 2009-11-23 09:36:59, attempting restart, up min/avg/max: 2m/2d/1w, crash average: 1.00 0.60 0.27 (18-10=8) 2009-11-23 09:39:46 MSG reporting_primary[28067]: arguments: /usr/bin/mserver5 --config=/etc/monetdb5.conf --dbname=reporting_primary --dbinit=include sql; --set monet_daemon=yes --set mapi_open=false --set mapi_autosense=true --set mapi_port=50001 --set monet_vault_key=/opt/MonetDB5/dbfarm/reporting_primary /.vaultkey 2009-11-23 09:39:46 MSG reporting_primary[28067]: # MonetDB server v5.14.2, based on kernel v1.32.2 2009-11-23 09:39:46 MSG reporting_primary[28067]: # Serving database 'reporting_primary', using 8 threads 2009-11-23 09:39:46 MSG reporting_primary[28067]: # Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked 2009-11-23 09:39:46 MSG reporting_primary[28067]: # Copyright (c) 1993-July 2008 CWI. 2009-11-23 09:39:46 MSG reporting_primary[28067]: # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved 2009-11-23 09:39:46 MSG reporting_primary[28067]: # Visit http://monetdb.cwi.nl / for further information 2009-11-23 09:39:46 MSG reporting_primary[28067]: # Listening for connection requests on mapi:monetdb://127.0.0.1:50001/ 2009-11-23 09:39:46 MSG reporting_primary[28067]: # MonetDB/SQL module v2.32.2 loaded 2009-11-23 09:39:46 ERR reporting_primary[28067]: !mvc_init: unable to create system tables 2009-11-23 09:39:55 ERR merovingian[28036]: failed to fork mserver: database 'reporting_primary' has inconsistent state (running but dead), review merovingian's logfile for any peculiarities The database marks itself as running but any attempt to connect to it returns the following error: monetdb ERROR MALException:setScenario:Scenario not initialized 'sql' I've read other problems reports that had a similar issue and the suggestion was to wait for the sql module to allow connections but even after 5 minutes this is all that is returned. Is there any way to get this database back to a consistent state so that it is usable? 73, Matthew W. Jones (KI4ZIB) http://matburt.net

8 20

[MonetDB-users] Mx documentation
by Paul Phillips [ gmail ] 24 Nov '09

24 Nov '09

Can someone tell where the Mx utility is for creating the documentation? I have seen references in sources to this command and searches are trouble with only two letters like mx. Is this documentation different/more than the nl website? Thank you. Paul

3 3

[MonetDB-users] limit resident memory usage
by Roberto Cornacchia 23 Nov '09

23 Nov '09

Hi, Is there a way to limit the usage of -resident- memory? Say I have 8GB RAM. What I would like is being able to say: no matter what, use up to 2GB resident memory, and as much virtual memory as you like. I have tried to play around with gdk_mem_maxsize and gkd_mmap_minsize, but with no luck so far. Maybe I haven't very clear yet how they work? Roberto

1 0

[MonetDB-users] strange UNION exception
by Alex Bo. 19 Nov '09

19 Nov '09

Hi, Every once in a while when using a UNION query I get an exception that looks like this: !UNION: column counts (3 and 2) do not match (the numbers '3' and '2' vary from case to case) The message isn't right, because the queries I run do have matching column counts between the Unions. This happens to me in various scenarios. The thing that is common to all the cases is that it seems to happen when some sort of threshold is passed. For example, I can have a working query with 50 OR clauses in the WHERE statement that works, but as soon as I add the 51th OR clause, I get the exception. In other cases I get the same exception with a different amount of OR clauses, but again I see the behavior of the exception appearing when adding one more OR clause to a working query. The thing that is in common to all the failing queries is that there's always a join on two tables and I get data from both tables with a lot of OR clauses. If necessary I can upload data and queries that illustrate this, but the queries are rather long. Please advise. Thanks. -- View this message in context: http://old.nabble.com/strange-UNION-exception-tp26421401p26421401.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] COPY with empty fields
by pphillips99＠gmail.com 19 Nov '09

19 Nov '09

COPY 1 OFFSET 100 RECORDS INTO tlbc FROM '/mnt/data/myfile.txt' DELIMITERS '\t', '\r\n' Trying to use COPY to import tab delimited text files. The text file has a header row and I've verified the delimiters and eols. I have a number of empty columns at the end of each row in the text file and those colums in the table are a combination of integers and decimals. Received the following error at the first of the empty columns: !SQLException:sql:value '' while parsing from line 0 field 213 not inserted, expecting type lng !SQLException:importTable:failed to import table !ERROR: Decimal cannot be parsed from lng I realize I could do manipulations but it's second choice given the data size, but the file is 8G. How can I overcome? Paul

4 7

[MonetDB-users] CSV file to a table
by Nafees Ur Rehman 17 Nov '09

17 Nov '09

Hi, I am trying to read a CSV file content to a table. But I think Im making mistake in the syntax somehow. Can any one please guide me a little? Regards Nafees Ur Rehman

3 3

[MonetDB-users] reading from a file
by Nafees Ur Rehman 17 Nov '09

17 Nov '09

Hi, I am trying to insert records from a file into a table WQ using the following code. Please if someone can help me write my code correctly. copy into WQ "C:\Document and Settings\Rehman\Desktop\wq.txt" USING DELIMITERS field_seperator ',' record_seperator '\n'; Regards Nafees Ur Rehman

2 1

[MonetDB-users] Recursing into a tree via SQL?
by Anton Berezin 16 Nov '09

16 Nov '09

Hi, I've been wondering whether MonetDB/SQL provides something equivalent to Oracle's START WITH ... CONNECT BY ... and if not, how difficult would it be to emulate the behavior with user functions. For example, PostgreSQL provides connectby() function which does that. The table in question is like that: id int, parent_id int, other stuff And it holds multiple small trees, with the root node for each having NULL parent_id. Thanks, \Anton. -- Matters of elegance ought to be left to the tailor and to the cobbler. -- L. Boltzmann

1 0

[MonetDB-users] Bug- & Test- status assessment: Please help!
by Stefan Manegold 15 Nov '09

15 Nov '09

Dear fellow MonetDB developers, Dear MonetDB users, preparing for the upcming Nov2009 release we spent quite some time and efford in cleaning-up the "Stable" TestWeb ( cf., http://monetdb.cwi.nl/Development/TestWeb/Stable/ ) and fixing as many open bugs as possible. Big thansk go to all of you that were actively involved! To further assess the status of (failing) tests and in particular open bug reports ( cf., https://sourceforge.net/tracker/?words=tracker_browse&sort=priority&sortdir… ) I ask all of you to 1) check the open bugs submitted by you, https://sourceforge.net/tracker/?words=tracker_browse&sort=submitted_by&sor… a) whether there is a test in CVS for this bug or not; b) whether the problem still occurs, i.e., whether the test still fails, or whether the problem still occurs for you with the latest Nov2009 CVS code base. Please report any findings in detail via the bug tracker. 2) check the open bugs assigned to you https://sourceforge.net/tracker/?words=tracker_browse&sort=assigned_to&sort… a) whether there is a test in CVS for this bug or not; b) whether the problem still occurs, i.e., whether the test still fails, or whether the problem still occurs for you with the latest Nov2009 CVS code base. Please report any findings in detail via the bug tracker. 3) check all bug reports closed since Aug2009, whether they are (if applicable) backed-up by a test in CVS. 4) check all failing test in the TestWeb http://monetdb.cwi.nl/Development/TestWeb/Stable/ whether they are documented by a bug report. Thank you very much in advance! Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[MonetDB-users] help with MALException meaning
by Alex Bo. 11 Nov '09

11 Nov '09

Hi, I got this exception when running a query on Aug-SP1 (Windows): ExecuteNonQuery failed: !MALException:!ERROR: BATpropcheck: BAT tmpr_1566(-886) with 35392 tuples seqbase of dense oid bat is wrong! 0 != 12306 !COMMIT: failed !ERROR: COMMIT: transaction is aborted, will ROLLBACK instead What does it mean? -- View this message in context: http://old.nabble.com/help-with-MALException-meaning-tp26300205p26300205.ht… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] High availability
by XueHJ 11 Nov '09

11 Nov '09

Hi: Does the MonetDB have a high-availability solution? best regards, allegro

2 1

[MonetDB-users] Error when uploading integers
by Roman Sokolyuk 10 Nov '09

10 Nov '09

Hi, I ran into the following problem: I used the COPY command to upload a large number of records and I got an error saying that a particular field was expecting an int. In the file which I am trying to upload fields are separated with commas ",", and records are separated with new-line characters - "\n". The value it was trying to upload and failed was basically an empty field - ",,". I worked around the problem by setting every entry in the column that was not set to zero - so the field would get its int, and later changing it back to null in the table. But it seems like a common task to upload null values into an integer column, so why would it fail?

2 1

[MonetDB-users] HEAPalloc: Insufficient space for HEAP
by tbohr＠quantentunnel.de 10 Nov '09

10 Nov '09

Hi, when I run the following query (complete testcase given), the server throws an exception !MALException:bbp.project:Can not create object !ERROR: HEAPalloc: Insufficient space for HEAP of 91226112 bytes. The result should be 11390625 (15^6) rows. The corresponding count query succesfully delivers this value. The amount of used memory of the mserver5.exe process is about 1.2GB at the time of failure. The testcase is: create table d (id integer, ordinal integer, value varchar(50)); insert into d (id, ordinal, value) values (1,1,'a'), (2,2,'b'), (3,3,'c'), (4,4,'d'), (5,5,'e'), (6,6,'f'), (7,7,'g'), (8,8,'h'), (9,9,'i'), (10,10,'j'), (11,11,'k'), (12,12,'l'), (13,13,'m'), (14,14,'n'), (15,15,'o'); create table M_189 (d1 integer, d11 integer, d19 integer, d4 integer, d6 integer, d8 integer, value double); SELECT G.M_ID, G.VALUE, G.d1, G.d11, G.d19, G.d4, G.d6, G.d8 FROM (SELECT DISTINCT 189 AS M_ID, 1 AS M_ORDINAL, M_189.VALUE AS VALUE, D1.ID AS d1, D11.ID AS d11, D19.ID AS d19, D4.ID AS d4, D6.ID AS d6, D8.ID AS d8 FROM D D11 CROSS JOIN D D1 CROSS JOIN D D4 CROSS JOIN D D6 CROSS JOIN D D8 CROSS JOIN D D19 LEFT OUTER JOIN M_189 ON M_189.d1=D1.ID AND M_189.d11=D11.ID AND M_189.d19=D19.ID AND M_189.d4=D4.ID AND M_189.d6=D6.ID AND M_189.d8=D8.ID ) G JOIN D D11 ON D11.ID=G.d11 JOIN D D6 ON D6.ID=G.d6 JOIN D D8 ON D8.ID=G.d8 JOIN D D19 ON D19.ID=G.d19 JOIN D D1 ON D1.ID=G.d1 JOIN D D4 ON D4.ID=G.d4 ORDER BY G.M_ORDINAL, D11.ORDINAL, D6.ORDINAL, D8.ORDINAL, D19.ORDINAL, D1.ORDINAL, D4.ORDINAL; Kind regards, TB

3 6

[MonetDB-users] Possible wrong results when Querying
by LeonardF 10 Nov '09

10 Nov '09

Hi There, I have some problem with the row_number() over() function. Consider the following table: create table "table1" ("customer" varchar(40), "product" varchar(40), "price" double) insert into "table1" values ('cust1', 'p1', 100) insert into "table1" values ('cust1', 'p2', 200) insert into "table1" values ('cust1', 'p3', 150) insert into "table1" values ('cust2', 'p1', 300) insert into "table1" values ('cust2', 'p3', 200) The following query over this table: SELECT "customer", "product", "sumprice", (Row_number() OVER(PARTITION BY "customer" ORDER BY "sumprice")) as "rank" FROM ( SELECT "customer", "product", (Sum("price")) AS "sumprice" FROM "table1" GROUP BY "customer", "product") AS "temp" Returns: Customer product sumprice rank Cust1 p1 100 1 Cust1 p2 200 2 Cust1 p3 150 3 Cust2 p1 300 1 Cust2 p3 200 2 But doesn’t it suppose to return the following result set?: Customer product sumprice rank Cust1 p1 100 1 Cust1 p3 150 2 Cust1 p2 200 3 Cust2 p3 200 1 Cust2 p1 200 2 Thanks -- Leonard Forgge -- View this message in context: http://www.nabble.com/Possible-wrong-results-when-Querying-tp22821802p22821… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] type mismatch on COPY command
by Roman Sokolyuk 09 Nov '09

09 Nov '09

Hi, I am trying to upload 500000 records using copy command and I am getting the following error: !SQLException:sql:value 'somestring' while parsing 'somestring,1,,,2009-05-11 00:00:00,0,,' from line 250108 field 3 not inserted, expecting type str !SQLException:importTable:failed to import table the type of the field is varchar(100). Why wouldn't it insert something like 'somestring'. Also, each row has another "string" column - "name" and it didn't complain about the names at all.

2 2

[MonetDB-users] Pf:attribute syntax
by Floris Ouwendijk (DT) 09 Nov '09

09 Nov '09

Hi, Can anybody shed some light on the pf:attribute syntax? I have some straightforward queries that match on a unique attribute but do not perform as desired. I'm hoping that using pf:attribute the corresponding element can directly be located. Kind regards, Floris

3 3

[MonetDB-users] MALException:algebra.join, HEAPextend: failed to extend
by tbohr＠quantentunnel.de 09 Nov '09

09 Nov '09

Hi, I am trying to execute a rather complex aggregation query (referencing a nested VIEW hierarchy) on a star schema. The server reports this exception: Error: MALException:algebra.join:GDK reported error. ERROR: HEAPextend: failed to extend to 115574952 for 76\7667tail The memory used by the mserver5.exe process after running the query the first time is about 780K. Running the query the second time even crashes the instance. The server (Release 5.14.2) runs on a 3,5GB Dual Core machine with Win XP 32bit. This is the last memory debug info after starting the server: #GDKmemchk (memcur=8910680,memmax=3061052579) (vmcur=58720256,vmmax=1610612736) What I am noticing is that after having executed the query the first time two comparably big files (the above reported 76\7667tail and a tail file) with 94MB each are generated in the bat folder. All the other files there are in the lower KB range. Is there a limit on the view nesting hierarchy (other than memory limitations)? Can I tune the accepted memory limits somehow? It seems that MonetDB does not use all available memory. Kind regards, TB.

1 0

[MonetDB-users] High availability
by XueHJ 07 Nov '09

07 Nov '09

Does the MonetDB have a high-availability solution?

1 0

[MonetDB-users] limit the number of rows in the result set
by Roman Sokolyuk 06 Nov '09

06 Nov '09

Hi, Could someone please tell me what the syntax is for selecting only say the top 20 rows ?

2 1

[MonetDB-users] Best way to avoid division by zero?
by Guillaume Theoret 06 Nov '09

06 Nov '09

I seem to have hit a bug (I just reported it) and now I'm using an ugly hack to get around it but I was wondering if there's a better way to avoid division by zero errors. The bug is that MonetDB seems to evaluate both branches of a CASE regardless of whether the branch will be taken or not: sql>SELECT more>CASE SUM(payout_units_cpc) more>WHEN 0 THEN 0 more>ELSE 1 more>END AS avg_cost_cpc more>FROM daily.stats_2009_week_31; SELECT +--------------+ | avg_cost_cpc | +==============+ | 0 | +--------------+ 1 tuple Timer 27.990 msec 1 rows sql>SELECT more>CASE SUM(payout_units_cpc) more>WHEN 0 THEN 0 more>ELSE cast(SUM(payout_units_cpc * payout_cpc) as numeric(12,4)) / SUM(payout_units_cpc) more>END AS avg_cost_cpc more>FROM daily.stats_2009_week_31; !MALException:calc./:Illegal argument Division by zero 0 tuples Timer 16.415 msec 0 rows So what I did was I changed my query to: SELECT CASE SUM(payout_units_cpc) WHEN 0 THEN 0 ELSE cast(SUM(payout_units_cpc * payout_cpc) as numeric(12,4)) / (SUM(payout_units_cpc) + 0.000001) END AS avg_cost_cpc FROM daily.stats_2009_week_31 WHERE date_added >= 1249099200 AND date_added <= 1249185599 Because of the decimal precision it won't affect my numbers but it feels wrong.

1 0

[MonetDB-users] substring extraction
by Roman Sokolyuk 06 Nov '09

06 Nov '09

Hi, If I have a column that contains email addresses, is there a way for me to select just the domain from SQL, so for dave(a)gmail.com, bob(a)yahoo.com, I will get just "gmail.com", and "yahoo.com"?

2 4

[MonetDB-users] Mathematical functions
by Roman Sokolyuk 05 Nov '09

05 Nov '09

Hi, I am encountering the following issue: SELECT field1, //returns 4 field2, //returns 1 ( ( field2 / field1) * 100) //this returns zero - not what I want - I am looking for 25 Am I doing something wrong with type conversion (integer/floating point)?

3 7

[MonetDB-users] Where is JAR file for monetdb Driver?
by Nafees Ur Rehman 05 Nov '09

05 Nov '09

Hi, I want to configure DBVisualizer with monetdb/sql. When I register for a driver, I can't find the driver files. I follow the instruction listed on the monetdb webpages. Please note that I am using WindowsXP. I would appreciate a kind response. Regards Nafees Ur Rehman __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

2 1

[MonetDB-users] Group By bug?
by Guillaume Theoret 04 Nov '09

04 Nov '09

I think this is a bug in Group By, I would just like to confirm before I submit a bug report. sql>SELECT payout_type, count(*) FROM test.aggregated_detail_data_2009_week_33 stats WHERE date_added >= 1250222400 AND date_added < 1250308799 GROUP BY payout_type; SELECT payout_type, count(*) FROM test.aggregated_detail_data_2009_week_33 stats WHERE date_added >= 1250222400 AND date_added < 1250308799 GROUP BY payout_type; +-------------+-------+ | payout_type | L206 | +=============+=======+ | 1 | 99021 | | 5 | 8719 | | 4 | 8940 | | 2 | 72 | | 3 | 39 | +-------------+-------+ 5 tuples Timer 13.464 msec 5 rows sql>SELECT 0 as breakdown_id, payout_type, count(*) FROM test.aggregated_detail_data_2009_week_33 stats WHERE date_added >= 1250222400 AND date_added < 1250308799 GROUP BY breakdown_id, payout_type; !TypeException:user.s2_1[6]:'group.new' undefined in: (ext14:any, grp12:any) := group.new(_11:bte) !TypeException:user.s2_1[33]:'group.derive' undefined in: (ext52:any, grp50:any) := group.derive(ext14:any, _14:any, _48:bat[:oid,:int]) !TypeException:user.s2_1[35]:'bat.mirror' undefined in: _53:any := bat.mirror(ext52:any) !TypeException:user.s2_1[36]:'algebra.join' undefined in: _54:any := algebra.join(_53:any, _48:bat[:oid,:int]) !TypeException:user.s2_1[39]:'aggr.count' undefined in: _57:bat[:any,:wrd] := aggr.count(_56:bat[:oid,:any], _52:any, _53:any) !SQLException:SQLengine:Program contains errors 0 tuples Timer 1.234 msec 0 rows

1 0

[MonetDB-users] COUNT on varchar column, counts nulls as well - how can I prevent that?
by Roman Sokolyuk 02 Nov '09

02 Nov '09

Hi, I am trying to run AGGR functions on a table - COUNT (column_name) and it looks like it counts <null>'s as well. Is there a way to prevent it?

4 3

[MonetDB-users] UTF-8 support
by Roman Sokolyuk 30 Oct '09

30 Oct '09

Hi, I installed MonetDB on Vista and am experiencing issues with the COPY utility and uploading text. Text that comes from CVS files and looks plain in Notepad generates errors like this one: *!SQLException:sql:value '∩╗┐505' while parsing '∩╗┐505,787, !SQLException:importTable:failed to import table* Is it possible I installed Monet without UTF-8 support? How can I check? How can I fix it?

2 1

[MonetDB-users] Convert date field to its proper name
by Roman Sokolyuk 30 Oct '09

30 Oct '09

Hi, Is there a way to convert a month number to its name? For example, I am executing the following statement: EXTRACT(MONTH FROM signup_date), but I want "1" to display as "January". Thanks.

2 2

[MonetDB-users] COPY command syntax
by Roman Sokolyuk 30 Oct '09

30 Oct '09

Hi, Could someone please point out to me what is wrong with the way I am using the COPY utility? Here is what I typed: COPY 2 RECORDS INTO my_table FROM (C:\MyDir\MyFile.txt) USING DELIMITERS field_separator ',' record_separator ','; I got this error: *!syntax error, unexpected IDENT, expecting STRING in: "copy 2 records !into my_table from (c" 0 tuples*

4 9

[MonetDB-users] Announcement: New Aug2009-SP2 bugfix release of MonetDB suite
by Sjoerd Mullender 30 Oct '09

30 Oct '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the Aug2009-SP2 bug fix release of the MonetDB suite of programs. This is the second bug fix release for the Aug2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb//Development/Releases/Aug2009/#Aug20…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[MonetDB-users] dbfarm unusable after computer crash
by Alex Bo. 27 Oct '09

27 Oct '09

Hi, I am using Aug09-SP1 on Windows from CVS. While working with MonetDB my computer stopped responding, so I shut it down forcefully. Then after restarting, I couldn't start my dbfarm. The server is saying: !ERROR: BBPinit: old BBP without version number !ERROR: dump the database using a compatible version, !ERROR: then restore into new database using this version. How can I save my data? Or is it forever unusable? Thanks. -- View this message in context: http://www.nabble.com/dbfarm-unusable-after-computer-crash-tp26078901p26078… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] blobs with mapilib
by Wilfried Hafner 27 Oct '09

27 Oct '09

Hi! Is there an example how to load a blob with the mapilib? I'm using mapi_query_array, after calling there is an assertion failure in Mapi.mx on line 3373, it works for small blobs (I tried with 4, 8 bytes) but not with a 4kB picture. Thanks, Wilfried

1 0

[MonetDB-users] server does not start anymore
by wilfried＠hafner.ws 24 Oct '09

24 Oct '09

Hello! For some testing purposes, I created a file with 63.158.399 rows and tried to load it into a table with following structure: create table logtest ( id bigint, dim_year smallint, dim_month smallint, dim_day smallint, dim_hour smallint, dim_min smallint, dim_sec smallint ); I loaded the data in pieces of 20.000.000 rows with the 'copy into' command. At the last 3158399 there was an error, the connection to the server terminated, the server crashed. I restarted the server and the error message ERROR: HEAPextend: failed to extend to 480000000 for 01\14\11401tail was displayed. I tried to restart again, but its not possible anymore, the server immediatly returns and there is no error message... C:\MonetDB\MonetDB5>MSQLserver.bat # MonetDB server v5.14.2, based on kernel v1.32.2 # Serving database 'demo', using 1 thread # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see C:\MonetDB\MonetDB5\etc\monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.32.2 loaded I know I can reinstall the server, but I would like to know the problem. Are there too much rows for the logtest table? There are about 10 other tables in the database, with 10 - 100 rows. As you can see from above, I'm using windows vista, 32 bit... The current size of the dbfarm folder is 1,52 GB, and the size of the file I tried to load is 1,72 GB. Thank you, Wilfried

2 4

[MonetDB-users] union bug?
by Allen Zhang 23 Oct '09

23 Oct '09

Hi, There, We encounter such a strange problem in the union in monetdb, when run attached sql. The where condition did not get applied towards the last union recordset. So the result from the attached sql is like 2009ABC 2008ABC 2007ABC ADD Notice the ADD get into the result!! But when we remove the last union of ADD, then the ABD gets into the result. Looks like the where condition gets ignored in the last union. Regards Allen

2 1

[MonetDB-users] mclient with mal
by Romulo Goncalves 22 Oct '09

22 Oct '09

Hello, Could someone explain what I could have done wrong to get this message when I start mclient: -bash-3.2$ ~/MonetDB/scripts/mclient current debug mal xchange_challenge: frontend mal not found I have the latest version of the cvs head. In the same machine there is another Mserver running. I used a different port for mine, i.e., there is two mservers running on the same machine... Regards, Romulo

2 3

[MonetDB-users] plz help
by ahmed_moon 22 Oct '09

22 Oct '09

Draw a Context as well as Level 0 Data Flow Diagram (DFD) of a Shop Sale Management System for a company sailing shops in different parts of country. The Shop Sale Management System works as follows: Ø Customer Places order. System checks availability of the customer in customer file (If he / she is already a customer). If found, then approved otherwise a new customer is created. Here new customer’s info is sent to ledger file. Ø Then the availability of shops is checked in the stock. If found, an Invoice is generated. Invoice info is sent to the customer, stock, ledger as well as sales department. Ø If shop is not available at this time, then this info is also sent to the customer. Purposes: Ensure that you can analyze existing manual system and can draw Data Flow Diagrams of any proposed system. Before Starting: Detail study of existing system. Rules for drawing DFDs. Differentiate different levels of DFDs. -- View this message in context: http://www.nabble.com/plz-help-tp26004897p26004897.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] bulk upload
by Roman Sokolyuk 22 Oct '09

22 Oct '09

Is there a facility in MonetDB for batch upload of large sets of data, instead of executing many INSERT statements and inserting one row at a time?

3 2

[MonetDB-users] Star Schema and MonetDB
by Roman Sokolyuk 21 Oct '09

21 Oct '09

Do I have to create Star Schema in Monet DB, or is it specially optimized for running data analysis on Just one large denormalized table?

2 1

[MonetDB-users] Invalid Identifier
by Roman Sokolyuk 21 Oct '09

21 Oct '09

So I am trying to import some data from a different DB to Monet. I created a large file with INSERT statements almost 7K insets. I saved it in a .sql file and tried importing it using \< [file_name] - that gave me almost 7K of Invalid identifier error messages. When I try just one insert out of that file it works fine though. Also, I compared my sql file to the VOC tutorial sql file and the only difference I see is that in mine each INSERT is one its own line - which means it has a newline character at the end of each line. Could this be creating a problem?

1 0

[MonetDB-users] How can I truncate a table
by Roman Sokolyuk 21 Oct '09

21 Oct '09

Is there an equivalent in MonetDB of truncating or emptying a table of all data?

2 2

[MonetDB-users] timestamp conversion failed -How can I convert a char string to a timestamp
by Roman Sokolyuk 21 Oct '09

21 Oct '09

Hi, I am trying to insert the following value into a timestamp column: '2/5/2008 4:05:31 PM' and I get the error message: !SQLException:timestamp:conversion of string '2/5/2008 4:05:31 PM' failed I would like to convert that date string into a timestamp type - is there a function in Monet to do that?

2 2

[MonetDB-users] SQL: Connect To statement, help request
by Bart Buter 21 Oct '09

21 Oct '09

I could use some pointers since I have trouble getting something started I have 2 machines ow138 ip:146.50.7.21 and ow139 ip:146.50.9.30 Both machines run a database with the name of the machine Merovingian is running on both systems >>monetdb discover location mapi:monetdb://ow139:50000/ow139 mapi:monetdb://ow138:50000/ow138 I would like to connect these databases using SQL: CONNECT TO statement, however I cannot seem to get past syntax errors etc. Thus something like >>mclient -lsql -d ow138 sql> CONNECT TO ow139 ..... Can someone please help me fill in the dots

2 1

[MonetDB-users] Question on Usage
by Roman Sokolyuk 21 Oct '09

21 Oct '09

Hi, I am evaluating MonetDB for OLAP purposes and had some questions about usage: Please, be patient with me as I am rather new to this area... 1. If I were to build a data warehouse in MonetDB, would I have to store data in a different manner than in any other RDBMS? From what I understand, in data warehousing data should be denormalized, but besides that, do I need to familiarize myself with any new paradigms specific to MonetDB? For example, If my firsm sells 4types of vehicles - RV's, small cars, and motorcycles - and I want to create reporting which can be limited to only one of them or all of them put together, would I have to create 3 tables - one for each type of vehicle, but which have the same columns? Say RVs: make_year, size, brand car: make_year, size, brand motorcylce: make_year, size, brand? 2. Let's say I wanted to also keep aggregate information on the purchase of those vehicles, would I keep the aggregate data in a separate table, or use MonetDB to compute it? I guess what I am struggling to understand is: is usage of monet db for a Java developer radically different from other RDBMS's like MySQL or Oracle, or is it the same, and the OLAP strength is only the result of MonetDB's internals? Thanks,

1 0

[MonetDB-users] create temp table privileges
by magicrobotmonkey 20 Oct '09

20 Oct '09

I am trying to set up monet as a backend to our system for reporting. I've got merovigian running, with a database created, and I've added a schema and user to that db via mclient: CREATE USER "test" WITH PASSWORD 'password' NAME 'Test User' SCHEMA "sys"; CREATE SCHEMA "test" AUTHORIZATION "test"; ALTER USER "test" SET SCHEMA "test"; Now, I can do all kinds of things in the test schema with this user. What I can't do is create temporary tables: Error in query: CREATE TABLE: insufficient privileges for user 'test' in schema 'tmp'. I cannot for the life of me figure out how to give this user create table privileges in tmp. -- View this message in context: http://www.nabble.com/create-temp-table-privileges-tp25981635p25981635.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] default database
by Roman Sokolyuk 20 Oct '09

20 Oct '09

Hi, I installed Monet, but I did not create a database, and now I want to connect SQuirrell, but I need to know the name of the database to put in the URL. I imported the voc data, so there must be a database set up already. Is there a way I can find out the name of the database I am logged into?

2 2

[MonetDB-users] Hibernate?
by Roman Sokolyuk 20 Oct '09

20 Oct '09

Does Monet integrate with Hibernate?

1 0

[MonetDB-users] Cannot import the VOC data
by Roman Sokolyuk 20 Oct '09

20 Oct '09

Hi, I extracted the sql voc data file, but when I run \< voc_dump.sql on the command line I get the error: *voc_dump.sql: cannot open* I extracted it directly into the MonetDB installation directory, alongside mclient.bat.

3 4

[MonetDB-users] Cannot start mclient on Windows
by Roman Sokolyuk 20 Oct '09

20 Oct '09

Hi, I am running Vista 64. I installed the 64 msi of monetdb. When I start the client from the Start menu it works fine, but when I try to run mclient --help for example in a simple command prompt window I get a Windows error message: "This application has failed to start because libMapi.dll was not found. Re-installing the application may fix the problem". Could you please suggest something? Thanks.

2 2

[MonetDB-users] How to display the 'cool' mclient error messages?
by Stefan de Konink 19 Oct '09

19 Oct '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, After trying to figure out for over an hour what could have possibly gone wrong with my database. And just before I started to complain out potential corruption I really wonder: If a mapilib user wants to get this message: SELECT: access denied for dbslayer to table 'sys.ietsanders' Could anyone provide a code snippet that returns that? printf("SELECT: access denied for dbslayer to table 'sys.ietsanders'\n"); is too easy... Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.13 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkrcpQoACgkQYH1+F2Rqwn2x9wCfVXutknJ59KByQ+CzobrhrucK BCkAnRM6MiUcd/TwK47InveuD2rx8v7c =gUIR -----END PGP SIGNATURE-----

1 0

Re: [MonetDB-users] loading RDF data in MonetDB
by Medha Atre 17 Oct '09

17 Oct '09

Hi, Thanks for the reply. At this point, all I am looking for is to load RDF NTriples data -- treated as a 3 column table -- into MonetDB using "vertical partitioning" to index the data nicely (as I read about MonetDB being used for the same in different research papers recently.. e.g. http://portal.acm.org/citation.cfm?id=1453856.1453927 RDF-3X etc). I am not really looking for a great support for different RDF formats (as the data has already been cleaned into NTriples format using rdflib), I want to check the correctness of the results generated using my own querying tool. So can you please suggest me a method of treating the given RDF NTriples file as a simple "space separated" 3-column data file from which I can load the data into MonetDB creating the required indexes or "vertical partitions"? Querying with SQL front end is fine with me! Looking forward to your help. Medha > ------------------------------ > > Message: 5 > Date: Tue, 6 Oct 2009 10:19:57 +0200 > From: Lefteris <lsidir(a)gmail.com> > Subject: Re: [MonetDB-users] loading RDF data in MonetDB > To: Communication channel for MonetDB users > <monetdb-users(a)lists.sourceforge.net> > Message-ID: > <852badbc0910060119x4f125a06qd5fc7ed0c56035c(a)mail.gmail.com> > Content-Type: text/plain; charset=ISO-8859-1 > > Hi, > > there is a highly experimental module for MonetDB to load RDF data. > This is not activated in the stable release, and in order to use it > you will need to do some compilation on your own and possible report > back any problems you have. If you are willing to jump deeper in the > MonetDB experience I can guide you on how to do this. The module will > read any RDF format supported by the rdflib library and create a > triple store with appropriate indices. However, the only way to query > the triple store at this point is through the SQL front-end. > > regrads, > > lefteris > > On Tue, Oct 6, 2009 at 8:59 AM, Medha Atre <medha.atre(a)gmail.com> wrote: >> Hi, >> >> I intend to use MonetDB for some of my experimental work using RDF >> data. I was wondering if there is an easy way to load RDF data (in >> NTriples format) in MonetDB making use of the column-wise vertical >> partitioning of the RDF data, based on properties/predicates in the >> RDF data. >> >> Some pointers or help regarding this is much appreciated. >> >> I am sorry if this is not the correct forum to post this message. >> >> Thanks. >> Medha

8 24

[MonetDB-users] prepared exec did not translate date string
by Allen Zhang 16 Oct '09

16 Oct '09

Hi, there, We are testing the Aug SP1 (v5.14.2) release, it seems the exec did not translate the date string, please run attached sql against Aug SP1, it give out the following error, the same script works file on mserver v5.10.4 (May SP1). Sounds like a bug to me. 15:19:53 [CREATE - 0 row(s), 0.000 secs] Command processed. No rows were affected 15:19:53 [SELECT - 3 row(s), 0.000 secs] Result set fetched 15:19:54 [PREPARE - 1 row(s), 0.000 secs] Result set fetched 15:19:54 [EXEC - 0 row(s), 0.000 secs] SQLException:sql.prepare:wrong argument for prepared statement (expected date instead of char) 15:19:54 [EXEC - 0 row(s), 0.000 secs] current transaction is aborted (please ROLLBACK) 15:19:54 [EXEC - 0 row(s), 0.000 secs] current transaction is aborted (please ROLLBACK) 15:19:54 [EXEC - 0 row(s), 0.000 secs] current transaction is aborted (please ROLLBACK) 15:19:54 [COMMIT - 0 row(s), 0.000 secs] COMMIT: failed ERROR: COMMIT: transaction is aborted, will ROLLBACK instead 15:19:54 [SELECT - 3 row(s), 0.015 secs] Result set fetched 15:19:54 [DROP - 0 row(s), 0.000 secs] Command processed. No rows were affected ... 10 statement(s) executed, 7 row(s) affected, exec/fetch time: 0.015/0.000 sec [3 successful, 2 warnings, 5 errors] Thanks for the attention. Allen

2 1

[MonetDB-users] BATpropcheck exception
by Alex Bo. 15 Oct '09

15 Oct '09

Hi, I haven't been able to reproduce this, but when running an INSERT query I got: !MALEXCEPTION: !ERROR: BATpropcheck: ... tuples seqbase of dense oid bat is wrong! 0 != 12306 I am running Aug09 SP1 compiled from CVS on Windows. What could have caused this error? Thanks. -- View this message in context: http://www.nabble.com/BATpropcheck-exception-tp25909476p25909476.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Use cases for seperate servers vs single database
by Stefan de Konink 11 Oct '09

11 Oct '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, What is the developer perspective of running a single database with a single mapi interface but different users (and rights) versus multiple databases having each one user. Is there a good reason not to merge databases? I understand that each MonetDB instance thinks it can access all the memory on the system available, that would indicate it might be better to run a single server. Could someone elaborate on the above? Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkrQsBgACgkQYH1+F2Rqwn3olACffKnjqdhef+fXkmKwmdOLvJkK ltgAnAw/MIIBHfXokLAbV3sA9RMUG/Hw =2fGw -----END PGP SIGNATURE-----

2 2

[MonetDB-users] MonetDB/XQuery with Java/Perl
by listanand＠gmail.com 09 Oct '09

09 Oct '09

Hi all, I am new to MonetDB/XQuery, and have a question to ask. Actually, I am new to MonetDB/XQuery, XML, SOAP, RPC, and XQuery also, and so you can very well imagine how overwhelmed I must be at this point :( I do not need super efficient query processing, but what I do certainly need is a convenient hassle free programmatic access to the XQuery database. I looked at the documentation and it appears that the Perl and Java APIs still need some work, and are not ready for prime time. Is that correct? Also, do I need to learn SOAP, RPC etc to be able to issue XQueries from my program? Thanks in advance. Sorry if I seem grumpy (I am!). Andy

1 0

[MonetDB-users] mapilib latin1
by wilfried＠hafner.ws 09 Oct '09

09 Oct '09

Hi! I have a table with a varchar(100) column, when I connect to the server with mclient.bat -Elatin1 option I'm able to insert and display characters like ä and ö correctly. But I have problems to do the same with a c++ app and the mapilib. Does anyone have some hints? regards, Wilfried

2 2

[MonetDB-users] Help with table sizes
by david85 08 Oct '09

08 Oct '09

Hello, I am currently trying to figure out how I can determine the size, i.e. the disk space, of the different tables. I know that they are stored in the dbfarm/database_name/bat folder, but I don't know which folder holds the data for which table. I looked at the manual but the bbp.getDiskSpace command didn't work (or maybe I used it wrong). I have also searched for this topic, but there was no concrete answer. Thank you in advance. Best Regards -- View this message in context: http://www.nabble.com/Help-with-table-sizes-tp25728470p25728470.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] Support for ANSI 1992/99 BIT
by McKennirey.Matthew 08 Oct '09

08 Oct '09

Although ANSI 2003 eliminated the BIT data type, I was wondering if anyone has developed support for this in MonetDB. Specifically we would like to store UUIDs in a column, as a 128 bit BIT type. Storing a UUID in its canonical string form (36 characters = 288 bits) seems inefficient. We would also like to consider using bit masks for access control. Thanks

1 0

[MonetDB-users] mapilib on windows
by wilfried＠hafner.ws 08 Oct '09

08 Oct '09

Hello! I have a question on getting the mapi working on windows... I downloaded the MonetDB-client-1.32.2.zip from the sources directory. I tried now to open the solution file in the NT directory but its not possible, I use vc++ 2008 express. What version of vc++ should I use? Is there an existing .lib in one of the other downloadable packages? I would like to create a sql driver for qt4 in c++... Kind Regards, Wilfried

2 2

[MonetDB-users] Insert slowdown
by Guillaume Theoret 08 Oct '09

08 Oct '09

Hi, I have a question about insert performance. At first, with an empty table, it took a little over 1 second (around 1.5) to insert 1000 rows. Now, with 5.2MM rows, it's taking ~65s. Is this to be expected? Thanks, Guillaume

2 4

[MonetDB-users] Segmentation fault on insert
by Guillaume Theoret 07 Oct '09

07 Oct '09

This has happened twice in two days so far. All I do is insert rows in a loop and eventually I hit a segmentation fault. [...] 160000 done - 2.1121% in 432.97 (0.0026 avg) 161000 done - 2.1253% in 435.68 (0.0027 avg) 162000 done - 2.1385% in 438.28 (0.0026 avg) 163000 done - 2.1517% in 442.37 (0.0041 avg) Segmentation fault monetdb@dev3:~$ MonetDB/bin/monetdb status name state uptime health last crash test running 2m 56s 34%, 0s 2009-10-06 15:45:01 Is there any way to recover from this? I tried stopping the db but it would just hang. I tried restarting monetdb/merovingian and starting the db again but it said this: starting database 'test'... FAILED: starting 'test' failed: database 'test' has inconsistent state (running but dead), review merovingian's logfile for any peculiarities This seems to be the log from when the crash occured: 2009-10-07 12:47:20 MSG merovingian[3081]: client localhost:40950 has disconnected from proxy 2009-10-07 12:47:20 MSG merovingian[3081]: client localhost:38976 has disconnected from proxy 2009-10-07 12:47:20 MSG merovingian[3081]: database 'test' (3865) was killed by signal 11 2009-10-07 14:03:29 MSG merovingian[3081]: database 'test' has crashed after start on 2009-10-06 15:45:01, attempting restart, up min/avg/max: 0s/0s/0s, crash average: 1.00 0.20 0.07 (2-0=2) 2009-10-07 14:03:30 MSG test[6042]: arguments: /home/guillaume/MonetDB/bin/mserver5 --config=/home/guillaume/MonetDB/etc/monetdb5.conf --dbnam e=test --dbinit=include sql; --set monet_daemon=yes --set mapi_open=false --set mapi_autosense=true --set mapi_port=50001 --set monet_vault_key=/home/guillaume/MonetDB/var/MonetDB5/dbfarm/test/.vaultkey And this is the log when I tried to start it: 2009-10-07 14:08:39 ERR merovingian[6059]: failed to fork mserver: database 'test' has inconsistent state (running but dead), review merovingian's logfile for any peculiarities If I recompile with debug mode enabled will it dump a stack trace somewhere when it segfaults? Thanks, Guillaume

1 1

[MonetDB-users] Restarting embedded connection
by Sebastian Ohl 06 Oct '09

06 Oct '09

Hi, i'am using the embedded version of monetdb sql server in one of my projects. now i want to write tests for several functions using a normal test framework. in theses frameworks it is normal to setup your test environment before every testcase. for me, that means that i have to start the embedded monetdb server. after every testcase i want to shutdown to server so that i have a clean environment again. after disconnecting from the server by mapi_disconnect/destroy, i tried to start a new embedded sql server, but at the first call it has lost its connection and my application dies. i digged a little bit in monetdb's code an there are a lot of static variables. it is even possible to restart an embedded sql server? if it is, how can i safely do this? regards sebastian

1 0

[MonetDB-users] Restarting embedded connection
by Sebastian Ohl 06 Oct '09

06 Oct '09

Hi, i'am using the embedded version of monetdb sql server in one of my projects. now i want to write tests for several functions using a normal test framework. in theses frameworks it is normal to setup your test environment before every testcase. for me, that means that i have to start the embedded monetdb server. after every testcase i want to shutdown to server so that i have a clean environment again. after disconnecting from the server by mapi_disconnect/destroy, i tried to start a new embedded sql server, but at the first call it has lost its connection and my application dies. i digged a little bit in monetdb's code an there are a lot of static variables. it is even possible to restart an embedded sql server? if it is, how can i safely do this? regards sebastian

1 0

[MonetDB-users] Optimizer exception in Aug09-SP1
by Alex Bo. 06 Oct '09

06 Oct '09

Hi, I got this exception while running a not so special query: ExecuteReader failed: !SQLException:optimizer: 'multiplex' should be the last !SQLException:optimizer: 'deadcode' should be used at least once !SQLException:optimizer: pipeline set to 'inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex' I haven't been able to reproduce it since. What does it mean? Is it something to worry about? Thanks. -- View this message in context: http://www.nabble.com/Optimizer-exception-in-Aug09-SP1-tp25736590p25736590.… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] gdk_single_user
by Matthew Jones 06 Oct '09

06 Oct '09

Is this option still required to keep the database from corrupting itself on shutdown? I've also noticed when running in this mode that I see a lot of duplicate tables and when attempting to drop a table it doesn't disappear from my table list... what gives? 73, Matthew W. Jones (KI4ZIB) http://matburt.net

2 2

[MonetDB-users] Unique constraint on char column
by Guillaume Theoret 06 Oct '09

06 Oct '09

Is the unique constraint supposed to work on a char column? I wanted to add a constraint such that a combination of two columns (date_added and hash_key) was always unique but although the constraint seems to have been added successfully, it seemingly has no effect: (please disregard timer measurements, I'm doing lots of concurrent inserts at the same time) sql>CREATE TABLE test.keytest ( more> date_added int NOT NULL, more> hash_key char(32) NOT NULL, more> dimension1 int NOT NULL, more> dimension2 int NOT NULL, more> metric1 int NOT NULL, more> metric2 int NOT NULL, more> more> CONSTRAINT key_test UNIQUE (hash_key,date_added) more>); Operation successful Timer 1855.919 msec 0 rows sql> 0 tuples Timer 368.076 msec 0 rows sql>select * from test.keytest; 0 tuples Timer 294.551 msec 0 rows sql>insert into test.keytest (date_added, hash_key, dimension1, dimension2, metric1, metric2) VALUES (1, a, 1, 1, 2, 2); !SELECT: identifier 'a' unknown 0 tuples Timer 22.811 msec 0 rows sql>insert into test.keytest (date_added, hash_key, dimension1, dimension2, metric1, metric2) VALUES (1, 'a', 1, 1, 2, 2); Rows affected 1 Timer 12.126 msec 0 rows sql>insert into test.keytest (date_added, hash_key, dimension1, dimension2, metric1, metric2) VALUES (1, 'a', 1, 1, 2, 2); Rows affected 1 Timer 18.345 msec 0 rows sql>select * from test.keytest; select * from test.keytest; +------------+----------------------------------+------------+------------+---------+---------+ | date_added | hash_key | dimension1 | dimension2 | metric1 | metric2 | +============+==================================+============+============+=========+=========+ | 1 | a | 1 | 1 | 2 | 2 | | 1 | a | 1 | 1 | 2 | 2 | +------------+----------------------------------+------------+------------+---------+---------+ 2 tuples Timer 1.997 msec 2 rows sql>CREATE UNIQUE INDEX unique_key_test ON test.keytest (date_added, hash_key); Operation successful Timer 25.904 msec 2 rows sql>insert into test.keytest (date_added, hash_key, dimension1, dimension2, metric1, metric2) VALUES (1, 'a', 1, 1, 2, 2); Rows affected 1 Timer 78.637 msec 2 rows sql>insert into test.keytest (date_added, hash_key, dimension1, dimension2, metric1, metric2) VALUES (1, 'a', 1, 1, 2, 2); Rows affected 1 Timer 31.788 msec 2 rows sql>select * from test.keytest; select * from test.keytest; +------------+----------------------------------+------------+------------+---------+---------+ | date_added | hash_key | dimension1 | dimension2 | metric1 | metric2 | +============+==================================+============+============+=========+=========+ | 1 | a | 1 | 1 | 2 | 2 | | 1 | a | 1 | 1 | 2 | 2 | | 1 | a | 1 | 1 | 2 | 2 | | 1 | a | 1 | 1 | 2 | 2 | +------------+----------------------------------+------------+------------+---------+---------+ 4 tuples Timer 18.083 msec 4 rows I can't seem to get monetdb to refuse to add the rows. I then tried: sql>CREATE TABLE test.keytest2 ( more> date_added int NOT NULL, more> key int NOT NULL, more> dimension1 int NOT NULL, more> dimension2 int NOT NULL, more> metric1 int NOT NULL, more> metric2 int NOT NULL, more> more> CONSTRAINT key_test2 UNIQUE (key,date_added) more>); Operation successful Timer 167.384 msec 0 rows sql>insert into test.keytest2 (date_added, key, dimension1, dimension2, metric1, metric2) VALUES (1, 1, 1, 1, 2, 2); Rows affected 1 Timer 1.693 msec 0 rows sql>insert into test.keytest2 (date_added, key, dimension1, dimension2, metric1, metric2) VALUES (1, 1, 1, 1, 2, 2); !SQLException:assert:INSERT INTO: UNIQUE constraint 'keytest2.key_test2' violated 0 tuples Timer 66.634 msec 0 rows sql>select * from test.keytest2; select * from test.keytest2; +------------+-------+------------+------------+---------+---------+ | date_added | key | dimension1 | dimension2 | metric1 | metric2 | +============+=======+============+============+=========+=========+ | 1 | 1 | 1 | 1 | 2 | 2 | +------------+-------+------------+------------+---------+---------+ 1 tuple Timer 140.707 msec 1 rows Which worked as expected. Is this a bug or is it by design? Thanks, Guillaume

2 2

[MonetDB-users] segmentation fault at startup
by Matthew Jones 06 Oct '09

06 Oct '09

After a spontaneous reboot while the database was idle, it now won't come back up due to a segmentation fault.... is there any way to recover from this? # /usr/bin/mserver5 --config=/etc/monetdb5.conf --dbname=qa-test-1 --dbinit="include sql;" --set monet_daemon=yes --set mapi_open=false --set mapi_autosense=true --set mapi_port=50001 --set monet_vault_key=/var/MonetDB5/dbfarm/qa-test-1/.vaultkey # MonetDB server v5.14.0, based on kernel v1.32.0 # Serving database 'qa-test-1', using 8 threads # Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information # Listening for connection requests on mapi:monetdb://127.0.0.1:50002/ # MonetDB/SQL module v2.32.0 loaded Segmentation fault Program received signal SIGSEGV, Segmentation fault. [Switching to Thread 0x7fe8592906e0 (LWP 5538)] 0x00007fe8582faa29 in strPut () from /usr/lib/libbat.so.1 (gdb) (gdb) bt #0 0x00007fe8582faa29 in strPut () from /usr/lib/libbat.so.1 #1 0x00007fe858259288 in BATappend () from /usr/lib/libbat.so.1 #2 0x00007fe858571e83 in ?? () from /usr/lib/libbat.so.1 #3 0x00007fe8585729e9 in ?? () from /usr/lib/libbat.so.1 #4 0x00007fe858573dc4 in logger_create () from /usr/lib/libbat.so.1 #5 0x00007fe84744f0c5 in ?? () from /usr/lib/MonetDB5/lib/lib_sql.so #6 0x00007fe847449245 in store_init () from /usr/lib/MonetDB5/lib/lib_sql.so #7 0x00007fe847415346 in mvc_init () from /usr/lib/MonetDB5/lib/lib_sql.so #8 0x00007fe8473d6b9b in SQLprelude () from /usr/lib/MonetDB5/lib/lib_sql.so #9 0x00007fe858d80ef1 in ?? () from /usr/lib/libmonetdb5.so.5 #10 0x00007fe858d8c471 in runMAL () from /usr/lib/libmonetdb5.so.5 #11 0x00007fe858d7aa74 in MALengine () from /usr/lib/libmonetdb5.so.5 #12 0x00007fe858d797b1 in callString () from /usr/lib/libmonetdb5.so.5 #13 0x0000000000402976 in main () 73, Matthew W. Jones (KI4ZIB) http://matburt.net

1 0

[MonetDB-users] 'deadcode' should be used at least once
by Guillaume Theoret 06 Oct '09

06 Oct '09

I was doing concurrent inserts (just running monetdb_query('INSERT INTO ...'); in a loop) with 2 workers. After ~172,000 inserts on the first worker I got this message: Error: SQLException:optimizer: 'deadcode' should be used at least once !SQLException:optimizer: pipeline set to 'inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex' And at the same time on the second worker I got: Error: SQLException:optimizer: 'multiplex' should be the last !SQLException:optimizer: 'deadcode' should be used at least once !SQLException:optimizer: pipeline set to 'inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex' Does anyone know what this might mean? At first I thought I may have made too big of a transaction but it seems monetdb runs in autocommit mode by default. Thanks, Guillaume

1 0

[MonetDB-users] loading RDF data in MonetDB
by Medha Atre 06 Oct '09

06 Oct '09

Hi, I intend to use MonetDB for some of my experimental work using RDF data. I was wondering if there is an easy way to load RDF data (in NTriples format) in MonetDB making use of the column-wise vertical partitioning of the RDF data, based on properties/predicates in the RDF data. Some pointers or help regarding this is much appreciated. I am sorry if this is not the correct forum to post this message. Thanks. Medha

2 1

[MonetDB-users] Download link broken?
by Guillaume Theoret 05 Oct '09

05 Oct '09

Hi, I tried to download the linux version of MonetDB/SQL on this page http://monetdb.cwi.nl/projects/monetdb//Download/ but both the lzma and bz2 links 404. I instead followed the Ubuntu instructions available here: http://monetdb.cwi.nl/downloads/Ubuntu/ and it worked fine but I thought I'd point out the above. Thanks, Guillaume

3 4

[MonetDB-users] Query time problem
by Chris Baros 05 Oct '09

05 Oct '09

Hi I am using Monetdb xquery in a Windows platform, I want to measure the timing in some queries. But every time I run a query, I see that the "Query time" increases. If I restart the server, then again at the first time the Query time is normall, and by the second and after, increases again.. Do you have any ideas whats the problem? _________________________________________________________________ Show them the way! Add maps and directions to your party invites. http://www.microsoft.com/windows/windowslive/products/events.aspx

2 2

[MonetDB-users] current_timestamp in windows is wrong
by Alex Bo. 04 Oct '09

04 Oct '09

Hi, I am running Feb09 and Aug09 on Windows. If I use CURRENT_TIMESTAMP / LOCALTIME / LOCALTIMESTAMP then I get the correct date but the time is 2 hours early. (I am running from time zone UTC +02:00) Is this a bug? -- View this message in context: http://www.nabble.com/current_timestamp-in-windows-is-wrong-tp25736255p2573… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Announcement: New Aug2009-SP1 bugfix release of MonetDB suite
by Sjoerd Mullender 30 Sep '09

30 Sep '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the Aug2009-SP1 bug fix release of the MonetDB suite of programs. This is the first bug fix release for the Aug2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb//Development/Releases/Aug2009/#Aug20…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

2 2

[MonetDB-users] xqueries from web apps and cgi scripts: ruby mapi interface ?
by Axel Belinfante 24 Sep '09

24 Sep '09

First of all, I'm a monetdb/xquery/ruby novice. I'm trying to do xqueries from the web in two ways: from a ruby-on-rails application, and from a cgi script. For the cgi script I use (a perl wrapper around) mclient, which seems to work ok. The remainder of this mail is about the access from ruby-on-rails. For the ruby-on-rails application, I typically have to do relatively small queries. The heart of the xqueries is in xquery module files (partly 'static', partly generated 'dynamically' from user data entered in web forms) and thus the queries to be done from ruby-on-rails are rather small: import the module, and invoke the right function with some parameters. I started using xrpc. However, I'm encountering issues that might be related to the fact that xrpc uses one backend, and mclient (by default) uses another one. (Being an xquery novice) I've also encountered some differences between the xquery support by both backends. I then started looking at the mapi interface, because that would allow the use of the same backend from both webapp an cgi scripts. To my understanding there are a couple of different routes possible, and I'm not sure what would be the best way. - use the native ruby code present in the MonetDB distribution this I tried, but it seems to not fully up-to-date/working in the Aug-2009 distribution at least, I had to hack MonetDBConnection.rb to make it work - use the swig mapi wrapper (via http://rubyforge.org/projects/monetdb-ror) I did not try that yet - somehow wrap mclient (using something like fork/exec from ruby) did not try that yet, but I have been using mclient to try queries - use libmapi to build my own translation daemon/program, that is kind of like mclient but e.g. without the prompts etc, that receives/sends xqueries/responses as strings on a socket (or so), and talks mapi to the database. I did not try this; I did compile and run the sample mapi program, which could be used as a start, I guess I'm kind of looking for comments, and in particular I'm curious about the status of the native ruby code included in the distribution - I would prefer to use that, but for some of the basic things I looked at the mapi C library seems to do things in a more involved way than the ruby code, which makes me wonder. On the other hand, it seems that for xquery support the library mainly has to pass strings around - not all the complicated things that seem to be necessary for, for example, the sql support. Thanks, Axel.

2 2

[MonetDB-users] functions in group by
by mkurtulus 22 Sep '09

22 Sep '09

Hello, in our attempt to use monetdb as a backend for Mondrian, we are running into trouble with queries that Mondrian generates where functions are used in group by. eg. select substring('string',1,2) from mytable group by substring('string',1,2); Monet complains about a syntax error... On the contrary, using this syntax works: select substring('string',1,2) as col from mytable group by col; We have found a closed bug (http://sourceforge.net/tracker/index.php?func=detail&aid=946935&group_id=56…) in sourceforge that says it is not a bug, as using functions in group by is not supported in standard sql'99. We have thought of modifying Mondrian query generator to use the supported syntax... but the supported syntax is _not_ supported by Oracle ! So not supporting Oracle in favor of Monet is not (yet :) an option... Also notice that MS Sqlserver does not support aliases in group by either. Some even state that it is not standard sql... Reading the BNF was not of great help to me :-) Would you think supporting functions in group by could be done ? Mehmet -- Open WebMail Project (http://openwebmail.org)

5 7

[MonetDB-users] dump & restore errors
by Alex Bo. 21 Sep '09

21 Sep '09

Hi, I'm failing to restore a dump from Feb09 to Aug09. I get these errors continuously when I try to restore: 0 tuples !current transaction is aborted (please ROLLBACK) !current transaction is aborted (please ROLLBACK) !current transaction is aborted (please ROLLBACK) !current transaction is aborted (please ROLLBACK) !current transaction is aborted (please ROLLBACK) !current transaction is aborted (please ROLLBACK) !current transaction is aborted (please ROLLBACK) !current transaction is aborted (please ROLLBACK) !current transaction is aborted (please ROLLBACK) The problem is that the error messages aren't descriptive, I can't know what's going on. Any ideas? Thanks, Alex. -- View this message in context: http://www.nabble.com/dump---restore-errors-tp25530320p25530320.html Sent from the monetdb-users mailing list archive at Nabble.com.

4 3

[MonetDB-users] Two count(*) in query with LIMIT crashes Monet
by Alex Bo. 17 Sep '09

17 Sep '09

Hi, I am running FebSP2 on Windows. The following query crashes Monet: SELECT COUNT (*) AS c1, COUNT (*) AS c2 FROM t2 limit 100 The following queries do work: 1. Same but with only 1 aggregation field: SELECT COUNT (*) AS c1 FROM t2 limit 100 2. Same but without LIMIT: SELECT COUNT (*) AS c1, COUNT (*) AS c2 FROM t2 This seems like a bug. Thanks, Alex. -- View this message in context: http://www.nabble.com/Two-count%28*%29-in-query-with-LIMIT-crashes-Monet-tp… Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] Aug2009 - ubuntu/out of memory
by dariuszs 15 Sep '09

15 Sep '09

Hi, I've installed the Aug2009 release on Ubuntu 64bit and it brings my system to a halt - 'out of memory', every time I try to load file into a table? Previous releases work fine. Dariusz.

2 3

[MonetDB-users] server crashes (may2009-sp2)
by Lazaros Koromilas 11 Sep '09

11 Sep '09

the scenario is: - create a large document with xmlgen: http://www.ins.cwi.nl/projects/xmark/Assets/unix.c - load it _updatable_ into monetdb/xquery - query many times with the current setup, it always segfaults the server at the 4th attempt. re-produce with: # xmlgen -f 1 > xmlgen-f1.xml -rw-r--r-- 112M 2009-09-11 18:24 xmlgen-f1.xml # echo 'pf:add-doc("'$PWD'/xmlgen-f1.xml", "xmlgen-f1", "xmlac", 10)' \ | mclient -lx # echo 'doc("xmlgen-f1")//africa//item' | mclient -lx > /dev/null # echo 'doc("xmlgen-f1")//africa//item' | mclient -lx > /dev/null # echo 'doc("xmlgen-f1")//africa//item' | mclient -lx > /dev/null # echo 'doc("xmlgen-f1")//africa//item' | mclient -lx > /dev/null MAPI = monetdb@localhost:50000 ACTION= read_line QUERY = doc("xmlgen-f1")//africa//item ERROR = Connection terminated other info: # uname -a Linux redrawn 2.6.30-ARCH #1 SMP PREEMPT Wed Sep 9 12:37:32 UTC 2009 i686 Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz GenuineIntel GNU/Linux # Mserver --version MonetDB server v4.30.4 (32-bit), based on kernel v1.30.4 (32-bit oids) Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Configured for prefix: /usr/local Libraries: libpcre: 7.9 2009-04-11 (compiled with 7.9) openssl: OpenSSL 0.9.8k 25 Mar 2009 (compiled with OpenSSL 0.9.8k 25 Mar 2009) Compiled by: root@redrawn Compilation: gcc -O2 Linking : /usr/bin/ld i'll try the latest stable also. i think there was no problem with august2008 release. any help is appreciated. thanx, lazaros. -- http://www.ics.forth.gr/~koromil

1 0