- users-list - monetdb.org

[MonetDB-users] MonetDB as server side environment
by bryan rasmussen 18 May '08

18 May '08

Hi, I'm thinking about moving some applications I have running in eXist to MonetDB, just to gauge performance and possibilities. These applications take parameters from the querystring, is there an example of accessing the querystring in a MonetDB Xquery XQL file when it runs? Best Regards, Bryan Rasmussen

3 2

[MonetDB-users] MonetDB V 4.22 installation on Mac OS X 10.5.2 and Mac OS X 10.4.0.
by Irini Fundulaki 16 May '08

16 May '08

Hi, I have the following problems with MonetDB XQuery Release Feb 2008, V. 4.22 on Mac OS X 10.5.2 and Mac OS X 10.4.0. 1) Mac OS X 10.5.2: a) I was not able to install MonetDB from sources. I downloaded MonetDB-Feb2008-SuperBall.bz2 and followed the instructions in http://monetdb.cwi.nl/projects/monetdb//MonetDB/Documentation/Linux-Install…. I successfully installed MonetDB, clients and MonetDB4-server, but when installing MonetDB4-XQuery I had the following error: Undefined symbols: "_embedded_mil", referenced from: _main in prog.o ld: symbol(s) not found collect2: ld returned 1 exit status make[5]: *** [Mbeddedxq] Error 1 make[4]: *** [all] Error 2 make[3]: *** [all-recursive] Error 1 make[2]: *** [all] Error 2 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 b) by calling monetdb-install.sh. MonetDB was installed with no problems. Nevertheless, mclient with a simple query (e.g., <example>hello</example) stalled. Mserver stalled when executing xmldb_print(); 2) Mac OS X 10.4.0 a) I was able to install MonetDB XQuery Release Feb 2008, V. 4.22 using monetdb-install.sh. Mserver did not stall with xmldb_print(). mclient for the same query exhibited different behaviors: that is, sometimes it stalled, and others not (again, the same simple query as before). I had downloaded MonetDB on September 2007, and installed it on Mac OS X 10.4.0. I had no problem with that version. Thanks for looking into it, Irini

1 0

[MonetDB-users] multi-query optimization?
by Chinyi Woo 16 May '08

16 May '08

Hello, I have a set of xqueres, which need to be run against a xml doc. In my xqueries, there are many common subexpressions. May I ask you whether MonetDB does any multi-query optimization, or the current version of MonetDB runs them sequentially? Thanks Chinyi

2 1

[MonetDB-users] question about composite uniqueness constraints
by Drew Sky 15 May '08

15 May '08

Hi, I have a question about creating composite uniqueness constraints in monetdb. Say I create the following table called test_property with 3 columns: subject, p1, p2. I want uniqueness contraints for each pair of (subject, p1) and (subject, p2). I try to do this with the following: sql>create table test_property(subject integer, p1 integer, p2 integer, unique(subject, p1), unique(subject, p2)); sql>\d test_property CREATE TABLE "sys"."test_property" ( "subject" int, "p1" int, "p2" int, CONSTRAINT "test_property_subject_p2_unique" UNIQUE ("subject"), CONSTRAINT "test_property_subject_p1_unique" UNIQUE ("subject", "p2", "p1") ); But somehow, I end up with a constraint on "subject" by itself and one on ("subject", p2, p1). Is this a bug in monetdb or am I missing something? I ran the exact same commands in postgres and I got my expected results (2 uniqueness contraints on (subject, p1) and (subject, p2)). I tried also creating the table first, then adding columns and the uniqueness constraint after using ALTER TABLE, but I got the same results. Does anyone see something I'm doing wrong? Thanks Andrew

3 2

[MonetDB-users] Space measurement and data compression in monetdb
by Iftikharn 15 May '08

15 May '08

I have two queries regarding monetdb: Is it possible to measure that how much space/memory each table has occupied? and Is is possible to compress the data (by using a command...)? Regards, Iftikhar -- View this message in context: http://www.nabble.com/Space-measurement-and-data-compression-in-monetdb-tp1… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] broken links on prepared queries
by Chinyi Woo 14 May '08

14 May '08

Hello I have a set of xqueries and want to convert all of them into prepared queries for better performance. I want to see several concrete examples to know how to do this. However, the link at http://monetdb.cwi.nl/XQuery/Version4/Documentation/PreparedQueries/q.xq and http://monetdb.cwi.nl/XQuery/Version4/Documentation/PreparedQueries/m.xq are broken. Could anyone please fix it? thanks Chinyi

2 1

[MonetDB-users] How to measure the performance of a SQL query
by Allan12 14 May '08

14 May '08

How could we measure the performance of a SQL query. I have a table with 100,000 rows and if I peform a SQL query on it, what statistical data I could get. -- View this message in context: http://www.nabble.com/How-to-measure-the-performance-of-a-SQL-query-tp17227… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] SQL Query performance
by Allan12 14 May '08

14 May '08

How could we measure the performance of a SQL query. I have a table with 100,000 rows and if I peform a SQL query on it, what statistical data I could get in addition to time. -- View this message in context: http://www.nabble.com/SQL-Query-performance-tp17227222p17227222.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] How could I run a set of XQuery in a batch?
by Chinyi Woo 14 May '08

14 May '08

Hello, everyone May I ask you how to run a set of XQueries in a batch? I am using MonetDB v4.22.0 on Redhat Linux. I have a set of XQueries. I want to run them against a single xml document and collect the running time. Currently I am only able to submit one XQuery at a time at the mclient commandline. Is there anyway for me to send all my XQueries in a batch and get the total running time? I also have another question. Does MonetDB handle multi-query optimization? I mean if more than one query have common subexpressions, will MonetDB evaluate them just once? Thanks in advance. Chinyi

2 1

[MonetDB-users] A sanity check on MondetDB/XQuery performance
by Nils Grimsmo 13 May '08

13 May '08

Using the "super-ball" from February. I am running some queries, and just want to check if my performance is sane. Are there more indexes I can ask to get built to increase performance? I don't ask for an accurate verification, just a hint of whether or not we are within an order of magnitude of what seems right :) $ Mserver --dbinit="module(pathfinder);" --set mapi_port=60000 $ echo 'pf:add-doc("path/dblp.xml", "dblp.xml")' | mclient --lx -p60000 --time Timer 73068.138 msec $ echo 'pf:documents()' | mclient -lx -p60000 <document updatable="false" url="path/dblp.xml" collection="dblp.xml">dblp.xml</document> $ cat dblp_q7.xq count(doc("dblp.xml")/dblp/*[author="Michael Stonebraker" and author="Hector Garcia-Molina" and year > 1950 ]/title) $ mclient -lx -p 60000 --time < dblp_q7.xq 4 Timer 15512.186 msec (Repeated multiple times for warm-up) My dblp.xml is 441 MB. Mserver uses 1.9 of 3.4 GB memory. $ cat /proc/cpuinfo <snip> model name : AMD Athlon(tm) 64 Processor 3500+ cpu MHz : 2210.763 cache size : 512 KB The dbfarm resides on a WD740GD (http://techreport.com/articles.x/6390) Klem fra Nils

3 3

[MonetDB-users] mclient command line history question
by Drew Sky 12 May '08

12 May '08

Hello, I am having trouble using the command line history feature of mclient. After I run a query at the command line, I can't re-use the same query by pressing the up-arrow. From documentation, it seems like I should be able to do this. Is this a feature I should have compiled in, when building from source code? When I press the up-arrow after a query I get sql>^[[A I've tried adding the --history and --interactive options but it doesn't help. I've also tried changing the terminal setting to other modes (I'm using linux) but this doesn't help either. Can anyone help me out? Thanks, Andrew ____________________________________________________________________________________ Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ

2 1

[MonetDB-users] php5 and windows
by Michiel Kamermans 08 May '08

08 May '08

Hi all, I've been hearing interesting things about MonetDB so I figured I'd see how it performed with the data that my website uses (several million cross-referencing records of Japanese/English dictionary data) by installing it for use with PHP5... but I ran into a problem come actual PHP interfacing. Which steps must be taken to get PHP5 to properly interface with MonetDB on a windows machine? The online documentation (http://homepages.cwi.nl/~mk/MonetDB/The-PHP-Library.html) has a wonderful, if slightly useless, "TODO" for the windows instruction section, and the self-help approach of simply placing the php_monetdb.dll file in PHP's extensions directory and adding an "extension=php_monetdb.dll" to the PHP.ini file leads to PHP throwing up a terminal error when it then tries to run. Any help is appreciated. - Mike Kamermans

1 0

[MonetDB-users] Limit statements
by Henrik Vendelbo 07 May '08

07 May '08

The section on sorting and limit 3.1.7.2 Select lists, distinct, sorting, limit Is very brief and doesn't seem to describe limit/sort, does this mean that LIMIT/OFFSET is supported or that ROW_NUMBER should be used? Henrik

2 1

[MonetDB-users] MonetDB/XQuery not coming back
by Richard Eckart 06 May '08

06 May '08

Hi there, I am looking again into MonetDB/XQuery. A colleague of mine ran a little test on MonetDB/XQuery and made the experience that when starting the server and importing some documents, a query is possible. But when killing the server (running as deamon - killed with CTRL-C), restarting it the same query never comes back. He tried this under FreeBSD and I am experiencing the same problem now on Mac OS X 10.4.11. I turned on debug logging (level 255) but did not see anything that would help me. The only thing I really did see were lines like this while the client was hanging and the CPU running at 100% load. # batstamp(-1418) = -292 # batstamp(1663) = -84581 # batstamp(1662) = -84582 # batstamp(1662) = -84583 # batstamp(-1659) = -84584 # batstamp(1662) = -84585 # batstamp(1449) = 0 # batstamp(1633) = 0 Killing the client the server would still be running producing these lines with the numbers keeping on sinking (getting more negative). After killing the server (CTRL-C) and restarting it I can browse the database using the web interface, but whenever I run the query it goes bye-bye. The query that ran successfully directly after import but not after restart is this: > declare namespace leveler="urn:xmlns:sfb441:leveler"; > > let $lexical := > pf:documents()[@collection eq 'tuebadz' and > fn:starts-with(., 'Corpus-Lexical')]/fn:string(text > ()) > > let $verbs := ( > for $doc in $lexical > return fn:doc($doc)//tok[fn:starts-with(fn:string(pos/ > @leveler:text), "V")] > ) > > return element results { > attribute matches { count($verbs) }, > for $verb in $verbs/fn:string(orth) > order by $verb > return element verb { $verb } > } If I slightly modify the query removing /fn:string(orth), the query runs well. I played around a little and whenever I try to access the "orth" element in any way it goes bye-bye. The "tok" elements have another child called "pos" which I can access just fine. The difference is that "orth" contains a text node while "pos" is an empty tag. Example: > <tok id="s_7_n_15"> > <orth>seien</orth> > <pos xmlns:leveler="urn:xmlns:sfb441:leveler" leveler:text="VAFIN" > func="HD" /> > </tok> Do you have any ideas how to fix/handle this problem? Thank you very much. Cheers, Richard

1 0

[MonetDB-users] Tutorial for database scripting language MIL?
by jz＠uva 06 May '08

06 May '08

Hi all, Does someone have a tutorial for the database scripting language MIL? I am currently checking pftijah.mx, but I am wondering whether there is a better option than trying to reverse engineer things. Thanks, junte

3 2

[MonetDB-users] MySQLError ?
by Henrik Vendelbo 06 May '08

06 May '08

I was having a look at the __init__.py module header for MonetSQLdb, and saw the following: __all__ = [ 'BINARY', 'Binary', 'Connect', 'Connection', 'DATE', 'Date', 'Time', 'Timestamp', 'DateFromTicks', 'TimeFromTicks', 'TimestampFromTicks', 'DataError', 'DatabaseError', 'Error', 'FIELD_TYPE', 'IntegrityError', 'InterfaceError', 'InternalError', 'MySQLError', 'NULL', 'NUMBER', 'NotSupportedError', 'DBAPISet', What is the reference to MySQLError doing in the code? I suppose it is just ignored by the interpreter but surely it is a mistake. Warning, OperationalError, and ProgrammingError are not exported by the module. Henrik

2 1

[MonetDB-users] Fwd: [ monetdb-Bugs-1957794 ] How to debug on Windows OS?
by Lefteris 05 May '08

05 May '08

Please read carefully the following comments to avoid opening a third bug with the same question. thank you ---------- Forwarded message ---------- From: SourceForge.net <noreply(a)sourceforge.net> Date: Mon, May 5, 2008 at 10:30 AM Subject: [ monetdb-Bugs-1957794 ] How to debug on Windows OS? To: noreply(a)sourceforge.net Bugs item #1957794, was opened at 2008-05-05 09:50 Message generated for change (Comment added) made by lsidir You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=482468&aid=1957794&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed >Resolution: Rejected Priority: 5 Private: No Submitted By: lxwandy (lxwandy) Assigned to: Nobody/Anonymous (nobody) Summary: How to debug on Windows OS? Initial Comment: Hi.. I want to know about the method of debugging MonetDB on Windows OS. After compiering MonetDB use "namke" , how can I debug it. Is special debug tool needed? ---------------------------------------------------------------------- >Comment By: Lefteris Sidirourgos (lsidir) Date: 2008-05-05 10:30 Message: Logged In: YES user_id=1856546 Originator: NO Hi, this question will be answered if you post it to the monetdb-user mailing list. See http://monetdb.cwi.nl/projects/monetdb/Development/MailChannels/index.html about our mailing lists. This is the bugtracker, a tool to submit bugs rather than questions. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=482468&aid=1957794&group_…

1 0

[MonetDB-users] Django Backend: SQL column types
by Henrik Vendelbo 04 May '08

04 May '08

Hi guys, I am jumping straight into the deep end with Monet. My first task is to implement a backend for Django written in Django. I need to map the field types to SQL column types, and that is for the most part easy, yet a few questions: 1) Is 'integer' accepted, or do I have to use 'int' 2) How do I specify a floating point with specified max_digits and decimal_places? I didn't see support for numeric in the docs. 3) How do I specify unsigned integers? unsigned or check expression? Is there a text field, or should I use varchar/clob ? These are my definitions as they stand so far: DATA_TYPES = { 'AutoField': 'serial', 'BooleanField': 'boolean', 'CharField': 'varchar(%(maxlength)s)', 'CommaSeparatedIntegerField': 'varchar(%(maxlength)s)', 'DateField': 'date', 'DateTimeField': 'timestamp', 'FileField': 'varchar(100)', 'FilePathField': 'varchar(100)', 'FloatField': 'numeric(%(max_digits)s, %(decimal_places)s)', 'ImageField': 'varchar(100)', 'IntegerField': 'int', 'IPAddressField': 'char(15)', 'ManyToManyField': None, 'NullBooleanField': 'bool', 'OneToOneField': 'int', 'PhoneNumberField': 'varchar(20)', 'PositiveIntegerField': 'integer unsigned', # TODO how should this be handled??? 'PositiveSmallIntegerField': 'smallint unsigned', # TODO how should this be handled??? 'SlugField': 'varchar(%(maxlength)s)', 'SmallIntegerField': 'smallint', 'TextField': 'text', 'TimeField': 'time', 'USStateField': 'varchar(2)', } Thanks, Henrik

3 2

[MonetDB-users] Performance issues with queries in SQL
by Nils Grimsmo 01 May '08

01 May '08

I have tables with around 12 million rows and large primary keys. I find the performance for various queries to be rather strange. * Why is Q2 (see below) so much slower than Q1? It is actually faster for me to use Q1 and do the rest of the matching myself. * Why is Q3 so immensely much faster than Q1? I understand that the first part of the primary key is selective in Q3. Do I understand right if Q1 scans until "type" matches, then scans until "name" matches, then scans until "value" matches? No indexes are put on disk, right? Then the matching for Q3 should be scan until "value" matches, which shouldn't be more than at most three times faster, right (if three columns are read instead of one for Q1)? I do Q1 twice to look for cash effects, but none are seen... Could some columns from the table "value" be cached and kept, without giving room for those from "type_name_value"? * Q4 has the same performance as Q1, as expected. * Why isn't Q5 faster than Q6? 82% of the rows have type=3. Fewer should be scanned to find that "!!foo" doesn't exist than for "~~foo", as "!" has a low ASCII value, while "~" is high. (See COUNT queries at the bottom.) Klem fra Nils Q1: SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' Q2: SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' AND doc = 1 AND nenc = '1.1.1.1' AND pos = 4 Q3: SELECT * FROM value WHERE value = 'Jurgen Annevelink' AND type = 3 AND name = 'author' Q4: SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = '__bar' Q5: SELECT * FROM type_name_value WHERE type = 3 AND name = '!!foo' AND value = '__bar' Q6: SELECT * FROM type_name_value WHERE type = 3 AND name = '~~foo' AND value = '__bar' Q7: SELECT * FROM type_name_value WHERE type = 3000 AND name = '__foo' AND value = '__bar' See runs below. Number of rows SELECT COUNT(type) FROM type_name_value % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 8 # length [ 12165109 ] Query time: 0.066192 SELECT COUNT(type) FROM value % nilsgri.value # table_name % count_no_nil_type # name % int # type % 8 # length [ 12165109 ] Query time: 0.058111 The PRIMARY KEY of type_name_value is (type,name,value,doc,nenc,pos) The PRIMARY KEY of value is (value,doc,nenc,pos) Q1: Search 3 first, match 3 first. SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 6, 17, 1, 12, 8, 3, 5 # length [ 3, "author", "Jurgen Annevelink", 1, "1.1.1.1", 4, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.23579.2.1", 724888, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.2487.3.1", 81996, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.42.2.1", 1071, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.533986.2.1", 17294725, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.576139.3.1", 18745432, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.944085.1.1", 30104242, 107, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.99173.2.1", 3191470, 56, true ] Query time: 1.643438 Q1: Repeat to check for disk cache effects. SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 6, 17, 1, 12, 8, 3, 5 # length [ 3, "author", "Jurgen Annevelink", 1, "1.1.1.1", 4, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.23579.2.1", 724888, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.2487.3.1", 81996, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.42.2.1", 1071, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.533986.2.1", 17294725, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.576139.3.1", 18745432, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.944085.1.1", 30104242, 107, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.99173.2.1", 3191470, 56, true ] Query time: 1.615900 Q2: Search entire, match entire. SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' AND doc = 1 AND nenc = '1.1.1.1' AND pos = 4 % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 6, 17, 1, 7, 1, 1, 5 # length [ 3, "author", "Jurgen Annevelink", 1, "1.1.1.1", 4, 5, true ] Query time: 11.073827 Q3: Use table value instead. SELECT * FROM value WHERE value = 'Jurgen Annevelink' AND type = 3 AND name = 'author' % nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value # table_name % value, doc, nenc, pos, type, name, pathid, complete # name % clob, int, varchar, int, int, varchar, int, boolean # type % 17, 1, 12, 8, 1, 6, 3, 5 # length [ "Jurgen Annevelink", 1, "1.1.1.1", 4, 3, "author", 5, true ] [ "Jurgen Annevelink", 1, "1.23579.2.1", 724888, 3, "author", 56, true ] [ "Jurgen Annevelink", 1, "1.2487.3.1", 81996, 3, "author", 5, true ] [ "Jurgen Annevelink", 1, "1.42.2.1", 1071, 3, "author", 5, true ] [ "Jurgen Annevelink", 1, "1.533986.2.1", 17294725, 3, "author", 56, true ] [ "Jurgen Annevelink", 1, "1.576139.3.1", 18745432, 3, "author", 56, true ] [ "Jurgen Annevelink", 1, "1.944085.1.1", 30104242, 3, "author", 107, true ] [ "Jurgen Annevelink", 1, "1.99173.2.1", 3191470, 3, "author", 56, true ] Query time: 0.000477 Q4: Search 3 first, match 2 first. SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = '__bar' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 0, 0, 1, 0, 1, 1, 5 # length Query time: 1.617259 Q5: Search 3 first, match 1 first. '!' early in alphabet. SELECT * FROM type_name_value WHERE type = 3 AND name = '!!foo' AND value = '__bar' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 0, 0, 1, 0, 1, 1, 5 # length Query time: 0.530727 Q6: Search 3 first, match 1 first. '~' late in alphabet. SELECT * FROM type_name_value WHERE type = 3 AND name = '~~foo' AND value = '__bar' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 0, 0, 1, 0, 1, 1, 5 # length Query time: 0.534592 Q7: Search 3 first, match 0 first. SELECT * FROM type_name_value WHERE type = 3000 AND name = '__foo' AND value = '__bar' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 0, 0, 1, 0, 1, 1, 5 # length Query time: 0.000407 Number of rows with type and name mathcing. SELECT COUNT(type) FROM type_name_value WHERE type = 3 AND name = 'author' % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 7 # length [ 2730959 ] Query time: 0.683863 Number of rows with type mathcing. SELECT COUNT(type) FROM type_name_value WHERE type = 3 % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 8 # length [ 10020569 ] Query time: 0.032573 SELECT COUNT(type) FROM type_name_value WHERE type = 3 AND name < '!!foo' % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 1 # length [ 0 ] Query time: 0.161186 SELECT COUNT(type) FROM type_name_value WHERE type = 3 AND name < '~~foo' % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 8 # length [ 10020569 ] Query time: 0.341732 Number of rows with type mathcing. real 0m18.372s user 0m0.005s sys 0m0.002s

2 3

[MonetDB-users] How to set the memory limit for monetDB.
by Kang Zhang 30 Apr '08

30 Apr '08

I am using the latest version of monetDB from the web-site(the super source tarball). My machine is a X86-64 machine with a red-hat installed on it. When I insert data into monetDB, it always requires memory from the system. Then it will be crashed with running out of memory. Is there a way to set the limit for memory used by monetDB ? I've read the docs on the web site and can't get what I need from that. Thank you. -- ------------------------------------------------------------ Kang Zhang Computer Science Dept. Shanghai Jiao Tong University

3 7

[MonetDB-users] Problems with parameters to mapi_param*()
by Nils Grimsmo 28 Apr '08

28 Apr '08

I am having some problems with the functions mapi_param*(). 1. It seems mapi_param() really wants a char* cast to a char**. (See the inner workings of mapi_param() vs. mapi_param_string().) 2. If mapi_param(), mapi_param_string() and mapi_param_type() get a char*, the value used in the query does not change as the char* is updated. Using mapi_bind_var( , , MAPI_INT, int*) and mapi_bind_var( , , MAPI_VARCHAR, char**) works as expected, while mapi_param_type( , , MAPI_INT, MAPI_INT, int*) and mapi_param_type( , , MAPI_VARCHAR, MAPI_VARCHAR, char**) do not. Is there something wrong with interface, or am I just using it wrong? Here is how I have tried using the functions: #include <cassert> #include <cstdio> #include <cstdlib> #include <cstring> #include <Mapi.h> using namespace std; Mapi dbh; void check(MapiHdl hdl, int ret = MOK, bool fatal = true) { if (ret != MOK || hdl == NULL || mapi_error(dbh)) { if (hdl) { mapi_explain_result(hdl,stderr); } else { mapi_explain(dbh,stderr); } if (fatal) assert(0);//exit(-1); } } void paramInt(MapiHdl hdl, int fldnr, int* val) { int ret = mapi_param_type(hdl, fldnr, MAPI_INT, MAPI_INT, val); check(hdl, ret); } void paramStr(MapiHdl hdl, int fldnr, char** val) { // int ret = mapi_param(hdl, fldnr, val); /* Case 1: * QUERY = INSERT INTO t VALUES(1, p`) * ERROR = !SELECT: identifier 'p`' unknown * Cast to (void*) in call to mapi_param_type() in mapi_param(). */ int ret = mapi_param(hdl, fldnr, (char**)*val); /* Case 2: * Works, sort of. * Seems it wants a (char*) really. * But 'foo' is inserted the second time instead of bar. */ // int ret = mapi_param_string(hdl, fldnr, MAPI_VARCHAR, *val, NULL); /* 'foo' twice. */ // int ret = mapi_param_string(hdl, fldnr, MAPI_VARCHAR, (char*)val, NULL); /* As Case 1. */ // int ret = mapi_param_type(hdl, fldnr, MAPI_VARCHAR, MAPI_VARCHAR, val); /* As Case 1. */ // int ret = mapi_param_type(hdl, fldnr, MAPI_VARCHAR, MAPI_VARCHAR, *val); /* 'foo' twice. */ check(hdl, ret); } int main() { dbh = mapi_connect("localhost", 50000, "nilsgri", "nilsgri", "sql", "proto"); MapiHdl hdl = mapi_query(dbh, "DROP TABLE t"); check(hdl, MOK, false); mapi_close_handle(hdl); hdl = mapi_query(dbh, "CREATE TABLE t (a INT, b VARCHAR(255))"); check(hdl); mapi_close_handle(hdl); hdl = mapi_prepare(dbh, "INSERT INTO t VALUES(?, ?)"); check(hdl); int a = 1; paramInt(hdl, 0, &a); char* b1 = strdup("'foo'"); char* b = b1; paramStr(hdl, 1, &b); int ret = mapi_execute(hdl); check(hdl, ret); a = 2; char* b2 = strdup("'bar'"); b = b2; // paramStr(hdl, 1, &b); // I would like not having to do this. ret = mapi_execute(hdl); check(hdl, ret); mapi_close_handle(hdl); hdl = mapi_quick_query(dbh, "SELECT * FROM t", stderr); check(hdl, ret); mapi_close_handle(hdl); mapi_disconnect(dbh); mapi_destroy(dbh); free(b1); free(b2); }

1 0

[MonetDB-users] Is it a bug? (insert into ... select command)
by Iftikharn 24 Apr '08

24 Apr '08

Hi I need to insert some null values into a table via a procedure. I created the table and did insert two rows. One with (insert into) command and second with (insert into ..select) command. Both commands work well and I could see two rows added in result. When I used the same (insert into.. select) command in a procedure. It behaves in a strange fashion. It shows that a row has been affected, but does not show the newly added row. If the rows are counted, it gives the correct count which is (3) in this case but still I could not see the last row which is added via a procedure. ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' create sequence "ff" as integer start with 1; CREATE TABLE t1(timeid INT DEFAULT NEXT VALUE FOR "ff" PRIMARY KEY, a INT, b INT, c INT, d INT, e INT, f VARCHAR(20), g VARCHAR(20), h INT, i VARCHAR(10), j VARCHAR(10), k VARCHAR(10), l INT, m INT, n VARCHAR(10), o VARCHAR(10), p VARCHAR(10), q VARCHAR(15), r INT ); ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' And then insert a row ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' insert into t1(a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r) values(1, 1, 1, 1, 1, 'first row', 'first row',1, 'first row', 'first row', 'first row',1,1, 'first row', 'first row', 'first row', 'first row', 1); select * from t1;sql>sql>sql>sql>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>sql> sql>Rows affected 1 sql> +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ | time |a |b |c |d |e |f |g |h |i |j |k |l |m |n |o |p |q |r | : id | | | | | | | | | | | | | | | | | | | +======+==+==+==+==+==+=====+=====+==+=====+======+======+==+==+======+======+======+======+==+ | 1 |1 |1 |1 |1 |1 |firs |firs |1 |firs |first |first |1 |1 |first |first |first |first |1 | : | | | | | |t |t | |t |row |row | | |row |row |row |row | | : | | | | | |row |row | |row | | | | | | | | | | +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' Every thing is fine so far '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' sql>insert into t1(a, b, c, d, e, f, g, h) select a, b, c, d, e, f, g, h from t1 where timeid = 1; Rows affected 1 sql>select * from t1; +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ | time |a |b |c |d |e |f |g |h |i |j |k |l |m |n |o |p |q |r | : id | | | | | | | | | | | | | | | | | | | +======+==+==+==+==+==+=====+=====+==+=====+======+======+==+==+======+======+======+======+==+ | 1 |1 |1 |1 |1 |1 |firs |firs |1 |firs |first |first |1 |1 |first |first |first |first |1 | : | | | | | |t |t | |t |row |row | | |row |row |row |row | | : | | | | | |row |row | |row | | | | | | | | | | | 2 |1 |1 |1 |1 |1 |firs |firs |1 |null |null |null |n |n |null |null |null |null |n | : | | | | | |t |t | | | | |u |u | | | | |u | : | | | | | |row |row | | | | |l |l | | | | |l | : | | | | | | | | | | | |l |l | | | | |l | +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' inserted another row and it works fine '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' sql>create procedure tt() begin insert into t1(a, b, c, d, e, f, g, h) select a, b, c, d, e, f, g, h from t1 where timeid = 1; end; call tt(); select * from t1; more>more>more> sql>Rows affected 1 sql>+------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ | time |a |b |c |d |e |f |g |h |i |j |k |l |m |n |o |p |q |r | : id | | | | | | | | | | | | | | | | | | | +======+==+==+==+==+==+=====+=====+==+=====+======+======+==+==+======+======+======+======+==+ | 1 |1 |1 |1 |1 |1 |firs |firs |1 |firs |first |first |1 |1 |first |first |first |first |1 | : | | | | | |t |t | |t |row |row | | |row |row |row |row | | : | | | | | |row |row | |row | | | | | | | | | | | 2 |1 |1 |1 |1 |1 |firs |firs |1 |null |null |null |n |n |null |null |null |null |n | : | | | | | |t |t | | | | |u |u | | | | |u | : | | | | | |row |row | | | | |l |l | | | | |l | : | | | | | | | | | | | |l |l | | | | |l | +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' The problem starts now: when I try to insert the row via a procedure it shows that row effected 1 but does not show the row. ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' sql>select count(*) from t1; +--------+ | count_ | +========+ | 3 | +--------+ sql>select timeid from t1; +--------+ | timeid | +========+ | 1 | | 2 | | 3 | +--------+ sql>select * from t1; +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ | time |a |b |c |d |e |f |g |h |i |j |k |l |m |n |o |p |q |r | : id | | | | | | | | | | | | | | | | | | | +======+==+==+==+==+==+=====+=====+==+=====+======+======+==+==+======+======+======+======+==+ | 1 |1 |1 |1 |1 |1 |firs |firs |1 |firs |first |first |1 |1 |first |first |first |first |1 | : | | | | | |t |t | |t |row |row | | |row |row |row |row | | : | | | | | |row |row | |row | | | | | | | | | | | 2 |1 |1 |1 |1 |1 |firs |firs |1 |null |null |null |n |n |null |null |null |null |n | : | | | | | |t |t | | | | |u |u | | | | |u | : | | | | | |row |row | | | | |l |l | | | | |l | : | | | | | | | | | | | |l |l | | | | |l | +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ sql> ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' I could not see the 3rd row *********************************** Regards, Nadeem -- View this message in context: http://www.nabble.com/Is-it-a-bug--%28insert-into-...-select-command%29-tp1… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] MServer crashing: Random Segmentation fault
by jz＠uva 24 Apr '08

24 Apr '08

Hi all, I am using MD4 with XQuery + PF/Tijah module. I have a problem that my server sometimes/frequently crashes. I could not detect a trigger, as it occurs randomly and at any time. It gives me this error: 26747 Segmentation fault Mserver --dbinit="module(pathfinder);" but it gives me any number before it. I am not sure where I can locate the MD error log (if it exists), and how it is triggered. Help? Thanks, junte

4 9

[MonetDB-users] MALException:opt.remap:no implementation present
by McKennirey.Matthew 24 Apr '08

24 Apr '08

Our application includes multiple services that independently connect to the database. When each service connects it reads the database metadata to discover the column names, many services may start at about the same time. We are getting the following error: java.sql.SQLException: TypeException:user.s7172_2[262]:'io.stdout' undefined in: _416:any MALException:opt.remap:no implementation present at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2058) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1808) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at nl.cwi.monetdb.jdbc.MonetStatement.executeQuery(MonetStatement.java:404) at nl.cwi.monetdb.jdbc.MonetDatabaseMetaData.getTypeInfo(MonetDatabaseMetaData.java:2454) # check status of database /monetdb status name state uptime crashes BUSINESS running 1d 1h 40m 38s 3 2008-04-22 11:23:59 # try a query using mclient running on the same machine as the database ./mclient -dBUSINESS -umonetdb -Pmonetdb -lsql sql>select * from tables; !TypeException:user.s5301_3[130]:'io.stdout' undefined in: _193:any sql>select * from schemas; !TypeException:user.s5302_3[40]:'io.stdout' undefined in: _63:any sql>select * from columns; !TypeException:user.s5303_3[146]:'io.stdout' undefined in: _210:any sql>\q; When we stop and restart the merovingian demon, the problem goes away, but may reoccur the next time we try and start multiple services in short succession. Environment MonetDB MSG merovingian[12454]: starting database 'BUSINESS', up min/avg/max: 121/43165/92925, crash average: 0.00 0.30 0.10 (7-4=3) MSG BUSINESS[12459]: executing '/monetdb/bin/mserver5' for database 'BUSINESS' MSG BUSINESS[12459]: # MonetDB server v5.5.0, based on kernel v1.23.0 MSG BUSINESS[12459]: # Serving database 'BUSINESS' MSG BUSINESS[12459]: # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked JDBC Driver 1.7 (Canephora_p2 20080418 based on MCL v1.3)

3 4

Re: [MonetDB-users] very slow query execution
by ewilde 22 Apr '08

22 Apr '08

hi, first: about that bug, i'll defiantly file it. second: when i migrated this table from mssql to monetdb5 I intentionally inserted it in that order (recid,ft,val). i used COPY INTO while supplying a file that i prepared in advanced with such a sorting. when i first decided to test monetdb5 i did it because i understood it should perform better than row-oriented DBMSs (like mssql), especially in CRM-like applications. so... i now understand that monetsdb5 is actually being expected to perform BAD in that specific situation i described before (in my previous message). from my experience in building CRM applications, that kind of "left join" according to unique number (recid) is very common in CRM applications. am i missing something here?? Thanks again, ewilde.

2 1

[MonetDB-users] mserver5 process locked unkillable
by mobigital1 22 Apr '08

22 Apr '08

I was testing some queries, and for example this query has made the mserver5 process 100% CPU, which i could not kill and machine could not be rebooted. running Fedora 8 64 bit. query like this: select col1, col2, sum(col3), sum(col4), sum(col5) from thetable group by col1, col2; there are about 160 columns in the table. col1 and col2 are "smallint" col3, col4, col5 are "real" number of distinct values: in col1 is about 120 in col2 about 80 total number of rows in table is about 400M I tested the query 2 times, simpler queries work ok, like this: select col1, count(*) from thetable group by col1; this query has crashed mserver5 before, not sure if this already fixed: select col1, count(1) from thetable group col1; -- View this message in context: http://www.nabble.com/mserver5-process-locked-unkillable-tp16789362p1678936… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] very slow query execution
by ewilde 22 Apr '08

22 Apr '08

hello, this is how my table - table1(int,int,varchar) - looks like: recid | ft | val --------------------------------------- 1001 | 301 | a 1001 | 302 | b 1001 | 303 | c 1002 | 301 | d 1002 | 302 | e 1003 | 303 | f 1003 | 301 | g 1003 | 302 | h 1004 | 303 | i in reality this table has a few millions of records. for the following query: select t1.val as val1 , t2.val as val2 from table1 t1 left join table1 t2 on t1.recid=t2.recid and t2.ft=303 where t1.recid=1002 and t1.ft=301 i get the expected result: val1 | val2 --------------------- d | f the execution time of this query is very slow: ~1.5 seconds - in comparison to MSSql:0.016 seconds. the kind of a query that i really need in my production application doesn't have only one such a "left join...", but may have even 10. with 5 such "left join..."s the query execution time is ~25 seconds, which is so far slower than MSSql: 0.156 more info: 1. i run the queries from SQuirreL SQL Client. the MonetDB5 is installed\run on the same machine. the MSSql server was running on another machine in the same LAN. 2. the primary key of table1 is : recid,ft,val 3. at the beginning i had another problem, that i have got an empty result when running a simple query like this: select * from table1 t1 where t1.recid=1002 and t1.ft=301 i'm not sure about this, but i guess that this problem had been solved by creating a view such as: create view v1 as select recid,ft,val from table1 i have no clue whether these two problems related to each other, but i mentioned it since it might give you a hint for solving the other problem. thanks in advanced for any help, ewilde.

2 1

[MonetDB-users] merovingian : could not retrieve uplog information ... Too many open files
by McKennirey.Matthew 21 Apr '08

21 Apr '08

Environment MSG BUSINESS[7403]: # MonetDB server v5.4.1, based on kernel v1.22.1 MSG BUSINESS[7403]: # Serving database 'BUSINESS' MSG BUSINESS[7403]: # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked During the course of software development using MonetDB for our application database, after running for a week or ten days without incident, the merovingian daemon will suddenly stop accepting connections. The merovingian log shows MSG merovingian[19349]: database 'BUSINESS' already running since 2008-04-11 14:42:27, up min/avg/max: 0/0/0, crash average: 0.00 0.00 0.00 (1-0=0) MSG merovingian[19349]: redirecting client 192.168.1.1:29378 for database 'BUSINESS' to mapi:monetdb://dev04:50001/ ERR merovingian[19349]: client error: could not retrieve uplog information: IOException:sabaoth.getUplogInfo:unable to open file /monetdb/var/MonetDB5/dbfarm/BUSINESS/.uplog: Too many open files ERR merovingian[19349]: client error: IOException:sabaoth.getStatus:unable to open directory /monetdb/var/MonetDB5/dbfarm: Too many open files # examine the .uplog file ? dev04:/monetdb/var/MonetDB5/dbfarm/BUSINESS # cat .uplog 1207290718 1207844298 1207844305 1207846979 1207846986 1208461825 1208461935 1208463257 1208463466 There is lots of space on the disk. /monetdb status shows the database is up and running netstat shows the daemon and databases listening on their ports Although it is not possible to connect to the database via the daemon, we can connect using mclient, # connect locally using mclient /mclient -dBUSINESS -umonetdb -Pmonetdb -lsql sql> And we can run, via mclient, the same sort of queries that were being run when the daemon stopped accepting connections. It is difficult to determine the exact query that was run as the application is generating lots of different queries frequently. And we can connect to the database from other clients on the network by connecting directly to the database, bypassing the daemon (which is what we are doing for now)

2 4

Re: [MonetDB-users] [Question] data loading to MonetDB
by Martin Kersten 19 Apr '08

19 Apr '08

ks038c wrote: > How can I load large dump data into MonetDB > > I mean... > > I have "test.txt" file with "csv" format like. > > 00001|"name1"|"address1" > 00002|"name2"|"address2" > ..... > > and want to load this LARGE data into my table > > TEST( ID NUMERIC(5), NAME VARCHAR(10), ADDR VARCHAR(20) ) > > I found word "tablet.load" or "tablet.SQLload" in m5manual > but don't know whether it is the one I need or not and don't know how > to use it. > > I beg yout answer... > > > > > http://monetdb.cwi.nl/projects/monetdb/MonetDB/Version4/Documentation/Modul…

2 1

[MonetDB-users] alternate dbfarm location not working
by mobigital1 18 Apr '08

18 Apr '08

i am trying to setup the dbfarm location to be on a different share from /opt/monetdb/var directory. i modified the /opt/monetdb/etc/monetdb5.conf file to reflect the alternate path to dbfarm location, and also sql-log location. i am able to start the server with >> merogivian start <dbname> but it is very unstable and crashes when i try to import some data. I have been able to import the same data when dbfarm was under /opt/monetdb/var directory. is there something else I need to do to relocate dbfarm to another folder? the new folder is mounted to another disk. (ext3 partition) any advice would be appreciated. -- View this message in context: http://www.nabble.com/alternate-dbfarm-location-not-working-tp16715294p1671… Sent from the monetdb-users mailing list archive at Nabble.com.

3 17

[MonetDB-users] Invalid Credentials for user when restarted mserver5
by mobigital1 18 Apr '08

18 Apr '08

I imported some data into database from 6 files or so. I restarted database after each file. on latest file, after stopping the database, I decided to start it up manually and ran like this: /opt/monetdb/bin/mserver5 -dbinit="include sql;" --dbname=<bbb> --set mapi_open=true when opened mclient, it said: !InvalidCredentialsException:checkCredentials:Invalid credentials for user '....' HOWEVER, as last hope I decided to try starting again via merovigian, and I think it worked, except that it's taking its time now to sync up sql_log into the dbfarm. so for some reason starting database via merovigian and manually like above is not the same thing. Does merovigian pass some environment variables to the mserver5 process? -- View this message in context: http://www.nabble.com/Invalid-Credentials-for-user-when-restarted-mserver5-… Sent from the monetdb-users mailing list archive at Nabble.com.

3 4

[MonetDB-users] corruption on db restart
by mobigital1 17 Apr '08

17 Apr '08

I imported some millions of rows into a table: sql>select part, count(*) from frag group by part order by part; +------+-----------+ | part |count_node | +======+===========+ | 1 | 25205085 | | 2 | 25618423 | | 3 | 27380780 | | 4 | 26963069 | | 5 | 25661196 | | 6 | 27021186 | | 7 | 26058891 | | 8 | 28092822 | | 9 | 27528646 | | 10 | 26429092 | | 11 | 25194504 | | 12 | 25136210 | | 13 | 25105453 | | 14 | 24860071 | | 16 | 20672348 | | 17 | 19138139 | +------+-----------+ then I stopped the database, and wanted to start it back up to see how quickly it would come up. it took a few minutes to come up while it was comitting uncomitted transactions. When i started it up the space usage looked like this: 251721152 ./var/MonetDB5/dbfarm (251gb) 24181152 ./var/MonetDB5/sql_logs (24gb) after a few minutes it became like this: 249855172 ./var/MonetDB5/dbfarm (249gb) 12 ./var/MonetDB5/sql_logs however when it came up, i guess the data became corrupted because look at what happened to my query results now: sql>select part, count(*) from frag group by part order by part; +------+-----------+ | part |count_node | +======+===========+ | 1 | 25205085 | | 0 | 361722691 | | 17 | 19138139 | | 18 | 21414794 | +------+-----------+ there are total about 427 M rows, of which 361.7M are corrupted. There is nothing in the merovingian.log file at all since stop/start of database. Can someone advise what to do with this? 1. if possible to recover data, please let me know 2. otherwise what can I do to prevent this in the future? this is a huge roadblock. -- View this message in context: http://www.nabble.com/corruption-on-db-restart-tp16737747p16737747.html Sent from the monetdb-users mailing list archive at Nabble.com.

3 7

[MonetDB-users] SQLException in executeQuery() =Query did not produce a result set
by sateesh 17 Apr '08

17 Apr '08

Hi, When i try to execute a Query using Prepared Statement some times i am getting the below listed Error. It seems like when no rows are returned it throws this Exception.. I am hoping that it is a safely ignorable one.. When i use Statement i don't get this Error!! Regards Sateesh [08-59-15 09:59] ERROR com.lmco.dpa.core.services.persistance.QueryPerformer (129)- SQLException in executeQuery() =Query did not produce a result set at nl.cwi.monetdb.jdbc.MonetPreparedStatement.executeQuery(MonetPreparedStatement.java:228) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93) at com.lmco.dpa.core.services.persistance.QueryPerformer.executeQuery(QueryPerformer.java:86) at com.lmco.dpa.storage.rdf.framework.DPARepositoryModelBuilder.getModelProperty(DPARepositoryModelBuilder.java:279) at com.lmco.dpa.storage.rdf.framework.DPARepositoryModelBuilder.getMetadataModelsMap(DPARepositoryModelBuilder.java:121) at com.lmco.dpa.storage.rdf.framework.DPAModelMetadataManager.init(DPAModelMetadataManager.java:185) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeCustomInitMethod(AbstractAutowireCapableBeanFactory.java:1237) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1203) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1167) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:427) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:339) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:267) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:110) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1095) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:857) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:423) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:291) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:352) at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:122) at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:76) at com.lmco.dpa.ui.common.dao.rdf.impl.UIRepositoryFacadeDaoImplTest.onSetUp(UIRepositoryFacadeDaoImplTest.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.internal.runners.ClassRoadie.runBefores(ClassRoadie.java:49) at org.junit.internal.runners.ClassRoadie.runProtected(ClassRoadie.java:36) at org.junit.internal.runners.JUnit4ClassRunner.run(JUnit4ClassRunner.java:42) at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:38) at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:460) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:673) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:386) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:196) -- View this message in context: http://www.nabble.com/SQLException-in-executeQuery%28%29-%3DQuery-did-not-p… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] db log shrink
by Colin Foss 17 Apr '08

17 Apr '08

Is there any method, besides restarting the database, of shrinking the sql log file? When I am performing a large set of large inserts (via COPY INTO) the log file gets very large. I wish there was a way to cycle the log file. Also during these large batches of inserts the database server becomes less and less responsive until I am forced to restart the server. Upon restart and the normal recovery monet returns to a very responsive state.

3 2

[MonetDB-users] COPY INTO of data containing hebrew letters
by ewilde 16 Apr '08

16 Apr '08

hello again. now i have another problem. following your suggestion of using COPY INTO for the migration of my database from MSSql to MonetDB5, i indeed succeeded in copying some tables, enjoying very good performances (for example, one table with ~8 millions of records in ~13 seconds). the new problem i'm facing now is that using COPY INTO for data with hebrew letters ends up with error. i tried to supply COPY INTO a UNICODE enoded file, but than i have not succeeded in defining the tuple and record seperators. the MonetDB5 itself is capable of storing and retrieving hebrew letters. i can tell this because i have no problem inserting such data through JDBC (actually, right now i have a java process working hard and slowly on copying such a table). so the problem is probably somewhere in the mclient application. is there any workaround for that? thanks, ewilde.

2 1

Re: [MonetDB-users] how to completely remove the MonetDB5installation
by ewilde 16 Apr '08

16 Apr '08

hello! thanks for the latest info. i indeed found all the stuff in %APPDATA%, and i removed it, and the MonetDB5 has come back to life again. if you think i may be able to supply more info about that bug i described in the first place, don't hesitate to contact me. ewilde.

1 0

[MonetDB-users] Sorted materialized views
by Nils Grimsmo 16 Apr '08

16 Apr '08

Hello, all! I am about to prototype something, and it would be convenient to use SQL to throw it together quickly to see if it flies. I downloaded MonetDB yesterday, so I am quite fresh :-) I have a table with a set of columns, and the like to have a few materialized views or projections (or whatever you DB people call it ;-)) sorted on different columns. The views may also have selection, I am not sure yet. And given problem (a data query), I use some statistics to decide which sorting order is most convenient, look up a (preferably continuous) vertical part of the columns, scan through it, and possibly do some filtering. The queries may also be trees, in which case I might use a different sorting order for each branch, and then do merging based on some of the columns. Assume: CREATE TABLE t (a INT, b INT); INSERT INTO t VALUES (1, 3), (4, 2); I would like to do something like: CREATE VIEW v AS SELECT b, a FROM t ORDER BY b, a; This is not allowed (works if I remove ORDER BY). I would also like to have an index over v(b,a), like: CREATE UNIQUE INDEX j USING BTREE ON v (b, a) ; But this is never allowed on a view, right? Since updates are not an issue in the prototype, I could just create a new table like this: CREATE TABLE v (b int, a int, PRIMARY KEY(b, a), INDEX i USING BTREE (b ASC, a ASC)) AS SELECT b, a FROM t ORDER BY b, a; (Using both PRIMARY KEY and INDEX is always butter on bacon?) But this is not allowed because of the table definition, all I am allowed to do is: CREATE TABLE v (b, a) AS SELECT b, a FROM t ORDER BY b, a WITH DATA; If I use PRIMARY KEY(b, a), am I then guaranteed the table to be sorted on (b, a)? Is there any other way of enforcing this in SQL? 1. Any suggestions for what I should do? Is my best option to create all "views" as tables from scratch, and fill them by hand? 2. How much slower would this be than using low-level stuff like BATs and BUNs myself? (The merges between branches in my (problem level) queries are simple, but cannot be expressed as SQL.) Klem fra Nils

3 4

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by kykim_lists＠mac.com 16 Apr '08

16 Apr '08

I found this subject in the archives, and I am having the same problem I am running on Mac OS X 10.4.11 I built MonetDB from source from MonetDB-Feb2008-SuperBall I am new to MonetDB, so please forgive any ignorance.. Here's what I did: > monetdb create foo # create the db > mserver5 --dbname=foo --dbinit="include sql;" # start the db > ./mclient -lsql sql>CREATE USER "bar" WITH PASSWORD 'password' NAME 'Foobar User' SCHEMA "sys"; sql>CREATE SCHEMA "bar" AUTHORIZATION "bar"; sql>ALTER USER "bar" SET SCHEMA "bar"; > ./mclient -lsql -ubar Password:password sql>\q > ./mclient -lsql -ubar Password:password !InvalidCredentialsException:checkCredentials:Invalid credentials for user 'ifm' Two things: 1) I am able to login as user 'monetdb' without any problem 2) If i stop and start 'mserver5', I can login ONCE I know that I probably should be using 'merovingian', but I'm still playing around. Any pointers? Anything I can do to help debug? Thanks, -kevin

3 6

[MonetDB-users] fail to connect via merovingian
by McKennirey.Matthew 16 Apr '08

16 Apr '08

2 2

Re: [MonetDB-users] how to completely remove the MonetDB5installation
by ewilde 14 Apr '08

14 Apr '08

the operationg system i want to completely remove MonetDB5 from is: windows server 2003 x64 r2

2 1

[MonetDB-users] how to completely remove the MonetDB5 installation?
by ewilde 14 Apr '08

14 Apr '08

thanks for replying my previous message. as i mentioned in the previous message, the first installation worked fine (more or less), so in order to finish evaluating MonetDB5 regarding my certain needs, i just want to completely remove it and re-install it. it looks like that the installation program doesn't completely remove the MonetDB5 installation, so, what's the secrete? how do i (manually) completely remove the installation, so i be able to successfully re-install it as it happened the first time. thanks again, ewilde.

3 2

[MonetDB-users] Error building PF/Tijah index
by Desislava I. Petkova 14 Apr '08

14 Apr '08

Hello I'm trying to build a full-text PF/Tijah index. After starting the Mserver, I add 10 XML files into a new collection. I've divided the collection into files so that the files are not too large. This finishes without errors and the collection exists since pf:collections( ) <> returns <collection updatable="false" size="100 MiB" numDocs="1">dblp.xml1</collection>, <collection updatable="false" size="61 MiB" numDocs="1">dblp.xml10</collection>, <collection updatable="false" size="102 MiB" numDocs="1">dblp.xml2</collection>, <collection updatable="false" size="102 MiB" numDocs="1">dblp.xml3</collection>, <collection updatable="false" size="102 MiB" numDocs="1">dblp.xml4</collection>, <collection updatable="false" size="103 MiB" numDocs="1">dblp.xml5</collection>, <collection updatable="false" size="101 MiB" numDocs="1">dblp.xml6</collection>, <collection updatable="false" size="101 MiB" numDocs="1">dblp.xml7</collection>, <collection updatable="false" size="107 MiB" numDocs="1">dblp.xml8</collection>, <collection updatable="false" size="107 MiB" numDocs="1">dblp.xml9</collection> Then I try to build a full-text index for the collection let $opt := <TijahOptions stemmer="porter-english" /> return tijah:create-ft-index($opt) <> But the Mserver aborts after some time with the following error message: MonetDB>*** glibc detected *** free(): invalid pointer: 0x0000002be9d42010 *** I would like to know what this error message means, and how can I fix the problem. Thank you for your response, Desislava

2 1

[MonetDB-users] mserver crashes on windows server 2003 x64
by ewilde 14 Apr '08

14 Apr '08

hi, i do the following steps: 1. run the install program: MonetDB5-SQL-Installer-x86_64-20080214.msi 2. from the start menu, run the shortcut: MonetDB SQL Server 3. from the start menu, run the shortcut: MonetDB SQL Client and... the MonetDB SQL Server window disapears.... a few days ago i installed it (first time in my life) and it worked. i started doing some testing for a couple of days, and suddenly the server stopped working. finally, i gave up: i removed it (using the install program) and re-installed it again (and again (to another directory)..). more info: 1. starting the client with the -lmal option (instead of -lsql) dose NOT crashes the server. so i guess something is probably wrong with the sql layer. 2. during those couple of days that the server was working, i could not find any file related to the database in the whole file system, even though i managed to store some tables with a few millions of records. i was able to query these tables and (most of the time) getting the expected results, so i moved on ignoring this strange thing. BTW: i wonder what is the best way to migrate a database from MSSql server to MonetDB5? i tried to export a whole database (~30 millions of records) from MSSql2005 to MonetDB. first, i thought i could do it with the MSSql export wizard using the odbc driver, but this driver did not show up in the wizard as a target possibility. next, i tried to write a java program using the jdbc driver, but the performances rate weren't constant: one table with 3 columns (int,int,decimal) and about a half a million of records moved to MonetDB in ~3000 records per second. but another very similar table with 3 columns (int,int,int) and about 8 millions of records moved to MonetDB in ~30 records per second (actually, this process had been stopped as a result of an attempt to create another table, and since than, the server is dead.) thanks in advanced for any help, ewilde

2 1

[MonetDB-users] New to MonetDB
by Shankar Yoganathan 13 Apr '08

13 Apr '08

Hello I am new to monetDB. I have a few questions about using MonetDB in embedded environment. I read in the embedded server page that only client is allowed to connect to the embedded server. 1. Does this mean I can not have multiple processes accessing the same database? 2. Can multiple threads with in the same process access the same database? 3. in the in-memory embedded environment, is there a way to save the data before the system shutdown? So that when the system starts, I can automatically populate the database to the previous state? Thank you for your help in advance Shankar

3 2

[MonetDB-users] linux flavor
by mobigital1 12 Apr '08

12 Apr '08

>From my testing of the windows 64 bit port it seems that may be the linux version is a bit more stable to run? (due to specifics of memory mapped file implementations)? can anyone suggest what flavor of linux is best to use to load most data? also the one that's easy to run under vmware? -- View this message in context: http://www.nabble.com/linux-flavor-tp15860790p15860790.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] cvs version (0.23) error
by Jorge Martín Cuervo 09 Apr '08

09 Apr '08

Hi all, I use the an script to download and compile the latest version of cvs, but despite theres no error messages and seems to start very good i can't store any file. The version i see in the console is 0.23, and if i return to my 0.22 version compiled from source it works perfect. I mean storing files, listing and so on. Also, i made a simple java program that connects to database throw jdbc to create documents quickly, and works pretty good with 0.22, but no way with 0.23. In the console (http://127.0.0.1:50001/admin/) i get the same error when i push on every button: Internal Receiver Error: out-of memory any idea? thanks. -- ;-) ____________________________________ Jorge Martin Cuervo Outsourcing Emarketplace deFacto Powered by Standards email <jorge.martin(a)defactops.com> voice +34 985 129 820 voice +34 660 026 384 ____________________________________ DE FACTO STANDARDS, S.L., le informa que su dirección de correo electrónico, así como el resto de los datos de carácter personal que nos facilite, serán objeto de tratamiento automatizado en nuestros ficheros, con la finalidad del envío de información comercial y/o personal por vía electrónica. Vd. podrá en cualquier momento ejercer el derecho de acceso, rectificación, cancelación y oposición en los términos establecidos en la Ley Orgánica de Protección de Datos de Carácter Personal (LOPD. 15/1999), dirigiendo un escrito a C/ Rivero 31 1º Izda. - 33402 AVILES (Asturias), o a nuestra dirección de correo electrónico (info(a)defactops.com) También informamos que la información incluida en este e-mail es CONFIDENCIAL, siendo para uso exclusivo del destinatario arriba mencionado. Si Usted lee este mensaje y no es el destinatario indicado, le informamos que está totalmente prohibida cualquier utilización, divulgación, distribución y/o reproducción de esta comunicación sin autorización expresa en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos nos lo notifique inmediatamente por esta misma vía y proceda a su eliminación. This e-mail contains information that will be added to our computerised guest data base and will be trated in the strict confidence. If you wish to access, correct, oppose or cancel your details, as specified the Law 15/99, December 13th, please send a certified letter to this effect to DE FACTO STANDARDS, S.L.., (C/ Rivero 31 1º Izda. - 33402 AVILES (Asturias) SPAIN). If you read this message, and is not the destinatary, we informal you that is forbidden anything utility, distribution, divulgation or reproduction of this communication without express authorization, of the present law. If you received this message for mistake, we proud in order to the present law, immediate communication to us, and please erase this e-mail

1 0

[MonetDB-users] !ERROR: err:FORG0001
by Jorge Martín Cuervo 08 Apr '08

08 Apr '08

Hi all, i have some error messages from mclient when i try to run an xquery. First i've got: ERROR = !type error: body of hr:fw() evaluates to `double | integer' which is not a subtype of `xs:double' and i removed the return type from function, and later i've got: ERROR = !ERROR: err:FORG0001: could not cast value from string to double. is there any way to know where is the error (like the before message)? thanks. -- ;-) ____________________________________ Jorge Martin Cuervo Outsourcing Emarketplace deFacto Powered by Standards email <jorge.martin(a)defactops.com> voice +34 985 129 820 voice +34 660 026 384 ____________________________________ DE FACTO STANDARDS, S.L., le informa que su dirección de correo electrónico, así como el resto de los datos de carácter personal que nos facilite, serán objeto de tratamiento automatizado en nuestros ficheros, con la finalidad del envío de información comercial y/o personal por vía electrónica. Vd. podrá en cualquier momento ejercer el derecho de acceso, rectificación, cancelación y oposición en los términos establecidos en la Ley Orgánica de Protección de Datos de Carácter Personal (LOPD. 15/1999), dirigiendo un escrito a C/ Rivero 31 1º Izda. - 33402 AVILES (Asturias), o a nuestra dirección de correo electrónico (info(a)defactops.com) También informamos que la información incluida en este e-mail es CONFIDENCIAL, siendo para uso exclusivo del destinatario arriba mencionado. Si Usted lee este mensaje y no es el destinatario indicado, le informamos que está totalmente prohibida cualquier utilización, divulgación, distribución y/o reproducción de esta comunicación sin autorización expresa en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos nos lo notifique inmediatamente por esta misma vía y proceda a su eliminación. This e-mail contains information that will be added to our computerised guest data base and will be trated in the strict confidence. If you wish to access, correct, oppose or cancel your details, as specified the Law 15/99, December 13th, please send a certified letter to this effect to DE FACTO STANDARDS, S.L.., (C/ Rivero 31 1º Izda. - 33402 AVILES (Asturias) SPAIN). If you read this message, and is not the destinatary, we informal you that is forbidden anything utility, distribution, divulgation or reproduction of this communication without express authorization, of the present law. If you received this message for mistake, we proud in order to the present law, immediate communication to us, and please erase this e-mail

4 12

[MonetDB-users] urlbox in MonetDB5
by Gifford Hesketh 02 Apr '08

02 Apr '08

Can someone help me understand exactly what the urlbox is for and how to use it ?

1 0

[MonetDB-users] blobs performance
by Henrik Vendelbo 29 Mar '08

29 Mar '08

I am working through the options for clustered file management. Normally I would expect fairly poor performance of binary file storage in a database. Hence I would favor using the file system, and sync across the machines in the cluster. Being quite different from common relational implementations, how well does Monet handle blobs of 1-10Mb? As a side question is there a support for multi-master replication? The technology looks really impressive, I hope to be able to base my future projects on MonetDB Thanks, Henrik

1 0

[MonetDB-users] !IOException:mal_mapi.listen When Starting MonetDB5 SQL Server
by kevin.haas＠openbi.com 27 Mar '08

27 Mar '08

When I try to start the MonetDB5 Server, I get the following error: # MonetDB server v5.4.0, based on kernel v1.22.0 # Serving database 'demo' # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see C:\Program Files\CWI\MonetDB5\etc\monetdb5.conf) !IOException:mal_mapi.listen:Creation of stream socket failedi: Unknown error #function user.main():void; ##library logger; # alarm.prelude(); ##command bat(ht:int, tt:int) :bat[:any_1,:any_2] ##address BKCnewBat_default ##comment "Creates a new empty transient BAT with head- and tail-types ## as indicated."; ##command bat(ht:int, tt:int, size:lng) :bat[:any_1,:any_2] <EDITED FOR BREVITY> ##comment "Execute the XQuery against the elements #end main; # MonetDB/SQL module v2.22.0 loaded > This does not seem like a "good" error. Any tips on how to correct? -- View this message in context: http://www.nabble.com/%21IOException%3Amal_mapi.listen-When-Starting-MonetD… Sent from the monetdb-users mailing list archive at Nabble.com.

3 3

Re: [MonetDB-users] Database dump does not support schemas
by McKennirey.Matthew 26 Mar '08

26 Mar '08

3 5

[MonetDB-users] Clustered Index and Merge Join
by Michael Schmidt 26 Mar '08

26 Mar '08

I have two tables of the form R1(x INTEGER, y INTEGER) R2(x INTEGER, y INTEGER) where x and y both are NOT NULL and may both contain duplicate values (however, the combination (a,b) is unique). My questions are the following: a.) Is there a possibility to create a /clustered/ index on the x-column (or a clustered combined x-y index?). I could also create a PRIMARY KEY on (x,y). Would this result in a clustered index? Is there any command to find out which indices are clustered? b.) Does MonetDB support MergeJoins? I.e., assume I have a clustered index on columns R1.a and R2.a and perform a join on these columns, will this join be realized by an efficient merge join? Best regards, Michael

3 6

[MonetDB-users] MonetDB XQuery Server Startup Error
by Sprattling, Roderick L. 24 Mar '08

24 Mar '08

After installing the Win32 version of MonetDB XQuery as single-user, making no changes to MonetDB.conf, and attempting to run MXQserver.bat, I get this output: C:\Program Files\CWI\MonetDB4>MXQserver.bat # MonetDB Server v4.22.0 # based on GDK v1.22.0 # Copyright (c) 1993-2008, CWI. All rights reserved. # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ <http://monetdb.cwi.nl/> for further information. # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah <http://dbappl.cs.utwente.nl/pftijah> !ERROR: MAPIlisten:creation of stream socket failed !OS: A blocking operation is currently executing. Since MXQserver.bat simply issues the command "Mserver.bat --dbinit='module(pathfinder);'", I ran that command directly, and to my surprise the server makes it to its own command line: # MonetDB Server v4.22.0 # based on GDK v1.22.0 # Copyright (c) 1993-2008, CWI. All rights reserved. # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. MonetXDB> In this second case, the mclient cannot connect (even when I set server and client ports to something other than 50000,) nor is the admin GUI available on port 50001. So my questions are: Why does the server report a socket creation failure from the MXQserver.bat script? Why is no failure reported when the Mserver.bat script is run directly? And why is the server instance that comes up with Mserver.bat unconnective? I've sought answers from the documentation, Googleverse and the MonetDB-users archive, but found nothing. Thanks in advance for any help you can provide. Rod

1 0

[MonetDB-users] Database dump does not support schemas
by McKennirey.Matthew 24 Mar '08

24 Mar '08

1 0

[MonetDB-users] COPY INTO using a schema fails
by McKennirey.Matthew 21 Mar '08

21 Mar '08

I was wondering if the COPY command does not support schemas? CREATE TABLE test ( column1 VARCHAR(32), column2 VARCHAR(32) ); COPY INTO test FROM '/location/file.csv' USING DELIMITERS ',', '\n'; works fine CREATE SCHEMA abc; CREATE TABLE abc.test ( column1 VARCHAR(32), column2 VARCHAR(32) ); COPY INTO abc.test FROM '/location/file.csv' USING DELIMITERS ',', '\n'; fails with !SQLException:sql:table test not found !SQLException:importTable:failed to import table INSERT into abc.test VALUES(one,two) works fine

2 1

[MonetDB-users] Sending an XML document via JDBC
by Richard Eckart 19 Mar '08

19 Mar '08

Hi again, is there some way to send a XML document to the server through the JDBC connection? That is (because of the <enter> problem on OS X) I need to have my MonetDB/XQuery server running on a remote machine and I want to load an XML document locally and store it on the machine via JDBC. The 'pf:add-doc()' functions do not really help be since the only connection over to the remote machine is the MonetDB connection. Setting up a facility for MonetDB to 'call back to' to fetch the XML document via http would be overkill. Also, the XML-DB API does no longer exist, does it? Cheers, Richard

2 1

[MonetDB-users] MonetDB Error Message
by Michael Schmidt 17 Mar '08

17 Mar '08

Hi, I am trying to run the following SQL query on the lates nightly build: SELECT T1.subject AS inproc, T2.object AS author, T3.object AS booktitle, T4.object AS title, T5.object AS proc, T6.object AS ee, T7.object AS page, T8.object AS URL, T9.object AS yr, AB.object AS abstract FROM Triples T1 JOIN Triples T2 ON T1.subject=T2.subject JOIN Triples T3 ON T1.subject=T3.subject JOIN Triples T4 ON T1.subject=T4.subject JOIN Triples T5 ON T1.subject=T5.subject JOIN Triples T6 ON T1.subject=T6.subject JOIN Triples T7 ON T1.subject=T7.subject JOIN Triples T8 ON T1.subject=T8.subject JOIN Triples T9 ON T1.subject=T9.subject LEFT JOIN ( SELECT * FROM Triples T10 WHERE T10.property='bench:abstract' ) AB ON T1.subject=AB.subject WHERE T1.property='rdf:type' AND T2.property='dc:creator' AND T3.property='bench:booktitle' AND T4.property='dc:title' AND T5.property='dcterms:partOf' AND T6.property='rdfs:seeAlso' AND T7.property='swrc:pages' AND T8.property='foaf:homepage' AND T9.property='dcterms:issued' AND T1.object='bench:Inproceedings' ORDER BY T9.object; on a single table "Triples(subject VARCHAR(50),predicate VARCHAR(20),object VARCHAR(20000))" with only 1000 entries. This query results in the following error message: ##GDKmmap(702808064) fail => BBPtrim(enter) usage[mem=101947960,vm=1505614392] # #mallinfo.arena = 11571200 ##mallinfo.ordblks = 1177 ##mallinfo.smblks = 102 ##mallinfo.hblkhd = 94076928 ##mallinfo.hblks = 12 ##mallinfo.usmblks = 0 ##mallinfo.fsmblks = 4080 ##mallinfo.uordblks = 9619432 ##mallinfo.fordblks = 1951768 ##BBPTRIM_ENTER: memsize=101947960,vmsize=1505614392 ##BBPTRIM: memtarget=0 vmtarget=1073741824 ##TRIMSCAN: mem=0 vm=1, start=1, limit=1 ##TRIMSCAN: 63756* 0=tmp_1462 (#0) ##TRIMSCAN: 63887* 1=tmp_1472 (#0) ##TRIMSCAN: 64223* 2=tmp_1473 (#0) ##TRIMSCAN: 64286* 3=tmp_1477 (#0) ##TRIMSCAN: 64301* 4=tmp_1500 (#0) ##TRIMSCAN: 64362* 5=tmp_1501 (#0) ##TRIMSCAN: 64438* 6=tmp_1502 (#0) ##TRIMSCAN: 64447* 7=tmp_1505 (#0) [...] // many many more entries of this form ##TRIMSCAN: 63994 235=tmp_2275 (#455647) ##TRIMSCAN: 63998 236=tmp_2304 (#3980331) ##TRIMSCAN: 64002 237=tmp_2305 (#3980331) ##TRIMSCAN: end at 1 (size=1234) ##TRIMSELECT: dirty = 0 ##TRIMSELECT: candidate=tmp_1462 BAT*=0x848fc28 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51285,63756,-2147419892) ##TRIMSELECT: keep tmp_1462 [228,0] bytes [228,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1472 BAT*=0x84964f8 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51294,63887,-2147419761) ##TRIMSELECT: keep tmp_1472 [228,0] bytes [228,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1473 BAT*=0x8496b18 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51313,64223,-2147419425) ##TRIMSELECT: keep tmp_1473 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1477 BAT*=0x84a6770 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51321,64286,-2147419362) ##TRIMSELECT: keep tmp_1477 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1500 BAT*=0x84a6d20 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51323,64301,-2147419347) ##TRIMSELECT: keep tmp_1500 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1501 BAT*=0x84a7318 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51325,64362,-2147419286) ##TRIMSELECT: keep tmp_1501 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1502 BAT*=0x84a7920 [...] // many many more entries of this form ##TRIMSELECT: candidate=tmp_2234 BAT*=0x871d5b0 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63975,63975,63975) ##TRIMSELECT: delete tmp_2234 from trimlist (does not match trim needs) ##TRIMSELECT: candidate=tmp_2235 BAT*=0x871e7e8 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63976,63976,63976) ##TRIMSELECT: delete tmp_2235 from trimlist (does not match trim needs) ##TRIMSELECT: candidate=tmp_2236 BAT*=0x871fa20 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63977,63977,63977) ##TRIMSELECT: delete tmp_2236 from trimlist (does not match trim needs) ##TRIMSELECT: end ##BBPTRIM: no more unload candidates! ##BBPTRIM_EXIT: memsize=11583488,vmsize=1505614392 ##GDKmmap(702808064) fail => BBPtrim(ready) usage[mem=101947960,vm=1505614392] # #mallinfo.arena = 11571200 ##mallinfo.ordblks = 1177 ##mallinfo.smblks = 102 ##mallinfo.hblkhd = 94076928 ##mallinfo.hblks = 12 ##mallinfo.usmblks = 0 ##mallinfo.fsmblks = 4080 ##mallinfo.uordblks = 9619432 Seems like a memory allocation problem to me. Any ideas what the problem could be? Best Regards, Michael

2 1

[MonetDB-users] Trouble connecting
by Richard Eckart 16 Mar '08

16 Mar '08

Hi everybody, I am completely new to MonetDB and have just compiled the latest SuperBall release on OS X. I set mapi_open to true in the config file /etc/monetdb5.conf because for some reason MonetDB would not use "localhost" but the machine name of my box as an address to listen on. I had to manually add that to /etc/hosts in order for it to refer to 127.0.0.1 at least. Maybe an OS X oddity. I start the merovingian process which seems to run fine. After that the only time I can connect successfully to a database using mclient (or any other client) is the first time I try to connect (if it works at all). For example ./mclient -lsql --database demo !InvalidCredentialsException:checkCredentials:Invalid credentials for user 'monetdb' Sometimes it would work just once but the second time with the same command line I would not be able to log in. The merovingian.log does not seem to contain any helpful messages. Any hints would be very helpful as currently I can not use MonetDB at all. Cheers, Richard

3 8

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by McKennirey.Matthew 14 Mar '08

14 Mar '08

2 1

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by McKennirey.Matthew 14 Mar '08

14 Mar '08

2 1

[MonetDB-users] Can not allocate memory, MonetDB5
by forte712 14 Mar '08

14 Mar '08

Hi I've just downloaded a new version of MonetDB a few days ago and started testing it.. I tried inserting a 2.6G data file (12 columns, 32 million rows) and it works fine. But when I added 4 more columns of data to that data file (of type bigint, bringing the file size up to 3.9G), it fails saying !SQLException:importTable:failed to import table !ERROR: GDKload: cannot mmap(): name=20/2023, ext=tail.priv !OS: Cannot allocate memory !ERROR: GDKload failed: name=20/2023, ext=tail.priv I tried searching for similar problem, but only found it for older versions of MonetDB. Is this still an issue in the current version? Thank you. -- View this message in context: http://www.nabble.com/Can-not-allocate-memory%2C-MonetDB5-tp16019364p160193… Sent from the monetdb-users mailing list archive at Nabble.com.

4 4

[MonetDB-users] Table space/size
by Iftikharn 14 Mar '08

14 Mar '08

Hi How to check that how much space a particular table has taken or what is the current size of a given tables in bytes etc. Because I am interested in writing a trigger when a particular table reaches a given size then the oldest of all rows, based on a time attribute should be deleted (I like to do it without counting the rows). Regards, Iftikhar -- View this message in context: http://www.nabble.com/Table-space-size-tp16040486p16040486.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Developing in MAL!
by Erik Holstad 13 Mar '08

13 Mar '08

Hi, I'm new to MonetDB, but are looking to develop my own interface towards the database, not using SQL, but just sticking with MAL or if possible C and just want to know what my options are? Is it, for example, possible to load you own MAL-files into the client, just for a test run or do you have to type in the commands line by line? And on the server side, how to you setup your own modules and libraries? Regards Erik Holstad

5 24

[MonetDB-users] JDBC insert performance
by chinarinde 11 Mar '08

11 Mar '08

Hi all, I am new to monetDB and ran into the following problem (I'll try to be as verbose as I can, perhaps it helps helping me): I've installed MonetDB server 5.0.0, clients and commons 1.18.2 and sql 2.18.2 on Ubuntu Feisty. Then I've taken the JDBC example which is available online and modified it to be able to insert data into a test database. More specifically I'm using prepared statements and executeBatch() together with the monetdb-1.6 JDBC driver. Which is quite successful until about 5 million records are inserted - afterwards the speed of the inserts drops dramatically. I've experimented with different batch sizes (10000 records seems to work ok), and I've tried to understand the chapter about memory tuning for MonetDB (not sure yet about how to use mem_cursize() though). In any case at first inserting 2 million records only takes about 5 minutes (measured with Javas System.timemillis), later on this time increases and the server gets rather unresponsive. I found only two posts concerning the speed of JDBC inserts (from January 2007 I think) and I would be interested if a solution or explanation has been found off-list. Thank you -- View this message in context: http://www.nabble.com/JDBC-insert-performance-tf4589411.html#a13100422 Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Help me,please
by ssoor 05 Mar '08

05 Mar '08

Dear MonetDB's Group, I am a school student in china. I want to compile the Source code of MonetDB on WindowsXP. I have read your Documentations. But I lost. Can you send me the particular how to compile it with the MS visual studio 2005. Thanks you very much . And forgive my poor English. I hope your answer. Lin Mailing Address: ssoor(a)126.com Tianjin University 92 Wei Jin Rd, Nan Kai District TianJin 300072 ssoor 2008-03-05

2 1

[MonetDB-users] Windows binary + Python2.4
by Pawel Lewicki 26 Feb '08

26 Feb '08

Hi, Is there any chance for Python extensions compiled for Python 2.4 for Windows? Paweł Lewicki

1 0

[MonetDB-users] Blacklisting certain XML elements
by jz＠uva 26 Feb '08

26 Feb '08

Dear all, I am wondering whether it is possible with MonetDB4/XQuery, PF/Tijah, to blacklist certain XML element names from being "shredded", and thus being indexed? If so, could someone tell me how? I hope this is the correct mailinglist for asking this question... Best, Junte

2 1

Re: [MonetDB-users] COPY TO corrupting data
by mobigital-nbl＠yahoo.com 26 Feb '08

26 Feb '08

Stefan Manegold wrote: > 32-bit system on 8 GB machines does not make much sense, does it? > A 32-bit systems can (at least per process) address at most 4 GB, usually > only 2 GB in practice... True, but doesn't seem like I am hitting the maximum process memory limit (not even approaching 1.5GB). > With 9M+ records of >= 438 byte each, your data is >=3.9 GB in size. > I'm not completely sure whether MonetDB temprarily need to hold all data > concurrently in its address sapce during bulk loading; but if so, your data > size might simply exceed the 32-bit address space. > (Obviously, MonetDB should better give an error than crash ...) I am bulk loading only 250K rows at a time, at which point they are copied from staging table into permament final table. am I allowed to have a table with total data size larger than max process memory size? > Did you try on a 64-bit systems using 64-bit MonetDB? I have, but hitting another - higher limit - 100M rows ending with corruption on 64 bits, see first message on this thread.

1 0

Re: [MonetDB-users] COPY TO corrupting data
by bunninge 25 Feb '08

25 Feb '08

-----Original Message----- From: Martin Kersten <Martin.Kersten(a)cwi.nl> Sent: Friday, February 22, 2008 17:07 To: Communication channel for MonetDB users <monetdb-users(a)lists.sourceforge.net> Subject: Re: [MonetDB-users] COPY TO corrupting data mobigital1 wrote: > FYI, i am using 500K rows at a time. > > I've seen the mserver5.exe process memory utilization go up to 13GB (free > memory was around 1.5 GB). > but then it winds down pretty quickly. > > > > Thanks. This means that the expected database chunk size is topped at 500K * (7 * 8+ 2*20+6 *10+15+144*8 ) bytes i.e. 500K* 1323= 0.670Gb chucksize wise there does not seem a problem. However, virtual memory footprint quickly increases and I am wondering if we hit a limit in OS regaring memory mapped files. I would check a single batch for consistency. Then built a merge table over the smaller batches. In a later stage you can then glue together the pieces until we hit another limit thanks for the info and help in improving MonetDB ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

1 0

[MonetDB-users] COPY TO corrupting data
by mobigital1 25 Feb '08

25 Feb '08

I am trying to load about 500M rows into a table with about 160 columns: column types: 7 columns of type "int" 2 columns of type "varchar(20)" 6 columns of type "varchar(10)" 1 columns of type "varchar(15)" 144 columns of type "real" on a system with 16 GB RAM , 64 bit windows server 2003 SP2. it takes some 20 hours to load the 100M rows, but when I reach that boundary, the server seems to crash and database becomes corrupt so that about 95M rows have 0 in numeric columns, blanks in varchars. The remaining 5M rows have real data. does anyone have any suggestions on what can be done to make it possible to load this data? -- View this message in context: http://www.nabble.com/COPY-TO-corrupting-data-tp15634267p15634267.html Sent from the monetdb-users mailing list archive at Nabble.com.

4 7

[MonetDB-users] MonetDB mserver5 crash
by Michael Schmidt 21 Feb '08

21 Feb '08

Hi, I'm trying to run a benchmark using the latest February stable (on an Ubuntu 7.04 - Feisty Fawn), and want to cleanup the database entirely between two single runs. Basically, my benchmark script is as follows: //////////////////// START CODE // kill all processes and remove databases) // (I know this is not the intended way, but using // > monetdb stop test // > monetdb destroy -f test // while not restarting merovingian basically results in // in the same error) > killall -9 merovingian > killall -9 mserver5 > killall -9 mclient > rm -Rf /usr/local/src/MonetDB/var/MonetDB5/dbfarm/* // start the merovingian server > merovingian > sleep 2 // wait until ports 50000 and 50001 are free, // as they might still be blocked (I inserted this piece // of code because I thought busy port allocation might // be the cause of failure) > [code works fine (ommited)] // create and start the database > monetdb create test; > sleep 2; > monetdb start test; > sleep 2; // load the document into the database (this part tends to fail) > mclient -lsql -dtest < document.sql //////////////////// END CODE The strange thing is that every second run fails due to a "Connection terminated" error when loading the document, i.e. mserver5 crashes away. Did anyone experience similar problems? Any hints would be appreciated. Thanks in advance, Michael

2 9

[MonetDB-users] Storing UUID, column of type Binary?
by McKennirey.Matthew 21 Feb '08

21 Feb '08

2 3

[MonetDB-users] Problem with View definition
by Michael Schmidt 21 Feb '08

21 Feb '08

Hi, I am running the latest (February) release of MonetDB, and I have a question concerning MonetDB view definitions. I have defined a schema consisting of simple triple-column tables, defined as follows CREATE TABLE bench_booktitle (subject INTEGER,object INTEGER,FOREIGN KEY (subject) REFERENCES Dictionary(ID),FOREIGN KEY (object) REFERENCES Dictionary(ID)); CREATE TABLE bench_cdrom (subject INTEGER,object INTEGER,FOREIGN KEY (subject) REFERENCES Dictionary(ID),FOREIGN KEY (object) REFERENCES Dictionary(ID)); ... using a simple Dictionary lookup table CREATE TABLE Dictionary (ID INTEGER,val VARCHAR(20000),PRIMARY KEY (ID)); Now, I'm trying to create a view ranging over all these tables. The problem with the view definition is that it takes a very long time and consumes large main memory resources (I aborted after 10 minutes, where the mserver5 process uses more than 1.2GB of main memory). It might be of interest that view creation takes place even before loading any data in the tables, i.e. all tables are empty. Maybe someone has an idea what's going on when creating the View. Why does it require so much memory and why does it take so long? Any idea how to fix this problem? Here is the view definition (which is rather straightforward): CREATE VIEW Triples AS ( SELECT subject,'bench:booktitle' AS predicate,object FROM bench_booktitle ) UNION ( SELECT subject,'bench:cdrom' AS predicate,object FROM bench_cdrom ) UNION ( SELECT subject,'swrc:pages' AS predicate,object FROM swrc_pages ) UNION ( SELECT subject,'foaf:homepage' AS predicate,object FROM foaf_homepage ) UNION ( SELECT subject,'swrc:editor' AS predicate,object FROM swrc_editor ) UNION ( SELECT subject,'swrc:number' AS predicate,object FROM swrc_number ) UNION ( SELECT subject,'dc:creator' AS predicate,object FROM dc_creator ) UNION ( SELECT subject,'rdfs:seeAlso' AS predicate,object FROM rdfs_seeAlso ) UNION ( SELECT subject,'dcterms:partOf' AS predicate,object FROM dcterms_partOf ) UNION ( SELECT subject,'dcterms:references' AS predicate,object FROM dcterms_references ) UNION ( SELECT subject,'dcterms:issued' AS predicate,object FROM dcterms_issued ) UNION ( SELECT subject,'swrc:volume' AS predicate,object FROM swrc_volume ) UNION ( SELECT subject,'dc:publisher' AS predicate,object FROM dc_publisher ) UNION ( SELECT subject,'swrc:note' AS predicate,object FROM swrc_note ) UNION ( SELECT subject,'swrc:chapter' AS predicate,object FROM swrc_chapter ) UNION ( SELECT subject,'swrc:address' AS predicate,object FROM swrc_address ) UNION ( SELECT subject,'swrc:series' AS predicate,object FROM swrc_series ) UNION ( SELECT subject,'swrc:month' AS predicate,object FROM swrc_month ) UNION ( SELECT subject,'foaf:name' AS predicate,object FROM foaf_name ) UNION ( SELECT subject,'rdf:type' AS predicate,object FROM rdf_type ) UNION ( SELECT subject,'dc:title' AS predicate,object FROM dc_title ) UNION ( SELECT subject,'swrc:journal' AS predicate,object FROM swrc_journal ) UNION ( SELECT subject,'bench:abstract' AS predicate,object FROM bench_abstract ) UNION ( SELECT subject,'swrc:isbn' AS predicate,object FROM swrc_isbn ); Kind regards, Michael Schmidt

2 4

Re: [MonetDB-users] New MonetDB Release
by Rahul Chopra 20 Feb '08

20 Feb '08

> > On Tue, Feb 19, 2008 at 11:35:14PM +0800, Rahul Chopra wrote: > > Congratulations on the release. > > > > I ran a TPC-H test on it. The majority of queries now seem slower > > Example: Query 21: 119 sec (was 18 sec), while others are closer, > > example: Query 13: 21 sec (was 18 sec). > > Which scale factor of TPC-H did you run? > Factor 10. The system has 24 GB of RAM, running SuSe 10 64-bit. The test system has been taken away from me, and the drives rebuilt, so I can't further help at the moment, but wanted to give you the heads up in case you folks did not have time to do much performance testing before this release. If you did, then there was probably just an issue in my environment for some reason. Thanks. > Niels > > > > Did you verify performance for this release? It could be > > something I misconfigured for the new release, so take this with > > a grain of salt. Thanks. > > > > > > > ----- Original Message ----- > > > From: "Stefan Manegold" <Stefan.Manegold(a)cwi.nl> > > > To: monetdb-announce(a)lists.sourceforge.net > > > Subject: [MonetDB-users] New MonetDB Release > > > Date: Tue, 19 Feb 2008 13:51:24 +0100 > > > > > > The MonetDB team at CWI is pleased to announce the new > > "Feb2008" release of > > > the MonetDB suite of programs. > > > > This release marks the roll forward of the binary storage > > layout to a single > > > column storage layout. This involved a major overhaul of the > > MonetDB Server > > > code. > > > > IMPORTANT NOTE: > > > The database format of this release is not compatible with that of any > > > previous release. Before installing this release, make a dump of your > > > database, and do a restore afterwards. > > > > Further changes include: > > > > SQL: The functional extensions to SQL are limited. The mostly concern > > > minor bugs and some of the optimizers have been improved to better exploit > > > re-occurring joins. The core cracker code has been cleaned up for better > > > inspection and sharing in the community. > > > > XQuery: Next to the original Pathfinder compiler (nick-named > > > "milprint_summer" or simply "MPS"), the development of the new improved and > > > enhanced Algebra-based Pathfinder compiler ("ALG") is progressing quickly. > > > While the original MPS version remains the default in this release of > > > MonetDB/XQuery, a preview of the new ALG version is now available without > > > recompilation. > > > > JDBC & XRPC: The Java code (JDBC driver & XRPC wrapper) has > > been moved from > > > the clients and pathfinder source trees to a dedicated java source tree in > > > CVS, which can simply be compiled using "ant". > > > > Apart from this, many bugs have been fixed, and many speed > > improvements have > > > been made. See > > > http://monetdb.cwi.nl/Development/Releases/Version4.22/ > > > for more details. > > > > The new release consists of the following packages: > > > > MonetDB Common 1.22.0 > > > MonetDB Clients 1.22.0 > > > MonetDB4 Server 4.22.0 > > > MonetDB XQuery 0.22.0 > > > MonetDB5 Server 5.4.0 > > > MonetDB SQL 2.22.0 > > > monetdb-1.7-jdbc.jar > > > > There is of course also a new "Super Source Ball", a tarball > > containing the > > > combined sources. > > > > All this is available on our SourceForge project page. See > > > https://sourceforge.net/project/showfiles.php?group_id=56967 for the > > > downloadable files. > > > > -- > > > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > > > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > > > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > > > | The Netherlands | Fax : +31 (20) 592-4312 | > > > > ------------------------------------------------------------------------- > > > This SF.net email is sponsored by: Microsoft > > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > > _______________________________________________ > > > MonetDB-users mailing list > > > MonetDB-users(a)lists.sourceforge.net > > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > > > > > > > > > > = > > Fishing Vacation Deals at Hyatt? > > Book Your Hyatt Fishing Vacation Now. Best Rates Online Guaranteed. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a0e62a460a6115c26a11780… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Search for products and services at: http://search.mail.com -- Powered by Outblaze

1 0

[MonetDB-users] New MonetDB Release
by Stefan Manegold 20 Feb '08

20 Feb '08

The MonetDB team at CWI is pleased to announce the new "Feb2008" release of the MonetDB suite of programs. This release marks the roll forward of the binary storage layout to a single column storage layout. This involved a major overhaul of the MonetDB Server code. IMPORTANT NOTE: The database format of this release is not compatible with that of any previous release. Before installing this release, make a dump of your database, and do a restore afterwards. Further changes include: SQL: The functional extensions to SQL are limited. The mostly concern minor bugs and some of the optimizers have been improved to better exploit re-occurring joins. The core cracker code has been cleaned up for better inspection and sharing in the community. XQuery: Next to the original Pathfinder compiler (nick-named "milprint_summer" or simply "MPS"), the development of the new improved and enhanced Algebra-based Pathfinder compiler ("ALG") is progressing quickly. While the original MPS version remains the default in this release of MonetDB/XQuery, a preview of the new ALG version is now available without recompilation. JDBC & XRPC: The Java code (JDBC driver & XRPC wrapper) has been moved from the clients and pathfinder source trees to a dedicated java source tree in CVS, which can simply be compiled using "ant". Apart from this, many bugs have been fixed, and many speed improvements have been made. See http://monetdb.cwi.nl/Development/Releases/Version4.22/ for more details. The new release consists of the following packages: MonetDB Common 1.22.0 MonetDB Clients 1.22.0 MonetDB4 Server 4.22.0 MonetDB XQuery 0.22.0 MonetDB5 Server 5.4.0 MonetDB SQL 2.22.0 monetdb-1.7-jdbc.jar There is of course also a new "Super Source Ball", a tarball containing the combined sources. All this is available on our SourceForge project page. See https://sourceforge.net/project/showfiles.php?group_id=56967 for the downloadable files. -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 8

Re: [MonetDB-users] Running multiple mserver5 processes, Merovingian
by McKennirey.Matthew 19 Feb '08

19 Feb '08

2 2

Re: [MonetDB-users] New MonetDB Release
by Rahul Chopra 19 Feb '08

19 Feb '08

Congratulations on the release. I ran a TPC-H test on it. The majority of queries now seem slower Example: Query 21: 119 sec (was 18 sec), while others are closer, example: Query 13: 21 sec (was 18 sec). Did you verify performance for this release? It could be something I misconfigured for the new release, so take this with a grain of salt. Thanks. > ----- Original Message ----- > From: "Stefan Manegold" <Stefan.Manegold(a)cwi.nl> > To: monetdb-announce(a)lists.sourceforge.net > Subject: [MonetDB-users] New MonetDB Release > Date: Tue, 19 Feb 2008 13:51:24 +0100 > > > > The MonetDB team at CWI is pleased to announce the new "Feb2008" release of > the MonetDB suite of programs. > > This release marks the roll forward of the binary storage layout to a single > column storage layout. This involved a major overhaul of the MonetDB Server > code. > > IMPORTANT NOTE: > The database format of this release is not compatible with that of any > previous release. Before installing this release, make a dump of your > database, and do a restore afterwards. > > Further changes include: > > SQL: The functional extensions to SQL are limited. The mostly concern > minor bugs and some of the optimizers have been improved to better exploit > re-occurring joins. The core cracker code has been cleaned up for better > inspection and sharing in the community. > > XQuery: Next to the original Pathfinder compiler (nick-named > "milprint_summer" or simply "MPS"), the development of the new improved and > enhanced Algebra-based Pathfinder compiler ("ALG") is progressing quickly. > While the original MPS version remains the default in this release of > MonetDB/XQuery, a preview of the new ALG version is now available without > recompilation. > > JDBC & XRPC: The Java code (JDBC driver & XRPC wrapper) has been moved from > the clients and pathfinder source trees to a dedicated java source tree in > CVS, which can simply be compiled using "ant". > > Apart from this, many bugs have been fixed, and many speed improvements have > been made. See > http://monetdb.cwi.nl/Development/Releases/Version4.22/ > for more details. > > The new release consists of the following packages: > > MonetDB Common 1.22.0 > MonetDB Clients 1.22.0 > MonetDB4 Server 4.22.0 > MonetDB XQuery 0.22.0 > MonetDB5 Server 5.4.0 > MonetDB SQL 2.22.0 > monetdb-1.7-jdbc.jar > > There is of course also a new "Super Source Ball", a tarball containing the > combined sources. > > All this is available on our SourceForge project page. See > https://sourceforge.net/project/showfiles.php?group_id=56967 for the > downloadable files. > > -- > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > | The Netherlands | Fax : +31 (20) 592-4312 | > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Fishing Vacation Deals at Hyatt® Book Your Hyatt Fishing Vacation Now. Best Rates Online Guaranteed. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a0e62a460a6115c26a11780… -- Powered by Outblaze

4 3

[MonetDB-users] compression & temp space
by Rahul Chopra 19 Feb '08

19 Feb '08

Hello, Does MonetDB use compression at all? I saw something on the site that made me think it might be used for low cardinality columns, but it was not clear, and I could not find any other instances, like for long char columns. Also, are there any plans to allow for specifying a separate device to use for temp space? (Or, can I create a link somewhere on the filesystem?) I just notice that sometimes MonetDB uses an awful lot of virtual memory, and I/O quickly becomes the bottleneck when it no longer fits in RAM. Thanks. = Profit From On Hold Messages 20 Years experience. Custom messages, free equipment, no contracts. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=49dd4ae6b19ee653ce7d12b… -- Powered by Outblaze

1 0

Re: [MonetDB-users] Analyze
by Rahul Chopra 19 Feb '08

19 Feb '08

Thank you. So, the database on its own will collect selectivity statistics so that if there are multiple atomic conditions on a column, it will choose to apply the more selective one first? Thanks > ----- Original Message ----- > From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Analyze > Date: Tue, 19 Feb 2008 14:35:48 +0100 > > > Dear Rahul > > thank you for your interest in MonetDB. > There is no such thing as ANALYZE or UPDATE STATISTICS. > They are not part of the SQL 99 standard > and its implementation would not make sense. > The database performance continuous analysis to optimize > execution using actual properties of the tables involved. > > regards, Martin > Rahul Chopra wrote: > > Is there the equivalent of ANALYZE or UPDATE STATISTICS in > > MonetDB? I tried both, but could not get them to work. > > > > Thanks! > > > > = > > embedded system > > UML 2.0-Based Software Engineering Using Model-Driven Development. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=b006f31a35aad8826624507… > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Sell Your Annuity If you are receiving payments from a structured settlement or annuity and need cash now, the Structured Settlement Alliance is here to help you get your cash now. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=fc012ccf36676d4eeec4d34… -- Powered by Outblaze

1 0

[MonetDB-users] protocol violation Unexpected line in data block
by sateesh 19 Feb '08

19 Feb '08

Hi All, When i try to fetch data from a table some times i am getting this error: It seems it has some thing to do with the type of characters that are being inserted. I am wondering why it didn't threw any exception while inserting but throwing the excep when trying to retrieve !! I hope this is not because of the sql client i am using..I tried using Squrriel and QuantumDB plugin of Eclipse. Here is the Stack Trace Error Executing: select * from dpa.collection_info:java.sql.SQLException: protocol violation: unexpected line in data block: . java.sql.SQLException: protocol violation: unexpected line in data block: . at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2048) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1798) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at sun.reflect.GeneratedMethodAccessor26.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.quantum.util.proxy.ProxyFactory$InvocationHandlerImpl.invoke(ProxyFactory.java:37) at $Proxy4.execute(Unknown Source) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:133) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:91) at com.quantum.actions.BaseExecuteAction.getSQLResults(BaseExecuteAction.java:202) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:174) at com.quantum.actions.ExecuteAction.execute(ExecuteAction.java:98) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:125) at com.quantum.actions.BaseExecuteAction.run(BaseExecuteAction.java:111) at org.eclipse.ui.actions.BaseSelectionListenerAction.runWithEvent(BaseSelectionListenerAction.java:168) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:443) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:66) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1101) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3319) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:2971) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2389) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2353) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2219) at org.eclipse.ui.internal.Workbench$4.run(Workbench.java:466) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:289) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:461) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:106) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:153) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:106) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:76) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:363) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:504) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:443) at org.eclipse.equinox.launcher.Main.run(Main.java:1169) -- View this message in context: http://www.nabble.com/protocol-violation-Unexpected-line-in-data-block-tp15… Sent from the monetdb-users mailing list archive at Nabble.com.

4 11

[MonetDB-users] Analyze
by Rahul Chopra 19 Feb '08

19 Feb '08

Is there the equivalent of ANALYZE or UPDATE STATISTICS in MonetDB? I tried both, but could not get them to work. Thanks! = embedded system UML 2.0-Based Software Engineering Using Model-Driven Development. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=b006f31a35aad8826624507… -- Powered by Outblaze

2 1

[MonetDB-users] Loading user-defined mal function on server start
by Michael 19 Feb '08

19 Feb '08

Hi, I'd like to place some MAL functions on the server and make them available asap the server starts. Placing a user.mal in the lib dir did not help. Placing in an existing file tells me that the appropriate module is not loaded and the datatypes I am using in are not available yet. Does that mean, that I have to place the functions when my app starts and opens the connection? Is there a desired way at all like the above? Thx, Mike -- <NO> OOXML - Say NO To Microsoft Office broken standard http://www.noooxml.org

2 1

[MonetDB-users] Trouble loading DLLs when called from scripting environment
by Yuvaraj Athur Raghuvir 19 Feb '08

19 Feb '08

Hello, I am using a language called J (www.jsoftware.com) What I have done so far is as follows: 1) Got the Mbedded example running in a C++ project 2) Moving the DLL interactions to J-MonetDB interactions by wrapping the main calls in my own dll called mdbdll.dll Everything is fine until I get to the call embedded_sql (set, setlen) in mdbdll.dll. What I see is that when the lib_sql.dll is loaded I get an access violation error and the program crashes. Is there any assumption on the location at which lib_sql.dll is loaded? Any other clues will be appreciated. Thanks, Yuva

1 0

[MonetDB-users] Windows 64-bit DBGEN
by Jos van Dongen 17 Feb '08

17 Feb '08

Hello, I want to run some TPC-H test on a Windows 64bit server. Does anyone have an executable version of the DBGEN tool which runs on Windows 64bit and will generate large (SF100 or more) files? Thanks in advance. Met vriendelijke groet/kind regards, Jos van Dongen Tholis Consulting T: 06-51169606 F: 0842-231136 M: jvdongen(a)tholis.com www.tholis.com No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.516 / Virus Database: 269.20.7/1283 - Release Date: 16-2-2008 14:16

1 0

[MonetDB-users] Embedded Use: Persisting and Metadata
by Yuvaraj Athur Raghuvir 13 Feb '08

13 Feb '08

Finally, I have managed to get the Mbeddded example working in VC++ 2005 Express Edition on Windows XP ! Thanks to the folks in the mailing list. Use Case: MonetDB5 , Embedded Mode , SQL To move towards the application I intend to experiment on, I need some more information: 1) How to make data durable? In the simple example, I tried the following: a) First Run: Create table and insert rows. Select to check if everything is ok. b) Second Run: Only perform selection >> I get an error in the second run. 2) How to get meta data of the database? a) I want to know the size of the tables and meta tables in the data base. In particular I am interested in seeing the growth of the database on addition of content. b) Typically, there is a master table in the database that records information of the schema persisted. What is the name of the Master Table and its schema in MonetDB? c) SQLite has an independent analyzer tool which dumps the state of the storage from which I can extract most of the data I need. Does MonetDB have a similar mechanism? ~Yuva >>>> code snippet >>>>> dbh = embedded_sql (set, setlen); if (dbh == NULL || mapi_error(dbh)) die(dbh, hdl); /* switch off autocommit */ if (mapi_setAutocommit(dbh, 0) != MOK || mapi_error(dbh)) die(dbh,NULL); if ((hdl = mapi_query(dbh, "create table emp" " (name varchar(20),age int)")) == NULL || mapi_error(dbh)) die(dbh, hdl); close_handle(dbh,hdl); for(i=0; i< 1000; i++) { char query[100]; _snprintf(query, 100,"insert into emp values(\'user%d\', %d)", i, (i % 82)); if ((hdl = mapi_query(dbh, query)) == NULL || mapi_error(dbh)) die(dbh, hdl); close_handle(dbh,hdl); } if ((hdl = mapi_query(dbh, "select * from emp")) == NULL || mapi_error(dbh)) die(dbh, hdl); i=0; while (mapi_fetch_row(hdl)) { char *age = mapi_fetch_field(hdl, 1); i= i+ atoi(age); } if (mapi_error(dbh)) die(dbh, hdl); close_handle(dbh,hdl); printf("The sum is %d \n",i); mapi_disconnect(dbh); return 0;

4 8

[MonetDB-users] How to convert time from seconds to Year Month Day...
by Iftikharn 11 Feb '08

11 Feb '08

Thanks to people out there for providing excellent answers. I have time values in the form of seconds since 1970/01/01 00:00:00.000 GMT e.g. "1087488000". How could I convert them into Year, Month, Day, Hour, Minute, and Second. Iftikhar -- View this message in context: http://www.nabble.com/How-to-convert-time-from-seconds-to-Year-Month-Day...… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] monetdb x100
by Cam Bazz 08 Feb '08

08 Feb '08

hello, I could not find a download for monetdb x100. is that a part of monetdb? Best.

2 1

[MonetDB-users] How to import tables along with data from MS Access into MonetDB
by Iftikharn 07 Feb '08

07 Feb '08

Hi Could any one kindly tell me how to import tables and data from MS Access into MonetDB. Regards, Iftikharn -- View this message in context: http://www.nabble.com/How-to-import-tables-along-with-data-from-MS-Access-i… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] MonetDB database server (Merovingian) is not running
by Iftikharn 06 Feb '08

06 Feb '08

Hi In MonetDB I want to create my own database "test" In one console I turned the mserver5 on by $mserver5 --dbinit="include sql;" # MonetDB server v5.2.0, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.0 loaded > In another concole, I issued the following command $monetdb create test The following message appears: Warning: MonetDB database server is not running successfully created database 'test' $monetdb status test monetdb status test name state uptime crashes test stopped 0 And $monetdb start test start: cannot perform: MonetDB Server (merovingian) is not running mserver5 is already running, how to run merovingian? I tried at the prompt $merovingian $ nothing happens Could any one help me to create my own database rather than the default one 'demo'. Regards, Iftikhar -- View this message in context: http://www.nabble.com/MonetDB-database-server-%28Merovingian%29-is-not-runn… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Accessing MonetDB with MAL through JBDC
by Michael 06 Feb '08

06 Feb '08

Hi folks, I just installed MonetDB. I tried to run the simplest examples and failed. :-( The MAL Reference does not semm really helpful though to me. My questions is, is it possible to use the DB as an embedded server with a Java application? The exampled displayed a C example only. Is it possible to communicate to the server with MAL? I want to write a backend for the Apache Directory Server. I want MonetDB to be it. I want to transform LDAP requests to MAL and get results back form the server. Is this possible at all with this DB? FYI: I am a C illiterate Mike -- <NO> OOXML - Say NO To Microsoft Office broken standard http://www.noooxml.org

5 10

Re: [MonetDB-users] (MonetWeb) monetweb/Docs manual.texi, Stable_2008-02-03, 1.37.2.3, 1.37.2.4
by Martin Kersten 04 Feb '08

04 Feb '08

This is not good and a remnant of Peter's attempt to get the Xquery stuff in. I did not have the time to correct it in a way that all intended results are available. Stefan Manegold wrote: > Update of /ufs/monet/repository/monetweb/Docs > In directory corona.ins.cwi.nl:/tmp/cvs-serv22830/Docs > > Modified Files: > Tag: Stable_2008-02-03 > manual.texi > Log Message: > > since I do not know, whether all these .texi files are supposed to exist, > or whether the reference to them are just legacy, > I (try to) comment them out, > to hope fully get (at least) a tiny step further with building the web site ... > > XQuery/Apache.texi > XQuery/POSIX.texi > XQuery/Windows.texi > XQuery/intro.texi > XQuery/Overview.texi > XQuery/DocMgmt.texi > XQuery/ListDoc.texi > XQuery/AddDoc.texi > XQuery/DelDoc.texi > XQuery/DocOther.texi > XQuery/Xquery.texi > XQuery/Functions.texi > XQuery/xrpc.texi > XQuery/FAQ.texi > > > Index: manual.texi > =================================================================== > RCS file: /ufs/monet/repository/monetweb/Docs/manual.texi,v > retrieving revision 1.37.2.3 > retrieving revision 1.37.2.4 > diff -u -d -r1.37.2.3 -r1.37.2.4 > --- manual.texi 4 Feb 2008 17:58:15 -0000 1.37.2.3 > +++ manual.texi 4 Feb 2008 18:21:05 -0000 1.37.2.4 > @@ -258,14 +258,15 @@ > @include MonetDB/iSQL-Viewer.texi > > @node Apache Configuration, CGI Interface, iSQL-Viewer, Client Interfaces > +@c @include XQuery/Apache.texi > @include XQuery/Security.texi > > @node CGI Interface, POSIX Interface, Apache Configuration, Client Interfaces > @include XQuery/CGI.texi > @node POSIX Interface, Windows Interface, CGI Interface, Client Interfaces > -@include XQuery/POSIX.texi > +@c @include XQuery/POSIX.texi > @node Windows Interface , SQL Reference, POSIX Interface, Client Interfaces > -@include XQuery/Windows.texi > +@c @include XQuery/Windows.texi > > @c ---------------------- SQL PART > @node SQL Reference, SQL Core, Windows Interface , Top > @@ -286,13 +287,13 @@ > > @node XQuery Reference, XQuery Overview, External Functions , Top > @chapter XQuery > -@include XQuery/intro.texi > +@c @include XQuery/intro.texi > > @node XQuery Overview, Database Scaleability, XQuery Reference , XQuery Reference > -@include XQuery/Overview.texi > +@c @include XQuery/Overview.texi > > @node Document Management, Document Collection, Pathfinder Project,XQuery Reference > -@include XQuery/DocMgmt.texi > +@c @include XQuery/DocMgmt.texi > @menu > * Document Collection:: > * Add Document:: > @@ -302,20 +303,20 @@ > @end menu > > @node Document Collection , Add Document, Document Management, Document Management > -@include XQuery/ListDoc.texi > +@c @include XQuery/ListDoc.texi > @node Add Document, Remove Document, Document Collection, Document Management > -@include XQuery/AddDoc.texi > +@c @include XQuery/AddDoc.texi > @node Remove Document, Cache Policy, Add Document, Document Management > -@include XQuery/DelDoc.texi > +@c @include XQuery/DelDoc.texi > @node Cache Policy, Miscellaneous, Remove Document, Document Management > @include XQuery/Cache.texi > @node Miscellaneous, Supported Functions, Cache Policy, Document Management > -@include XQuery/DocOther.texi > +@c @include XQuery/DocOther.texi > > @node Supported Functions, Prepared Queries , Miscellaneous , XQuery Reference > @section Supported Functions > -@include XQuery/Xquery.texi > -@include XQuery/Functions.texi > +@c @include XQuery/Xquery.texi > +@c @include XQuery/Functions.texi > > @node Prepared Queries, StandOff Extensions , Supported Functions ,XQuery Reference > @include XQuery/PreparedQueries.texi > @@ -325,10 +326,10 @@ > @include XQuery/Standoff.texi > > @node XRPC Extention, XQuery FAQ, Why StandOff Extensions?, XQuery Reference > -@include XQuery/xrpc.texi > +@c @include XQuery/xrpc.texi > > @node XQuery FAQ, Design Overview, SOAP Protocol, Top > -@include XQuery/FAQ.texi > +@c @include XQuery/FAQ.texi > > @c ---------------------- MAL Design PART > > >

1 0

[MonetDB-users] embedded SQL server under Windows
by Grigorio V. Moshkin 04 Feb '08

04 Feb '08

Hi, I've installed MonetDB/SQL/32bit under Windows, but I can't find DLL or LIB for embedded server. Although, MonetDB documentation mentioned embedded libraries for UNIX-like system: http://monetdb.cwi.nl/projects/monetdb/MonetDB/Documentation/A-Simple-Examp… But, what about Windows? Can I use MonetDB under Windows in embedded mode?

6 12

[MonetDB-users] MonetDB - backup, restore, transaction logs?
by Артур Суилин 04 Feb '08

04 Feb '08

I have a questions regarding MonetDB readiness for 24h per day production server usage: 1. Does it have any method for online (hot) full backup? Manual says about database dumps via mclient. Are they intended only for database transporation? Can I perform online backup via dump? What about data modifications/uncommited transactions during dump? 2. What about incremental backups? It seems MonetDB have some kind of transaction logs? How can I use them? 3. Does it have any defence against unexpected server crash? Manual says that checkpoint/recovery facility exists, but still not completely implemented/tested? 4. In the case of server crash and database corruption - how can I return database to consistent state? Does it have any tool like myisamchk for MySQL? Thank you. -- Arthur Suilin

1 0

[MonetDB-users] How to reset the password for a DB Insatnce
by sateesh 01 Feb '08

01 Feb '08

Hi All, How can i reset the password for a given DB Instance. Some how the default password monetdb is not getting accepted.. Thanks Sateesh -- View this message in context: http://www.nabble.com/How-to-reset-the-password-for-a-DB-Insatnce-tp1519457… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] JDBC Driver Problem with the new Build..
by sateesh 01 Feb '08

01 Feb '08

HI All, We got the latest build and the JDBC Driver seems to be giving lot of problems.. When i try to view the tables for a given schema it doesn't show any even if there are tables. ( if i execute a select query it returns the results..) Also when i execute a query i am getting the following Error after the results.. [ERROR] Exception in ResultSet for "MYSCHEMA" java.sql.SQLException: Method not implemented yet, sorry! at nl.cwi.monetdb.jdbc.MonetResultSet.getCharacterStream(MonetResultSet.java:294) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.quantum.util.proxy.ProxyFactory$InvocationHandlerImpl.invoke(ProxyFactory.java:37) at $Proxy3.getCharacterStream(Unknown Source) at com.quantum.sql.SQLStandardResultSetResults.getStringFromCharacterSteam(SQLStandardResultSetResults.java:250) at com.quantum.sql.SQLStandardResultSetResults.parseResultSet(SQLStandardResultSetResults.java:147) at com.quantum.sql.SQLStandardResultSetResults.create(SQLStandardResultSetResults.java:69) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:139) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:91) at com.quantum.actions.BaseExecuteAction.getSQLResults(BaseExecuteAction.java:202) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:174) at com.quantum.actions.ExecuteAction.execute(ExecuteAction.java:98) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:125) at com.quantum.actions.BaseExecuteAction.run(BaseExecuteAction.java:111) at org.eclipse.ui.actions.BaseSelectionListenerAction.runWithEvent(BaseSelectionListenerAction.java:168) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:443) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:66) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1101) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3319) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:2971) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2389) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2353) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2219) at org.eclipse.ui.internal.Workbench$4.run(Workbench.java:466) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:289) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:461) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:106) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:153) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:106) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:76) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:363) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:504) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:443) at org.eclipse.equinox.launcher.Main.run(Main.java:1169) [/ERROR] thanks sateesh -- View this message in context: http://www.nabble.com/JDBC-Driver-Problem-with-the-new-Build..-tp15205660p1… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Running multiple mserver5 processes, Merovingian port allocation
by McKennirey.Matthew 01 Feb '08

01 Feb '08

2 1

[MonetDB-users] ALTER TABLE doesn't work in MonetDB !!
by sateesh 30 Jan '08

30 Jan '08

Hi All, I am trying to add columns at the run time to one of the Tables and i am getting an error No Such Table. But when i try to select values from the table i get the values ( there are no rows in this table and no key columns as well..) Here is the Error: [CODE] Error Executing: ALTER TABLE collection_1234.collection_info add customer_a_name varchar(256):java.sql.SQLException: ALTER TABLE: no such table 'collection_info' java.sql.SQLException: ALTER TABLE: no such table 'collection_info' at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2048) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1798) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.quantum.util.proxy.ProxyFactory$InvocationHandlerImpl.invoke(ProxyFactory.java:37) at $Proxy4.execute(Unknown Source) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:133) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:91) at com.quantum.actions.BaseExecuteAction.getSQLResults(BaseExecuteAction.java:202) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:174) at com.quantum.actions.ExecuteAction.execute(ExecuteAction.java:98) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:125) at com.quantum.actions.BaseExecuteAction.run(BaseExecuteAction.java:111) at org.eclipse.ui.actions.BaseSelectionListenerAction.runWithEvent(BaseSelectionListenerAction.java:168) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:443) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:66) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1101) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3319) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:2971) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2389) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2353) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2219) at org.eclipse.ui.internal.Workbench$4.run(Workbench.java:466) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:289) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:461) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:106) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:153) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:106) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:76) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:363) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:504) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:443) at org.eclipse.equinox.launcher.Main.run(Main.java:1169) SQL (DPACUSTOMER1) [select * from collection_1234.collection_info] Success: result set displayed [/CODE] Is this a bug or am i missing some thing ?? Thanks Sateesh -- View this message in context: http://www.nabble.com/ALTER-TABLE-doesn%27t-work-in-MonetDB-%21%21-tp151680… Sent from the monetdb-users mailing list archive at Nabble.com.

2 5

Re: [MonetDB-users] subscribe
by Yuvaraj Athur Raghuvir 30 Jan '08

30 Jan '08

Hello, I am experimenting with in-memory row-based & column-based stores. For the row-based store I am using SQLite. For the column-based, I am proposing to use MonetDB. In this context, I would like to join the mailing list. I am working on Windows XP / 32 and would like to use MonetDB as a DLL. Regards, Yuva

1 0

[MonetDB-users] SQL Function to remove all alpha characters
by Venks 28 Jan '08

28 Jan '08

Hi, Does MonetDB has regular expression support in SQL? I am looking to remove all alpha characters in a column value and wondering if there is a better way to do so rather than removing one character at a time. Thanks, -Venks

3 2

[MonetDB-users] Crash during COPY INTO on --nightly=stable 2008-01-21
by Bob Ippolito 23 Jan '08

23 Jan '08

So here's the core dump for our ETL test with --nightly=stable. We have not yet tried to restart mserver5. Here's some stats on the data dirs: $ du -sh * 10G bat 4.0K box 5.6G core.6950 $ find bat|wc -l 777933 (box is an empty dir) Core was generated by `//mochi/bin/mserver5 --dbname=mochiads_stats --dbinit=include sql; --dbfarm=/da'. Program terminated with signal 6, Aborted. #0 0x00002b5e2eb77cab in raise () from /lib/libc.so.6 (gdb) bt #0 0x00002b5e2eb77cab in raise () from /lib/libc.so.6 #1 0x00002b5e2eb79660 in abort () from /lib/libc.so.6 #2 0x00002b5e2ebaf66b in ?? () from /lib/libc.so.6 #3 0x00002b5e2ebb6b23 in ?? () from /lib/libc.so.6 #4 0x00002b5e2ebba26c in free () from /lib/libc.so.6 #5 0x00002b5e2d18f63e in GDKfree (blk=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_utils.mx:1140 #6 0x00002b5e2d12bd2d in HEAPfree (h=0x1e7270d0) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_heap.mx:265 #7 0x00002b5e2d1d3a50 in BATfree (b=0x1e726f98) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_bat.mx:522 #8 0x00002b5e2d129d3e in BBPfree (b=0x1e726f98, calledFrom=0x2b5e2d2eb338 "BBPtrim") at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_bbp.mx:1748 #9 0x00002b5e2d12a841 in BBPtrim (memtarget=0, vmtarget=0) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_bbp.mx:2081 #10 0x00002b5e2d190d7d in GDKmemchk (memchk=1, vmchk=761245848) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_utils.mx:688 #11 0x00002b5e2d19166d in GDKvmalloc (size=707393416, maxsize=0x42801688, emergency=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_utils.mx:1306 #12 0x00002b5e2d191b30 in GDKmallocmax (size=<value optimized out>, maxsize=0x3439f438, emergency=0) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_utils.mx:1051 #13 0x00002b5e2d12c630 in HEAPalloc (h=0x3439f438, nitems=88424175, itemsize=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_heap.mx:127 #14 0x00002b5e2d115a02 in HASHnew (hp=0x1b26, tpe=6, size=21315311, mask=18446744073709551615) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_search.mx:289 #15 0x00002b5e2d116fc4 in BAThash (b=0x2aab2d943118, masksize=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_search.mx:383 #16 0x00002b5e2d253853 in BAThashjoin (l=0x190, r=0x2aab2d943118, estimate=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_relop.mx:426 #17 0x00002b5e2d2501aa in batjoin (l=0x2aab9c1f6128, r=0x2aabb04f49f8, estimate=9223372036854775808, swap=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_relop.mx:1157 #18 0x00002b5e2d25050b in BATjoin (l=0x1b26, r=0x2356, estimate=6) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_relop.mx:1168 #19 0x00002aaab14a5302 in ALGjoinPath (mb=<value optimized out>, stk=0x2aab56174f18, pci=0x245b2378) ---Type <return> to continue, or q <return> to quit--- at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/optimizer/opt_joinpath.mx:223 #20 0x00002b5e2c880504 in runMALsequence (cntxt=0x604980, mb=0x2aab697741b8, startpc=1, stoppc=0, stk=0x2aab56174f18, env=0x0, pcicaller=0x0) at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_interpreter.mx:1159 #21 0x00002b5e2c8821cb in callMAL (cntxt=0x604980, mb=0x2aab697741b8, env=0x42803fd8, argv=0x42803fb0, debug=0 '\0') at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_interpreter.mx:377 #22 0x00002aaab266d19c in SQLexecutePrepared (cntxt=0x604980, be=<value optimized out>, q=0x2aab1c3ca488) at /scratch/monet.GNU.64.64.d.29168/sql/src/backends/monet5/sql_scenario.mx:1188 #23 0x00002aaab266ed0d in SQLengineIntern (c=0x604980, be=0x2aab140554d8) at /scratch/monet.GNU.64.64.d.29168/sql/src/backends/monet5/sql_scenario.mx:1273 #24 0x00002b5e2c8a105d in runScenarioBody (c=0x604980) at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_scenario.mx:558 #25 0x00002b5e2c8a113a in runScenario (c=0x1b26) at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_scenario.mx:622 #26 0x00002b5e2c87c1d8 in MSserveClient (dummy=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_session.mx:471 #27 0x00002b5e2df362a5 in start_thread () from /lib/libpthread.so.0 #28 0x00002b5e2ec1661d in clone () from /lib/libc.so.6 #29 0x0000000000000000 in ?? () (gdb) And this is the log of everything printed by mserver5: !WARNING: GDKlockHome: created directory /data/db/monetdb/mochiads_stats/ !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. !WARNING: BBPdir: initializing BBP. # MonetDB server v5.2.3, based on kernel v1.20.1 # Serving database 'mochiads_stats' # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /mochi/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.3 loaded >*** glibc detected *** //mochi/bin/mserver5: free(): invalid pointer: 0x00002aae5199e008 *** ======= Backtrace: ========= /lib/libc.so.6[0x2b5e2ebb6b23] /lib/libc.so.6(cfree+0x8c)[0x2b5e2ebba26c] /mochi/lib/libbat.so.0(GDKfree+0x2e)[0x2b5e2d18f63e] /mochi/lib/libbat.so.0(HEAPfree+0xad)[0x2b5e2d12bd2d] /mochi/lib/libbat.so.0(BATfree+0x1f0)[0x2b5e2d1d3a50] /mochi/lib/libbat.so.0[0x2b5e2d129d3e] /mochi/lib/libbat.so.0(BBPtrim+0x851)[0x2b5e2d12a841] /mochi/lib/libbat.so.0[0x2b5e2d190d7d] /mochi/lib/libbat.so.0(GDKvmalloc+0xdd)[0x2b5e2d19166d] /mochi/lib/libbat.so.0(GDKmallocmax+0xf0)[0x2b5e2d191b30] /mochi/lib/libbat.so.0(HEAPalloc+0x170)[0x2b5e2d12c630] /mochi/lib/libbat.so.0(HASHnew+0x32)[0x2b5e2d115a02] /mochi/lib/libbat.so.0(BAThash+0x334)[0x2b5e2d116fc4] /mochi/lib/libbat.so.0(BAThashjoin+0x3193)[0x2b5e2d253853] /mochi/lib/libbat.so.0[0x2b5e2d2501aa] /mochi/lib/libbat.so.0(BATjoin+0xb)[0x2b5e2d25050b] /mochi/lib/MonetDB5/lib/lib_optimizer.so(ALGjoinPath+0x222)[0x2aaab14a5302] /mochi/lib/libmal.so.0[0x2b5e2c880504] /mochi/lib/libmal.so.0(callMAL+0x25b)[0x2b5e2c8821cb] /mochi/lib/MonetDB5/lib/lib_sql.so(SQLexecutePrepared+0x25c)[0x2aaab266d19c] /mochi/lib/MonetDB5/lib/lib_sql.so(SQLengineIntern+0x21d)[0x2aaab266ed0d] /mochi/lib/libmal.so.0(runScenarioBody+0x14d)[0x2b5e2c8a105d] /mochi/lib/libmal.so.0(runScenario+0x3a)[0x2b5e2c8a113a] /mochi/lib/libmal.so.0(MSserveClient+0x58)[0x2b5e2c87c1d8] /lib/libpthread.so.0[0x2b5e2df362a5] /lib/libc.so.6(clone+0x6d)[0x2b5e2ec1661d] ======= Memory map: ======== 00400000-00404000 r-xp 00000000 fe:00 2115695 /mochi/bin/mserver5 00604000-00605000 rw-p 00004000 fe:00 2115695 /mochi/bin/mserver5 00605000-3ffec000 rw-p 00605000 00:00 0 [heap] 40000000-40001000 ---p 40000000 00:00 0 40001000-40801000 rw-p 40001000 00:00 0 40801000-40802000 ---p 40801000 00:00 0 40802000-41002000 rw-p 40802000 00:00 0 41002000-41003000 ---p 41002000 00:00 0 41003000-41803000 rw-p 41003000 00:00 0 41803000-41804000 ---p 41803000 00:00 0 41804000-42004000 rw-p 41804000 00:00 0 42004000-42005000 ---p 42004000 00:00 0 42005000-42805000 rw-p 42005000 00:00 0 2aaaaabaf000-2aaaaabb3000 r-xp 00000000 fe:00 2085181 /mochi/lib/MonetDB5/lib/lib_mdb.so.0.0.0 2aaaaabb3000-2aaaaadb3000 ---p 00004000 fe:00 2085181 /mochi/lib/MonetDB5/lib/lib_mdb.so.0.0.0 2aaaaadb3000-2aaaaadb4000 rw-p 00004000 fe:00 2085181 /mochi/lib/MonetDB5/lib/lib_mdb.so.0.0.0 2aaaaadb4000-2aaaaadb6000 r-xp 00000000 fe:00 2084480 /mochi/lib/MonetDB5/lib/lib_xml.so.0.0.0 2aaaaadb6000-2aaaaafb5000 ---p 00002000 fe:00 2084480 /mochi/lib/MonetDB5/lib/lib_xml.so.0.0.0 2aaaaafb5000-2aaaaafb6000 rw-p 00001000 fe:00 2084480 /mochi/lib/MonetDB5/lib/lib_xml.so.0.0.0 2aaaaafbd000-2aaaab03e000 r-xp 00000000 fe:00 540697 /lib/libm-2.5.so 2aaaab03e000-2aaaab23d000 ---p 00081000 fe:00 540697 /lib/libm-2.5.so 2aaaab23d000-2aaaab23f000 rw-p 00080000 fe:00 540697 /lib/libm-2.5.so 2aaaab23f000-2aaaab24d000 r-xp 00000000 fe:00 2016109 /mochi/lib/libMapi.so.0.0.0 2aaaab24d000-2aaaab44c000 ---p 0000e000 fe:00 2016109 /mochi/lib/libMapi.so.0.0.0 2aaaab44c000-2aaaab44d000 rw-p 0000d000 fe:00 2016109 /mochi/lib/libMapi.so.0.0.0 2aaaab44d000-2aaaab44e000 r-xp 00000000 fe:00 2085120 /mochi/lib/MonetDB5/lib/lib_unix.so.0.0.0 2aaaab44e000-2aaaab64d000 ---p 00001000 fe:00 2085120 /mochi/lib/MonetDB5/lib/lib_unix.so.0.0.0 2aaaab64d000-2aaaab64e000 rw-p 00000000 fe:00 2085120 /mochi/lib/MonetDB5/lib/lib_unix.so.0.0.0 2aaaab64e000-2aaaab650000 r-xp 00000000 fe:00 2085099 /mochi/lib/MonetDB5/lib/lib_lock.so.0.0.0 2aaaab650000-2aaaab84f000 ---p 00002000 fe:00 2085099 /mochi/lib/MonetDB5/lib/lib_lock.so.0.0.0 2aaaab84f000-2aaaab850000 rw-p 00001000 fe:00 2085099 /mochi/lib/MonetDB5/lib/lib_lock.so.0.0.0 2aaaab850000-2aaaab851000 r-xp 00000000 fe:00 2085118 /mochi/lib/MonetDB5/lib/lib_sema.so.0.0.0 2aaaab851000-2aaaaba51000 ---p 00001000 fe:00 2085118 /mochi/lib/MonetDB5/lib/lib_sema.so.0.0.0 2aaaaba51000-2aaaaba52000 rw-p 00001000 fe:00 2085118 /mochi/lib/MonetDB5/lib/lib_sema.so.0.0.0 2aaaaba52000-2aaaaba57000 r-xp 00000000 fe:00 2085116

2 1