- users-list - monetdb.org

[MonetDB-users] MonetDB as server side environment
by bryan rasmussen 18 May '08

18 May '08

Hi, I'm thinking about moving some applications I have running in eXist to MonetDB, just to gauge performance and possibilities. These applications take parameters from the querystring, is there an example of accessing the querystring in a MonetDB Xquery XQL file when it runs? Best Regards, Bryan Rasmussen

3 2

[MonetDB-users] MonetDB V 4.22 installation on Mac OS X 10.5.2 and Mac OS X 10.4.0.
by Irini Fundulaki 16 May '08

16 May '08

Hi, I have the following problems with MonetDB XQuery Release Feb 2008, V. 4.22 on Mac OS X 10.5.2 and Mac OS X 10.4.0. 1) Mac OS X 10.5.2: a) I was not able to install MonetDB from sources. I downloaded MonetDB-Feb2008-SuperBall.bz2 and followed the instructions in http://monetdb.cwi.nl/projects/monetdb//MonetDB/Documentation/Linux-Install…. I successfully installed MonetDB, clients and MonetDB4-server, but when installing MonetDB4-XQuery I had the following error: Undefined symbols: "_embedded_mil", referenced from: _main in prog.o ld: symbol(s) not found collect2: ld returned 1 exit status make[5]: *** [Mbeddedxq] Error 1 make[4]: *** [all] Error 2 make[3]: *** [all-recursive] Error 1 make[2]: *** [all] Error 2 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 b) by calling monetdb-install.sh. MonetDB was installed with no problems. Nevertheless, mclient with a simple query (e.g., <example>hello</example) stalled. Mserver stalled when executing xmldb_print(); 2) Mac OS X 10.4.0 a) I was able to install MonetDB XQuery Release Feb 2008, V. 4.22 using monetdb-install.sh. Mserver did not stall with xmldb_print(). mclient for the same query exhibited different behaviors: that is, sometimes it stalled, and others not (again, the same simple query as before). I had downloaded MonetDB on September 2007, and installed it on Mac OS X 10.4.0. I had no problem with that version. Thanks for looking into it, Irini

1 0

[MonetDB-users] multi-query optimization?
by Chinyi Woo 16 May '08

16 May '08

Hello, I have a set of xqueres, which need to be run against a xml doc. In my xqueries, there are many common subexpressions. May I ask you whether MonetDB does any multi-query optimization, or the current version of MonetDB runs them sequentially? Thanks Chinyi

2 1

[MonetDB-users] question about composite uniqueness constraints
by Drew Sky 15 May '08

15 May '08

Hi, I have a question about creating composite uniqueness constraints in monetdb. Say I create the following table called test_property with 3 columns: subject, p1, p2. I want uniqueness contraints for each pair of (subject, p1) and (subject, p2). I try to do this with the following: sql>create table test_property(subject integer, p1 integer, p2 integer, unique(subject, p1), unique(subject, p2)); sql>\d test_property CREATE TABLE "sys"."test_property" ( "subject" int, "p1" int, "p2" int, CONSTRAINT "test_property_subject_p2_unique" UNIQUE ("subject"), CONSTRAINT "test_property_subject_p1_unique" UNIQUE ("subject", "p2", "p1") ); But somehow, I end up with a constraint on "subject" by itself and one on ("subject", p2, p1). Is this a bug in monetdb or am I missing something? I ran the exact same commands in postgres and I got my expected results (2 uniqueness contraints on (subject, p1) and (subject, p2)). I tried also creating the table first, then adding columns and the uniqueness constraint after using ALTER TABLE, but I got the same results. Does anyone see something I'm doing wrong? Thanks Andrew

3 2

[MonetDB-users] Space measurement and data compression in monetdb
by Iftikharn 15 May '08

15 May '08

I have two queries regarding monetdb: Is it possible to measure that how much space/memory each table has occupied? and Is is possible to compress the data (by using a command...)? Regards, Iftikhar -- View this message in context: http://www.nabble.com/Space-measurement-and-data-compression-in-monetdb-tp1… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] broken links on prepared queries
by Chinyi Woo 14 May '08

14 May '08

Hello I have a set of xqueries and want to convert all of them into prepared queries for better performance. I want to see several concrete examples to know how to do this. However, the link at http://monetdb.cwi.nl/XQuery/Version4/Documentation/PreparedQueries/q.xq and http://monetdb.cwi.nl/XQuery/Version4/Documentation/PreparedQueries/m.xq are broken. Could anyone please fix it? thanks Chinyi

2 1

[MonetDB-users] How to measure the performance of a SQL query
by Allan12 14 May '08

14 May '08

How could we measure the performance of a SQL query. I have a table with 100,000 rows and if I peform a SQL query on it, what statistical data I could get. -- View this message in context: http://www.nabble.com/How-to-measure-the-performance-of-a-SQL-query-tp17227… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] SQL Query performance
by Allan12 14 May '08

14 May '08

How could we measure the performance of a SQL query. I have a table with 100,000 rows and if I peform a SQL query on it, what statistical data I could get in addition to time. -- View this message in context: http://www.nabble.com/SQL-Query-performance-tp17227222p17227222.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] How could I run a set of XQuery in a batch?
by Chinyi Woo 14 May '08

14 May '08

Hello, everyone May I ask you how to run a set of XQueries in a batch? I am using MonetDB v4.22.0 on Redhat Linux. I have a set of XQueries. I want to run them against a single xml document and collect the running time. Currently I am only able to submit one XQuery at a time at the mclient commandline. Is there anyway for me to send all my XQueries in a batch and get the total running time? I also have another question. Does MonetDB handle multi-query optimization? I mean if more than one query have common subexpressions, will MonetDB evaluate them just once? Thanks in advance. Chinyi

2 1

[MonetDB-users] A sanity check on MondetDB/XQuery performance
by Nils Grimsmo 13 May '08

13 May '08

Using the "super-ball" from February. I am running some queries, and just want to check if my performance is sane. Are there more indexes I can ask to get built to increase performance? I don't ask for an accurate verification, just a hint of whether or not we are within an order of magnitude of what seems right :) $ Mserver --dbinit="module(pathfinder);" --set mapi_port=60000 $ echo 'pf:add-doc("path/dblp.xml", "dblp.xml")' | mclient --lx -p60000 --time Timer 73068.138 msec $ echo 'pf:documents()' | mclient -lx -p60000 <document updatable="false" url="path/dblp.xml" collection="dblp.xml">dblp.xml</document> $ cat dblp_q7.xq count(doc("dblp.xml")/dblp/*[author="Michael Stonebraker" and author="Hector Garcia-Molina" and year > 1950 ]/title) $ mclient -lx -p 60000 --time < dblp_q7.xq 4 Timer 15512.186 msec (Repeated multiple times for warm-up) My dblp.xml is 441 MB. Mserver uses 1.9 of 3.4 GB memory. $ cat /proc/cpuinfo <snip> model name : AMD Athlon(tm) 64 Processor 3500+ cpu MHz : 2210.763 cache size : 512 KB The dbfarm resides on a WD740GD (http://techreport.com/articles.x/6390) Klem fra Nils

3 3

[MonetDB-users] mclient command line history question
by Drew Sky 12 May '08

12 May '08

Hello, I am having trouble using the command line history feature of mclient. After I run a query at the command line, I can't re-use the same query by pressing the up-arrow. From documentation, it seems like I should be able to do this. Is this a feature I should have compiled in, when building from source code? When I press the up-arrow after a query I get sql>^[[A I've tried adding the --history and --interactive options but it doesn't help. I've also tried changing the terminal setting to other modes (I'm using linux) but this doesn't help either. Can anyone help me out? Thanks, Andrew ____________________________________________________________________________________ Be a better friend, newshound, and know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ

2 1

[MonetDB-users] php5 and windows
by Michiel Kamermans 08 May '08

08 May '08

Hi all, I've been hearing interesting things about MonetDB so I figured I'd see how it performed with the data that my website uses (several million cross-referencing records of Japanese/English dictionary data) by installing it for use with PHP5... but I ran into a problem come actual PHP interfacing. Which steps must be taken to get PHP5 to properly interface with MonetDB on a windows machine? The online documentation (http://homepages.cwi.nl/~mk/MonetDB/The-PHP-Library.html) has a wonderful, if slightly useless, "TODO" for the windows instruction section, and the self-help approach of simply placing the php_monetdb.dll file in PHP's extensions directory and adding an "extension=php_monetdb.dll" to the PHP.ini file leads to PHP throwing up a terminal error when it then tries to run. Any help is appreciated. - Mike Kamermans

1 0

[MonetDB-users] Limit statements
by Henrik Vendelbo 07 May '08

07 May '08

The section on sorting and limit 3.1.7.2 Select lists, distinct, sorting, limit Is very brief and doesn't seem to describe limit/sort, does this mean that LIMIT/OFFSET is supported or that ROW_NUMBER should be used? Henrik

2 1

[MonetDB-users] MonetDB/XQuery not coming back
by Richard Eckart 06 May '08

06 May '08

Hi there, I am looking again into MonetDB/XQuery. A colleague of mine ran a little test on MonetDB/XQuery and made the experience that when starting the server and importing some documents, a query is possible. But when killing the server (running as deamon - killed with CTRL-C), restarting it the same query never comes back. He tried this under FreeBSD and I am experiencing the same problem now on Mac OS X 10.4.11. I turned on debug logging (level 255) but did not see anything that would help me. The only thing I really did see were lines like this while the client was hanging and the CPU running at 100% load. # batstamp(-1418) = -292 # batstamp(1663) = -84581 # batstamp(1662) = -84582 # batstamp(1662) = -84583 # batstamp(-1659) = -84584 # batstamp(1662) = -84585 # batstamp(1449) = 0 # batstamp(1633) = 0 Killing the client the server would still be running producing these lines with the numbers keeping on sinking (getting more negative). After killing the server (CTRL-C) and restarting it I can browse the database using the web interface, but whenever I run the query it goes bye-bye. The query that ran successfully directly after import but not after restart is this: > declare namespace leveler="urn:xmlns:sfb441:leveler"; > > let $lexical := > pf:documents()[@collection eq 'tuebadz' and > fn:starts-with(., 'Corpus-Lexical')]/fn:string(text > ()) > > let $verbs := ( > for $doc in $lexical > return fn:doc($doc)//tok[fn:starts-with(fn:string(pos/ > @leveler:text), "V")] > ) > > return element results { > attribute matches { count($verbs) }, > for $verb in $verbs/fn:string(orth) > order by $verb > return element verb { $verb } > } If I slightly modify the query removing /fn:string(orth), the query runs well. I played around a little and whenever I try to access the "orth" element in any way it goes bye-bye. The "tok" elements have another child called "pos" which I can access just fine. The difference is that "orth" contains a text node while "pos" is an empty tag. Example: > <tok id="s_7_n_15"> > <orth>seien</orth> > <pos xmlns:leveler="urn:xmlns:sfb441:leveler" leveler:text="VAFIN" > func="HD" /> > </tok> Do you have any ideas how to fix/handle this problem? Thank you very much. Cheers, Richard

1 0

[MonetDB-users] Tutorial for database scripting language MIL?
by jz＠uva 06 May '08

06 May '08

Hi all, Does someone have a tutorial for the database scripting language MIL? I am currently checking pftijah.mx, but I am wondering whether there is a better option than trying to reverse engineer things. Thanks, junte

3 2

[MonetDB-users] MySQLError ?
by Henrik Vendelbo 06 May '08

06 May '08

I was having a look at the __init__.py module header for MonetSQLdb, and saw the following: __all__ = [ 'BINARY', 'Binary', 'Connect', 'Connection', 'DATE', 'Date', 'Time', 'Timestamp', 'DateFromTicks', 'TimeFromTicks', 'TimestampFromTicks', 'DataError', 'DatabaseError', 'Error', 'FIELD_TYPE', 'IntegrityError', 'InterfaceError', 'InternalError', 'MySQLError', 'NULL', 'NUMBER', 'NotSupportedError', 'DBAPISet', What is the reference to MySQLError doing in the code? I suppose it is just ignored by the interpreter but surely it is a mistake. Warning, OperationalError, and ProgrammingError are not exported by the module. Henrik

2 1

[MonetDB-users] Fwd: [ monetdb-Bugs-1957794 ] How to debug on Windows OS?
by Lefteris 05 May '08

05 May '08

Please read carefully the following comments to avoid opening a third bug with the same question. thank you ---------- Forwarded message ---------- From: SourceForge.net <noreply(a)sourceforge.net> Date: Mon, May 5, 2008 at 10:30 AM Subject: [ monetdb-Bugs-1957794 ] How to debug on Windows OS? To: noreply(a)sourceforge.net Bugs item #1957794, was opened at 2008-05-05 09:50 Message generated for change (Comment added) made by lsidir You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=482468&aid=1957794&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed >Resolution: Rejected Priority: 5 Private: No Submitted By: lxwandy (lxwandy) Assigned to: Nobody/Anonymous (nobody) Summary: How to debug on Windows OS? Initial Comment: Hi.. I want to know about the method of debugging MonetDB on Windows OS. After compiering MonetDB use "namke" , how can I debug it. Is special debug tool needed? ---------------------------------------------------------------------- >Comment By: Lefteris Sidirourgos (lsidir) Date: 2008-05-05 10:30 Message: Logged In: YES user_id=1856546 Originator: NO Hi, this question will be answered if you post it to the monetdb-user mailing list. See http://monetdb.cwi.nl/projects/monetdb/Development/MailChannels/index.html about our mailing lists. This is the bugtracker, a tool to submit bugs rather than questions. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=482468&aid=1957794&group_…

1 0

[MonetDB-users] Django Backend: SQL column types
by Henrik Vendelbo 04 May '08

04 May '08

Hi guys, I am jumping straight into the deep end with Monet. My first task is to implement a backend for Django written in Django. I need to map the field types to SQL column types, and that is for the most part easy, yet a few questions: 1) Is 'integer' accepted, or do I have to use 'int' 2) How do I specify a floating point with specified max_digits and decimal_places? I didn't see support for numeric in the docs. 3) How do I specify unsigned integers? unsigned or check expression? Is there a text field, or should I use varchar/clob ? These are my definitions as they stand so far: DATA_TYPES = { 'AutoField': 'serial', 'BooleanField': 'boolean', 'CharField': 'varchar(%(maxlength)s)', 'CommaSeparatedIntegerField': 'varchar(%(maxlength)s)', 'DateField': 'date', 'DateTimeField': 'timestamp', 'FileField': 'varchar(100)', 'FilePathField': 'varchar(100)', 'FloatField': 'numeric(%(max_digits)s, %(decimal_places)s)', 'ImageField': 'varchar(100)', 'IntegerField': 'int', 'IPAddressField': 'char(15)', 'ManyToManyField': None, 'NullBooleanField': 'bool', 'OneToOneField': 'int', 'PhoneNumberField': 'varchar(20)', 'PositiveIntegerField': 'integer unsigned', # TODO how should this be handled??? 'PositiveSmallIntegerField': 'smallint unsigned', # TODO how should this be handled??? 'SlugField': 'varchar(%(maxlength)s)', 'SmallIntegerField': 'smallint', 'TextField': 'text', 'TimeField': 'time', 'USStateField': 'varchar(2)', } Thanks, Henrik

3 2

[MonetDB-users] Performance issues with queries in SQL
by Nils Grimsmo 01 May '08

01 May '08

I have tables with around 12 million rows and large primary keys. I find the performance for various queries to be rather strange. * Why is Q2 (see below) so much slower than Q1? It is actually faster for me to use Q1 and do the rest of the matching myself. * Why is Q3 so immensely much faster than Q1? I understand that the first part of the primary key is selective in Q3. Do I understand right if Q1 scans until "type" matches, then scans until "name" matches, then scans until "value" matches? No indexes are put on disk, right? Then the matching for Q3 should be scan until "value" matches, which shouldn't be more than at most three times faster, right (if three columns are read instead of one for Q1)? I do Q1 twice to look for cash effects, but none are seen... Could some columns from the table "value" be cached and kept, without giving room for those from "type_name_value"? * Q4 has the same performance as Q1, as expected. * Why isn't Q5 faster than Q6? 82% of the rows have type=3. Fewer should be scanned to find that "!!foo" doesn't exist than for "~~foo", as "!" has a low ASCII value, while "~" is high. (See COUNT queries at the bottom.) Klem fra Nils Q1: SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' Q2: SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' AND doc = 1 AND nenc = '1.1.1.1' AND pos = 4 Q3: SELECT * FROM value WHERE value = 'Jurgen Annevelink' AND type = 3 AND name = 'author' Q4: SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = '__bar' Q5: SELECT * FROM type_name_value WHERE type = 3 AND name = '!!foo' AND value = '__bar' Q6: SELECT * FROM type_name_value WHERE type = 3 AND name = '~~foo' AND value = '__bar' Q7: SELECT * FROM type_name_value WHERE type = 3000 AND name = '__foo' AND value = '__bar' See runs below. Number of rows SELECT COUNT(type) FROM type_name_value % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 8 # length [ 12165109 ] Query time: 0.066192 SELECT COUNT(type) FROM value % nilsgri.value # table_name % count_no_nil_type # name % int # type % 8 # length [ 12165109 ] Query time: 0.058111 The PRIMARY KEY of type_name_value is (type,name,value,doc,nenc,pos) The PRIMARY KEY of value is (value,doc,nenc,pos) Q1: Search 3 first, match 3 first. SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 6, 17, 1, 12, 8, 3, 5 # length [ 3, "author", "Jurgen Annevelink", 1, "1.1.1.1", 4, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.23579.2.1", 724888, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.2487.3.1", 81996, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.42.2.1", 1071, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.533986.2.1", 17294725, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.576139.3.1", 18745432, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.944085.1.1", 30104242, 107, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.99173.2.1", 3191470, 56, true ] Query time: 1.643438 Q1: Repeat to check for disk cache effects. SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 6, 17, 1, 12, 8, 3, 5 # length [ 3, "author", "Jurgen Annevelink", 1, "1.1.1.1", 4, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.23579.2.1", 724888, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.2487.3.1", 81996, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.42.2.1", 1071, 5, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.533986.2.1", 17294725, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.576139.3.1", 18745432, 56, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.944085.1.1", 30104242, 107, true ] [ 3, "author", "Jurgen Annevelink", 1, "1.99173.2.1", 3191470, 56, true ] Query time: 1.615900 Q2: Search entire, match entire. SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = 'Jurgen Annevelink' AND doc = 1 AND nenc = '1.1.1.1' AND pos = 4 % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 6, 17, 1, 7, 1, 1, 5 # length [ 3, "author", "Jurgen Annevelink", 1, "1.1.1.1", 4, 5, true ] Query time: 11.073827 Q3: Use table value instead. SELECT * FROM value WHERE value = 'Jurgen Annevelink' AND type = 3 AND name = 'author' % nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value, nilsgri.value # table_name % value, doc, nenc, pos, type, name, pathid, complete # name % clob, int, varchar, int, int, varchar, int, boolean # type % 17, 1, 12, 8, 1, 6, 3, 5 # length [ "Jurgen Annevelink", 1, "1.1.1.1", 4, 3, "author", 5, true ] [ "Jurgen Annevelink", 1, "1.23579.2.1", 724888, 3, "author", 56, true ] [ "Jurgen Annevelink", 1, "1.2487.3.1", 81996, 3, "author", 5, true ] [ "Jurgen Annevelink", 1, "1.42.2.1", 1071, 3, "author", 5, true ] [ "Jurgen Annevelink", 1, "1.533986.2.1", 17294725, 3, "author", 56, true ] [ "Jurgen Annevelink", 1, "1.576139.3.1", 18745432, 3, "author", 56, true ] [ "Jurgen Annevelink", 1, "1.944085.1.1", 30104242, 3, "author", 107, true ] [ "Jurgen Annevelink", 1, "1.99173.2.1", 3191470, 3, "author", 56, true ] Query time: 0.000477 Q4: Search 3 first, match 2 first. SELECT * FROM type_name_value WHERE type = 3 AND name = 'author' AND value = '__bar' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 0, 0, 1, 0, 1, 1, 5 # length Query time: 1.617259 Q5: Search 3 first, match 1 first. '!' early in alphabet. SELECT * FROM type_name_value WHERE type = 3 AND name = '!!foo' AND value = '__bar' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 0, 0, 1, 0, 1, 1, 5 # length Query time: 0.530727 Q6: Search 3 first, match 1 first. '~' late in alphabet. SELECT * FROM type_name_value WHERE type = 3 AND name = '~~foo' AND value = '__bar' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 0, 0, 1, 0, 1, 1, 5 # length Query time: 0.534592 Q7: Search 3 first, match 0 first. SELECT * FROM type_name_value WHERE type = 3000 AND name = '__foo' AND value = '__bar' % nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value, nilsgri.type_name_value # table_name % type, name, value, doc, nenc, pos, pathid, complete # name % int, varchar, clob, int, varchar, int, int, boolean # type % 1, 0, 0, 1, 0, 1, 1, 5 # length Query time: 0.000407 Number of rows with type and name mathcing. SELECT COUNT(type) FROM type_name_value WHERE type = 3 AND name = 'author' % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 7 # length [ 2730959 ] Query time: 0.683863 Number of rows with type mathcing. SELECT COUNT(type) FROM type_name_value WHERE type = 3 % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 8 # length [ 10020569 ] Query time: 0.032573 SELECT COUNT(type) FROM type_name_value WHERE type = 3 AND name < '!!foo' % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 1 # length [ 0 ] Query time: 0.161186 SELECT COUNT(type) FROM type_name_value WHERE type = 3 AND name < '~~foo' % nilsgri.type_name_value # table_name % count_no_nil_type # name % int # type % 8 # length [ 10020569 ] Query time: 0.341732 Number of rows with type mathcing. real 0m18.372s user 0m0.005s sys 0m0.002s

2 3

[MonetDB-users] How to set the memory limit for monetDB.
by Kang Zhang 30 Apr '08

30 Apr '08

I am using the latest version of monetDB from the web-site(the super source tarball). My machine is a X86-64 machine with a red-hat installed on it. When I insert data into monetDB, it always requires memory from the system. Then it will be crashed with running out of memory. Is there a way to set the limit for memory used by monetDB ? I've read the docs on the web site and can't get what I need from that. Thank you. -- ------------------------------------------------------------ Kang Zhang Computer Science Dept. Shanghai Jiao Tong University

3 7

[MonetDB-users] Problems with parameters to mapi_param*()
by Nils Grimsmo 28 Apr '08

28 Apr '08

I am having some problems with the functions mapi_param*(). 1. It seems mapi_param() really wants a char* cast to a char**. (See the inner workings of mapi_param() vs. mapi_param_string().) 2. If mapi_param(), mapi_param_string() and mapi_param_type() get a char*, the value used in the query does not change as the char* is updated. Using mapi_bind_var( , , MAPI_INT, int*) and mapi_bind_var( , , MAPI_VARCHAR, char**) works as expected, while mapi_param_type( , , MAPI_INT, MAPI_INT, int*) and mapi_param_type( , , MAPI_VARCHAR, MAPI_VARCHAR, char**) do not. Is there something wrong with interface, or am I just using it wrong? Here is how I have tried using the functions: #include <cassert> #include <cstdio> #include <cstdlib> #include <cstring> #include <Mapi.h> using namespace std; Mapi dbh; void check(MapiHdl hdl, int ret = MOK, bool fatal = true) { if (ret != MOK || hdl == NULL || mapi_error(dbh)) { if (hdl) { mapi_explain_result(hdl,stderr); } else { mapi_explain(dbh,stderr); } if (fatal) assert(0);//exit(-1); } } void paramInt(MapiHdl hdl, int fldnr, int* val) { int ret = mapi_param_type(hdl, fldnr, MAPI_INT, MAPI_INT, val); check(hdl, ret); } void paramStr(MapiHdl hdl, int fldnr, char** val) { // int ret = mapi_param(hdl, fldnr, val); /* Case 1: * QUERY = INSERT INTO t VALUES(1, p`) * ERROR = !SELECT: identifier 'p`' unknown * Cast to (void*) in call to mapi_param_type() in mapi_param(). */ int ret = mapi_param(hdl, fldnr, (char**)*val); /* Case 2: * Works, sort of. * Seems it wants a (char*) really. * But 'foo' is inserted the second time instead of bar. */ // int ret = mapi_param_string(hdl, fldnr, MAPI_VARCHAR, *val, NULL); /* 'foo' twice. */ // int ret = mapi_param_string(hdl, fldnr, MAPI_VARCHAR, (char*)val, NULL); /* As Case 1. */ // int ret = mapi_param_type(hdl, fldnr, MAPI_VARCHAR, MAPI_VARCHAR, val); /* As Case 1. */ // int ret = mapi_param_type(hdl, fldnr, MAPI_VARCHAR, MAPI_VARCHAR, *val); /* 'foo' twice. */ check(hdl, ret); } int main() { dbh = mapi_connect("localhost", 50000, "nilsgri", "nilsgri", "sql", "proto"); MapiHdl hdl = mapi_query(dbh, "DROP TABLE t"); check(hdl, MOK, false); mapi_close_handle(hdl); hdl = mapi_query(dbh, "CREATE TABLE t (a INT, b VARCHAR(255))"); check(hdl); mapi_close_handle(hdl); hdl = mapi_prepare(dbh, "INSERT INTO t VALUES(?, ?)"); check(hdl); int a = 1; paramInt(hdl, 0, &a); char* b1 = strdup("'foo'"); char* b = b1; paramStr(hdl, 1, &b); int ret = mapi_execute(hdl); check(hdl, ret); a = 2; char* b2 = strdup("'bar'"); b = b2; // paramStr(hdl, 1, &b); // I would like not having to do this. ret = mapi_execute(hdl); check(hdl, ret); mapi_close_handle(hdl); hdl = mapi_quick_query(dbh, "SELECT * FROM t", stderr); check(hdl, ret); mapi_close_handle(hdl); mapi_disconnect(dbh); mapi_destroy(dbh); free(b1); free(b2); }

1 0

[MonetDB-users] Is it a bug? (insert into ... select command)
by Iftikharn 24 Apr '08

24 Apr '08

Hi I need to insert some null values into a table via a procedure. I created the table and did insert two rows. One with (insert into) command and second with (insert into ..select) command. Both commands work well and I could see two rows added in result. When I used the same (insert into.. select) command in a procedure. It behaves in a strange fashion. It shows that a row has been affected, but does not show the newly added row. If the rows are counted, it gives the correct count which is (3) in this case but still I could not see the last row which is added via a procedure. ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' create sequence "ff" as integer start with 1; CREATE TABLE t1(timeid INT DEFAULT NEXT VALUE FOR "ff" PRIMARY KEY, a INT, b INT, c INT, d INT, e INT, f VARCHAR(20), g VARCHAR(20), h INT, i VARCHAR(10), j VARCHAR(10), k VARCHAR(10), l INT, m INT, n VARCHAR(10), o VARCHAR(10), p VARCHAR(10), q VARCHAR(15), r INT ); ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' And then insert a row ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' insert into t1(a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r) values(1, 1, 1, 1, 1, 'first row', 'first row',1, 'first row', 'first row', 'first row',1,1, 'first row', 'first row', 'first row', 'first row', 1); select * from t1;sql>sql>sql>sql>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>more>sql> sql>Rows affected 1 sql> +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ | time |a |b |c |d |e |f |g |h |i |j |k |l |m |n |o |p |q |r | : id | | | | | | | | | | | | | | | | | | | +======+==+==+==+==+==+=====+=====+==+=====+======+======+==+==+======+======+======+======+==+ | 1 |1 |1 |1 |1 |1 |firs |firs |1 |firs |first |first |1 |1 |first |first |first |first |1 | : | | | | | |t |t | |t |row |row | | |row |row |row |row | | : | | | | | |row |row | |row | | | | | | | | | | +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' Every thing is fine so far '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' sql>insert into t1(a, b, c, d, e, f, g, h) select a, b, c, d, e, f, g, h from t1 where timeid = 1; Rows affected 1 sql>select * from t1; +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ | time |a |b |c |d |e |f |g |h |i |j |k |l |m |n |o |p |q |r | : id | | | | | | | | | | | | | | | | | | | +======+==+==+==+==+==+=====+=====+==+=====+======+======+==+==+======+======+======+======+==+ | 1 |1 |1 |1 |1 |1 |firs |firs |1 |firs |first |first |1 |1 |first |first |first |first |1 | : | | | | | |t |t | |t |row |row | | |row |row |row |row | | : | | | | | |row |row | |row | | | | | | | | | | | 2 |1 |1 |1 |1 |1 |firs |firs |1 |null |null |null |n |n |null |null |null |null |n | : | | | | | |t |t | | | | |u |u | | | | |u | : | | | | | |row |row | | | | |l |l | | | | |l | : | | | | | | | | | | | |l |l | | | | |l | +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' inserted another row and it works fine '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' sql>create procedure tt() begin insert into t1(a, b, c, d, e, f, g, h) select a, b, c, d, e, f, g, h from t1 where timeid = 1; end; call tt(); select * from t1; more>more>more> sql>Rows affected 1 sql>+------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ | time |a |b |c |d |e |f |g |h |i |j |k |l |m |n |o |p |q |r | : id | | | | | | | | | | | | | | | | | | | +======+==+==+==+==+==+=====+=====+==+=====+======+======+==+==+======+======+======+======+==+ | 1 |1 |1 |1 |1 |1 |firs |firs |1 |firs |first |first |1 |1 |first |first |first |first |1 | : | | | | | |t |t | |t |row |row | | |row |row |row |row | | : | | | | | |row |row | |row | | | | | | | | | | | 2 |1 |1 |1 |1 |1 |firs |firs |1 |null |null |null |n |n |null |null |null |null |n | : | | | | | |t |t | | | | |u |u | | | | |u | : | | | | | |row |row | | | | |l |l | | | | |l | : | | | | | | | | | | | |l |l | | | | |l | +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' The problem starts now: when I try to insert the row via a procedure it shows that row effected 1 but does not show the row. ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' sql>select count(*) from t1; +--------+ | count_ | +========+ | 3 | +--------+ sql>select timeid from t1; +--------+ | timeid | +========+ | 1 | | 2 | | 3 | +--------+ sql>select * from t1; +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ | time |a |b |c |d |e |f |g |h |i |j |k |l |m |n |o |p |q |r | : id | | | | | | | | | | | | | | | | | | | +======+==+==+==+==+==+=====+=====+==+=====+======+======+==+==+======+======+======+======+==+ | 1 |1 |1 |1 |1 |1 |firs |firs |1 |firs |first |first |1 |1 |first |first |first |first |1 | : | | | | | |t |t | |t |row |row | | |row |row |row |row | | : | | | | | |row |row | |row | | | | | | | | | | | 2 |1 |1 |1 |1 |1 |firs |firs |1 |null |null |null |n |n |null |null |null |null |n | : | | | | | |t |t | | | | |u |u | | | | |u | : | | | | | |row |row | | | | |l |l | | | | |l | : | | | | | | | | | | | |l |l | | | | |l | +------+--+--+--+--+--+-----+-----+--+-----+------+------+--+--+------+------+------+------+--+ sql> ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' I could not see the 3rd row *********************************** Regards, Nadeem -- View this message in context: http://www.nabble.com/Is-it-a-bug--%28insert-into-...-select-command%29-tp1… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] MServer crashing: Random Segmentation fault
by jz＠uva 24 Apr '08

24 Apr '08

Hi all, I am using MD4 with XQuery + PF/Tijah module. I have a problem that my server sometimes/frequently crashes. I could not detect a trigger, as it occurs randomly and at any time. It gives me this error: 26747 Segmentation fault Mserver --dbinit="module(pathfinder);" but it gives me any number before it. I am not sure where I can locate the MD error log (if it exists), and how it is triggered. Help? Thanks, junte

4 9

[MonetDB-users] MALException:opt.remap:no implementation present
by McKennirey.Matthew 24 Apr '08

24 Apr '08

Our application includes multiple services that independently connect to the database. When each service connects it reads the database metadata to discover the column names, many services may start at about the same time. We are getting the following error: java.sql.SQLException: TypeException:user.s7172_2[262]:'io.stdout' undefined in: _416:any MALException:opt.remap:no implementation present at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2058) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1808) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at nl.cwi.monetdb.jdbc.MonetStatement.executeQuery(MonetStatement.java:404) at nl.cwi.monetdb.jdbc.MonetDatabaseMetaData.getTypeInfo(MonetDatabaseMetaData.java:2454) # check status of database /monetdb status name state uptime crashes BUSINESS running 1d 1h 40m 38s 3 2008-04-22 11:23:59 # try a query using mclient running on the same machine as the database ./mclient -dBUSINESS -umonetdb -Pmonetdb -lsql sql>select * from tables; !TypeException:user.s5301_3[130]:'io.stdout' undefined in: _193:any sql>select * from schemas; !TypeException:user.s5302_3[40]:'io.stdout' undefined in: _63:any sql>select * from columns; !TypeException:user.s5303_3[146]:'io.stdout' undefined in: _210:any sql>\q; When we stop and restart the merovingian demon, the problem goes away, but may reoccur the next time we try and start multiple services in short succession. Environment MonetDB MSG merovingian[12454]: starting database 'BUSINESS', up min/avg/max: 121/43165/92925, crash average: 0.00 0.30 0.10 (7-4=3) MSG BUSINESS[12459]: executing '/monetdb/bin/mserver5' for database 'BUSINESS' MSG BUSINESS[12459]: # MonetDB server v5.5.0, based on kernel v1.23.0 MSG BUSINESS[12459]: # Serving database 'BUSINESS' MSG BUSINESS[12459]: # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked JDBC Driver 1.7 (Canephora_p2 20080418 based on MCL v1.3)

3 4

Re: [MonetDB-users] very slow query execution
by ewilde 22 Apr '08

22 Apr '08

hi, first: about that bug, i'll defiantly file it. second: when i migrated this table from mssql to monetdb5 I intentionally inserted it in that order (recid,ft,val). i used COPY INTO while supplying a file that i prepared in advanced with such a sorting. when i first decided to test monetdb5 i did it because i understood it should perform better than row-oriented DBMSs (like mssql), especially in CRM-like applications. so... i now understand that monetsdb5 is actually being expected to perform BAD in that specific situation i described before (in my previous message). from my experience in building CRM applications, that kind of "left join" according to unique number (recid) is very common in CRM applications. am i missing something here?? Thanks again, ewilde.

2 1

[MonetDB-users] mserver5 process locked unkillable
by mobigital1 22 Apr '08

22 Apr '08

I was testing some queries, and for example this query has made the mserver5 process 100% CPU, which i could not kill and machine could not be rebooted. running Fedora 8 64 bit. query like this: select col1, col2, sum(col3), sum(col4), sum(col5) from thetable group by col1, col2; there are about 160 columns in the table. col1 and col2 are "smallint" col3, col4, col5 are "real" number of distinct values: in col1 is about 120 in col2 about 80 total number of rows in table is about 400M I tested the query 2 times, simpler queries work ok, like this: select col1, count(*) from thetable group by col1; this query has crashed mserver5 before, not sure if this already fixed: select col1, count(1) from thetable group col1; -- View this message in context: http://www.nabble.com/mserver5-process-locked-unkillable-tp16789362p1678936… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] very slow query execution
by ewilde 22 Apr '08

22 Apr '08

hello, this is how my table - table1(int,int,varchar) - looks like: recid | ft | val --------------------------------------- 1001 | 301 | a 1001 | 302 | b 1001 | 303 | c 1002 | 301 | d 1002 | 302 | e 1003 | 303 | f 1003 | 301 | g 1003 | 302 | h 1004 | 303 | i in reality this table has a few millions of records. for the following query: select t1.val as val1 , t2.val as val2 from table1 t1 left join table1 t2 on t1.recid=t2.recid and t2.ft=303 where t1.recid=1002 and t1.ft=301 i get the expected result: val1 | val2 --------------------- d | f the execution time of this query is very slow: ~1.5 seconds - in comparison to MSSql:0.016 seconds. the kind of a query that i really need in my production application doesn't have only one such a "left join...", but may have even 10. with 5 such "left join..."s the query execution time is ~25 seconds, which is so far slower than MSSql: 0.156 more info: 1. i run the queries from SQuirreL SQL Client. the MonetDB5 is installed\run on the same machine. the MSSql server was running on another machine in the same LAN. 2. the primary key of table1 is : recid,ft,val 3. at the beginning i had another problem, that i have got an empty result when running a simple query like this: select * from table1 t1 where t1.recid=1002 and t1.ft=301 i'm not sure about this, but i guess that this problem had been solved by creating a view such as: create view v1 as select recid,ft,val from table1 i have no clue whether these two problems related to each other, but i mentioned it since it might give you a hint for solving the other problem. thanks in advanced for any help, ewilde.

2 1

[MonetDB-users] merovingian : could not retrieve uplog information ... Too many open files
by McKennirey.Matthew 21 Apr '08

21 Apr '08

Environment MSG BUSINESS[7403]: # MonetDB server v5.4.1, based on kernel v1.22.1 MSG BUSINESS[7403]: # Serving database 'BUSINESS' MSG BUSINESS[7403]: # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked During the course of software development using MonetDB for our application database, after running for a week or ten days without incident, the merovingian daemon will suddenly stop accepting connections. The merovingian log shows MSG merovingian[19349]: database 'BUSINESS' already running since 2008-04-11 14:42:27, up min/avg/max: 0/0/0, crash average: 0.00 0.00 0.00 (1-0=0) MSG merovingian[19349]: redirecting client 192.168.1.1:29378 for database 'BUSINESS' to mapi:monetdb://dev04:50001/ ERR merovingian[19349]: client error: could not retrieve uplog information: IOException:sabaoth.getUplogInfo:unable to open file /monetdb/var/MonetDB5/dbfarm/BUSINESS/.uplog: Too many open files ERR merovingian[19349]: client error: IOException:sabaoth.getStatus:unable to open directory /monetdb/var/MonetDB5/dbfarm: Too many open files # examine the .uplog file ? dev04:/monetdb/var/MonetDB5/dbfarm/BUSINESS # cat .uplog 1207290718 1207844298 1207844305 1207846979 1207846986 1208461825 1208461935 1208463257 1208463466 There is lots of space on the disk. /monetdb status shows the database is up and running netstat shows the daemon and databases listening on their ports Although it is not possible to connect to the database via the daemon, we can connect using mclient, # connect locally using mclient /mclient -dBUSINESS -umonetdb -Pmonetdb -lsql sql> And we can run, via mclient, the same sort of queries that were being run when the daemon stopped accepting connections. It is difficult to determine the exact query that was run as the application is generating lots of different queries frequently. And we can connect to the database from other clients on the network by connecting directly to the database, bypassing the daemon (which is what we are doing for now)

2 4

Re: [MonetDB-users] [Question] data loading to MonetDB
by Martin Kersten 19 Apr '08

19 Apr '08

ks038c wrote: > How can I load large dump data into MonetDB > > I mean... > > I have "test.txt" file with "csv" format like. > > 00001|"name1"|"address1" > 00002|"name2"|"address2" > ..... > > and want to load this LARGE data into my table > > TEST( ID NUMERIC(5), NAME VARCHAR(10), ADDR VARCHAR(20) ) > > I found word "tablet.load" or "tablet.SQLload" in m5manual > but don't know whether it is the one I need or not and don't know how > to use it. > > I beg yout answer... > > > > > http://monetdb.cwi.nl/projects/monetdb/MonetDB/Version4/Documentation/Modul…

2 1

[MonetDB-users] alternate dbfarm location not working
by mobigital1 18 Apr '08

18 Apr '08

i am trying to setup the dbfarm location to be on a different share from /opt/monetdb/var directory. i modified the /opt/monetdb/etc/monetdb5.conf file to reflect the alternate path to dbfarm location, and also sql-log location. i am able to start the server with >> merogivian start <dbname> but it is very unstable and crashes when i try to import some data. I have been able to import the same data when dbfarm was under /opt/monetdb/var directory. is there something else I need to do to relocate dbfarm to another folder? the new folder is mounted to another disk. (ext3 partition) any advice would be appreciated. -- View this message in context: http://www.nabble.com/alternate-dbfarm-location-not-working-tp16715294p1671… Sent from the monetdb-users mailing list archive at Nabble.com.

3 17

[MonetDB-users] Invalid Credentials for user when restarted mserver5
by mobigital1 18 Apr '08

18 Apr '08

I imported some data into database from 6 files or so. I restarted database after each file. on latest file, after stopping the database, I decided to start it up manually and ran like this: /opt/monetdb/bin/mserver5 -dbinit="include sql;" --dbname=<bbb> --set mapi_open=true when opened mclient, it said: !InvalidCredentialsException:checkCredentials:Invalid credentials for user '....' HOWEVER, as last hope I decided to try starting again via merovigian, and I think it worked, except that it's taking its time now to sync up sql_log into the dbfarm. so for some reason starting database via merovigian and manually like above is not the same thing. Does merovigian pass some environment variables to the mserver5 process? -- View this message in context: http://www.nabble.com/Invalid-Credentials-for-user-when-restarted-mserver5-… Sent from the monetdb-users mailing list archive at Nabble.com.

3 4

[MonetDB-users] corruption on db restart
by mobigital1 17 Apr '08

17 Apr '08

I imported some millions of rows into a table: sql>select part, count(*) from frag group by part order by part; +------+-----------+ | part |count_node | +======+===========+ | 1 | 25205085 | | 2 | 25618423 | | 3 | 27380780 | | 4 | 26963069 | | 5 | 25661196 | | 6 | 27021186 | | 7 | 26058891 | | 8 | 28092822 | | 9 | 27528646 | | 10 | 26429092 | | 11 | 25194504 | | 12 | 25136210 | | 13 | 25105453 | | 14 | 24860071 | | 16 | 20672348 | | 17 | 19138139 | +------+-----------+ then I stopped the database, and wanted to start it back up to see how quickly it would come up. it took a few minutes to come up while it was comitting uncomitted transactions. When i started it up the space usage looked like this: 251721152 ./var/MonetDB5/dbfarm (251gb) 24181152 ./var/MonetDB5/sql_logs (24gb) after a few minutes it became like this: 249855172 ./var/MonetDB5/dbfarm (249gb) 12 ./var/MonetDB5/sql_logs however when it came up, i guess the data became corrupted because look at what happened to my query results now: sql>select part, count(*) from frag group by part order by part; +------+-----------+ | part |count_node | +======+===========+ | 1 | 25205085 | | 0 | 361722691 | | 17 | 19138139 | | 18 | 21414794 | +------+-----------+ there are total about 427 M rows, of which 361.7M are corrupted. There is nothing in the merovingian.log file at all since stop/start of database. Can someone advise what to do with this? 1. if possible to recover data, please let me know 2. otherwise what can I do to prevent this in the future? this is a huge roadblock. -- View this message in context: http://www.nabble.com/corruption-on-db-restart-tp16737747p16737747.html Sent from the monetdb-users mailing list archive at Nabble.com.

3 7

[MonetDB-users] SQLException in executeQuery() =Query did not produce a result set
by sateesh 17 Apr '08

17 Apr '08

Hi, When i try to execute a Query using Prepared Statement some times i am getting the below listed Error. It seems like when no rows are returned it throws this Exception.. I am hoping that it is a safely ignorable one.. When i use Statement i don't get this Error!! Regards Sateesh [08-59-15 09:59] ERROR com.lmco.dpa.core.services.persistance.QueryPerformer (129)- SQLException in executeQuery() =Query did not produce a result set at nl.cwi.monetdb.jdbc.MonetPreparedStatement.executeQuery(MonetPreparedStatement.java:228) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93) at com.lmco.dpa.core.services.persistance.QueryPerformer.executeQuery(QueryPerformer.java:86) at com.lmco.dpa.storage.rdf.framework.DPARepositoryModelBuilder.getModelProperty(DPARepositoryModelBuilder.java:279) at com.lmco.dpa.storage.rdf.framework.DPARepositoryModelBuilder.getMetadataModelsMap(DPARepositoryModelBuilder.java:121) at com.lmco.dpa.storage.rdf.framework.DPAModelMetadataManager.init(DPAModelMetadataManager.java:185) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeCustomInitMethod(AbstractAutowireCapableBeanFactory.java:1237) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1203) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1167) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:427) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:339) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:267) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:110) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1095) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:857) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:423) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:291) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:352) at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:122) at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:76) at com.lmco.dpa.ui.common.dao.rdf.impl.UIRepositoryFacadeDaoImplTest.onSetUp(UIRepositoryFacadeDaoImplTest.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.internal.runners.ClassRoadie.runBefores(ClassRoadie.java:49) at org.junit.internal.runners.ClassRoadie.runProtected(ClassRoadie.java:36) at org.junit.internal.runners.JUnit4ClassRunner.run(JUnit4ClassRunner.java:42) at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:38) at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:460) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:673) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:386) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:196) -- View this message in context: http://www.nabble.com/SQLException-in-executeQuery%28%29-%3DQuery-did-not-p… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] db log shrink
by Colin Foss 17 Apr '08

17 Apr '08

Is there any method, besides restarting the database, of shrinking the sql log file? When I am performing a large set of large inserts (via COPY INTO) the log file gets very large. I wish there was a way to cycle the log file. Also during these large batches of inserts the database server becomes less and less responsive until I am forced to restart the server. Upon restart and the normal recovery monet returns to a very responsive state.

3 2

[MonetDB-users] COPY INTO of data containing hebrew letters
by ewilde 16 Apr '08

16 Apr '08

hello again. now i have another problem. following your suggestion of using COPY INTO for the migration of my database from MSSql to MonetDB5, i indeed succeeded in copying some tables, enjoying very good performances (for example, one table with ~8 millions of records in ~13 seconds). the new problem i'm facing now is that using COPY INTO for data with hebrew letters ends up with error. i tried to supply COPY INTO a UNICODE enoded file, but than i have not succeeded in defining the tuple and record seperators. the MonetDB5 itself is capable of storing and retrieving hebrew letters. i can tell this because i have no problem inserting such data through JDBC (actually, right now i have a java process working hard and slowly on copying such a table). so the problem is probably somewhere in the mclient application. is there any workaround for that? thanks, ewilde.

2 1

Re: [MonetDB-users] how to completely remove the MonetDB5installation
by ewilde 16 Apr '08

16 Apr '08

hello! thanks for the latest info. i indeed found all the stuff in %APPDATA%, and i removed it, and the MonetDB5 has come back to life again. if you think i may be able to supply more info about that bug i described in the first place, don't hesitate to contact me. ewilde.

1 0

[MonetDB-users] Sorted materialized views
by Nils Grimsmo 16 Apr '08

16 Apr '08

Hello, all! I am about to prototype something, and it would be convenient to use SQL to throw it together quickly to see if it flies. I downloaded MonetDB yesterday, so I am quite fresh :-) I have a table with a set of columns, and the like to have a few materialized views or projections (or whatever you DB people call it ;-)) sorted on different columns. The views may also have selection, I am not sure yet. And given problem (a data query), I use some statistics to decide which sorting order is most convenient, look up a (preferably continuous) vertical part of the columns, scan through it, and possibly do some filtering. The queries may also be trees, in which case I might use a different sorting order for each branch, and then do merging based on some of the columns. Assume: CREATE TABLE t (a INT, b INT); INSERT INTO t VALUES (1, 3), (4, 2); I would like to do something like: CREATE VIEW v AS SELECT b, a FROM t ORDER BY b, a; This is not allowed (works if I remove ORDER BY). I would also like to have an index over v(b,a), like: CREATE UNIQUE INDEX j USING BTREE ON v (b, a) ; But this is never allowed on a view, right? Since updates are not an issue in the prototype, I could just create a new table like this: CREATE TABLE v (b int, a int, PRIMARY KEY(b, a), INDEX i USING BTREE (b ASC, a ASC)) AS SELECT b, a FROM t ORDER BY b, a; (Using both PRIMARY KEY and INDEX is always butter on bacon?) But this is not allowed because of the table definition, all I am allowed to do is: CREATE TABLE v (b, a) AS SELECT b, a FROM t ORDER BY b, a WITH DATA; If I use PRIMARY KEY(b, a), am I then guaranteed the table to be sorted on (b, a)? Is there any other way of enforcing this in SQL? 1. Any suggestions for what I should do? Is my best option to create all "views" as tables from scratch, and fill them by hand? 2. How much slower would this be than using low-level stuff like BATs and BUNs myself? (The merges between branches in my (problem level) queries are simple, but cannot be expressed as SQL.) Klem fra Nils

3 4

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by kykim_lists＠mac.com 16 Apr '08

16 Apr '08

I found this subject in the archives, and I am having the same problem I am running on Mac OS X 10.4.11 I built MonetDB from source from MonetDB-Feb2008-SuperBall I am new to MonetDB, so please forgive any ignorance.. Here's what I did: > monetdb create foo # create the db > mserver5 --dbname=foo --dbinit="include sql;" # start the db > ./mclient -lsql sql>CREATE USER "bar" WITH PASSWORD 'password' NAME 'Foobar User' SCHEMA "sys"; sql>CREATE SCHEMA "bar" AUTHORIZATION "bar"; sql>ALTER USER "bar" SET SCHEMA "bar"; > ./mclient -lsql -ubar Password:password sql>\q > ./mclient -lsql -ubar Password:password !InvalidCredentialsException:checkCredentials:Invalid credentials for user 'ifm' Two things: 1) I am able to login as user 'monetdb' without any problem 2) If i stop and start 'mserver5', I can login ONCE I know that I probably should be using 'merovingian', but I'm still playing around. Any pointers? Anything I can do to help debug? Thanks, -kevin

3 6

[MonetDB-users] fail to connect via merovingian
by McKennirey.Matthew 16 Apr '08

16 Apr '08

2 2

Re: [MonetDB-users] how to completely remove the MonetDB5installation
by ewilde 14 Apr '08

14 Apr '08

the operationg system i want to completely remove MonetDB5 from is: windows server 2003 x64 r2

2 1

[MonetDB-users] how to completely remove the MonetDB5 installation?
by ewilde 14 Apr '08

14 Apr '08

thanks for replying my previous message. as i mentioned in the previous message, the first installation worked fine (more or less), so in order to finish evaluating MonetDB5 regarding my certain needs, i just want to completely remove it and re-install it. it looks like that the installation program doesn't completely remove the MonetDB5 installation, so, what's the secrete? how do i (manually) completely remove the installation, so i be able to successfully re-install it as it happened the first time. thanks again, ewilde.

3 2

[MonetDB-users] Error building PF/Tijah index
by Desislava I. Petkova 14 Apr '08

14 Apr '08

Hello I'm trying to build a full-text PF/Tijah index. After starting the Mserver, I add 10 XML files into a new collection. I've divided the collection into files so that the files are not too large. This finishes without errors and the collection exists since pf:collections( ) <> returns <collection updatable="false" size="100 MiB" numDocs="1">dblp.xml1</collection>, <collection updatable="false" size="61 MiB" numDocs="1">dblp.xml10</collection>, <collection updatable="false" size="102 MiB" numDocs="1">dblp.xml2</collection>, <collection updatable="false" size="102 MiB" numDocs="1">dblp.xml3</collection>, <collection updatable="false" size="102 MiB" numDocs="1">dblp.xml4</collection>, <collection updatable="false" size="103 MiB" numDocs="1">dblp.xml5</collection>, <collection updatable="false" size="101 MiB" numDocs="1">dblp.xml6</collection>, <collection updatable="false" size="101 MiB" numDocs="1">dblp.xml7</collection>, <collection updatable="false" size="107 MiB" numDocs="1">dblp.xml8</collection>, <collection updatable="false" size="107 MiB" numDocs="1">dblp.xml9</collection> Then I try to build a full-text index for the collection let $opt := <TijahOptions stemmer="porter-english" /> return tijah:create-ft-index($opt) <> But the Mserver aborts after some time with the following error message: MonetDB>*** glibc detected *** free(): invalid pointer: 0x0000002be9d42010 *** I would like to know what this error message means, and how can I fix the problem. Thank you for your response, Desislava

2 1

[MonetDB-users] mserver crashes on windows server 2003 x64
by ewilde 14 Apr '08

14 Apr '08

hi, i do the following steps: 1. run the install program: MonetDB5-SQL-Installer-x86_64-20080214.msi 2. from the start menu, run the shortcut: MonetDB SQL Server 3. from the start menu, run the shortcut: MonetDB SQL Client and... the MonetDB SQL Server window disapears.... a few days ago i installed it (first time in my life) and it worked. i started doing some testing for a couple of days, and suddenly the server stopped working. finally, i gave up: i removed it (using the install program) and re-installed it again (and again (to another directory)..). more info: 1. starting the client with the -lmal option (instead of -lsql) dose NOT crashes the server. so i guess something is probably wrong with the sql layer. 2. during those couple of days that the server was working, i could not find any file related to the database in the whole file system, even though i managed to store some tables with a few millions of records. i was able to query these tables and (most of the time) getting the expected results, so i moved on ignoring this strange thing. BTW: i wonder what is the best way to migrate a database from MSSql server to MonetDB5? i tried to export a whole database (~30 millions of records) from MSSql2005 to MonetDB. first, i thought i could do it with the MSSql export wizard using the odbc driver, but this driver did not show up in the wizard as a target possibility. next, i tried to write a java program using the jdbc driver, but the performances rate weren't constant: one table with 3 columns (int,int,decimal) and about a half a million of records moved to MonetDB in ~3000 records per second. but another very similar table with 3 columns (int,int,int) and about 8 millions of records moved to MonetDB in ~30 records per second (actually, this process had been stopped as a result of an attempt to create another table, and since than, the server is dead.) thanks in advanced for any help, ewilde

2 1

[MonetDB-users] New to MonetDB
by Shankar Yoganathan 13 Apr '08

13 Apr '08

Hello I am new to monetDB. I have a few questions about using MonetDB in embedded environment. I read in the embedded server page that only client is allowed to connect to the embedded server. 1. Does this mean I can not have multiple processes accessing the same database? 2. Can multiple threads with in the same process access the same database? 3. in the in-memory embedded environment, is there a way to save the data before the system shutdown? So that when the system starts, I can automatically populate the database to the previous state? Thank you for your help in advance Shankar

3 2

[MonetDB-users] linux flavor
by mobigital1 12 Apr '08

12 Apr '08

>From my testing of the windows 64 bit port it seems that may be the linux version is a bit more stable to run? (due to specifics of memory mapped file implementations)? can anyone suggest what flavor of linux is best to use to load most data? also the one that's easy to run under vmware? -- View this message in context: http://www.nabble.com/linux-flavor-tp15860790p15860790.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] cvs version (0.23) error
by Jorge Martín Cuervo 09 Apr '08

09 Apr '08

Hi all, I use the an script to download and compile the latest version of cvs, but despite theres no error messages and seems to start very good i can't store any file. The version i see in the console is 0.23, and if i return to my 0.22 version compiled from source it works perfect. I mean storing files, listing and so on. Also, i made a simple java program that connects to database throw jdbc to create documents quickly, and works pretty good with 0.22, but no way with 0.23. In the console (http://127.0.0.1:50001/admin/) i get the same error when i push on every button: Internal Receiver Error: out-of memory any idea? thanks. -- ;-) ____________________________________ Jorge Martin Cuervo Outsourcing Emarketplace deFacto Powered by Standards email <jorge.martin(a)defactops.com> voice +34 985 129 820 voice +34 660 026 384 ____________________________________ DE FACTO STANDARDS, S.L., le informa que su dirección de correo electrónico, así como el resto de los datos de carácter personal que nos facilite, serán objeto de tratamiento automatizado en nuestros ficheros, con la finalidad del envío de información comercial y/o personal por vía electrónica. Vd. podrá en cualquier momento ejercer el derecho de acceso, rectificación, cancelación y oposición en los términos establecidos en la Ley Orgánica de Protección de Datos de Carácter Personal (LOPD. 15/1999), dirigiendo un escrito a C/ Rivero 31 1º Izda. - 33402 AVILES (Asturias), o a nuestra dirección de correo electrónico (info(a)defactops.com) También informamos que la información incluida en este e-mail es CONFIDENCIAL, siendo para uso exclusivo del destinatario arriba mencionado. Si Usted lee este mensaje y no es el destinatario indicado, le informamos que está totalmente prohibida cualquier utilización, divulgación, distribución y/o reproducción de esta comunicación sin autorización expresa en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos nos lo notifique inmediatamente por esta misma vía y proceda a su eliminación. This e-mail contains information that will be added to our computerised guest data base and will be trated in the strict confidence. If you wish to access, correct, oppose or cancel your details, as specified the Law 15/99, December 13th, please send a certified letter to this effect to DE FACTO STANDARDS, S.L.., (C/ Rivero 31 1º Izda. - 33402 AVILES (Asturias) SPAIN). If you read this message, and is not the destinatary, we informal you that is forbidden anything utility, distribution, divulgation or reproduction of this communication without express authorization, of the present law. If you received this message for mistake, we proud in order to the present law, immediate communication to us, and please erase this e-mail

1 0

[MonetDB-users] !ERROR: err:FORG0001
by Jorge Martín Cuervo 08 Apr '08

08 Apr '08

Hi all, i have some error messages from mclient when i try to run an xquery. First i've got: ERROR = !type error: body of hr:fw() evaluates to `double | integer' which is not a subtype of `xs:double' and i removed the return type from function, and later i've got: ERROR = !ERROR: err:FORG0001: could not cast value from string to double. is there any way to know where is the error (like the before message)? thanks. -- ;-) ____________________________________ Jorge Martin Cuervo Outsourcing Emarketplace deFacto Powered by Standards email <jorge.martin(a)defactops.com> voice +34 985 129 820 voice +34 660 026 384 ____________________________________ DE FACTO STANDARDS, S.L., le informa que su dirección de correo electrónico, así como el resto de los datos de carácter personal que nos facilite, serán objeto de tratamiento automatizado en nuestros ficheros, con la finalidad del envío de información comercial y/o personal por vía electrónica. Vd. podrá en cualquier momento ejercer el derecho de acceso, rectificación, cancelación y oposición en los términos establecidos en la Ley Orgánica de Protección de Datos de Carácter Personal (LOPD. 15/1999), dirigiendo un escrito a C/ Rivero 31 1º Izda. - 33402 AVILES (Asturias), o a nuestra dirección de correo electrónico (info(a)defactops.com) También informamos que la información incluida en este e-mail es CONFIDENCIAL, siendo para uso exclusivo del destinatario arriba mencionado. Si Usted lee este mensaje y no es el destinatario indicado, le informamos que está totalmente prohibida cualquier utilización, divulgación, distribución y/o reproducción de esta comunicación sin autorización expresa en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos nos lo notifique inmediatamente por esta misma vía y proceda a su eliminación. This e-mail contains information that will be added to our computerised guest data base and will be trated in the strict confidence. If you wish to access, correct, oppose or cancel your details, as specified the Law 15/99, December 13th, please send a certified letter to this effect to DE FACTO STANDARDS, S.L.., (C/ Rivero 31 1º Izda. - 33402 AVILES (Asturias) SPAIN). If you read this message, and is not the destinatary, we informal you that is forbidden anything utility, distribution, divulgation or reproduction of this communication without express authorization, of the present law. If you received this message for mistake, we proud in order to the present law, immediate communication to us, and please erase this e-mail

4 12

[MonetDB-users] urlbox in MonetDB5
by Gifford Hesketh 02 Apr '08

02 Apr '08

Can someone help me understand exactly what the urlbox is for and how to use it ?

1 0

[MonetDB-users] blobs performance
by Henrik Vendelbo 29 Mar '08

29 Mar '08

I am working through the options for clustered file management. Normally I would expect fairly poor performance of binary file storage in a database. Hence I would favor using the file system, and sync across the machines in the cluster. Being quite different from common relational implementations, how well does Monet handle blobs of 1-10Mb? As a side question is there a support for multi-master replication? The technology looks really impressive, I hope to be able to base my future projects on MonetDB Thanks, Henrik

1 0

[MonetDB-users] !IOException:mal_mapi.listen When Starting MonetDB5 SQL Server
by kevin.haas＠openbi.com 27 Mar '08

27 Mar '08

When I try to start the MonetDB5 Server, I get the following error: # MonetDB server v5.4.0, based on kernel v1.22.0 # Serving database 'demo' # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see C:\Program Files\CWI\MonetDB5\etc\monetdb5.conf) !IOException:mal_mapi.listen:Creation of stream socket failedi: Unknown error #function user.main():void; ##library logger; # alarm.prelude(); ##command bat(ht:int, tt:int) :bat[:any_1,:any_2] ##address BKCnewBat_default ##comment "Creates a new empty transient BAT with head- and tail-types ## as indicated."; ##command bat(ht:int, tt:int, size:lng) :bat[:any_1,:any_2] <EDITED FOR BREVITY> ##comment "Execute the XQuery against the elements #end main; # MonetDB/SQL module v2.22.0 loaded > This does not seem like a "good" error. Any tips on how to correct? -- View this message in context: http://www.nabble.com/%21IOException%3Amal_mapi.listen-When-Starting-MonetD… Sent from the monetdb-users mailing list archive at Nabble.com.

3 3

Re: [MonetDB-users] Database dump does not support schemas
by McKennirey.Matthew 26 Mar '08

26 Mar '08

3 5

[MonetDB-users] Clustered Index and Merge Join
by Michael Schmidt 26 Mar '08

26 Mar '08

I have two tables of the form R1(x INTEGER, y INTEGER) R2(x INTEGER, y INTEGER) where x and y both are NOT NULL and may both contain duplicate values (however, the combination (a,b) is unique). My questions are the following: a.) Is there a possibility to create a /clustered/ index on the x-column (or a clustered combined x-y index?). I could also create a PRIMARY KEY on (x,y). Would this result in a clustered index? Is there any command to find out which indices are clustered? b.) Does MonetDB support MergeJoins? I.e., assume I have a clustered index on columns R1.a and R2.a and perform a join on these columns, will this join be realized by an efficient merge join? Best regards, Michael

3 6

[MonetDB-users] MonetDB XQuery Server Startup Error
by Sprattling, Roderick L. 24 Mar '08

24 Mar '08

After installing the Win32 version of MonetDB XQuery as single-user, making no changes to MonetDB.conf, and attempting to run MXQserver.bat, I get this output: C:\Program Files\CWI\MonetDB4>MXQserver.bat # MonetDB Server v4.22.0 # based on GDK v1.22.0 # Copyright (c) 1993-2008, CWI. All rights reserved. # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ <http://monetdb.cwi.nl/> for further information. # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah <http://dbappl.cs.utwente.nl/pftijah> !ERROR: MAPIlisten:creation of stream socket failed !OS: A blocking operation is currently executing. Since MXQserver.bat simply issues the command "Mserver.bat --dbinit='module(pathfinder);'", I ran that command directly, and to my surprise the server makes it to its own command line: # MonetDB Server v4.22.0 # based on GDK v1.22.0 # Copyright (c) 1993-2008, CWI. All rights reserved. # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. MonetXDB> In this second case, the mclient cannot connect (even when I set server and client ports to something other than 50000,) nor is the admin GUI available on port 50001. So my questions are: Why does the server report a socket creation failure from the MXQserver.bat script? Why is no failure reported when the Mserver.bat script is run directly? And why is the server instance that comes up with Mserver.bat unconnective? I've sought answers from the documentation, Googleverse and the MonetDB-users archive, but found nothing. Thanks in advance for any help you can provide. Rod

1 0

[MonetDB-users] Database dump does not support schemas
by McKennirey.Matthew 24 Mar '08

24 Mar '08

1 0

[MonetDB-users] COPY INTO using a schema fails
by McKennirey.Matthew 21 Mar '08

21 Mar '08

I was wondering if the COPY command does not support schemas? CREATE TABLE test ( column1 VARCHAR(32), column2 VARCHAR(32) ); COPY INTO test FROM '/location/file.csv' USING DELIMITERS ',', '\n'; works fine CREATE SCHEMA abc; CREATE TABLE abc.test ( column1 VARCHAR(32), column2 VARCHAR(32) ); COPY INTO abc.test FROM '/location/file.csv' USING DELIMITERS ',', '\n'; fails with !SQLException:sql:table test not found !SQLException:importTable:failed to import table INSERT into abc.test VALUES(one,two) works fine

2 1

[MonetDB-users] Sending an XML document via JDBC
by Richard Eckart 19 Mar '08

19 Mar '08

Hi again, is there some way to send a XML document to the server through the JDBC connection? That is (because of the <enter> problem on OS X) I need to have my MonetDB/XQuery server running on a remote machine and I want to load an XML document locally and store it on the machine via JDBC. The 'pf:add-doc()' functions do not really help be since the only connection over to the remote machine is the MonetDB connection. Setting up a facility for MonetDB to 'call back to' to fetch the XML document via http would be overkill. Also, the XML-DB API does no longer exist, does it? Cheers, Richard

2 1

[MonetDB-users] MonetDB Error Message
by Michael Schmidt 17 Mar '08

17 Mar '08

Hi, I am trying to run the following SQL query on the lates nightly build: SELECT T1.subject AS inproc, T2.object AS author, T3.object AS booktitle, T4.object AS title, T5.object AS proc, T6.object AS ee, T7.object AS page, T8.object AS URL, T9.object AS yr, AB.object AS abstract FROM Triples T1 JOIN Triples T2 ON T1.subject=T2.subject JOIN Triples T3 ON T1.subject=T3.subject JOIN Triples T4 ON T1.subject=T4.subject JOIN Triples T5 ON T1.subject=T5.subject JOIN Triples T6 ON T1.subject=T6.subject JOIN Triples T7 ON T1.subject=T7.subject JOIN Triples T8 ON T1.subject=T8.subject JOIN Triples T9 ON T1.subject=T9.subject LEFT JOIN ( SELECT * FROM Triples T10 WHERE T10.property='bench:abstract' ) AB ON T1.subject=AB.subject WHERE T1.property='rdf:type' AND T2.property='dc:creator' AND T3.property='bench:booktitle' AND T4.property='dc:title' AND T5.property='dcterms:partOf' AND T6.property='rdfs:seeAlso' AND T7.property='swrc:pages' AND T8.property='foaf:homepage' AND T9.property='dcterms:issued' AND T1.object='bench:Inproceedings' ORDER BY T9.object; on a single table "Triples(subject VARCHAR(50),predicate VARCHAR(20),object VARCHAR(20000))" with only 1000 entries. This query results in the following error message: ##GDKmmap(702808064) fail => BBPtrim(enter) usage[mem=101947960,vm=1505614392] # #mallinfo.arena = 11571200 ##mallinfo.ordblks = 1177 ##mallinfo.smblks = 102 ##mallinfo.hblkhd = 94076928 ##mallinfo.hblks = 12 ##mallinfo.usmblks = 0 ##mallinfo.fsmblks = 4080 ##mallinfo.uordblks = 9619432 ##mallinfo.fordblks = 1951768 ##BBPTRIM_ENTER: memsize=101947960,vmsize=1505614392 ##BBPTRIM: memtarget=0 vmtarget=1073741824 ##TRIMSCAN: mem=0 vm=1, start=1, limit=1 ##TRIMSCAN: 63756* 0=tmp_1462 (#0) ##TRIMSCAN: 63887* 1=tmp_1472 (#0) ##TRIMSCAN: 64223* 2=tmp_1473 (#0) ##TRIMSCAN: 64286* 3=tmp_1477 (#0) ##TRIMSCAN: 64301* 4=tmp_1500 (#0) ##TRIMSCAN: 64362* 5=tmp_1501 (#0) ##TRIMSCAN: 64438* 6=tmp_1502 (#0) ##TRIMSCAN: 64447* 7=tmp_1505 (#0) [...] // many many more entries of this form ##TRIMSCAN: 63994 235=tmp_2275 (#455647) ##TRIMSCAN: 63998 236=tmp_2304 (#3980331) ##TRIMSCAN: 64002 237=tmp_2305 (#3980331) ##TRIMSCAN: end at 1 (size=1234) ##TRIMSELECT: dirty = 0 ##TRIMSELECT: candidate=tmp_1462 BAT*=0x848fc28 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51285,63756,-2147419892) ##TRIMSELECT: keep tmp_1462 [228,0] bytes [228,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1472 BAT*=0x84964f8 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51294,63887,-2147419761) ##TRIMSELECT: keep tmp_1472 [228,0] bytes [228,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1473 BAT*=0x8496b18 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51313,64223,-2147419425) ##TRIMSELECT: keep tmp_1473 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1477 BAT*=0x84a6770 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51321,64286,-2147419362) ##TRIMSELECT: keep tmp_1477 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1500 BAT*=0x84a6d20 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51323,64301,-2147419347) ##TRIMSELECT: keep tmp_1500 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1501 BAT*=0x84a7318 ## (cnt=0, mode=4096, refs=0, wait=0, parent=0,0, lastused=51325,64362,-2147419286) ##TRIMSELECT: keep tmp_1501 [228,0] bytes [0,0] dirty target(mem=0 vm=1073741824) ##TRIMSELECT: candidate=tmp_1502 BAT*=0x84a7920 [...] // many many more entries of this form ##TRIMSELECT: candidate=tmp_2234 BAT*=0x871d5b0 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63975,63975,63975) ##TRIMSELECT: delete tmp_2234 from trimlist (does not match trim needs) ##TRIMSELECT: candidate=tmp_2235 BAT*=0x871e7e8 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63976,63976,63976) ##TRIMSELECT: delete tmp_2235 from trimlist (does not match trim needs) ##TRIMSELECT: candidate=tmp_2236 BAT*=0x871fa20 ## (cnt=0, mode=1024, refs=0, wait=0, parent=0,0, lastused=63977,63977,63977) ##TRIMSELECT: delete tmp_2236 from trimlist (does not match trim needs) ##TRIMSELECT: end ##BBPTRIM: no more unload candidates! ##BBPTRIM_EXIT: memsize=11583488,vmsize=1505614392 ##GDKmmap(702808064) fail => BBPtrim(ready) usage[mem=101947960,vm=1505614392] # #mallinfo.arena = 11571200 ##mallinfo.ordblks = 1177 ##mallinfo.smblks = 102 ##mallinfo.hblkhd = 94076928 ##mallinfo.hblks = 12 ##mallinfo.usmblks = 0 ##mallinfo.fsmblks = 4080 ##mallinfo.uordblks = 9619432 Seems like a memory allocation problem to me. Any ideas what the problem could be? Best Regards, Michael

2 1

[MonetDB-users] Trouble connecting
by Richard Eckart 16 Mar '08

16 Mar '08

Hi everybody, I am completely new to MonetDB and have just compiled the latest SuperBall release on OS X. I set mapi_open to true in the config file /etc/monetdb5.conf because for some reason MonetDB would not use "localhost" but the machine name of my box as an address to listen on. I had to manually add that to /etc/hosts in order for it to refer to 127.0.0.1 at least. Maybe an OS X oddity. I start the merovingian process which seems to run fine. After that the only time I can connect successfully to a database using mclient (or any other client) is the first time I try to connect (if it works at all). For example ./mclient -lsql --database demo !InvalidCredentialsException:checkCredentials:Invalid credentials for user 'monetdb' Sometimes it would work just once but the second time with the same command line I would not be able to log in. The merovingian.log does not seem to contain any helpful messages. Any hints would be very helpful as currently I can not use MonetDB at all. Cheers, Richard

3 8

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by McKennirey.Matthew 14 Mar '08

14 Mar '08

2 1

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by McKennirey.Matthew 14 Mar '08

14 Mar '08

2 1

[MonetDB-users] Can not allocate memory, MonetDB5
by forte712 14 Mar '08

14 Mar '08

Hi I've just downloaded a new version of MonetDB a few days ago and started testing it.. I tried inserting a 2.6G data file (12 columns, 32 million rows) and it works fine. But when I added 4 more columns of data to that data file (of type bigint, bringing the file size up to 3.9G), it fails saying !SQLException:importTable:failed to import table !ERROR: GDKload: cannot mmap(): name=20/2023, ext=tail.priv !OS: Cannot allocate memory !ERROR: GDKload failed: name=20/2023, ext=tail.priv I tried searching for similar problem, but only found it for older versions of MonetDB. Is this still an issue in the current version? Thank you. -- View this message in context: http://www.nabble.com/Can-not-allocate-memory%2C-MonetDB5-tp16019364p160193… Sent from the monetdb-users mailing list archive at Nabble.com.

4 4

[MonetDB-users] Table space/size
by Iftikharn 14 Mar '08

14 Mar '08

Hi How to check that how much space a particular table has taken or what is the current size of a given tables in bytes etc. Because I am interested in writing a trigger when a particular table reaches a given size then the oldest of all rows, based on a time attribute should be deleted (I like to do it without counting the rows). Regards, Iftikhar -- View this message in context: http://www.nabble.com/Table-space-size-tp16040486p16040486.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Developing in MAL!
by Erik Holstad 13 Mar '08

13 Mar '08

Hi, I'm new to MonetDB, but are looking to develop my own interface towards the database, not using SQL, but just sticking with MAL or if possible C and just want to know what my options are? Is it, for example, possible to load you own MAL-files into the client, just for a test run or do you have to type in the commands line by line? And on the server side, how to you setup your own modules and libraries? Regards Erik Holstad

5 24

[MonetDB-users] JDBC insert performance
by chinarinde 11 Mar '08

11 Mar '08

Hi all, I am new to monetDB and ran into the following problem (I'll try to be as verbose as I can, perhaps it helps helping me): I've installed MonetDB server 5.0.0, clients and commons 1.18.2 and sql 2.18.2 on Ubuntu Feisty. Then I've taken the JDBC example which is available online and modified it to be able to insert data into a test database. More specifically I'm using prepared statements and executeBatch() together with the monetdb-1.6 JDBC driver. Which is quite successful until about 5 million records are inserted - afterwards the speed of the inserts drops dramatically. I've experimented with different batch sizes (10000 records seems to work ok), and I've tried to understand the chapter about memory tuning for MonetDB (not sure yet about how to use mem_cursize() though). In any case at first inserting 2 million records only takes about 5 minutes (measured with Javas System.timemillis), later on this time increases and the server gets rather unresponsive. I found only two posts concerning the speed of JDBC inserts (from January 2007 I think) and I would be interested if a solution or explanation has been found off-list. Thank you -- View this message in context: http://www.nabble.com/JDBC-insert-performance-tf4589411.html#a13100422 Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Help me,please
by ssoor 05 Mar '08

05 Mar '08

Dear MonetDB's Group, I am a school student in china. I want to compile the Source code of MonetDB on WindowsXP. I have read your Documentations. But I lost. Can you send me the particular how to compile it with the MS visual studio 2005. Thanks you very much . And forgive my poor English. I hope your answer. Lin Mailing Address: ssoor(a)126.com Tianjin University 92 Wei Jin Rd, Nan Kai District TianJin 300072 ssoor 2008-03-05

2 1

[MonetDB-users] Windows binary + Python2.4
by Pawel Lewicki 26 Feb '08

26 Feb '08

Hi, Is there any chance for Python extensions compiled for Python 2.4 for Windows? Paweł Lewicki

1 0

[MonetDB-users] Blacklisting certain XML elements
by jz＠uva 26 Feb '08

26 Feb '08

Dear all, I am wondering whether it is possible with MonetDB4/XQuery, PF/Tijah, to blacklist certain XML element names from being "shredded", and thus being indexed? If so, could someone tell me how? I hope this is the correct mailinglist for asking this question... Best, Junte

2 1

Re: [MonetDB-users] COPY TO corrupting data
by mobigital-nbl＠yahoo.com 26 Feb '08

26 Feb '08

Stefan Manegold wrote: > 32-bit system on 8 GB machines does not make much sense, does it? > A 32-bit systems can (at least per process) address at most 4 GB, usually > only 2 GB in practice... True, but doesn't seem like I am hitting the maximum process memory limit (not even approaching 1.5GB). > With 9M+ records of >= 438 byte each, your data is >=3.9 GB in size. > I'm not completely sure whether MonetDB temprarily need to hold all data > concurrently in its address sapce during bulk loading; but if so, your data > size might simply exceed the 32-bit address space. > (Obviously, MonetDB should better give an error than crash ...) I am bulk loading only 250K rows at a time, at which point they are copied from staging table into permament final table. am I allowed to have a table with total data size larger than max process memory size? > Did you try on a 64-bit systems using 64-bit MonetDB? I have, but hitting another - higher limit - 100M rows ending with corruption on 64 bits, see first message on this thread.

1 0

Re: [MonetDB-users] COPY TO corrupting data
by bunninge 25 Feb '08

25 Feb '08

-----Original Message----- From: Martin Kersten <Martin.Kersten(a)cwi.nl> Sent: Friday, February 22, 2008 17:07 To: Communication channel for MonetDB users <monetdb-users(a)lists.sourceforge.net> Subject: Re: [MonetDB-users] COPY TO corrupting data mobigital1 wrote: > FYI, i am using 500K rows at a time. > > I've seen the mserver5.exe process memory utilization go up to 13GB (free > memory was around 1.5 GB). > but then it winds down pretty quickly. > > > > Thanks. This means that the expected database chunk size is topped at 500K * (7 * 8+ 2*20+6 *10+15+144*8 ) bytes i.e. 500K* 1323= 0.670Gb chucksize wise there does not seem a problem. However, virtual memory footprint quickly increases and I am wondering if we hit a limit in OS regaring memory mapped files. I would check a single batch for consistency. Then built a merge table over the smaller batches. In a later stage you can then glue together the pieces until we hit another limit thanks for the info and help in improving MonetDB ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

1 0

[MonetDB-users] COPY TO corrupting data
by mobigital1 25 Feb '08

25 Feb '08

I am trying to load about 500M rows into a table with about 160 columns: column types: 7 columns of type "int" 2 columns of type "varchar(20)" 6 columns of type "varchar(10)" 1 columns of type "varchar(15)" 144 columns of type "real" on a system with 16 GB RAM , 64 bit windows server 2003 SP2. it takes some 20 hours to load the 100M rows, but when I reach that boundary, the server seems to crash and database becomes corrupt so that about 95M rows have 0 in numeric columns, blanks in varchars. The remaining 5M rows have real data. does anyone have any suggestions on what can be done to make it possible to load this data? -- View this message in context: http://www.nabble.com/COPY-TO-corrupting-data-tp15634267p15634267.html Sent from the monetdb-users mailing list archive at Nabble.com.

4 7

[MonetDB-users] MonetDB mserver5 crash
by Michael Schmidt 21 Feb '08

21 Feb '08

Hi, I'm trying to run a benchmark using the latest February stable (on an Ubuntu 7.04 - Feisty Fawn), and want to cleanup the database entirely between two single runs. Basically, my benchmark script is as follows: //////////////////// START CODE // kill all processes and remove databases) // (I know this is not the intended way, but using // > monetdb stop test // > monetdb destroy -f test // while not restarting merovingian basically results in // in the same error) > killall -9 merovingian > killall -9 mserver5 > killall -9 mclient > rm -Rf /usr/local/src/MonetDB/var/MonetDB5/dbfarm/* // start the merovingian server > merovingian > sleep 2 // wait until ports 50000 and 50001 are free, // as they might still be blocked (I inserted this piece // of code because I thought busy port allocation might // be the cause of failure) > [code works fine (ommited)] // create and start the database > monetdb create test; > sleep 2; > monetdb start test; > sleep 2; // load the document into the database (this part tends to fail) > mclient -lsql -dtest < document.sql //////////////////// END CODE The strange thing is that every second run fails due to a "Connection terminated" error when loading the document, i.e. mserver5 crashes away. Did anyone experience similar problems? Any hints would be appreciated. Thanks in advance, Michael

2 9

[MonetDB-users] Storing UUID, column of type Binary?
by McKennirey.Matthew 21 Feb '08

21 Feb '08

2 3

[MonetDB-users] Problem with View definition
by Michael Schmidt 21 Feb '08

21 Feb '08

Hi, I am running the latest (February) release of MonetDB, and I have a question concerning MonetDB view definitions. I have defined a schema consisting of simple triple-column tables, defined as follows CREATE TABLE bench_booktitle (subject INTEGER,object INTEGER,FOREIGN KEY (subject) REFERENCES Dictionary(ID),FOREIGN KEY (object) REFERENCES Dictionary(ID)); CREATE TABLE bench_cdrom (subject INTEGER,object INTEGER,FOREIGN KEY (subject) REFERENCES Dictionary(ID),FOREIGN KEY (object) REFERENCES Dictionary(ID)); ... using a simple Dictionary lookup table CREATE TABLE Dictionary (ID INTEGER,val VARCHAR(20000),PRIMARY KEY (ID)); Now, I'm trying to create a view ranging over all these tables. The problem with the view definition is that it takes a very long time and consumes large main memory resources (I aborted after 10 minutes, where the mserver5 process uses more than 1.2GB of main memory). It might be of interest that view creation takes place even before loading any data in the tables, i.e. all tables are empty. Maybe someone has an idea what's going on when creating the View. Why does it require so much memory and why does it take so long? Any idea how to fix this problem? Here is the view definition (which is rather straightforward): CREATE VIEW Triples AS ( SELECT subject,'bench:booktitle' AS predicate,object FROM bench_booktitle ) UNION ( SELECT subject,'bench:cdrom' AS predicate,object FROM bench_cdrom ) UNION ( SELECT subject,'swrc:pages' AS predicate,object FROM swrc_pages ) UNION ( SELECT subject,'foaf:homepage' AS predicate,object FROM foaf_homepage ) UNION ( SELECT subject,'swrc:editor' AS predicate,object FROM swrc_editor ) UNION ( SELECT subject,'swrc:number' AS predicate,object FROM swrc_number ) UNION ( SELECT subject,'dc:creator' AS predicate,object FROM dc_creator ) UNION ( SELECT subject,'rdfs:seeAlso' AS predicate,object FROM rdfs_seeAlso ) UNION ( SELECT subject,'dcterms:partOf' AS predicate,object FROM dcterms_partOf ) UNION ( SELECT subject,'dcterms:references' AS predicate,object FROM dcterms_references ) UNION ( SELECT subject,'dcterms:issued' AS predicate,object FROM dcterms_issued ) UNION ( SELECT subject,'swrc:volume' AS predicate,object FROM swrc_volume ) UNION ( SELECT subject,'dc:publisher' AS predicate,object FROM dc_publisher ) UNION ( SELECT subject,'swrc:note' AS predicate,object FROM swrc_note ) UNION ( SELECT subject,'swrc:chapter' AS predicate,object FROM swrc_chapter ) UNION ( SELECT subject,'swrc:address' AS predicate,object FROM swrc_address ) UNION ( SELECT subject,'swrc:series' AS predicate,object FROM swrc_series ) UNION ( SELECT subject,'swrc:month' AS predicate,object FROM swrc_month ) UNION ( SELECT subject,'foaf:name' AS predicate,object FROM foaf_name ) UNION ( SELECT subject,'rdf:type' AS predicate,object FROM rdf_type ) UNION ( SELECT subject,'dc:title' AS predicate,object FROM dc_title ) UNION ( SELECT subject,'swrc:journal' AS predicate,object FROM swrc_journal ) UNION ( SELECT subject,'bench:abstract' AS predicate,object FROM bench_abstract ) UNION ( SELECT subject,'swrc:isbn' AS predicate,object FROM swrc_isbn ); Kind regards, Michael Schmidt

2 4

Re: [MonetDB-users] New MonetDB Release
by Rahul Chopra 20 Feb '08

20 Feb '08

> > On Tue, Feb 19, 2008 at 11:35:14PM +0800, Rahul Chopra wrote: > > Congratulations on the release. > > > > I ran a TPC-H test on it. The majority of queries now seem slower > > Example: Query 21: 119 sec (was 18 sec), while others are closer, > > example: Query 13: 21 sec (was 18 sec). > > Which scale factor of TPC-H did you run? > Factor 10. The system has 24 GB of RAM, running SuSe 10 64-bit. The test system has been taken away from me, and the drives rebuilt, so I can't further help at the moment, but wanted to give you the heads up in case you folks did not have time to do much performance testing before this release. If you did, then there was probably just an issue in my environment for some reason. Thanks. > Niels > > > > Did you verify performance for this release? It could be > > something I misconfigured for the new release, so take this with > > a grain of salt. Thanks. > > > > > > > ----- Original Message ----- > > > From: "Stefan Manegold" <Stefan.Manegold(a)cwi.nl> > > > To: monetdb-announce(a)lists.sourceforge.net > > > Subject: [MonetDB-users] New MonetDB Release > > > Date: Tue, 19 Feb 2008 13:51:24 +0100 > > > > > > The MonetDB team at CWI is pleased to announce the new > > "Feb2008" release of > > > the MonetDB suite of programs. > > > > This release marks the roll forward of the binary storage > > layout to a single > > > column storage layout. This involved a major overhaul of the > > MonetDB Server > > > code. > > > > IMPORTANT NOTE: > > > The database format of this release is not compatible with that of any > > > previous release. Before installing this release, make a dump of your > > > database, and do a restore afterwards. > > > > Further changes include: > > > > SQL: The functional extensions to SQL are limited. The mostly concern > > > minor bugs and some of the optimizers have been improved to better exploit > > > re-occurring joins. The core cracker code has been cleaned up for better > > > inspection and sharing in the community. > > > > XQuery: Next to the original Pathfinder compiler (nick-named > > > "milprint_summer" or simply "MPS"), the development of the new improved and > > > enhanced Algebra-based Pathfinder compiler ("ALG") is progressing quickly. > > > While the original MPS version remains the default in this release of > > > MonetDB/XQuery, a preview of the new ALG version is now available without > > > recompilation. > > > > JDBC & XRPC: The Java code (JDBC driver & XRPC wrapper) has > > been moved from > > > the clients and pathfinder source trees to a dedicated java source tree in > > > CVS, which can simply be compiled using "ant". > > > > Apart from this, many bugs have been fixed, and many speed > > improvements have > > > been made. See > > > http://monetdb.cwi.nl/Development/Releases/Version4.22/ > > > for more details. > > > > The new release consists of the following packages: > > > > MonetDB Common 1.22.0 > > > MonetDB Clients 1.22.0 > > > MonetDB4 Server 4.22.0 > > > MonetDB XQuery 0.22.0 > > > MonetDB5 Server 5.4.0 > > > MonetDB SQL 2.22.0 > > > monetdb-1.7-jdbc.jar > > > > There is of course also a new "Super Source Ball", a tarball > > containing the > > > combined sources. > > > > All this is available on our SourceForge project page. See > > > https://sourceforge.net/project/showfiles.php?group_id=56967 for the > > > downloadable files. > > > > -- > > > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > > > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > > > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > > > | The Netherlands | Fax : +31 (20) 592-4312 | > > > > ------------------------------------------------------------------------- > > > This SF.net email is sponsored by: Microsoft > > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > > _______________________________________________ > > > MonetDB-users mailing list > > > MonetDB-users(a)lists.sourceforge.net > > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > > > > > > > > > > = > > Fishing Vacation Deals at Hyatt? > > Book Your Hyatt Fishing Vacation Now. Best Rates Online Guaranteed. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a0e62a460a6115c26a11780… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2008. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Search for products and services at: http://search.mail.com -- Powered by Outblaze

1 0

[MonetDB-users] New MonetDB Release
by Stefan Manegold 20 Feb '08

20 Feb '08

The MonetDB team at CWI is pleased to announce the new "Feb2008" release of the MonetDB suite of programs. This release marks the roll forward of the binary storage layout to a single column storage layout. This involved a major overhaul of the MonetDB Server code. IMPORTANT NOTE: The database format of this release is not compatible with that of any previous release. Before installing this release, make a dump of your database, and do a restore afterwards. Further changes include: SQL: The functional extensions to SQL are limited. The mostly concern minor bugs and some of the optimizers have been improved to better exploit re-occurring joins. The core cracker code has been cleaned up for better inspection and sharing in the community. XQuery: Next to the original Pathfinder compiler (nick-named "milprint_summer" or simply "MPS"), the development of the new improved and enhanced Algebra-based Pathfinder compiler ("ALG") is progressing quickly. While the original MPS version remains the default in this release of MonetDB/XQuery, a preview of the new ALG version is now available without recompilation. JDBC & XRPC: The Java code (JDBC driver & XRPC wrapper) has been moved from the clients and pathfinder source trees to a dedicated java source tree in CVS, which can simply be compiled using "ant". Apart from this, many bugs have been fixed, and many speed improvements have been made. See http://monetdb.cwi.nl/Development/Releases/Version4.22/ for more details. The new release consists of the following packages: MonetDB Common 1.22.0 MonetDB Clients 1.22.0 MonetDB4 Server 4.22.0 MonetDB XQuery 0.22.0 MonetDB5 Server 5.4.0 MonetDB SQL 2.22.0 monetdb-1.7-jdbc.jar There is of course also a new "Super Source Ball", a tarball containing the combined sources. All this is available on our SourceForge project page. See https://sourceforge.net/project/showfiles.php?group_id=56967 for the downloadable files. -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 8

Re: [MonetDB-users] Running multiple mserver5 processes, Merovingian
by McKennirey.Matthew 19 Feb '08

19 Feb '08

2 2

Re: [MonetDB-users] New MonetDB Release
by Rahul Chopra 19 Feb '08

19 Feb '08

Congratulations on the release. I ran a TPC-H test on it. The majority of queries now seem slower Example: Query 21: 119 sec (was 18 sec), while others are closer, example: Query 13: 21 sec (was 18 sec). Did you verify performance for this release? It could be something I misconfigured for the new release, so take this with a grain of salt. Thanks. > ----- Original Message ----- > From: "Stefan Manegold" <Stefan.Manegold(a)cwi.nl> > To: monetdb-announce(a)lists.sourceforge.net > Subject: [MonetDB-users] New MonetDB Release > Date: Tue, 19 Feb 2008 13:51:24 +0100 > > > > The MonetDB team at CWI is pleased to announce the new "Feb2008" release of > the MonetDB suite of programs. > > This release marks the roll forward of the binary storage layout to a single > column storage layout. This involved a major overhaul of the MonetDB Server > code. > > IMPORTANT NOTE: > The database format of this release is not compatible with that of any > previous release. Before installing this release, make a dump of your > database, and do a restore afterwards. > > Further changes include: > > SQL: The functional extensions to SQL are limited. The mostly concern > minor bugs and some of the optimizers have been improved to better exploit > re-occurring joins. The core cracker code has been cleaned up for better > inspection and sharing in the community. > > XQuery: Next to the original Pathfinder compiler (nick-named > "milprint_summer" or simply "MPS"), the development of the new improved and > enhanced Algebra-based Pathfinder compiler ("ALG") is progressing quickly. > While the original MPS version remains the default in this release of > MonetDB/XQuery, a preview of the new ALG version is now available without > recompilation. > > JDBC & XRPC: The Java code (JDBC driver & XRPC wrapper) has been moved from > the clients and pathfinder source trees to a dedicated java source tree in > CVS, which can simply be compiled using "ant". > > Apart from this, many bugs have been fixed, and many speed improvements have > been made. See > http://monetdb.cwi.nl/Development/Releases/Version4.22/ > for more details. > > The new release consists of the following packages: > > MonetDB Common 1.22.0 > MonetDB Clients 1.22.0 > MonetDB4 Server 4.22.0 > MonetDB XQuery 0.22.0 > MonetDB5 Server 5.4.0 > MonetDB SQL 2.22.0 > monetdb-1.7-jdbc.jar > > There is of course also a new "Super Source Ball", a tarball containing the > combined sources. > > All this is available on our SourceForge project page. See > https://sourceforge.net/project/showfiles.php?group_id=56967 for the > downloadable files. > > -- > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > | The Netherlands | Fax : +31 (20) 592-4312 | > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Fishing Vacation Deals at Hyatt® Book Your Hyatt Fishing Vacation Now. Best Rates Online Guaranteed. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a0e62a460a6115c26a11780… -- Powered by Outblaze

4 3

[MonetDB-users] compression & temp space
by Rahul Chopra 19 Feb '08

19 Feb '08

Hello, Does MonetDB use compression at all? I saw something on the site that made me think it might be used for low cardinality columns, but it was not clear, and I could not find any other instances, like for long char columns. Also, are there any plans to allow for specifying a separate device to use for temp space? (Or, can I create a link somewhere on the filesystem?) I just notice that sometimes MonetDB uses an awful lot of virtual memory, and I/O quickly becomes the bottleneck when it no longer fits in RAM. Thanks. = Profit From On Hold Messages 20 Years experience. Custom messages, free equipment, no contracts. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=49dd4ae6b19ee653ce7d12b… -- Powered by Outblaze

1 0

Re: [MonetDB-users] Analyze
by Rahul Chopra 19 Feb '08

19 Feb '08

Thank you. So, the database on its own will collect selectivity statistics so that if there are multiple atomic conditions on a column, it will choose to apply the more selective one first? Thanks > ----- Original Message ----- > From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Analyze > Date: Tue, 19 Feb 2008 14:35:48 +0100 > > > Dear Rahul > > thank you for your interest in MonetDB. > There is no such thing as ANALYZE or UPDATE STATISTICS. > They are not part of the SQL 99 standard > and its implementation would not make sense. > The database performance continuous analysis to optimize > execution using actual properties of the tables involved. > > regards, Martin > Rahul Chopra wrote: > > Is there the equivalent of ANALYZE or UPDATE STATISTICS in > > MonetDB? I tried both, but could not get them to work. > > > > Thanks! > > > > = > > embedded system > > UML 2.0-Based Software Engineering Using Model-Driven Development. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=b006f31a35aad8826624507… > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2008. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Sell Your Annuity If you are receiving payments from a structured settlement or annuity and need cash now, the Structured Settlement Alliance is here to help you get your cash now. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=fc012ccf36676d4eeec4d34… -- Powered by Outblaze

1 0

[MonetDB-users] protocol violation Unexpected line in data block
by sateesh 19 Feb '08

19 Feb '08

Hi All, When i try to fetch data from a table some times i am getting this error: It seems it has some thing to do with the type of characters that are being inserted. I am wondering why it didn't threw any exception while inserting but throwing the excep when trying to retrieve !! I hope this is not because of the sql client i am using..I tried using Squrriel and QuantumDB plugin of Eclipse. Here is the Stack Trace Error Executing: select * from dpa.collection_info:java.sql.SQLException: protocol violation: unexpected line in data block: . java.sql.SQLException: protocol violation: unexpected line in data block: . at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2048) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1798) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at sun.reflect.GeneratedMethodAccessor26.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.quantum.util.proxy.ProxyFactory$InvocationHandlerImpl.invoke(ProxyFactory.java:37) at $Proxy4.execute(Unknown Source) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:133) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:91) at com.quantum.actions.BaseExecuteAction.getSQLResults(BaseExecuteAction.java:202) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:174) at com.quantum.actions.ExecuteAction.execute(ExecuteAction.java:98) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:125) at com.quantum.actions.BaseExecuteAction.run(BaseExecuteAction.java:111) at org.eclipse.ui.actions.BaseSelectionListenerAction.runWithEvent(BaseSelectionListenerAction.java:168) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:443) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:66) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1101) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3319) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:2971) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2389) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2353) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2219) at org.eclipse.ui.internal.Workbench$4.run(Workbench.java:466) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:289) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:461) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:106) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:153) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:106) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:76) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:363) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:504) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:443) at org.eclipse.equinox.launcher.Main.run(Main.java:1169) -- View this message in context: http://www.nabble.com/protocol-violation-Unexpected-line-in-data-block-tp15… Sent from the monetdb-users mailing list archive at Nabble.com.

4 11

[MonetDB-users] Analyze
by Rahul Chopra 19 Feb '08

19 Feb '08

Is there the equivalent of ANALYZE or UPDATE STATISTICS in MonetDB? I tried both, but could not get them to work. Thanks! = embedded system UML 2.0-Based Software Engineering Using Model-Driven Development. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=b006f31a35aad8826624507… -- Powered by Outblaze

2 1

[MonetDB-users] Loading user-defined mal function on server start
by Michael 19 Feb '08

19 Feb '08

Hi, I'd like to place some MAL functions on the server and make them available asap the server starts. Placing a user.mal in the lib dir did not help. Placing in an existing file tells me that the appropriate module is not loaded and the datatypes I am using in are not available yet. Does that mean, that I have to place the functions when my app starts and opens the connection? Is there a desired way at all like the above? Thx, Mike -- <NO> OOXML - Say NO To Microsoft Office broken standard http://www.noooxml.org

2 1

[MonetDB-users] Trouble loading DLLs when called from scripting environment
by Yuvaraj Athur Raghuvir 19 Feb '08

19 Feb '08

Hello, I am using a language called J (www.jsoftware.com) What I have done so far is as follows: 1) Got the Mbedded example running in a C++ project 2) Moving the DLL interactions to J-MonetDB interactions by wrapping the main calls in my own dll called mdbdll.dll Everything is fine until I get to the call embedded_sql (set, setlen) in mdbdll.dll. What I see is that when the lib_sql.dll is loaded I get an access violation error and the program crashes. Is there any assumption on the location at which lib_sql.dll is loaded? Any other clues will be appreciated. Thanks, Yuva

1 0

[MonetDB-users] Windows 64-bit DBGEN
by Jos van Dongen 17 Feb '08

17 Feb '08

Hello, I want to run some TPC-H test on a Windows 64bit server. Does anyone have an executable version of the DBGEN tool which runs on Windows 64bit and will generate large (SF100 or more) files? Thanks in advance. Met vriendelijke groet/kind regards, Jos van Dongen Tholis Consulting T: 06-51169606 F: 0842-231136 M: jvdongen(a)tholis.com www.tholis.com No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.516 / Virus Database: 269.20.7/1283 - Release Date: 16-2-2008 14:16

1 0

[MonetDB-users] Embedded Use: Persisting and Metadata
by Yuvaraj Athur Raghuvir 13 Feb '08

13 Feb '08

Finally, I have managed to get the Mbeddded example working in VC++ 2005 Express Edition on Windows XP ! Thanks to the folks in the mailing list. Use Case: MonetDB5 , Embedded Mode , SQL To move towards the application I intend to experiment on, I need some more information: 1) How to make data durable? In the simple example, I tried the following: a) First Run: Create table and insert rows. Select to check if everything is ok. b) Second Run: Only perform selection >> I get an error in the second run. 2) How to get meta data of the database? a) I want to know the size of the tables and meta tables in the data base. In particular I am interested in seeing the growth of the database on addition of content. b) Typically, there is a master table in the database that records information of the schema persisted. What is the name of the Master Table and its schema in MonetDB? c) SQLite has an independent analyzer tool which dumps the state of the storage from which I can extract most of the data I need. Does MonetDB have a similar mechanism? ~Yuva >>>> code snippet >>>>> dbh = embedded_sql (set, setlen); if (dbh == NULL || mapi_error(dbh)) die(dbh, hdl); /* switch off autocommit */ if (mapi_setAutocommit(dbh, 0) != MOK || mapi_error(dbh)) die(dbh,NULL); if ((hdl = mapi_query(dbh, "create table emp" " (name varchar(20),age int)")) == NULL || mapi_error(dbh)) die(dbh, hdl); close_handle(dbh,hdl); for(i=0; i< 1000; i++) { char query[100]; _snprintf(query, 100,"insert into emp values(\'user%d\', %d)", i, (i % 82)); if ((hdl = mapi_query(dbh, query)) == NULL || mapi_error(dbh)) die(dbh, hdl); close_handle(dbh,hdl); } if ((hdl = mapi_query(dbh, "select * from emp")) == NULL || mapi_error(dbh)) die(dbh, hdl); i=0; while (mapi_fetch_row(hdl)) { char *age = mapi_fetch_field(hdl, 1); i= i+ atoi(age); } if (mapi_error(dbh)) die(dbh, hdl); close_handle(dbh,hdl); printf("The sum is %d \n",i); mapi_disconnect(dbh); return 0;

4 8

[MonetDB-users] How to convert time from seconds to Year Month Day...
by Iftikharn 11 Feb '08

11 Feb '08

Thanks to people out there for providing excellent answers. I have time values in the form of seconds since 1970/01/01 00:00:00.000 GMT e.g. "1087488000". How could I convert them into Year, Month, Day, Hour, Minute, and Second. Iftikhar -- View this message in context: http://www.nabble.com/How-to-convert-time-from-seconds-to-Year-Month-Day...… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] monetdb x100
by Cam Bazz 08 Feb '08

08 Feb '08

hello, I could not find a download for monetdb x100. is that a part of monetdb? Best.

2 1

[MonetDB-users] How to import tables along with data from MS Access into MonetDB
by Iftikharn 07 Feb '08

07 Feb '08

Hi Could any one kindly tell me how to import tables and data from MS Access into MonetDB. Regards, Iftikharn -- View this message in context: http://www.nabble.com/How-to-import-tables-along-with-data-from-MS-Access-i… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] MonetDB database server (Merovingian) is not running
by Iftikharn 06 Feb '08

06 Feb '08

Hi In MonetDB I want to create my own database "test" In one console I turned the mserver5 on by $mserver5 --dbinit="include sql;" # MonetDB server v5.2.0, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.0 loaded > In another concole, I issued the following command $monetdb create test The following message appears: Warning: MonetDB database server is not running successfully created database 'test' $monetdb status test monetdb status test name state uptime crashes test stopped 0 And $monetdb start test start: cannot perform: MonetDB Server (merovingian) is not running mserver5 is already running, how to run merovingian? I tried at the prompt $merovingian $ nothing happens Could any one help me to create my own database rather than the default one 'demo'. Regards, Iftikhar -- View this message in context: http://www.nabble.com/MonetDB-database-server-%28Merovingian%29-is-not-runn… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Accessing MonetDB with MAL through JBDC
by Michael 06 Feb '08

06 Feb '08

Hi folks, I just installed MonetDB. I tried to run the simplest examples and failed. :-( The MAL Reference does not semm really helpful though to me. My questions is, is it possible to use the DB as an embedded server with a Java application? The exampled displayed a C example only. Is it possible to communicate to the server with MAL? I want to write a backend for the Apache Directory Server. I want MonetDB to be it. I want to transform LDAP requests to MAL and get results back form the server. Is this possible at all with this DB? FYI: I am a C illiterate Mike -- <NO> OOXML - Say NO To Microsoft Office broken standard http://www.noooxml.org

5 10

Re: [MonetDB-users] (MonetWeb) monetweb/Docs manual.texi, Stable_2008-02-03, 1.37.2.3, 1.37.2.4
by Martin Kersten 04 Feb '08

04 Feb '08

This is not good and a remnant of Peter's attempt to get the Xquery stuff in. I did not have the time to correct it in a way that all intended results are available. Stefan Manegold wrote: > Update of /ufs/monet/repository/monetweb/Docs > In directory corona.ins.cwi.nl:/tmp/cvs-serv22830/Docs > > Modified Files: > Tag: Stable_2008-02-03 > manual.texi > Log Message: > > since I do not know, whether all these .texi files are supposed to exist, > or whether the reference to them are just legacy, > I (try to) comment them out, > to hope fully get (at least) a tiny step further with building the web site ... > > XQuery/Apache.texi > XQuery/POSIX.texi > XQuery/Windows.texi > XQuery/intro.texi > XQuery/Overview.texi > XQuery/DocMgmt.texi > XQuery/ListDoc.texi > XQuery/AddDoc.texi > XQuery/DelDoc.texi > XQuery/DocOther.texi > XQuery/Xquery.texi > XQuery/Functions.texi > XQuery/xrpc.texi > XQuery/FAQ.texi > > > Index: manual.texi > =================================================================== > RCS file: /ufs/monet/repository/monetweb/Docs/manual.texi,v > retrieving revision 1.37.2.3 > retrieving revision 1.37.2.4 > diff -u -d -r1.37.2.3 -r1.37.2.4 > --- manual.texi 4 Feb 2008 17:58:15 -0000 1.37.2.3 > +++ manual.texi 4 Feb 2008 18:21:05 -0000 1.37.2.4 > @@ -258,14 +258,15 @@ > @include MonetDB/iSQL-Viewer.texi > > @node Apache Configuration, CGI Interface, iSQL-Viewer, Client Interfaces > +@c @include XQuery/Apache.texi > @include XQuery/Security.texi > > @node CGI Interface, POSIX Interface, Apache Configuration, Client Interfaces > @include XQuery/CGI.texi > @node POSIX Interface, Windows Interface, CGI Interface, Client Interfaces > -@include XQuery/POSIX.texi > +@c @include XQuery/POSIX.texi > @node Windows Interface , SQL Reference, POSIX Interface, Client Interfaces > -@include XQuery/Windows.texi > +@c @include XQuery/Windows.texi > > @c ---------------------- SQL PART > @node SQL Reference, SQL Core, Windows Interface , Top > @@ -286,13 +287,13 @@ > > @node XQuery Reference, XQuery Overview, External Functions , Top > @chapter XQuery > -@include XQuery/intro.texi > +@c @include XQuery/intro.texi > > @node XQuery Overview, Database Scaleability, XQuery Reference , XQuery Reference > -@include XQuery/Overview.texi > +@c @include XQuery/Overview.texi > > @node Document Management, Document Collection, Pathfinder Project,XQuery Reference > -@include XQuery/DocMgmt.texi > +@c @include XQuery/DocMgmt.texi > @menu > * Document Collection:: > * Add Document:: > @@ -302,20 +303,20 @@ > @end menu > > @node Document Collection , Add Document, Document Management, Document Management > -@include XQuery/ListDoc.texi > +@c @include XQuery/ListDoc.texi > @node Add Document, Remove Document, Document Collection, Document Management > -@include XQuery/AddDoc.texi > +@c @include XQuery/AddDoc.texi > @node Remove Document, Cache Policy, Add Document, Document Management > -@include XQuery/DelDoc.texi > +@c @include XQuery/DelDoc.texi > @node Cache Policy, Miscellaneous, Remove Document, Document Management > @include XQuery/Cache.texi > @node Miscellaneous, Supported Functions, Cache Policy, Document Management > -@include XQuery/DocOther.texi > +@c @include XQuery/DocOther.texi > > @node Supported Functions, Prepared Queries , Miscellaneous , XQuery Reference > @section Supported Functions > -@include XQuery/Xquery.texi > -@include XQuery/Functions.texi > +@c @include XQuery/Xquery.texi > +@c @include XQuery/Functions.texi > > @node Prepared Queries, StandOff Extensions , Supported Functions ,XQuery Reference > @include XQuery/PreparedQueries.texi > @@ -325,10 +326,10 @@ > @include XQuery/Standoff.texi > > @node XRPC Extention, XQuery FAQ, Why StandOff Extensions?, XQuery Reference > -@include XQuery/xrpc.texi > +@c @include XQuery/xrpc.texi > > @node XQuery FAQ, Design Overview, SOAP Protocol, Top > -@include XQuery/FAQ.texi > +@c @include XQuery/FAQ.texi > > @c ---------------------- MAL Design PART > > >

1 0

[MonetDB-users] embedded SQL server under Windows
by Grigorio V. Moshkin 04 Feb '08

04 Feb '08

Hi, I've installed MonetDB/SQL/32bit under Windows, but I can't find DLL or LIB for embedded server. Although, MonetDB documentation mentioned embedded libraries for UNIX-like system: http://monetdb.cwi.nl/projects/monetdb/MonetDB/Documentation/A-Simple-Examp… But, what about Windows? Can I use MonetDB under Windows in embedded mode?

6 12

[MonetDB-users] MonetDB - backup, restore, transaction logs?
by Артур Суилин 04 Feb '08

04 Feb '08

I have a questions regarding MonetDB readiness for 24h per day production server usage: 1. Does it have any method for online (hot) full backup? Manual says about database dumps via mclient. Are they intended only for database transporation? Can I perform online backup via dump? What about data modifications/uncommited transactions during dump? 2. What about incremental backups? It seems MonetDB have some kind of transaction logs? How can I use them? 3. Does it have any defence against unexpected server crash? Manual says that checkpoint/recovery facility exists, but still not completely implemented/tested? 4. In the case of server crash and database corruption - how can I return database to consistent state? Does it have any tool like myisamchk for MySQL? Thank you. -- Arthur Suilin

1 0

[MonetDB-users] How to reset the password for a DB Insatnce
by sateesh 01 Feb '08

01 Feb '08

Hi All, How can i reset the password for a given DB Instance. Some how the default password monetdb is not getting accepted.. Thanks Sateesh -- View this message in context: http://www.nabble.com/How-to-reset-the-password-for-a-DB-Insatnce-tp1519457… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] JDBC Driver Problem with the new Build..
by sateesh 01 Feb '08

01 Feb '08

HI All, We got the latest build and the JDBC Driver seems to be giving lot of problems.. When i try to view the tables for a given schema it doesn't show any even if there are tables. ( if i execute a select query it returns the results..) Also when i execute a query i am getting the following Error after the results.. [ERROR] Exception in ResultSet for "MYSCHEMA" java.sql.SQLException: Method not implemented yet, sorry! at nl.cwi.monetdb.jdbc.MonetResultSet.getCharacterStream(MonetResultSet.java:294) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.quantum.util.proxy.ProxyFactory$InvocationHandlerImpl.invoke(ProxyFactory.java:37) at $Proxy3.getCharacterStream(Unknown Source) at com.quantum.sql.SQLStandardResultSetResults.getStringFromCharacterSteam(SQLStandardResultSetResults.java:250) at com.quantum.sql.SQLStandardResultSetResults.parseResultSet(SQLStandardResultSetResults.java:147) at com.quantum.sql.SQLStandardResultSetResults.create(SQLStandardResultSetResults.java:69) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:139) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:91) at com.quantum.actions.BaseExecuteAction.getSQLResults(BaseExecuteAction.java:202) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:174) at com.quantum.actions.ExecuteAction.execute(ExecuteAction.java:98) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:125) at com.quantum.actions.BaseExecuteAction.run(BaseExecuteAction.java:111) at org.eclipse.ui.actions.BaseSelectionListenerAction.runWithEvent(BaseSelectionListenerAction.java:168) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:443) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:66) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1101) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3319) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:2971) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2389) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2353) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2219) at org.eclipse.ui.internal.Workbench$4.run(Workbench.java:466) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:289) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:461) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:106) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:153) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:106) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:76) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:363) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:504) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:443) at org.eclipse.equinox.launcher.Main.run(Main.java:1169) [/ERROR] thanks sateesh -- View this message in context: http://www.nabble.com/JDBC-Driver-Problem-with-the-new-Build..-tp15205660p1… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Running multiple mserver5 processes, Merovingian port allocation
by McKennirey.Matthew 01 Feb '08

01 Feb '08

2 1

[MonetDB-users] ALTER TABLE doesn't work in MonetDB !!
by sateesh 30 Jan '08

30 Jan '08

Hi All, I am trying to add columns at the run time to one of the Tables and i am getting an error No Such Table. But when i try to select values from the table i get the values ( there are no rows in this table and no key columns as well..) Here is the Error: [CODE] Error Executing: ALTER TABLE collection_1234.collection_info add customer_a_name varchar(256):java.sql.SQLException: ALTER TABLE: no such table 'collection_info' java.sql.SQLException: ALTER TABLE: no such table 'collection_info' at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2048) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1798) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at com.quantum.util.proxy.ProxyFactory$InvocationHandlerImpl.invoke(ProxyFactory.java:37) at $Proxy4.execute(Unknown Source) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:133) at com.quantum.sql.MultiSQLServer.execute(MultiSQLServer.java:91) at com.quantum.actions.BaseExecuteAction.getSQLResults(BaseExecuteAction.java:202) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:174) at com.quantum.actions.ExecuteAction.execute(ExecuteAction.java:98) at com.quantum.actions.BaseExecuteAction.execute(BaseExecuteAction.java:125) at com.quantum.actions.BaseExecuteAction.run(BaseExecuteAction.java:111) at org.eclipse.ui.actions.BaseSelectionListenerAction.runWithEvent(BaseSelectionListenerAction.java:168) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$6.handleEvent(ActionContributionItem.java:443) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:66) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1101) at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3319) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:2971) at org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2389) at org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2353) at org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2219) at org.eclipse.ui.internal.Workbench$4.run(Workbench.java:466) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:289) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:461) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149) at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:106) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:153) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:106) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:76) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:363) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:504) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:443) at org.eclipse.equinox.launcher.Main.run(Main.java:1169) SQL (DPACUSTOMER1) [select * from collection_1234.collection_info] Success: result set displayed [/CODE] Is this a bug or am i missing some thing ?? Thanks Sateesh -- View this message in context: http://www.nabble.com/ALTER-TABLE-doesn%27t-work-in-MonetDB-%21%21-tp151680… Sent from the monetdb-users mailing list archive at Nabble.com.

2 5

Re: [MonetDB-users] subscribe
by Yuvaraj Athur Raghuvir 30 Jan '08

30 Jan '08

Hello, I am experimenting with in-memory row-based & column-based stores. For the row-based store I am using SQLite. For the column-based, I am proposing to use MonetDB. In this context, I would like to join the mailing list. I am working on Windows XP / 32 and would like to use MonetDB as a DLL. Regards, Yuva

1 0

[MonetDB-users] SQL Function to remove all alpha characters
by Venks 28 Jan '08

28 Jan '08

Hi, Does MonetDB has regular expression support in SQL? I am looking to remove all alpha characters in a column value and wondering if there is a better way to do so rather than removing one character at a time. Thanks, -Venks

3 2

[MonetDB-users] Crash during COPY INTO on --nightly=stable 2008-01-21
by Bob Ippolito 23 Jan '08

23 Jan '08

So here's the core dump for our ETL test with --nightly=stable. We have not yet tried to restart mserver5. Here's some stats on the data dirs: $ du -sh * 10G bat 4.0K box 5.6G core.6950 $ find bat|wc -l 777933 (box is an empty dir) Core was generated by `//mochi/bin/mserver5 --dbname=mochiads_stats --dbinit=include sql; --dbfarm=/da'. Program terminated with signal 6, Aborted. #0 0x00002b5e2eb77cab in raise () from /lib/libc.so.6 (gdb) bt #0 0x00002b5e2eb77cab in raise () from /lib/libc.so.6 #1 0x00002b5e2eb79660 in abort () from /lib/libc.so.6 #2 0x00002b5e2ebaf66b in ?? () from /lib/libc.so.6 #3 0x00002b5e2ebb6b23 in ?? () from /lib/libc.so.6 #4 0x00002b5e2ebba26c in free () from /lib/libc.so.6 #5 0x00002b5e2d18f63e in GDKfree (blk=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_utils.mx:1140 #6 0x00002b5e2d12bd2d in HEAPfree (h=0x1e7270d0) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_heap.mx:265 #7 0x00002b5e2d1d3a50 in BATfree (b=0x1e726f98) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_bat.mx:522 #8 0x00002b5e2d129d3e in BBPfree (b=0x1e726f98, calledFrom=0x2b5e2d2eb338 "BBPtrim") at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_bbp.mx:1748 #9 0x00002b5e2d12a841 in BBPtrim (memtarget=0, vmtarget=0) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_bbp.mx:2081 #10 0x00002b5e2d190d7d in GDKmemchk (memchk=1, vmchk=761245848) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_utils.mx:688 #11 0x00002b5e2d19166d in GDKvmalloc (size=707393416, maxsize=0x42801688, emergency=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_utils.mx:1306 #12 0x00002b5e2d191b30 in GDKmallocmax (size=<value optimized out>, maxsize=0x3439f438, emergency=0) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_utils.mx:1051 #13 0x00002b5e2d12c630 in HEAPalloc (h=0x3439f438, nitems=88424175, itemsize=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_heap.mx:127 #14 0x00002b5e2d115a02 in HASHnew (hp=0x1b26, tpe=6, size=21315311, mask=18446744073709551615) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_search.mx:289 #15 0x00002b5e2d116fc4 in BAThash (b=0x2aab2d943118, masksize=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_search.mx:383 #16 0x00002b5e2d253853 in BAThashjoin (l=0x190, r=0x2aab2d943118, estimate=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_relop.mx:426 #17 0x00002b5e2d2501aa in batjoin (l=0x2aab9c1f6128, r=0x2aabb04f49f8, estimate=9223372036854775808, swap=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_relop.mx:1157 #18 0x00002b5e2d25050b in BATjoin (l=0x1b26, r=0x2356, estimate=6) at /scratch/monet.GNU.64.64.d.29168/MonetDB/src/gdk/gdk_relop.mx:1168 #19 0x00002aaab14a5302 in ALGjoinPath (mb=<value optimized out>, stk=0x2aab56174f18, pci=0x245b2378) ---Type <return> to continue, or q <return> to quit--- at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/optimizer/opt_joinpath.mx:223 #20 0x00002b5e2c880504 in runMALsequence (cntxt=0x604980, mb=0x2aab697741b8, startpc=1, stoppc=0, stk=0x2aab56174f18, env=0x0, pcicaller=0x0) at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_interpreter.mx:1159 #21 0x00002b5e2c8821cb in callMAL (cntxt=0x604980, mb=0x2aab697741b8, env=0x42803fd8, argv=0x42803fb0, debug=0 '\0') at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_interpreter.mx:377 #22 0x00002aaab266d19c in SQLexecutePrepared (cntxt=0x604980, be=<value optimized out>, q=0x2aab1c3ca488) at /scratch/monet.GNU.64.64.d.29168/sql/src/backends/monet5/sql_scenario.mx:1188 #23 0x00002aaab266ed0d in SQLengineIntern (c=0x604980, be=0x2aab140554d8) at /scratch/monet.GNU.64.64.d.29168/sql/src/backends/monet5/sql_scenario.mx:1273 #24 0x00002b5e2c8a105d in runScenarioBody (c=0x604980) at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_scenario.mx:558 #25 0x00002b5e2c8a113a in runScenario (c=0x1b26) at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_scenario.mx:622 #26 0x00002b5e2c87c1d8 in MSserveClient (dummy=<value optimized out>) at /scratch/monet.GNU.64.64.d.29168/MonetDB5/src/mal/mal_session.mx:471 #27 0x00002b5e2df362a5 in start_thread () from /lib/libpthread.so.0 #28 0x00002b5e2ec1661d in clone () from /lib/libc.so.6 #29 0x0000000000000000 in ?? () (gdb) And this is the log of everything printed by mserver5: !WARNING: GDKlockHome: created directory /data/db/monetdb/mochiads_stats/ !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. !WARNING: BBPdir: initializing BBP. # MonetDB server v5.2.3, based on kernel v1.20.1 # Serving database 'mochiads_stats' # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /mochi/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.3 loaded >*** glibc detected *** //mochi/bin/mserver5: free(): invalid pointer: 0x00002aae5199e008 *** ======= Backtrace: ========= /lib/libc.so.6[0x2b5e2ebb6b23] /lib/libc.so.6(cfree+0x8c)[0x2b5e2ebba26c] /mochi/lib/libbat.so.0(GDKfree+0x2e)[0x2b5e2d18f63e] /mochi/lib/libbat.so.0(HEAPfree+0xad)[0x2b5e2d12bd2d] /mochi/lib/libbat.so.0(BATfree+0x1f0)[0x2b5e2d1d3a50] /mochi/lib/libbat.so.0[0x2b5e2d129d3e] /mochi/lib/libbat.so.0(BBPtrim+0x851)[0x2b5e2d12a841] /mochi/lib/libbat.so.0[0x2b5e2d190d7d] /mochi/lib/libbat.so.0(GDKvmalloc+0xdd)[0x2b5e2d19166d] /mochi/lib/libbat.so.0(GDKmallocmax+0xf0)[0x2b5e2d191b30] /mochi/lib/libbat.so.0(HEAPalloc+0x170)[0x2b5e2d12c630] /mochi/lib/libbat.so.0(HASHnew+0x32)[0x2b5e2d115a02] /mochi/lib/libbat.so.0(BAThash+0x334)[0x2b5e2d116fc4] /mochi/lib/libbat.so.0(BAThashjoin+0x3193)[0x2b5e2d253853] /mochi/lib/libbat.so.0[0x2b5e2d2501aa] /mochi/lib/libbat.so.0(BATjoin+0xb)[0x2b5e2d25050b] /mochi/lib/MonetDB5/lib/lib_optimizer.so(ALGjoinPath+0x222)[0x2aaab14a5302] /mochi/lib/libmal.so.0[0x2b5e2c880504] /mochi/lib/libmal.so.0(callMAL+0x25b)[0x2b5e2c8821cb] /mochi/lib/MonetDB5/lib/lib_sql.so(SQLexecutePrepared+0x25c)[0x2aaab266d19c] /mochi/lib/MonetDB5/lib/lib_sql.so(SQLengineIntern+0x21d)[0x2aaab266ed0d] /mochi/lib/libmal.so.0(runScenarioBody+0x14d)[0x2b5e2c8a105d] /mochi/lib/libmal.so.0(runScenario+0x3a)[0x2b5e2c8a113a] /mochi/lib/libmal.so.0(MSserveClient+0x58)[0x2b5e2c87c1d8] /lib/libpthread.so.0[0x2b5e2df362a5] /lib/libc.so.6(clone+0x6d)[0x2b5e2ec1661d] ======= Memory map: ======== 00400000-00404000 r-xp 00000000 fe:00 2115695 /mochi/bin/mserver5 00604000-00605000 rw-p 00004000 fe:00 2115695 /mochi/bin/mserver5 00605000-3ffec000 rw-p 00605000 00:00 0 [heap] 40000000-40001000 ---p 40000000 00:00 0 40001000-40801000 rw-p 40001000 00:00 0 40801000-40802000 ---p 40801000 00:00 0 40802000-41002000 rw-p 40802000 00:00 0 41002000-41003000 ---p 41002000 00:00 0 41003000-41803000 rw-p 41003000 00:00 0 41803000-41804000 ---p 41803000 00:00 0 41804000-42004000 rw-p 41804000 00:00 0 42004000-42005000 ---p 42004000 00:00 0 42005000-42805000 rw-p 42005000 00:00 0 2aaaaabaf000-2aaaaabb3000 r-xp 00000000 fe:00 2085181 /mochi/lib/MonetDB5/lib/lib_mdb.so.0.0.0 2aaaaabb3000-2aaaaadb3000 ---p 00004000 fe:00 2085181 /mochi/lib/MonetDB5/lib/lib_mdb.so.0.0.0 2aaaaadb3000-2aaaaadb4000 rw-p 00004000 fe:00 2085181 /mochi/lib/MonetDB5/lib/lib_mdb.so.0.0.0 2aaaaadb4000-2aaaaadb6000 r-xp 00000000 fe:00 2084480 /mochi/lib/MonetDB5/lib/lib_xml.so.0.0.0 2aaaaadb6000-2aaaaafb5000 ---p 00002000 fe:00 2084480 /mochi/lib/MonetDB5/lib/lib_xml.so.0.0.0 2aaaaafb5000-2aaaaafb6000 rw-p 00001000 fe:00 2084480 /mochi/lib/MonetDB5/lib/lib_xml.so.0.0.0 2aaaaafbd000-2aaaab03e000 r-xp 00000000 fe:00 540697 /lib/libm-2.5.so 2aaaab03e000-2aaaab23d000 ---p 00081000 fe:00 540697 /lib/libm-2.5.so 2aaaab23d000-2aaaab23f000 rw-p 00080000 fe:00 540697 /lib/libm-2.5.so 2aaaab23f000-2aaaab24d000 r-xp 00000000 fe:00 2016109 /mochi/lib/libMapi.so.0.0.0 2aaaab24d000-2aaaab44c000 ---p 0000e000 fe:00 2016109 /mochi/lib/libMapi.so.0.0.0 2aaaab44c000-2aaaab44d000 rw-p 0000d000 fe:00 2016109 /mochi/lib/libMapi.so.0.0.0 2aaaab44d000-2aaaab44e000 r-xp 00000000 fe:00 2085120 /mochi/lib/MonetDB5/lib/lib_unix.so.0.0.0 2aaaab44e000-2aaaab64d000 ---p 00001000 fe:00 2085120 /mochi/lib/MonetDB5/lib/lib_unix.so.0.0.0 2aaaab64d000-2aaaab64e000 rw-p 00000000 fe:00 2085120 /mochi/lib/MonetDB5/lib/lib_unix.so.0.0.0 2aaaab64e000-2aaaab650000 r-xp 00000000 fe:00 2085099 /mochi/lib/MonetDB5/lib/lib_lock.so.0.0.0 2aaaab650000-2aaaab84f000 ---p 00002000 fe:00 2085099 /mochi/lib/MonetDB5/lib/lib_lock.so.0.0.0 2aaaab84f000-2aaaab850000 rw-p 00001000 fe:00 2085099 /mochi/lib/MonetDB5/lib/lib_lock.so.0.0.0 2aaaab850000-2aaaab851000 r-xp 00000000 fe:00 2085118 /mochi/lib/MonetDB5/lib/lib_sema.so.0.0.0 2aaaab851000-2aaaaba51000 ---p 00001000 fe:00 2085118 /mochi/lib/MonetDB5/lib/lib_sema.so.0.0.0 2aaaaba51000-2aaaaba52000 rw-p 00001000 fe:00 2085118 /mochi/lib/MonetDB5/lib/lib_sema.so.0.0.0 2aaaaba52000-2aaaaba57000 r-xp 00000000 fe:00 2085116

2 1

[MonetDB-users] Change schema for already existing tables
by Travis Brady 22 Jan '08

22 Jan '08

Hello, Is it possible to change the schema for tables that have already been created and populated? I'd like to avoid having to fully recreate everything as the load process will likely take a few days at least. thank you, Travis Brady

5 5

[MonetDB-users] Problems with COPY INTO and CHAR(N) columns containing empty strings or all spaces
by Bob Ippolito 22 Jan '08

22 Jan '08

We've had problems with MonetDB SR5 using COPY INTO with data that may be the empty string or all spaces. We've been able to work around this by surrounding all of the values in our copy files with "quotes" (I read tablet.c to try and diagnose the issue and found that as a workaround). I'm not familiar enough with the source and build process yet to submit a patch. We are using '\t' as the separator and the fields that we've had problem with are CHAR(2) or CHAR(16) if that matters. -bob

2 3

[MonetDB-users] Optimal filesystem/platform choices for MonetDB?
by Bob Ippolito 22 Jan '08

22 Jan '08

We've started doing a big import of data into SR5 and I've noticed that it's creating *A LOT* of files. So far we've got about 620k files for 6.7 GB of bat. I expect that a full import should have at least 20 times what's imported so far. It seems that loading data is relatively slow compared to PostgreSQL (we're using COPY) and I'm guessing it's due to all of these files. Right now we're using ext3 on amd64 ubuntu linux. Should we be looking at other platforms? -bob

2 3

[MonetDB-users] Core dump on first connect by mclient in BUNinplace
by Bob Ippolito 22 Jan '08

22 Jan '08

So we've been testing out a big ETL and it crashed again, and now every time we start mserver5 it will seemingly start up ok but as soon as mclient connects it will crash. I've generated a core dump. The db farm is 3.6GB and the core dump is 15MB. I can send either to someone if they need it to look further into the issue. The platform is 2.6.20-15-generic (root@yellow) (gcc version 4.1.2 (Ubuntu 4.1.2-0ubuntu4)) #2 SMP on amd64. It's running an unmodified SR5 superball that we compiled ourselves. I tried looking at strace and the --debug option with all of the flags on but it didn't produce anything that looked very interesting. The backtrace is here: Core was generated by `//mochi/bin/mserver5 --dbname=mochiads_stats --dbinit=include sql; --dbfarm=/da'. Program terminated with signal 11, Segmentation fault. #0 0x00002b88a35bf285 in BUNinplace (b=0x12458e8, p=0x0, h=<value optimized out>, t=0x1246eb0, force=1 '\001') at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB/src/gdk/gdk_bat.mx:1555 1555 ATOMreplace(b->ttype, b->theap, BUNtloc(b, p), t); (gdb) bt #0 0x00002b88a35bf285 in BUNinplace (b=0x12458e8, p=0x0, h=<value optimized out>, t=0x1246eb0, force=1 '\001') at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB/src/gdk/gdk_bat.mx:1555 #1 0x00002b88a35bfb75 in void_inplace (b=0x12458e8, id=1, val=0x1245a20, force=1 '\001') at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB/src/gdk/gdk_bat.mx:1671 #2 0x00002b88a35bfc33 in void_replace_bat (b=0x12458e8, u=0x1246d08, force=<value optimized out>) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB/src/gdk/gdk_bat.mx:1688 #3 0x00002aaab26c9a5a in load_bat (sname=<value optimized out>, tname=<value optimized out>, bname=<value optimized out>, type=<value optimized out>, sz=<value optimized out>, cnt=0x1214400) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/bat/bat_storage.mx:364 #4 0x00002aaab26c9b83 in create_col (tr=<value optimized out>, c=0x1245878) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/bat/bat_storage.mx:456 #5 0x00002aaab26c44a9 in load_table (tr=0xd3dec8, s=0xd3df38, rid=149) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/store.mx:511 #6 0x00002aaab26c5523 in load_trans (tr=0xd3dec8, id=1128) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/store.mx:845 #7 0x00002aaab26c6ff4 in store_init (debug=<value optimized out>, store=<value optimized out>, logdir=<value optimized out>, dbname=<value optimized out>, stk=0) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/store.mx:1318 #8 0x00002aaab26aab79 in mvc_init (debug=0, store=store_bat, stk=0) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/server/sql_mvc.mx:246 #9 0x00002aaab2665c97 in SQLinit (c=<value optimized out>) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/backends/monet5/sql_scenario.mx:225 #10 0x00002b88a2c7d42a in initScenario (c=0x604980, s=0x2b88a2e934d0) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB5/src/mal/mal_scenario.mx:264 #11 0x00002b88a2c58d82 in MSscheduleClient (command=0xb0a1b8 "LIT", challenge=0x41000fd0 "KdhtXMmr29n", fin=0xb10270, fout=0xb03030) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB5/src/mal/mal_session.mx:342 #12 0x00002aaab0e78247 in doChallenge (cmd=<value optimized out>, in=<value optimized out>, out=<value optimized out>) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB5/src/modules/mal/mserver.mx:482 #13 0x00002aaab0e79036 in SERVERlistenThread (Sock=<value optimized out>) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB5/src/modules/mal/mserver.mx:564 #14 0x00002b88a43122a5 in start_thread () from /lib/libpthread.so.0 #15 0x00002b88a4ff261d in clone () from /lib/libc.so.6 #16 0x0000000000000000 in ?? () -bob

2 2

Re: [MonetDB-users] MonetDB/SQL 64-bit
by Martin Kersten 22 Jan '08

22 Jan '08

Stefan Manegold wrote: > Hi Peter, > > unfortunately, this still does not help us much --- at least not me (but I'm > everything but a Windows expert) ... > the 4 tutorial sessions on MonetDB website have been designed to uncover installation errors quickly and to get a first working session. Is tutorial 1 running? > I know, though, that on Windows both server & client need to be started via > the proper batch scripts (or by clicking on the respective icons) to ensure > evironment and paths are set correctly. > yes, the commands execute a script, which sets paths correctly. locate them to see what is required to properly run both. Especially, if you have manually moved folders around or changed permissions. > To help you any further, (sorry for repeating myself), we'd need to know > the exact error message, or at least the paths/names of DLLs that are not > found. > > Furthermoe, could you please continue mailing to neten(a)cwi.nl (as requested > monet(a)cwi.nl > by the "Rply-To:" in the mail header of bot my first and this reply; or even > better to Monetdb-users(a)lists.sourceforge.net)? --- thus, more people than > just me get to see your problem and can help answering and solving it... > > Stefan > > On Tue, Jan 22, 2008 at 12:51:19AM -0600, Peter Haluska wrote: > >> Hi Stefan, >> >> installation has worked. It looks like that it is having problems with >> system paths while trying to run server file(can not find dlls) or server >> batch file. Thanks. >> >> -Peter >> >> >> >> On Jan 21, 2008 6:24 PM, Stefan Manegold <Stefan.Manegold(a)cwi.nl> wrote: >> >> >>> Dear Peter, >>> >>> thank you very much for your interest in MonetDB! >>> >>> To be of any help for you, it is necessary for us to know exactly what >>> does >>> (not) work for you. >>> >>> Does it install? >>> Can you start a server? >>> Can you start a client and connect to the server? >>> Can you load data? >>> Can you run a query? >>> >>> Hence, please let us know exactly which steps you took to download, >>> install, >>> start, etc. MonetDB/SQL, where you get stuck, whether you get any error >>> message(s), and if so, which one(s)... >>> >>> Kind regards, >>> Stefan >>> >>> >>> On Mon, Jan 21, 2008 at 06:02:05PM -0600, Peter Haluska wrote: >>> >>>> Hi, we are testing your software MonetDB/SQL >>>> 64-bit< >>>> >>> http://monetdb.cwi.nl/projects/monetdb//download.php?target=http://prdownlo… >>> >>> > on >>> >>>> our new system 'Windows Server 2008 RC1 Enterprise Edition' with 64-bit >>>> support server and we can not make it to work. >>>> Any suggestions? Thanks. >>>> >>>> -Peter >>>> > >

1 0

[MonetDB-users] Unexpected results with COALESCE and aggregates
by Bob Ippolito 21 Jan '08

21 Jan '08

MonetDB SR5 behaves unexpectedly when we've tried to use COALESCE with aggregates, here's an example: sql>CREATE TABLE tmp(a int); sql>SELECT SUM(a) FROM tmp; +-------+ | sum_a | +=======+ | 0 | +-------+ sql>SELECT MIN(a) FROM tmp; +-------------+ | min_a | +=============+ | null | +-------------+ sql>SELECT COALESCE(MIN(a), 0) FROM tmp; sql> For the first SELECT I would expect NULL, the second SELECT is okay, but I expect a result for the third! Here's what PosgreSQL does: bob=# CREATE TABLE tmp(a int); CREATE TABLE bob=# SELECT SUM(A) FROM tmp; sum ----- (1 row) bob=# SELECT MIN(a) FROM tmp; min ----- (1 row) bob=# SELECT COALESCE(MIN(a), 0) FROM tmp; coalesce ---------- 0 -bob

2 2

[MonetDB-users] timestamptz issues with non-GMT
by Bob Ippolito 21 Jan '08

21 Jan '08

We've been playing around with MonetDB-Mars-SuperBall-SR5 for the past couple weeks and we've been having some issues with timestamps. We unfortunately don't do all of our calculations on GMT so we've hit a couple walls because it seems that the MonetDB 5 mtime module doesn't consider timezones: (Yes I know the compiler seems to optimize out the original type if you look at the EXPLAIN output, but this happens for timestamptz coming from tables too) sql>set time zone interval '-08:00' hour to minute; sql>SELECT CAST(TIMESTAMPTZ '2008-01-01 00:00+00:00' AS DATE); +--------------+ | single_value | +==============+ | 2008-01-01 | +--------------+ PostgreSQL has the expected behavior, which accounts for the local time zone when converting timestamps to dates. bob=# SET TIMEZONE TO 'PST8PST8'; SET bob=# SELECT '2008-01-01 00:00+00:00'::timestamptz::date; date ------------ 2007-12-31 (1 row) This is the best I've been able to do, but it's of course ugly and it seems like it could break if the implementation gets fixed: sql>SELECT CAST(TIMESTAMPTZ '2008-01-01 00:00+00' + CURRENT_TIMEZONE AS DATE); +----------------------+ | sql_add_single_value | +======================+ | 2007-12-31 | +----------------------+ Is the "best" solution to just use the GMT timezone (or the TIMESTAMP type) and hardcode our timezone offset everywhere? sql>SELECT CAST(TIMESTAMP '2008-01-01 00:00' - SEC_INTERVAL '28800' AS DATE); +----------------------+ | sql_sub_single_value | +======================+ | 2007-12-31 | +----------------------+ -bob

1 0

[MonetDB-users] "bpm_storage.h" missing when trying to install "sql" module
by xxiao 19 Jan '08

19 Jan '08

Hi, I have sucessfully installed the following modules of MonetDB monetdb version 1.21.0 monetdb-clients version 1.21.0 monetdb4 version 4.21.0 When I continue to install "sql" module, the "make" complains missing file "bpm_storage.h". The platform is Solaris10/SPARC. Anyone here has a hint what has gone wrong? Thank you so much for your attention. Xiang -- View this message in context: http://www.nabble.com/%22bpm_storage.h%22--missing-when-trying-to-install-%… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] mserver5 question
by Claude Monet 18 Jan '08

18 Jan '08

OS: CentOS 4.6 I am only able to initiate mserver5 as su. What should I do to be able to start the server in a user account? Thanks

2 4

Re: [MonetDB-users] tuning advice for TPC-H
by Rahul Chopra 18 Jan '08

18 Jan '08

I thought I would try and ask these questions again, since there was no response. - How does how MonetDB handles its virtual memory? Does it swap out entire BATs at a time? Or just smaller blocks? What type of caching algorithms does it use? - If I configure a large swap, MonetDB is not using it. I guess it allocates based on actual physical memory. If I want to run a test to let the OS handle virtual memory and have MonetDB try and use more of system virtual memory, how do I do that? I am interested in seeing how this affects performance when the database is too large to fit in memory. - Are there any other tuning settings I should set when using a database that is much larger than memory? Thanks in advance, Rahul > ----- Original Message ----- > From: "Rahul Chopra" <rchopra(a)linuxmail.org> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] tuning advice for TPC-H > Date: Thu, 10 Jan 2008 03:14:54 +0800 > > > > I am still trying to get better performance when doing TPC-H tests > for a database more than twice the size of physical memory. > > I am not sure how MonetDB handles its virtual memory, but it sure > seems to be going to disk an awful lot. Does it swap out entire > BATs? Or just smaller blocks? What type of caching algorithms does > it use? > > Also, one of the things I wanted to try is to setup a really big > swap partition on a separate device with write-back cache enabled > and have MonetDB use it (Basically, see if Linux will virtual > memory better than MonetDB does, and take advantage of putting swap > on a separate device for speed). When I try and do that though, > MonetDB seems to just be trying to stay within the confines of > physical memory available. Is there something I can configure to > try and get it to use system virtual memory? Has anyone tried out > anything like that? > > -Rahul > > > > > > > > > > > > > > I am trying to run some TPC-H queries to get a sense for how > > > > large of databases MonetDB can handle. I am currently trying > > a > > factor 20 database. I notice that on query 9, it is taking > > over > > two hours (still running). In "top" it claims that > > virtual > memory > for the process started at 27 GB or so, and is > > now down > to 10 GB. > What is noteworthy is that CPU usage is > > pretty small, > at 2%. I > previously observed 80-100% with a > > factor 1 database. > > > > > > Does this mean you got the sf-20 loaded? What fixed your problem with > > > loading? > > > > Yes, I got it loaded. Since I had broken up the file into smaller > > chunks, I just restarted on the last chunk that it failed on > > before the crash. Eventually, it went through all of the tables. > > > > > > > > The low cpu usage indicates that MonetDB is waiting for IO. I'll later > > > this week try to repeat your experiment on a similar system. Then I'll > > > have more input on how to improve things. > > > > After writing the email I noticed that system CPU wait time was > > at 25%, with MonetDB at 2% and idle at 73% or so. So, yes, it is > > waiting on IO. Perhaps it is just my hardware. > > > > I did disable the 2 GB swap partition and rerun. After doing so, > > execution time did improve somewhat. I am not sure if this means > > one should always disable swap on a MonetDB system, since the > > system drive is slower than the data drives. I will try another > > experiment and let you know the results. > > > > > = > College For Financial Planning > Nation's most successful CFP® Program with 35+ years of experience. > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=0badaaf35b41b0f3ca7504b… > > > -- > Powered by Outblaze > > ------------------------------------------------------------------------- > Check out the new SourceForge.net Marketplace. > It's the best place to buy or sell services for > just about anything Open Source. > http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Las Vegas, Nevada Home for Sale Dave Radcliffe will help you find your Las Vegas new home for sale, dream condo, townhome, or real estate investment property. Search here for all the homes for sale in Las Vegas, Nevada. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=95c6cb18131e4c352f8c920… -- Powered by Outblaze

2 1

[MonetDB-users] Distributed database
by Michaela Buergle 17 Jan '08

17 Jan '08

Hi there, I'm new to MonetDB and trying to figure out if it can be used for a db distributed over several computers. Have any of you tried to do that? Is there any documentation available? Thanks a lot micha

4 7

[MonetDB-users] create database on different drive
by Jos van Dongen 16 Jan '08

16 Jan '08

Hi all, I’m having a few difficulties on a Windows server: - I want to move the dbfarm to another drive and have altered the gdk_farm setting in the etc\monetdb5.conf file: gdk_dbfarm=G:\MonetDB5\dbfarm. MonetDB server however keeps creating a new MonetDB dir in the ‘documents and settings’ directory, the last place where I want to store a database. Do I need to alter other settings, or is there another config file? - How do you create a new database (on the different drive) and connect to that one instead of the standard ‘demo’ db? Met vriendelijke groet/kind regards, Jos van Dongen Tholis Consulting T: 06-51169606 F: 0842-231136 M: jvdongen(a)tholis.com www.tholis.com No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.516 / Virus Database: 269.19.2/1224 - Release Date: 14-1-2008 17:39

3 2

[MonetDB-users] make failed for buildtools/mel
by xxiao 15 Jan '08

15 Jan '08

Hi, I am trying to build MonetDB on SPARC/Solaris 10 platform from scratch. I started from buildtools. bootstrap and configure succeed. make of Mx succeed. make of mel failed. error messages: make[3]: Leaving directory `/tmp/MonetDB-CVS/buildtools/Mx' make[2]: Leaving directory `/tmp/MonetDB-CVS/buildtools/Mx' Making all in mel make[2]: Entering directory `/tmp/MonetDB-CVS/buildtools/mel' make[2]: *** No rule to make target `all'. Stop. make[2]: Leaving directory `/tmp/MonetDB-CVS/buildtools/mel' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/tmp/MonetDB-CVS/buildtools' any help is greatly appreciated! -- View this message in context: http://www.nabble.com/make-failed-for-buildtools-mel-tp14841558p14841558.ht… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Incorrect version (SR4 instead of SR5) linked to from download page
by Bob Ippolito 10 Jan '08

10 Jan '08

The Super Source Tarball referenced on http://monetdb.cwi.nl/projects/monetdb/Download/index.html is SR4, when it should be SR5. I wasted a couple hours trying to make SR4 build correctly on Mac OS X 10.5 when I finally found out that I was building an old version. I re-built with SR5 and everything seems to be working fine so far. -bob

2 1

[MonetDB-users] Sqlalchemy support to be in trunk soon
by m h 10 Jan '08

10 Jan '08

Just thought I'd give any python developers here a heads up. I've recently gotten commit access to sqlalchemy and am planning on pushing Monetdb support in. Hopefully the 0.4.3 release will include it as "experimental". For motivated python users who want to try it know, the source is found at bug 874[0] cheers, matt 0 - http://www.sqlalchemy.org/trac/ticket/874

1 0

Re: [MonetDB-users] tuning advice for TPC-H
by Rahul Chopra 09 Jan '08

09 Jan '08

I am still trying to get better performance when doing TPC-H tests for a database more than twice the size of physical memory. I am not sure how MonetDB handles its virtual memory, but it sure seems to be going to disk an awful lot. Does it swap out entire BATs? Or just smaller blocks? What type of caching algorithms does it use? Also, one of the things I wanted to try is to setup a really big swap partition on a separate device with write-back cache enabled and have MonetDB use it (Basically, see if Linux will virtual memory better than MonetDB does, and take advantage of putting swap on a separate device for speed). When I try and do that though, MonetDB seems to just be trying to stay within the confines of physical memory available. Is there something I can configure to try and get it to use system virtual memory? Has anyone tried out anything like that? -Rahul > > > > > > > > I am trying to run some TPC-H queries to get a sense for how > > > large of databases MonetDB can handle. I am currently trying a > > > factor 20 database. I notice that on query 9, it is taking over > > > two hours (still running). In "top" it claims that virtual > > memory > for the process started at 27 GB or so, and is now down > > to 10 GB. > What is noteworthy is that CPU usage is pretty small, > > at 2%. I > previously observed 80-100% with a factor 1 database. > > > > Does this mean you got the sf-20 loaded? What fixed your problem with > > loading? > > Yes, I got it loaded. Since I had broken up the file into smaller > chunks, I just restarted on the last chunk that it failed on before > the crash. Eventually, it went through all of the tables. > > > > > The low cpu usage indicates that MonetDB is waiting for IO. I'll later > > this week try to repeat your experiment on a similar system. Then I'll > > have more input on how to improve things. > > After writing the email I noticed that system CPU wait time was at > 25%, with MonetDB at 2% and idle at 73% or so. So, yes, it is > waiting on IO. Perhaps it is just my hardware. > > I did disable the 2 GB swap partition and rerun. After doing so, > execution time did improve somewhat. I am not sure if this means > one should always disable swap on a MonetDB system, since the > system drive is slower than the data drives. I will try another > experiment and let you know the results. > = College For Financial Planning Nation's most successful CFP® Program with 35+ years of experience. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=0badaaf35b41b0f3ca7504b… -- Powered by Outblaze

1 0

[MonetDB-users] Info reg the Physical Tables..
by sateesh 08 Jan '08

08 Jan '08

Hi All, If i create two logical tables which has the same column then when MonetDB actually creates the Physical Tables does it create two tables for this Column.. For Ex: I created these two Tables at the Logical Level.. TAB_1 col_1 varchar(100), col_2 int TAB_2 col_3 varchar(256), col_2 int Now I home MonetDB will create these physical tables.. For TAB_1 PHYSICAL_TAB_1 PHYSICAL_TAB_2 OID , COL_1 OID , COL_2 How abt for TAB_2 Does it create PHYSICAL_TAB_3 PHYSICAL_TAB_4 OID , COL_3 OID , COL_2 or Just PHYSICAL_TAB_3 OID , COL_3 Thanks Sateesh -- View this message in context: http://www.nabble.com/Info-reg-the-Physical-Tables..-tp14692698p14692698.ht… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Noob question: Why can I only initiate mserver5 as root?
by Claude Monet 08 Jan '08

08 Jan '08

Logged as root mserver5 works perfectly. Yet when I login as a user and call mserver5: >mserver5 --dbinit="include sql;" I get the error: !FATAL: GDKlockHome: Database lock '.gdk_lock' denied Any help is greatly appreciated

3 2

Re: [MonetDB-users] tuning advice for TPC-H
by Rahul Chopra 08 Jan '08

08 Jan '08

> > > > I am trying to run some TPC-H queries to get a sense for how > > large of databases MonetDB can handle. I am currently trying a > > factor 20 database. I notice that on query 9, it is taking over > > two hours (still running). In "top" it claims that virtual memory > > for the process started at 27 GB or so, and is now down to 10 GB. > > What is noteworthy is that CPU usage is pretty small, at 2%. I > > previously observed 80-100% with a factor 1 database. > > Does this mean you got the sf-20 loaded? What fixed your problem with > loading? Yes, I got it loaded. Since I had broken up the file into smaller chunks, I just restarted on the last chunk that it failed on before the crash. Eventually, it went through all of the tables. > > The low cpu usage indicates that MonetDB is waiting for IO. I'll later > this week try to repeat your experiment on a similar system. Then I'll > have more input on how to improve things. After writing the email I noticed that system CPU wait time was at 25%, with MonetDB at 2% and idle at 73% or so. So, yes, it is waiting on IO. Perhaps it is just my hardware. I did disable the 2 GB swap partition and rerun. After doing so, execution time did improve somewhat. I am not sure if this means one should always disable swap on a MonetDB system, since the system drive is slower than the data drives. I will try another experiment and let you know the results. = Series 7 NASD Exam Training Series 7 and related NASD Exam Books, software and web based training. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=16e765a220119782741a407… -- Powered by Outblaze

1 0

[MonetDB-users] MonetDB scalability
by Djordje Djokovic 08 Jan '08

08 Jan '08

2 1

[MonetDB-users] tuning advice for TPC-H
by Rahul Chopra 08 Jan '08

08 Jan '08

I am trying to run some TPC-H queries to get a sense for how large of databases MonetDB can handle. I am currently trying a factor 20 database. I notice that on query 9, it is taking over two hours (still running). In "top" it claims that virtual memory for the process started at 27 GB or so, and is now down to 10 GB. What is noteworthy is that CPU usage is pretty small, at 2%. I previously observed 80-100% with a factor 1 database. I have 8 GB RAM, with 2 GB RAM swap. System swap is on a slower partition than the data drive, which is a relatively fast RAID 5 disk array. Might I be better off disabling system swap altogether when using MonetDB? Are there any other configuration changes I should make or MonetDB best practices I should follow? Thanks, Rahul = Mercedes Homes- San Antonio real estate Mercedes Homes builds homes and communities in the San Antonio area. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=9c24f83a902bfb70ef8d7bc… -- Powered by Outblaze

2 1

[MonetDB-users] indexes
by Rahul Chopra 07 Jan '08

07 Jan '08

Hello, I was just curious, what happens behind the scenes when an index is created in MonetDB? I noticed it is instantaneous... just wondering why. Is the BAT file reordered (for a single column index) kind of like for a clustered index, or is a separate index created? Thanks, Rahul = Truelife Financial Get the loan you deserve today regardless your credit history. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=cc5aa117b4038bf76c9b23d… -- Powered by Outblaze

2 1

[MonetDB-users] loading data
by Rahul Chopra 07 Jan '08

07 Jan '08

I ran into some problems loading data for doing some TPC-H tests. After a successful test for a factor 1 database, I moved on to test a factor 20 database. mserver5 appeared to crash when loading partsupp, orders, or lineitem. On a hunch, I ran split on these to ensure that each file was less than 2 GB each, splitting partsupp and orders into two files, and orders into 10. After doing this, partsupp and orders loaded without any problems. However, lineitem would cause mserver5 to crash after loading 2 or 3 of the 1.5 GB chunks. Also, in restarting mserver5, I noticed that CPU usage was sometimes heavy for a while, before starting loading. I am guessing it is doing some recovery or cleanup? Is loading an issue? Since it was busy upon restart, do I need to wait a while before loading a new file to give the system some time to do any housekeeping or something? I am using the latest released sources (not from HEAD), compiled on CentOS 5.1 (64 bit). Thanks, Rahul = Live Answering Service Answering. Live operators 24/7. Rates start at $39/100 calls. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=202d1706cc4cee71bfb381f… -- Powered by Outblaze

2 1

Re: [MonetDB-users] gdk_mem_bigsize and gdk_vm_minsize
by Rahul Chopra 03 Jan '08

03 Jan '08

> > On Fri, Jan 04, 2008 at 12:09:05AM +0800, Rahul Chopra wrote: > > Can you please explain gdk_mem_bigsize and gdk_vm_minsize? I > > searched around on the site and I am not really clear on what the > > optimal settings for these are. > > Memory blocks allocated via GDKmalloc and friends larger then > gdk_mem_bigsize will be mmaped using virtual swap space (vmalloc). This > is done to avoid fragmentation. So this is just for an individual block, and not for total allocated memory? Is a "block" allocated via entire BATs? Or are blocks allocated in segments when read from a single BAT? > > BATs have heaps, these can be malloced (GDKmalloc), virtual mmapped > using swap space (GDKvmalloc) or mmapped (needs a filename). > Blocks (heaps) larger then vm_minsize will be vmalloced. > The backends (sql/xquery) control when we switch to mmapped with files. > > > > > I am currently using the defaults, on a system with 8 GB of RAM. > It depends on your os if thats okay. Thanks. I am using Linux (64 bit), CentOS 5.1. My main concern was if setting these too low somehow restricts the amount of memory used and leads to more swapping. I am not familiar enough with the system to understand all of this, but with 8 GB of ram, should I be using a larger gdk_mem_bigsize than the config default of 262144? The config file mentions these being set to 1/2 of available memory, but default values appear commented out. Are those the values that are actually used? Or, if these are commented out, are these dynamically set? -Rahul > > Niels > > > > Thanks, > > > > Rahul > > > > > > = > > Limousine and Luxury Bus Wine Tours > > Private Napa & Sonoma wine-tasting tours via luxury limousine or bus. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=2c5439db6084d9969b4f63e… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2005. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Mercedes Homes - In FL, TX, NC, & SC Mercedes Homes builds homes in Florida, Texas, and the Carolinas. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=e0639e1f90664efd0041110… -- Powered by Outblaze

2 1

Re: [MonetDB-users] killing queries
by Rahul Chopra 03 Jan '08

03 Jan '08

Thanks for the information, I understand. Other than killing the client application, is there a way to separately connect to the server and gracefully kill the query or connection? > ----- Original Message ----- > From: "Niels Nes" <Niels.Nes(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] killing queries > Date: Thu, 3 Jan 2008 17:47:45 +0100 > > > On Fri, Jan 04, 2008 at 12:06:37AM +0800, Rahul Chopra wrote: > > How can I safely kill queries? > > > > I notice if I ctrl-c out of mclient when executing a long run > > query, mserver5 still seems to be using a lot of memory, maybe it > > has not deallocated it all? Also, if I start a new mclient > > session queries now run slower. Of course, one should always > > avoid ctrl-c, but in case we do have multiple queries running and > > we wish to kill a long running one for some reason, is there a > > way to safely do so? (Like, start a new mclient session, and > > execute some kind of admin commands). > Resources taken because of killed clients should disappear. This can > however take some time as the cleanup is only done within the > interpreter loop. Also we keep the used persistent tables in memory. > They only get freed when running out of memory or when idle for some > time. > > I'm not sure which version your using, but also the current released > version has some memory leaks which maybe the reason for your memory > growth and slowdown. > > Niels > > > > TIA > > > > > > = > > Espresso Machines - Free Shipping > > Espresso Machines, coffee beans and pods, cappuccino cups and > > spoons. Free shipping. No sales tax. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=8427826bf39d56eb7c331a1… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2005. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Area Homes Realty Online Home Search Area Homes Realty is a full service residential real estate company servicing Eastern Massachusetts. Our website is a valuable resource of information whether you are buying or selling. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=6d65a7e04b5c96a53badb07… -- Powered by Outblaze

2 1

[MonetDB-users] gdk_mem_bigsize and gdk_vm_minsize
by Rahul Chopra 03 Jan '08

03 Jan '08

Can you please explain gdk_mem_bigsize and gdk_vm_minsize? I searched around on the site and I am not really clear on what the optimal settings for these are. I am currently using the defaults, on a system with 8 GB of RAM. Thanks, Rahul = Limousine and Luxury Bus Wine Tours Private Napa & Sonoma wine-tasting tours via luxury limousine or bus. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=2c5439db6084d9969b4f63e… -- Powered by Outblaze

2 1

[MonetDB-users] killing queries
by Rahul Chopra 03 Jan '08

03 Jan '08

How can I safely kill queries? I notice if I ctrl-c out of mclient when executing a long run query, mserver5 still seems to be using a lot of memory, maybe it has not deallocated it all? Also, if I start a new mclient session queries now run slower. Of course, one should always avoid ctrl-c, but in case we do have multiple queries running and we wish to kill a long running one for some reason, is there a way to safely do so? (Like, start a new mclient session, and execute some kind of admin commands). TIA = Espresso Machines - Free Shipping Espresso Machines, coffee beans and pods, cappuccino cups and spoons. Free shipping. No sales tax. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=8427826bf39d56eb7c331a1… -- Powered by Outblaze

2 1

[MonetDB-users] mserver5 daemon
by Rahul Chopra 03 Jan '08

03 Jan '08

I had a question about using the daemon option. If I start mserver5 with daemon=yes, it seems to stop: ./mserver5 --dbinit="include sql;" --dbname=db1 --daemon=yes & [1] 10038 [monetdb@localhost bin]$ # MonetDB server v5.2.0, based on kernel v1.20.0 # Serving database 'db1' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /home/monetdb/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.0 loaded [1]+ Stopped ./mserver5 --dbinit="include sql;" --dbname=db1 --daemon=yes If I leave off &, I still get a > prompt and can interact with it. I also tried nohup. I am not sure what I need to do to get the server running in the background and keep it running without it being in the foreground.... = nantucket vacation in Nantucket, MA Sanford Real Estate provides professional real estate services in Nantucket, Massachusetts. Visit us today for home buying, selling, rentals and more. Customer satisfaction is our priority. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=751b4f3b7386a2440fa9cc8… -- Powered by Outblaze

2 1

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Just letting you know I compiled on CentOS 5.1, and it appears to be working now. Thanks for the help. > ----- Original Message ----- > From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 17:59:18 +0100 > > > > Yes, it seems you are right. Download the SuperSourceBall and compile > from that. > The website indicates that the latest stable version works on Centoo. > http://monetdb.cwi.nl/testing/projects/monetdb/Stable/sql5/.mTests103/index… > > Rahul Chopra wrote: > > Hi Martin, > > > > I am now running as a non-root user. > > > > Here is the output from the stack trace: > > > > Program received signal SIGSEGV, Segmentation fault. > > [Switching to Thread 46912496255632 (LWP 23889)] > > 0x0000000000000000 in ?? () > > > > (gdb) bt > > #0 0x0000000000000000 in ?? () > > #1 0x0000003a1e026d9e in _rl_init_terminal_io () > > from /usr/lib64/libreadline.so.5 > > #2 0x0000003a1e013f07 in rl_initialize () from /usr/lib64/libreadline.so.5 > > #3 0x0000003a1e014d07 in readline () from /usr/lib64/libreadline.so.5 > > #4 0x00000038d3c4e98d in getConsoleInput () from /usr/lib64/libmal.so.0 > > #5 0x00000038d3c4f089 in readConsole () from /usr/lib64/libmal.so.0 > > #6 0x00000038d3c195ee in MALreader () from /usr/lib64/libmal.so.0 > > #7 0x00000038d3c463d6 in runScenarioBody () from /usr/lib64/libmal.so.0 > > #8 0x00000038d3c465be in runScenario () from /usr/lib64/libmal.so.0 > > #9 0x00000038d3c196f0 in MSserveClient () from /usr/lib64/libmal.so.0 > > > > Maybe FC7 RPMs cannot run on CentOS 5.1. I may try building > > manually. Thank you and sorry for the trouble. > > > > > > > >> ----- Original Message ----- > >> From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > >> To: "Communication channel for MonetDB users" > >> <monetdb-users(a)lists.sourceforge.net> > >> Subject: Re: [MonetDB-users] Cannot start mserver5 > >> Date: Fri, 28 Dec 2007 15:56:14 +0100 > >> > >> > >> Rahul, > >> > >> I seen you run as root, something one normally doesn't do, but that's > >> your decision > >> and won't affect MonetDB. > >> > >> I have no clue as what ocal configuration setting interferes with the > >> packages. > >> You might run 'gdb mserver5 --dbinit="include sql;"' and > >> sent us the stack trace. > >> > >> Rahul Chopra wrote: > >> > >>> Thank you for the clarification, I did miss that one. I have > >>> now installed it. Here is what happens now: > >>> > >>> [root@localhost bin]# mserver5 --dbinit="include sql;" > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> # MonetDB/SQL module v2.20.2 loaded > >>> [root@localhost bin]# > >>> > >>> It immediately exits without an error message instead of giving > >>> me a prompt. In the getting started guide it mentions to check > >>> your $PATH. It does include /usr/bin: > >>> > >>> [root@localhost bin]# echo $PATH > >>> /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin > >>> > >>> Is there something else I must do? I have not changed the configuration. > >>> > >>> > >>> More info: > >>> > >>> [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 > >>> /usr/bin/Mbeddedsql5 > >>> /usr/bin/merovingian > >>> /usr/bin/monetdb > >>> /usr/lib64/MonetDB5/lib/lib_sql.so > >>> /usr/lib64/MonetDB5/lib/lib_sql.so.0 > >>> /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 > >>> /usr/lib64/MonetDB5/sql.mal > >>> /usr/lib64/libembeddedsql5.so.0 > >>> /usr/lib64/libembeddedsql5.so.0.0.0 > >>> /usr/share/man/man1/merovingian.1.gz > >>> /usr/share/man/man1/monetdb.1.gz > >>> > >>> > >>> [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 > >>> /usr/share/MonetDB/sql > >>> /usr/share/MonetDB/sql/bbp.sql > >>> /usr/share/MonetDB/sql/cache.sql > >>> /usr/share/MonetDB/sql/dependency_functions.sql > >>> /usr/share/MonetDB/sql/math.sql > >>> /usr/share/MonetDB/sql/ms_functions.sql > >>> /usr/share/MonetDB/sql/mtime.sql > >>> /usr/share/MonetDB/sql/stats.sql > >>> /usr/share/MonetDB/sql/url.sql > >>> /usr/share/doc/MonetDB-SQL-2.20.2 > >>> /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL > >>> /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt > >>> /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html > >>> /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt > >>> > >>> [root@localhost bin]# mserver5 --xproperties > >>> # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu > >>> # builtin opt gdk_version = 1.20.0 > >>> # builtin opt monet_pid = 23171 > >>> # builtin opt prefix = /usr > >>> # builtin opt exec_prefix = /usr > >>> # builtin opt gdk_dbname = tst > >>> # builtin opt gdk_dbfarm = /var/MonetDB > >>> # builtin opt gdk_debug = 8 > >>> # builtin opt gdk_mem_bigsize = 262144 > >>> # builtin opt gdk_vm_minsize = 137438953472 > >>> # builtin opt gdk_alloc_map = yes > >>> # builtin opt gdk_mem_pagebits = 14 > >>> # builtin opt gdk_vmtrim = yes > >>> # builtin opt monet_admin = adm > >>> # builtin opt monet_prompt = > > >>> # builtin opt monet_welcome = yes > >>> # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin > >>> # builtin opt monet_daemon = yes > >>> # builtin opt host = localhost > >>> # builtin opt mapi_port = 50000 > >>> # builtin opt mapi_noheaders = no > >>> # builtin opt mapi_debug = 0 > >>> # builtin opt mapi_clients = 2 > >>> # builtin opt sql_debug = 0 > >>> # builtin opt sql_logdir = /var/MonetDB/sql_logs > >>> # builtin opt xquery_logdir = /var/MonetDB/xquery_logs > >>> # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > >>> # builtin opt standoff_start = start > >>> # builtin opt standoff_end = end > >>> # config opt prefix = /usr > >>> # config opt config = /etc/monetdb5.conf > >>> # config opt prefix = /usr > >>> # config opt exec_prefix = /usr > >>> # config opt gdk_dbfarm = /var/MonetDB5/dbfarm > >>> # config opt gdk_dbname = demo > >>> # config opt gdk_alloc_map = no > >>> # config opt gdk_embedded = no > >>> # config opt gdk_debug = 0 > >>> # config opt monet_mod_path = > >>> /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin > >>> # config opt monet_daemon = no > >>> # config opt monet_welcome = yes > >>> # config opt mero_msglog = /var/log/merovingian.log > >>> # config opt mero_errlog = /var/log/merovingian.log > >>> # config opt mero_timeinterval = 600 > >>> # config opt mero_exittimeout = 7 > >>> # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal > >>> # config opt mal_listing = 15 > >>> # config opt checkpoint_dir = /var/MonetDB5/chkpnt > >>> # config opt mapi_port = 0 > >>> # config opt mapi_open = false > >>> # config opt sql_debug = 0 > >>> # config opt sql_logdir = /var/MonetDB5/sql_logs > >>> # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> [root@localhost bin]# > >>> > >>> > >>> > >>> > >>> > >>>> ----- Original Message ----- > >>>> From: "Niels Nes" <Niels.Nes(a)cwi.nl> > >>>> To: "Communication channel for MonetDB users" > >>>> <monetdb-users(a)lists.sourceforge.net> > >>>> Subject: Re: [MonetDB-users] Cannot start mserver5 > >>>> Date: Fri, 28 Dec 2007 09:44:56 +0100 > >>>> > >>>> > >>>> On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > >>>> > >>>> > >>>>> Hello, > >>>>> > >>>>> I installed a copy of MonetDB on CentOS 5.1, but don't seem > >>>>> to be able to start it. I installed the RPMs, and then wanted > >>>>> to follow the "Getting Started" page on your website. > >>>>> > >>>>> > >>>>> [root@localhost ~]# mserver5 --dbinit="include sql;" > >>>>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>>>> # Serving database 'demo' > >>>>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>>>> dynamically linked > >>>>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>>>> # Visit http://monetdb.cwi.nl/ for further information > >>>>> #warning: please don't forget to set your vault key! > >>>>> #(see /etc/monetdb5.conf) > >>>>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>>>> !MALException:malInclude:could not open file: sql > >>>>> > >>>>> [root@localhost ~]# uname -a > >>>>> Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov > >>>>> 12 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > >>>>> > >>>>> [root@localhost ~]# rpm -qa | grep MonetDB > >>>>> MonetDB-client-1.20.2-1.fc7.oid64 > >>>>> MonetDB-1.20.0-3.fc7.oid64 > >>>>> MonetDB-SQL-2.20.2-1.fc7.oid64 > >>>>> MonetDB5-server-5.2.2-1.fc7.oid64 > >>>>> > >>>>> Any idea what I am doing wrong? > >>>>> > >>>>> > >>>> You need to also install the MonetDB-SQL-server5 rpm > >>>> > >>>> Niels > >>>> > >>>> > >>>> > >>>> > >>>>> Regards, > >>>>> > >>>>> Rahul > >>>>> > >>>>> > >>>>> > >>>>> = > >>>>> Criminal Justice Degrees > >>>>> Online Criminal Justice studies - Free info pack now. > >>>>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > >>>>> > >>>>> > >>>>> -- Powered by Outblaze > >>>>> > >>>>> ------------------------------------------------------------------------- > >>>>> This SF.net email is sponsored by: Microsoft > >>>>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>>>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>>>> _______________________________________________ > >>>>> MonetDB-users mailing list > >>>>> MonetDB-users(a)lists.sourceforge.net > >>>>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>>>> > >>>>> > >>>> -- > >>>> > >>>> Niels Nes, Centre for Mathematics and Computer Science (CWI) > >>>> Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > >>>> room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > >>>> url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > >>>> > >>>> ------------------------------------------------------------------------- > >>>> This SF.net email is sponsored by: Microsoft > >>>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>>> _______________________________________________ > >>>> MonetDB-users mailing list > >>>> MonetDB-users(a)lists.sourceforge.net > >>>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>>> > >>>> > >>> > >>> > >>> = > >>> Looking for HR Software? > >>> BillQuick HR will help you manage your employees more efficiently. > >>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… > >>> > >>> > >>> > >>> > >> ------------------------------------------------------------------------- > >> This SF.net email is sponsored by: Microsoft > >> Defy all challenges. Microsoft(R) Visual Studio 2005. > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >> _______________________________________________ > >> MonetDB-users mailing list > >> MonetDB-users(a)lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >> > > > > > > > > > > = > > Illinois Real Estate > > Search approximately 80,000 listings - easy to use and consumer-friendly. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=cd5e8640812a8f246564650… > > > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Aliante - Las Vegas Valley, Nevada Welcome to the beautiful new residential master-planned community of Aliante. Browse our site to see a community map, community resources, descriptions and builder information. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=1b166d271bb74530d5618e7… = Battery Backups from $25 Huge bargains on UPS power backup systems. Hundreds in stock. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=fcec83cbfc8a5226862cb33… -- Powered by Outblaze

1 0

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Hi Martin, I am now running as a non-root user. Here is the output from the stack trace: Program received signal SIGSEGV, Segmentation fault. [Switching to Thread 46912496255632 (LWP 23889)] 0x0000000000000000 in ?? () (gdb) bt #0 0x0000000000000000 in ?? () #1 0x0000003a1e026d9e in _rl_init_terminal_io () from /usr/lib64/libreadline.so.5 #2 0x0000003a1e013f07 in rl_initialize () from /usr/lib64/libreadline.so.5 #3 0x0000003a1e014d07 in readline () from /usr/lib64/libreadline.so.5 #4 0x00000038d3c4e98d in getConsoleInput () from /usr/lib64/libmal.so.0 #5 0x00000038d3c4f089 in readConsole () from /usr/lib64/libmal.so.0 #6 0x00000038d3c195ee in MALreader () from /usr/lib64/libmal.so.0 #7 0x00000038d3c463d6 in runScenarioBody () from /usr/lib64/libmal.so.0 #8 0x00000038d3c465be in runScenario () from /usr/lib64/libmal.so.0 #9 0x00000038d3c196f0 in MSserveClient () from /usr/lib64/libmal.so.0 Maybe FC7 RPMs cannot run on CentOS 5.1. I may try building manually. Thank you and sorry for the trouble. > ----- Original Message ----- > From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 15:56:14 +0100 > > > Rahul, > > I seen you run as root, something one normally doesn't do, but that's > your decision > and won't affect MonetDB. > > I have no clue as what ocal configuration setting interferes with the > packages. > You might run 'gdb mserver5 --dbinit="include sql;"' and > sent us the stack trace. > > Rahul Chopra wrote: > > Thank you for the clarification, I did miss that one. I have now > > installed it. Here is what happens now: > > > > [root@localhost bin]# mserver5 --dbinit="include sql;" > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > # MonetDB/SQL module v2.20.2 loaded > > [root@localhost bin]# > > > > It immediately exits without an error message instead of giving > > me a prompt. In the getting started guide it mentions to check > > your $PATH. It does include /usr/bin: > > > > [root@localhost bin]# echo $PATH > > /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin > > > > Is there something else I must do? I have not changed the configuration. > > > > > > More info: > > > > [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 > > /usr/bin/Mbeddedsql5 > > /usr/bin/merovingian > > /usr/bin/monetdb > > /usr/lib64/MonetDB5/lib/lib_sql.so > > /usr/lib64/MonetDB5/lib/lib_sql.so.0 > > /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 > > /usr/lib64/MonetDB5/sql.mal > > /usr/lib64/libembeddedsql5.so.0 > > /usr/lib64/libembeddedsql5.so.0.0.0 > > /usr/share/man/man1/merovingian.1.gz > > /usr/share/man/man1/monetdb.1.gz > > > > > > [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 > > /usr/share/MonetDB/sql > > /usr/share/MonetDB/sql/bbp.sql > > /usr/share/MonetDB/sql/cache.sql > > /usr/share/MonetDB/sql/dependency_functions.sql > > /usr/share/MonetDB/sql/math.sql > > /usr/share/MonetDB/sql/ms_functions.sql > > /usr/share/MonetDB/sql/mtime.sql > > /usr/share/MonetDB/sql/stats.sql > > /usr/share/MonetDB/sql/url.sql > > /usr/share/doc/MonetDB-SQL-2.20.2 > > /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL > > /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt > > /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html > > /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt > > > > [root@localhost bin]# mserver5 --xproperties > > # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu > > # builtin opt gdk_version = 1.20.0 > > # builtin opt monet_pid = 23171 > > # builtin opt prefix = /usr > > # builtin opt exec_prefix = /usr > > # builtin opt gdk_dbname = tst > > # builtin opt gdk_dbfarm = /var/MonetDB > > # builtin opt gdk_debug = 8 > > # builtin opt gdk_mem_bigsize = 262144 > > # builtin opt gdk_vm_minsize = 137438953472 > > # builtin opt gdk_alloc_map = yes > > # builtin opt gdk_mem_pagebits = 14 > > # builtin opt gdk_vmtrim = yes > > # builtin opt monet_admin = adm > > # builtin opt monet_prompt = > > > # builtin opt monet_welcome = yes > > # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin > > # builtin opt monet_daemon = yes > > # builtin opt host = localhost > > # builtin opt mapi_port = 50000 > > # builtin opt mapi_noheaders = no > > # builtin opt mapi_debug = 0 > > # builtin opt mapi_clients = 2 > > # builtin opt sql_debug = 0 > > # builtin opt sql_logdir = /var/MonetDB/sql_logs > > # builtin opt xquery_logdir = /var/MonetDB/xquery_logs > > # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > > # builtin opt standoff_start = start > > # builtin opt standoff_end = end > > # config opt prefix = /usr > > # config opt config = /etc/monetdb5.conf > > # config opt prefix = /usr > > # config opt exec_prefix = /usr > > # config opt gdk_dbfarm = /var/MonetDB5/dbfarm > > # config opt gdk_dbname = demo > > # config opt gdk_alloc_map = no > > # config opt gdk_embedded = no > > # config opt gdk_debug = 0 > > # config opt monet_mod_path = > > /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin > > # config opt monet_daemon = no > > # config opt monet_welcome = yes > > # config opt mero_msglog = /var/log/merovingian.log > > # config opt mero_errlog = /var/log/merovingian.log > > # config opt mero_timeinterval = 600 > > # config opt mero_exittimeout = 7 > > # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal > > # config opt mal_listing = 15 > > # config opt checkpoint_dir = /var/MonetDB5/chkpnt > > # config opt mapi_port = 0 > > # config opt mapi_open = false > > # config opt sql_debug = 0 > > # config opt sql_logdir = /var/MonetDB5/sql_logs > > # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > [root@localhost bin]# > > > > > > > > > >> ----- Original Message ----- > >> From: "Niels Nes" <Niels.Nes(a)cwi.nl> > >> To: "Communication channel for MonetDB users" > >> <monetdb-users(a)lists.sourceforge.net> > >> Subject: Re: [MonetDB-users] Cannot start mserver5 > >> Date: Fri, 28 Dec 2007 09:44:56 +0100 > >> > >> > >> On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > >> > >>> Hello, > >>> > >>> I installed a copy of MonetDB on CentOS 5.1, but don't seem to > >>> be able to start it. I installed the RPMs, and then wanted to > >>> follow the "Getting Started" page on your website. > >>> > >>> > >>> [root@localhost ~]# mserver5 --dbinit="include sql;" > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> !MALException:malInclude:could not open file: sql > >>> > >>> [root@localhost ~]# uname -a > >>> Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 > >>> 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > >>> > >>> [root@localhost ~]# rpm -qa | grep MonetDB > >>> MonetDB-client-1.20.2-1.fc7.oid64 > >>> MonetDB-1.20.0-3.fc7.oid64 > >>> MonetDB-SQL-2.20.2-1.fc7.oid64 > >>> MonetDB5-server-5.2.2-1.fc7.oid64 > >>> > >>> Any idea what I am doing wrong? > >>> > >> You need to also install the MonetDB-SQL-server5 rpm > >> > >> Niels > >> > >> > >> > >>> Regards, > >>> > >>> Rahul > >>> > >>> > >>> > >>> = > >>> Criminal Justice Degrees > >>> Online Criminal Justice studies - Free info pack now. > >>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > >>> > >>> > >>> -- Powered by Outblaze > >>> > >>> ------------------------------------------------------------------------- > >>> This SF.net email is sponsored by: Microsoft > >>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>> _______________________________________________ > >>> MonetDB-users mailing list > >>> MonetDB-users(a)lists.sourceforge.net > >>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>> > >> -- > >> > >> Niels Nes, Centre for Mathematics and Computer Science (CWI) > >> Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > >> room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > >> url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > >> > >> ------------------------------------------------------------------------- > >> This SF.net email is sponsored by: Microsoft > >> Defy all challenges. Microsoft(R) Visual Studio 2005. > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >> _______________________________________________ > >> MonetDB-users mailing list > >> MonetDB-users(a)lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >> > > > > > > > > > > = > > Looking for HR Software? > > BillQuick HR will help you manage your employees more efficiently. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… > > > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Illinois Real Estate Search approximately 80,000 listings - easy to use and consumer-friendly. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=cd5e8640812a8f246564650… -- Powered by Outblaze

2 1

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Thank you for the clarification, I did miss that one. I have now installed it. Here is what happens now: [root@localhost bin]# mserver5 --dbinit="include sql;" # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.2 loaded [root@localhost bin]# It immediately exits without an error message instead of giving me a prompt. In the getting started guide it mentions to check your $PATH. It does include /usr/bin: [root@localhost bin]# echo $PATH /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin Is there something else I must do? I have not changed the configuration. More info: [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 /usr/bin/Mbeddedsql5 /usr/bin/merovingian /usr/bin/monetdb /usr/lib64/MonetDB5/lib/lib_sql.so /usr/lib64/MonetDB5/lib/lib_sql.so.0 /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 /usr/lib64/MonetDB5/sql.mal /usr/lib64/libembeddedsql5.so.0 /usr/lib64/libembeddedsql5.so.0.0.0 /usr/share/man/man1/merovingian.1.gz /usr/share/man/man1/monetdb.1.gz [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 /usr/share/MonetDB/sql /usr/share/MonetDB/sql/bbp.sql /usr/share/MonetDB/sql/cache.sql /usr/share/MonetDB/sql/dependency_functions.sql /usr/share/MonetDB/sql/math.sql /usr/share/MonetDB/sql/ms_functions.sql /usr/share/MonetDB/sql/mtime.sql /usr/share/MonetDB/sql/stats.sql /usr/share/MonetDB/sql/url.sql /usr/share/doc/MonetDB-SQL-2.20.2 /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt [root@localhost bin]# mserver5 --xproperties # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu # builtin opt gdk_version = 1.20.0 # builtin opt monet_pid = 23171 # builtin opt prefix = /usr # builtin opt exec_prefix = /usr # builtin opt gdk_dbname = tst # builtin opt gdk_dbfarm = /var/MonetDB # builtin opt gdk_debug = 8 # builtin opt gdk_mem_bigsize = 262144 # builtin opt gdk_vm_minsize = 137438953472 # builtin opt gdk_alloc_map = yes # builtin opt gdk_mem_pagebits = 14 # builtin opt gdk_vmtrim = yes # builtin opt monet_admin = adm # builtin opt monet_prompt = > # builtin opt monet_welcome = yes # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin # builtin opt monet_daemon = yes # builtin opt host = localhost # builtin opt mapi_port = 50000 # builtin opt mapi_noheaders = no # builtin opt mapi_debug = 0 # builtin opt mapi_clients = 2 # builtin opt sql_debug = 0 # builtin opt sql_logdir = /var/MonetDB/sql_logs # builtin opt xquery_logdir = /var/MonetDB/xquery_logs # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff # builtin opt standoff_start = start # builtin opt standoff_end = end # config opt prefix = /usr # config opt config = /etc/monetdb5.conf # config opt prefix = /usr # config opt exec_prefix = /usr # config opt gdk_dbfarm = /var/MonetDB5/dbfarm # config opt gdk_dbname = demo # config opt gdk_alloc_map = no # config opt gdk_embedded = no # config opt gdk_debug = 0 # config opt monet_mod_path = /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin # config opt monet_daemon = no # config opt monet_welcome = yes # config opt mero_msglog = /var/log/merovingian.log # config opt mero_errlog = /var/log/merovingian.log # config opt mero_timeinterval = 600 # config opt mero_exittimeout = 7 # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal # config opt mal_listing = 15 # config opt checkpoint_dir = /var/MonetDB5/chkpnt # config opt mapi_port = 0 # config opt mapi_open = false # config opt sql_debug = 0 # config opt sql_logdir = /var/MonetDB5/sql_logs # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ [root@localhost bin]# > ----- Original Message ----- > From: "Niels Nes" <Niels.Nes(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 09:44:56 +0100 > > > On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > > Hello, > > > > I installed a copy of MonetDB on CentOS 5.1, but don't seem to be > > able to start it. I installed the RPMs, and then wanted to follow > > the "Getting Started" page on your website. > > > > > > [root@localhost ~]# mserver5 --dbinit="include sql;" > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > !MALException:malInclude:could not open file: sql > > > > [root@localhost ~]# uname -a > > Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 > > 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > > > > [root@localhost ~]# rpm -qa | grep MonetDB > > MonetDB-client-1.20.2-1.fc7.oid64 > > MonetDB-1.20.0-3.fc7.oid64 > > MonetDB-SQL-2.20.2-1.fc7.oid64 > > MonetDB5-server-5.2.2-1.fc7.oid64 > > > > Any idea what I am doing wrong? > You need to also install the MonetDB-SQL-server5 rpm > > Niels > > > > > > Regards, > > > > Rahul > > > > > > > > = > > Criminal Justice Degrees > > Online Criminal Justice studies - Free info pack now. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2005. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Looking for HR Software? BillQuick HR will help you manage your employees more efficiently. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… -- Powered by Outblaze

2 1

[MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Hello, I installed a copy of MonetDB on CentOS 5.1, but don't seem to be able to start it. I installed the RPMs, and then wanted to follow the "Getting Started" page on your website. [root@localhost ~]# mserver5 --dbinit="include sql;" # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ !MALException:malInclude:could not open file: sql [root@localhost ~]# uname -a Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux [root@localhost ~]# rpm -qa | grep MonetDB MonetDB-client-1.20.2-1.fc7.oid64 MonetDB-1.20.0-3.fc7.oid64 MonetDB-SQL-2.20.2-1.fc7.oid64 MonetDB5-server-5.2.2-1.fc7.oid64 Any idea what I am doing wrong? Regards, Rahul = Criminal Justice Degrees Online Criminal Justice studies - Free info pack now. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… -- Powered by Outblaze

3 2

[MonetDB-users] Benchmark on MonetDB/X100
by Konstantinos Krikellas 26 Dec '07

26 Dec '07

I want to use MonetDB for benchmarking on the TPC-H workload. According to the paper "MonetDB/X100 - A DBMS In The CPU Cache", the X100 module achieves significant acceleration against MonetDB/MIL on Query 1 of TPC-H. Still, when I search your site, there is no reference about how it is possible to activate X100 inside MonetDB. I have only found X100 in your repository for mserver5 in Sourceforge, but it is not currently active. Therefore, I have the following questions: a) Has X100 been integrated to the Mserver5 version of MonetDB, or included as an extension module? b) Does Mserver5 use vector processing as proposed in the paper "MonetDB/X100: Hyper-Pipelining Query Execution" (CIDR 2005) ? c) How is it possible to use MonetDB/X100 for benchmarking purposes? Are there any instructions online? Thank you.

2 1

[MonetDB-users] Memory leaks on nightly stable
by m h 22 Dec '07

22 Dec '07

Hey all- I've been benchmarking my application against mysql and postgres. For my test application which has some 1Mil rows of data and my sample query that returns some 260K rows here's some stats. Speed for query: Postgres 15 sec (8.1) Monetdb 33 sec (nightly stable) Mysql 100 sec (5.0) Bulk load speed: Postgres 12 Min Monetdb 1 Min Mysql 2 Min Memory during bulk load: Postgres 20 Meg Monetdb 700 Meg!!! (And it doesn't come back down) Mysql 20 Meg Memory during query: Postgres 30Meg Monetdb 180 Meg (And increases by 10-20 Meg /query) Mysql 30 Meg Niels has some trick up his sleeves that bring the query speed down (using the nightly current). But I'm concerned about memory use. It's fine to use memory if you are going to be fast. But if I can't load my data (in all I have 67+ mil rows) or have to restart the server after a few queries it is problematic. I've submitted bugs with valgrind reports during load/query, but am wondering if other steps can be taken to help with the memory issue? I know that both mysql and postgres (and a host of other open source projects) have benefitted from coverity's offering [0] and klocworks [1] as well. Have these been looked into? It might be worth it have some automated "eyes" along with the "many eyes" of the open source community that make all bugs shallow. Some food for thought cheers, -matt 0 - http://scan.coverity.com/ 1 - http://www.klocwork.com/company/releases/06_26_06.asp

2 2

[MonetDB-users] Is there a Front End for SPARQL to MonetDB Backend
by sateesh 21 Dec '07

21 Dec '07

HI All, I am wondering whether any effort is made to build a frontend which accepts SPARQL Queries and convers them into MIL for the Monet Back-end ?? Or how difficult to use MIL Directly in a Programming language like Java?? (Which is basically developing the front-end) If such front-end accepts either SQL or XQuery etc then it has to be a Query Parser and Optimizer . How ever if it uses MIL Directly then i guess we don't need a Query Parser and Optimizer..!! Any comments or info reg SPARQL Related front-ends will be of great help Thanks Sateesh -- View this message in context: http://www.nabble.com/Is-there-a-Front-End-for-SPARQL-to-MonetDB-Backend-tp… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Problem with running TPC-H query No.5
by Konstantinos Krikellas 18 Dec '07

18 Dec '07

I am using MonetDB for benchmarking on the TPC-H workload. I have successfully run queries 1, 3 and 10. However, when I try to run query 5: select n_name, sum(l_extendedprice * (1 - l_discount)) as revenue from customer, orders, lineitem, supplier, nation, region where c_custkey = o_custkey and l_orderkey = o_orderkey and l_suppkey = s_suppkey and c_nationkey = s_nationkey and s_nationkey = n_nationkey and n_regionkey = r_regionkey and r_name = 'ASIA' and o_orderdate >= date '1994-01-01' and o_orderdate < date '1994-01-01' + interval '1' year group by n_name order by revenue desc; it takes about two (2) hours to evaluate it. It is obvious that the query cannot be executed inside the main memory, so the system thrashes through paging. Still, this behaviour does not appear for the rest of the queries, as they are computed within one or two seconds. In all cases, the results are correct. The specifications of my system are: Processor: Intel Core 2 Duo @ 1.86 Mhz RAM: 2 Gb Operating System: Linux Ubuntu Gutsy 7.10 MonetDB version: Mserver5 (recently downloaded from your site). Can you give me some indications about why this query takes too long and how can I bypass this response delay? Thanks.

2 4

[MonetDB-users] install script (monetdb-install.sh) doesn't work for current branch
by Ying Zhang 18 Dec '07

18 Dec '07

Hello, I try to install the nightly build of current branch using the install script "monetdb-install.sh" (just downloaded from http://monetdb.cwi.nl/projects/monetdb/Assets/monetdb-install.sh) , but it stops when trying to rename the directory for MonetDB- client-1.21.0 I run the script with the following options: monetdb-install.sh --prefix=$HOME/monetdb --build=$HOME/tmp/ monetdb_build --enable-xquery --nightly=current --enable-debug The log is attached below. A request: would the owner of the script please add the new module "java" in to the script? Thanks a lot! Jennie ============================== $ cat monetdb_build/log Fri Dec 7 12:37:45 CET 2007 called with arguments: --prefix=/export/scratch0/streettivo/monetdb -- build=/export/scratch0/streettivo/tmp/monetdb_build --enable-xquery -- nightly=current --enable-debug --12:37:46-- http://www.ins.cwi.nl/~monet/tars/latest/current/MonetDB.tar.gz Resolving www.ins.cwi.nl... 192.16.196.21 Connecting to www.ins.cwi.nl|192.16.196.21|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1198570 (1.1M) [application/x-gzip] Saving to: `/export/scratch0/streettivo/tmp/monetdb_build/MonetDB/ MonetDB.tar.gz' 0K ........ ........ .. 100% 4.85M=0.2s 12:37:46 (4.85 MB/s) - `/export/scratch0/streettivo/tmp/monetdb_build/ MonetDB/MonetDB.tar.gz' saved [1198570/1198570] unpacking MonetDB.tar.gz --12:37:46-- http://www.ins.cwi.nl/~monet/tars/latest/current/MonetDB-client.tar.gz Resolving www.ins.cwi.nl... 192.16.196.21 Connecting to www.ins.cwi.nl|192.16.196.21|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 920374 (899K) [application/x-gzip] Saving to: `/export/scratch0/streettivo/tmp/monetdb_build/MonetDB- client/MonetDB-client.tar.gz' 0K ........ ...... 100% 32.9M=0.03s 12:37:46 (32.9 MB/s) - `/export/scratch0/streettivo/tmp/monetdb_build/ MonetDB-client/MonetDB-client.tar.gz' saved [920374/920374] unpacking MonetDB-client.tar.gz mv: cannot stat `clients-[0-9]*': No such file or directory failed to rename sources to the right name Please refer to the full log at /export/scratch0/streettivo/tmp/ monetdb_build/log If you believe this is an error in the script or the software, file a bug and attach the logfile. Fri Dec 7 12:37:46 CET 2007 The following tools might be relevant to debug your problem: : 1.15.4.6 $ /usr/bin/autoconf autoconf (GNU Autoconf) 2.59 Written by David J. MacKenzie and Akim Demaille. Copyright (C) 2003 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/automake automake (GNU automake) 1.9.6 Written by Tom Tromey <tromey(a)redhat.com>. Copyright 2005 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/libtool ltmain.sh (GNU libtool) 1.5.22 (1.1220.2.365 2005/12/18 22:14:06) Copyright (C) 2005 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. glibtool cannot be found in the path /usr/lib64/ccache/gcc gcc (GCC) 4.1.2 20070626 (Red Hat 4.1.2-13) Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/ld GNU ld version 2.17.50.0.6-5.fc6 20061020 Copyright 2005 Free Software Foundation, Inc. This program is free software; you may redistribute it under the terms of the GNU General Public License. This program has absolutely no warranty. /usr/bin/make GNU Make 3.81 Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. This program built for x86_64-redhat-linux-gnu /usr/bin/gmake GNU Make 3.81 Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. This program built for x86_64-redhat-linux-gnu /usr/bin/python 2.4.4 (#1, Oct 23 2006, 13:58:18) [GCC 4.1.1 20061011 (Red Hat 4.1.1-30)] /bin/gawk GNU Awk 3.1.5 Copyright (C) 1989, 1991-2005 Free Software Foundation. This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. /bin/sed GNU sed version 4.1.5 Copyright (C) 2003 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE, to the extent permitted by law. gsed cannot be found in the path

4 17

Re: [MonetDB-users] MonetDB size limitation questions.
by Martin Kersten 17 Dec '07

17 Dec '07

Thomas Backlund wrote: > > Hi, > Hi Thomas. Thanks for your interest in MonetDB. > > I stumbled over MonetDB a few days ago and it really cought my > interest. But it is hard to find information about it, so I hope You > could answer a few questions. > > I need a database engine that could handle many rows, about 350*10^9 > rows of about 1000TB data. > This is really large, do you really mean 1 PetaByte? For MonetDB the first interesting part is that it will automatically split the table into 350 tables of 1000.000.000 rows, each would then be be 3 TB.. which means you are using a special column type? I think we need a snippet of the relation declaration to understand your schema We are currently working on automatic horizontal fragmentation with distribution to indeed handle them as single tables. To understand if MonetDB is the solution to your problem, it is also relevant to know what kind of queries you intend to run. We know there are users moving MonetDB into this direction (sizewise) and we would certainly be interested in learning the problems encountered. Given, of course, you have the time to help us on this track and you know of any database system that can already solve the problem out of the box. regards, Martin Kersten > > > Well I dont really need it right now, but I want to be prepared. > > My option up til now has been to use MySQL and to do some kind of > sharding using alot of databases. > But that complicates stuff alot since I still want to do selects in > this gigantic table and that will be a bit of a problem doing selects > if the data is split up in 8000 different MySQL databases. > > Do You think MonetDB could handle this in one single table? > Even if MonetDB could handle this I still will need a hard disk of > 1000TB, do You know of any technique merging many computers together > into one virtiualized hard drive that MonetDB would accept? > > Thank You very much! > > Best regards > Thomas Backlund, > Sweden. >

1 0

Re: [MonetDB-users] Shell script to start MonetDB as service on Linux
by McKennirey.Matthew 13 Dec '07

13 Dec '07

Fabian, thanks for your quick reply, and pointing me in the right direction. We are running on OpenSuse, and for the moment have settled on the following script. I'm sure it could use a lot of improvement, but we are up and running ********** !/bin/sh # Portions Copyright (c) 1995-2002 SuSE Linux AG Nuernberg, Germany. # Author: Lenz Grimmer <feedback(a)suse.de> # # /etc/init.d/monetdb ### BEGIN INIT INFO # Provides: monetdb # Required-Start: $network $remote_fs # Required-Stop: # Default-Start: 2 3 5 # Default-Stop: # Description: Start the MonetDB database server ### END INIT INFO # Shell functions sourced from /etc/rc.status: # rc_check check and set local and overall rc status # rc_status check and set local and overall rc status # rc_status -v ditto but be verbose in local rc status # rc_status -v -r ditto and clear the local rc status # rc_failed set local and overall rc status to failed # rc_failed <num> set local and overall rc status to <num> # rc_reset clear local rc status (overall remains) # rc_exit exit appropriate to overall rc status /etc/rc.status # First reset status of this service rc_reset # Return values acc. to LSB for all commands but status: # 0 - success # 1 - generic or unspecified error # 2 - invalid or excess argument(s) # 3 - unimplemented feature (e.g. "reload") # 4 - insufficient privilege # 5 - program is not installed # 6 - program is not configured # 7 - program is not running # # update these as appropriate for your server MDB_USER='root' MDB_GROUP='root' MDB_HOME=/srv/monetdb MDB_BINDIR=/srv/monetdb/bin echo "" echo "Using configuration at " $MDB_HOME/etc/monetdb5.conf echo "" # Test, if path to merovingian is valid unset MEROVINGIAN if test -x $MDB_BINDIR/merovingian then MEROVINGIAN=$MDB_BINDIR/merovingian fi test "$MEROVINGIAN" || { echo "MonetDB daemon (merovingian) is not available at indicated path:" $MDB_BINDIR "verify path settings in /etc/monetdb"; rc_failed 5; rc_status -v; rc_exit; } depend() { use net } start(){ echo -n "Starting MonetDB/SQL" startproc -s -u $MDB_USER -g $MDB_GROUP $MDB_BINDIR/merovingian # Rmember status and be verbose rc_status -v } stop() { echo -n "Stopping MonetDB/SQL" # shut down mserver if it is running kill -INT $(pidof mserver5) # stop merovingian daemon kill -INT $(pidof merovingian) # Remember status and be verbose rc_status -v } status(){ echo -n "Checking for MonetDb service: " # NOTE: checkproc returns LSB compliant status values. checkproc $MEROVINGIAN rc_status -v } case "$1" in start) start ;; stop) stop ;; status) status ;; restart) stop start ;; *) echo "Usage: {start|stop|status|restart}" exit 1 ;; esac rc_exit

2 1

Re: [MonetDB-users] connecting to monetDB from a Java program
by Ying Zhang 13 Dec '07

13 Dec '07

Hello Gerben, On Dec 13, 2007, at 15:36 , <e.g.broenink(a)student.utwente.nl> <e.g.broenink(a)student.utwente.nl > wrote: > Hello Jennie, > > I got the system working, I can write SOAP messages and execute them > on the server. However there is a new problem. > I'm using the system to execute a few thousand queries, and the > problem is that MonetDB is caching a lot of (intermediate) results, > therefore, after a few honderd queries the server has cached over > 800MB, and the system becomes very slow. Mmm, this is annoying. Do you mean that MonetDB is using more memory ("over 800MB") or is the size of you dbfarm growing? If the memory usage is growing, it sounds like a leak, but I don't know if XRPC is eating up your memory, or is MonetDB doing that (so I cc this e-mail to the monetdb-users mailing-list). It's an interesting problem to investigate. Would you please provide us more information about your problem? - the xml data you are working on - the xquery functions you are using, or are causing your problems - the request messages you use - which version of MonetDB4 are you using? - which OS (and it version) are you using? > I would like to restart the server after a few honderd queries, do > you know how I can do that? (can I send a SOAP message to restart?) > Or is there another way of solving this problem? No, it is not possible to send SOAP messages to restart an Mserver. You might be able to send MIL commands to stop Mserver to stop it, and use a script to check regularly if your Mserver is still running, and (re)start Mserver if it is not running (any more). Jennie

1 0

[MonetDB-users] Shell script to start MonetDB as service on Linux
by Matthew McKennirey 13 Dec '07

13 Dec '07

Is anyone aware of any UNIX shell scripts (bash, bourne, C) that exist to start the MonetDB server as a service on Linux (/etc/init.d). I have successfully (and, well done to the team, painlessly) installed MonetDB from the MonetDB-Mars-SuperBall-SR4.tar.bz2 and tried out the VOC demo. All is well. However I am struggling with merovingian and monetdb trying to figure out how to get things to start correctly in a scripted manner so that the database is ready when the server finishes booting. I have searched the users list, and others and read presentations on the issue of painlessly starting MonetDB (/etc/init.d/monetdb start) but am no further ahead. If anyone has a script I would be grateful. Thanks

2 1

[MonetDB-users] Shell script to start MonetDB as service on Linux
by McKennirey.Matthew 13 Dec '07

13 Dec '07

1 0

[MonetDB-users] Info reg Column Oriented DB
by sateesh 13 Dec '07

13 Dec '07

Hi All, I am evaluating MonetDB for my project and we are planning to Store Semantic Web related info which is basically in RDF Format and wants to use a Colum Oriented DB for this purpose.. Now when i looked at the Sample DB VOC that comes with DB most of the tables have more than two columns. So is this sample (voc) not meant for semantic storage .. Thanks Sateesh -- View this message in context: http://www.nabble.com/Info-reg-Column-Oriented-DB-tp14303148p14303148.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Persistent Stored Modules ?
by Venks 08 Dec '07

08 Dec '07

I need to perform some ETL processing for which I need CURSOR support in a PSAM. I read the meta-data in a CURSOR and dynamically create SQL statements for execution. According to documentation CURSORS are not supported because of the underlying data model in a PSM. This means I can't use PSM for my ETL processing. Let me know if there is anything I could use a PSM in my ETL process. I only wish you had a driver for Ruby. I see that you have PERL, Python and PHP. It would be great if we have a Ruby Library (:- Regards,

3 2

[MonetDB-users] SQL Script execution behaviour
by Venks 08 Dec '07

08 Dec '07

Please find attached 2 scripts namely "test1.sql" and "test2.sql". 1. First execute the script "test1.sql". You will get an error for each and every statement in the script and that's fine. 2. Execute the second script "test2.sql" which will create five simple tables and then execute "test1.sql" again. You will see that the "test1.sql" script executes fine even though it should report errors after the last DELETE statement. In short, it looks like the script stops executing after the first successful SQL statement. It should continue to report errors for all the COPY commands. Thanks,

2 1

[MonetDB-users] Enable/Disable auto-commit
by Venks 08 Dec '07

08 Dec '07

How do I enable/disable auto-commit using "mclient"? Does \A and \a still work? Thanks,

3 2

[MonetDB-users] MonetDB and fast data storage
by Djordje Djokovic 07 Dec '07

07 Dec '07

2 1

[MonetDB-users] Problem with (Tijah) search query for StreetTiVo
by Ying Zhang 07 Dec '07

07 Dec '07

Hello all, When executing the attached search query in the streettivo bobo collection, I get the following errors: $ mclient -lx -p 60000 a.xq MAPI = monetdb@localhost:60000 QUERY = import module namespace stvc = "http://monetdb.cwi.nl/streettivo/search " at "/export/scratch0/streettivo/streettivo/mxq/search.xq"; stvc:search("bobo camperen") ERROR = !ERROR: interpret_params: reverse(param 1): invalid BAT. !ERROR: interpret_params: exist(param 1): evaluation error. !ERROR: interpret_params: not(param 1): evaluation error. $ cat a.xq import module namespace stvc = "http://monetdb.cwi.nl/streettivo/search" at "/export/scratch0/streettivo/streettivo/mxq/search.xq"; stvc:search("bobo camperen") The function "search()" is implemented as the following (see also the attachment): 1. module namespace stvc = "http://monetdb.cwi.nl/streettivo/search"; 2. declare namespace tijah = 'http://dbappl.cs.utwente.nl/pftijah/'; 3. stvc:search($keywords as xs:string) as node()* { 4. let $config := doc("config.xml") 5. (: number of programs to be returned :) 6. let $numPrograms := exactly-one($config/stv-config/nr-programs/ text()) 7. (: number of fragments to be returned per program :) 8. let $numFrags := exactly-one($config/stv-config/nr-fragments/text()) 9. (: number of sentences to be ranked by TIJAH :) 10. let $numSentences := exactly-one($config/stv-config/nr-sentences/ text()) 11. let $query := tijah:tokenize($keywords) 12. let $nexi := if ($query) then 13. concat("//(asr|teletext)[about(.,", $query, ")]// sentence[about(.,", $query, ")]") 14. else "//sentence[about(., asdkjasdkj)]" (: in case query is only a stop word :) 15. let $opt := <TijahOptions ft-index="SpeechOut" returnNumber="{$numSentences}" /> 16. let $res := tijah:queryall-id($nexi,$opt) 17. let $nodes := tijah:nodes($res) 18. let $resultlist := 19. for $pid in distinct-values ($nodes/../@progID) 20. let $sentences := 21. for $s in $nodes[../@progID = $pid] 22. order by tijah:score($res, $s) descending 23. return $s 24. let $best := $sentences[1] 25. let $speech := $best/.. 26. let $pscore := tijah:score($res, exactly-one($best)) 27. order by $pscore descending 28. return element program { 29. attribute thumbnail-image {$speech/@thumbnail_image}, 30. attribute video-file {$speech/@video-file}, 31. attribute startDT {$speech/@startDT}, 32. attribute channel {$speech/@channel}, 33. attribute title {$speech/@title}, 34. attribute progID {$pid}, 35. attribute score {$pscore}, 36. subsequence( 37. for $fragment in $sentences 38. return element fragment { 39. $fragment/@*, 40. $fragment/text() }, 41. 1, $numFrags) } 42. return 43. subsequence($resultlist, 1, $numPrograms) (: first result page :) 44. }; The problem starts in lines 16 and 17. It feels like that the error will occur, as soon as the return value of the function "tijah:queryall-id" or "tijah:nodes" is used. Above error occurs, if I - query the original function, or - skip lines 17 - 43 and return <res>{$res}</res> - skip lines 18 - 43 and return $nodes I use the latest stable version, compiled using the monetdb-install.sh script as the following: $ monetdb-install.sh --prefix=$STV_HOME/monetdb --build=$STV_TEMP/ monetdb_build --enable-xquery --nightly=stable --enable-debug System info: $ uname -a Linux andorea.ins.cwi.nl 2.6.20-1.2933.fc6 #1 SMP Mon Mar 19 11:00:19 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux Would some Tijah experts please have a lot at this problem? I'm not sure if the problem is in the Tijah functions or somewhere else in MonetDB/XQuery. Thanks a lot! Regards, Jennie

1 0

[MonetDB-users] COPY with AUTO_INCREMENT column
by Venks 07 Dec '07

07 Dec '07

Hi, How can I use COPY to load data into a table with a AUTO_INCREMENT column? Just to clarify, the AUTO_INCREMENT column would be the PRIMARY KEY by default and doesn't have any corresponding data in the data file. Thanks,

3 3

[MonetDB-users] COPY - performing SQL processing while COPYing
by Venks 07 Dec '07

07 Dec '07

Hi, Is there are way I can perform some SQL processing while using COPY to load the data? For e.g. I need to load a file into a table but would like to TRIM all the spaces at the beginning and at the end of each column for all VARCHAR Columns. Below is an example in MySQL where I can load the data into a variable first and then load the variable into an actual column. LOAD DATA .... ( @col1_temp, @col2_temp, @col3_temp ) SET col1 = TRIM(@col1_temp), SET col2 = TRIM(@col2_temp), SET col3 = TRIM(@col3_temp) @<variable> stores the initial value of each field and then you can use most of the default SQL functions on the variable before inserting the data. The advantage here is the ability to perform some basic transformations on the data to adhere to the column definitions instead of loading into a temp table and then performing the transformations to load into the actual table. This really helps when loading billions of rows and 100G worth of data. Thanks,

2 1

Re: [MonetDB-users] JDBC driver, where? (sorry)
by Martin Koch 07 Dec '07

07 Dec '07

Thanks all of you for helping me along with my MonetDB testing environment. My today's build seems to contain more of the parts mentioned in the documentation. I could not test sooner due to some typical Dutch festivity involving a crazy horseman in red riding on my roof. Kind regards, Martin

2 1

[MonetDB-users] XQuery Update Last Call
by Florian Wendland 07 Dec '07

07 Dec '07

Hi, a question concerning XQuery Update Facility. The Last Call is not supported by MonetDB at this time. Are there plans to implement it in the near future or will this be skipped, until the final recommendation is published? Thx mfw -- Marc-Florian Wendland Dipl.-Inform. (FH) http://www.florianwendland.de

2 1

[MonetDB-users] Changing default monetdb password
by Venks 06 Dec '07

06 Dec '07

How can I change the default MonetDB password? ALTER USER on "monetdb" gives me the following error: !InvalidCredentialsException:setPassword:The administrator cannot set its own password, use changePassword instead Thanks, -Venks

3 17

[MonetDB-users] Profiling queries
by m h 06 Dec '07

06 Dec '07

Hello all- First of all thanks to you guys for your great help these past few weeks. I really appreciate it. I've learned a bit, and hopefully your product is improving from my bug reports. I've managed to pull a bit of my data from my proprietary db into monetdb. (Have some 60 million rows in the fact table, pulled in 5 million)! I even ran a query against it and got the same numbers (though in a different order)! So I did a very basic poor mans benchmark. My python code can hit the old db or monetdb by changing one line. So I took timestamps around the query execution portion. The old db takes 0.21 seconds when cold. Subsequent queries take 0.027-0.072 seconds Monetdb takes 0.67 seconds when cold and 0.12-0.23 otherwise. It appears that the old db is faster when cold than monetdb is after being primed. A few more caveats. (Yes, this is a poor benchmark but after reading pdfs saying that monetdb was 7 times faster than a 64 way oracle box, I thought I'd get quite a bit of speedup.) The old db is running under vmware on a Core2 1.86Ghz box. Monetdb is running on my laptop, a Pentium M 1.86 Ghz machine. Since the query is confidential I can't really put it here, but I can describe it. I'm pulling stuff out of my fact table and two other dimension tables. The select clause sums a few columns, and on one sums the product of one column and the sum of a few others. The coalesce function is used to convert NULLs to 0. The where statement joins the tables using the = operator and then has two "IN" clauses. Then there is a group by (since I'm aggregating in the select) and an order by. Any hints on how to increase performance? Do I need to tune my query or tweak other things? (Yes I know the laptop machine is not apples to apples to the vmware machine) Am open to suggestions. thanks much, -matt

3 17

[MonetDB-users] JDBC driver, where? (sorry)
by Martin Koch 06 Dec '07

06 Dec '07

Dear Reader, I compiled a Mars-Superball-SR4 and a SR5. Both apperently succesfull, as I have sql functionality. But in neiter I found a /share/MonetDB/ lib/ directory containing the promised JDBC driver. What am I doing wrong? I use a standard Ubuntu Gutsy 32 bit, with sun JRE 5.0 (but not the JDK) to run SQuirreL SQL Thanks for your attention and for your software, Kind regards, Martin

4 4

[MonetDB-users] update query performance
by Lange Marcus 05 Dec '07

05 Dec '07

Hello, I have a question. I have a table with the columns ( id, name (string), num(int) ). In this table I have lets say 100 rows of data. In a Java app. I am updating the different rows individually with the sql command: "UPDATE "tableName" SET "num" = ('99') WHERE "id" = (5);" The time to run this single query is between 15 to 32 milliseconds, except every once in a while when it can be as much as 110 milliseconds. Since I want to do this several times each second for all rows this is way to long time. Am I doing something wrong, or am I using Monet in a way that it is not meant to be used or what ? Is there another way to solve this (Updating individual cells/variables in individual rows FAST) ? Thanks for any input! Regards, Marcus

1 0

[MonetDB-users] inserting into default schema?
by m h 05 Dec '07

05 Dec '07

If I create a table, by default it goes into the "tmp" schema. But when I try to create a "users" table, it complains, since there is one in the "sys" schema. Why doesn't it create one in the "tmp" schema? ie: CREATE TABLE users (fcol FLOAT(25)); !CREATE TABLE: name 'users' already in use Just wondering about the resolution order. thanks -matt

3 6

[MonetDB-users] Optimal hardware/software configuration?
by m h 04 Dec '07

04 Dec '07

Say one wanted to do some benchmarks for Monetdb. Here would be a few questions: * Does Raid 0+1 help more than RAM? * What about multi cores? Are they currently useful? * Are big processor caches useful? * What about 64 bit linux? Does that help or hurt? Or here's another way to put it. If you had between $2-$5K to spend what hardware would you buy? A bunch of PS3's ;) Any input would be great? thanks matt

3 2

[MonetDB-users] converting strings to dates?
by m h 04 Dec '07

04 Dec '07

In Oracle I can do the following: select * from table where timestampcol BETWEEN to_date('01/01/07', 'MM/DD/RR') AND to_date('12/31'/07'), 'MM/DD/RR') It's not clear that this is possible in monetdb. There's the EXTRACT function which pulls a numeric value (month, day or year) from a string representing a timestamp, but I can't see how to get a timestamp/date object out? -matt

3 2

[MonetDB-users] Portuguese Characters
by Paulo Jorge Dias 04 Dec '07

04 Dec '07

Hi, I am trying to insert data which has Portuguese Characters and I get some errors. Using the copy command: sql>copy into d_concelho from '/monetdb5/bo/dados/d_concelho.txt' delimiters '|'; !SQLException:sql:value ALTER DO CH├O|12|20071202 from line 23 not inserted !SQLException:importTable:failed to import table Using a java program with jdbc: D:\MonetDB5>java Concelho java.sql.SQLException: unexpected end of input at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2048) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1798) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at nl.cwi.monetdb.jdbc.MonetPreparedStatement.execute(MonetPreparedStatement.java:209) at Concelho.main(Concelho.java:25) Is there any way to get this running? Thanks very much, Paulo Jorge Dias -- View this message in context: http://www.nabble.com/Portuguese-Characters-tf4938671.html#a14136589 Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] Question about used Encoding
by Markus Gritsch 04 Dec '07

04 Dec '07

Hi, I would like to know how encoding related issues are handles in MonetDB. For example, when I run the following Python script # -*- coding: utf-8 -*- import MonetSQLdb x = MonetSQLdb.connect(host = 'localhost', user = 'voc', password = 'voc', lang = 'sql') c = x.cursor() c.execute('DROP TABLE test') c.execute('CREATE TABLE test(id int, name varchar(20))') c.execute('INSERT INTO test (id, name) VALUES (%s, %s)', (0, 'ä ö ü')) c.close() x.close() and then look at the inserted data using DbVisualizer I get Ã¤ Ã¶ Ã¼ in the 'name' column. When I try to edit the value in the DbVisualizer, I get an error message "unexpected end of input". (The SQL statements reads update voc.test set name = 'ö' where id = 0). Is this a JDBC driver problem? When I connect to an MySQL database with the MySQL JDBC driver included in DbVisualizer I can insert arbitrary characters, and they get properly displayed in the GUI. Kind regards, Markus

3 29

[MonetDB-users] primary key retrieval
by Lange Marcus 04 Dec '07

04 Dec '07

Hello, How do I retrieve the primary key id value after inserting something new into the database ? I am writing a simple Java app. (using JDBC) and would like to get this info back into my program. Thanks for any help! Regards Marcus

2 2

[MonetDB-users] windows 127.0.0.1
by Miki Muzsi 04 Dec '07

04 Dec '07

Hi there, Anybody knows if the installation of Monet can be changed (on windows) to use localhost instead of 127.0.0.1. It seems that because of that I can not connect to MondetDB from a different machine; I get the error message: Could not open connection to the host, on port 50000: Connect failed. I've lokked into monetdb5.conf, registriey, docs ... nothing helpt. BTW I am using version v5.2.2 on windows. Cheers, Miki Chordiant Software International Ltd. Registered office: Chiswick Park Building 10, 566 Chiswick High Road, London W4 5XS Registered in UK no. 02155722 and VAT no. GB 479 9023 02 The information transmitted herewith is sensitive information of Chordiant Software or its customers and is intended only for use to the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon, this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

2 1

[MonetDB-users] offset support?
by m h 04 Dec '07

04 Dec '07

Is there support for OFFSET in queries? The syntax doesn't throw an error, but the expected behavior isn't correct... sql>select * from query_users; +---------+----------+ |user_id |user_name | +=========+==========+ | 1 |john | | 2 |jack | | 3 |ed | | 4 |wendy | | 5 |laura | | 6 |ralph | | 7 |fido | +---------+----------+ Timer 1.820 msec 7 rows sql> Timer 0.294 msec 0 rows sql>SELECT query_users.user_id, query_users.user_name more>FROM query_users ORDER BY query_users.user_id more> LIMIT 3 OFFSET 2; +---------+----------+ |user_id |user_name | +=========+==========+ | 1 |john | | 2 |jack | | 3 |ed | +---------+----------+ -matt

3 10

[MonetDB-users] Slow Data Load
by Paulo Jorge Dias 03 Dec '07

03 Dec '07

Hi, I am working on a Windows XP SP2 32bit with MonetDB v5.2.2 kernel v1.20.0 I have built a java program to upload data from an Oracle Database Table with 6milion rows. After about 4milion of rows loaded the performance decreases dramatically. I have tried to use other way, which is generating all insert statements to a file and then using mclient to execute all the insert statements. Slower that the java option because the autocommit=on and parsing of each statement, but the result is the same. After about 4milion of rows loaded the performance decreases dramatically. Can someone give an explanation for this behavior? Thanks, Paulo Jorge Dias -- View this message in context: http://www.nabble.com/Slow-Data-Load-tf4929292.html#a14108678 Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] Server in a weird state....
by m h 01 Dec '07

01 Dec '07

I tried running the SQLAlchemy ORM testsuite. The first time it ran for a while and then mserver segfaulted. (It also grew to using 700+Megs of memory. Am assumming this is a monetdb issue, since after each test the tables are usually dropped). The server now has issues. It appears to start fine: # MonetDB server v5.2.3, based on kernel v1.20.1 # Serving database 'demo' # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /root/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.3 loaded When I try to connect with the command line client it complains repeatedly: !ERROR: BUNdelete: access denied to tmp_537, aborting. !ERROR: BUNdelete: access denied to tmp_537, aborting. ....

3 21

[MonetDB-users] Preferred bulk load method?
by m h 01 Dec '07

01 Dec '07

Good afternoon- Just wondering if there is a preferred method to load large datasets into monetdb? Piping SQL through mclient? thanks much -matt

2 14

[MonetDB-users] Difficulty with External C Function
by Thomas J. Schulte 30 Nov '07

30 Nov '07

I'm having difficulty linking a custom external C function into MonetDB without crashing the database connection. If anyone knows of a documented end-to-end example of adding external functions compiled with GCC, please let me know. I've documented a minimal example below that crashes the connection for me each time. Software: Red Hat Linux knock-off CentOS, i386. Most recent MonetDB download from Sourceforge (server 5.2.2, client 1.20.2, common 1.20.0). GCC 4.1.1 1. Create a simple C file named te.c. int TEtest( ) { return 4; } 2. Compile file, move it to the proper directory, and create symlinks. $ gcc -c -fPIC te.c -o te.o $ gcc -shared -Wl,-soname,lib_te.so.0 -o lib_te.so.0.0.0 te.o (also tried with soname = libte.so.0, leaving output as lib_te.so.0.0.0) $ cp lib_te.so.0.0.0 $mhome/lib/MonetDB5/lib $ cd $mhome/lib/MonetDB5/lib $ ln -s lib_te.so.0.0.0 lib_te.so.0 $ ln -s lib_te.so.0.0.0 lib_te.so 3. Create a MAL file, saved as $mhome/lib/MonetDB5/te.mal module te; command test( ):int address TEtest(); command doesnotexist( ):int address TEdoesnotexist; 4. Update mal_init.mal by adding the following 2 lines: library te; include te; 5. Start a random DB and try to invoke the test function. Merovingian log show database dino killed by signal 11 afterwards. $ cd $mhome/bin $ ./merovingian & [1] xxxx $ ./mclient -lmal --database=dino -h COS1 mal> te.test( ); MAPI = monetdb@COS1:50001 ACTION= read_line QUERY = te.test(); ERROR = Connection terminated If I instead invoke te.doesnotexist(), I get a different error (below.) This leads me to think that MonetDB is findng and loading my compiled .so file, but it wasn't compiled correctly or otherwise isn't providing what MonetDB expects. mal> te.doesnotexist(); MAPI = monetdb@COS1:50001 QUERY = te.doesnotexist(); ERROR = !TypeException:user.main[1]:'te.doesnotexist' undefined in: _1:int := te.doesnotexist() Any pointers are appreciated. Thomas Schulte

3 2

[MonetDB-users] Howto query with non ascii in python?
by m h 30 Nov '07

30 Nov '07

How do I run non-ascii queries in python? Or from the command line for that matter? Naive tests on my part fail.... python: RuntimeError: !syntax error, unexpected IDENT, expecting INTERSECT or EXCEPT or UNION in: "select name from tables where system=false and name=unitéble2" commandline: sql>select name from tables where system=false and name=unitéble2; !syntax error, unexpected IDENT, expecting INTERSECT or EXCEPT or UNION in: "select name from tables where system=false and name=unitéble2" Thanks -matt

3 2

[MonetDB-users] incorrect handling of NULL values in "IN" statements?
by m h 29 Nov '07

29 Nov '07

My understanding that is that NULL is never equal to anything including itself. Thus to test for NULL values, one must use the IS operator. I'm wondering if the following is a bug. The NOT IN will return the null row, instead of the empty set. Are NULL values outside that query? CREATE TABLE query_users ( user_id INT NOT NULL AUTO_INCREMENT, user_name VARCHAR(20), PRIMARY KEY (user_id) ); INSERT INTO query_users (user_id, user_name) VALUES (1, 'matt'); INSERT INTO query_users (user_id, user_name) VALUES (2, 'fred'); INSERT INTO query_users (user_id, user_name) VALUES (3, null); SELECT user_name FROM query_users WHERE user_name IN ('matt', 'fred'); -- should return empty set, returns null SELECT user_name FROM query_users WHERE user_name NOT IN ('matt', 'fred');

2 3

[MonetDB-users] use column names as column alias?
by m h 29 Nov '07

29 Nov '07

Is it possible to use the column names as the alias? The select query below fails. CREATE TABLE query_users ( user_id INTEGER NOT NULL, user_name VARCHAR(20), PRIMARY KEY (user_id) ); INSERT INTO query_users (user_id, user_name) VALUES (1,'matt'); select query_users.user_id AS "query_users.user_id", query_users.user_name AS "query_users.user_name" from query_users; Here's the error: !Invalid identifier 'query_users.user_id' -matt

2 1

[MonetDB-users] SQL exception during query resolving. Slow join? How to submit external variables?
by Huib Verweij 28 Nov '07

28 Nov '07

Hi everyone, I'm new to MonetDB XQuery and have written a crude Cocoon generator for MonetDB using the example code for the JDBC client from the website. I am using the latest Bug Fix Release of MonetDB as announced by Sjoerd Mullender on 24-10-2007. When I execute the following query I get an error: --------------------------------------------------------- let $zz := doc('vogels.xml')//Vogels[data(Dwaalgast) = 'zeer zeldzaam'] return <vogeltjes>{$zz}</vogeltjes> --------------------------------------------------------- throws: java.sql.SQLException: ERROR: ERROR: XML Generation: NULL BAT has a 4415 head, but tail is NULL. ERROR: ERROR: xquery_print_result_loop: operation failed. However, when I change the XQuery to: --------------------------------------------------------- let $zz := doc('vogels.xml')//Vogels[data(Dwaalgast) = 'zeer zeldzaam'] return <vogeltjes>{$zz}azaz</vogeltjes> --------------------------------------------------------- everything's OK and I get the proper result. (The previous release threw the same error btw.) Also, when I join the results from the above query with another table to resolve some codes to code-descriptions, the query takes from 8.5 up to 11 seconds to execute, vs. <1 second for a query without the join. The result is a little over 1Mb in size. The query I use is this: --------------------------------------------------------- let $zz := doc('vogels.xml')//Vogels[Ecotoop_x0020_nest] return <vogeltjes> {for $vogel in doc('vogels.xml')//Vogels[Ecotoop_x0020_nest], $vc in doc('vogels-code.xml')//Vogels-code[data(Kolomnaam) = 'Ecotoop nest'][data(Code) = $vogel/Ecotoop_x0020_nest]/Codebeschrijving return <vogel> {$vogel/*} {$vc} </vogel> } </vogeltjes> --------------------------------------------------------- The latest preview release of eXist handles the join in 3.1 seconds, any ideas on why this join takes almost three times as long? I have a final question: how do I specify external variables using the JDBC client? Regards, Huib Verweij.

2 2

[MonetDB-users] Why does MonetDB take indexes not into account?
by Markus Gritsch 28 Nov '07

28 Nov '07

Hi, I basically have this schema: CREATE TABLE "act" ( "id" int NOT NULL auto_increment, "title" text NOT NULL, "is_closed" bool NOT NULL, PRIMARY KEY ("id") ); CREATE INDEX act_isClosedIndex ON act (is_closed); CREATE TABLE "entry" ( "id" int NOT NULL auto_increment, "note" text NOT NULL, "act_id" int NOT NULL, PRIMARY KEY ("id"), CONSTRAINT "entry_act_id_exists" FOREIGN KEY ("act_id") REFERENCES "act" ("id") ); CREATE INDEX entry_actIndex ON entry (act_id); Each "act" has several "entries" and each "entry" belongs to one "act". *) full-text search in the "note" column over all entries: SELECT * FROM entry WHERE entry.note LIKE ('%hui%') MySQL: 4.5 Seconds MonetDB: 0.8 Seconds So this is very good and this motivates me to switch to MonetDB. However, the majority of the acts have the "is_closed" field set. The usual case in my application is to take into account only the entries of open acts: *) full-text search in the "note" column over all entries of the open acts: SELECT * FROM entry, act WHERE entry.act_id = act.id AND act.is_closed = 0 AND entry.note LIKE ('%hui%') MySQL: 0.26 Seconds MonetDB: 0.8 Seconds Here, MySQL can take advantage of the index on the is_closed column, whereas MonetDB does not. Is this intended? Databases without indexes seem strange to me. Markus

4 16

[MonetDB-users] python cursor missing lastrowid attribute?
by m h 27 Nov '07

27 Nov '07

In MonetSQLdb BaseCursor.insert_id, the docstring says to use the lastrowid attribute. When I try to access that lastrowid on the cursor instance I get an AttributeError. Should I file a bug for this? matt

5 21

[MonetDB-users] Another query that works in MySQL and SQLite but not in MonetDB
by Markus Gritsch 26 Nov '07

26 Nov '07

Hi, I have another question with an SQL query that works in SQLite and MySQL but does not in MonetDB. SELECT * FROM test WHERE ((1) AND (id=100)) syntax error, unexpected AND in: "prepare select * from test where ((1) and" The query is forged by an ORM. I programmatically put together the WHERE clause. All the contitions are put together using AND, and in the case of no conditions, the WHERE clause simply reads (1), which yields all entries in the table. However, MonetDB cannot parse this. Markus

4 9

[MonetDB-users] Problem with colums named "begin" and "end"
by Markus Gritsch 25 Nov '07

25 Nov '07

Hi, I have a table with columns named "begin" and "end". With SQLite and MySQL the SELECT works all right, but MonetDB cannot parse the SQL: sql>CREATE TABLE "test" ("id" INT, "begin" TIMESTAMP, "end" TIMESTAMP); sql>INSERT INTO test ("id", "begin", "end") VALUES (0, '2003-02-07 12:00:00', '2003-02-07 12:00:00'); sql>SELECT id, begin end FROM test; !syntax error, unexpected BEGIN in: "select id, begin" Kind regards, Markus

3 4

[MonetDB-users] Memory Leak in mserver5.exe
by Markus Gritsch 24 Nov '07

24 Nov '07

Hi, I have a medium sized dataset of about 50 MB text data. When I repeatedly call SELECT * FROM entry WHERE LOWER(note) LIKE '%hui%' I get at some time not my result, but the following error in DbVisualizer: protocol violation, unexpected line: VirtualAlloc(1a0a0000,29806592,MEM_COMMIT,PAGE_READWRITE): failed Repeatedly calling the query from the command line like this mclient.exe -lsql -s"SELECT * FROM entry WHERE LOWER(note) LIKE '%hui%'" > result.txt produces the attached memory usage graph. After 11 times calling the query the memory is full, and some kind of garbage collection seems to happen. However, after only 6 additional times the memory is again full and the garbage collection is quite less effective than before. Subsequent calls reach the memory limit every time. Markus P.S.: I have disabled the virtual memory on my Windows XP because when the OS starts paging, it becomes unbearably slow.

2 5

[MonetDB-users] New MonetDB Bug Fix Release
by Sjoerd Mullender 24 Nov '07

24 Nov '07

The MonetDB team at CWI is pleased to announce a new bug fix release of the MonetDB suite of programs. The following packages have been released: MonetDB Clients 1.20.2 MonetDB5 Server 5.2.2 MonetDB SQL 2.20.2 There is of course also a new "Super Source Ball", a tarball containing the combined sources. All this is available on our SourceForge project page. See https://sourceforge.net/project/showfiles.php?group_id=56967 for the downloadable files. See http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Version4.20/ind… for a list of fixes. -- Sjoerd Mullender

1 0

[MonetDB-users] MonetSQLdb and Unicode
by Markus Gritsch 23 Nov '07

23 Nov '07

Hi, is the Python module MonetSQLdb expected to handle unicode? Currently when INSERTing I must make sure that Python unicode types get converted to strings using UTF-8 encoding. Likewise when SELECTing I get UTF-8 encoded strings back. BTW, is it possible to use another encoding than UTF-8 with MonetDB? The Python DB API for SQLite allows inserting Python unicode types and yields unicode when selecting. MySQLdb allows specifying a 'charset' parameter in the connection constructor and uses this charset to automatically encode unicode objects when inserting. It also returns unicode objects. The following script raises an exception when used with MonetDB: import MonetSQLdb x = MonetSQLdb.connect() c = x.cursor() c.execute('DROP TABLE test') c.execute('CREATE TABLE test(id int, name varchar(20))') c.execute('INSERT INTO test (id, name) VALUES (%s, %s)', (0, u'm')) c.execute("SELECT * FROM test") value = c.fetchone()[-1] print type(value) c.close() x.close() --- Traceback (most recent call last): File "test.py", line 8, in <module> c.execute('INSERT INTO test (id, name) VALUES (%s, %s)', (0, u'm')) File "C:\Python25\lib\site-packages\mdb\MonetSQLdb\cursors.py", line 95, in execute self.errorhandler(self, exc, value) File "C:\Python25\lib\site-packages\mdb\MonetSQLdb\__init__.py", line 77, in defaulterrorhandler raise errorclass, errorvalue RuntimeError: !SELECT: identifier 'm' unknown

2 1

[MonetDB-users] No useful error message on SQL syntax error
by Markus Gritsch 23 Nov '07

23 Nov '07

Hi, when using MonetSQLdb from Python and the executed SQL contains a syntax error, there is no useful information displayed in the traceback. The following script for example import MonetSQLdb x = MonetSQLdb.connect() c = x.cursor() c.execute('DROP TABLE test') c.execute('DROP TABLE test') yield this traceback: Traceback (most recent call last): File "testMonetDB.py", line 9, in <module> c.execute('DROP TABLE test') File "C:\Python25\lib\site-packages\mdb\MonetSQLdb\cursors.py", line 95, in execute self.errorhandler(self, exc, value) File "C:\Python25\lib\site-packages\mdb\MonetSQLdb\__init__.py", line 72, in defaulterrorhandler raise errorclass, errorvalue RuntimeError: None The Message is None whereas it should be DROP TABLE: no such table 'test' Kind regards, Markus

2 2

[MonetDB-users] bug 1834820 AUTO_INCREMENT failures...
by m h 22 Nov '07

22 Nov '07

Hello again - I've filed another bug here.... http://sourceforge.net/tracker/index.php?func=detail&aid=1834820&group_id=5… Similar to the NUMERIC not allowing initial NULLs, AUTO_INCREMENT won't allow skipping of Primary Keys (the first time after, the second time it works) after you've inserted with a Primary Key... -matt

2 3

[MonetDB-users] Merovingian
by Venks 21 Nov '07

21 Nov '07

Hi, I have been using some old scripts to START and STOP MonetDB instances. One of our requirements is to not to use default database and default directories for data/logs. So, I specify the data/log/checkpoint and the mapi_port explicitly when I bring up the instance using "mserver5". Please find enclosed the actual command from the START script below. #...Launch the database /root/countdb/bin/mserver5 --dbfarm=/mnt/countdb1/dbfarm --dbname=csdb --dbinit='include sql;' --set sql_logdir=/mnt/countdb1/sql_logs --set checkpoint_dir=/mnt/countdb1/chkpnt --set mapi_port=50001 --set daemon=yes --set monet_welcom=no --set MONETDB5_PREFIX=$MDIR >> $LOG 2>&1 & I understand the "merovingian" is the new and updated program to handle instance administration issues. Can you please provide more information on how I can use "merovingian" to START/STOP MonetDB instances? Is there online help for "merovingian" apart from what mentioned in the configuration file? Like "mserver5 --help" I was expecting "merovingian --help" but that doesn't work. Thanks, -Venks

4 5

[MonetDB-users] Running multiple instances on same machine
by Venks 21 Nov '07

21 Nov '07

Hi, Can you please tell me how to run three different MonetDB instances on one machine? I created three different binaries from the install and I tried to change the port from 50000 to 50001, 50002 and 50003. But for some reason I can only connect using 50000. Thanks, -Venks

3 3

[MonetDB-users] Bug 1833800 - python client not getting actual errors, only None
by m h 19 Nov '07

19 Nov '07

I've filed bug 1833800. It was reported in passing in a previous thread that the python client isn't getting the acutal errors. A fix for this wonderful! thanks much, matt

2 3

[MonetDB-users] python issues
by m h 17 Nov '07

17 Nov '07

Hello- The simple python example from the website is crashing [0]. I get the following output when I try to run it: matt@r52 ~/work/II/svn/trunk/2MonetDB $ python testmdb.py (981, 'schemas', 980, None, '0', True, '0', '0') *** glibc detected *** python: free(): invalid pointer: 0x080cf8d8 *** ======= Backtrace: ========= /lib/libc.so.6[0xb7cdea00] /lib/libc.so.6(cfree+0x89)[0xb7ce06f9] /usr/lib/libMapi.so.0(mapi_destroy+0x77)[0xb7b4a40f] /home/matt/work/vpython/lib/python2.4/site-packages/MonetDB/_MapiLib.so[0xb7fa25a5] /usr/lib/libpython2.4.so.1.0(PyCFunction_Call+0x10d)[0xb7eef420] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x3259)[0xb7f1c7b5] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0(PyDict_DelItem+0xc8)[0xb7eee29a] /usr/lib/libpython2.4.so.1.0[0xb7ed5755] /usr/lib/libpython2.4.so.1.0(PyObject_SetAttr+0xbc)[0xb7ef098b] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x23b5)[0xb7f1b911] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0[0xb7eec587] /usr/lib/libpython2.4.so.1.0(PyDict_SetItem+0xb0)[0xb7eee75d] /usr/lib/libpython2.4.so.1.0[0xb7ed579f] /usr/lib/libpython2.4.so.1.0(PyObject_SetAttr+0xbc)[0xb7ef098b] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x2372)[0xb7f1b8ce] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x3390)[0xb7f1c8ec] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0[0xb7eec587] /usr/lib/libpython2.4.so.1.0(PyDict_SetItem+0xb0)[0xb7eee75d] /usr/lib/libpython2.4.so.1.0(_PyModule_Clear+0x148)[0xb7eef9c3] /usr/lib/libpython2.4.so.1.0(PyImport_Cleanup+0x1ee)[0xb7f2fc18] /usr/lib/libpython2.4.so.1.0(Py_Finalize+0xf9)[0xb7f35261] /usr/lib/libpython2.4.so.1.0(Py_Main+0x9ad)[0xb7f3b1e9] python(main+0x1a)[0x804866e] /lib/libc.so.6(__libc_start_main+0xdc)[0xb7c8efdc] python[0x80485b1] ======= Memory map: ======== 08048000-08049000 r-xp 00000000 08:03 1772622 /home/matt/work/vpython/bin/python 08049000-0804a000 rw-p 00000000 08:03 1772622 /home/matt/work/vpython/bin/python 0804a000-080f5000 rw-p 0804a000 00:00 0 [heap] b7800000-b7821000 rw-p b7800000 00:00 0 b7821000-b7900000 ---p b7821000 00:00 0 b79e1000-b79e9000 r-xp 00000000 08:03 4735072 /lib/libnss_files-2.6.1.so b79e9000-b79ea000 r--p 00007000 08:03 4735072 /lib/libnss_files-2.6.1.so b79ea000-b79eb000 rw-p 00008000 08:03 4735072 /lib/libnss_files-2.6.1.so b79eb000-b79f6000 r-xp 00000000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f6000-b79f7000 r--p 0000a000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f7000-b79f8000 rw-p 0000b000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f8000-b7a06000 r-xp 00000000 08:03 2621464 /lib/libz.so.1.2.3 b7a06000-b7a07000 rw-p 0000d000 08:03 2621464 /lib/libz.so.1.2.3 b7a07000-b7a0d000 r-xp 00000000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0d000-b7a0e000 r--p 00005000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0e000-b7a0f000 rw-p 00006000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0f000-b7af6000 r-xp 00000000 08:03 3432882 /usr/lib/libcrypto.so.0.9.8 b7af6000-b7b0b000 rw-p 000e6000 08:03 3432882 /usr/lib/libcrypto.so.0.9.8 b7b0b000-b7b0e000 rw-p b7b0b000 00:00 0 b7b0e000-b7b3d000 r-xp 00000000 08:03 3432885 /usr/lib/libssl.so.0.9.8 b7b3d000-b7b41000 rw-p 0002e000 08:03 3432885 /usr/lib/libssl.so.0.9.8 b7b41000-b7b4c000 r-xp 00000000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b4c000-b7b4d000 r--p 0000a000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b4d000-b7b4e000 rw-p 0000b000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b73000-b7c79000 rw-p b7b73000 00:00 0 b7c79000-b7da3000 r-xp 00000000 08:03 4735105 /lib/libc-2.6.1.so b7da3000-b7da5000 r--p 0012a000 08:03 4735105 /lib/libc-2.6.1.so b7da5000-b7da6000 rw-p 0012c000 08:03 4735105 /lib/libc-2.6.1.so b7da6000-b7da9000 rw-p b7da6000 00:00 0 b7da9000-b7db2000 r-xp 00000000 08:03 1492902 /usr/lib/gcc/i686-pc-linux-gnu/4.1.2/libgcc_s.so.1 b7db2000-b7db3000 rw-p 00009000 08:03 1492902 /usr/lib/gcc/i686-pc-linux-gnu/4.1.2/libgcc_s.so.1 b7db3000-b7db4000 rw-p b7db3000 00:00 0 b7db4000-b7dd8000 r-xp 00000000 08:03 4735063 /lib/libm-2.6.1.so b7dd8000-b7dd9000 r--p 00023000 08:03 4735063 /lib/libm-2.6.1.so b7dd9000-b7dda000 rw-p 00024000 08:03 4735063 /lib/libm-2.6.1.so b7dda000-b7e85000 r-xp 00000000 08:03 1712627 /usr/lib/gcc-lib/i686-pc-linux-gnu/3.3.6/libstdc++.so.5.0.7 b7e85000-b7e8a000 rw-p 000aa000 08:03 1712627 /usr/lib/gcc-lib/i686-pc-linux-gnu/3.3.6/libstdc++.so.5.0.7 b7e8a000-b7e8f000 rw-p b7e8a000 00:00 0 b7e8f000-b7e91000 r-xp 00000000 08:03 4735083 /lib/libutil-2.6.1.so b7e91000-b7e92000 r--p 00001000 08:03 4735083 /lib/libutil-2.6.1.so b7e92000-b7e93000 rw-p 00002000 08:03 4735083 /lib/libutil-2.6.1.so b7e93000-b7e95000 r-xp 00000000 08:03 4735065 /lib/libdl-2.6.1.so b7e95000-b7e96000 r--p 00001000 08:03 4735065 /lib/libdl-2.6.1.so b7e96000-b7e97000 rw-p 00002000 08:03 4735065 /lib/libdl-2.6.1.so b7e97000-b7eaa000 r-xp 00000000 08:03 4735068 /lib/libpthread-2.6.1.so b7eaa000-b7eab000 r--p 00013000 08:03 4735068 /lib/libpthread-2.6.1.so b7eab000-b7eac000 rw-p 00014000 08:03 4735068 /lib/libpthread-2.6.1.so b7eac000-b7eae000 rw-p b7eac000 00:00 0 b7eae000-b7f62000 r-xp 00000000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f62000-b7f63000 r--p 000b3000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f63000-b7f85000 rw-p 000b4000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f85000-b7f8b000 rw-p b7f85000 00:00 0 b7f8b000-b7f8f000 r-xp 00000000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f8f000-b7f90000 r--p 00003000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f90000-b7f92000 rw-p 00004000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f92000-b7f94000 r-xp 00000000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f94000-b7f95000 r--p 00001000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f95000-b7f96000 rw-p 00002000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f96000-b7fab000 r-xp 00000000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fab000-b7fac000 r--p 00014000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fac000-b7fad000 rw-p 00015000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fad000-b7fae000 rw-p b7fad000 00:00 0 b7fb1000-b7fb2000 r-xp b7fb1000 00:00 0 [vdso] b7fb2000-b7fcc000 r-xp 00000000 08:03 4735086 /lib/ld-2.6.1.so b7fcc000-b7fcd000 r--p 00019000 08:03 4735086 /lib/ld-2.6.1.so b7fcd000-b7fce000 rw-p 0001a000 08:03 4735086 /lib/ld-2.6.1.so bff36000-bff58000 rw-p bff36000 00:00 0 [stack] Aborted matt@r52 ~/work/II/svn/trunk/2MonetDB $ I'm running the latest ebuild for gentoo. Any suggestions to remove crashing would be great. thanks much, matt 0 -http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/The-Python-Library.html#The-Python-Library

5 17

[MonetDB-users] (some) Numeric columns don't allow NULL?
by m h 16 Nov '07

16 Nov '07

Hello again, I've got a column declared as such: foo NUMERIC(9, 2), When I try and enter NULL values into it, it gives the following error: !SQLException:int:"" is no decimal value (doesn't contain a '.') Now, the message itself had me confused (still does actually), but I figured out by trial that it was complaining that I was shoving a NULL value in that column. Can someone explain why a NULL value can't go it here? (There is no "NOT NULL" on the column) Also columns defined as "NUMERIC(7,0)" allow NULL values..... Confused..... -matt

2 4

[MonetDB-users] Using DataSource class within MonetDB -- connection error -- cause? fix?
by jsolderitsch 16 Nov '07

16 Nov '07

I got lots of good help with my last query. I am trying to access a MonetDB through Sun's Glassfish app server. I am following an example that uses the Java Persistence API and Netbeans 6.0 beta 2 that has some interesting automation to generate code, in particular for configuration file generation that define the jndi context. But my example doesn't work. My code is based on a tutorial I found that uses Derby which is built into Glassfish. I see the errors: TopLink, version: Oracle TopLink Essentials - 2.0 (Build b58g-fcs (09/07/2007)) Server: unknown RAR5038:Unexpected exception while creating resource RAR5117 : Failed to obtain/create connection from connection pool [ jdbc_monetdb_localhost_demoPool ]. Reason : Connection could not be allocated because: Unable to connect (localhost:45123): Connection refused RAR5114 : Error allocating connection : [Error in allocating a connection. Cause: Connection could not be allocated because: Unable to connect (localhost:45123): Connection refused] Internal Exception: java.sql.SQLException: Error in allocating a connection. Cause: Connection could not be allocated because: Unable to connect (localhost:45123): Connection refused Error Code: 0 Local Exception Stack: Exception [TOPLINK-4002] (Oracle TopLink Essentials - 2.0 (Build b58g-fcs (09/07/2007))): oracle.toplink.essentials.exceptions.DatabaseException Internal Exception: java.sql.SQLException: Error in allocating a connection. Cause: Connection could not be allocated because: Unable to connect (localhost:45123): Connection refused I looked at the class MonetDataSource in the JDBC jar file and I see that the constructor for MonetDataSource uses 45123 for the field portNumber. But there is no apparent way to set the portNumber to something else. How do I get MonetDB to listen on this port? It seems that the default port is 50000. Is there a conf setting I can make to get this to work? What is the difference between portNumber here and port value as checked for in the Driver class? Any help appreciated. Jim -- View this message in context: http://www.nabble.com/Using-DataSource-class-within-MonetDB----connection-e… Sent from the monetdb-users mailing list archive at Nabble.com.

3 7

[MonetDB-users] how to select a column named "column"?
by m h 15 Nov '07

15 Nov '07

Hi all, I'm trying to reflect tables (to create a sqlalchemy backend for monetdb). I need to reflect the tables to do that and need primary keys. This information is stored in keycolumns, yet I can't seem to get the column out by itself. sql>select * from keycolumns; +------+--------+------+---+ |id |column |trunc |nr | +======+========+======+===+ |4394 |vendnum | 0 | 0 | |4393 |vendnum | 0 | 0 | +------+--------+------+---+ Timer 1.750 msec 2 rows sql>select column from keycolumns; !syntax error, unexpected COLUMN in: "select column" Timer 0.163 msec 0 rows sql>select keycolumns.column from keycolumns; !syntax error, unexpected COLUMN in: "select keycolumns.column" Advice??? thanks matt

4 3

[MonetDB-users] how compile PHP interface on Linux
by Martin Minka 15 Nov '07

15 Nov '07

I am running CentOS 4.5 (RHEL4.5). I compiled PHP 5.2.2 from source. I compiled "MonetDB server v5.2.0, based on kernel v1.20.0" from source with monetdb-install.sh . MonetDB server works for me. I downloaded clients-1.20.0.tar.gz, unpacked in /tmp and runned: ./configure --prefix=/mytest/MonetDB --with-php --with-php-config=/mytest/php/bin --with-php-extensiondir=/mytest/php/lib/php/extensions I see only warning, that Buildtools are not installed and that I will not able to build from CVS, that should be fine, I am not using source code from CVS (right?). I run make and it seams to me, that the process is only building only mapiclient and mapilib. Output of make does not mention any problems but there is also no mentioning of PHP in this output. The output files are here http://www.struix.com/phpmonetdb.zip. I wonder, if somebody could help me out. Sincerely, Martin

2 4

[MonetDB-users] Using JDBC for MonetDB across the network
by jsolderitsch 13 Nov '07

13 Nov '07

I successfully installed Monet on Mac OS X (Tiger) and it works as expected. I can use JDBC from Aqua Data Studio or even Netbeans 6.0 beta 2 to access databases I create but my experiments so far are when these clients and the Monet DB are on the same Mac OS X host. Now I want to install Monet on a linux box on my network and access the DB via JDBC from my Mac. I installed Monet on the linux box (Cent OS). But access via JDBC from the Mac does not seem to be working. I seem to connect from the Mac via Aqua Data Studio, but I do not see the demo database. Instead I see a <DEFAULT> database listed with no schemas. I created a new user and and a schema for that user on Linux using the command line client and that seemed to work. But after disconnecting and re-connecting, I still don't see the database. Could I be doing something wrong? Jim -- View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.h… Sent from the monetdb-users mailing list archive at Nabble.com.

3 24

[MonetDB-users] Compilation error in MonetDB4
by Ying Zhang 13 Nov '07

13 Nov '07

Hello, I get the following error when compiling the module MonetDB4: (dev branch, on andorea.ins.cwi.nl => fedora 6, MD Athlon(tm) 64 X2 Dual Core Processor 3800+) gcc -m64 -DHAVE_CONFIG_H -I. -I/ufs/zhang/monet/dev/MonetDB4/src/tools -I../.. -I/ufs/zhang/monet/dev/MonetDB4/src/tools -I../monet -I/ufs/zhang/monet/dev/MonetDB4/src/tools/../monet -I../modules/plain -I/ufs/zhang/monet/dev/MonetDB4/src/tools/../modules/plain -I/export/scratch1/zhang/monet/dev/G.64.64.d.debug/include/MonetDB -I/export/scratch1/zhang/monet/dev/G.64.64.d.debug/include/MonetDB/common -I/export/scratch1/zhang/monet/dev/G.64.64.d.debug/include/MonetDB/gdk -DLIBEMBEDDEDMIL -Wall -Wextra -std=c99 -g -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -D_REENTRANT -c embeddedclient.c -fPIC -DPIC -o .libs/libembeddedmil_la-embeddedclient.o In file included from /ufs/zhang/monet/dev/MonetDB4/src/tools/embeddedclient.mx:69: embeddedclient.h:29:26: error: mapilib/Mapi.h: No such file or directory In file included from /ufs/zhang/monet/dev/MonetDB4/src/tools/embeddedclient.mx:69: embeddedclient.h:31: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'embedded_mil' /ufs/zhang/monet/dev/MonetDB4/src/tools/embeddedclient.mx:183: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'embedded_mil' make[5]: *** [libembeddedmil_la-embeddedclient.lo] Error 1 make[5]: Leaving directory `/export/scratch1/zhang/mbuild/dev/MonetDB4/build-debug/src/tools' I think I have seen such error earlier, in de mailing-list or bug report, but I can't recall it. I believe both my source code and build env. are up-to-date and clean, but this error still looks as if I have some out-dated stuf. Does anybody have a clue about this? Thanks! Jennie

2 2

[MonetDB-users] R: Re: mclient fails to connect to local database server: "No route to host"
by marco.antonelli82＠fastwebnet.it 12 Nov '07

12 Nov '07

>Can you check the merovingian.log file to see if it actually sees a >client connecting, or maybe give another hint why things go wrong? > These lines appear in /usr/local/var/log/merovingian.log when I try to connect with mclient: MSG merovingian[8124]: database 'demo' already running since 2007-11-12 14:24: 35, up min/avg/max: 2/769/4851, crash average: 0.00 0.00 0.00 (10-9=0) MSG merovingian[8124]: redirecting client for database 'demo' to mapi:monetdb: //hp:50001/ The fact is that my host is reffered as "hp" (my machine name) and as "localhost". On my /etc/hosts file "hp" is an alias for 192.168.1.1 and not for 127.0.0.1, and beacuse of this mclient is blocked by my firewall. I changed my /etc/hosts file and now it works, but how to make MonetDB listen on "localhost" instead of "hp"? There is no option for that in /usr/local/etc/monetdb5.conf I find this error message as well when I start the "demo" db: ERR demo[8181]: #warning: please don't forget to set your vault key! ERR demo[8181]: #(see /usr/local/etc/monetdb5.conf) What is this about? Thanks for help Fabian!

2 1

[MonetDB-users] mclient fails to connect to local database server: "No route to host"
by marco.antonelli82＠fastwebnet.it 12 Nov '07

12 Nov '07

Hello everyone, I successfully managed to install MonetDB components(MonetDB-common, MonetDB clients, MonetDB5-server, MonetDB_SQL) on Linux, but I have some problems in running it. These are the steps that I followed from the online documentation: I started merovingian with: sudo merovingian then I created the "demo" database and started it with: sudo monetdb create demo sudo monetdb start demo I checked the status: sudo monetdb status demo name state uptime crashes demo running 29m 6s 0 (if I run this command without 'sudo' i get: monetdb status demo warning: MonetDB Database Server is not running name state uptime crashes demo stopped 1 2007-11-12 12:33:41 Is that normal?) So everything seems fine, but when I run mclient (both as root and normal user) I got an error: mclient -lsql --database=demo !ERROR mapi_reconnect: connect: No route to host Setup connection failed I even tried to add a kernel route with: sudo route add -host localhost lo but it did not help. Does somebody know what is the problem and how to solve it? Best regards, Marco Antonelli

2 1

[MonetDB-users] XQuery: Schema import, Indexing
by Silvio Kohler 09 Nov '07

09 Nov '07

Hi, we're trying to benchmark different XML-DBs, one of them is MonetDB/Xquery. Two questions came up: 1) How is schema import done in MonetDB/XQuery? Does it affect execution time for queries? We imported it in the XML file and also in the query, but did not have any effect on execution time. Also, a lot of schema items such as <xs:enumeration> or <xs:dateTime> seem not to be supported. 2) Is indexing possible? Regards, Silvio

4 4

[MonetDB-users] Is there a blocking connect to server
by Pranav Vaidya 08 Nov '07

08 Nov '07

Hello, Is there a client API in Monet which implements a blocking connect to the Mserver (possibly with a time out). My understanding of mapi_connect is that it is a non-blocking connect. I would appreciate it if someone could kindly direct me in this regard. My thanks in advance. Pranav. -- View this message in context: http://www.nabble.com/Is-there-a-blocking-connect-to-server-tf4768425.html#… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] XQuery: Schema import, Indexing
by Silvio Kohler 06 Nov '07

06 Nov '07

Hi, we're trying to benchmark different XML-DBs, one of them is MonetDB/Xquery. Two questions came up: 1) How is schema import done in MonetDB/XQuery? Does it affect execution time for queries? We imported it in the XML file and also in the query, but did not have any effect on execution time. Also, a lot of schema items such as <xs:enumeration> or <xs:dateTime> seem not to be supported. 2) Is indexing possible? Regards, Silvio

1 0

[MonetDB-users] "merovingian" usage
by Venks 31 Oct '07

31 Oct '07

Recent installation of MonetDB showed the following text at the end of the installation. ==================================== You can start using MonetDB/SQL by starting /root/countdb/bin/merovingian in the background. Read the merovingian(1), monetdb(1) and mclient(1) manpages to learn how to create a database and afterwards connect to it. ==================================== Is "merovingian" ready for usage? When I type "merovingian" I am getting the following error: =============================================================================== unable to create .merovingian_lock file in /root/countdb/var/MonetDB5/dbfarm: No such file or directory =============================================================================== That's because there is no MonetDB5 directory yet. This may be of importance to us as I need to do the following: - Run MonetDB in background - Create the database directory, LOG, CheckPoint and any other files related to any database in a user specified directory. Right now I am using mserver5 executable in a script to start MonetDB in the background. This script was provided by you (Fabian) Please let me know if I need to start using "merovingian" for my needs. Thanks, -Venks

6 14

[MonetDB-users] On Java/JDBC compatibility
by Sander Kruseman 31 Oct '07

31 Oct '07

I thought this might be of interest to some of you. New Java releases are normally upwards binary-compatible with prior releases with only few minor/niche exceptions. This implies that one should normally be able to use recent JVM versions to run MonetDB's (JDBC) class/jar files, even if these were compiled with an older JDK version. See: http://java.sun.com/j2se/1.5.0/compatibility.html and: http://java.sun.com/javase/6/webnotes/compatibility.html#binary Note that the opposite does not hold: class/jar files cannot be run with a JVM older than that from the JDK used to compile them. (Every newer JDK marks its generated class files with a different class file version number, which is checked by the JVM.) I hope this helps. Sander Kruseman

1 0

[MonetDB-users] SQL DELETE bug?
by Sander Kruseman 30 Oct '07

30 Oct '07

Hi, Using server v5.0.0 on Windows with the JDBC terminal v1.18.0, SQL DELETE statements appear to fail. Working in autocommit mode, I issue the following commands: create table test (id int unique not null, name varchar(10) not null); insert into test (id, name) values (1, 'jan'); delete from test where id = 1; select * from test; I get no rows, as was to be expected. However, using DbVisualizer (also using JDBC) I can still see the one inserted table row (after Reload View). After restarting both server and JDBC terminal, I also get the row when using the JDBC terminal. Bug or ignorance? Note that I am using my own schema having been setup with its own user, similar to the VOC tutorial. kind regards, Sander Kruseman

2 2

[MonetDB-users] Large Databases
by algatt 29 Oct '07

29 Oct '07

I am trying to create a large database almost 10GB (TPC-H). When I try to bulk load a 7GB file the server does not work anymore. First, the server quits in the middle of the bulk load, then when I try to re-start the server it does not start showing a message about the OS not having enough space. Then I split the 7GB file into individuals 1GB files, after I upload around 4GB individually, the server crashes. Then when I re-start the server it does not start stating that the BACKUP folder cannot be accessed and not enough permissions! I am using MonetDB 5 on Windows XP 1GB RAM. Any ideas? Thank You. alan -- View this message in context: http://www.nabble.com/Large-Databases-tf4710020.html#a13462531 Sent from the monetdb-users mailing list archive at Nabble.com.

3 3