- users-list - monetdb.org

[MonetDB-users] SyntaxException in "monetdb create demo" statement
by rmaadil 03 Sep '08

03 Sep '08

I have installed MnetDB by downloading the file "MonetDB-ODBC-Installer-i386-20080812.msi". Then I opened MonetDB SQL Server. The last message that I got on the command prompt was "MonetDB/SQL module v2.24.0 loaded". Then I tried the statement "monetdb create demo", but I got the following error SyntaxException:parseError:monetdb create demo SyntaxException:parseError ^';' expected Can anybody tell me that where I was going wrong. -- View this message in context: http://www.nabble.com/SyntaxException-in-%22monetdb-create-demo%22-statemen… Sent from the monetdb-users mailing list archive at Nabble.com.

2 5

[MonetDB-users] ERROR 404 /~monet/tars/latest/stable/MonetDB.tar.gz.md5sum
by McKennirey.Matthew 03 Sep '08

03 Sep '08

2 1

Re: [MonetDB-users] [ADT] bug report?
by Stefan Manegold 02 Sep '08

02 Sep '08

On Mon, Sep 01, 2008 at 11:22:10PM +0200, Ying Zhang wrote: > Hi, > > I have just updated my monet source from souceforge and did a from > scratch compilation on my leopard. > > Fabian's fix gets rid of the error "implicit declaration of..." (thanks!) > However, the other error "ISO C90 forbids.." is still there. With the > following patch, I was able to compile the module MonetDB (a complete > rebuild of monet modules is still ongoing). > > I simply moved the definition of len to the begin of the function: > > $ cvs diff src/gdk/gdk_system.mx > Index: src/gdk/gdk_system.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_system.mx,v > retrieving revision 1.115 > diff -r1.115 gdk_system.mx > 570a571,574 > > #if defined(__FreeBSD__) || defined(__NetBSD__) || > defined(__OpenBSD__) || defined(__MACH__) > > size_t len = sizeof(int); > > #endif > > > 578d581 > < size_t len = sizeof(int); Thanks. I just checked in (my version of ;-)) your patch. Stefan > Jennie > > > On Sep 01, 2008, at 22:35 , Hendrike Peetz wrote: > >> nope. still the same problem. I checked out from the svn right after I >> got your mail. >> >> On Sep 1, 2008, at 10:13 PM, Fabian Groffen (Project Account) wrote: >> >>> I tried to fix the issue. Please report if it works. >>> >>> On 01-09-2008 22:01:01 +0200, Fabian Groffen (Project Account) wrote: >>>> On 01-09-2008 21:57:13 +0200, Fabian Groffen wrote: >>>>>>> cc1: warnings being treated as errors >>>>>>> ../../../MonetDB/src/gdk/gdk_system.mx: In function >>>>>>> 'MT_check_nr_cores': >>>>>>> ../../../MonetDB/src/gdk/gdk_system.mx:575: warning: ISO C90 >>>>>>> forbids mixed declarations and code >>>>>>> ../../../MonetDB/src/gdk/gdk_system.mx:576: error: implicit >>>>>>> declaration of function 'sysctlbyname' >>>>> >>>>> No. The MonetDB sources aren't tested on Leopard on a daily >>>>> basis, and >>>>> this change/code in particular isn't at all. I tried it on >>>>> Tiger, but >>>>> didn't care to check on Leopard. >>>> >>>> Actually, the actual code was never tested, as it's just missing an >>>> include ;) >> > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[MonetDB-users] PF: (new) compilation problem on Mac OS 10.5
by Ying Zhang 02 Sep '08

02 Sep '08

Hello, On Mac OS 10.5, source code just checked out from sourceforge. rebuild (debootstrap, boostrap, configure, make, make install) monet and its modules ends with some errors in pathfinder: Putting files in AC_CONFIG_AUX_DIR, `conf'. /opt/local/share/aclocal/audiofile.m4:12: warning: underquoted definition of AM_PATH_AUDIOFILE /opt/local/share/aclocal/audiofile.m4:12: run info '(automake)Extending aclocal' /opt/local/share/aclocal/audiofile.m4:12: or see http://sources.redhat.com/automake/automake.html#Extending-aclocal configure.in:85: warning: macro `AM_MONETDB_JAVA' not found in library patching file aclocal.m4 Hunk #1 succeeded at 428 (offset -5958 lines). configure.in:183: installing `conf/compile' configure.in:37: installing `conf/install-sh' configure.in:37: installing `conf/missing' configure.in:85: error: possibly undefined macro: AM_MONETDB_JAVA If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. This problem does not occur on my cwi desktop. Does anyone have an idea? Thanks! Jennie

2 3

Re: [MonetDB-users] [ADT] bug report?
by Stefan Manegold 01 Sep '08

01 Sep '08

On Mon, Sep 01, 2008 at 10:08:09PM +0200, Hendrike Peetz wrote: > Ok, I assume I should have set compiler options to --disable-strict. well, for us, it should also work with --enable-strict (default in CVS version as that is meant for developers --- and as a reminder to us to produce clean code ... ;-)) --- but for "users", --disable-strict (default in tarballs) is indeed just fine. > But now I can still not check, because it says: > > $ make check > make check-recursive > Making check in src > make check-recursive > Making check in common > make check-am > make[5]: Nothing to be done for `check-am'. > Making check in gdk > make check-am > make[5]: Nothing to be done for `check-am'. > Making check in testing > make check-am > rm -f Mapprove.py > ln -s Mtest.py Mapprove.py > make[4]: Nothing to be done for `check-am'. > Making check in conf > make check-am > make[3]: Nothing to be done for `check-am'. for which part did you call `make check`? for "MonetDB" (Common) there are indeed not tests; neither for (MonetDB/)"java"; only for clients, MonetDB4, MonetDB5, sql, geom, pathfinder, template there are tests and `make check` should work --- be aware though, that some tests are known to fail on some platforms ... > Sorry for bothering you, but we were two people (who do know the basics > of working with unix) trying to get this running today and couldn't make > it work. No problem --- in fact, `make check` is not "mendatory" for getting it to work --- just `make && make install` (or use monetdb-install.sh) and then try to run `Mserver` (MonetDB4) or `mserver5` (MonetDB5) as a very basic "sanitycheck". Stefan > Hendrike > > > Begin forwarded message: > >> From: Hendrike Peetz <hendrike(a)peetz-intelligence.com> >> Date: September 1, 2008 9:27:37 PM GMT+02:00 >> To: Monet(a)cwi.nl >> Subject: [ADT] bug report? >> >> Dear people in charge, >> >> I have been spending a lot of time today trying to install Monet on >> Leopard 10.5.4, 64 bit, core 2 duo. >> >> Before I did anything with the cvs, I tried to work with the Super >> tarball version. Compiling was not a problem but the tests were not >> installed and I was not too sure wether everything is working. I thus >> wanted to install it properly: >> >> I checked out the latest version (friday I assume) from the cvs. >> bootstrap and configure worked fine, but I had problems with the >> compiling. >> >> I tried gcc4.1 (apple) and gcc4.2 (apple) (Yes, I recompiled my c- >> compiler!). Both of them returned the attached error. >> I am not sure wether this is my mistake or some weird code, but as I >> was able to compile the tarball version I assume its something in the >> code. >> >> Best regards, >> >> Hendrike >> >> >> >> >> >> > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [MonetDB-users] [ADT] bug report?
by Stefan Manegold 01 Sep '08

01 Sep '08

Dear Hendrike, thank you very much for your detailed report. I suppose you sucessfully compiled the latest released "Stable" "Aug2008" version of the Super tarball, right? Then, indeed the compilation problems seem to be triggered by the (our) code in the latest "cutting-edge" "Current" development version from the CVS heads. Although we do quite some testing (cf. http://monetdb.cwi.nl/Development/TestWeb/) we do not (yet?) have a "Leopard" machine in our testing pool (we actually also lost access to the "Tiger" machine we used to have...). We will look into the problem ASAP and try to fix it. Could you please also file your problem as bug report in the MonetDB bug tracker at SF: http://sourceforge.net/tracker/?atid=482468&group_id=56967&func=browse ? For the time being you might want to try the latest "Stable" version from the CVS branches as listed at http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Version4.24/ind… . What puzzles me, though, is your initial point that no tests were included in the tests were not included in the Super tarball. They should actaully be in there. I'll check again ... Stefan On Mon, Sep 01, 2008 at 09:27:37PM +0200, Hendrike Peetz wrote: > Dear people in charge, > > I have been spending a lot of time today trying to install Monet on > Leopard 10.5.4, 64 bit, core 2 duo. > > Before I did anything with the cvs, I tried to work with the Super > tarball version. Compiling was not a problem but the tests were not > installed and I was not too sure wether everything is working. I thus > wanted to install it properly: > > I checked out the latest version (friday I assume) from the cvs. > bootstrap and configure worked fine, but I had problems with the > compiling. > > I tried gcc4.1 (apple) and gcc4.2 (apple) (Yes, I recompiled my c- > compiler!). Both of them returned the attached error. > I am not sure wether this is my mistake or some weird code, but as I was > able to compile the tarball version I assume its something in the code. > > Best regards, > > Hendrike > > > $ make > make all-recursive > Making all in src > make all-recursive > Making all in common > make all-am > make[5]: Nothing to be done for `all-am'. > Making all in gdk > make all-am > /bin/sh ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -I../../../MonetDB/src/gdk -I../../../MonetDB/src/gdk -I../common -I../../../MonetDB/src/gdk/../common -DLIBGDK -Wall -Wextra -std=c99 -g -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -Wno-uninitialized -D_REENTRANT -c -o libbat_la-gdk_system.lo `test -f 'gdk_system.c' || echo '../../../MonetDB/src/gdk/'`gdk_system.c > gcc -DHAVE_CONFIG_H -I. -I../.. -I../../../MonetDB/src/gdk -I../../../MonetDB/src/gdk -I../common -I../../../MonetDB/src/gdk/../common -DLIBGDK -Wall -Wextra -std=c99 -g -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -Wno-uninitialized -D_REENTRANT -c gdk_system.c -fno-common -DPIC -o .libs/libbat_la-gdk_system.o > cc1: warnings being treated as errors > ../../../MonetDB/src/gdk/gdk_system.mx: In function 'MT_check_nr_cores': > ../../../MonetDB/src/gdk/gdk_system.mx:575: warning: ISO C90 forbids mixed declarations and code > ../../../MonetDB/src/gdk/gdk_system.mx:576: error: implicit declaration of function 'sysctlbyname' > make[5]: *** [libbat_la-gdk_system.lo] Error 1 > make[4]: *** [all] Error 2 > make[3]: *** [all-recursive] Error 1 > make[2]: *** [all] Error 2 > make[1]: *** [all-recursive] Error 1 > make: *** [all] Error 2 > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

4 4

[MonetDB-users] batcalc.ifThenElse:requires bats of identical size
by Rick Spickelmier 28 Aug '08

28 Aug '08

Hi! I am running into this error: batcalc.ifThenElse:requires bats of identical size My server (running on Windows XP 64): # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-win32/64bit with 32bit OIDs dynamically linked The following recreates the problem: CREATE TABLE test1 (col1 INTEGER); INSERT INTO test1 VALUES (null); INSERT INTO test1 VALUES (null); SELECT CASE WHEN col1=1 THEN 'ONE' END AS "pc1" FROM test1 GROUP BY "pc1"; Any ideas? Obviously the above isn't too interesting, but it a simplified test case from a more complex query on a much larger dataset. Seems to be related to GROUP BY on a CASE... Thanks! Rick +----------------------------------------------------------------------- ------+ | mal | +======================================================================= ======+ | function user.s0_3():void; | | _1:bat[:oid,:int]{rows=1:lng} := sql.bind("voc","test2","col1",0); | | _6:bat[:oid,:int]{rows=1:lng} := sql.bind("voc","test2","col1",1); | | _8{rows=2:lng} := algebra.kunion(_1,_6); | | _1:bat[:oid,:int]{rows=1:lng} := nil; | | _6:bat[:oid,:int]{rows=1:lng} := nil; | | _9:bat[:oid,:int]{rows=1:lng} := sql.bind("voc","test2","col1",2); | | _11{rows=2:lng} := algebra.kdifference(_8,_9); | | _8{rows=2:lng} := nil; | | _12{rows=3:lng} := algebra.kunion(_11,_9); | | _11{rows=2:lng} := nil; | | _9:bat[:oid,:int]{rows=1:lng} := nil; | | _13:bat[:oid,:oid]{rows=1:lng} := sql.bind_dbat("voc","test2",1); | | _14{rows=1:lng} := bat.reverse(_13); | | _13:bat[:oid,:oid]{rows=1:lng} := nil; | | _15{rows=3:lng} := algebra.kdifference(_12,_14); | | _14{rows=1:lng} := nil; | | _17{rows=3:lng,tlb>=0@0:oid,tub<1@0:oid} := algebra.markT(_15,0@0); | | _15{rows=3:lng} := nil; | | _18{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := bat.reverse(_17); | | _17{rows=3:lng,tlb>=0@0:oid,tub<1@0:oid} := nil; | | _19{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := algebra.join(_18,_12); | | _12{rows=3:lng} := nil; | | _20:bat[:oid,:bit]{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := | : batcalc.==(_19,1); | | _23{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := algebra.project(_18,nil:str); | | _24:bat[:oid,:str]{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := | : batcalc.ifthenelse(_20,"ONE",_23); | | _20:bat[:oid,:bit]{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _23{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | (ext36,grp34):= group.new(_24); | | _24:bat[:oid,:str]{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _27 := bat.mirror(ext36); | | ext36 := nil; | | _28 := algebra.join(_27,_19); | | _27 := nil; | | _19{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _29:bat[:oid,:bit] := batcalc.==(_28,1); | | _28 := nil; | | _30{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := algebra.project(_18,nil:str); | | _18{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _31:bat[:oid,:str] := batcalc.ifthenelse(_29,"ONE",_30); | | _29:bat[:oid,:bit] := nil; | | _30{rows=3:lng,hlb>=0@0:oid,hub<1@0:oid} := nil; | | _32 := sql.resultSet(1,1,_31); | | sql.rsColumn(_32,"voc.","pc1","char",0,0,_31); | | _31:bat[:oid,:str] := nil; | | _37 := io.stdout(); | | sql.exportResult(_37,_32,""); | | end s0_3; | +----------------------------------------------------------------------- ------+ Rick Spickelmier | CTO | Success Metrics, Inc. | w (415) 738-2078 | ricks(a)successmetricsinc.com

3 3

[MonetDB-users] upgrading ...
by ewilde 24 Aug '08

24 Aug '08

hi, i have updated my monet installtion from "june 2008" to "current" on Aug 19, using YAM on fedora 9. i tried to run monet-server: mserver5 --dbinit="include sql;" --set gdk_vm_minsize=1000000000000 and i have got: # MonetDB server v5.7.0, based on kernel v1.25.0 # Serving database 'demo', using 2 threads # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ #WARNING: LoaderException:loadLibrary:sql: loader error lib_logger.so.0: cannot open shared object file: No such file or directory !MALException:MAL.getAddress:address of 'sql.SQLsession' not found !MALException:MAL.getAddress:address of 'sql.SQLsession2' not found !MALException:MAL.getAddress:address of 'sql.SQLinitEnvironment' not found !MALException:MAL.getAddress:address of 'sql.SQLcommit' not found !MALException:MAL.getAddress:address of 'sql.SQLrollback' not found !MALException:MAL.getAddress:address of 'sql.SQLstatement' not found !MALException:MAL.getAddress:address of 'sql.SQLstatementOut' not found !MALException:MAL.getAddress:address of 'sql.SQLassert' not found !MALException:MAL.getAddress:address of 'sql.SQLassertInt' not found !MALException:MAL.getAddress:address of 'sql.SQLassertLng' not found !MALException:MAL.getAddress:address of 'sql.setVariable' not found !MALException:MAL.getAddress:address of 'sql.getVariable' not found !MALException:MAL.getAddress:address of 'sql.mvc_logfile' not found !MALException:MAL.getAddress:address of 'sql.mvc_next_value' not found !MALException:MAL.getAddress:address of 'batsql.mvc_bat_next_value' not found !MALException:MAL.getAddress:address of 'sql.mvc_get_value' not found !MALException:MAL.getAddress:address of 'sql.mvc_restart_seq' not found !MALException:MAL.getAddress:address of 'sql.mvc_bind_dbat_wrap' not found !MALException:MAL.getAddress:address of 'sql.mvc_bind_idxbat_wrap' not found !MALException:MAL.getAddress:address of 'sql.mvc_bind_wrap' not found . . .[lines were removed because the message would not been sent otherwise] . . !MALException:MAL.getAddress:address of 'mat.mat_bind_idxbat_wrap' not found !MALException:MAL.getAddress:address of 'mat.inc_parts_wrap' not found !MALException:MAL.getAddress:address of 'mat.send_part_wrap' not found !MALException:MAL.getAddress:address of 'mat.get_part_wrap' not found !MALException:MAL.getAddress:address of 'mat.print_part_wrap' not found !MALException:MAL.getAddress:address of 'constraints.Cparts' not found !TypeException:user.main[1]:'sql.prelude' undefined in: _1:void := sql.prelude() > this file lib_logger.so.0 (which is actually a link to lib_logger.so.0.0.0) exists in: /usr/lib64/MonetDB5/lib thanks in advanced for any help, ewilde.

3 2

[MonetDB-users] test 2
by ewilde 24 Aug '08

24 Aug '08

1 0

[MonetDB-users] C# odbc connection
by Aviad Harell 21 Aug '08

21 Aug '08

Hi there, I'm playing here with MonetDB. I've downloaded the monetDb sql DB and the odbc driver. With the console I succeeded to connect and query the voc sample db, which is great. I also succeeded to import data to excel from the MonetDb via odbc as shown on the website. Now, I want to connect to the monetDB via C# and odbc driver. How can I do that? Thanks, Aviad

2 1

[MonetDB-users] C# odbc connection
by Aviad Harell 21 Aug '08

21 Aug '08

Hi there, I'm playing here with MonetDB. I've downloaded the monetDb sql DB and the odbc driver. With the console I succeeded to connect and query the voc sample db, which is great. I also succeeded to import data to excel from the MonetDb via odbc as shown on the website. Now, I want to connect to the monetDB via C# and odbc driver. How can I do that? Thanks, Aviad

1 0

[MonetDB-users] C# odbc connection
by Aviad 20 Aug '08

20 Aug '08

Hi there, I'm playing here with MonetDB. I’ve downloaded the monetDb sql DB and the odbc driver. With the console I succeeded to connect and query the voc sample db, which is great. I also succeeded to import data to excel from the MonetDb via odbc as shown on the website. Now, I want to connect to the monetDB via C# and odbc driver. How can I do that? Thanks, Aviad -- View this message in context: http://www.nabble.com/C--odbc-connection-tp19073114p19073114.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

Re: [MonetDB-users] Order of WHERE clause has significant performance impact
by Ross Bates 15 Aug '08

15 Aug '08

On Tue, Aug 12, 2008 at 08:31:22PM -0500, Ross Bates wrote: > Hi All - I have 2 queries which run very different based on how I > order the WHERE clause. > > When I put the larger filter first, it runs for 3.5 seconds. > > Query 1: > > select c5, c6, sum(sale) from sobi.sample > where > c5 in (5253,5110,5375,5268,5257,5266,5243,5256,5252,5361,5379,5363,5386,5367,5240,5241,5261,5249,5245,5260,5247,5264,5354,5250,5373,5366,5246,5356,5365,5255,5262,5259,5251,5369,5357,5269,5364,5380,5244,5248,5242,5254,5358,5360,5263,5362,5374,5378,5370,5294,5339,5272,5277,5275,5295,5340,5273,5276,5270,5061,5081,5079,5080,5066,5056,5073,5060,5070,5099,5101,5100,5067,5063,5077,5072,5062,5075,5083,5086,5071,5095,5058,5087,5090,5102,5084,5098,5076,5059,5074,5094,5091,5065,5069,5068,5104,5109,5107,5108,5013,5019,5022,5010,5009,5023,5011,5024,5012,5021,5007,5008,5025,5020,5055,5006,5036,5038,5054,5032,5033,5031,5039,5035,5026,5027,5030,5200,5043,5005,5041,5049,5042,5052,5040,5053,5045,5047,5048,5050,5051,5044,5046) > and c6 in (5182) > group by c5, c6; > > > When I reverse the order of the WHERE clause, it runs in about .4 seconds. > > > Query 2: > > c5, c6, sum(sale) from sobi.sample > where > c6 in (5182) > and > c5 in (5253,5110,5375,5268,5257,5266,5243,5256,5252,5361,5379,5363,5386,5367,5240,5241,5261,5249,5245,5260,5247,5264,5354,5250,5373,5366,5246,5356,5365,5255,5262,5259,5251,5369,5357,5269,5364,5380,5244,5248,5242,5254,5358,5360,5263,5362,5374,5378,5370,5294,5339,5272,5277,5275,5295,5340,5273,5276,5270,5061,5081,5079,5080,5066,5056,5073,5060,5070,5099,5101,5100,5067,5063,5077,5072,5062,5075,5083,5086,5071,5095,5058,5087,5090,5102,5084,5098,5076,5059,5074,5094,5091,5065,5069,5068,5104,5109,5107,5108,5013,5019,5022,5010,5009,5023,5011,5024,5012,5021,5007,5008,5025,5020,5055,5006,5036,5038,5054,5032,5033,5031,5039,5035,5026,5027,5030,5200,5043,5005,5041,5049,5042,5052,5040,5053,5045,5047,5048,5050,5051,5044,5046) > group by c5, c6; > > This in on MonetDB server v5.6.0, based on kernel v1.24.0 which I > built from the super tarball. > > I can attach the entire trace files for each query if appropriate for the list. > > While I am still learning to read the trace, it looks like most of the > time spent in the first query on a series of algebra.semijoin > operations. Here are the excerpted lines: > > Query 1: > > [2320345 usec # _461 := > algebra.semijoin(_167=<~tmp_2116>bat[:str,:oid]{8280020}, > _460=<~tmp_2016>bat[:str,:oid]{142}) ] > [776017 usec # _463 := > algebra.semijoin(_158=<tmp_2130>bat[:oid,:str]{8280020}, > _462=<~tmp_1572>bat[:oid,:str]{5135708}) ] > [253551 usec # _470 := > algebra.semijoin(_464=<~tmp_2116>bat[:str,:oid]{5135708}, > _469=<~tmp_2016>bat[:str,:oid]{1}) ] > > > Query 2: > > [412122 usec # _179 := > algebra.semijoin(_167=<~tmp_2076>bat[:str,:oid]{8280020}, > _178=<~tmp_2016>bat[:str,:oid]{1}) ] > [ 194 usec # _181 := > algebra.semijoin(_158=<tmp_2070>bat[:oid,:str]{8280020}, > _180=<~tmp_1572>bat[:oid,:str]{304}) ] > [ 0 usec # _470 := > algebra.semijoin(_182=<~tmp_2076>bat[:str,:oid]{304}, > _469=<~tmp_2016>bat[:str,:oid]{142}) ] > > > Any assistance would be greatly appreciated. Indeed the optimizer isn't smart enough to use the correct (most selective) in first. Could you send the create statement for the sobi.sample table? If possible could you try this on the 'current' and with mclient -lsql -G. That last -G enables the new implementation which first translates sql into a relational algebra and then in binary algebra. Niels > > -Ross Niels - thanks for the response. I tried using the -G switch and the performance time was the same for both versions of the query. The table is pretty simple (see below). I've tried the query against the table using both int and varchar for the columns being used in the WHERE clause. When c6 and C7 are declared as ints the queries run faster, but the order of the WHERE clause still creates a difference. 3.3 vs .4 when varchar 1.9 vs .2 when int CREATE TABLE "sobi"."sample" ( c1 char(1), c2 varchar(24), c3 varchar(12), c4 varchar(12), c5 varchar(12), c6 int, c7 int, c8 varchar(12), c9 varchar(12), sale int ) CREATE TABLE "sobi"."sample" ( c1 char(1), c2 varchar(24), c3 varchar(12), c4 varchar(12), c5 varchar(12), c6 varchar(12), c7 varchar(12), c8 varchar(12), c9 varchar(12), sale int ) Would it introduce any issues or risks to have the optimizer reorder the execution of each WHERE clause based on the number of predicates specified? I am still learning about the optimizer, but would changing any steps in the default SQL optimization sequence help in this situation? Thanks again, Ross

4 9

[MonetDB-users] Newbie question about XML / SQL capabilities
by Bill Walton 14 Aug '08

14 Aug '08

Greetings all, I just became aware of MonetDB via a post to the Ruby on Rails list about a new connection adapter for MonetDB (thanks Michalis). I'm intrigued by what looks like a very impressive capability. If I'm reading the site right, MonetDB can import an XML file using the XQuery client and then query that same data using the SQL client. Is that a correct reading? TIA, Bill

2 1

[MonetDB-users] Order of WHERE clause has significant performance impact
by Ross Bates 13 Aug '08

13 Aug '08

Hi All - I have 2 queries which run very different based on how I order the WHERE clause. When I put the larger filter first, it runs for 3.5 seconds. Query 1: select c5, c6, sum(sale) from sobi.sample where c5 in (5253,5110,5375,5268,5257,5266,5243,5256,5252,5361,5379,5363,5386,5367,5240,5241,5261,5249,5245,5260,5247,5264,5354,5250,5373,5366,5246,5356,5365,5255,5262,5259,5251,5369,5357,5269,5364,5380,5244,5248,5242,5254,5358,5360,5263,5362,5374,5378,5370,5294,5339,5272,5277,5275,5295,5340,5273,5276,5270,5061,5081,5079,5080,5066,5056,5073,5060,5070,5099,5101,5100,5067,5063,5077,5072,5062,5075,5083,5086,5071,5095,5058,5087,5090,5102,5084,5098,5076,5059,5074,5094,5091,5065,5069,5068,5104,5109,5107,5108,5013,5019,5022,5010,5009,5023,5011,5024,5012,5021,5007,5008,5025,5020,5055,5006,5036,5038,5054,5032,5033,5031,5039,5035,5026,5027,5030,5200,5043,5005,5041,5049,5042,5052,5040,5053,5045,5047,5048,5050,5051,5044,5046) and c6 in (5182) group by c5, c6; When I reverse the order of the WHERE clause, it runs in about .4 seconds. Query 2: c5, c6, sum(sale) from sobi.sample where c6 in (5182) and c5 in (5253,5110,5375,5268,5257,5266,5243,5256,5252,5361,5379,5363,5386,5367,5240,5241,5261,5249,5245,5260,5247,5264,5354,5250,5373,5366,5246,5356,5365,5255,5262,5259,5251,5369,5357,5269,5364,5380,5244,5248,5242,5254,5358,5360,5263,5362,5374,5378,5370,5294,5339,5272,5277,5275,5295,5340,5273,5276,5270,5061,5081,5079,5080,5066,5056,5073,5060,5070,5099,5101,5100,5067,5063,5077,5072,5062,5075,5083,5086,5071,5095,5058,5087,5090,5102,5084,5098,5076,5059,5074,5094,5091,5065,5069,5068,5104,5109,5107,5108,5013,5019,5022,5010,5009,5023,5011,5024,5012,5021,5007,5008,5025,5020,5055,5006,5036,5038,5054,5032,5033,5031,5039,5035,5026,5027,5030,5200,5043,5005,5041,5049,5042,5052,5040,5053,5045,5047,5048,5050,5051,5044,5046) group by c5, c6; This in on MonetDB server v5.6.0, based on kernel v1.24.0 which I built from the super tarball. I can attach the entire trace files for each query if appropriate for the list. While I am still learning to read the trace, it looks like most of the time spent in the first query on a series of algebra.semijoin operations. Here are the excerpted lines: Query 1: [2320345 usec # _461 := algebra.semijoin(_167=<~tmp_2116>bat[:str,:oid]{8280020}, _460=<~tmp_2016>bat[:str,:oid]{142}) ] [776017 usec # _463 := algebra.semijoin(_158=<tmp_2130>bat[:oid,:str]{8280020}, _462=<~tmp_1572>bat[:oid,:str]{5135708}) ] [253551 usec # _470 := algebra.semijoin(_464=<~tmp_2116>bat[:str,:oid]{5135708}, _469=<~tmp_2016>bat[:str,:oid]{1}) ] Query 2: [412122 usec # _179 := algebra.semijoin(_167=<~tmp_2076>bat[:str,:oid]{8280020}, _178=<~tmp_2016>bat[:str,:oid]{1}) ] [ 194 usec # _181 := algebra.semijoin(_158=<tmp_2070>bat[:oid,:str]{8280020}, _180=<~tmp_1572>bat[:oid,:str]{304}) ] [ 0 usec # _470 := algebra.semijoin(_182=<~tmp_2076>bat[:str,:oid]{304}, _469=<~tmp_2016>bat[:str,:oid]{142}) ] Any assistance would be greatly appreciated. -Ross

2 1

[MonetDB-users] Announcement: new minor release of MonetDB Clients package
by Sjoerd Mullender 12 Aug '08

12 Aug '08

The MonetDB team at CWI is pleased to announve a bug fix release for the MonetDB Clients package. A number of bugs in the ODBC driver have been fixed: - fixes for the handling of UTF-8 encoded queries and query parameters; - fixes for dealing with wide characters. There is also a fix for mclient: - the timer (-t/--time option) could overflow. There are new Windows installers for the ODBC driver, and there are new RPMs for Fedora 8 and 9. All of this for both 32 and 64 bit architectures. There is also a new Super Source Ball. -- Sjoerd Mullender

1 0

Re: [MonetDB-users] MonetDB rpm issues
by Stefan Manegold 11 Aug '08

11 Aug '08

On Mon, Aug 11, 2008 at 10:52:34AM +0100, John Baxter wrote: > Stefan, > > Sorry about the html format, it is just the default, i've changed it to > plain text now. Thanks! > cenos == centos, my mistake. > > CentOS is basically the same as Red Hat Enterprise server but rebranded. > I feel it is more stable than fedora core and as it is also open source > it is just as usable. > > I'm sorry, i didn't realise i would have to compile it first, i'll do > that today, thank you for the tips about what order to do it in. > > One last thing, i'm sure i read somewhere that the sql implementation is > the same as postgresql. Is this still correct, and is the implementation > exactly the same or are there some exceptions? Well, we do not follow or copy any other SQL implementation (in particular not their modification and/or extensions of the standard), but rather (try to) stick to teh standard. For details see http://monetdb.cwi.nl/SQL/Documentation/index.html and in particular http://monetdb.cwi.nl/SQL/Documentation/SQL-Reference.html Stefan > Thanks again for your assistance. > > Kind Regards > > John > > > Stefan Manegold wrote: >> Hi John, >> >> On Fri, Aug 08, 2008 at 04:26:09PM +0100, John Baxter wrote: >> >>> <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> >>> <html> >>> <head> >>> <meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type"> >>> </head> >>> <body bgcolor="#ffffff" text="#000000"> >>> Stefan, >>> >>> Thanks very much for replying, i really appreciate it. >>> >>> These are the RPM's i have tried: >>> >>> MonetDB5-server-5.6.0-4.src.rpm >>> MonetDB-SQL-2.24.0-4.src.rpm >>> >>> I'm only installing this on a local centos install. I downloaded the >>> RPM's to the root of the filesystem and ran them from there. >>> I'm running cenos from it's GUI at the moment so it would be the GUI >>> >> ^^^^^ >> Typo (i.e., "cenos" == "centos") or is that the application/tools you use to >> install RPMs? >> I don't know CentOS and/or it's adminstrative tools at all. Sorry. >> >> However, the "platform independent" RPMs are *source* RPMs that cannot be >> installed directly using, e.g., `rpm -i`. Instead, they have to be compiled >> (into platform-specific binary RPMs, first, e.g., via `rpmbuild --rebuild` >> or `rpmbuild --recompile`. >> >> See your systems RPM documentation (e.g., `man rpm` / `man rpmbuild` and/or >> http://www.rpm.org/ for a detailed documentation of RPM. >> >> >> Before compiling/building and installing >> MonetDB5-server-5.6.0-4.src.rpm >> and MonetDB-SQL-2.24.0-4.src.rpm >> >> you first need to compile/build and install >> MonetDB-1.24.0-4.src.rpm >> and MonetDB-client-1.24.0-4.src.rpm >> >> >> Stefan >> >> >> ps: We would greatly apprechiate if you would not sedn HTML(-only) >> emails/postings --- plain text is more than sufficient (and much easier >> to handle) ... >> >> >> >>> that gave me the error messages. >>> >>> Thanks >>> >>> John >>> >>> Stefan Manegold wrote: >>> <blockquote cite="mid:20080808151929.GA10101@cwi.nl" type="cite"> >>> <pre wrap="">Hi John, >>> >>> which "platform independent RPM's" are you refering to? >>> >>> On our download page on SF we only provide Fedora 8 & 9 (binary) RPMs as >>> well as source-RPMs --- only the latter are platform independent, except >>> that the target OS need to obviously provide RPM support in general. >>> >>> How exactly do you try to install the (source?) RPMs? >>> >>> And who (i.e., which program) give the error messages? >>> >>> Stefan >>> >>> On Fri, Aug 08, 2008 at 03:49:45PM +0100, John Baxter wrote: >>> </pre> >>> <blockquote type="cite"> >>> <pre wrap="">Stefan, >>> >>> I hope you don't mind me e-mailing you. You were kind enough to help >>> me once before when i was having trouble installing MonetDB and i'm >>> having trouble again. >>> >>> I'm trying to install the platform independent RPM's on centos 5.2 >>> but it is saying that it "cannot install source packages" and then >>> "no packages were given for installation" >>> >>> Are the RPM's usable at the moment? >>> >>> If you can offer any advice that would be great. >>> >>> Thank you >>> >>> Kind Regards >>> >>> John Baxter >>> </pre> >>> </blockquote> >>> <pre wrap=""> >>> </pre> >>> </blockquote> >>> >>> <pre class="moz-signature" cols="72">-- Co: Baxter Designs >>> >>> Web: <a class="moz-txt-link-freetext" href="http://www.baxterdesigns.co.uk">http://www.baxterdesigns.co.uk</a> >>> >>> Mail: <a class="moz-txt-link-abbreviated" href="mailto:john@baxterdesigns.co.uk">john(a)baxterdesigns.co.uk</a> >>> >>> Tel: 07968754215</pre> >>> </body> >>> </html> >>> >>> >> >> >>> ------------------------------------------------------------------------- >>> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge >>> Build the coolest Linux based applications with Moblin SDK & win great prizes >>> Grand prize is a trip for two to an Open Source event anywhere in the world >>> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >>> _______________________________________________ >>> MonetDB-users mailing list >>> MonetDB-users(a)lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/monetdb-users >>> >> >> >> > > -- > Co: Baxter Designs > > Web: http://www.baxterdesigns.co.uk > > Mail: john(a)baxterdesigns.co.uk > > Tel: 07968754215 -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 5

[MonetDB-users] (no subject)
by Matt Magoffin 11 Aug '08

11 Aug '08

Hello, I am interested in evaluating MonetDB/XQuery. I have some XML collections for a project I work on that are of 1-2 million individual XML documents for which I use XQuery to access for OLAP style reporting operations. This is a Java-based project, and while working on this project I developed a thin XQuery-centric API so that I could evaluate/use many different XQuery implementations, which my company released as an open source project called Xaj (http://sourceforge.net/projects/xaj) Currently I am using a Berkeley DB XML implementation, but am interested in exploring other options. I'd like to implement a MonetDB version of this API now, but I am having some difficulty finding out how to effectively access MonetDB through Java. So far I was able to use the MonetDB JDBC driver to construct XQuery statements and get XML results, and also I was able to construct MonetDB pf:add-doc() statements to add documents, but I am wondering if this is the best approach (and if so, how to add documents to a remote MonetDB server using the pf:add-doc() mechanism). The API I am trying to implement you can view here, to give you an idea what I'm trying to do: http://xaj.svn.sourceforge.net/viewvc/xaj/xaj/src/net/sf/xaj/XmlDb.java?rev… It was somewhat modeled after the defunct XML:DB API, but focused just on add/store/XQuery operations. Any help/advise would be greatly appreciated! -- m@

2 3

Re: [MonetDB-users] MonetDB rpm issues
by Stefan Manegold 11 Aug '08

11 Aug '08

Hi John, which "platform independent RPM's" are you refering to? On our download page on SF we only provide Fedora 8 & 9 (binary) RPMs as well as source-RPMs --- only the latter are platform independent, except that the target OS need to obviously provide RPM support in general. How exactly do you try to install the (source?) RPMs? And who (i.e., which program) give the error messages? Stefan On Fri, Aug 08, 2008 at 03:49:45PM +0100, John Baxter wrote: > Stefan, > > I hope you don't mind me e-mailing you. You were kind enough to help me > once before when i was having trouble installing MonetDB and i'm having > trouble again. > > I'm trying to install the platform independent RPM's on centos 5.2 but > it is saying that it "cannot install source packages" and then "no > packages were given for installation" > > Are the RPM's usable at the moment? > > If you can offer any advice that would be great. > > Thank you > > Kind Regards > > John Baxter -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

[MonetDB-users] Announcing MonetDB support for Ruby on Rails
by Michalis Polakis 10 Aug '08

10 Aug '08

Hello folks, I developed the MonetDB adapter for Rail's ActiveRecord. It will enable you to work with MonetDB databases in Ruby on Rails. You are more than welcome to try the code, give me some feedback, and maybe help me maintain it. To get the code visit : http://rubyforge.org/projects/monetdb-ror Thanks, Michalis Polakis

1 0

[MonetDB-users] MonetDB Indexes and Data Types
by Ross Bates 09 Aug '08

09 Aug '08

Hi All - I'm new to MonetDB and just getting my feet wet. Quick question for the experts. Does the data type of the column impact the performance of the indexes created on the fly by MonetDB? In other words, should I expect WHERE clauses on INT columns to perform faster than VARCHAR like I would in a tradtional row store? Many Thanks, Ross

2 1

[MonetDB-users] full text search?
by mark 09 Aug '08

09 Aug '08

hi, i am beginning with monetdb. is there any support for full text search on monet-db via plugin or natively? thanks a lot

2 1

[MonetDB-users] COPY INTO on Ubuntu 64bit is slow
by Cronje Fourie 08 Aug '08

08 Aug '08

Hi guys.... I've got to machines running Monet. 1. Quad core Intel with 4GB RAM, Ubuntu 8.04 32BIT (server ed) 2. AMD64 Quad Core, 4GB RAM, KUbuntu 8.04 64BIT (kde 3.5.9) On system 1 I can do a "copy into" of 6million records in no time at all :) On system 2 the same function, with the exact same data takes forever. Any thoughts on the reason? Is this a memory related issue? Cronje

7 12

[MonetDB-users] [XQuery] Communicate with Java?
by Chaojing Yang 08 Aug '08

08 Aug '08

Dear all, I'm a totally newbie and try to implements an LDAP-application over MonetDB/XQuery due to efficient search performance of column-store. Like the example XQueryLoad.java does i have succeed to import a XML-file and now come my questions: * How can i manipulate my XML-files with JAVA? Like doing searches and changes over XML-files. * How is the performance of Subtree-search? Like doing searchs over the whole tree or any subtrees. As once discussed in http://comments.gmane.org/gmane.comp.db.monetdb.user/1027, i'm in the same situation. Best regards, Chaojing Yang -- ------------------------------------------------------------------------------------------------------------------------------------------ Email: chaojing.yang(a)gmail.com Blog: http://goethe-ist-taoist.blogspot.com/ §1 Ich widerspreche der Nutzung oder Übermittlung meiner Daten für Werbezwecke oder sowie andere unbefugte Verwendungszwecke. (§ 28 Abs. 4 BDSG=Bundesdatenschutzgesetz). §2 Durch die Datenübertragung bzw. Kommunikation per E-Mail liegt ein Verstoß gegen das BDSG vor, da ihre Daten insoweit nicht ausreichend geschützt sind. Ich bitte Sie daher, mir schriftlich zu bestätigen, dass Sie mit dem Verstoß gegen das BDSG einverstanden sind und keine Schadensersatzanspräche bzw. Unterlassungsanspräche mir gegenüber geltend machen. §3 Der Inhalt dieser Nachricht ist vertraulich und nur für den oben angegebenen Empfänger bestimmt.

5 8

[MonetDB-users] Does MonetDB's JDBC Driver support CachedRowSet??
by sateesh 07 Aug '08

07 Aug '08

Hi All, I am wondering what JDBC Spec does the MonetDB's JDBC Driver conform to ? (is it JDBC3.0 ,4.0) We would like to use the pagination at the Database level and hence i want to know whether the JDBC Driver has any implementation of CachedRowSet.. Thanks Sateesh -- View this message in context: http://www.nabble.com/Does-MonetDB%27s--JDBC-Driver-support-CachedRowSet---… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1