- users-list - monetdb.org

[MonetDB-users] gdk_mem_bigsize and gdk_vm_minsize
by Rahul Chopra 03 Jan '08

03 Jan '08

Can you please explain gdk_mem_bigsize and gdk_vm_minsize? I searched around on the site and I am not really clear on what the optimal settings for these are. I am currently using the defaults, on a system with 8 GB of RAM. Thanks, Rahul = Limousine and Luxury Bus Wine Tours Private Napa & Sonoma wine-tasting tours via luxury limousine or bus. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=2c5439db6084d9969b4f63e… -- Powered by Outblaze

2 1

[MonetDB-users] killing queries
by Rahul Chopra 03 Jan '08

03 Jan '08

How can I safely kill queries? I notice if I ctrl-c out of mclient when executing a long run query, mserver5 still seems to be using a lot of memory, maybe it has not deallocated it all? Also, if I start a new mclient session queries now run slower. Of course, one should always avoid ctrl-c, but in case we do have multiple queries running and we wish to kill a long running one for some reason, is there a way to safely do so? (Like, start a new mclient session, and execute some kind of admin commands). TIA = Espresso Machines - Free Shipping Espresso Machines, coffee beans and pods, cappuccino cups and spoons. Free shipping. No sales tax. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=8427826bf39d56eb7c331a1… -- Powered by Outblaze

2 1

[MonetDB-users] mserver5 daemon
by Rahul Chopra 03 Jan '08

03 Jan '08

I had a question about using the daemon option. If I start mserver5 with daemon=yes, it seems to stop: ./mserver5 --dbinit="include sql;" --dbname=db1 --daemon=yes & [1] 10038 [monetdb@localhost bin]$ # MonetDB server v5.2.0, based on kernel v1.20.0 # Serving database 'db1' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /home/monetdb/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.0 loaded [1]+ Stopped ./mserver5 --dbinit="include sql;" --dbname=db1 --daemon=yes If I leave off &, I still get a > prompt and can interact with it. I also tried nohup. I am not sure what I need to do to get the server running in the background and keep it running without it being in the foreground.... = nantucket vacation in Nantucket, MA Sanford Real Estate provides professional real estate services in Nantucket, Massachusetts. Visit us today for home buying, selling, rentals and more. Customer satisfaction is our priority. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=751b4f3b7386a2440fa9cc8… -- Powered by Outblaze

2 1

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Just letting you know I compiled on CentOS 5.1, and it appears to be working now. Thanks for the help. > ----- Original Message ----- > From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 17:59:18 +0100 > > > > Yes, it seems you are right. Download the SuperSourceBall and compile > from that. > The website indicates that the latest stable version works on Centoo. > http://monetdb.cwi.nl/testing/projects/monetdb/Stable/sql5/.mTests103/index… > > Rahul Chopra wrote: > > Hi Martin, > > > > I am now running as a non-root user. > > > > Here is the output from the stack trace: > > > > Program received signal SIGSEGV, Segmentation fault. > > [Switching to Thread 46912496255632 (LWP 23889)] > > 0x0000000000000000 in ?? () > > > > (gdb) bt > > #0 0x0000000000000000 in ?? () > > #1 0x0000003a1e026d9e in _rl_init_terminal_io () > > from /usr/lib64/libreadline.so.5 > > #2 0x0000003a1e013f07 in rl_initialize () from /usr/lib64/libreadline.so.5 > > #3 0x0000003a1e014d07 in readline () from /usr/lib64/libreadline.so.5 > > #4 0x00000038d3c4e98d in getConsoleInput () from /usr/lib64/libmal.so.0 > > #5 0x00000038d3c4f089 in readConsole () from /usr/lib64/libmal.so.0 > > #6 0x00000038d3c195ee in MALreader () from /usr/lib64/libmal.so.0 > > #7 0x00000038d3c463d6 in runScenarioBody () from /usr/lib64/libmal.so.0 > > #8 0x00000038d3c465be in runScenario () from /usr/lib64/libmal.so.0 > > #9 0x00000038d3c196f0 in MSserveClient () from /usr/lib64/libmal.so.0 > > > > Maybe FC7 RPMs cannot run on CentOS 5.1. I may try building > > manually. Thank you and sorry for the trouble. > > > > > > > >> ----- Original Message ----- > >> From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > >> To: "Communication channel for MonetDB users" > >> <monetdb-users(a)lists.sourceforge.net> > >> Subject: Re: [MonetDB-users] Cannot start mserver5 > >> Date: Fri, 28 Dec 2007 15:56:14 +0100 > >> > >> > >> Rahul, > >> > >> I seen you run as root, something one normally doesn't do, but that's > >> your decision > >> and won't affect MonetDB. > >> > >> I have no clue as what ocal configuration setting interferes with the > >> packages. > >> You might run 'gdb mserver5 --dbinit="include sql;"' and > >> sent us the stack trace. > >> > >> Rahul Chopra wrote: > >> > >>> Thank you for the clarification, I did miss that one. I have > >>> now installed it. Here is what happens now: > >>> > >>> [root@localhost bin]# mserver5 --dbinit="include sql;" > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> # MonetDB/SQL module v2.20.2 loaded > >>> [root@localhost bin]# > >>> > >>> It immediately exits without an error message instead of giving > >>> me a prompt. In the getting started guide it mentions to check > >>> your $PATH. It does include /usr/bin: > >>> > >>> [root@localhost bin]# echo $PATH > >>> /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin > >>> > >>> Is there something else I must do? I have not changed the configuration. > >>> > >>> > >>> More info: > >>> > >>> [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 > >>> /usr/bin/Mbeddedsql5 > >>> /usr/bin/merovingian > >>> /usr/bin/monetdb > >>> /usr/lib64/MonetDB5/lib/lib_sql.so > >>> /usr/lib64/MonetDB5/lib/lib_sql.so.0 > >>> /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 > >>> /usr/lib64/MonetDB5/sql.mal > >>> /usr/lib64/libembeddedsql5.so.0 > >>> /usr/lib64/libembeddedsql5.so.0.0.0 > >>> /usr/share/man/man1/merovingian.1.gz > >>> /usr/share/man/man1/monetdb.1.gz > >>> > >>> > >>> [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 > >>> /usr/share/MonetDB/sql > >>> /usr/share/MonetDB/sql/bbp.sql > >>> /usr/share/MonetDB/sql/cache.sql > >>> /usr/share/MonetDB/sql/dependency_functions.sql > >>> /usr/share/MonetDB/sql/math.sql > >>> /usr/share/MonetDB/sql/ms_functions.sql > >>> /usr/share/MonetDB/sql/mtime.sql > >>> /usr/share/MonetDB/sql/stats.sql > >>> /usr/share/MonetDB/sql/url.sql > >>> /usr/share/doc/MonetDB-SQL-2.20.2 > >>> /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL > >>> /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt > >>> /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html > >>> /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt > >>> > >>> [root@localhost bin]# mserver5 --xproperties > >>> # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu > >>> # builtin opt gdk_version = 1.20.0 > >>> # builtin opt monet_pid = 23171 > >>> # builtin opt prefix = /usr > >>> # builtin opt exec_prefix = /usr > >>> # builtin opt gdk_dbname = tst > >>> # builtin opt gdk_dbfarm = /var/MonetDB > >>> # builtin opt gdk_debug = 8 > >>> # builtin opt gdk_mem_bigsize = 262144 > >>> # builtin opt gdk_vm_minsize = 137438953472 > >>> # builtin opt gdk_alloc_map = yes > >>> # builtin opt gdk_mem_pagebits = 14 > >>> # builtin opt gdk_vmtrim = yes > >>> # builtin opt monet_admin = adm > >>> # builtin opt monet_prompt = > > >>> # builtin opt monet_welcome = yes > >>> # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin > >>> # builtin opt monet_daemon = yes > >>> # builtin opt host = localhost > >>> # builtin opt mapi_port = 50000 > >>> # builtin opt mapi_noheaders = no > >>> # builtin opt mapi_debug = 0 > >>> # builtin opt mapi_clients = 2 > >>> # builtin opt sql_debug = 0 > >>> # builtin opt sql_logdir = /var/MonetDB/sql_logs > >>> # builtin opt xquery_logdir = /var/MonetDB/xquery_logs > >>> # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > >>> # builtin opt standoff_start = start > >>> # builtin opt standoff_end = end > >>> # config opt prefix = /usr > >>> # config opt config = /etc/monetdb5.conf > >>> # config opt prefix = /usr > >>> # config opt exec_prefix = /usr > >>> # config opt gdk_dbfarm = /var/MonetDB5/dbfarm > >>> # config opt gdk_dbname = demo > >>> # config opt gdk_alloc_map = no > >>> # config opt gdk_embedded = no > >>> # config opt gdk_debug = 0 > >>> # config opt monet_mod_path = > >>> /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin > >>> # config opt monet_daemon = no > >>> # config opt monet_welcome = yes > >>> # config opt mero_msglog = /var/log/merovingian.log > >>> # config opt mero_errlog = /var/log/merovingian.log > >>> # config opt mero_timeinterval = 600 > >>> # config opt mero_exittimeout = 7 > >>> # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal > >>> # config opt mal_listing = 15 > >>> # config opt checkpoint_dir = /var/MonetDB5/chkpnt > >>> # config opt mapi_port = 0 > >>> # config opt mapi_open = false > >>> # config opt sql_debug = 0 > >>> # config opt sql_logdir = /var/MonetDB5/sql_logs > >>> # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> [root@localhost bin]# > >>> > >>> > >>> > >>> > >>> > >>>> ----- Original Message ----- > >>>> From: "Niels Nes" <Niels.Nes(a)cwi.nl> > >>>> To: "Communication channel for MonetDB users" > >>>> <monetdb-users(a)lists.sourceforge.net> > >>>> Subject: Re: [MonetDB-users] Cannot start mserver5 > >>>> Date: Fri, 28 Dec 2007 09:44:56 +0100 > >>>> > >>>> > >>>> On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > >>>> > >>>> > >>>>> Hello, > >>>>> > >>>>> I installed a copy of MonetDB on CentOS 5.1, but don't seem > >>>>> to be able to start it. I installed the RPMs, and then wanted > >>>>> to follow the "Getting Started" page on your website. > >>>>> > >>>>> > >>>>> [root@localhost ~]# mserver5 --dbinit="include sql;" > >>>>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>>>> # Serving database 'demo' > >>>>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>>>> dynamically linked > >>>>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>>>> # Visit http://monetdb.cwi.nl/ for further information > >>>>> #warning: please don't forget to set your vault key! > >>>>> #(see /etc/monetdb5.conf) > >>>>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>>>> !MALException:malInclude:could not open file: sql > >>>>> > >>>>> [root@localhost ~]# uname -a > >>>>> Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov > >>>>> 12 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > >>>>> > >>>>> [root@localhost ~]# rpm -qa | grep MonetDB > >>>>> MonetDB-client-1.20.2-1.fc7.oid64 > >>>>> MonetDB-1.20.0-3.fc7.oid64 > >>>>> MonetDB-SQL-2.20.2-1.fc7.oid64 > >>>>> MonetDB5-server-5.2.2-1.fc7.oid64 > >>>>> > >>>>> Any idea what I am doing wrong? > >>>>> > >>>>> > >>>> You need to also install the MonetDB-SQL-server5 rpm > >>>> > >>>> Niels > >>>> > >>>> > >>>> > >>>> > >>>>> Regards, > >>>>> > >>>>> Rahul > >>>>> > >>>>> > >>>>> > >>>>> = > >>>>> Criminal Justice Degrees > >>>>> Online Criminal Justice studies - Free info pack now. > >>>>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > >>>>> > >>>>> > >>>>> -- Powered by Outblaze > >>>>> > >>>>> ------------------------------------------------------------------------- > >>>>> This SF.net email is sponsored by: Microsoft > >>>>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>>>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>>>> _______________________________________________ > >>>>> MonetDB-users mailing list > >>>>> MonetDB-users(a)lists.sourceforge.net > >>>>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>>>> > >>>>> > >>>> -- > >>>> > >>>> Niels Nes, Centre for Mathematics and Computer Science (CWI) > >>>> Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > >>>> room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > >>>> url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > >>>> > >>>> ------------------------------------------------------------------------- > >>>> This SF.net email is sponsored by: Microsoft > >>>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>>> _______________________________________________ > >>>> MonetDB-users mailing list > >>>> MonetDB-users(a)lists.sourceforge.net > >>>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>>> > >>>> > >>> > >>> > >>> = > >>> Looking for HR Software? > >>> BillQuick HR will help you manage your employees more efficiently. > >>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… > >>> > >>> > >>> > >>> > >> ------------------------------------------------------------------------- > >> This SF.net email is sponsored by: Microsoft > >> Defy all challenges. Microsoft(R) Visual Studio 2005. > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >> _______________________________________________ > >> MonetDB-users mailing list > >> MonetDB-users(a)lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >> > > > > > > > > > > = > > Illinois Real Estate > > Search approximately 80,000 listings - easy to use and consumer-friendly. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=cd5e8640812a8f246564650… > > > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Aliante - Las Vegas Valley, Nevada Welcome to the beautiful new residential master-planned community of Aliante. Browse our site to see a community map, community resources, descriptions and builder information. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=1b166d271bb74530d5618e7… = Battery Backups from $25 Huge bargains on UPS power backup systems. Hundreds in stock. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=fcec83cbfc8a5226862cb33… -- Powered by Outblaze

1 0

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Hi Martin, I am now running as a non-root user. Here is the output from the stack trace: Program received signal SIGSEGV, Segmentation fault. [Switching to Thread 46912496255632 (LWP 23889)] 0x0000000000000000 in ?? () (gdb) bt #0 0x0000000000000000 in ?? () #1 0x0000003a1e026d9e in _rl_init_terminal_io () from /usr/lib64/libreadline.so.5 #2 0x0000003a1e013f07 in rl_initialize () from /usr/lib64/libreadline.so.5 #3 0x0000003a1e014d07 in readline () from /usr/lib64/libreadline.so.5 #4 0x00000038d3c4e98d in getConsoleInput () from /usr/lib64/libmal.so.0 #5 0x00000038d3c4f089 in readConsole () from /usr/lib64/libmal.so.0 #6 0x00000038d3c195ee in MALreader () from /usr/lib64/libmal.so.0 #7 0x00000038d3c463d6 in runScenarioBody () from /usr/lib64/libmal.so.0 #8 0x00000038d3c465be in runScenario () from /usr/lib64/libmal.so.0 #9 0x00000038d3c196f0 in MSserveClient () from /usr/lib64/libmal.so.0 Maybe FC7 RPMs cannot run on CentOS 5.1. I may try building manually. Thank you and sorry for the trouble. > ----- Original Message ----- > From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 15:56:14 +0100 > > > Rahul, > > I seen you run as root, something one normally doesn't do, but that's > your decision > and won't affect MonetDB. > > I have no clue as what ocal configuration setting interferes with the > packages. > You might run 'gdb mserver5 --dbinit="include sql;"' and > sent us the stack trace. > > Rahul Chopra wrote: > > Thank you for the clarification, I did miss that one. I have now > > installed it. Here is what happens now: > > > > [root@localhost bin]# mserver5 --dbinit="include sql;" > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > # MonetDB/SQL module v2.20.2 loaded > > [root@localhost bin]# > > > > It immediately exits without an error message instead of giving > > me a prompt. In the getting started guide it mentions to check > > your $PATH. It does include /usr/bin: > > > > [root@localhost bin]# echo $PATH > > /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin > > > > Is there something else I must do? I have not changed the configuration. > > > > > > More info: > > > > [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 > > /usr/bin/Mbeddedsql5 > > /usr/bin/merovingian > > /usr/bin/monetdb > > /usr/lib64/MonetDB5/lib/lib_sql.so > > /usr/lib64/MonetDB5/lib/lib_sql.so.0 > > /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 > > /usr/lib64/MonetDB5/sql.mal > > /usr/lib64/libembeddedsql5.so.0 > > /usr/lib64/libembeddedsql5.so.0.0.0 > > /usr/share/man/man1/merovingian.1.gz > > /usr/share/man/man1/monetdb.1.gz > > > > > > [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 > > /usr/share/MonetDB/sql > > /usr/share/MonetDB/sql/bbp.sql > > /usr/share/MonetDB/sql/cache.sql > > /usr/share/MonetDB/sql/dependency_functions.sql > > /usr/share/MonetDB/sql/math.sql > > /usr/share/MonetDB/sql/ms_functions.sql > > /usr/share/MonetDB/sql/mtime.sql > > /usr/share/MonetDB/sql/stats.sql > > /usr/share/MonetDB/sql/url.sql > > /usr/share/doc/MonetDB-SQL-2.20.2 > > /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL > > /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt > > /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html > > /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt > > > > [root@localhost bin]# mserver5 --xproperties > > # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu > > # builtin opt gdk_version = 1.20.0 > > # builtin opt monet_pid = 23171 > > # builtin opt prefix = /usr > > # builtin opt exec_prefix = /usr > > # builtin opt gdk_dbname = tst > > # builtin opt gdk_dbfarm = /var/MonetDB > > # builtin opt gdk_debug = 8 > > # builtin opt gdk_mem_bigsize = 262144 > > # builtin opt gdk_vm_minsize = 137438953472 > > # builtin opt gdk_alloc_map = yes > > # builtin opt gdk_mem_pagebits = 14 > > # builtin opt gdk_vmtrim = yes > > # builtin opt monet_admin = adm > > # builtin opt monet_prompt = > > > # builtin opt monet_welcome = yes > > # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin > > # builtin opt monet_daemon = yes > > # builtin opt host = localhost > > # builtin opt mapi_port = 50000 > > # builtin opt mapi_noheaders = no > > # builtin opt mapi_debug = 0 > > # builtin opt mapi_clients = 2 > > # builtin opt sql_debug = 0 > > # builtin opt sql_logdir = /var/MonetDB/sql_logs > > # builtin opt xquery_logdir = /var/MonetDB/xquery_logs > > # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > > # builtin opt standoff_start = start > > # builtin opt standoff_end = end > > # config opt prefix = /usr > > # config opt config = /etc/monetdb5.conf > > # config opt prefix = /usr > > # config opt exec_prefix = /usr > > # config opt gdk_dbfarm = /var/MonetDB5/dbfarm > > # config opt gdk_dbname = demo > > # config opt gdk_alloc_map = no > > # config opt gdk_embedded = no > > # config opt gdk_debug = 0 > > # config opt monet_mod_path = > > /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin > > # config opt monet_daemon = no > > # config opt monet_welcome = yes > > # config opt mero_msglog = /var/log/merovingian.log > > # config opt mero_errlog = /var/log/merovingian.log > > # config opt mero_timeinterval = 600 > > # config opt mero_exittimeout = 7 > > # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal > > # config opt mal_listing = 15 > > # config opt checkpoint_dir = /var/MonetDB5/chkpnt > > # config opt mapi_port = 0 > > # config opt mapi_open = false > > # config opt sql_debug = 0 > > # config opt sql_logdir = /var/MonetDB5/sql_logs > > # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > [root@localhost bin]# > > > > > > > > > >> ----- Original Message ----- > >> From: "Niels Nes" <Niels.Nes(a)cwi.nl> > >> To: "Communication channel for MonetDB users" > >> <monetdb-users(a)lists.sourceforge.net> > >> Subject: Re: [MonetDB-users] Cannot start mserver5 > >> Date: Fri, 28 Dec 2007 09:44:56 +0100 > >> > >> > >> On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > >> > >>> Hello, > >>> > >>> I installed a copy of MonetDB on CentOS 5.1, but don't seem to > >>> be able to start it. I installed the RPMs, and then wanted to > >>> follow the "Getting Started" page on your website. > >>> > >>> > >>> [root@localhost ~]# mserver5 --dbinit="include sql;" > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> !MALException:malInclude:could not open file: sql > >>> > >>> [root@localhost ~]# uname -a > >>> Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 > >>> 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > >>> > >>> [root@localhost ~]# rpm -qa | grep MonetDB > >>> MonetDB-client-1.20.2-1.fc7.oid64 > >>> MonetDB-1.20.0-3.fc7.oid64 > >>> MonetDB-SQL-2.20.2-1.fc7.oid64 > >>> MonetDB5-server-5.2.2-1.fc7.oid64 > >>> > >>> Any idea what I am doing wrong? > >>> > >> You need to also install the MonetDB-SQL-server5 rpm > >> > >> Niels > >> > >> > >> > >>> Regards, > >>> > >>> Rahul > >>> > >>> > >>> > >>> = > >>> Criminal Justice Degrees > >>> Online Criminal Justice studies - Free info pack now. > >>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > >>> > >>> > >>> -- Powered by Outblaze > >>> > >>> ------------------------------------------------------------------------- > >>> This SF.net email is sponsored by: Microsoft > >>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>> _______________________________________________ > >>> MonetDB-users mailing list > >>> MonetDB-users(a)lists.sourceforge.net > >>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>> > >> -- > >> > >> Niels Nes, Centre for Mathematics and Computer Science (CWI) > >> Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > >> room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > >> url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > >> > >> ------------------------------------------------------------------------- > >> This SF.net email is sponsored by: Microsoft > >> Defy all challenges. Microsoft(R) Visual Studio 2005. > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >> _______________________________________________ > >> MonetDB-users mailing list > >> MonetDB-users(a)lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >> > > > > > > > > > > = > > Looking for HR Software? > > BillQuick HR will help you manage your employees more efficiently. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… > > > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Illinois Real Estate Search approximately 80,000 listings - easy to use and consumer-friendly. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=cd5e8640812a8f246564650… -- Powered by Outblaze

2 1

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Thank you for the clarification, I did miss that one. I have now installed it. Here is what happens now: [root@localhost bin]# mserver5 --dbinit="include sql;" # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.2 loaded [root@localhost bin]# It immediately exits without an error message instead of giving me a prompt. In the getting started guide it mentions to check your $PATH. It does include /usr/bin: [root@localhost bin]# echo $PATH /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin Is there something else I must do? I have not changed the configuration. More info: [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 /usr/bin/Mbeddedsql5 /usr/bin/merovingian /usr/bin/monetdb /usr/lib64/MonetDB5/lib/lib_sql.so /usr/lib64/MonetDB5/lib/lib_sql.so.0 /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 /usr/lib64/MonetDB5/sql.mal /usr/lib64/libembeddedsql5.so.0 /usr/lib64/libembeddedsql5.so.0.0.0 /usr/share/man/man1/merovingian.1.gz /usr/share/man/man1/monetdb.1.gz [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 /usr/share/MonetDB/sql /usr/share/MonetDB/sql/bbp.sql /usr/share/MonetDB/sql/cache.sql /usr/share/MonetDB/sql/dependency_functions.sql /usr/share/MonetDB/sql/math.sql /usr/share/MonetDB/sql/ms_functions.sql /usr/share/MonetDB/sql/mtime.sql /usr/share/MonetDB/sql/stats.sql /usr/share/MonetDB/sql/url.sql /usr/share/doc/MonetDB-SQL-2.20.2 /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt [root@localhost bin]# mserver5 --xproperties # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu # builtin opt gdk_version = 1.20.0 # builtin opt monet_pid = 23171 # builtin opt prefix = /usr # builtin opt exec_prefix = /usr # builtin opt gdk_dbname = tst # builtin opt gdk_dbfarm = /var/MonetDB # builtin opt gdk_debug = 8 # builtin opt gdk_mem_bigsize = 262144 # builtin opt gdk_vm_minsize = 137438953472 # builtin opt gdk_alloc_map = yes # builtin opt gdk_mem_pagebits = 14 # builtin opt gdk_vmtrim = yes # builtin opt monet_admin = adm # builtin opt monet_prompt = > # builtin opt monet_welcome = yes # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin # builtin opt monet_daemon = yes # builtin opt host = localhost # builtin opt mapi_port = 50000 # builtin opt mapi_noheaders = no # builtin opt mapi_debug = 0 # builtin opt mapi_clients = 2 # builtin opt sql_debug = 0 # builtin opt sql_logdir = /var/MonetDB/sql_logs # builtin opt xquery_logdir = /var/MonetDB/xquery_logs # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff # builtin opt standoff_start = start # builtin opt standoff_end = end # config opt prefix = /usr # config opt config = /etc/monetdb5.conf # config opt prefix = /usr # config opt exec_prefix = /usr # config opt gdk_dbfarm = /var/MonetDB5/dbfarm # config opt gdk_dbname = demo # config opt gdk_alloc_map = no # config opt gdk_embedded = no # config opt gdk_debug = 0 # config opt monet_mod_path = /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin # config opt monet_daemon = no # config opt monet_welcome = yes # config opt mero_msglog = /var/log/merovingian.log # config opt mero_errlog = /var/log/merovingian.log # config opt mero_timeinterval = 600 # config opt mero_exittimeout = 7 # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal # config opt mal_listing = 15 # config opt checkpoint_dir = /var/MonetDB5/chkpnt # config opt mapi_port = 0 # config opt mapi_open = false # config opt sql_debug = 0 # config opt sql_logdir = /var/MonetDB5/sql_logs # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ [root@localhost bin]# > ----- Original Message ----- > From: "Niels Nes" <Niels.Nes(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 09:44:56 +0100 > > > On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > > Hello, > > > > I installed a copy of MonetDB on CentOS 5.1, but don't seem to be > > able to start it. I installed the RPMs, and then wanted to follow > > the "Getting Started" page on your website. > > > > > > [root@localhost ~]# mserver5 --dbinit="include sql;" > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > !MALException:malInclude:could not open file: sql > > > > [root@localhost ~]# uname -a > > Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 > > 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > > > > [root@localhost ~]# rpm -qa | grep MonetDB > > MonetDB-client-1.20.2-1.fc7.oid64 > > MonetDB-1.20.0-3.fc7.oid64 > > MonetDB-SQL-2.20.2-1.fc7.oid64 > > MonetDB5-server-5.2.2-1.fc7.oid64 > > > > Any idea what I am doing wrong? > You need to also install the MonetDB-SQL-server5 rpm > > Niels > > > > > > Regards, > > > > Rahul > > > > > > > > = > > Criminal Justice Degrees > > Online Criminal Justice studies - Free info pack now. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2005. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Looking for HR Software? BillQuick HR will help you manage your employees more efficiently. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… -- Powered by Outblaze

2 1

[MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Hello, I installed a copy of MonetDB on CentOS 5.1, but don't seem to be able to start it. I installed the RPMs, and then wanted to follow the "Getting Started" page on your website. [root@localhost ~]# mserver5 --dbinit="include sql;" # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ !MALException:malInclude:could not open file: sql [root@localhost ~]# uname -a Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux [root@localhost ~]# rpm -qa | grep MonetDB MonetDB-client-1.20.2-1.fc7.oid64 MonetDB-1.20.0-3.fc7.oid64 MonetDB-SQL-2.20.2-1.fc7.oid64 MonetDB5-server-5.2.2-1.fc7.oid64 Any idea what I am doing wrong? Regards, Rahul = Criminal Justice Degrees Online Criminal Justice studies - Free info pack now. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… -- Powered by Outblaze

3 2

[MonetDB-users] Benchmark on MonetDB/X100
by Konstantinos Krikellas 26 Dec '07

26 Dec '07

I want to use MonetDB for benchmarking on the TPC-H workload. According to the paper "MonetDB/X100 - A DBMS In The CPU Cache", the X100 module achieves significant acceleration against MonetDB/MIL on Query 1 of TPC-H. Still, when I search your site, there is no reference about how it is possible to activate X100 inside MonetDB. I have only found X100 in your repository for mserver5 in Sourceforge, but it is not currently active. Therefore, I have the following questions: a) Has X100 been integrated to the Mserver5 version of MonetDB, or included as an extension module? b) Does Mserver5 use vector processing as proposed in the paper "MonetDB/X100: Hyper-Pipelining Query Execution" (CIDR 2005) ? c) How is it possible to use MonetDB/X100 for benchmarking purposes? Are there any instructions online? Thank you.

2 1

[MonetDB-users] Memory leaks on nightly stable
by m h 22 Dec '07

22 Dec '07

Hey all- I've been benchmarking my application against mysql and postgres. For my test application which has some 1Mil rows of data and my sample query that returns some 260K rows here's some stats. Speed for query: Postgres 15 sec (8.1) Monetdb 33 sec (nightly stable) Mysql 100 sec (5.0) Bulk load speed: Postgres 12 Min Monetdb 1 Min Mysql 2 Min Memory during bulk load: Postgres 20 Meg Monetdb 700 Meg!!! (And it doesn't come back down) Mysql 20 Meg Memory during query: Postgres 30Meg Monetdb 180 Meg (And increases by 10-20 Meg /query) Mysql 30 Meg Niels has some trick up his sleeves that bring the query speed down (using the nightly current). But I'm concerned about memory use. It's fine to use memory if you are going to be fast. But if I can't load my data (in all I have 67+ mil rows) or have to restart the server after a few queries it is problematic. I've submitted bugs with valgrind reports during load/query, but am wondering if other steps can be taken to help with the memory issue? I know that both mysql and postgres (and a host of other open source projects) have benefitted from coverity's offering [0] and klocworks [1] as well. Have these been looked into? It might be worth it have some automated "eyes" along with the "many eyes" of the open source community that make all bugs shallow. Some food for thought cheers, -matt 0 - http://scan.coverity.com/ 1 - http://www.klocwork.com/company/releases/06_26_06.asp

2 2

[MonetDB-users] Is there a Front End for SPARQL to MonetDB Backend
by sateesh 21 Dec '07

21 Dec '07

HI All, I am wondering whether any effort is made to build a frontend which accepts SPARQL Queries and convers them into MIL for the Monet Back-end ?? Or how difficult to use MIL Directly in a Programming language like Java?? (Which is basically developing the front-end) If such front-end accepts either SQL or XQuery etc then it has to be a Query Parser and Optimizer . How ever if it uses MIL Directly then i guess we don't need a Query Parser and Optimizer..!! Any comments or info reg SPARQL Related front-ends will be of great help Thanks Sateesh -- View this message in context: http://www.nabble.com/Is-there-a-Front-End-for-SPARQL-to-MonetDB-Backend-tp… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Problem with running TPC-H query No.5
by Konstantinos Krikellas 18 Dec '07

18 Dec '07

I am using MonetDB for benchmarking on the TPC-H workload. I have successfully run queries 1, 3 and 10. However, when I try to run query 5: select n_name, sum(l_extendedprice * (1 - l_discount)) as revenue from customer, orders, lineitem, supplier, nation, region where c_custkey = o_custkey and l_orderkey = o_orderkey and l_suppkey = s_suppkey and c_nationkey = s_nationkey and s_nationkey = n_nationkey and n_regionkey = r_regionkey and r_name = 'ASIA' and o_orderdate >= date '1994-01-01' and o_orderdate < date '1994-01-01' + interval '1' year group by n_name order by revenue desc; it takes about two (2) hours to evaluate it. It is obvious that the query cannot be executed inside the main memory, so the system thrashes through paging. Still, this behaviour does not appear for the rest of the queries, as they are computed within one or two seconds. In all cases, the results are correct. The specifications of my system are: Processor: Intel Core 2 Duo @ 1.86 Mhz RAM: 2 Gb Operating System: Linux Ubuntu Gutsy 7.10 MonetDB version: Mserver5 (recently downloaded from your site). Can you give me some indications about why this query takes too long and how can I bypass this response delay? Thanks.

2 4

[MonetDB-users] install script (monetdb-install.sh) doesn't work for current branch
by Ying Zhang 18 Dec '07

18 Dec '07

Hello, I try to install the nightly build of current branch using the install script "monetdb-install.sh" (just downloaded from http://monetdb.cwi.nl/projects/monetdb/Assets/monetdb-install.sh) , but it stops when trying to rename the directory for MonetDB- client-1.21.0 I run the script with the following options: monetdb-install.sh --prefix=$HOME/monetdb --build=$HOME/tmp/ monetdb_build --enable-xquery --nightly=current --enable-debug The log is attached below. A request: would the owner of the script please add the new module "java" in to the script? Thanks a lot! Jennie ============================== $ cat monetdb_build/log Fri Dec 7 12:37:45 CET 2007 called with arguments: --prefix=/export/scratch0/streettivo/monetdb -- build=/export/scratch0/streettivo/tmp/monetdb_build --enable-xquery -- nightly=current --enable-debug --12:37:46-- http://www.ins.cwi.nl/~monet/tars/latest/current/MonetDB.tar.gz Resolving www.ins.cwi.nl... 192.16.196.21 Connecting to www.ins.cwi.nl|192.16.196.21|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1198570 (1.1M) [application/x-gzip] Saving to: `/export/scratch0/streettivo/tmp/monetdb_build/MonetDB/ MonetDB.tar.gz' 0K ........ ........ .. 100% 4.85M=0.2s 12:37:46 (4.85 MB/s) - `/export/scratch0/streettivo/tmp/monetdb_build/ MonetDB/MonetDB.tar.gz' saved [1198570/1198570] unpacking MonetDB.tar.gz --12:37:46-- http://www.ins.cwi.nl/~monet/tars/latest/current/MonetDB-client.tar.gz Resolving www.ins.cwi.nl... 192.16.196.21 Connecting to www.ins.cwi.nl|192.16.196.21|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 920374 (899K) [application/x-gzip] Saving to: `/export/scratch0/streettivo/tmp/monetdb_build/MonetDB- client/MonetDB-client.tar.gz' 0K ........ ...... 100% 32.9M=0.03s 12:37:46 (32.9 MB/s) - `/export/scratch0/streettivo/tmp/monetdb_build/ MonetDB-client/MonetDB-client.tar.gz' saved [920374/920374] unpacking MonetDB-client.tar.gz mv: cannot stat `clients-[0-9]*': No such file or directory failed to rename sources to the right name Please refer to the full log at /export/scratch0/streettivo/tmp/ monetdb_build/log If you believe this is an error in the script or the software, file a bug and attach the logfile. Fri Dec 7 12:37:46 CET 2007 The following tools might be relevant to debug your problem: : 1.15.4.6 $ /usr/bin/autoconf autoconf (GNU Autoconf) 2.59 Written by David J. MacKenzie and Akim Demaille. Copyright (C) 2003 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/automake automake (GNU automake) 1.9.6 Written by Tom Tromey <tromey(a)redhat.com>. Copyright 2005 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/libtool ltmain.sh (GNU libtool) 1.5.22 (1.1220.2.365 2005/12/18 22:14:06) Copyright (C) 2005 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. glibtool cannot be found in the path /usr/lib64/ccache/gcc gcc (GCC) 4.1.2 20070626 (Red Hat 4.1.2-13) Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/ld GNU ld version 2.17.50.0.6-5.fc6 20061020 Copyright 2005 Free Software Foundation, Inc. This program is free software; you may redistribute it under the terms of the GNU General Public License. This program has absolutely no warranty. /usr/bin/make GNU Make 3.81 Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. This program built for x86_64-redhat-linux-gnu /usr/bin/gmake GNU Make 3.81 Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. This program built for x86_64-redhat-linux-gnu /usr/bin/python 2.4.4 (#1, Oct 23 2006, 13:58:18) [GCC 4.1.1 20061011 (Red Hat 4.1.1-30)] /bin/gawk GNU Awk 3.1.5 Copyright (C) 1989, 1991-2005 Free Software Foundation. This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. /bin/sed GNU sed version 4.1.5 Copyright (C) 2003 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE, to the extent permitted by law. gsed cannot be found in the path

4 17

Re: [MonetDB-users] MonetDB size limitation questions.
by Martin Kersten 17 Dec '07

17 Dec '07

Thomas Backlund wrote: > > Hi, > Hi Thomas. Thanks for your interest in MonetDB. > > I stumbled over MonetDB a few days ago and it really cought my > interest. But it is hard to find information about it, so I hope You > could answer a few questions. > > I need a database engine that could handle many rows, about 350*10^9 > rows of about 1000TB data. > This is really large, do you really mean 1 PetaByte? For MonetDB the first interesting part is that it will automatically split the table into 350 tables of 1000.000.000 rows, each would then be be 3 TB.. which means you are using a special column type? I think we need a snippet of the relation declaration to understand your schema We are currently working on automatic horizontal fragmentation with distribution to indeed handle them as single tables. To understand if MonetDB is the solution to your problem, it is also relevant to know what kind of queries you intend to run. We know there are users moving MonetDB into this direction (sizewise) and we would certainly be interested in learning the problems encountered. Given, of course, you have the time to help us on this track and you know of any database system that can already solve the problem out of the box. regards, Martin Kersten > > > Well I dont really need it right now, but I want to be prepared. > > My option up til now has been to use MySQL and to do some kind of > sharding using alot of databases. > But that complicates stuff alot since I still want to do selects in > this gigantic table and that will be a bit of a problem doing selects > if the data is split up in 8000 different MySQL databases. > > Do You think MonetDB could handle this in one single table? > Even if MonetDB could handle this I still will need a hard disk of > 1000TB, do You know of any technique merging many computers together > into one virtiualized hard drive that MonetDB would accept? > > Thank You very much! > > Best regards > Thomas Backlund, > Sweden. >

1 0

Re: [MonetDB-users] Shell script to start MonetDB as service on Linux
by McKennirey.Matthew 13 Dec '07

13 Dec '07

Fabian, thanks for your quick reply, and pointing me in the right direction. We are running on OpenSuse, and for the moment have settled on the following script. I'm sure it could use a lot of improvement, but we are up and running ********** !/bin/sh # Portions Copyright (c) 1995-2002 SuSE Linux AG Nuernberg, Germany. # Author: Lenz Grimmer <feedback(a)suse.de> # # /etc/init.d/monetdb ### BEGIN INIT INFO # Provides: monetdb # Required-Start: $network $remote_fs # Required-Stop: # Default-Start: 2 3 5 # Default-Stop: # Description: Start the MonetDB database server ### END INIT INFO # Shell functions sourced from /etc/rc.status: # rc_check check and set local and overall rc status # rc_status check and set local and overall rc status # rc_status -v ditto but be verbose in local rc status # rc_status -v -r ditto and clear the local rc status # rc_failed set local and overall rc status to failed # rc_failed <num> set local and overall rc status to <num> # rc_reset clear local rc status (overall remains) # rc_exit exit appropriate to overall rc status /etc/rc.status # First reset status of this service rc_reset # Return values acc. to LSB for all commands but status: # 0 - success # 1 - generic or unspecified error # 2 - invalid or excess argument(s) # 3 - unimplemented feature (e.g. "reload") # 4 - insufficient privilege # 5 - program is not installed # 6 - program is not configured # 7 - program is not running # # update these as appropriate for your server MDB_USER='root' MDB_GROUP='root' MDB_HOME=/srv/monetdb MDB_BINDIR=/srv/monetdb/bin echo "" echo "Using configuration at " $MDB_HOME/etc/monetdb5.conf echo "" # Test, if path to merovingian is valid unset MEROVINGIAN if test -x $MDB_BINDIR/merovingian then MEROVINGIAN=$MDB_BINDIR/merovingian fi test "$MEROVINGIAN" || { echo "MonetDB daemon (merovingian) is not available at indicated path:" $MDB_BINDIR "verify path settings in /etc/monetdb"; rc_failed 5; rc_status -v; rc_exit; } depend() { use net } start(){ echo -n "Starting MonetDB/SQL" startproc -s -u $MDB_USER -g $MDB_GROUP $MDB_BINDIR/merovingian # Rmember status and be verbose rc_status -v } stop() { echo -n "Stopping MonetDB/SQL" # shut down mserver if it is running kill -INT $(pidof mserver5) # stop merovingian daemon kill -INT $(pidof merovingian) # Remember status and be verbose rc_status -v } status(){ echo -n "Checking for MonetDb service: " # NOTE: checkproc returns LSB compliant status values. checkproc $MEROVINGIAN rc_status -v } case "$1" in start) start ;; stop) stop ;; status) status ;; restart) stop start ;; *) echo "Usage: {start|stop|status|restart}" exit 1 ;; esac rc_exit

2 1

Re: [MonetDB-users] connecting to monetDB from a Java program
by Ying Zhang 13 Dec '07

13 Dec '07

Hello Gerben, On Dec 13, 2007, at 15:36 , <e.g.broenink(a)student.utwente.nl> <e.g.broenink(a)student.utwente.nl > wrote: > Hello Jennie, > > I got the system working, I can write SOAP messages and execute them > on the server. However there is a new problem. > I'm using the system to execute a few thousand queries, and the > problem is that MonetDB is caching a lot of (intermediate) results, > therefore, after a few honderd queries the server has cached over > 800MB, and the system becomes very slow. Mmm, this is annoying. Do you mean that MonetDB is using more memory ("over 800MB") or is the size of you dbfarm growing? If the memory usage is growing, it sounds like a leak, but I don't know if XRPC is eating up your memory, or is MonetDB doing that (so I cc this e-mail to the monetdb-users mailing-list). It's an interesting problem to investigate. Would you please provide us more information about your problem? - the xml data you are working on - the xquery functions you are using, or are causing your problems - the request messages you use - which version of MonetDB4 are you using? - which OS (and it version) are you using? > I would like to restart the server after a few honderd queries, do > you know how I can do that? (can I send a SOAP message to restart?) > Or is there another way of solving this problem? No, it is not possible to send SOAP messages to restart an Mserver. You might be able to send MIL commands to stop Mserver to stop it, and use a script to check regularly if your Mserver is still running, and (re)start Mserver if it is not running (any more). Jennie

1 0

[MonetDB-users] Shell script to start MonetDB as service on Linux
by Matthew McKennirey 13 Dec '07

13 Dec '07

Is anyone aware of any UNIX shell scripts (bash, bourne, C) that exist to start the MonetDB server as a service on Linux (/etc/init.d). I have successfully (and, well done to the team, painlessly) installed MonetDB from the MonetDB-Mars-SuperBall-SR4.tar.bz2 and tried out the VOC demo. All is well. However I am struggling with merovingian and monetdb trying to figure out how to get things to start correctly in a scripted manner so that the database is ready when the server finishes booting. I have searched the users list, and others and read presentations on the issue of painlessly starting MonetDB (/etc/init.d/monetdb start) but am no further ahead. If anyone has a script I would be grateful. Thanks

2 1

[MonetDB-users] Shell script to start MonetDB as service on Linux
by McKennirey.Matthew 13 Dec '07

13 Dec '07

1 0

[MonetDB-users] Info reg Column Oriented DB
by sateesh 13 Dec '07

13 Dec '07

Hi All, I am evaluating MonetDB for my project and we are planning to Store Semantic Web related info which is basically in RDF Format and wants to use a Colum Oriented DB for this purpose.. Now when i looked at the Sample DB VOC that comes with DB most of the tables have more than two columns. So is this sample (voc) not meant for semantic storage .. Thanks Sateesh -- View this message in context: http://www.nabble.com/Info-reg-Column-Oriented-DB-tp14303148p14303148.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Persistent Stored Modules ?
by Venks 08 Dec '07

08 Dec '07

I need to perform some ETL processing for which I need CURSOR support in a PSAM. I read the meta-data in a CURSOR and dynamically create SQL statements for execution. According to documentation CURSORS are not supported because of the underlying data model in a PSM. This means I can't use PSM for my ETL processing. Let me know if there is anything I could use a PSM in my ETL process. I only wish you had a driver for Ruby. I see that you have PERL, Python and PHP. It would be great if we have a Ruby Library (:- Regards,

3 2

[MonetDB-users] SQL Script execution behaviour
by Venks 08 Dec '07

08 Dec '07

Please find attached 2 scripts namely "test1.sql" and "test2.sql". 1. First execute the script "test1.sql". You will get an error for each and every statement in the script and that's fine. 2. Execute the second script "test2.sql" which will create five simple tables and then execute "test1.sql" again. You will see that the "test1.sql" script executes fine even though it should report errors after the last DELETE statement. In short, it looks like the script stops executing after the first successful SQL statement. It should continue to report errors for all the COPY commands. Thanks,

2 1

[MonetDB-users] Enable/Disable auto-commit
by Venks 08 Dec '07

08 Dec '07

How do I enable/disable auto-commit using "mclient"? Does \A and \a still work? Thanks,

3 2

[MonetDB-users] MonetDB and fast data storage
by Djordje Djokovic 07 Dec '07

07 Dec '07

2 1

[MonetDB-users] Problem with (Tijah) search query for StreetTiVo
by Ying Zhang 07 Dec '07

07 Dec '07

Hello all, When executing the attached search query in the streettivo bobo collection, I get the following errors: $ mclient -lx -p 60000 a.xq MAPI = monetdb@localhost:60000 QUERY = import module namespace stvc = "http://monetdb.cwi.nl/streettivo/search " at "/export/scratch0/streettivo/streettivo/mxq/search.xq"; stvc:search("bobo camperen") ERROR = !ERROR: interpret_params: reverse(param 1): invalid BAT. !ERROR: interpret_params: exist(param 1): evaluation error. !ERROR: interpret_params: not(param 1): evaluation error. $ cat a.xq import module namespace stvc = "http://monetdb.cwi.nl/streettivo/search" at "/export/scratch0/streettivo/streettivo/mxq/search.xq"; stvc:search("bobo camperen") The function "search()" is implemented as the following (see also the attachment): 1. module namespace stvc = "http://monetdb.cwi.nl/streettivo/search"; 2. declare namespace tijah = 'http://dbappl.cs.utwente.nl/pftijah/'; 3. stvc:search($keywords as xs:string) as node()* { 4. let $config := doc("config.xml") 5. (: number of programs to be returned :) 6. let $numPrograms := exactly-one($config/stv-config/nr-programs/ text()) 7. (: number of fragments to be returned per program :) 8. let $numFrags := exactly-one($config/stv-config/nr-fragments/text()) 9. (: number of sentences to be ranked by TIJAH :) 10. let $numSentences := exactly-one($config/stv-config/nr-sentences/ text()) 11. let $query := tijah:tokenize($keywords) 12. let $nexi := if ($query) then 13. concat("//(asr|teletext)[about(.,", $query, ")]// sentence[about(.,", $query, ")]") 14. else "//sentence[about(., asdkjasdkj)]" (: in case query is only a stop word :) 15. let $opt := <TijahOptions ft-index="SpeechOut" returnNumber="{$numSentences}" /> 16. let $res := tijah:queryall-id($nexi,$opt) 17. let $nodes := tijah:nodes($res) 18. let $resultlist := 19. for $pid in distinct-values ($nodes/../@progID) 20. let $sentences := 21. for $s in $nodes[../@progID = $pid] 22. order by tijah:score($res, $s) descending 23. return $s 24. let $best := $sentences[1] 25. let $speech := $best/.. 26. let $pscore := tijah:score($res, exactly-one($best)) 27. order by $pscore descending 28. return element program { 29. attribute thumbnail-image {$speech/@thumbnail_image}, 30. attribute video-file {$speech/@video-file}, 31. attribute startDT {$speech/@startDT}, 32. attribute channel {$speech/@channel}, 33. attribute title {$speech/@title}, 34. attribute progID {$pid}, 35. attribute score {$pscore}, 36. subsequence( 37. for $fragment in $sentences 38. return element fragment { 39. $fragment/@*, 40. $fragment/text() }, 41. 1, $numFrags) } 42. return 43. subsequence($resultlist, 1, $numPrograms) (: first result page :) 44. }; The problem starts in lines 16 and 17. It feels like that the error will occur, as soon as the return value of the function "tijah:queryall-id" or "tijah:nodes" is used. Above error occurs, if I - query the original function, or - skip lines 17 - 43 and return <res>{$res}</res> - skip lines 18 - 43 and return $nodes I use the latest stable version, compiled using the monetdb-install.sh script as the following: $ monetdb-install.sh --prefix=$STV_HOME/monetdb --build=$STV_TEMP/ monetdb_build --enable-xquery --nightly=stable --enable-debug System info: $ uname -a Linux andorea.ins.cwi.nl 2.6.20-1.2933.fc6 #1 SMP Mon Mar 19 11:00:19 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux Would some Tijah experts please have a lot at this problem? I'm not sure if the problem is in the Tijah functions or somewhere else in MonetDB/XQuery. Thanks a lot! Regards, Jennie

1 0

[MonetDB-users] COPY with AUTO_INCREMENT column
by Venks 07 Dec '07

07 Dec '07

Hi, How can I use COPY to load data into a table with a AUTO_INCREMENT column? Just to clarify, the AUTO_INCREMENT column would be the PRIMARY KEY by default and doesn't have any corresponding data in the data file. Thanks,

3 3

[MonetDB-users] COPY - performing SQL processing while COPYing
by Venks 07 Dec '07

07 Dec '07

Hi, Is there are way I can perform some SQL processing while using COPY to load the data? For e.g. I need to load a file into a table but would like to TRIM all the spaces at the beginning and at the end of each column for all VARCHAR Columns. Below is an example in MySQL where I can load the data into a variable first and then load the variable into an actual column. LOAD DATA .... ( @col1_temp, @col2_temp, @col3_temp ) SET col1 = TRIM(@col1_temp), SET col2 = TRIM(@col2_temp), SET col3 = TRIM(@col3_temp) @<variable> stores the initial value of each field and then you can use most of the default SQL functions on the variable before inserting the data. The advantage here is the ability to perform some basic transformations on the data to adhere to the column definitions instead of loading into a temp table and then performing the transformations to load into the actual table. This really helps when loading billions of rows and 100G worth of data. Thanks,

2 1