- users-list - monetdb.org

[MonetDB-users] Change schema for already existing tables
by Travis Brady 22 Jan '08

22 Jan '08

Hello, Is it possible to change the schema for tables that have already been created and populated? I'd like to avoid having to fully recreate everything as the load process will likely take a few days at least. thank you, Travis Brady

5 5

[MonetDB-users] Problems with COPY INTO and CHAR(N) columns containing empty strings or all spaces
by Bob Ippolito 22 Jan '08

22 Jan '08

We've had problems with MonetDB SR5 using COPY INTO with data that may be the empty string or all spaces. We've been able to work around this by surrounding all of the values in our copy files with "quotes" (I read tablet.c to try and diagnose the issue and found that as a workaround). I'm not familiar enough with the source and build process yet to submit a patch. We are using '\t' as the separator and the fields that we've had problem with are CHAR(2) or CHAR(16) if that matters. -bob

2 3

[MonetDB-users] Optimal filesystem/platform choices for MonetDB?
by Bob Ippolito 22 Jan '08

22 Jan '08

We've started doing a big import of data into SR5 and I've noticed that it's creating *A LOT* of files. So far we've got about 620k files for 6.7 GB of bat. I expect that a full import should have at least 20 times what's imported so far. It seems that loading data is relatively slow compared to PostgreSQL (we're using COPY) and I'm guessing it's due to all of these files. Right now we're using ext3 on amd64 ubuntu linux. Should we be looking at other platforms? -bob

2 3

[MonetDB-users] Core dump on first connect by mclient in BUNinplace
by Bob Ippolito 22 Jan '08

22 Jan '08

So we've been testing out a big ETL and it crashed again, and now every time we start mserver5 it will seemingly start up ok but as soon as mclient connects it will crash. I've generated a core dump. The db farm is 3.6GB and the core dump is 15MB. I can send either to someone if they need it to look further into the issue. The platform is 2.6.20-15-generic (root@yellow) (gcc version 4.1.2 (Ubuntu 4.1.2-0ubuntu4)) #2 SMP on amd64. It's running an unmodified SR5 superball that we compiled ourselves. I tried looking at strace and the --debug option with all of the flags on but it didn't produce anything that looked very interesting. The backtrace is here: Core was generated by `//mochi/bin/mserver5 --dbname=mochiads_stats --dbinit=include sql; --dbfarm=/da'. Program terminated with signal 11, Segmentation fault. #0 0x00002b88a35bf285 in BUNinplace (b=0x12458e8, p=0x0, h=<value optimized out>, t=0x1246eb0, force=1 '\001') at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB/src/gdk/gdk_bat.mx:1555 1555 ATOMreplace(b->ttype, b->theap, BUNtloc(b, p), t); (gdb) bt #0 0x00002b88a35bf285 in BUNinplace (b=0x12458e8, p=0x0, h=<value optimized out>, t=0x1246eb0, force=1 '\001') at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB/src/gdk/gdk_bat.mx:1555 #1 0x00002b88a35bfb75 in void_inplace (b=0x12458e8, id=1, val=0x1245a20, force=1 '\001') at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB/src/gdk/gdk_bat.mx:1671 #2 0x00002b88a35bfc33 in void_replace_bat (b=0x12458e8, u=0x1246d08, force=<value optimized out>) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB/src/gdk/gdk_bat.mx:1688 #3 0x00002aaab26c9a5a in load_bat (sname=<value optimized out>, tname=<value optimized out>, bname=<value optimized out>, type=<value optimized out>, sz=<value optimized out>, cnt=0x1214400) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/bat/bat_storage.mx:364 #4 0x00002aaab26c9b83 in create_col (tr=<value optimized out>, c=0x1245878) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/bat/bat_storage.mx:456 #5 0x00002aaab26c44a9 in load_table (tr=0xd3dec8, s=0xd3df38, rid=149) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/store.mx:511 #6 0x00002aaab26c5523 in load_trans (tr=0xd3dec8, id=1128) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/store.mx:845 #7 0x00002aaab26c6ff4 in store_init (debug=<value optimized out>, store=<value optimized out>, logdir=<value optimized out>, dbname=<value optimized out>, stk=0) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/storage/store.mx:1318 #8 0x00002aaab26aab79 in mvc_init (debug=0, store=store_bat, stk=0) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/server/sql_mvc.mx:246 #9 0x00002aaab2665c97 in SQLinit (c=<value optimized out>) at /ufs/sjoerd/src/MonetDB/virgin-stable/sql/src/backends/monet5/sql_scenario.mx:225 #10 0x00002b88a2c7d42a in initScenario (c=0x604980, s=0x2b88a2e934d0) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB5/src/mal/mal_scenario.mx:264 #11 0x00002b88a2c58d82 in MSscheduleClient (command=0xb0a1b8 "LIT", challenge=0x41000fd0 "KdhtXMmr29n", fin=0xb10270, fout=0xb03030) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB5/src/mal/mal_session.mx:342 #12 0x00002aaab0e78247 in doChallenge (cmd=<value optimized out>, in=<value optimized out>, out=<value optimized out>) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB5/src/modules/mal/mserver.mx:482 #13 0x00002aaab0e79036 in SERVERlistenThread (Sock=<value optimized out>) at /ufs/sjoerd/src/MonetDB/virgin-stable/MonetDB5/src/modules/mal/mserver.mx:564 #14 0x00002b88a43122a5 in start_thread () from /lib/libpthread.so.0 #15 0x00002b88a4ff261d in clone () from /lib/libc.so.6 #16 0x0000000000000000 in ?? () -bob

2 2

Re: [MonetDB-users] MonetDB/SQL 64-bit
by Martin Kersten 22 Jan '08

22 Jan '08

Stefan Manegold wrote: > Hi Peter, > > unfortunately, this still does not help us much --- at least not me (but I'm > everything but a Windows expert) ... > the 4 tutorial sessions on MonetDB website have been designed to uncover installation errors quickly and to get a first working session. Is tutorial 1 running? > I know, though, that on Windows both server & client need to be started via > the proper batch scripts (or by clicking on the respective icons) to ensure > evironment and paths are set correctly. > yes, the commands execute a script, which sets paths correctly. locate them to see what is required to properly run both. Especially, if you have manually moved folders around or changed permissions. > To help you any further, (sorry for repeating myself), we'd need to know > the exact error message, or at least the paths/names of DLLs that are not > found. > > Furthermoe, could you please continue mailing to neten(a)cwi.nl (as requested > monet(a)cwi.nl > by the "Rply-To:" in the mail header of bot my first and this reply; or even > better to Monetdb-users(a)lists.sourceforge.net)? --- thus, more people than > just me get to see your problem and can help answering and solving it... > > Stefan > > On Tue, Jan 22, 2008 at 12:51:19AM -0600, Peter Haluska wrote: > >> Hi Stefan, >> >> installation has worked. It looks like that it is having problems with >> system paths while trying to run server file(can not find dlls) or server >> batch file. Thanks. >> >> -Peter >> >> >> >> On Jan 21, 2008 6:24 PM, Stefan Manegold <Stefan.Manegold(a)cwi.nl> wrote: >> >> >>> Dear Peter, >>> >>> thank you very much for your interest in MonetDB! >>> >>> To be of any help for you, it is necessary for us to know exactly what >>> does >>> (not) work for you. >>> >>> Does it install? >>> Can you start a server? >>> Can you start a client and connect to the server? >>> Can you load data? >>> Can you run a query? >>> >>> Hence, please let us know exactly which steps you took to download, >>> install, >>> start, etc. MonetDB/SQL, where you get stuck, whether you get any error >>> message(s), and if so, which one(s)... >>> >>> Kind regards, >>> Stefan >>> >>> >>> On Mon, Jan 21, 2008 at 06:02:05PM -0600, Peter Haluska wrote: >>> >>>> Hi, we are testing your software MonetDB/SQL >>>> 64-bit< >>>> >>> http://monetdb.cwi.nl/projects/monetdb//download.php?target=http://prdownlo… >>> >>> > on >>> >>>> our new system 'Windows Server 2008 RC1 Enterprise Edition' with 64-bit >>>> support server and we can not make it to work. >>>> Any suggestions? Thanks. >>>> >>>> -Peter >>>> > >

1 0

[MonetDB-users] Unexpected results with COALESCE and aggregates
by Bob Ippolito 21 Jan '08

21 Jan '08

MonetDB SR5 behaves unexpectedly when we've tried to use COALESCE with aggregates, here's an example: sql>CREATE TABLE tmp(a int); sql>SELECT SUM(a) FROM tmp; +-------+ | sum_a | +=======+ | 0 | +-------+ sql>SELECT MIN(a) FROM tmp; +-------------+ | min_a | +=============+ | null | +-------------+ sql>SELECT COALESCE(MIN(a), 0) FROM tmp; sql> For the first SELECT I would expect NULL, the second SELECT is okay, but I expect a result for the third! Here's what PosgreSQL does: bob=# CREATE TABLE tmp(a int); CREATE TABLE bob=# SELECT SUM(A) FROM tmp; sum ----- (1 row) bob=# SELECT MIN(a) FROM tmp; min ----- (1 row) bob=# SELECT COALESCE(MIN(a), 0) FROM tmp; coalesce ---------- 0 -bob

2 2

[MonetDB-users] timestamptz issues with non-GMT
by Bob Ippolito 21 Jan '08

21 Jan '08

We've been playing around with MonetDB-Mars-SuperBall-SR5 for the past couple weeks and we've been having some issues with timestamps. We unfortunately don't do all of our calculations on GMT so we've hit a couple walls because it seems that the MonetDB 5 mtime module doesn't consider timezones: (Yes I know the compiler seems to optimize out the original type if you look at the EXPLAIN output, but this happens for timestamptz coming from tables too) sql>set time zone interval '-08:00' hour to minute; sql>SELECT CAST(TIMESTAMPTZ '2008-01-01 00:00+00:00' AS DATE); +--------------+ | single_value | +==============+ | 2008-01-01 | +--------------+ PostgreSQL has the expected behavior, which accounts for the local time zone when converting timestamps to dates. bob=# SET TIMEZONE TO 'PST8PST8'; SET bob=# SELECT '2008-01-01 00:00+00:00'::timestamptz::date; date ------------ 2007-12-31 (1 row) This is the best I've been able to do, but it's of course ugly and it seems like it could break if the implementation gets fixed: sql>SELECT CAST(TIMESTAMPTZ '2008-01-01 00:00+00' + CURRENT_TIMEZONE AS DATE); +----------------------+ | sql_add_single_value | +======================+ | 2007-12-31 | +----------------------+ Is the "best" solution to just use the GMT timezone (or the TIMESTAMP type) and hardcode our timezone offset everywhere? sql>SELECT CAST(TIMESTAMP '2008-01-01 00:00' - SEC_INTERVAL '28800' AS DATE); +----------------------+ | sql_sub_single_value | +======================+ | 2007-12-31 | +----------------------+ -bob

1 0

[MonetDB-users] "bpm_storage.h" missing when trying to install "sql" module
by xxiao 19 Jan '08

19 Jan '08

Hi, I have sucessfully installed the following modules of MonetDB monetdb version 1.21.0 monetdb-clients version 1.21.0 monetdb4 version 4.21.0 When I continue to install "sql" module, the "make" complains missing file "bpm_storage.h". The platform is Solaris10/SPARC. Anyone here has a hint what has gone wrong? Thank you so much for your attention. Xiang -- View this message in context: http://www.nabble.com/%22bpm_storage.h%22--missing-when-trying-to-install-%… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] mserver5 question
by Claude Monet 18 Jan '08

18 Jan '08

OS: CentOS 4.6 I am only able to initiate mserver5 as su. What should I do to be able to start the server in a user account? Thanks

2 4

Re: [MonetDB-users] tuning advice for TPC-H
by Rahul Chopra 18 Jan '08

18 Jan '08

I thought I would try and ask these questions again, since there was no response. - How does how MonetDB handles its virtual memory? Does it swap out entire BATs at a time? Or just smaller blocks? What type of caching algorithms does it use? - If I configure a large swap, MonetDB is not using it. I guess it allocates based on actual physical memory. If I want to run a test to let the OS handle virtual memory and have MonetDB try and use more of system virtual memory, how do I do that? I am interested in seeing how this affects performance when the database is too large to fit in memory. - Are there any other tuning settings I should set when using a database that is much larger than memory? Thanks in advance, Rahul > ----- Original Message ----- > From: "Rahul Chopra" <rchopra(a)linuxmail.org> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] tuning advice for TPC-H > Date: Thu, 10 Jan 2008 03:14:54 +0800 > > > > I am still trying to get better performance when doing TPC-H tests > for a database more than twice the size of physical memory. > > I am not sure how MonetDB handles its virtual memory, but it sure > seems to be going to disk an awful lot. Does it swap out entire > BATs? Or just smaller blocks? What type of caching algorithms does > it use? > > Also, one of the things I wanted to try is to setup a really big > swap partition on a separate device with write-back cache enabled > and have MonetDB use it (Basically, see if Linux will virtual > memory better than MonetDB does, and take advantage of putting swap > on a separate device for speed). When I try and do that though, > MonetDB seems to just be trying to stay within the confines of > physical memory available. Is there something I can configure to > try and get it to use system virtual memory? Has anyone tried out > anything like that? > > -Rahul > > > > > > > > > > > > > > I am trying to run some TPC-H queries to get a sense for how > > > > large of databases MonetDB can handle. I am currently trying > > a > > factor 20 database. I notice that on query 9, it is taking > > over > > two hours (still running). In "top" it claims that > > virtual > memory > for the process started at 27 GB or so, and is > > now down > to 10 GB. > What is noteworthy is that CPU usage is > > pretty small, > at 2%. I > previously observed 80-100% with a > > factor 1 database. > > > > > > Does this mean you got the sf-20 loaded? What fixed your problem with > > > loading? > > > > Yes, I got it loaded. Since I had broken up the file into smaller > > chunks, I just restarted on the last chunk that it failed on > > before the crash. Eventually, it went through all of the tables. > > > > > > > > The low cpu usage indicates that MonetDB is waiting for IO. I'll later > > > this week try to repeat your experiment on a similar system. Then I'll > > > have more input on how to improve things. > > > > After writing the email I noticed that system CPU wait time was > > at 25%, with MonetDB at 2% and idle at 73% or so. So, yes, it is > > waiting on IO. Perhaps it is just my hardware. > > > > I did disable the 2 GB swap partition and rerun. After doing so, > > execution time did improve somewhat. I am not sure if this means > > one should always disable swap on a MonetDB system, since the > > system drive is slower than the data drives. I will try another > > experiment and let you know the results. > > > > > = > College For Financial Planning > Nation's most successful CFP® Program with 35+ years of experience. > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=0badaaf35b41b0f3ca7504b… > > > -- > Powered by Outblaze > > ------------------------------------------------------------------------- > Check out the new SourceForge.net Marketplace. > It's the best place to buy or sell services for > just about anything Open Source. > http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Las Vegas, Nevada Home for Sale Dave Radcliffe will help you find your Las Vegas new home for sale, dream condo, townhome, or real estate investment property. Search here for all the homes for sale in Las Vegas, Nevada. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=95c6cb18131e4c352f8c920… -- Powered by Outblaze

2 1

[MonetDB-users] Distributed database
by Michaela Buergle 17 Jan '08

17 Jan '08

Hi there, I'm new to MonetDB and trying to figure out if it can be used for a db distributed over several computers. Have any of you tried to do that? Is there any documentation available? Thanks a lot micha

4 7

[MonetDB-users] create database on different drive
by Jos van Dongen 16 Jan '08

16 Jan '08

Hi all, I’m having a few difficulties on a Windows server: - I want to move the dbfarm to another drive and have altered the gdk_farm setting in the etc\monetdb5.conf file: gdk_dbfarm=G:\MonetDB5\dbfarm. MonetDB server however keeps creating a new MonetDB dir in the ‘documents and settings’ directory, the last place where I want to store a database. Do I need to alter other settings, or is there another config file? - How do you create a new database (on the different drive) and connect to that one instead of the standard ‘demo’ db? Met vriendelijke groet/kind regards, Jos van Dongen Tholis Consulting T: 06-51169606 F: 0842-231136 M: jvdongen(a)tholis.com www.tholis.com No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.516 / Virus Database: 269.19.2/1224 - Release Date: 14-1-2008 17:39

3 2

[MonetDB-users] make failed for buildtools/mel
by xxiao 15 Jan '08

15 Jan '08

Hi, I am trying to build MonetDB on SPARC/Solaris 10 platform from scratch. I started from buildtools. bootstrap and configure succeed. make of Mx succeed. make of mel failed. error messages: make[3]: Leaving directory `/tmp/MonetDB-CVS/buildtools/Mx' make[2]: Leaving directory `/tmp/MonetDB-CVS/buildtools/Mx' Making all in mel make[2]: Entering directory `/tmp/MonetDB-CVS/buildtools/mel' make[2]: *** No rule to make target `all'. Stop. make[2]: Leaving directory `/tmp/MonetDB-CVS/buildtools/mel' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/tmp/MonetDB-CVS/buildtools' any help is greatly appreciated! -- View this message in context: http://www.nabble.com/make-failed-for-buildtools-mel-tp14841558p14841558.ht… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Incorrect version (SR4 instead of SR5) linked to from download page
by Bob Ippolito 10 Jan '08

10 Jan '08

The Super Source Tarball referenced on http://monetdb.cwi.nl/projects/monetdb/Download/index.html is SR4, when it should be SR5. I wasted a couple hours trying to make SR4 build correctly on Mac OS X 10.5 when I finally found out that I was building an old version. I re-built with SR5 and everything seems to be working fine so far. -bob

2 1

[MonetDB-users] Sqlalchemy support to be in trunk soon
by m h 10 Jan '08

10 Jan '08

Just thought I'd give any python developers here a heads up. I've recently gotten commit access to sqlalchemy and am planning on pushing Monetdb support in. Hopefully the 0.4.3 release will include it as "experimental". For motivated python users who want to try it know, the source is found at bug 874[0] cheers, matt 0 - http://www.sqlalchemy.org/trac/ticket/874

1 0

Re: [MonetDB-users] tuning advice for TPC-H
by Rahul Chopra 09 Jan '08

09 Jan '08

I am still trying to get better performance when doing TPC-H tests for a database more than twice the size of physical memory. I am not sure how MonetDB handles its virtual memory, but it sure seems to be going to disk an awful lot. Does it swap out entire BATs? Or just smaller blocks? What type of caching algorithms does it use? Also, one of the things I wanted to try is to setup a really big swap partition on a separate device with write-back cache enabled and have MonetDB use it (Basically, see if Linux will virtual memory better than MonetDB does, and take advantage of putting swap on a separate device for speed). When I try and do that though, MonetDB seems to just be trying to stay within the confines of physical memory available. Is there something I can configure to try and get it to use system virtual memory? Has anyone tried out anything like that? -Rahul > > > > > > > > I am trying to run some TPC-H queries to get a sense for how > > > large of databases MonetDB can handle. I am currently trying a > > > factor 20 database. I notice that on query 9, it is taking over > > > two hours (still running). In "top" it claims that virtual > > memory > for the process started at 27 GB or so, and is now down > > to 10 GB. > What is noteworthy is that CPU usage is pretty small, > > at 2%. I > previously observed 80-100% with a factor 1 database. > > > > Does this mean you got the sf-20 loaded? What fixed your problem with > > loading? > > Yes, I got it loaded. Since I had broken up the file into smaller > chunks, I just restarted on the last chunk that it failed on before > the crash. Eventually, it went through all of the tables. > > > > > The low cpu usage indicates that MonetDB is waiting for IO. I'll later > > this week try to repeat your experiment on a similar system. Then I'll > > have more input on how to improve things. > > After writing the email I noticed that system CPU wait time was at > 25%, with MonetDB at 2% and idle at 73% or so. So, yes, it is > waiting on IO. Perhaps it is just my hardware. > > I did disable the 2 GB swap partition and rerun. After doing so, > execution time did improve somewhat. I am not sure if this means > one should always disable swap on a MonetDB system, since the > system drive is slower than the data drives. I will try another > experiment and let you know the results. > = College For Financial Planning Nation's most successful CFP® Program with 35+ years of experience. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=0badaaf35b41b0f3ca7504b… -- Powered by Outblaze

1 0

[MonetDB-users] Info reg the Physical Tables..
by sateesh 08 Jan '08

08 Jan '08

Hi All, If i create two logical tables which has the same column then when MonetDB actually creates the Physical Tables does it create two tables for this Column.. For Ex: I created these two Tables at the Logical Level.. TAB_1 col_1 varchar(100), col_2 int TAB_2 col_3 varchar(256), col_2 int Now I home MonetDB will create these physical tables.. For TAB_1 PHYSICAL_TAB_1 PHYSICAL_TAB_2 OID , COL_1 OID , COL_2 How abt for TAB_2 Does it create PHYSICAL_TAB_3 PHYSICAL_TAB_4 OID , COL_3 OID , COL_2 or Just PHYSICAL_TAB_3 OID , COL_3 Thanks Sateesh -- View this message in context: http://www.nabble.com/Info-reg-the-Physical-Tables..-tp14692698p14692698.ht… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Noob question: Why can I only initiate mserver5 as root?
by Claude Monet 08 Jan '08

08 Jan '08

Logged as root mserver5 works perfectly. Yet when I login as a user and call mserver5: >mserver5 --dbinit="include sql;" I get the error: !FATAL: GDKlockHome: Database lock '.gdk_lock' denied Any help is greatly appreciated

3 2

Re: [MonetDB-users] tuning advice for TPC-H
by Rahul Chopra 08 Jan '08

08 Jan '08

> > > > I am trying to run some TPC-H queries to get a sense for how > > large of databases MonetDB can handle. I am currently trying a > > factor 20 database. I notice that on query 9, it is taking over > > two hours (still running). In "top" it claims that virtual memory > > for the process started at 27 GB or so, and is now down to 10 GB. > > What is noteworthy is that CPU usage is pretty small, at 2%. I > > previously observed 80-100% with a factor 1 database. > > Does this mean you got the sf-20 loaded? What fixed your problem with > loading? Yes, I got it loaded. Since I had broken up the file into smaller chunks, I just restarted on the last chunk that it failed on before the crash. Eventually, it went through all of the tables. > > The low cpu usage indicates that MonetDB is waiting for IO. I'll later > this week try to repeat your experiment on a similar system. Then I'll > have more input on how to improve things. After writing the email I noticed that system CPU wait time was at 25%, with MonetDB at 2% and idle at 73% or so. So, yes, it is waiting on IO. Perhaps it is just my hardware. I did disable the 2 GB swap partition and rerun. After doing so, execution time did improve somewhat. I am not sure if this means one should always disable swap on a MonetDB system, since the system drive is slower than the data drives. I will try another experiment and let you know the results. = Series 7 NASD Exam Training Series 7 and related NASD Exam Books, software and web based training. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=16e765a220119782741a407… -- Powered by Outblaze

1 0

[MonetDB-users] MonetDB scalability
by Djordje Djokovic 08 Jan '08

08 Jan '08

2 1

[MonetDB-users] tuning advice for TPC-H
by Rahul Chopra 08 Jan '08

08 Jan '08

I am trying to run some TPC-H queries to get a sense for how large of databases MonetDB can handle. I am currently trying a factor 20 database. I notice that on query 9, it is taking over two hours (still running). In "top" it claims that virtual memory for the process started at 27 GB or so, and is now down to 10 GB. What is noteworthy is that CPU usage is pretty small, at 2%. I previously observed 80-100% with a factor 1 database. I have 8 GB RAM, with 2 GB RAM swap. System swap is on a slower partition than the data drive, which is a relatively fast RAID 5 disk array. Might I be better off disabling system swap altogether when using MonetDB? Are there any other configuration changes I should make or MonetDB best practices I should follow? Thanks, Rahul = Mercedes Homes- San Antonio real estate Mercedes Homes builds homes and communities in the San Antonio area. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=9c24f83a902bfb70ef8d7bc… -- Powered by Outblaze

2 1

[MonetDB-users] indexes
by Rahul Chopra 07 Jan '08

07 Jan '08

Hello, I was just curious, what happens behind the scenes when an index is created in MonetDB? I noticed it is instantaneous... just wondering why. Is the BAT file reordered (for a single column index) kind of like for a clustered index, or is a separate index created? Thanks, Rahul = Truelife Financial Get the loan you deserve today regardless your credit history. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=cc5aa117b4038bf76c9b23d… -- Powered by Outblaze

2 1

[MonetDB-users] loading data
by Rahul Chopra 07 Jan '08

07 Jan '08

I ran into some problems loading data for doing some TPC-H tests. After a successful test for a factor 1 database, I moved on to test a factor 20 database. mserver5 appeared to crash when loading partsupp, orders, or lineitem. On a hunch, I ran split on these to ensure that each file was less than 2 GB each, splitting partsupp and orders into two files, and orders into 10. After doing this, partsupp and orders loaded without any problems. However, lineitem would cause mserver5 to crash after loading 2 or 3 of the 1.5 GB chunks. Also, in restarting mserver5, I noticed that CPU usage was sometimes heavy for a while, before starting loading. I am guessing it is doing some recovery or cleanup? Is loading an issue? Since it was busy upon restart, do I need to wait a while before loading a new file to give the system some time to do any housekeeping or something? I am using the latest released sources (not from HEAD), compiled on CentOS 5.1 (64 bit). Thanks, Rahul = Live Answering Service Answering. Live operators 24/7. Rates start at $39/100 calls. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=202d1706cc4cee71bfb381f… -- Powered by Outblaze

2 1

Re: [MonetDB-users] gdk_mem_bigsize and gdk_vm_minsize
by Rahul Chopra 03 Jan '08

03 Jan '08

> > On Fri, Jan 04, 2008 at 12:09:05AM +0800, Rahul Chopra wrote: > > Can you please explain gdk_mem_bigsize and gdk_vm_minsize? I > > searched around on the site and I am not really clear on what the > > optimal settings for these are. > > Memory blocks allocated via GDKmalloc and friends larger then > gdk_mem_bigsize will be mmaped using virtual swap space (vmalloc). This > is done to avoid fragmentation. So this is just for an individual block, and not for total allocated memory? Is a "block" allocated via entire BATs? Or are blocks allocated in segments when read from a single BAT? > > BATs have heaps, these can be malloced (GDKmalloc), virtual mmapped > using swap space (GDKvmalloc) or mmapped (needs a filename). > Blocks (heaps) larger then vm_minsize will be vmalloced. > The backends (sql/xquery) control when we switch to mmapped with files. > > > > > I am currently using the defaults, on a system with 8 GB of RAM. > It depends on your os if thats okay. Thanks. I am using Linux (64 bit), CentOS 5.1. My main concern was if setting these too low somehow restricts the amount of memory used and leads to more swapping. I am not familiar enough with the system to understand all of this, but with 8 GB of ram, should I be using a larger gdk_mem_bigsize than the config default of 262144? The config file mentions these being set to 1/2 of available memory, but default values appear commented out. Are those the values that are actually used? Or, if these are commented out, are these dynamically set? -Rahul > > Niels > > > > Thanks, > > > > Rahul > > > > > > = > > Limousine and Luxury Bus Wine Tours > > Private Napa & Sonoma wine-tasting tours via luxury limousine or bus. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=2c5439db6084d9969b4f63e… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2005. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Mercedes Homes - In FL, TX, NC, & SC Mercedes Homes builds homes in Florida, Texas, and the Carolinas. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=e0639e1f90664efd0041110… -- Powered by Outblaze

2 1

Re: [MonetDB-users] killing queries
by Rahul Chopra 03 Jan '08

03 Jan '08

Thanks for the information, I understand. Other than killing the client application, is there a way to separately connect to the server and gracefully kill the query or connection? > ----- Original Message ----- > From: "Niels Nes" <Niels.Nes(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] killing queries > Date: Thu, 3 Jan 2008 17:47:45 +0100 > > > On Fri, Jan 04, 2008 at 12:06:37AM +0800, Rahul Chopra wrote: > > How can I safely kill queries? > > > > I notice if I ctrl-c out of mclient when executing a long run > > query, mserver5 still seems to be using a lot of memory, maybe it > > has not deallocated it all? Also, if I start a new mclient > > session queries now run slower. Of course, one should always > > avoid ctrl-c, but in case we do have multiple queries running and > > we wish to kill a long running one for some reason, is there a > > way to safely do so? (Like, start a new mclient session, and > > execute some kind of admin commands). > Resources taken because of killed clients should disappear. This can > however take some time as the cleanup is only done within the > interpreter loop. Also we keep the used persistent tables in memory. > They only get freed when running out of memory or when idle for some > time. > > I'm not sure which version your using, but also the current released > version has some memory leaks which maybe the reason for your memory > growth and slowdown. > > Niels > > > > TIA > > > > > > = > > Espresso Machines - Free Shipping > > Espresso Machines, coffee beans and pods, cappuccino cups and > > spoons. Free shipping. No sales tax. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=8427826bf39d56eb7c331a1… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2005. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Area Homes Realty Online Home Search Area Homes Realty is a full service residential real estate company servicing Eastern Massachusetts. Our website is a valuable resource of information whether you are buying or selling. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=6d65a7e04b5c96a53badb07… -- Powered by Outblaze

2 1

[MonetDB-users] gdk_mem_bigsize and gdk_vm_minsize
by Rahul Chopra 03 Jan '08

03 Jan '08

Can you please explain gdk_mem_bigsize and gdk_vm_minsize? I searched around on the site and I am not really clear on what the optimal settings for these are. I am currently using the defaults, on a system with 8 GB of RAM. Thanks, Rahul = Limousine and Luxury Bus Wine Tours Private Napa & Sonoma wine-tasting tours via luxury limousine or bus. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=2c5439db6084d9969b4f63e… -- Powered by Outblaze

2 1

[MonetDB-users] killing queries
by Rahul Chopra 03 Jan '08

03 Jan '08

How can I safely kill queries? I notice if I ctrl-c out of mclient when executing a long run query, mserver5 still seems to be using a lot of memory, maybe it has not deallocated it all? Also, if I start a new mclient session queries now run slower. Of course, one should always avoid ctrl-c, but in case we do have multiple queries running and we wish to kill a long running one for some reason, is there a way to safely do so? (Like, start a new mclient session, and execute some kind of admin commands). TIA = Espresso Machines - Free Shipping Espresso Machines, coffee beans and pods, cappuccino cups and spoons. Free shipping. No sales tax. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=8427826bf39d56eb7c331a1… -- Powered by Outblaze

2 1

[MonetDB-users] mserver5 daemon
by Rahul Chopra 03 Jan '08

03 Jan '08

I had a question about using the daemon option. If I start mserver5 with daemon=yes, it seems to stop: ./mserver5 --dbinit="include sql;" --dbname=db1 --daemon=yes & [1] 10038 [monetdb@localhost bin]$ # MonetDB server v5.2.0, based on kernel v1.20.0 # Serving database 'db1' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /home/monetdb/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.0 loaded [1]+ Stopped ./mserver5 --dbinit="include sql;" --dbname=db1 --daemon=yes If I leave off &, I still get a > prompt and can interact with it. I also tried nohup. I am not sure what I need to do to get the server running in the background and keep it running without it being in the foreground.... = nantucket vacation in Nantucket, MA Sanford Real Estate provides professional real estate services in Nantucket, Massachusetts. Visit us today for home buying, selling, rentals and more. Customer satisfaction is our priority. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=751b4f3b7386a2440fa9cc8… -- Powered by Outblaze

2 1

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Just letting you know I compiled on CentOS 5.1, and it appears to be working now. Thanks for the help. > ----- Original Message ----- > From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 17:59:18 +0100 > > > > Yes, it seems you are right. Download the SuperSourceBall and compile > from that. > The website indicates that the latest stable version works on Centoo. > http://monetdb.cwi.nl/testing/projects/monetdb/Stable/sql5/.mTests103/index… > > Rahul Chopra wrote: > > Hi Martin, > > > > I am now running as a non-root user. > > > > Here is the output from the stack trace: > > > > Program received signal SIGSEGV, Segmentation fault. > > [Switching to Thread 46912496255632 (LWP 23889)] > > 0x0000000000000000 in ?? () > > > > (gdb) bt > > #0 0x0000000000000000 in ?? () > > #1 0x0000003a1e026d9e in _rl_init_terminal_io () > > from /usr/lib64/libreadline.so.5 > > #2 0x0000003a1e013f07 in rl_initialize () from /usr/lib64/libreadline.so.5 > > #3 0x0000003a1e014d07 in readline () from /usr/lib64/libreadline.so.5 > > #4 0x00000038d3c4e98d in getConsoleInput () from /usr/lib64/libmal.so.0 > > #5 0x00000038d3c4f089 in readConsole () from /usr/lib64/libmal.so.0 > > #6 0x00000038d3c195ee in MALreader () from /usr/lib64/libmal.so.0 > > #7 0x00000038d3c463d6 in runScenarioBody () from /usr/lib64/libmal.so.0 > > #8 0x00000038d3c465be in runScenario () from /usr/lib64/libmal.so.0 > > #9 0x00000038d3c196f0 in MSserveClient () from /usr/lib64/libmal.so.0 > > > > Maybe FC7 RPMs cannot run on CentOS 5.1. I may try building > > manually. Thank you and sorry for the trouble. > > > > > > > >> ----- Original Message ----- > >> From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > >> To: "Communication channel for MonetDB users" > >> <monetdb-users(a)lists.sourceforge.net> > >> Subject: Re: [MonetDB-users] Cannot start mserver5 > >> Date: Fri, 28 Dec 2007 15:56:14 +0100 > >> > >> > >> Rahul, > >> > >> I seen you run as root, something one normally doesn't do, but that's > >> your decision > >> and won't affect MonetDB. > >> > >> I have no clue as what ocal configuration setting interferes with the > >> packages. > >> You might run 'gdb mserver5 --dbinit="include sql;"' and > >> sent us the stack trace. > >> > >> Rahul Chopra wrote: > >> > >>> Thank you for the clarification, I did miss that one. I have > >>> now installed it. Here is what happens now: > >>> > >>> [root@localhost bin]# mserver5 --dbinit="include sql;" > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> # MonetDB/SQL module v2.20.2 loaded > >>> [root@localhost bin]# > >>> > >>> It immediately exits without an error message instead of giving > >>> me a prompt. In the getting started guide it mentions to check > >>> your $PATH. It does include /usr/bin: > >>> > >>> [root@localhost bin]# echo $PATH > >>> /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin > >>> > >>> Is there something else I must do? I have not changed the configuration. > >>> > >>> > >>> More info: > >>> > >>> [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 > >>> /usr/bin/Mbeddedsql5 > >>> /usr/bin/merovingian > >>> /usr/bin/monetdb > >>> /usr/lib64/MonetDB5/lib/lib_sql.so > >>> /usr/lib64/MonetDB5/lib/lib_sql.so.0 > >>> /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 > >>> /usr/lib64/MonetDB5/sql.mal > >>> /usr/lib64/libembeddedsql5.so.0 > >>> /usr/lib64/libembeddedsql5.so.0.0.0 > >>> /usr/share/man/man1/merovingian.1.gz > >>> /usr/share/man/man1/monetdb.1.gz > >>> > >>> > >>> [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 > >>> /usr/share/MonetDB/sql > >>> /usr/share/MonetDB/sql/bbp.sql > >>> /usr/share/MonetDB/sql/cache.sql > >>> /usr/share/MonetDB/sql/dependency_functions.sql > >>> /usr/share/MonetDB/sql/math.sql > >>> /usr/share/MonetDB/sql/ms_functions.sql > >>> /usr/share/MonetDB/sql/mtime.sql > >>> /usr/share/MonetDB/sql/stats.sql > >>> /usr/share/MonetDB/sql/url.sql > >>> /usr/share/doc/MonetDB-SQL-2.20.2 > >>> /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL > >>> /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt > >>> /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html > >>> /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt > >>> > >>> [root@localhost bin]# mserver5 --xproperties > >>> # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu > >>> # builtin opt gdk_version = 1.20.0 > >>> # builtin opt monet_pid = 23171 > >>> # builtin opt prefix = /usr > >>> # builtin opt exec_prefix = /usr > >>> # builtin opt gdk_dbname = tst > >>> # builtin opt gdk_dbfarm = /var/MonetDB > >>> # builtin opt gdk_debug = 8 > >>> # builtin opt gdk_mem_bigsize = 262144 > >>> # builtin opt gdk_vm_minsize = 137438953472 > >>> # builtin opt gdk_alloc_map = yes > >>> # builtin opt gdk_mem_pagebits = 14 > >>> # builtin opt gdk_vmtrim = yes > >>> # builtin opt monet_admin = adm > >>> # builtin opt monet_prompt = > > >>> # builtin opt monet_welcome = yes > >>> # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin > >>> # builtin opt monet_daemon = yes > >>> # builtin opt host = localhost > >>> # builtin opt mapi_port = 50000 > >>> # builtin opt mapi_noheaders = no > >>> # builtin opt mapi_debug = 0 > >>> # builtin opt mapi_clients = 2 > >>> # builtin opt sql_debug = 0 > >>> # builtin opt sql_logdir = /var/MonetDB/sql_logs > >>> # builtin opt xquery_logdir = /var/MonetDB/xquery_logs > >>> # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > >>> # builtin opt standoff_start = start > >>> # builtin opt standoff_end = end > >>> # config opt prefix = /usr > >>> # config opt config = /etc/monetdb5.conf > >>> # config opt prefix = /usr > >>> # config opt exec_prefix = /usr > >>> # config opt gdk_dbfarm = /var/MonetDB5/dbfarm > >>> # config opt gdk_dbname = demo > >>> # config opt gdk_alloc_map = no > >>> # config opt gdk_embedded = no > >>> # config opt gdk_debug = 0 > >>> # config opt monet_mod_path = > >>> /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin > >>> # config opt monet_daemon = no > >>> # config opt monet_welcome = yes > >>> # config opt mero_msglog = /var/log/merovingian.log > >>> # config opt mero_errlog = /var/log/merovingian.log > >>> # config opt mero_timeinterval = 600 > >>> # config opt mero_exittimeout = 7 > >>> # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal > >>> # config opt mal_listing = 15 > >>> # config opt checkpoint_dir = /var/MonetDB5/chkpnt > >>> # config opt mapi_port = 0 > >>> # config opt mapi_open = false > >>> # config opt sql_debug = 0 > >>> # config opt sql_logdir = /var/MonetDB5/sql_logs > >>> # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> [root@localhost bin]# > >>> > >>> > >>> > >>> > >>> > >>>> ----- Original Message ----- > >>>> From: "Niels Nes" <Niels.Nes(a)cwi.nl> > >>>> To: "Communication channel for MonetDB users" > >>>> <monetdb-users(a)lists.sourceforge.net> > >>>> Subject: Re: [MonetDB-users] Cannot start mserver5 > >>>> Date: Fri, 28 Dec 2007 09:44:56 +0100 > >>>> > >>>> > >>>> On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > >>>> > >>>> > >>>>> Hello, > >>>>> > >>>>> I installed a copy of MonetDB on CentOS 5.1, but don't seem > >>>>> to be able to start it. I installed the RPMs, and then wanted > >>>>> to follow the "Getting Started" page on your website. > >>>>> > >>>>> > >>>>> [root@localhost ~]# mserver5 --dbinit="include sql;" > >>>>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>>>> # Serving database 'demo' > >>>>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>>>> dynamically linked > >>>>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>>>> # Visit http://monetdb.cwi.nl/ for further information > >>>>> #warning: please don't forget to set your vault key! > >>>>> #(see /etc/monetdb5.conf) > >>>>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>>>> !MALException:malInclude:could not open file: sql > >>>>> > >>>>> [root@localhost ~]# uname -a > >>>>> Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov > >>>>> 12 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > >>>>> > >>>>> [root@localhost ~]# rpm -qa | grep MonetDB > >>>>> MonetDB-client-1.20.2-1.fc7.oid64 > >>>>> MonetDB-1.20.0-3.fc7.oid64 > >>>>> MonetDB-SQL-2.20.2-1.fc7.oid64 > >>>>> MonetDB5-server-5.2.2-1.fc7.oid64 > >>>>> > >>>>> Any idea what I am doing wrong? > >>>>> > >>>>> > >>>> You need to also install the MonetDB-SQL-server5 rpm > >>>> > >>>> Niels > >>>> > >>>> > >>>> > >>>> > >>>>> Regards, > >>>>> > >>>>> Rahul > >>>>> > >>>>> > >>>>> > >>>>> = > >>>>> Criminal Justice Degrees > >>>>> Online Criminal Justice studies - Free info pack now. > >>>>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > >>>>> > >>>>> > >>>>> -- Powered by Outblaze > >>>>> > >>>>> ------------------------------------------------------------------------- > >>>>> This SF.net email is sponsored by: Microsoft > >>>>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>>>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>>>> _______________________________________________ > >>>>> MonetDB-users mailing list > >>>>> MonetDB-users(a)lists.sourceforge.net > >>>>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>>>> > >>>>> > >>>> -- > >>>> > >>>> Niels Nes, Centre for Mathematics and Computer Science (CWI) > >>>> Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > >>>> room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > >>>> url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > >>>> > >>>> ------------------------------------------------------------------------- > >>>> This SF.net email is sponsored by: Microsoft > >>>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>>> _______________________________________________ > >>>> MonetDB-users mailing list > >>>> MonetDB-users(a)lists.sourceforge.net > >>>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>>> > >>>> > >>> > >>> > >>> = > >>> Looking for HR Software? > >>> BillQuick HR will help you manage your employees more efficiently. > >>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… > >>> > >>> > >>> > >>> > >> ------------------------------------------------------------------------- > >> This SF.net email is sponsored by: Microsoft > >> Defy all challenges. Microsoft(R) Visual Studio 2005. > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >> _______________________________________________ > >> MonetDB-users mailing list > >> MonetDB-users(a)lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >> > > > > > > > > > > = > > Illinois Real Estate > > Search approximately 80,000 listings - easy to use and consumer-friendly. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=cd5e8640812a8f246564650… > > > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Aliante - Las Vegas Valley, Nevada Welcome to the beautiful new residential master-planned community of Aliante. Browse our site to see a community map, community resources, descriptions and builder information. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=1b166d271bb74530d5618e7… = Battery Backups from $25 Huge bargains on UPS power backup systems. Hundreds in stock. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=fcec83cbfc8a5226862cb33… -- Powered by Outblaze

1 0

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Hi Martin, I am now running as a non-root user. Here is the output from the stack trace: Program received signal SIGSEGV, Segmentation fault. [Switching to Thread 46912496255632 (LWP 23889)] 0x0000000000000000 in ?? () (gdb) bt #0 0x0000000000000000 in ?? () #1 0x0000003a1e026d9e in _rl_init_terminal_io () from /usr/lib64/libreadline.so.5 #2 0x0000003a1e013f07 in rl_initialize () from /usr/lib64/libreadline.so.5 #3 0x0000003a1e014d07 in readline () from /usr/lib64/libreadline.so.5 #4 0x00000038d3c4e98d in getConsoleInput () from /usr/lib64/libmal.so.0 #5 0x00000038d3c4f089 in readConsole () from /usr/lib64/libmal.so.0 #6 0x00000038d3c195ee in MALreader () from /usr/lib64/libmal.so.0 #7 0x00000038d3c463d6 in runScenarioBody () from /usr/lib64/libmal.so.0 #8 0x00000038d3c465be in runScenario () from /usr/lib64/libmal.so.0 #9 0x00000038d3c196f0 in MSserveClient () from /usr/lib64/libmal.so.0 Maybe FC7 RPMs cannot run on CentOS 5.1. I may try building manually. Thank you and sorry for the trouble. > ----- Original Message ----- > From: "Martin Kersten" <Martin.Kersten(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 15:56:14 +0100 > > > Rahul, > > I seen you run as root, something one normally doesn't do, but that's > your decision > and won't affect MonetDB. > > I have no clue as what ocal configuration setting interferes with the > packages. > You might run 'gdb mserver5 --dbinit="include sql;"' and > sent us the stack trace. > > Rahul Chopra wrote: > > Thank you for the clarification, I did miss that one. I have now > > installed it. Here is what happens now: > > > > [root@localhost bin]# mserver5 --dbinit="include sql;" > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > # MonetDB/SQL module v2.20.2 loaded > > [root@localhost bin]# > > > > It immediately exits without an error message instead of giving > > me a prompt. In the getting started guide it mentions to check > > your $PATH. It does include /usr/bin: > > > > [root@localhost bin]# echo $PATH > > /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin > > > > Is there something else I must do? I have not changed the configuration. > > > > > > More info: > > > > [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 > > /usr/bin/Mbeddedsql5 > > /usr/bin/merovingian > > /usr/bin/monetdb > > /usr/lib64/MonetDB5/lib/lib_sql.so > > /usr/lib64/MonetDB5/lib/lib_sql.so.0 > > /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 > > /usr/lib64/MonetDB5/sql.mal > > /usr/lib64/libembeddedsql5.so.0 > > /usr/lib64/libembeddedsql5.so.0.0.0 > > /usr/share/man/man1/merovingian.1.gz > > /usr/share/man/man1/monetdb.1.gz > > > > > > [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 > > /usr/share/MonetDB/sql > > /usr/share/MonetDB/sql/bbp.sql > > /usr/share/MonetDB/sql/cache.sql > > /usr/share/MonetDB/sql/dependency_functions.sql > > /usr/share/MonetDB/sql/math.sql > > /usr/share/MonetDB/sql/ms_functions.sql > > /usr/share/MonetDB/sql/mtime.sql > > /usr/share/MonetDB/sql/stats.sql > > /usr/share/MonetDB/sql/url.sql > > /usr/share/doc/MonetDB-SQL-2.20.2 > > /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL > > /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt > > /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html > > /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt > > > > [root@localhost bin]# mserver5 --xproperties > > # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu > > # builtin opt gdk_version = 1.20.0 > > # builtin opt monet_pid = 23171 > > # builtin opt prefix = /usr > > # builtin opt exec_prefix = /usr > > # builtin opt gdk_dbname = tst > > # builtin opt gdk_dbfarm = /var/MonetDB > > # builtin opt gdk_debug = 8 > > # builtin opt gdk_mem_bigsize = 262144 > > # builtin opt gdk_vm_minsize = 137438953472 > > # builtin opt gdk_alloc_map = yes > > # builtin opt gdk_mem_pagebits = 14 > > # builtin opt gdk_vmtrim = yes > > # builtin opt monet_admin = adm > > # builtin opt monet_prompt = > > > # builtin opt monet_welcome = yes > > # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin > > # builtin opt monet_daemon = yes > > # builtin opt host = localhost > > # builtin opt mapi_port = 50000 > > # builtin opt mapi_noheaders = no > > # builtin opt mapi_debug = 0 > > # builtin opt mapi_clients = 2 > > # builtin opt sql_debug = 0 > > # builtin opt sql_logdir = /var/MonetDB/sql_logs > > # builtin opt xquery_logdir = /var/MonetDB/xquery_logs > > # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > > # builtin opt standoff_start = start > > # builtin opt standoff_end = end > > # config opt prefix = /usr > > # config opt config = /etc/monetdb5.conf > > # config opt prefix = /usr > > # config opt exec_prefix = /usr > > # config opt gdk_dbfarm = /var/MonetDB5/dbfarm > > # config opt gdk_dbname = demo > > # config opt gdk_alloc_map = no > > # config opt gdk_embedded = no > > # config opt gdk_debug = 0 > > # config opt monet_mod_path = > > /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin > > # config opt monet_daemon = no > > # config opt monet_welcome = yes > > # config opt mero_msglog = /var/log/merovingian.log > > # config opt mero_errlog = /var/log/merovingian.log > > # config opt mero_timeinterval = 600 > > # config opt mero_exittimeout = 7 > > # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal > > # config opt mal_listing = 15 > > # config opt checkpoint_dir = /var/MonetDB5/chkpnt > > # config opt mapi_port = 0 > > # config opt mapi_open = false > > # config opt sql_debug = 0 > > # config opt sql_logdir = /var/MonetDB5/sql_logs > > # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > [root@localhost bin]# > > > > > > > > > >> ----- Original Message ----- > >> From: "Niels Nes" <Niels.Nes(a)cwi.nl> > >> To: "Communication channel for MonetDB users" > >> <monetdb-users(a)lists.sourceforge.net> > >> Subject: Re: [MonetDB-users] Cannot start mserver5 > >> Date: Fri, 28 Dec 2007 09:44:56 +0100 > >> > >> > >> On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > >> > >>> Hello, > >>> > >>> I installed a copy of MonetDB on CentOS 5.1, but don't seem to > >>> be able to start it. I installed the RPMs, and then wanted to > >>> follow the "Getting Started" page on your website. > >>> > >>> > >>> [root@localhost ~]# mserver5 --dbinit="include sql;" > >>> # MonetDB server v5.2.2, based on kernel v1.20.0 > >>> # Serving database 'demo' > >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > >>> dynamically linked > >>> # Copyright (c) 1993-2007 CWI, all rights reserved > >>> # Visit http://monetdb.cwi.nl/ for further information > >>> #warning: please don't forget to set your vault key! > >>> #(see /etc/monetdb5.conf) > >>> # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > >>> !MALException:malInclude:could not open file: sql > >>> > >>> [root@localhost ~]# uname -a > >>> Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 > >>> 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > >>> > >>> [root@localhost ~]# rpm -qa | grep MonetDB > >>> MonetDB-client-1.20.2-1.fc7.oid64 > >>> MonetDB-1.20.0-3.fc7.oid64 > >>> MonetDB-SQL-2.20.2-1.fc7.oid64 > >>> MonetDB5-server-5.2.2-1.fc7.oid64 > >>> > >>> Any idea what I am doing wrong? > >>> > >> You need to also install the MonetDB-SQL-server5 rpm > >> > >> Niels > >> > >> > >> > >>> Regards, > >>> > >>> Rahul > >>> > >>> > >>> > >>> = > >>> Criminal Justice Degrees > >>> Online Criminal Justice studies - Free info pack now. > >>> http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > >>> > >>> > >>> -- Powered by Outblaze > >>> > >>> ------------------------------------------------------------------------- > >>> This SF.net email is sponsored by: Microsoft > >>> Defy all challenges. Microsoft(R) Visual Studio 2005. > >>> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >>> _______________________________________________ > >>> MonetDB-users mailing list > >>> MonetDB-users(a)lists.sourceforge.net > >>> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >>> > >> -- > >> > >> Niels Nes, Centre for Mathematics and Computer Science (CWI) > >> Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > >> room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > >> url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > >> > >> ------------------------------------------------------------------------- > >> This SF.net email is sponsored by: Microsoft > >> Defy all challenges. Microsoft(R) Visual Studio 2005. > >> http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > >> _______________________________________________ > >> MonetDB-users mailing list > >> MonetDB-users(a)lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/monetdb-users > >> > > > > > > > > > > = > > Looking for HR Software? > > BillQuick HR will help you manage your employees more efficiently. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… > > > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Illinois Real Estate Search approximately 80,000 listings - easy to use and consumer-friendly. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=cd5e8640812a8f246564650… -- Powered by Outblaze

2 1

Re: [MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Thank you for the clarification, I did miss that one. I have now installed it. Here is what happens now: [root@localhost bin]# mserver5 --dbinit="include sql;" # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.2 loaded [root@localhost bin]# It immediately exits without an error message instead of giving me a prompt. In the getting started guide it mentions to check your $PATH. It does include /usr/bin: [root@localhost bin]# echo $PATH /usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin Is there something else I must do? I have not changed the configuration. More info: [root@localhost bin]# rpm -ql MonetDB-SQL-server5-2.20.2-1.fc7.oid64 /usr/bin/Mbeddedsql5 /usr/bin/merovingian /usr/bin/monetdb /usr/lib64/MonetDB5/lib/lib_sql.so /usr/lib64/MonetDB5/lib/lib_sql.so.0 /usr/lib64/MonetDB5/lib/lib_sql.so.0.0.0 /usr/lib64/MonetDB5/sql.mal /usr/lib64/libembeddedsql5.so.0 /usr/lib64/libembeddedsql5.so.0.0.0 /usr/share/man/man1/merovingian.1.gz /usr/share/man/man1/monetdb.1.gz [root@localhost bin]# rpm -ql MonetDB-SQL-2.20.2-1.fc7.oid64 /usr/share/MonetDB/sql /usr/share/MonetDB/sql/bbp.sql /usr/share/MonetDB/sql/cache.sql /usr/share/MonetDB/sql/dependency_functions.sql /usr/share/MonetDB/sql/math.sql /usr/share/MonetDB/sql/ms_functions.sql /usr/share/MonetDB/sql/mtime.sql /usr/share/MonetDB/sql/stats.sql /usr/share/MonetDB/sql/url.sql /usr/share/doc/MonetDB-SQL-2.20.2 /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL /usr/share/doc/MonetDB-SQL-2.20.2/HowToStart-SQL-Win32.txt /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.html /usr/share/doc/MonetDB-SQL-2.20.2/dump-restore.txt [root@localhost bin]# mserver5 --xproperties # builtin opt gdk_arch = 64bitx86_64-redhat-linux-gnu # builtin opt gdk_version = 1.20.0 # builtin opt monet_pid = 23171 # builtin opt prefix = /usr # builtin opt exec_prefix = /usr # builtin opt gdk_dbname = tst # builtin opt gdk_dbfarm = /var/MonetDB # builtin opt gdk_debug = 8 # builtin opt gdk_mem_bigsize = 262144 # builtin opt gdk_vm_minsize = 137438953472 # builtin opt gdk_alloc_map = yes # builtin opt gdk_mem_pagebits = 14 # builtin opt gdk_vmtrim = yes # builtin opt monet_admin = adm # builtin opt monet_prompt = > # builtin opt monet_welcome = yes # builtin opt monet_mod_path = /usr/lib64/MonetDB:/usr/lib64/bin # builtin opt monet_daemon = yes # builtin opt host = localhost # builtin opt mapi_port = 50000 # builtin opt mapi_noheaders = no # builtin opt mapi_debug = 0 # builtin opt mapi_clients = 2 # builtin opt sql_debug = 0 # builtin opt sql_logdir = /var/MonetDB/sql_logs # builtin opt xquery_logdir = /var/MonetDB/xquery_logs # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff # builtin opt standoff_start = start # builtin opt standoff_end = end # config opt prefix = /usr # config opt config = /etc/monetdb5.conf # config opt prefix = /usr # config opt exec_prefix = /usr # config opt gdk_dbfarm = /var/MonetDB5/dbfarm # config opt gdk_dbname = demo # config opt gdk_alloc_map = no # config opt gdk_embedded = no # config opt gdk_debug = 0 # config opt monet_mod_path = /usr/lib64/MonetDB5:/usr/lib64/MonetDB5/lib:/usr/lib64/MonetDB5/bin # config opt monet_daemon = no # config opt monet_welcome = yes # config opt mero_msglog = /var/log/merovingian.log # config opt mero_errlog = /var/log/merovingian.log # config opt mero_timeinterval = 600 # config opt mero_exittimeout = 7 # config opt mal_init = /usr/lib64/MonetDB5/mal_init.mal # config opt mal_listing = 15 # config opt checkpoint_dir = /var/MonetDB5/chkpnt # config opt mapi_port = 0 # config opt mapi_open = false # config opt sql_debug = 0 # config opt sql_logdir = /var/MonetDB5/sql_logs # config opt sql_init = /usr/lib64/MonetDB5/sql_init.sql # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ [root@localhost bin]# > ----- Original Message ----- > From: "Niels Nes" <Niels.Nes(a)cwi.nl> > To: "Communication channel for MonetDB users" <monetdb-users(a)lists.sourceforge.net> > Subject: Re: [MonetDB-users] Cannot start mserver5 > Date: Fri, 28 Dec 2007 09:44:56 +0100 > > > On Fri, Dec 28, 2007 at 08:16:45AM +0800, Rahul Chopra wrote: > > Hello, > > > > I installed a copy of MonetDB on CentOS 5.1, but don't seem to be > > able to start it. I installed the RPMs, and then wanted to follow > > the "Getting Started" page on your website. > > > > > > [root@localhost ~]# mserver5 --dbinit="include sql;" > > # MonetDB server v5.2.2, based on kernel v1.20.0 > > # Serving database 'demo' > > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs > > dynamically linked > > # Copyright (c) 1993-2007 CWI, all rights reserved > > # Visit http://monetdb.cwi.nl/ for further information > > #warning: please don't forget to set your vault key! > > #(see /etc/monetdb5.conf) > > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > > !MALException:malInclude:could not open file: sql > > > > [root@localhost ~]# uname -a > > Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 > > 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux > > > > [root@localhost ~]# rpm -qa | grep MonetDB > > MonetDB-client-1.20.2-1.fc7.oid64 > > MonetDB-1.20.0-3.fc7.oid64 > > MonetDB-SQL-2.20.2-1.fc7.oid64 > > MonetDB5-server-5.2.2-1.fc7.oid64 > > > > Any idea what I am doing wrong? > You need to also install the MonetDB-SQL-server5 rpm > > Niels > > > > > > Regards, > > > > Rahul > > > > > > > > = > > Criminal Justice Degrees > > Online Criminal Justice studies - Free info pack now. > > http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… > > > > > > -- Powered by Outblaze > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Microsoft > > Defy all challenges. Microsoft(R) Visual Studio 2005. > > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > > _______________________________________________ > > MonetDB-users mailing list > > MonetDB-users(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > = Looking for HR Software? BillQuick HR will help you manage your employees more efficiently. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=a512cd91e758d3cf866e8fb… -- Powered by Outblaze

2 1

[MonetDB-users] Cannot start mserver5
by Rahul Chopra 28 Dec '07

28 Dec '07

Hello, I installed a copy of MonetDB on CentOS 5.1, but don't seem to be able to start it. I installed the RPMs, and then wanted to follow the "Getting Started" page on your website. [root@localhost ~]# mserver5 --dbinit="include sql;" # MonetDB server v5.2.2, based on kernel v1.20.0 # Serving database 'demo' # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ !MALException:malInclude:could not open file: sql [root@localhost ~]# uname -a Linux localhost.localdomain 2.6.18-53.el5xen #1 SMP Mon Nov 12 02:46:57 EST 2007 x86_64 x86_64 x86_64 GNU/Linux [root@localhost ~]# rpm -qa | grep MonetDB MonetDB-client-1.20.2-1.fc7.oid64 MonetDB-1.20.0-3.fc7.oid64 MonetDB-SQL-2.20.2-1.fc7.oid64 MonetDB5-server-5.2.2-1.fc7.oid64 Any idea what I am doing wrong? Regards, Rahul = Criminal Justice Degrees Online Criminal Justice studies - Free info pack now. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=c47df44e10a9717326d9f94… -- Powered by Outblaze

3 2

[MonetDB-users] Benchmark on MonetDB/X100
by Konstantinos Krikellas 26 Dec '07

26 Dec '07

I want to use MonetDB for benchmarking on the TPC-H workload. According to the paper "MonetDB/X100 - A DBMS In The CPU Cache", the X100 module achieves significant acceleration against MonetDB/MIL on Query 1 of TPC-H. Still, when I search your site, there is no reference about how it is possible to activate X100 inside MonetDB. I have only found X100 in your repository for mserver5 in Sourceforge, but it is not currently active. Therefore, I have the following questions: a) Has X100 been integrated to the Mserver5 version of MonetDB, or included as an extension module? b) Does Mserver5 use vector processing as proposed in the paper "MonetDB/X100: Hyper-Pipelining Query Execution" (CIDR 2005) ? c) How is it possible to use MonetDB/X100 for benchmarking purposes? Are there any instructions online? Thank you.

2 1

[MonetDB-users] Memory leaks on nightly stable
by m h 22 Dec '07

22 Dec '07

Hey all- I've been benchmarking my application against mysql and postgres. For my test application which has some 1Mil rows of data and my sample query that returns some 260K rows here's some stats. Speed for query: Postgres 15 sec (8.1) Monetdb 33 sec (nightly stable) Mysql 100 sec (5.0) Bulk load speed: Postgres 12 Min Monetdb 1 Min Mysql 2 Min Memory during bulk load: Postgres 20 Meg Monetdb 700 Meg!!! (And it doesn't come back down) Mysql 20 Meg Memory during query: Postgres 30Meg Monetdb 180 Meg (And increases by 10-20 Meg /query) Mysql 30 Meg Niels has some trick up his sleeves that bring the query speed down (using the nightly current). But I'm concerned about memory use. It's fine to use memory if you are going to be fast. But if I can't load my data (in all I have 67+ mil rows) or have to restart the server after a few queries it is problematic. I've submitted bugs with valgrind reports during load/query, but am wondering if other steps can be taken to help with the memory issue? I know that both mysql and postgres (and a host of other open source projects) have benefitted from coverity's offering [0] and klocworks [1] as well. Have these been looked into? It might be worth it have some automated "eyes" along with the "many eyes" of the open source community that make all bugs shallow. Some food for thought cheers, -matt 0 - http://scan.coverity.com/ 1 - http://www.klocwork.com/company/releases/06_26_06.asp

2 2

[MonetDB-users] Is there a Front End for SPARQL to MonetDB Backend
by sateesh 21 Dec '07

21 Dec '07

HI All, I am wondering whether any effort is made to build a frontend which accepts SPARQL Queries and convers them into MIL for the Monet Back-end ?? Or how difficult to use MIL Directly in a Programming language like Java?? (Which is basically developing the front-end) If such front-end accepts either SQL or XQuery etc then it has to be a Query Parser and Optimizer . How ever if it uses MIL Directly then i guess we don't need a Query Parser and Optimizer..!! Any comments or info reg SPARQL Related front-ends will be of great help Thanks Sateesh -- View this message in context: http://www.nabble.com/Is-there-a-Front-End-for-SPARQL-to-MonetDB-Backend-tp… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Problem with running TPC-H query No.5
by Konstantinos Krikellas 18 Dec '07

18 Dec '07

I am using MonetDB for benchmarking on the TPC-H workload. I have successfully run queries 1, 3 and 10. However, when I try to run query 5: select n_name, sum(l_extendedprice * (1 - l_discount)) as revenue from customer, orders, lineitem, supplier, nation, region where c_custkey = o_custkey and l_orderkey = o_orderkey and l_suppkey = s_suppkey and c_nationkey = s_nationkey and s_nationkey = n_nationkey and n_regionkey = r_regionkey and r_name = 'ASIA' and o_orderdate >= date '1994-01-01' and o_orderdate < date '1994-01-01' + interval '1' year group by n_name order by revenue desc; it takes about two (2) hours to evaluate it. It is obvious that the query cannot be executed inside the main memory, so the system thrashes through paging. Still, this behaviour does not appear for the rest of the queries, as they are computed within one or two seconds. In all cases, the results are correct. The specifications of my system are: Processor: Intel Core 2 Duo @ 1.86 Mhz RAM: 2 Gb Operating System: Linux Ubuntu Gutsy 7.10 MonetDB version: Mserver5 (recently downloaded from your site). Can you give me some indications about why this query takes too long and how can I bypass this response delay? Thanks.

2 4

[MonetDB-users] install script (monetdb-install.sh) doesn't work for current branch
by Ying Zhang 18 Dec '07

18 Dec '07

Hello, I try to install the nightly build of current branch using the install script "monetdb-install.sh" (just downloaded from http://monetdb.cwi.nl/projects/monetdb/Assets/monetdb-install.sh) , but it stops when trying to rename the directory for MonetDB- client-1.21.0 I run the script with the following options: monetdb-install.sh --prefix=$HOME/monetdb --build=$HOME/tmp/ monetdb_build --enable-xquery --nightly=current --enable-debug The log is attached below. A request: would the owner of the script please add the new module "java" in to the script? Thanks a lot! Jennie ============================== $ cat monetdb_build/log Fri Dec 7 12:37:45 CET 2007 called with arguments: --prefix=/export/scratch0/streettivo/monetdb -- build=/export/scratch0/streettivo/tmp/monetdb_build --enable-xquery -- nightly=current --enable-debug --12:37:46-- http://www.ins.cwi.nl/~monet/tars/latest/current/MonetDB.tar.gz Resolving www.ins.cwi.nl... 192.16.196.21 Connecting to www.ins.cwi.nl|192.16.196.21|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1198570 (1.1M) [application/x-gzip] Saving to: `/export/scratch0/streettivo/tmp/monetdb_build/MonetDB/ MonetDB.tar.gz' 0K ........ ........ .. 100% 4.85M=0.2s 12:37:46 (4.85 MB/s) - `/export/scratch0/streettivo/tmp/monetdb_build/ MonetDB/MonetDB.tar.gz' saved [1198570/1198570] unpacking MonetDB.tar.gz --12:37:46-- http://www.ins.cwi.nl/~monet/tars/latest/current/MonetDB-client.tar.gz Resolving www.ins.cwi.nl... 192.16.196.21 Connecting to www.ins.cwi.nl|192.16.196.21|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 920374 (899K) [application/x-gzip] Saving to: `/export/scratch0/streettivo/tmp/monetdb_build/MonetDB- client/MonetDB-client.tar.gz' 0K ........ ...... 100% 32.9M=0.03s 12:37:46 (32.9 MB/s) - `/export/scratch0/streettivo/tmp/monetdb_build/ MonetDB-client/MonetDB-client.tar.gz' saved [920374/920374] unpacking MonetDB-client.tar.gz mv: cannot stat `clients-[0-9]*': No such file or directory failed to rename sources to the right name Please refer to the full log at /export/scratch0/streettivo/tmp/ monetdb_build/log If you believe this is an error in the script or the software, file a bug and attach the logfile. Fri Dec 7 12:37:46 CET 2007 The following tools might be relevant to debug your problem: : 1.15.4.6 $ /usr/bin/autoconf autoconf (GNU Autoconf) 2.59 Written by David J. MacKenzie and Akim Demaille. Copyright (C) 2003 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/automake automake (GNU automake) 1.9.6 Written by Tom Tromey <tromey(a)redhat.com>. Copyright 2005 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/libtool ltmain.sh (GNU libtool) 1.5.22 (1.1220.2.365 2005/12/18 22:14:06) Copyright (C) 2005 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. glibtool cannot be found in the path /usr/lib64/ccache/gcc gcc (GCC) 4.1.2 20070626 (Red Hat 4.1.2-13) Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. /usr/bin/ld GNU ld version 2.17.50.0.6-5.fc6 20061020 Copyright 2005 Free Software Foundation, Inc. This program is free software; you may redistribute it under the terms of the GNU General Public License. This program has absolutely no warranty. /usr/bin/make GNU Make 3.81 Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. This program built for x86_64-redhat-linux-gnu /usr/bin/gmake GNU Make 3.81 Copyright (C) 2006 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. This program built for x86_64-redhat-linux-gnu /usr/bin/python 2.4.4 (#1, Oct 23 2006, 13:58:18) [GCC 4.1.1 20061011 (Red Hat 4.1.1-30)] /bin/gawk GNU Awk 3.1.5 Copyright (C) 1989, 1991-2005 Free Software Foundation. This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. /bin/sed GNU sed version 4.1.5 Copyright (C) 2003 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE, to the extent permitted by law. gsed cannot be found in the path

4 17

Re: [MonetDB-users] MonetDB size limitation questions.
by Martin Kersten 17 Dec '07

17 Dec '07

Thomas Backlund wrote: > > Hi, > Hi Thomas. Thanks for your interest in MonetDB. > > I stumbled over MonetDB a few days ago and it really cought my > interest. But it is hard to find information about it, so I hope You > could answer a few questions. > > I need a database engine that could handle many rows, about 350*10^9 > rows of about 1000TB data. > This is really large, do you really mean 1 PetaByte? For MonetDB the first interesting part is that it will automatically split the table into 350 tables of 1000.000.000 rows, each would then be be 3 TB.. which means you are using a special column type? I think we need a snippet of the relation declaration to understand your schema We are currently working on automatic horizontal fragmentation with distribution to indeed handle them as single tables. To understand if MonetDB is the solution to your problem, it is also relevant to know what kind of queries you intend to run. We know there are users moving MonetDB into this direction (sizewise) and we would certainly be interested in learning the problems encountered. Given, of course, you have the time to help us on this track and you know of any database system that can already solve the problem out of the box. regards, Martin Kersten > > > Well I dont really need it right now, but I want to be prepared. > > My option up til now has been to use MySQL and to do some kind of > sharding using alot of databases. > But that complicates stuff alot since I still want to do selects in > this gigantic table and that will be a bit of a problem doing selects > if the data is split up in 8000 different MySQL databases. > > Do You think MonetDB could handle this in one single table? > Even if MonetDB could handle this I still will need a hard disk of > 1000TB, do You know of any technique merging many computers together > into one virtiualized hard drive that MonetDB would accept? > > Thank You very much! > > Best regards > Thomas Backlund, > Sweden. >

1 0

Re: [MonetDB-users] Shell script to start MonetDB as service on Linux
by McKennirey.Matthew 13 Dec '07

13 Dec '07

Fabian, thanks for your quick reply, and pointing me in the right direction. We are running on OpenSuse, and for the moment have settled on the following script. I'm sure it could use a lot of improvement, but we are up and running ********** !/bin/sh # Portions Copyright (c) 1995-2002 SuSE Linux AG Nuernberg, Germany. # Author: Lenz Grimmer <feedback(a)suse.de> # # /etc/init.d/monetdb ### BEGIN INIT INFO # Provides: monetdb # Required-Start: $network $remote_fs # Required-Stop: # Default-Start: 2 3 5 # Default-Stop: # Description: Start the MonetDB database server ### END INIT INFO # Shell functions sourced from /etc/rc.status: # rc_check check and set local and overall rc status # rc_status check and set local and overall rc status # rc_status -v ditto but be verbose in local rc status # rc_status -v -r ditto and clear the local rc status # rc_failed set local and overall rc status to failed # rc_failed <num> set local and overall rc status to <num> # rc_reset clear local rc status (overall remains) # rc_exit exit appropriate to overall rc status /etc/rc.status # First reset status of this service rc_reset # Return values acc. to LSB for all commands but status: # 0 - success # 1 - generic or unspecified error # 2 - invalid or excess argument(s) # 3 - unimplemented feature (e.g. "reload") # 4 - insufficient privilege # 5 - program is not installed # 6 - program is not configured # 7 - program is not running # # update these as appropriate for your server MDB_USER='root' MDB_GROUP='root' MDB_HOME=/srv/monetdb MDB_BINDIR=/srv/monetdb/bin echo "" echo "Using configuration at " $MDB_HOME/etc/monetdb5.conf echo "" # Test, if path to merovingian is valid unset MEROVINGIAN if test -x $MDB_BINDIR/merovingian then MEROVINGIAN=$MDB_BINDIR/merovingian fi test "$MEROVINGIAN" || { echo "MonetDB daemon (merovingian) is not available at indicated path:" $MDB_BINDIR "verify path settings in /etc/monetdb"; rc_failed 5; rc_status -v; rc_exit; } depend() { use net } start(){ echo -n "Starting MonetDB/SQL" startproc -s -u $MDB_USER -g $MDB_GROUP $MDB_BINDIR/merovingian # Rmember status and be verbose rc_status -v } stop() { echo -n "Stopping MonetDB/SQL" # shut down mserver if it is running kill -INT $(pidof mserver5) # stop merovingian daemon kill -INT $(pidof merovingian) # Remember status and be verbose rc_status -v } status(){ echo -n "Checking for MonetDb service: " # NOTE: checkproc returns LSB compliant status values. checkproc $MEROVINGIAN rc_status -v } case "$1" in start) start ;; stop) stop ;; status) status ;; restart) stop start ;; *) echo "Usage: {start|stop|status|restart}" exit 1 ;; esac rc_exit

2 1

Re: [MonetDB-users] connecting to monetDB from a Java program
by Ying Zhang 13 Dec '07

13 Dec '07

Hello Gerben, On Dec 13, 2007, at 15:36 , <e.g.broenink(a)student.utwente.nl> <e.g.broenink(a)student.utwente.nl > wrote: > Hello Jennie, > > I got the system working, I can write SOAP messages and execute them > on the server. However there is a new problem. > I'm using the system to execute a few thousand queries, and the > problem is that MonetDB is caching a lot of (intermediate) results, > therefore, after a few honderd queries the server has cached over > 800MB, and the system becomes very slow. Mmm, this is annoying. Do you mean that MonetDB is using more memory ("over 800MB") or is the size of you dbfarm growing? If the memory usage is growing, it sounds like a leak, but I don't know if XRPC is eating up your memory, or is MonetDB doing that (so I cc this e-mail to the monetdb-users mailing-list). It's an interesting problem to investigate. Would you please provide us more information about your problem? - the xml data you are working on - the xquery functions you are using, or are causing your problems - the request messages you use - which version of MonetDB4 are you using? - which OS (and it version) are you using? > I would like to restart the server after a few honderd queries, do > you know how I can do that? (can I send a SOAP message to restart?) > Or is there another way of solving this problem? No, it is not possible to send SOAP messages to restart an Mserver. You might be able to send MIL commands to stop Mserver to stop it, and use a script to check regularly if your Mserver is still running, and (re)start Mserver if it is not running (any more). Jennie

1 0

[MonetDB-users] Shell script to start MonetDB as service on Linux
by Matthew McKennirey 13 Dec '07

13 Dec '07

Is anyone aware of any UNIX shell scripts (bash, bourne, C) that exist to start the MonetDB server as a service on Linux (/etc/init.d). I have successfully (and, well done to the team, painlessly) installed MonetDB from the MonetDB-Mars-SuperBall-SR4.tar.bz2 and tried out the VOC demo. All is well. However I am struggling with merovingian and monetdb trying to figure out how to get things to start correctly in a scripted manner so that the database is ready when the server finishes booting. I have searched the users list, and others and read presentations on the issue of painlessly starting MonetDB (/etc/init.d/monetdb start) but am no further ahead. If anyone has a script I would be grateful. Thanks

2 1

[MonetDB-users] Shell script to start MonetDB as service on Linux
by McKennirey.Matthew 13 Dec '07

13 Dec '07

1 0

[MonetDB-users] Info reg Column Oriented DB
by sateesh 13 Dec '07

13 Dec '07

Hi All, I am evaluating MonetDB for my project and we are planning to Store Semantic Web related info which is basically in RDF Format and wants to use a Colum Oriented DB for this purpose.. Now when i looked at the Sample DB VOC that comes with DB most of the tables have more than two columns. So is this sample (voc) not meant for semantic storage .. Thanks Sateesh -- View this message in context: http://www.nabble.com/Info-reg-Column-Oriented-DB-tp14303148p14303148.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Persistent Stored Modules ?
by Venks 08 Dec '07

08 Dec '07

I need to perform some ETL processing for which I need CURSOR support in a PSAM. I read the meta-data in a CURSOR and dynamically create SQL statements for execution. According to documentation CURSORS are not supported because of the underlying data model in a PSM. This means I can't use PSM for my ETL processing. Let me know if there is anything I could use a PSM in my ETL process. I only wish you had a driver for Ruby. I see that you have PERL, Python and PHP. It would be great if we have a Ruby Library (:- Regards,

3 2

[MonetDB-users] SQL Script execution behaviour
by Venks 08 Dec '07

08 Dec '07

Please find attached 2 scripts namely "test1.sql" and "test2.sql". 1. First execute the script "test1.sql". You will get an error for each and every statement in the script and that's fine. 2. Execute the second script "test2.sql" which will create five simple tables and then execute "test1.sql" again. You will see that the "test1.sql" script executes fine even though it should report errors after the last DELETE statement. In short, it looks like the script stops executing after the first successful SQL statement. It should continue to report errors for all the COPY commands. Thanks,

2 1

[MonetDB-users] Enable/Disable auto-commit
by Venks 08 Dec '07

08 Dec '07

How do I enable/disable auto-commit using "mclient"? Does \A and \a still work? Thanks,

3 2

[MonetDB-users] MonetDB and fast data storage
by Djordje Djokovic 07 Dec '07

07 Dec '07

2 1

[MonetDB-users] Problem with (Tijah) search query for StreetTiVo
by Ying Zhang 07 Dec '07

07 Dec '07

Hello all, When executing the attached search query in the streettivo bobo collection, I get the following errors: $ mclient -lx -p 60000 a.xq MAPI = monetdb@localhost:60000 QUERY = import module namespace stvc = "http://monetdb.cwi.nl/streettivo/search " at "/export/scratch0/streettivo/streettivo/mxq/search.xq"; stvc:search("bobo camperen") ERROR = !ERROR: interpret_params: reverse(param 1): invalid BAT. !ERROR: interpret_params: exist(param 1): evaluation error. !ERROR: interpret_params: not(param 1): evaluation error. $ cat a.xq import module namespace stvc = "http://monetdb.cwi.nl/streettivo/search" at "/export/scratch0/streettivo/streettivo/mxq/search.xq"; stvc:search("bobo camperen") The function "search()" is implemented as the following (see also the attachment): 1. module namespace stvc = "http://monetdb.cwi.nl/streettivo/search"; 2. declare namespace tijah = 'http://dbappl.cs.utwente.nl/pftijah/'; 3. stvc:search($keywords as xs:string) as node()* { 4. let $config := doc("config.xml") 5. (: number of programs to be returned :) 6. let $numPrograms := exactly-one($config/stv-config/nr-programs/ text()) 7. (: number of fragments to be returned per program :) 8. let $numFrags := exactly-one($config/stv-config/nr-fragments/text()) 9. (: number of sentences to be ranked by TIJAH :) 10. let $numSentences := exactly-one($config/stv-config/nr-sentences/ text()) 11. let $query := tijah:tokenize($keywords) 12. let $nexi := if ($query) then 13. concat("//(asr|teletext)[about(.,", $query, ")]// sentence[about(.,", $query, ")]") 14. else "//sentence[about(., asdkjasdkj)]" (: in case query is only a stop word :) 15. let $opt := <TijahOptions ft-index="SpeechOut" returnNumber="{$numSentences}" /> 16. let $res := tijah:queryall-id($nexi,$opt) 17. let $nodes := tijah:nodes($res) 18. let $resultlist := 19. for $pid in distinct-values ($nodes/../@progID) 20. let $sentences := 21. for $s in $nodes[../@progID = $pid] 22. order by tijah:score($res, $s) descending 23. return $s 24. let $best := $sentences[1] 25. let $speech := $best/.. 26. let $pscore := tijah:score($res, exactly-one($best)) 27. order by $pscore descending 28. return element program { 29. attribute thumbnail-image {$speech/@thumbnail_image}, 30. attribute video-file {$speech/@video-file}, 31. attribute startDT {$speech/@startDT}, 32. attribute channel {$speech/@channel}, 33. attribute title {$speech/@title}, 34. attribute progID {$pid}, 35. attribute score {$pscore}, 36. subsequence( 37. for $fragment in $sentences 38. return element fragment { 39. $fragment/@*, 40. $fragment/text() }, 41. 1, $numFrags) } 42. return 43. subsequence($resultlist, 1, $numPrograms) (: first result page :) 44. }; The problem starts in lines 16 and 17. It feels like that the error will occur, as soon as the return value of the function "tijah:queryall-id" or "tijah:nodes" is used. Above error occurs, if I - query the original function, or - skip lines 17 - 43 and return <res>{$res}</res> - skip lines 18 - 43 and return $nodes I use the latest stable version, compiled using the monetdb-install.sh script as the following: $ monetdb-install.sh --prefix=$STV_HOME/monetdb --build=$STV_TEMP/ monetdb_build --enable-xquery --nightly=stable --enable-debug System info: $ uname -a Linux andorea.ins.cwi.nl 2.6.20-1.2933.fc6 #1 SMP Mon Mar 19 11:00:19 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux Would some Tijah experts please have a lot at this problem? I'm not sure if the problem is in the Tijah functions or somewhere else in MonetDB/XQuery. Thanks a lot! Regards, Jennie

1 0

[MonetDB-users] COPY with AUTO_INCREMENT column
by Venks 07 Dec '07

07 Dec '07

Hi, How can I use COPY to load data into a table with a AUTO_INCREMENT column? Just to clarify, the AUTO_INCREMENT column would be the PRIMARY KEY by default and doesn't have any corresponding data in the data file. Thanks,

3 3

[MonetDB-users] COPY - performing SQL processing while COPYing
by Venks 07 Dec '07

07 Dec '07

Hi, Is there are way I can perform some SQL processing while using COPY to load the data? For e.g. I need to load a file into a table but would like to TRIM all the spaces at the beginning and at the end of each column for all VARCHAR Columns. Below is an example in MySQL where I can load the data into a variable first and then load the variable into an actual column. LOAD DATA .... ( @col1_temp, @col2_temp, @col3_temp ) SET col1 = TRIM(@col1_temp), SET col2 = TRIM(@col2_temp), SET col3 = TRIM(@col3_temp) @<variable> stores the initial value of each field and then you can use most of the default SQL functions on the variable before inserting the data. The advantage here is the ability to perform some basic transformations on the data to adhere to the column definitions instead of loading into a temp table and then performing the transformations to load into the actual table. This really helps when loading billions of rows and 100G worth of data. Thanks,

2 1

Re: [MonetDB-users] JDBC driver, where? (sorry)
by Martin Koch 07 Dec '07

07 Dec '07

Thanks all of you for helping me along with my MonetDB testing environment. My today's build seems to contain more of the parts mentioned in the documentation. I could not test sooner due to some typical Dutch festivity involving a crazy horseman in red riding on my roof. Kind regards, Martin

2 1

[MonetDB-users] XQuery Update Last Call
by Florian Wendland 07 Dec '07

07 Dec '07

Hi, a question concerning XQuery Update Facility. The Last Call is not supported by MonetDB at this time. Are there plans to implement it in the near future or will this be skipped, until the final recommendation is published? Thx mfw -- Marc-Florian Wendland Dipl.-Inform. (FH) http://www.florianwendland.de

2 1

[MonetDB-users] Changing default monetdb password
by Venks 06 Dec '07

06 Dec '07

How can I change the default MonetDB password? ALTER USER on "monetdb" gives me the following error: !InvalidCredentialsException:setPassword:The administrator cannot set its own password, use changePassword instead Thanks, -Venks

3 17

[MonetDB-users] Profiling queries
by m h 06 Dec '07

06 Dec '07

Hello all- First of all thanks to you guys for your great help these past few weeks. I really appreciate it. I've learned a bit, and hopefully your product is improving from my bug reports. I've managed to pull a bit of my data from my proprietary db into monetdb. (Have some 60 million rows in the fact table, pulled in 5 million)! I even ran a query against it and got the same numbers (though in a different order)! So I did a very basic poor mans benchmark. My python code can hit the old db or monetdb by changing one line. So I took timestamps around the query execution portion. The old db takes 0.21 seconds when cold. Subsequent queries take 0.027-0.072 seconds Monetdb takes 0.67 seconds when cold and 0.12-0.23 otherwise. It appears that the old db is faster when cold than monetdb is after being primed. A few more caveats. (Yes, this is a poor benchmark but after reading pdfs saying that monetdb was 7 times faster than a 64 way oracle box, I thought I'd get quite a bit of speedup.) The old db is running under vmware on a Core2 1.86Ghz box. Monetdb is running on my laptop, a Pentium M 1.86 Ghz machine. Since the query is confidential I can't really put it here, but I can describe it. I'm pulling stuff out of my fact table and two other dimension tables. The select clause sums a few columns, and on one sums the product of one column and the sum of a few others. The coalesce function is used to convert NULLs to 0. The where statement joins the tables using the = operator and then has two "IN" clauses. Then there is a group by (since I'm aggregating in the select) and an order by. Any hints on how to increase performance? Do I need to tune my query or tweak other things? (Yes I know the laptop machine is not apples to apples to the vmware machine) Am open to suggestions. thanks much, -matt

3 17

[MonetDB-users] JDBC driver, where? (sorry)
by Martin Koch 06 Dec '07

06 Dec '07

Dear Reader, I compiled a Mars-Superball-SR4 and a SR5. Both apperently succesfull, as I have sql functionality. But in neiter I found a /share/MonetDB/ lib/ directory containing the promised JDBC driver. What am I doing wrong? I use a standard Ubuntu Gutsy 32 bit, with sun JRE 5.0 (but not the JDK) to run SQuirreL SQL Thanks for your attention and for your software, Kind regards, Martin

4 4

[MonetDB-users] update query performance
by Lange Marcus 05 Dec '07

05 Dec '07

Hello, I have a question. I have a table with the columns ( id, name (string), num(int) ). In this table I have lets say 100 rows of data. In a Java app. I am updating the different rows individually with the sql command: "UPDATE "tableName" SET "num" = ('99') WHERE "id" = (5);" The time to run this single query is between 15 to 32 milliseconds, except every once in a while when it can be as much as 110 milliseconds. Since I want to do this several times each second for all rows this is way to long time. Am I doing something wrong, or am I using Monet in a way that it is not meant to be used or what ? Is there another way to solve this (Updating individual cells/variables in individual rows FAST) ? Thanks for any input! Regards, Marcus

1 0

[MonetDB-users] inserting into default schema?
by m h 05 Dec '07

05 Dec '07

If I create a table, by default it goes into the "tmp" schema. But when I try to create a "users" table, it complains, since there is one in the "sys" schema. Why doesn't it create one in the "tmp" schema? ie: CREATE TABLE users (fcol FLOAT(25)); !CREATE TABLE: name 'users' already in use Just wondering about the resolution order. thanks -matt

3 6

[MonetDB-users] Optimal hardware/software configuration?
by m h 04 Dec '07

04 Dec '07

Say one wanted to do some benchmarks for Monetdb. Here would be a few questions: * Does Raid 0+1 help more than RAM? * What about multi cores? Are they currently useful? * Are big processor caches useful? * What about 64 bit linux? Does that help or hurt? Or here's another way to put it. If you had between $2-$5K to spend what hardware would you buy? A bunch of PS3's ;) Any input would be great? thanks matt

3 2

[MonetDB-users] converting strings to dates?
by m h 04 Dec '07

04 Dec '07

In Oracle I can do the following: select * from table where timestampcol BETWEEN to_date('01/01/07', 'MM/DD/RR') AND to_date('12/31'/07'), 'MM/DD/RR') It's not clear that this is possible in monetdb. There's the EXTRACT function which pulls a numeric value (month, day or year) from a string representing a timestamp, but I can't see how to get a timestamp/date object out? -matt

3 2

[MonetDB-users] Portuguese Characters
by Paulo Jorge Dias 04 Dec '07

04 Dec '07

Hi, I am trying to insert data which has Portuguese Characters and I get some errors. Using the copy command: sql>copy into d_concelho from '/monetdb5/bo/dados/d_concelho.txt' delimiters '|'; !SQLException:sql:value ALTER DO CH├O|12|20071202 from line 23 not inserted !SQLException:importTable:failed to import table Using a java program with jdbc: D:\MonetDB5>java Concelho java.sql.SQLException: unexpected end of input at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2048) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1798) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at nl.cwi.monetdb.jdbc.MonetPreparedStatement.execute(MonetPreparedStatement.java:209) at Concelho.main(Concelho.java:25) Is there any way to get this running? Thanks very much, Paulo Jorge Dias -- View this message in context: http://www.nabble.com/Portuguese-Characters-tf4938671.html#a14136589 Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] Question about used Encoding
by Markus Gritsch 04 Dec '07

04 Dec '07

Hi, I would like to know how encoding related issues are handles in MonetDB. For example, when I run the following Python script # -*- coding: utf-8 -*- import MonetSQLdb x = MonetSQLdb.connect(host = 'localhost', user = 'voc', password = 'voc', lang = 'sql') c = x.cursor() c.execute('DROP TABLE test') c.execute('CREATE TABLE test(id int, name varchar(20))') c.execute('INSERT INTO test (id, name) VALUES (%s, %s)', (0, 'ä ö ü')) c.close() x.close() and then look at the inserted data using DbVisualizer I get Ã¤ Ã¶ Ã¼ in the 'name' column. When I try to edit the value in the DbVisualizer, I get an error message "unexpected end of input". (The SQL statements reads update voc.test set name = 'ö' where id = 0). Is this a JDBC driver problem? When I connect to an MySQL database with the MySQL JDBC driver included in DbVisualizer I can insert arbitrary characters, and they get properly displayed in the GUI. Kind regards, Markus

3 29

[MonetDB-users] primary key retrieval
by Lange Marcus 04 Dec '07

04 Dec '07

Hello, How do I retrieve the primary key id value after inserting something new into the database ? I am writing a simple Java app. (using JDBC) and would like to get this info back into my program. Thanks for any help! Regards Marcus

2 2

[MonetDB-users] windows 127.0.0.1
by Miki Muzsi 04 Dec '07

04 Dec '07

Hi there, Anybody knows if the installation of Monet can be changed (on windows) to use localhost instead of 127.0.0.1. It seems that because of that I can not connect to MondetDB from a different machine; I get the error message: Could not open connection to the host, on port 50000: Connect failed. I've lokked into monetdb5.conf, registriey, docs ... nothing helpt. BTW I am using version v5.2.2 on windows. Cheers, Miki Chordiant Software International Ltd. Registered office: Chiswick Park Building 10, 566 Chiswick High Road, London W4 5XS Registered in UK no. 02155722 and VAT no. GB 479 9023 02 The information transmitted herewith is sensitive information of Chordiant Software or its customers and is intended only for use to the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon, this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

2 1

[MonetDB-users] offset support?
by m h 04 Dec '07

04 Dec '07

Is there support for OFFSET in queries? The syntax doesn't throw an error, but the expected behavior isn't correct... sql>select * from query_users; +---------+----------+ |user_id |user_name | +=========+==========+ | 1 |john | | 2 |jack | | 3 |ed | | 4 |wendy | | 5 |laura | | 6 |ralph | | 7 |fido | +---------+----------+ Timer 1.820 msec 7 rows sql> Timer 0.294 msec 0 rows sql>SELECT query_users.user_id, query_users.user_name more>FROM query_users ORDER BY query_users.user_id more> LIMIT 3 OFFSET 2; +---------+----------+ |user_id |user_name | +=========+==========+ | 1 |john | | 2 |jack | | 3 |ed | +---------+----------+ -matt

3 10

[MonetDB-users] Slow Data Load
by Paulo Jorge Dias 03 Dec '07

03 Dec '07

Hi, I am working on a Windows XP SP2 32bit with MonetDB v5.2.2 kernel v1.20.0 I have built a java program to upload data from an Oracle Database Table with 6milion rows. After about 4milion of rows loaded the performance decreases dramatically. I have tried to use other way, which is generating all insert statements to a file and then using mclient to execute all the insert statements. Slower that the java option because the autocommit=on and parsing of each statement, but the result is the same. After about 4milion of rows loaded the performance decreases dramatically. Can someone give an explanation for this behavior? Thanks, Paulo Jorge Dias -- View this message in context: http://www.nabble.com/Slow-Data-Load-tf4929292.html#a14108678 Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] Server in a weird state....
by m h 01 Dec '07

01 Dec '07

I tried running the SQLAlchemy ORM testsuite. The first time it ran for a while and then mserver segfaulted. (It also grew to using 700+Megs of memory. Am assumming this is a monetdb issue, since after each test the tables are usually dropped). The server now has issues. It appears to start fine: # MonetDB server v5.2.3, based on kernel v1.20.1 # Serving database 'demo' # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2007 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /root/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.20.3 loaded When I try to connect with the command line client it complains repeatedly: !ERROR: BUNdelete: access denied to tmp_537, aborting. !ERROR: BUNdelete: access denied to tmp_537, aborting. ....

3 21

[MonetDB-users] Preferred bulk load method?
by m h 01 Dec '07

01 Dec '07

Good afternoon- Just wondering if there is a preferred method to load large datasets into monetdb? Piping SQL through mclient? thanks much -matt

2 14

[MonetDB-users] Difficulty with External C Function
by Thomas J. Schulte 30 Nov '07

30 Nov '07

I'm having difficulty linking a custom external C function into MonetDB without crashing the database connection. If anyone knows of a documented end-to-end example of adding external functions compiled with GCC, please let me know. I've documented a minimal example below that crashes the connection for me each time. Software: Red Hat Linux knock-off CentOS, i386. Most recent MonetDB download from Sourceforge (server 5.2.2, client 1.20.2, common 1.20.0). GCC 4.1.1 1. Create a simple C file named te.c. int TEtest( ) { return 4; } 2. Compile file, move it to the proper directory, and create symlinks. $ gcc -c -fPIC te.c -o te.o $ gcc -shared -Wl,-soname,lib_te.so.0 -o lib_te.so.0.0.0 te.o (also tried with soname = libte.so.0, leaving output as lib_te.so.0.0.0) $ cp lib_te.so.0.0.0 $mhome/lib/MonetDB5/lib $ cd $mhome/lib/MonetDB5/lib $ ln -s lib_te.so.0.0.0 lib_te.so.0 $ ln -s lib_te.so.0.0.0 lib_te.so 3. Create a MAL file, saved as $mhome/lib/MonetDB5/te.mal module te; command test( ):int address TEtest(); command doesnotexist( ):int address TEdoesnotexist; 4. Update mal_init.mal by adding the following 2 lines: library te; include te; 5. Start a random DB and try to invoke the test function. Merovingian log show database dino killed by signal 11 afterwards. $ cd $mhome/bin $ ./merovingian & [1] xxxx $ ./mclient -lmal --database=dino -h COS1 mal> te.test( ); MAPI = monetdb@COS1:50001 ACTION= read_line QUERY = te.test(); ERROR = Connection terminated If I instead invoke te.doesnotexist(), I get a different error (below.) This leads me to think that MonetDB is findng and loading my compiled .so file, but it wasn't compiled correctly or otherwise isn't providing what MonetDB expects. mal> te.doesnotexist(); MAPI = monetdb@COS1:50001 QUERY = te.doesnotexist(); ERROR = !TypeException:user.main[1]:'te.doesnotexist' undefined in: _1:int := te.doesnotexist() Any pointers are appreciated. Thomas Schulte

3 2

[MonetDB-users] Howto query with non ascii in python?
by m h 30 Nov '07

30 Nov '07

How do I run non-ascii queries in python? Or from the command line for that matter? Naive tests on my part fail.... python: RuntimeError: !syntax error, unexpected IDENT, expecting INTERSECT or EXCEPT or UNION in: "select name from tables where system=false and name=unitéble2" commandline: sql>select name from tables where system=false and name=unitéble2; !syntax error, unexpected IDENT, expecting INTERSECT or EXCEPT or UNION in: "select name from tables where system=false and name=unitéble2" Thanks -matt

3 2

[MonetDB-users] incorrect handling of NULL values in "IN" statements?
by m h 29 Nov '07

29 Nov '07

My understanding that is that NULL is never equal to anything including itself. Thus to test for NULL values, one must use the IS operator. I'm wondering if the following is a bug. The NOT IN will return the null row, instead of the empty set. Are NULL values outside that query? CREATE TABLE query_users ( user_id INT NOT NULL AUTO_INCREMENT, user_name VARCHAR(20), PRIMARY KEY (user_id) ); INSERT INTO query_users (user_id, user_name) VALUES (1, 'matt'); INSERT INTO query_users (user_id, user_name) VALUES (2, 'fred'); INSERT INTO query_users (user_id, user_name) VALUES (3, null); SELECT user_name FROM query_users WHERE user_name IN ('matt', 'fred'); -- should return empty set, returns null SELECT user_name FROM query_users WHERE user_name NOT IN ('matt', 'fred');

2 3

[MonetDB-users] use column names as column alias?
by m h 29 Nov '07

29 Nov '07

Is it possible to use the column names as the alias? The select query below fails. CREATE TABLE query_users ( user_id INTEGER NOT NULL, user_name VARCHAR(20), PRIMARY KEY (user_id) ); INSERT INTO query_users (user_id, user_name) VALUES (1,'matt'); select query_users.user_id AS "query_users.user_id", query_users.user_name AS "query_users.user_name" from query_users; Here's the error: !Invalid identifier 'query_users.user_id' -matt

2 1

[MonetDB-users] SQL exception during query resolving. Slow join? How to submit external variables?
by Huib Verweij 28 Nov '07

28 Nov '07

Hi everyone, I'm new to MonetDB XQuery and have written a crude Cocoon generator for MonetDB using the example code for the JDBC client from the website. I am using the latest Bug Fix Release of MonetDB as announced by Sjoerd Mullender on 24-10-2007. When I execute the following query I get an error: --------------------------------------------------------- let $zz := doc('vogels.xml')//Vogels[data(Dwaalgast) = 'zeer zeldzaam'] return <vogeltjes>{$zz}</vogeltjes> --------------------------------------------------------- throws: java.sql.SQLException: ERROR: ERROR: XML Generation: NULL BAT has a 4415 head, but tail is NULL. ERROR: ERROR: xquery_print_result_loop: operation failed. However, when I change the XQuery to: --------------------------------------------------------- let $zz := doc('vogels.xml')//Vogels[data(Dwaalgast) = 'zeer zeldzaam'] return <vogeltjes>{$zz}azaz</vogeltjes> --------------------------------------------------------- everything's OK and I get the proper result. (The previous release threw the same error btw.) Also, when I join the results from the above query with another table to resolve some codes to code-descriptions, the query takes from 8.5 up to 11 seconds to execute, vs. <1 second for a query without the join. The result is a little over 1Mb in size. The query I use is this: --------------------------------------------------------- let $zz := doc('vogels.xml')//Vogels[Ecotoop_x0020_nest] return <vogeltjes> {for $vogel in doc('vogels.xml')//Vogels[Ecotoop_x0020_nest], $vc in doc('vogels-code.xml')//Vogels-code[data(Kolomnaam) = 'Ecotoop nest'][data(Code) = $vogel/Ecotoop_x0020_nest]/Codebeschrijving return <vogel> {$vogel/*} {$vc} </vogel> } </vogeltjes> --------------------------------------------------------- The latest preview release of eXist handles the join in 3.1 seconds, any ideas on why this join takes almost three times as long? I have a final question: how do I specify external variables using the JDBC client? Regards, Huib Verweij.

2 2

[MonetDB-users] Why does MonetDB take indexes not into account?
by Markus Gritsch 28 Nov '07

28 Nov '07

Hi, I basically have this schema: CREATE TABLE "act" ( "id" int NOT NULL auto_increment, "title" text NOT NULL, "is_closed" bool NOT NULL, PRIMARY KEY ("id") ); CREATE INDEX act_isClosedIndex ON act (is_closed); CREATE TABLE "entry" ( "id" int NOT NULL auto_increment, "note" text NOT NULL, "act_id" int NOT NULL, PRIMARY KEY ("id"), CONSTRAINT "entry_act_id_exists" FOREIGN KEY ("act_id") REFERENCES "act" ("id") ); CREATE INDEX entry_actIndex ON entry (act_id); Each "act" has several "entries" and each "entry" belongs to one "act". *) full-text search in the "note" column over all entries: SELECT * FROM entry WHERE entry.note LIKE ('%hui%') MySQL: 4.5 Seconds MonetDB: 0.8 Seconds So this is very good and this motivates me to switch to MonetDB. However, the majority of the acts have the "is_closed" field set. The usual case in my application is to take into account only the entries of open acts: *) full-text search in the "note" column over all entries of the open acts: SELECT * FROM entry, act WHERE entry.act_id = act.id AND act.is_closed = 0 AND entry.note LIKE ('%hui%') MySQL: 0.26 Seconds MonetDB: 0.8 Seconds Here, MySQL can take advantage of the index on the is_closed column, whereas MonetDB does not. Is this intended? Databases without indexes seem strange to me. Markus

4 16

[MonetDB-users] python cursor missing lastrowid attribute?
by m h 27 Nov '07

27 Nov '07

In MonetSQLdb BaseCursor.insert_id, the docstring says to use the lastrowid attribute. When I try to access that lastrowid on the cursor instance I get an AttributeError. Should I file a bug for this? matt

5 21

[MonetDB-users] Another query that works in MySQL and SQLite but not in MonetDB
by Markus Gritsch 26 Nov '07

26 Nov '07

Hi, I have another question with an SQL query that works in SQLite and MySQL but does not in MonetDB. SELECT * FROM test WHERE ((1) AND (id=100)) syntax error, unexpected AND in: "prepare select * from test where ((1) and" The query is forged by an ORM. I programmatically put together the WHERE clause. All the contitions are put together using AND, and in the case of no conditions, the WHERE clause simply reads (1), which yields all entries in the table. However, MonetDB cannot parse this. Markus

4 9

[MonetDB-users] Problem with colums named "begin" and "end"
by Markus Gritsch 25 Nov '07

25 Nov '07

Hi, I have a table with columns named "begin" and "end". With SQLite and MySQL the SELECT works all right, but MonetDB cannot parse the SQL: sql>CREATE TABLE "test" ("id" INT, "begin" TIMESTAMP, "end" TIMESTAMP); sql>INSERT INTO test ("id", "begin", "end") VALUES (0, '2003-02-07 12:00:00', '2003-02-07 12:00:00'); sql>SELECT id, begin end FROM test; !syntax error, unexpected BEGIN in: "select id, begin" Kind regards, Markus

3 4

[MonetDB-users] Memory Leak in mserver5.exe
by Markus Gritsch 24 Nov '07

24 Nov '07

Hi, I have a medium sized dataset of about 50 MB text data. When I repeatedly call SELECT * FROM entry WHERE LOWER(note) LIKE '%hui%' I get at some time not my result, but the following error in DbVisualizer: protocol violation, unexpected line: VirtualAlloc(1a0a0000,29806592,MEM_COMMIT,PAGE_READWRITE): failed Repeatedly calling the query from the command line like this mclient.exe -lsql -s"SELECT * FROM entry WHERE LOWER(note) LIKE '%hui%'" > result.txt produces the attached memory usage graph. After 11 times calling the query the memory is full, and some kind of garbage collection seems to happen. However, after only 6 additional times the memory is again full and the garbage collection is quite less effective than before. Subsequent calls reach the memory limit every time. Markus P.S.: I have disabled the virtual memory on my Windows XP because when the OS starts paging, it becomes unbearably slow.

2 5

[MonetDB-users] New MonetDB Bug Fix Release
by Sjoerd Mullender 24 Nov '07

24 Nov '07

The MonetDB team at CWI is pleased to announce a new bug fix release of the MonetDB suite of programs. The following packages have been released: MonetDB Clients 1.20.2 MonetDB5 Server 5.2.2 MonetDB SQL 2.20.2 There is of course also a new "Super Source Ball", a tarball containing the combined sources. All this is available on our SourceForge project page. See https://sourceforge.net/project/showfiles.php?group_id=56967 for the downloadable files. See http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Version4.20/ind… for a list of fixes. -- Sjoerd Mullender

1 0

[MonetDB-users] MonetSQLdb and Unicode
by Markus Gritsch 23 Nov '07

23 Nov '07

Hi, is the Python module MonetSQLdb expected to handle unicode? Currently when INSERTing I must make sure that Python unicode types get converted to strings using UTF-8 encoding. Likewise when SELECTing I get UTF-8 encoded strings back. BTW, is it possible to use another encoding than UTF-8 with MonetDB? The Python DB API for SQLite allows inserting Python unicode types and yields unicode when selecting. MySQLdb allows specifying a 'charset' parameter in the connection constructor and uses this charset to automatically encode unicode objects when inserting. It also returns unicode objects. The following script raises an exception when used with MonetDB: import MonetSQLdb x = MonetSQLdb.connect() c = x.cursor() c.execute('DROP TABLE test') c.execute('CREATE TABLE test(id int, name varchar(20))') c.execute('INSERT INTO test (id, name) VALUES (%s, %s)', (0, u'm')) c.execute("SELECT * FROM test") value = c.fetchone()[-1] print type(value) c.close() x.close() --- Traceback (most recent call last): File "test.py", line 8, in <module> c.execute('INSERT INTO test (id, name) VALUES (%s, %s)', (0, u'm')) File "C:\Python25\lib\site-packages\mdb\MonetSQLdb\cursors.py", line 95, in execute self.errorhandler(self, exc, value) File "C:\Python25\lib\site-packages\mdb\MonetSQLdb\__init__.py", line 77, in defaulterrorhandler raise errorclass, errorvalue RuntimeError: !SELECT: identifier 'm' unknown

2 1

[MonetDB-users] No useful error message on SQL syntax error
by Markus Gritsch 23 Nov '07

23 Nov '07

Hi, when using MonetSQLdb from Python and the executed SQL contains a syntax error, there is no useful information displayed in the traceback. The following script for example import MonetSQLdb x = MonetSQLdb.connect() c = x.cursor() c.execute('DROP TABLE test') c.execute('DROP TABLE test') yield this traceback: Traceback (most recent call last): File "testMonetDB.py", line 9, in <module> c.execute('DROP TABLE test') File "C:\Python25\lib\site-packages\mdb\MonetSQLdb\cursors.py", line 95, in execute self.errorhandler(self, exc, value) File "C:\Python25\lib\site-packages\mdb\MonetSQLdb\__init__.py", line 72, in defaulterrorhandler raise errorclass, errorvalue RuntimeError: None The Message is None whereas it should be DROP TABLE: no such table 'test' Kind regards, Markus

2 2

[MonetDB-users] bug 1834820 AUTO_INCREMENT failures...
by m h 22 Nov '07

22 Nov '07

Hello again - I've filed another bug here.... http://sourceforge.net/tracker/index.php?func=detail&aid=1834820&group_id=5… Similar to the NUMERIC not allowing initial NULLs, AUTO_INCREMENT won't allow skipping of Primary Keys (the first time after, the second time it works) after you've inserted with a Primary Key... -matt

2 3

[MonetDB-users] Merovingian
by Venks 21 Nov '07

21 Nov '07

Hi, I have been using some old scripts to START and STOP MonetDB instances. One of our requirements is to not to use default database and default directories for data/logs. So, I specify the data/log/checkpoint and the mapi_port explicitly when I bring up the instance using "mserver5". Please find enclosed the actual command from the START script below. #...Launch the database /root/countdb/bin/mserver5 --dbfarm=/mnt/countdb1/dbfarm --dbname=csdb --dbinit='include sql;' --set sql_logdir=/mnt/countdb1/sql_logs --set checkpoint_dir=/mnt/countdb1/chkpnt --set mapi_port=50001 --set daemon=yes --set monet_welcom=no --set MONETDB5_PREFIX=$MDIR >> $LOG 2>&1 & I understand the "merovingian" is the new and updated program to handle instance administration issues. Can you please provide more information on how I can use "merovingian" to START/STOP MonetDB instances? Is there online help for "merovingian" apart from what mentioned in the configuration file? Like "mserver5 --help" I was expecting "merovingian --help" but that doesn't work. Thanks, -Venks

4 5

[MonetDB-users] Running multiple instances on same machine
by Venks 21 Nov '07

21 Nov '07

Hi, Can you please tell me how to run three different MonetDB instances on one machine? I created three different binaries from the install and I tried to change the port from 50000 to 50001, 50002 and 50003. But for some reason I can only connect using 50000. Thanks, -Venks

3 3

[MonetDB-users] Bug 1833800 - python client not getting actual errors, only None
by m h 19 Nov '07

19 Nov '07

I've filed bug 1833800. It was reported in passing in a previous thread that the python client isn't getting the acutal errors. A fix for this wonderful! thanks much, matt

2 3

[MonetDB-users] python issues
by m h 17 Nov '07

17 Nov '07

Hello- The simple python example from the website is crashing [0]. I get the following output when I try to run it: matt@r52 ~/work/II/svn/trunk/2MonetDB $ python testmdb.py (981, 'schemas', 980, None, '0', True, '0', '0') *** glibc detected *** python: free(): invalid pointer: 0x080cf8d8 *** ======= Backtrace: ========= /lib/libc.so.6[0xb7cdea00] /lib/libc.so.6(cfree+0x89)[0xb7ce06f9] /usr/lib/libMapi.so.0(mapi_destroy+0x77)[0xb7b4a40f] /home/matt/work/vpython/lib/python2.4/site-packages/MonetDB/_MapiLib.so[0xb7fa25a5] /usr/lib/libpython2.4.so.1.0(PyCFunction_Call+0x10d)[0xb7eef420] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x3259)[0xb7f1c7b5] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0(PyDict_DelItem+0xc8)[0xb7eee29a] /usr/lib/libpython2.4.so.1.0[0xb7ed5755] /usr/lib/libpython2.4.so.1.0(PyObject_SetAttr+0xbc)[0xb7ef098b] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x23b5)[0xb7f1b911] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0[0xb7eec587] /usr/lib/libpython2.4.so.1.0(PyDict_SetItem+0xb0)[0xb7eee75d] /usr/lib/libpython2.4.so.1.0[0xb7ed579f] /usr/lib/libpython2.4.so.1.0(PyObject_SetAttr+0xbc)[0xb7ef098b] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x2372)[0xb7f1b8ce] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x3390)[0xb7f1c8ec] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0[0xb7eec587] /usr/lib/libpython2.4.so.1.0(PyDict_SetItem+0xb0)[0xb7eee75d] /usr/lib/libpython2.4.so.1.0(_PyModule_Clear+0x148)[0xb7eef9c3] /usr/lib/libpython2.4.so.1.0(PyImport_Cleanup+0x1ee)[0xb7f2fc18] /usr/lib/libpython2.4.so.1.0(Py_Finalize+0xf9)[0xb7f35261] /usr/lib/libpython2.4.so.1.0(Py_Main+0x9ad)[0xb7f3b1e9] python(main+0x1a)[0x804866e] /lib/libc.so.6(__libc_start_main+0xdc)[0xb7c8efdc] python[0x80485b1] ======= Memory map: ======== 08048000-08049000 r-xp 00000000 08:03 1772622 /home/matt/work/vpython/bin/python 08049000-0804a000 rw-p 00000000 08:03 1772622 /home/matt/work/vpython/bin/python 0804a000-080f5000 rw-p 0804a000 00:00 0 [heap] b7800000-b7821000 rw-p b7800000 00:00 0 b7821000-b7900000 ---p b7821000 00:00 0 b79e1000-b79e9000 r-xp 00000000 08:03 4735072 /lib/libnss_files-2.6.1.so b79e9000-b79ea000 r--p 00007000 08:03 4735072 /lib/libnss_files-2.6.1.so b79ea000-b79eb000 rw-p 00008000 08:03 4735072 /lib/libnss_files-2.6.1.so b79eb000-b79f6000 r-xp 00000000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f6000-b79f7000 r--p 0000a000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f7000-b79f8000 rw-p 0000b000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f8000-b7a06000 r-xp 00000000 08:03 2621464 /lib/libz.so.1.2.3 b7a06000-b7a07000 rw-p 0000d000 08:03 2621464 /lib/libz.so.1.2.3 b7a07000-b7a0d000 r-xp 00000000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0d000-b7a0e000 r--p 00005000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0e000-b7a0f000 rw-p 00006000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0f000-b7af6000 r-xp 00000000 08:03 3432882 /usr/lib/libcrypto.so.0.9.8 b7af6000-b7b0b000 rw-p 000e6000 08:03 3432882 /usr/lib/libcrypto.so.0.9.8 b7b0b000-b7b0e000 rw-p b7b0b000 00:00 0 b7b0e000-b7b3d000 r-xp 00000000 08:03 3432885 /usr/lib/libssl.so.0.9.8 b7b3d000-b7b41000 rw-p 0002e000 08:03 3432885 /usr/lib/libssl.so.0.9.8 b7b41000-b7b4c000 r-xp 00000000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b4c000-b7b4d000 r--p 0000a000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b4d000-b7b4e000 rw-p 0000b000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b73000-b7c79000 rw-p b7b73000 00:00 0 b7c79000-b7da3000 r-xp 00000000 08:03 4735105 /lib/libc-2.6.1.so b7da3000-b7da5000 r--p 0012a000 08:03 4735105 /lib/libc-2.6.1.so b7da5000-b7da6000 rw-p 0012c000 08:03 4735105 /lib/libc-2.6.1.so b7da6000-b7da9000 rw-p b7da6000 00:00 0 b7da9000-b7db2000 r-xp 00000000 08:03 1492902 /usr/lib/gcc/i686-pc-linux-gnu/4.1.2/libgcc_s.so.1 b7db2000-b7db3000 rw-p 00009000 08:03 1492902 /usr/lib/gcc/i686-pc-linux-gnu/4.1.2/libgcc_s.so.1 b7db3000-b7db4000 rw-p b7db3000 00:00 0 b7db4000-b7dd8000 r-xp 00000000 08:03 4735063 /lib/libm-2.6.1.so b7dd8000-b7dd9000 r--p 00023000 08:03 4735063 /lib/libm-2.6.1.so b7dd9000-b7dda000 rw-p 00024000 08:03 4735063 /lib/libm-2.6.1.so b7dda000-b7e85000 r-xp 00000000 08:03 1712627 /usr/lib/gcc-lib/i686-pc-linux-gnu/3.3.6/libstdc++.so.5.0.7 b7e85000-b7e8a000 rw-p 000aa000 08:03 1712627 /usr/lib/gcc-lib/i686-pc-linux-gnu/3.3.6/libstdc++.so.5.0.7 b7e8a000-b7e8f000 rw-p b7e8a000 00:00 0 b7e8f000-b7e91000 r-xp 00000000 08:03 4735083 /lib/libutil-2.6.1.so b7e91000-b7e92000 r--p 00001000 08:03 4735083 /lib/libutil-2.6.1.so b7e92000-b7e93000 rw-p 00002000 08:03 4735083 /lib/libutil-2.6.1.so b7e93000-b7e95000 r-xp 00000000 08:03 4735065 /lib/libdl-2.6.1.so b7e95000-b7e96000 r--p 00001000 08:03 4735065 /lib/libdl-2.6.1.so b7e96000-b7e97000 rw-p 00002000 08:03 4735065 /lib/libdl-2.6.1.so b7e97000-b7eaa000 r-xp 00000000 08:03 4735068 /lib/libpthread-2.6.1.so b7eaa000-b7eab000 r--p 00013000 08:03 4735068 /lib/libpthread-2.6.1.so b7eab000-b7eac000 rw-p 00014000 08:03 4735068 /lib/libpthread-2.6.1.so b7eac000-b7eae000 rw-p b7eac000 00:00 0 b7eae000-b7f62000 r-xp 00000000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f62000-b7f63000 r--p 000b3000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f63000-b7f85000 rw-p 000b4000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f85000-b7f8b000 rw-p b7f85000 00:00 0 b7f8b000-b7f8f000 r-xp 00000000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f8f000-b7f90000 r--p 00003000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f90000-b7f92000 rw-p 00004000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f92000-b7f94000 r-xp 00000000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f94000-b7f95000 r--p 00001000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f95000-b7f96000 rw-p 00002000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f96000-b7fab000 r-xp 00000000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fab000-b7fac000 r--p 00014000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fac000-b7fad000 rw-p 00015000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fad000-b7fae000 rw-p b7fad000 00:00 0 b7fb1000-b7fb2000 r-xp b7fb1000 00:00 0 [vdso] b7fb2000-b7fcc000 r-xp 00000000 08:03 4735086 /lib/ld-2.6.1.so b7fcc000-b7fcd000 r--p 00019000 08:03 4735086 /lib/ld-2.6.1.so b7fcd000-b7fce000 rw-p 0001a000 08:03 4735086 /lib/ld-2.6.1.so bff36000-bff58000 rw-p bff36000 00:00 0 [stack] Aborted matt@r52 ~/work/II/svn/trunk/2MonetDB $ I'm running the latest ebuild for gentoo. Any suggestions to remove crashing would be great. thanks much, matt 0 -http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/The-Python-Library.html#The-Python-Library

5 17

[MonetDB-users] (some) Numeric columns don't allow NULL?
by m h 16 Nov '07

16 Nov '07

Hello again, I've got a column declared as such: foo NUMERIC(9, 2), When I try and enter NULL values into it, it gives the following error: !SQLException:int:"" is no decimal value (doesn't contain a '.') Now, the message itself had me confused (still does actually), but I figured out by trial that it was complaining that I was shoving a NULL value in that column. Can someone explain why a NULL value can't go it here? (There is no "NOT NULL" on the column) Also columns defined as "NUMERIC(7,0)" allow NULL values..... Confused..... -matt

2 4

[MonetDB-users] Using DataSource class within MonetDB -- connection error -- cause? fix?
by jsolderitsch 16 Nov '07

16 Nov '07

I got lots of good help with my last query. I am trying to access a MonetDB through Sun's Glassfish app server. I am following an example that uses the Java Persistence API and Netbeans 6.0 beta 2 that has some interesting automation to generate code, in particular for configuration file generation that define the jndi context. But my example doesn't work. My code is based on a tutorial I found that uses Derby which is built into Glassfish. I see the errors: TopLink, version: Oracle TopLink Essentials - 2.0 (Build b58g-fcs (09/07/2007)) Server: unknown RAR5038:Unexpected exception while creating resource RAR5117 : Failed to obtain/create connection from connection pool [ jdbc_monetdb_localhost_demoPool ]. Reason : Connection could not be allocated because: Unable to connect (localhost:45123): Connection refused RAR5114 : Error allocating connection : [Error in allocating a connection. Cause: Connection could not be allocated because: Unable to connect (localhost:45123): Connection refused] Internal Exception: java.sql.SQLException: Error in allocating a connection. Cause: Connection could not be allocated because: Unable to connect (localhost:45123): Connection refused Error Code: 0 Local Exception Stack: Exception [TOPLINK-4002] (Oracle TopLink Essentials - 2.0 (Build b58g-fcs (09/07/2007))): oracle.toplink.essentials.exceptions.DatabaseException Internal Exception: java.sql.SQLException: Error in allocating a connection. Cause: Connection could not be allocated because: Unable to connect (localhost:45123): Connection refused I looked at the class MonetDataSource in the JDBC jar file and I see that the constructor for MonetDataSource uses 45123 for the field portNumber. But there is no apparent way to set the portNumber to something else. How do I get MonetDB to listen on this port? It seems that the default port is 50000. Is there a conf setting I can make to get this to work? What is the difference between portNumber here and port value as checked for in the Driver class? Any help appreciated. Jim -- View this message in context: http://www.nabble.com/Using-DataSource-class-within-MonetDB----connection-e… Sent from the monetdb-users mailing list archive at Nabble.com.

3 7

[MonetDB-users] how to select a column named "column"?
by m h 15 Nov '07

15 Nov '07

Hi all, I'm trying to reflect tables (to create a sqlalchemy backend for monetdb). I need to reflect the tables to do that and need primary keys. This information is stored in keycolumns, yet I can't seem to get the column out by itself. sql>select * from keycolumns; +------+--------+------+---+ |id |column |trunc |nr | +======+========+======+===+ |4394 |vendnum | 0 | 0 | |4393 |vendnum | 0 | 0 | +------+--------+------+---+ Timer 1.750 msec 2 rows sql>select column from keycolumns; !syntax error, unexpected COLUMN in: "select column" Timer 0.163 msec 0 rows sql>select keycolumns.column from keycolumns; !syntax error, unexpected COLUMN in: "select keycolumns.column" Advice??? thanks matt

4 3

[MonetDB-users] how compile PHP interface on Linux
by Martin Minka 15 Nov '07

15 Nov '07

I am running CentOS 4.5 (RHEL4.5). I compiled PHP 5.2.2 from source. I compiled "MonetDB server v5.2.0, based on kernel v1.20.0" from source with monetdb-install.sh . MonetDB server works for me. I downloaded clients-1.20.0.tar.gz, unpacked in /tmp and runned: ./configure --prefix=/mytest/MonetDB --with-php --with-php-config=/mytest/php/bin --with-php-extensiondir=/mytest/php/lib/php/extensions I see only warning, that Buildtools are not installed and that I will not able to build from CVS, that should be fine, I am not using source code from CVS (right?). I run make and it seams to me, that the process is only building only mapiclient and mapilib. Output of make does not mention any problems but there is also no mentioning of PHP in this output. The output files are here http://www.struix.com/phpmonetdb.zip. I wonder, if somebody could help me out. Sincerely, Martin

2 4

[MonetDB-users] Using JDBC for MonetDB across the network
by jsolderitsch 13 Nov '07

13 Nov '07

I successfully installed Monet on Mac OS X (Tiger) and it works as expected. I can use JDBC from Aqua Data Studio or even Netbeans 6.0 beta 2 to access databases I create but my experiments so far are when these clients and the Monet DB are on the same Mac OS X host. Now I want to install Monet on a linux box on my network and access the DB via JDBC from my Mac. I installed Monet on the linux box (Cent OS). But access via JDBC from the Mac does not seem to be working. I seem to connect from the Mac via Aqua Data Studio, but I do not see the demo database. Instead I see a <DEFAULT> database listed with no schemas. I created a new user and and a schema for that user on Linux using the command line client and that seemed to work. But after disconnecting and re-connecting, I still don't see the database. Could I be doing something wrong? Jim -- View this message in context: http://www.nabble.com/Using-JDBC-for-MonetDB-across-the-network-tf4793137.h… Sent from the monetdb-users mailing list archive at Nabble.com.

3 24

[MonetDB-users] Compilation error in MonetDB4
by Ying Zhang 13 Nov '07

13 Nov '07

Hello, I get the following error when compiling the module MonetDB4: (dev branch, on andorea.ins.cwi.nl => fedora 6, MD Athlon(tm) 64 X2 Dual Core Processor 3800+) gcc -m64 -DHAVE_CONFIG_H -I. -I/ufs/zhang/monet/dev/MonetDB4/src/tools -I../.. -I/ufs/zhang/monet/dev/MonetDB4/src/tools -I../monet -I/ufs/zhang/monet/dev/MonetDB4/src/tools/../monet -I../modules/plain -I/ufs/zhang/monet/dev/MonetDB4/src/tools/../modules/plain -I/export/scratch1/zhang/monet/dev/G.64.64.d.debug/include/MonetDB -I/export/scratch1/zhang/monet/dev/G.64.64.d.debug/include/MonetDB/common -I/export/scratch1/zhang/monet/dev/G.64.64.d.debug/include/MonetDB/gdk -DLIBEMBEDDEDMIL -Wall -Wextra -std=c99 -g -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -D_REENTRANT -c embeddedclient.c -fPIC -DPIC -o .libs/libembeddedmil_la-embeddedclient.o In file included from /ufs/zhang/monet/dev/MonetDB4/src/tools/embeddedclient.mx:69: embeddedclient.h:29:26: error: mapilib/Mapi.h: No such file or directory In file included from /ufs/zhang/monet/dev/MonetDB4/src/tools/embeddedclient.mx:69: embeddedclient.h:31: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'embedded_mil' /ufs/zhang/monet/dev/MonetDB4/src/tools/embeddedclient.mx:183: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'embedded_mil' make[5]: *** [libembeddedmil_la-embeddedclient.lo] Error 1 make[5]: Leaving directory `/export/scratch1/zhang/mbuild/dev/MonetDB4/build-debug/src/tools' I think I have seen such error earlier, in de mailing-list or bug report, but I can't recall it. I believe both my source code and build env. are up-to-date and clean, but this error still looks as if I have some out-dated stuf. Does anybody have a clue about this? Thanks! Jennie

2 2

[MonetDB-users] R: Re: mclient fails to connect to local database server: "No route to host"
by marco.antonelli82＠fastwebnet.it 12 Nov '07

12 Nov '07

>Can you check the merovingian.log file to see if it actually sees a >client connecting, or maybe give another hint why things go wrong? > These lines appear in /usr/local/var/log/merovingian.log when I try to connect with mclient: MSG merovingian[8124]: database 'demo' already running since 2007-11-12 14:24: 35, up min/avg/max: 2/769/4851, crash average: 0.00 0.00 0.00 (10-9=0) MSG merovingian[8124]: redirecting client for database 'demo' to mapi:monetdb: //hp:50001/ The fact is that my host is reffered as "hp" (my machine name) and as "localhost". On my /etc/hosts file "hp" is an alias for 192.168.1.1 and not for 127.0.0.1, and beacuse of this mclient is blocked by my firewall. I changed my /etc/hosts file and now it works, but how to make MonetDB listen on "localhost" instead of "hp"? There is no option for that in /usr/local/etc/monetdb5.conf I find this error message as well when I start the "demo" db: ERR demo[8181]: #warning: please don't forget to set your vault key! ERR demo[8181]: #(see /usr/local/etc/monetdb5.conf) What is this about? Thanks for help Fabian!

2 1

[MonetDB-users] mclient fails to connect to local database server: "No route to host"
by marco.antonelli82＠fastwebnet.it 12 Nov '07

12 Nov '07

Hello everyone, I successfully managed to install MonetDB components(MonetDB-common, MonetDB clients, MonetDB5-server, MonetDB_SQL) on Linux, but I have some problems in running it. These are the steps that I followed from the online documentation: I started merovingian with: sudo merovingian then I created the "demo" database and started it with: sudo monetdb create demo sudo monetdb start demo I checked the status: sudo monetdb status demo name state uptime crashes demo running 29m 6s 0 (if I run this command without 'sudo' i get: monetdb status demo warning: MonetDB Database Server is not running name state uptime crashes demo stopped 1 2007-11-12 12:33:41 Is that normal?) So everything seems fine, but when I run mclient (both as root and normal user) I got an error: mclient -lsql --database=demo !ERROR mapi_reconnect: connect: No route to host Setup connection failed I even tried to add a kernel route with: sudo route add -host localhost lo but it did not help. Does somebody know what is the problem and how to solve it? Best regards, Marco Antonelli

2 1

[MonetDB-users] XQuery: Schema import, Indexing
by Silvio Kohler 09 Nov '07

09 Nov '07

Hi, we're trying to benchmark different XML-DBs, one of them is MonetDB/Xquery. Two questions came up: 1) How is schema import done in MonetDB/XQuery? Does it affect execution time for queries? We imported it in the XML file and also in the query, but did not have any effect on execution time. Also, a lot of schema items such as <xs:enumeration> or <xs:dateTime> seem not to be supported. 2) Is indexing possible? Regards, Silvio

4 4

[MonetDB-users] Is there a blocking connect to server
by Pranav Vaidya 08 Nov '07

08 Nov '07

Hello, Is there a client API in Monet which implements a blocking connect to the Mserver (possibly with a time out). My understanding of mapi_connect is that it is a non-blocking connect. I would appreciate it if someone could kindly direct me in this regard. My thanks in advance. Pranav. -- View this message in context: http://www.nabble.com/Is-there-a-blocking-connect-to-server-tf4768425.html#… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] XQuery: Schema import, Indexing
by Silvio Kohler 06 Nov '07

06 Nov '07

Hi, we're trying to benchmark different XML-DBs, one of them is MonetDB/Xquery. Two questions came up: 1) How is schema import done in MonetDB/XQuery? Does it affect execution time for queries? We imported it in the XML file and also in the query, but did not have any effect on execution time. Also, a lot of schema items such as <xs:enumeration> or <xs:dateTime> seem not to be supported. 2) Is indexing possible? Regards, Silvio

1 0

[MonetDB-users] "merovingian" usage
by Venks 31 Oct '07

31 Oct '07

Recent installation of MonetDB showed the following text at the end of the installation. ==================================== You can start using MonetDB/SQL by starting /root/countdb/bin/merovingian in the background. Read the merovingian(1), monetdb(1) and mclient(1) manpages to learn how to create a database and afterwards connect to it. ==================================== Is "merovingian" ready for usage? When I type "merovingian" I am getting the following error: =============================================================================== unable to create .merovingian_lock file in /root/countdb/var/MonetDB5/dbfarm: No such file or directory =============================================================================== That's because there is no MonetDB5 directory yet. This may be of importance to us as I need to do the following: - Run MonetDB in background - Create the database directory, LOG, CheckPoint and any other files related to any database in a user specified directory. Right now I am using mserver5 executable in a script to start MonetDB in the background. This script was provided by you (Fabian) Please let me know if I need to start using "merovingian" for my needs. Thanks, -Venks

6 14

[MonetDB-users] On Java/JDBC compatibility
by Sander Kruseman 31 Oct '07

31 Oct '07

I thought this might be of interest to some of you. New Java releases are normally upwards binary-compatible with prior releases with only few minor/niche exceptions. This implies that one should normally be able to use recent JVM versions to run MonetDB's (JDBC) class/jar files, even if these were compiled with an older JDK version. See: http://java.sun.com/j2se/1.5.0/compatibility.html and: http://java.sun.com/javase/6/webnotes/compatibility.html#binary Note that the opposite does not hold: class/jar files cannot be run with a JVM older than that from the JDK used to compile them. (Every newer JDK marks its generated class files with a different class file version number, which is checked by the JVM.) I hope this helps. Sander Kruseman

1 0

[MonetDB-users] SQL DELETE bug?
by Sander Kruseman 30 Oct '07

30 Oct '07

Hi, Using server v5.0.0 on Windows with the JDBC terminal v1.18.0, SQL DELETE statements appear to fail. Working in autocommit mode, I issue the following commands: create table test (id int unique not null, name varchar(10) not null); insert into test (id, name) values (1, 'jan'); delete from test where id = 1; select * from test; I get no rows, as was to be expected. However, using DbVisualizer (also using JDBC) I can still see the one inserted table row (after Reload View). After restarting both server and JDBC terminal, I also get the row when using the JDBC terminal. Bug or ignorance? Note that I am using my own schema having been setup with its own user, similar to the VOC tutorial. kind regards, Sander Kruseman

2 2

[MonetDB-users] Large Databases
by algatt 29 Oct '07

29 Oct '07

I am trying to create a large database almost 10GB (TPC-H). When I try to bulk load a 7GB file the server does not work anymore. First, the server quits in the middle of the bulk load, then when I try to re-start the server it does not start showing a message about the OS not having enough space. Then I split the 7GB file into individuals 1GB files, after I upload around 4GB individually, the server crashes. Then when I re-start the server it does not start stating that the BACKUP folder cannot be accessed and not enough permissions! I am using MonetDB 5 on Windows XP 1GB RAM. Any ideas? Thank You. alan -- View this message in context: http://www.nabble.com/Large-Databases-tf4710020.html#a13462531 Sent from the monetdb-users mailing list archive at Nabble.com.

3 3