- users-list - monetdb.org

[MonetDB-users] JDBC: Not all results returned
by Martin Beck 23 Feb '06

23 Feb '06

Hi, I have a simple SQL script which starts like this: CREATE TABLE people ( pid integer NOT NULL PRIMARY KEY, name varchar(40) NOT NULL DEFAULT '', number varchar(15) NOT NULL UNIQUE DEFAULT '0', email varchar(100) NOT NULL, spid integer NOT NULL DEFAULT '0' ); Afterwards, it inserts 251 People with ascending pids from 0 to 250. I apply it to the MonetDB database either with MapiClient, or JDBCClient. However, if I login with the JDBCClient and do a "select name,number from people;" i only get 250 rows, not 251! But no error is reported. Instead, a "select count(*) from people;" returns 251. if i try the same with the MapiClient, everything works as expected. the problem seems to be with other tables, too, but there the count of returned rows another one, so I expect it has something to with a packet limit, or something? is it a configuration thing or a bug? with 2.8.2 everything worked. if executed from a java program, the statement returns the exception "protocol violation: unexpected line in data block:"

3 8

[MonetDB-users] network setup
by Colin Foss 15 Feb '06

15 Feb '06

How do you configure MonetDB to listen to connections from anywhere besides the localhost? I can make a local connection but as soon as I try to connect from another computer I get an error. I have even tested with netcat (nc) to make sure there wasn't a firewall blocking the connection. Colin Foss

2 1

[MonetDB-users] Mondrian and MonetDB
by Martin Kersten 31 Jan '06

31 Jan '06

LS, I think the combination of the opensource project Mondrian and MonetDB would be a very strong couple. Especially given the history of MonetDB in the area of datamining. However, the resources at the core team are insufficient at this point in time to embark on such a (short term) project. Perhaps someone in our user community is willing to take up the challenge and report on the problems encountered/ results obtained. The core development teams is particularly interested in missing features, interfacing problems, and, ofcourse, performance problems. regards, Martin ----------------------------------------------- Read and respond to this message at: https://sourceforge.net/forum/message.php?msg_id=3551757 By: jhyde I'm always happy to add support to Mondrian for another DBMS. The process is fairly well-worn, since we support several DBs already. It's best if someone familiar with the DBMS goes through the process, then I'll integrate the code and update the doc. The process is: 1. Get the MondrianFoodMartLoader working for your DB. 2. Tweak Mondrian's SQL-generation facilities for the capabilities of your DB. Look at SqlQuery.Dialect and you will see the kinds of things that Mondrian cares about. (If your DB has a fairly expressive SQL, and driver provides the appropriate metadata so Mondrian knows what it's capable of, this step may be trivial.) 3. Add your database name as an option for the <SQL dialect="db"> element. (Code is in Mondrian.xml, and elsewhere.) 4. Get the Mondrian regression suite to run cleanly. 5. Provide some typical connect strings for me to put into mondrian.properties. 6. Give me a contact who is willing to run the regression suite on your DB before each release. ______________________________________________________________________ You are receiving this email because you elected to monitor this forum. To stop monitoring this forum, login to SourceForge.net and visit: https://sourceforge.net/forum/unmonitor.php?forum_id=111375

2 1

[MonetDB-users] MonetDB-SQL 2.10.0 - Status of temorary tables?
by leemarks＠netspace.net.au 31 Jan '06

31 Jan '06

Hi, Are temporary tables currently supported in monetdb-sql? If I do something like, create temporary table foo (abc integer) It fails with a strange error. [Perhaps I'm using invalid syntax?] Thanks in advance, Lee ------------------------------------------------------------ This email was sent from Netspace Webmail: http://www.netspace.net.au

4 8

[MonetDB-users] 8 hours of Photoshop Video Tutorials
by Cole 23 Jan '06

23 Jan '06

1 0

[MonetDB-users] MonetDB/Five slotting: on running M4 next to M5
by Fabian Groffen 25 Dec '05

25 Dec '05

Hi list, Scheduled for next year is the (alpha/beta) release of MonetDB/Five, the successor of the current MonetDB generation. MonetDB/Five is the logical successor to its predecessor in terms of speed and performance. However, MonetDB/Five is not fully backwards compatible with it's predecessor. Instead of using the MIL language for kernel operations, it uses MAL. Although many MIL operations can be easily mapped on MAL operations, a fully automatic (and correct) translation of MIL to MAL is not possible. Directly related to this, is the availability of MonetDB/XQuery, which currently heavily relies on the MIL language. The SQL users of MonetDB will be the only ones that will immediately benefit from the improved MonetDB/Five engine, as SQL is fully functional and there is no difference in language or output. Due to this situation where both M4 (curent MonetDB generation) and M5 (MonetDB/Five generation) have it's own advantages (XQuery support, MIL, MAL, better performance) it is most likely that one would like to run both M4 and M5 engines next to each other to benefit from both. This would currently cause problems when applied out of the box. Given that M4 and M5 would be slotted, and hence installable next to each other, starting it's services would cause problems because both engines try to bind to the same ports by default. To give a short view on the ports in use by default: M4 M5 Mapi 50000 50000 SQL 45123 45123 XQuery 45789 N/A This obviously clases for default MIL/MAL (Mapi) connections as well as SQL connections. XQuery is not an issue for the moment. A few observations: - The actual language spoken over the Mapi server port is engine specific, i.e. MIL for M4 and MAL for M5. This is probably somewhat confusing. For SQL it is clear, and the port specifies which language to use, regardless the engine. - XQuery support is not available for M5 yet, but it should be dealt with as for SQL. Possible scenarios to solve the problems of clashing ports can be: 1. Use different port numbers based on the engine, i.e. use 55123 for SQL on M5 and 45123 on M4. Mapi could become something like 50005 for M5. 2. Build (or extend for instance the DatabasePool) an application that handles transparently the request for a service making use of a combination of port and challenge response to give the client a M4 MIL, M5 MAL, M5 SQL or M4 XQuery connection, using the ports currently known. (Note: this also allows for multi-catalog support for SQL, when the DatabasePool is taken as base.) 3. Ignore the problem and only document it, including how to change the default ports to avoid clashes. (Note: unfortunately we're unable to bind to a certain interface...) 4. A combination between 1 and 2, with the purpose of getting each language it's own port in the system, reducing the problem and possibly disable M4's SQL server. Are end-users interested in/aided by such changes made, or will they figure out themselves easily enough? Just a few thoughts on a problem that will arise in distribution land...

1 0

[MonetDB-users] MonetDB Bug-Etiquette
by Stefan Manegold 24 Nov '05

24 Nov '05

Dear MonetDB-users and -developers, bug reports and especially test script play a crucial role with maintaining and improving the stability and correct functioning of MonetDB. However, adding test scripts "a posteriori" as we did recently during the two "MonetDB-Bug-Days" (a third one is still to come before the end of this year!) is a very tedious and time-consuming task, especially since who ever is adding a test script first needs to get familiar with the details of the very bug report. Since both the user who submits a bug report and the developer(s) who take(s) care of fixing a bug are by definition very familiar with the details of a bug report, it seems more than obvious that they should share the task of adding a test script to the CVS repository while dealing with the respective bug, i.e., *before* closing the bug report. Ideally, the user/submitter provides the query or script that triggers the bug as well as the expected/correct output with his/her bug report. In case the user/submitter has CVS check-in privileges, he/she could add the test script to the CVS repository him-/herself. Otherwise, the developer/assignee should add the user's test script to the CVS repository. The test script helps both the developer/assignee and the user/submitter to monitor the status of the bug by running "Mtest[.py]" (cf., http://monetdb.cwi.nl/monet/src/testing/README) or by checking the TestWeb (http://monetdb.cwi.nl/Development/TestWeb/) To coordinate this procedure, I made a first draft for a "MonetDB Bug Etiquette", which you find attached to this mail. I'd be very pleased, if you could comment on this. Thank you all very much for your contribution to make MonetDB even better than it already is! Kind regards, Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

4 10

[MonetDB-users] MonetDB 10.000 downloads
by Martin Kersten 20 Nov '05

20 Nov '05

LS, It is my pleasure to announce that on Nov 19, 2005 around 23:00 GMT we reached the first 10.000 downloads of MonetDB packages (MonetDB+SQL+XQuery) available on Sourceforge. Let's go the 100.000 ! regards, Martin

1 0

[MonetDB-users] Still can't compile under FreeBSD
by Eugene Rogoza 31 Oct '05

31 Oct '05

Hello everybody, I can't compile MonetDB from sources no matter what I do. Even with the patch from Marcel. I've been trying to compile the MonetDB-4.8.2 sources as well as CVS version. What I get is attached below. Could someone point out the exact steps to compile this stuff on FreeBSD 5.3? I would be very grateful. Eugene root@inspiron:~/MonetDB-4.8.2/FreeBSD> gmake cd .. && /usr/local/bin/bash /root/MonetDB-4.8.2/conf/missing --run aclocal-1.9 /usr/X11R6/share/aclocal/xmms.m4:17: warning: underquoted definition of XMMS_TEST_VERSION run info '(automake)Extending aclocal' or see http://sources.redhat.com/automake/automake.html#Extending-aclocal /usr/X11R6/share/aclocal/xmms.m4:62: warning: underquoted definition of AM_PATH_XMMS /usr/X11R6/share/aclocal/oaf.m4:4: warning: underquoted definition of AM_PATH_OAF /usr/X11R6/share/aclocal/libglade.m4:7: warning: underquoted definition of AM_PATH_LIBGLADE /usr/X11R6/share/aclocal/libart.m4:11: warning: underquoted definition of AM_PATH_LIBART /usr/X11R6/share/aclocal/imlib.m4:9: warning: underquoted definition of AM_PATH_IMLIB /usr/X11R6/share/aclocal/imlib.m4:167: warning: underquoted definition of AM_PATH_GDK_IMLIB /usr/X11R6/share/aclocal/gtk.m4:7: warning: underquoted definition of AM_PATH_GTK /usr/X11R6/share/aclocal/gdk-pixbuf.m4:12: warning: underquoted definition of AM_PATH_GDK_PIXBUF /usr/X11R6/share/aclocal/gconf-1.m4:4: warning: underquoted definition of AM_PATH_GCONF /usr/X11R6/share/aclocal/gconf-1.m4:71: warning: underquoted definition of AM_GCONF_SOURCE aclocal:configure.in:74: warning: macro `AM_MONETDB_COMPILER' not found in library aclocal:configure.in:75: warning: macro `AM_MONETDB_TOOLS' not found in library aclocal:configure.in:76: warning: macro `AM_MONETDB_OPTIONS' not found in library aclocal:configure.in:77: warning: macro `AM_MONETDB_LIBS' not found in library cd .. && /usr/local/bin/bash /root/MonetDB-4.8.2/conf/missing --run autoconf configure.in:74: error: possibly undefined macro: AM_MONETDB_COMPILER If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. configure.in:75: error: possibly undefined macro: AM_MONETDB_TOOLS configure.in:76: error: possibly undefined macro: AM_MONETDB_OPTIONS configure.in:77: error: possibly undefined macro: AM_MONETDB_LIBS WARNING: `autoconf' is missing on your system. You should only need it if you modified `configure.in'. You might want to install the `Autoconf' and `GNU m4' packages. Grab them from any GNU archive site. /usr/local/bin/bash ./config.status --recheck running /usr/local/bin/bash ../configure --no-create --no-recursion checking build system type... i386-unknown-freebsd5.3 checking host system type... i386-unknown-freebsd5.3 checking target system type... i386-unknown-freebsd5.3 checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for gawk... gawk checking whether make sets $(MAKE)... yes ../configure: line 1898: syntax error near unexpected token `AM_MONETDB_TOOLS' ../configure: line 1898: `AM_MONETDB_TOOLS()' gmake: *** [config.status] Error 2

3 4

[MonetDB-users] FreeBSD compile patch
by Marcel Hamer 21 Oct '05

21 Oct '05

Hello, The following, very small, patch makes MonetDB compile without errors and warnings on a FreeBSD 5.4 system. I was able to succesfully compile and run MonetDB this way on FreeBSD. ----------------------------------------------------------------- +++ ./conf/monet.m4 Wed Oct 19 21:26:01 2005 @@ -236,6 +236,8 @@ yes-*-*) dnl defines that enable the features beyond C89 in the various dnl platforms. Here's what we found working so far... case "$gcc_ver-$host_os" in + *-freebsd*) + ;; *-cygwin*) dnl MonetDB/src/testing/Mtimeout.c fails to compile with dnl "--std=c99" as the compiler then refuses to recognize ------------------------------------------------------------------ Kind regards, Marcel Hamer

2 2

[MonetDB-users] mail Server
by Jone 21 Oct '05

21 Oct '05

Dear monetdb-users(a)lists.sourceforge.net: Bullet-Proof server: Fresh IPs 1024MB RAM P4 CPU 72GB SCSI Dedicated 100M fiber Unlimited Data Transfer Any software Based China US$599.00 per month May use the server for: Bulk web Hosting Direct Mail We also supply email list according to your order and sending out your message for you. Hope to service for you. Cheers! Jone Server Team kezunli666(a)sohu.com For.NoSend: MoreNot(a)yahoo.com

1 0

[MonetDB-users] Huge tables
by Andrei Martsinchyk 04 Oct '05

04 Oct '05

Hello, It seems MonetDB has problem with handling of huge tables (larger than amount of memory available). I tried to load large amount of data into a table using COPY command. I loaded same data (6 millions records, 700+MBytes) few times. Loading was successful two times, on third time server crushed. After crush I could not start the server again, it output messages !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. !FATAL: BBPinit: cannot properly process bat/BACKUP/. and exited. Removing of the database data directory did not help much - server output messages !ERROR:mvc_init: unable to create system tables !WARNING: BBPincref: range error 410 Couple minutes later it output !ERROR: BATSIGcrash: Mserver internal error (Segmentation fault), please restart . !ERROR: (One potential cause could be that your disk might be full...) Well, insufficient disk space could be a cause, before server crashed I had approximately 2GB free. But I have cleaned up 10 GB and problem persists. How can I troubleshoot and fix the server ? What are memory / disk space requirements when bulk loading data ? I tested with 32-bit system, 512 MB RAM + 1GB swap, Ubuntu Linux, MonetDB-4.9.3, nightly build dated September 30. -- Best regards, Andrei Martsinchyk mailto:andrei.martsinchyk@gmail.com

2 6

[MonetDB-users] Bulk load
by Andrei Martsinchyk 03 Oct '05

03 Oct '05

Hello, I am trying to pipe output from my application using bulk load. If application produced output like this: CREATE TABLE test (col1 int); COPY 3 RECORDS INTO "test" FROM stdin USING DELIMITERS '\t'; 1 2 NULL COMMIT; I could pipe it to MapiClient -lsql -umonetdb -Pmonetdb, it worked OK. But application does not know how many rows it will produce, until dump out all the records. When I tried to skip record count I got failed assertion error (a bug ?). Anyway, it would fail when encountered COMMIT; at the end. At the same time COPY without record count can load data from a file, but I do not want to put data into temp table and then do load because i want them run in parallel. Could you suggest a way to do the loading ? -- Best regards, Andrei Martsinchyk mailto:andrei.martsinchyk@gmail.com

1 1

[MonetDB-users] SQL: Update table from another table
by Andrei Martsinchyk 08 Sep '05

08 Sep '05

Hello All, Does SQL frontent support updating one table with data from another table ? More formally, if I have two tables create table t1 (id1 int, val1 varchar(255)); and create table t2 (id2 int, val2 varchar(255)); , can I execute statement like this (PostgreSQL syntax): update t1 set val1=val2 from t2 where id1=id2; ? Thanks in advance. -- Best regards, Andrei Martsinchyk mailto:andrei.martsinchyk@gmail.com

2 4

[MonetDB-users] "Large" document collection and MonetDB/XQuery
by Bastiaan Naber 05 Sep '05

05 Sep '05

We have been experimenting with the MonetDB/XQuery at our institure and we have some issues. We have loaded 727 XML documents into MonetDB with the shred_doc() command: shred_doc("{xml file 1}, "1") shred_doc("{xml file 2}, "2") etc... These files are small (4 a 5 kilobytes). When we query these files with the following query the result takes a long time to complete (2 minutes): for $i in ("0", "1", .... "727") return $i Can anyone explain why looping over 727 documents is so slow? We have collected all 727 XML documents into 1 XML file and loaded this in MonetDB and this is a lot faster. The test machine is a 2.8 GHz P4 with 1 GB of memory. Another isue is related to the size of the database on the harddisk. When we fist load the 727 XML documents into the database the database directory contains about 47.000 files and is 50 megabytes in size. When we have excuted a number of querys the size of this directory increases to 1.7 gigabytes!! Can anyone explain this behaviour? Is MonetDB generating somekind of dynamic indices? Thanks for your replys, Bastiaan Naber

3 2

[MonetDB-users] MonetDB/XQuery: performance issues
by Peter van der Kamp 23 Aug '05

23 Aug '05

I've been experimenting with MonetDB/XQuery for some time now and i wonder what kind of machine was used to produce the benchmark results as published on the website. Are there some guidelines ("do's and don'ts") with respect to performance? Peter van der Kamp

3 4

[MonetDB-users] AMD64 version of MonetDB for Windows?
by Cardillo Raymond A Civ AFRL/IFEA 19 Aug '05

19 Aug '05

Has anyone out there taken the time to build an MSI for the AMD64 versions of Windows? The x64 version of Windows was released a few months ago and was available in Beta for a while, so I'm hoping someone has either done this already, or can provide some advice on how to build/compile for this platform. Anyone know of future plans to make this one of the standard platform builds? Windows x64 is only going to grow in popularity from here, especially amongst researchers and others who can benefit from 64 bits. Thanks for any info, Ray Cardillo

2 1

[MonetDB-users] Perl and MonetDB Xquery
by Peter van der Kamp 18 Aug '05

18 Aug '05

LS, As Perl is one of the main programming languages at our institute, I tried the Perl API with MonetDB-Xquery. I succeeded with sending mil statements (with the language parameter set to 'mil') to the server and getting the correct answer, but xqueries failed (with the language parameter set to 'xquery'). This was not a complete surprise as the documentation seems to be ambiguous ("MonetDB/XQuery for POSIX (Linux/Unix) platforms currently only supports MAPI (MonetDB API) to communicate with the XQuery engine."). Following the link to the API's: "Perl binding of the simple Monet API (Mapi) for MIL/SQL database interaction". So, I would like to know if my assumption that currently no xqueries are supported by the Perl API is correct. Peter

4 7

[MonetDB-users] BerkeleyDB
by Rodrigo Schmidt 16 Aug '05

16 Aug '05

Has anyone compared the relative performance between MonetDB (MIL interface) and BerkeleyDB? If so, what were the results? Cheers, Rodrigo

1 0

[MonetDB-users] Re: Support for group by <ordinal> and SQL OLAP functions
by Fabian (MonetDB Project) 12 Aug '05

12 Aug '05

(I'm sending this to the monetdb-users list, as it might help some other people too) Hi, Thanks for your interest in MonetDB/SQL. gustavo wrote: > ... What I´m missing mostly is support for group by a > number of a column. In this way it would be possible to group by na > expression without the use of a derived table (select from select). I don't exactly understand what you want to do. Can you give a concrete (SQL) example that shows what you want to do? I think that would help getting me to understand. > Another > thing that could boost MonetDb usage is SQL OLAP support like stddev, ranks, > running sums/averages, windowing support, rollup and cube. Most of what you mention require a different approach to the data I think. Like running sums or windowing support somehow require you to examine 'streams' of data, thus acting on data as soon as it comes in. I don't think SQL is yet up for this job, the best you can do is simply simulate it. I think CUBE was added to SQL-2003 and therefore might get included, but I don't think on the short term. However, a concrete list of wishes is always welcome! Thanks for your input!

3 2

[MonetDB-users] JDBC driver
by Rodrigo Schmidt 12 Aug '05

12 Aug '05

I installed MonetDB_JDBC-1.2-Blunt-SR1.jar and I am getting the following problem when I try to load MonetDriver using class.forName(): java.lang.UnsupportedClassVersionError: nl/cwi/monetdb/jdbc/MonetDriver (Unsupported major.minor version 49.0). Does any of you know what the problem is? Cheers, Rodrigo

2 9

[MonetDB-users] Problem configuring MonetDB/XQuery
by Peter van der Kamp 11 Aug '05

11 Aug '05

I successfully build MonetDB, prior to configure and build the XQuery front end. However, running configure for this front end stops with: Checking for Mx... no configure: error: No Mx found in PATH I try to build the Mx software, without success. Before continuing I would like to know if the XQuery front end really needs Mx. Thanks. Peter van der Kamp

3 10

[MonetDB-users] inconsistent database
by Rodrigo Schmidt 10 Aug '05

10 Aug '05

Hi, While playing with SQL schemas (creating and eliminating them) I managed to put the database in an inconsistent state. Now I have a schema with nothing inside (neither users nor tables) and apparently I am not able to drop it. When I try, both database server and client crash with an internal error. Is there any monetdb tool that checks the database consistency and recovers it if a problem is identified? Cheers, Rodrigo

2 1

[MonetDB-users] Different storage spaces
by Rodrigo Schmidt 10 Aug '05

10 Aug '05

Hello, In my application I have several processes in a server, each one managing different and non-related pieces of data, which I intend to store in MonetDB databases. As these processes are not related to each other, I would like to put their data in logically different storage spaces, like a different catalog or a different schema inside the database, if not in in different databases themselves. I am just starting with MonetDB and I do not know how I can create new databases, catalogs or schemas and what I should do to configure these things on the server. Can you give me some hints about it? FYI, my application is written in Java and I am using the JDBC interface to connect to the database. Cheers, Rodrigo

2 1

[MonetDB-users] New
by rita kelly 08 Aug '05

08 Aug '05

3 2