- users-list - monetdb.org

[MonetDB-users] mserver5 ignores ulimit?
by Siva Manoharan 14 Dec '10

14 Dec '10

Hi. I am currently running monetdb (release Oct2010) on Debian etch, with 8GB physical RAM and 10GB virutal memory. During unrestricted operation (using the merovingian daemon) monetdb takes up a significant majority of the resources, which is not desirable as there are other processes running on the same server. To limit the memory, I tried using ulimit (setting -d, -v and -m all to 2GB). According to the logs, merovingian notices the limit (a line from log states "Found 1.907 GiB available main-memory"). However, memory usage of mserver still exceeds that limit and is killed off by the OS, abandoning an ongoing query. (merovingian is not killed and mserver restarts without any problems). Is this expected behaviour or is it a bug? Is there another way to limit monetdb's memory usage? As a note, none of the tables (and therefore none of the columns) are anywhere near 2GB in size. The biggest table has ~2.5M rows, where each row has 2 columns ( 8byte bigint and 4 byte int). However, there are thousands of tables, and mserver exceeds the limit most often when a large number of tables are being updated within a short time (in a single php process, however). Is it possible that mserver doesn't release memory fast enough to allow multiple tables to be accessed? Thanks.

1 0

[MonetDB-users] crashes with copy into (270MB file)
by Lex Slaghuis 13 Dec '10

13 Dec '10

Hello I Experience crashes with the copy into statement, with large files (270MB utf8) ... sql>COPY 6000000 records into wptool.wpstats from '/var/www/pagecounts' using delimiters ' ','\n','' null as ''; MAPI = testuser@localhost:50000 ACTION= read_line QUERY = COPY 6000000 records into wptool.wpstats from '/var/www/pagecounts' using delimiters ' ','\n','' null as ''; ERROR = !Connection terminated Timer 5846.447 msec...... Number of records: wc -l /var/www/pagecounts 5983201 /var/www/pagecounts My memory: free -m(egabytes) total used free shared buffers cached Mem: 2007 431 1576 0 20 304 -/+ buffers/cache: 106 1900 Swap: 16769 0 16769 Error-logs: 2010-12-13 14:17:41 MSG merovingian[902]: proxying client localhost:52737 for database 'test' to mapi:monetdb:///var/MonetDB5/dbf arm/test/.mapi.sock?database=test 2010-12-13 14:17:41 MSG merovingian[902]: target connection is on local UNIX domain socket, passing on filedescriptor instead of proxying 2010-12-13 14:18:30 MSG merovingian[902]: database 'test' (1142) was killed by signal SIGSEGV 2010-12-13 14:18:38 ERR control[902]: (local): received stop signal for non running database: test 2010-12-13 14:18:46 MSG merovingian[902]: database 'test' has crashed after start on 2010-12-13 14:17:33, attempting restart, up min/avg/max: 14s/22h/2d, crash average: 1.00 0.70 0.23 (10-3=7) Some specs: uname -a Linux ubuntu 2.6.32-24-server #43-Ubuntu SMP Thu Sep 16 16:05:42 UTC 2010 x86_64 GNU/Linux 2010-12-13 14:17:33 MSG test[1142]: # Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked 2010-12-13 14:17:33 MSG test[1142]: # Found 1.961 GiB available main-memory. If anyone has some pointers on this , it would really help out. I think it would be really to chop up the files into smaller pieces, just for import. Regards Lex Slaghuis -----Original Message----- From: monetdb-users-request(a)lists.sourceforge.net [mailto:monetdb-users-request@lists.sourceforge.net] Sent: vrijdag 10 december 2010 11:12 To: monetdb-users(a)lists.sourceforge.net Subject: MonetDB-users Digest, Vol 55, Issue 2 Send MonetDB-users mailing list submissions to monetdb-users(a)lists.sourceforge.net To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/monetdb-users or, via email, send a message with subject or body 'help' to monetdb-users-request(a)lists.sourceforge.net You can reach the person managing the list at monetdb-users-owner(a)lists.sourceforge.net When replying, please edit your Subject line so it is more specific than "Re: Contents of MonetDB-users digest..." Today's Topics: 1. COPY INTO: wrong length with backslashed chars? (Daniel Boesswetter) 2. Re: COPY INTO: wrong length with backslashed chars? (Stefan de Konink) 3. Some questions regarding parallelism and other stuff... (Mike De-La-Columnar) 4. Re: Some questions regarding parallelism and other stuff... (Martin Kersten) 5. Add primary key performance (paulr135) 6. Re: Add primary key performance (Stefan Manegold) 7. Re: COPY INTO: wrong length with backslashed chars? (Daniel Boesswetter) ---------------------------------------------------------------------- Message: 1 Date: Sun, 05 Dec 2010 19:08:01 +0100 From: Daniel Boesswetter <daniel.boesswetter(a)fu-berlin.de> Subject: [MonetDB-users] COPY INTO: wrong length with backslashed chars? To: monetdb-users(a)lists.sourceforge.net Message-ID: <4CFBD501.9030709(a)fu-berlin.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hi all, I'm using MonetDB for the analysis for ~90GB of data which come from a MySQL-based web-application. The data is dumped into CSV-files on a regular basis and then imported into MonetDB with the COPY command. I have experienced some strange behaviour: obviously, MonetDB counts the number of chars for a VARCHAR-field before removing backslashes which are used e.g. for escaping newlines or other backslashes and rejects strings that should actually fit. A simple reproduction is this: 1. In mclient: CREATE TABLE t (x VARCHAR(1)); 2. Create a textfile foo.txt containing two backslashes: \\ 3. In mclient: sql>copy into t from '/tmp/foo.txt'; SQLException:importTable:value '\\' from line 1 field 1 not inserted, expecting type varchar(1) failed to import table Performing exactly the same steps with a VARCHAR(2) column works without errors and results in t.x containg the de-escaped single backslash. I'm using the Oct-2010 release. My current workaround is to enlarge VARCHARs which caused problems in the past, but this is of course no guarantee that it won't happen again. Although I found a few monetdb-bugs entries concerning the COPY command (e.g. about the misleading error message seen above), none seems to deal with my problem. Is this a bug? Best regards, Daniel ------------------------------ Message: 2 Date: Sun, 05 Dec 2010 19:15:36 +0100 From: Stefan de Konink <stefan(a)konink.de> Subject: Re: [MonetDB-users] COPY INTO: wrong length with backslashed chars? To: Communication channel for MonetDB users <monetdb-users(a)lists.sourceforge.net> Message-ID: <4CFBD6C8.30208(a)konink.de> Content-Type: text/plain; charset=ISO-8859-1 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Op 05-12-10 19:08, Daniel Boesswetter schreef: > Hi all, > > I'm using MonetDB for the analysis for ~90GB of data which come from a > MySQL-based web-application. The data is dumped into CSV-files on a > regular basis and then imported into MonetDB with the COPY command. I > have experienced some strange behaviour: obviously, MonetDB counts the > number of chars for a VARCHAR-field before removing backslashes which > are used e.g. for escaping newlines or other backslashes and rejects > strings that should actually fit. > > A simple reproduction is this: > > 1. In mclient: CREATE TABLE t (x VARCHAR(1)); 2. Create a textfile > foo.txt containing two backslashes: \\ 3. In mclient: > sql>copy into t from '/tmp/foo.txt'; > SQLException:importTable:value '\\' from line 1 field 1 not inserted, > expecting type varchar(1) failed to import table > > Performing exactly the same steps with a VARCHAR(2) column works > without errors and results in t.x containg the de-escaped single backslash. > > I'm using the Oct-2010 release. My current workaround is to enlarge > VARCHARs which caused problems in the past, but this is of course no > guarantee that it won't happen again. > > Although I found a few monetdb-bugs entries concerning the COPY > command (e.g. about the misleading error message seen above), none > seems to deal with my problem. > > Is this a bug? What are you escaping? Paste the line that fails ;) Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEAREKAAYFAkz71sgACgkQYH1+F2Rqwn3AmgCfayhLg6zjXZgvqhV9OHJbj5Kh z64An2xZJy7H1wv3M6hr/SHQaK2C8IM3 =//V/ -----END PGP SIGNATURE----- ------------------------------ Message: 3 Date: Mon, 6 Dec 2010 05:07:46 -0800 (PST) From: Mike De-La-Columnar <mikevermondusa(a)gmail.com> Subject: [MonetDB-users] Some questions regarding parallelism and other stuff... To: monetdb-users(a)lists.sourceforge.net Message-ID: <30366715.post(a)talk.nabble.com> Content-Type: text/plain; charset=us-ascii Hi fellas, If its not too much of a hassle, i have a few questions regarding parallelism & the internal algorithms 1. What is the difference between Data-Flow, and Mitosis? 2. Is there a special reason why the distinct count aggregation is not parallelized just like the other aggregation functions? Is it just a matter of not making it into the release, or is there a fundamental problem here. Note: even though the parallel distinct can be slower in certain distributions, it could still be useful... 3. Are there any plans on supporting parallel frameworks like OpenMP/Intel TBB directly within the low-level MAL functions? Providing data-parallelism on the loop-code level could even increase performance. Or did you already play with it and decided that the performance gain is just not worth it? 4. Is there a way for me to prevent MonetDB server from cleaning up all intermediate BATs between server restarts. I've read here that some intermediates (like join indices etc.) are lost between restarts... is it still correct? Thank you very much for your time, Keep up the amazing job of building the most powerful columnar database out there! -- View this message in context: http://old.nabble.com/Some-questions-regarding-parallelism-and-other-stuff.… Sent from the monetdb-users mailing list archive at Nabble.com. ------------------------------ Message: 4 Date: Mon, 06 Dec 2010 20:13:55 +0100 From: Martin Kersten <Martin.Kersten(a)cwi.nl> Subject: Re: [MonetDB-users] Some questions regarding parallelism and other stuff... To: monetdb-users(a)lists.sourceforge.net Message-ID: <4CFD35F3.1060001(a)cwi.nl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed On 12/6/10 2:07 PM, Mike De-La-Columnar wrote: > > Hi fellas, Hi Mike > > If its not too much of a hassle, i have a few questions regarding > parallelism& the internal algorithms > > 1. > What is the difference between Data-Flow, and Mitosis? See optimizer descriptions: http://monetdb.cwi.nl/MonetDB/Documentation/Optimizer-Toolkit.html Orthogonal issues. > > 2. > Is there a special reason why the distinct count aggregation is not > parallelized just like the other aggregation functions? > Is it just a matter of not making it into the release, or is there a > fundamental problem here. Distinct is a global property, not a local one. A distributed version may easily lead to throwing the complete underlying table around. > > Note: even though the parallel distinct can be slower in certain > distributions, it could still be useful... > > 3. > Are there any plans on supporting parallel frameworks like OpenMP/Intel TBB > directly within the low-level MAL functions? > Providing data-parallelism on the loop-code level could even increase > performance. It could improve, but there should be a clear driving application. > Or did you already play with it and decided that the performance gain is > just not worth it? Depends on the amount of work per byte unit. > > 4. > Is there a way for me to prevent MonetDB server from cleaning up all > intermediate BATs between server restarts. > I've read here that some intermediates (like join indices etc.) are lost > between restarts... is it still correct? All temporaries are indeed lost. Join indices for foreign key checking are retained on disk. Rebuilding hashes is cheaper (mostly) then write/read them from disk > > > Thank you very much for your time, > Keep up the amazing job of building the most powerful columnar database out > there! Thanks for the support !. Martin > > > ------------------------------ Message: 5 Date: Tue, 7 Dec 2010 07:44:14 -0800 (PST) From: paulr135 <romesh135(a)gmail.com> Subject: [MonetDB-users] Add primary key performance To: monetdb-users(a)lists.sourceforge.net Message-ID: <30397515.post(a)talk.nabble.com> Content-Type: text/plain; charset=us-ascii I've loaded a 27GB (~165M rows) file into a table in MonetDB and now I am trying to add a primary key which consists of 4 fields - 2 varchars and 2 ints. It has been running for a few days (since Friday of last week). I've followed the instructions laid out on this post: http://old.nabble.com/MonetDB-SQL:-bulk-loading-large-data-sets---adding-ke… which involves setting the optimizer variable to "nov2009_pipe". I am unable to log in via mclient - I am able to put in my credentials but it just hangs at the "Welcome to mclient, the MonetDB/SQL interactive terminal (Jun2010-SP2)" line. So I have a few questions: 1. Is there any way I can see the status of the alter table ... add primary key command? 2. Is it possible to stop the alter table gracefully? Or will I have to shut the db down? 3. Is there anything I should do in future to speed up adding of primary keys? Thanks. -- View this message in context: http://old.nabble.com/Add-primary-key-performance-tp30397515p30397515.html Sent from the monetdb-users mailing list archive at Nabble.com. ------------------------------ Message: 6 Date: Wed, 8 Dec 2010 09:38:23 +0100 From: Stefan Manegold <Stefan.Manegold(a)cwi.nl> Subject: Re: [MonetDB-users] Add primary key performance To: Communication channel for MonetDB users <monetdb-users(a)lists.sourceforge.net> Message-ID: <20101208083823.GA24931(a)cwi.nl> Content-Type: text/plain; charset=us-ascii On Tue, Dec 07, 2010 at 07:44:14AM -0800, paulr135 wrote: > > I've loaded a 27GB (~165M rows) file into a table in MonetDB and now I am > trying to add a primary key which consists of 4 fields - 2 varchars and 2 > ints. > It has been running for a few days (since Friday of last week). > > I've followed the instructions laid out on this post: > http://old.nabble.com/MonetDB-SQL:-bulk-loading-large-data-sets---adding-ke… > which involves setting the optimizer variable to "nov2009_pipe". Using the nov2009_pipe optimizer pipeline for adding constraint only holds for the Feb2010 release of MonetDB. It should not be required anymore for later releases as of Jun2010-SP1, incl. the latest Oct2010 release. Which version of MonetDB are you using? Which OS are you running on? What kind of manchine/hardware are you running on, in particular how much memory does it have? Can you check what the machine is doing? Is it running out of physical memory and swapping, i.e., is the virtual size of the mserver5 (much) larger than the machine's physical memory size? > I am unable to log in via mclient - I am able to put in my credentials but > it just hangs at the "Welcome to mclient, the MonetDB/SQL interactive > terminal (Jun2010-SP2)" line. > > So I have a few questions: > 1. Is there any way I can see the status of the alter table ... add primary > key command? You can use MonetDB's stethoscope tool to "listen" what the server is doing; however, while it is busy with a single (MAL-)operation, there will not be any output; hence, you might have to wait for some time to see some output. Unless very familiar with MonetDB internals, the output of stethoscope might not be too informative for you. But you're welcome to send us the output to have a look at it. In addition, you can check what the mserver5 is doing as suggested above. > 2. Is it possible to stop the alter table gracefully? Or will I have to > shut the db down? No, unfortunately there is no way to gracefully stop a running query. You'd have to way until it finishes (successfully or with an error), or shut down the DB. > 3. Is there anything I should do in future to speed up adding of primary > keys? In priciple not. We are aware that with data sizes (i.e., total size of all columns that the primary keys consists of) that significantly exceed main memory, adding the key (i.e., checking whether the data fulfills the key condition) does not work as efficiently as it could/should, in particular with multi-column keys --- we're working on that ... You could, though, run the ALTER TABLE statement in trace mode, i.e., `TRACE ALTER TABLE ...`, collect the output and send it to us for analysis; that could help us to improve the creation of large multi-column primary keys. Regards, Stefan > Thanks. > -- > View this message in context: http://old.nabble.com/Add-primary-key-performance-tp30397515p30397515.html > Sent from the monetdb-users mailing list archive at Nabble.com. > > > ------------------------------------------------------------------------------ > What happens now with your Lotus Notes apps - do you make another costly > upgrade, or settle for being marooned without product support? Time to move > off Lotus Notes and onto the cloud with Force.com, apps are easier to build, > use, and manage than apps on traditional platforms. Sign up for the Lotus > Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > > > > > > > > > > -- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) | ------------------------------ Message: 7 Date: Fri, 10 Dec 2010 11:11:34 +0100 From: Daniel Boesswetter <daniel.boesswetter(a)fu-berlin.de> Subject: Re: [MonetDB-users] COPY INTO: wrong length with backslashed chars? To: monetdb-users(a)lists.sourceforge.net Message-ID: <4D01FCD6.9040201(a)fu-berlin.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hi Stefan, > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA512 > > Op 05-12-10 19:08, Daniel Boesswetter schreef: > > Hi all, > > > > I'm using MonetDB for the analysis for ~90GB of data which come from a > > MySQL-based web-application. The data is dumped into CSV-files on a > > regular basis and then imported into MonetDB with the COPY command. I > > have experienced some strange behaviour: obviously, MonetDB counts the > > number of chars for a VARCHAR-field before removing backslashes which > > are used e.g. for escaping newlines or other backslashes and rejects > > strings that should actually fit. > > > > A simple reproduction is this: > > > > 1. In mclient: CREATE TABLE t (x VARCHAR(1)); > > 2. Create a textfile foo.txt containing two backslashes: \\ > > 3. In mclient: > > sql>copy into t from '/tmp/foo.txt'; > > SQLException:importTable:value '\\' from line 1 field 1 not inserted, > > expecting type varchar(1) > > failed to import table > > > > Performing exactly the same steps with a VARCHAR(2) column works without > > errors and results in t.x containg the de-escaped single backslash. > > > > I'm using the Oct-2010 release. My current workaround is to enlarge > > VARCHARs which caused problems in the past, but this is of course no > > guarantee that it won't happen again. > > > > Although I found a few monetdb-bugs entries concerning the COPY command > > (e.g. about the misleading error message seen above), none seems to deal > > with my problem. > > > > Is this a bug? > > What are you escaping? Paste the line that fails ;) > > As I said: try to import a single "\" into a VARCHAR(1) with COPY. Writing "\" does not work because it escapes the newline. Writing "\\" does not work because it is longer than 1 char. Regards, Daniel > Stefan > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v2.0.16 (GNU/Linux) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ > > iEYEAREKAAYFAkz71sgACgkQYH1+F2Rqwn3AmgCfayhLg6zjXZgvqhV9OHJbj5Kh > z64An2xZJy7H1wv3M6hr/SHQaK2C8IM3 > =//V/ > -----END PGP SIGNATURE----- > ------------------------------ ------------------------------------------------------------------------------ ------------------------------ _______________________________________________ MonetDB-users mailing list MonetDB-users(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users End of MonetDB-users Digest, Vol 55, Issue 2 ********************************************

1 0

[MonetDB-users] COPY INTO: wrong length with backslashed chars?
by Daniel Boesswetter 10 Dec '10

10 Dec '10

Hi all, I'm using MonetDB for the analysis for ~90GB of data which come from a MySQL-based web-application. The data is dumped into CSV-files on a regular basis and then imported into MonetDB with the COPY command. I have experienced some strange behaviour: obviously, MonetDB counts the number of chars for a VARCHAR-field before removing backslashes which are used e.g. for escaping newlines or other backslashes and rejects strings that should actually fit. A simple reproduction is this: 1. In mclient: CREATE TABLE t (x VARCHAR(1)); 2. Create a textfile foo.txt containing two backslashes: \\ 3. In mclient: sql>copy into t from '/tmp/foo.txt'; SQLException:importTable:value '\\' from line 1 field 1 not inserted, expecting type varchar(1) failed to import table Performing exactly the same steps with a VARCHAR(2) column works without errors and results in t.x containg the de-escaped single backslash. I'm using the Oct-2010 release. My current workaround is to enlarge VARCHARs which caused problems in the past, but this is of course no guarantee that it won't happen again. Although I found a few monetdb-bugs entries concerning the COPY command (e.g. about the misleading error message seen above), none seems to deal with my problem. Is this a bug? Best regards, Daniel

3 4

[MonetDB-users] Some questions regarding parallelism and other stuff...
by Mike De-La-Columnar 06 Dec '10

06 Dec '10

Hi fellas, If its not too much of a hassle, i have a few questions regarding parallelism & the internal algorithms 1. What is the difference between Data-Flow, and Mitosis? 2. Is there a special reason why the distinct count aggregation is not parallelized just like the other aggregation functions? Is it just a matter of not making it into the release, or is there a fundamental problem here. Note: even though the parallel distinct can be slower in certain distributions, it could still be useful... 3. Are there any plans on supporting parallel frameworks like OpenMP/Intel TBB directly within the low-level MAL functions? Providing data-parallelism on the loop-code level could even increase performance. Or did you already play with it and decided that the performance gain is just not worth it? 4. Is there a way for me to prevent MonetDB server from cleaning up all intermediate BATs between server restarts. I've read here that some intermediates (like join indices etc.) are lost between restarts... is it still correct? Thank you very much for your time, Keep up the amazing job of building the most powerful columnar database out there! -- View this message in context: http://old.nabble.com/Some-questions-regarding-parallelism-and-other-stuff.… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] MonetDB/XQuery Installation
by Rob Fynes 01 Dec '10

01 Dec '10

Hello, Apologies if this is the improper place to be asking this. I'm a new user to MonetDB, and I'm having trouble installing MonetDB/XQuery on Ubuntu 10.04 32-bit. Actually, the installation did seem to succeed (running the auto install script from the super source tarball) and I can start MServer, but with the error: # MonetDB Server v4.40.2 # based on GDK v1.40.2 # not released # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-2010, MonetDB B.V.. All rights reserved. # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs; dynamically linked. # Detected 3.919 GiB (4208013312 bytes) main-memory. # Visit http://monetdb.cwi.nl/ for further information. !ERROR: moduleClient: module(pathfinder) load error. The problem, its seems anyway, is during the configuration of pathfinder: ... ... checking for signal.h... yes checking return type of signal handlers... (cached) void checking for strings.h... (cached) yes checking for strcasecmp... yes checking for xml2-config.32... no checking for xml2-32-config... no checking for xml2-config... no checking for libxml/parser.h... no configure: error: in `/home/rob/MonetDB': configure: error: The libxml2 XML parsing library and/or include files were not found or you have requested to not use it. This is required dependence, core components like the XML Schema import functionality depends on it. See `config.log' for more details. I do have libxml2 installed (by default with Lucid). I've run the pathfinder configure script a few times, with the option --with-libxml2=*some variations*, but I'm not really confident about what I'm doing. I was wondering if anyone could point me in the right direction. Thanks. -Rob

3 5

[MonetDB-users] Granting TMP Table Creation Privileges to User
by Reeves, Matthew J. 30 Nov '10

30 Nov '10

I'm not sure what I'm missing but how does one grant permissions to a user to create temporary tables? I'm totally stumped. Thanks, Matt

1 0

[MonetDB-users] issue with concurrent access to MonetDB/SQL via JDBC
by Wouter Alink 26 Nov '10

26 Nov '10

Dear users, I'm currently struggling with concurrent access to MonetDB/SQL via JDBC. Version: MonetDB server v5.20.4 (64-bit), based on kernel v1.38.4 (64-bit oids). I might still have some concurrency issues with my own code, but somehow I frequently end up with the following error message: (while stress-testing by querying with 10 threads at the same time) class java.sql.SQLException: TypeException:user.s3_1[448]:'user.contains' undefined in: _1933:any := user.contains(_1929:str, _1931:str, _474:bit) TypeException:user.s3_1[449]:'bat.insert' undefined in: _1934:any := bat.insert(_1923:bat[:oid,:bit], _1928:oid, _1933:any) TypeException:user.s3_1[645]:'user.contains' undefined in: _1946:any := user.contains(_1942:str, _1944:str, _474:bit) TypeException:user.s3_1[646]:'bat.insert' undefined in: _1947:any := bat.insert(_1938:bat[:oid,:bit], _1941:oid, _1946:any) TypeException:user.s3_1[1042]:'user.contains' undefined in: _1959:any := user.contains(_1955:str, _1957:str, _474:bit) TypeException:user.s3_1[1043]:'bat.insert' undefined in: _1960:any := bat.insert(_1951:bat[:oid,:bit], _1954:oid, _1959:any) TypeException:user.s3_1[1226]:'user.contains' undefined in: _1974:any := user.contains(_1970:str, _1972:str, _474:bit) TypeException:user.s3_1[1227]:'bat.insert' undefined in: _1975:any := bat.insert(_1964:bat[:oid,:bit], _1969:oid, _1974:any) SQLException:SQLengine:Program contains errors nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2209) nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1968) nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:506) nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:347) nl.cwi.monetdb.jdbc.MonetStatement.executeUpdate(MonetStatement.java:542) Does anyone else have experienced such error messages before, or does anyone have a clue to where to look? (like too many open connections, concurrent access of the same connection, querying a closed connection, or perhaps a bug inside monetdb)? Thanks, Wouter

2 1

[MonetDB-users] MonetDB Debain and RDF
by Andreas Harth 25 Nov '10

25 Nov '10

Hi, I'd like to use Lefteris' RDF package on Debian. What do I have to do to create and connect to a database as user on Debian? I've installed the following packages: # dpkg -l | grep -e monetdb ii libmonetdb-client1 1.40.1-20101110 MonetDB database client libraries ii libmonetdb1 1.40.1-20101110 database system for high-performance applications, libraries ii libmonetdb5-server5 5.22.1-20101110 MonetDB database server version 5, libraries ii libmonetdb5-sql2 2.40.1-20101110 MonetDB SQL libraries for monetdb5-server ii monetdb-client 1.40.1-20101110 MonetDB database client ii monetdb5-server 5.22.1-20101110 MonetDB database server version 5 ii monetdb5-sql 2.40.1-20101110 MonetDB SQL support for monetdb5 I can start MonetDB: # /etc/init.d/monetdb5-sql start Starting MonetDB SQL server: merovingian. When I try do create the tables (as a user): $ mclient -lsql create_tables.sql user(aharth): password: merovingian: please specify a database $ $ mclient -lsql create_tables.sql -d demo user(aharth): password: merovingian: internal error while starting mserver, please refer to the logs $ The log says: 2010-11-25 16:20:19 MSG merovingian[3685]: starting database 'demo', up min/avg/max: 3s/4s/5s, crash average: 0.00 0.00 0.00 (2-2=0) 2010-11-25 16:20:19 ERR merovingian[3685]: client error: cannot start database 'demo': no .vaultkey found (did you create the database with `monetdb create demo`?) I'm stuck here. How can I create a database as a user? $ monetdb create demo2 permission denied $ As root, I only can create a database in maintainance mode: # monetdb create demo2 created database in maintenance mode: demo2 # Any pointers to howto's that'll help? Cheers, Andreas.

3 5

Re: [MonetDB-users] Querying date type column in MonetDB
by Stefan Manegold 23 Nov '10

23 Nov '10

I see --- if you consider it a bug, please file a detailed bug report including information & instructions to reporduce the problem as well as infornmation about the exact MonetDB version and OS you're using via http://bugs.MonetDB.org/ Stefan ----- Oorspronkelijk bericht ----- Van: Freddy Priyatna <freddy.priyatna(a)gmail.com> Verzonden: maandag 25 oktober 2010 16:32 Aan: Communication channel for MonetDB users <monetdb-users(a)lists.sourceforge.net> Onderwerp: Re: [MonetDB-users] Querying date type column in MonetDB Hi Stefan, Nope, the name of the column is "deliveryDays" :) Freddy 2010/10/25 Stefan Manegold <Stefan.Manegold(a)cwi.nl> > Hi Freddy, > > I don't think that the error you experience is triggered by the column > type, but rather by the fact that your date column ha? a name - say "date" - > that is a reserved key word in SQL an hence needs to be double-quoted > according to the SQL standard (this is not a MonetDB specific choice, but a > "feature" of the SQL standard) --- not knowing your table & column names, I > can only guess, though ... > > Stefan > > > ----- Oorspronkelijk bericht ----- > Van: Freddy Priyatna <freddy.priyatna(a)gmail.com> > Verzonden: maandag 25 oktober 2010 16:03 > Aan: MonetDB-users <monetdb-users(a)lists.sourceforge.net> > Onderwerp: [MonetDB-users] Querying date type column in MonetDB > > Dear All, > > I am new to MonetDB, so most likely my question will look obvious. > > I would like to ask, how can columns with date type is queried in monetdb. > Based on my experience, it seems that date type columns need special > treatment. It seems that the only way to query them is with the syntax > "column_name" while other columns seems to work with the format > table_name.column_name without the need of double quote. When I tried to > query date column with the syntax table_name.column_name, it gave me an > error "no such column" > > So my question is, is it true that the only way to query date columns is > using "column_name" format? Another question will be, what happen if I need > to query same name columns coming from different table? > > Thanks in advance, > Freddy > > > ------------------------------------------------------------------------------ > Nokia and AT&T present the 2010 Calling All Innovators-North America > contest > Create new apps & games for the Nokia N8 for consumers in U.S. and Canada > $10 million total in prizes - $4M cash, 500 devices, nearly $6M in > marketing > Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store > http://p.sf.net/sfu/nokia-dev2dev > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users >

4 6

[MonetDB-users] Copy into issues with mixed ascii / hex data
by paulr135 23 Nov '10

23 Nov '10

I have a tab-delimited data file that is mostly ascii, but has a few hex characters in it. For example: ... 3263640152 ABC<99> ... where <99> is a hex value for (tm) - trademark. When I try and load this data file into monetdb, I get the following error: [root@bidbtest ~]# /usr/local/MonetDB/bin/mclient -lsql --database=myschema -t -s "COPY 20603 records into test_table from '/tmp/testdata.txt' using delimiters '\t','\n','\"' null as '';" user(root):monetdb password: MAPI = (monetdb) /usr/local/MonetDB/var/MonetDB5/dbfarm/mapi_socket QUERY = COPY 20603 records into test_table from '/tmp/testdata.txt' using delimiters '\t','\n','"' null as ''; ERROR = !SQLException:importTable:value 'failed to import table Timer 790.415 msec The table def is: CREATE TABLE creative_dim ( id bigint NOT NULL, headline varchar(100) DEFAULT NULL ) How can I go about loading this file? Ideally, I would like to get these characters loaded as is. I saw that mclient has a -E flag that accepts an encoding type. However, I'm not sure what to set it to for a file with ascii / hex data. A complicating factor is that I don't know all the hex characters that are in my file. I luckily spotted the <99>/tm one above as it was one of the first lines in the file. But after replacing all instances of that character with the empty string, I still get a similar error to what I pasted above. I manually paged through the file and found different hex characters. It isn't practical for me to page through an entire file and monetdb doesn't tell me which line number the problem is on. By the way, I am using MonetDB v5.20.5. Thanks for the help! -- View this message in context: http://old.nabble.com/Copy-into-issues-with-mixed-ascii---hex-data-tp302389… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3