- users-list - monetdb.org

Re: [MonetDB-users] COPY...INTO from remote
by Matthew Jones 10 Sep '09

10 Sep '09

The original suggestion was to use 'mclient' with the '<' redirect operator I'm assuming like this: mclient -lsql -s "COPY INTO table from STDIN DELIMITERS '\t';" < recordsfile but this doesn't work, it wants to interpret the contents of the file as a query... is there no way to batch load from a script from a remote monet instance? 73, Matthew W. Jones (KI4ZIB) http://matburt.net

3 2

[MonetDB-users] monetdb-install.sh: com.sun.tools.javac.Main is not on the classpath.
by Ying Zhang 09 Sep '09

09 Sep '09

Hi all, I logged in on another INS1 desktop 'vili', and try to install monetdb there with $monetdb-install.sh --enable-xquery --enable-optimize --nightly=stable --prefix="/export/scratch0/zhang/MonetDB" and it ends in: BUILD FAILED /var/tmp/MonetDB-1252495100/MonetDB-java/java/build.xml:94: The following error occurred while executing this line: /var/tmp/MonetDB-1252495100/MonetDB-java/java/build.xml:289: Unable to find a javac compiler; com.sun.tools.javac.Main is not on the classpath. Perhaps JAVA_HOME does not point to the JDK. It is currently set to "/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/ jre" While javac says: $ which javac /usr/bin/javac $ javac -version javac 1.6.0_0 Manually setting JAVA_HOME to my own java installation ends in the same error: $env JAVA_HOME=/ufs/zhang/install/java/current monetdb-install.sh -- enable-xquery --enable-optimize --nightly=stable --prefix="/export/ scratch0/zhang/MonetDB" The log is attached. Thanks in advance. Jennie

3 4

[MonetDB-users] Serious concurrency issues via python api
by Matthew Jones 09 Sep '09

09 Sep '09

I have multiple processes reading and writing to the same table and I've noticed really persistent concurrency problems: File "/usr/lib/python2.5/site-packages/monetdb/sql/cursors.py", line 208, in execute self.__store_result(block) File "/usr/lib/python2.5/site-packages/monetdb/sql/cursors.py", line 520, in __store_result self.__exception_handler(InterfaceError, "Unknown state, %s" % block) File "/usr/lib/python2.5/site-packages/monetdb/sql/cursors.py", line 574, in __exception_handler raise exception_class(message) InterfaceError: Unknown state, &2 65541 -1 !ERROR: COMMIT: transaction is aborted because of concurency conflicts, will ROLLBACK instead I'm not sure what the problem is, but it exists in such a way that all operations that load or update information in MonetDB have to be put into a loop to continuously retry. I'm using autocommit, but I would expect MonetDB to handle concurrency issues in a decent way, like maybe blocking a query until the other query finished. I'm not clobbering data, most of these are just bulk load operations that insert new rows. Is there any way to address this issue without having to putting retry loops around all of the code I'm writing to write to the database? 73, Matthew W. Jones (KI4ZIB) http://matburt.net

6 10

[MonetDB-users] readline/readline.h does not contain rl_completion_func_t
by Ying Zhang 08 Sep '09

08 Sep '09

Hello, I was trying to install monet on Mac OS 10.5 with monetdb-install.sh --enable-xquery --enable-optimize --nightly=stable It has always worked, but this time, it stops due to an error while configuring MonetDB: checking readline/readline.h usability... yes checking readline/readline.h presence... yes checking for readline/readline.h... yes checking for readline in -lreadline... yes checking for rl_completion_matches in -lreadline... no checking whether rl_completion_func_t exists... configure: error: readline/readline.h does not contain rl_completion_func_t, is it GNU readline? The complete log is in the attachment. What is wrong with my readline.h? How can I find out which readline.h the install script is checking, and which readline.h is expected / should be used? Thanks in advance. Jennie

2 3

[MonetDB-users] OpenSSL and SHA512
by Alex Bo. 08 Sep '09

08 Sep '09

Hi, I have compiled the latest August build from CVS on windows. When I run mclient, I get this: server requires 'SHA512' hash, but client support was not compiled in I saw another thread regarding this before, but couldn't resolve the issue based on it. Please let me know what I might be doing wrong. Here is my server output: # MonetDB server v5.14.0, based on kernel v1.32.0 # Serving database 'demo', using 1 thread # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see C:\MonetCVS_base_Aug09\MonetCVS32_cleanBuild\Install\etc\monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > Thanks. -- View this message in context: http://www.nabble.com/OpenSSL-and-SHA512-tp25223356p25223356.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 5

[MonetDB-users] using MonetDB for INEX data
by Erik Tjong Kim Sang 07 Sep '09

07 Sep '09

Dear MonetDB users, We are trying to add load the INEX XML Wikipedia data into MonetDB but we get some strange error messages: When adding documents: $ echo 'pf:add-doc("/data/erikt/inex2009/tmp/330.xml", "330")' | /storage/erikt/MonetDB/bin/mclient -lxquery MAPI = monetdb@localhost:50000 QUERY = pf:add-doc("/data/erikt/inex2009/tmp/330.xml", "330") ERROR = !ERROR: interpret_params: insert(param 3): invalid BAT. When querying the data: $ echo -e 'let $c := collection("330")\nfor $t in $c//article\nreturn($t//title/text())' | /storage/erikt/MonetDB/bin/mclient -lxquery ... text {"The Black Stallion (film)"}, text {"Halle, Germany"}, text {"FLCL"}, write error We get only 5% of the data that was expected from the query and then it crashes with the message "write error". Does anyone know what could cause these problems? Please respond to me personally (e.f.tjong.kim.sang(at)rug.nl) since I am not a member of this mailing list. Erik TKS -------- e-mail: e.f.tjong.kim.sang(a)rug.nl WWW: http://www.let.rug.nl/erikt/

2 2

[MonetDB-users] Segmentation fault
by Sten Hjelmqvist 07 Sep '09

07 Sep '09

Using MonetDB Aug 2009 on a Ubuntu Server 9.04 with 4Gbyte memory and 60Gbyte free disk space. I import a large database, ~1.5Gbyte , using \<filename. After a while the database exits with msg: ">Segmentation fault" Can I reconfigure the database to avoid this? --------------------------------------- Sten Hjelmqvist DataKonsult MERdata AB Sveavägen 33, 111 34 Stockholm Mobil : 0708 305616 E-mejl : sten.hjelmqvist(a)merdata.se <mailto:sten.hjelmqist@merdata.se> Webb : www.merdata.se <http://www.main.se/> ---------------------------------------

3 6

[MonetDB-users] XQUF: expected insert speed
by Ying Zhang 06 Sep '09

06 Sep '09

Hi all, Does anyone have an idea of the 'normal' insert speed (e.g., #nodes per sec, or #MBs per sec) of MonetDB/XQuery? I inserted a document of ~101mb into an xmark document of 2mb, and it took more than 10 minutes: $ mclient -lx -g -t xquery>do insert doc("persons.xml")/persons into doc("xmark2mb.xml")/ site more><> Trans 12.143 msec Shred 8.429 msec Query 5.869 msec Update 619019.583 msec Timer 619058.179 msec With the algebra back-end, it ends in an error (bug report will follow), but it is also not faster: $ mclient -lx -t xquery>do insert doc("persons.xml")/persons into doc("xmark2mb.xml")/ site more><> MAPI = monetdb@localhost:50000 QUERY = do insert doc("persons.xml")/persons into doc("xmark2mb.xml")/ site ERROR = !ERROR: interpret: no matching MIL operator to '-(lng, void)'. !MAYBE YOU MEAN: ! -(dbl) : dbl ! -(lng) : lng ! -(flt) : flt ! -(wrd) : wrd ! -(int) : int ! -(sht) : sht ! -(bte) : bte ! -(chr) : chr ! -(lng, dbl) : dbl ! -(lng, flt) : dbl ! -(lng, lng) : lng ! -(lng, wrd) : lng ! -(lng, int) : lng ! -(lng, sht) : lng ! -(lng, bte) : lng ! -(lng, chr) : lng ! -(dbl, dbl) : dbl ! -(dbl, flt) : dbl ! -(dbl, lng) : dbl ! -(dbl, wrd) : dbl ! -(dbl, int) : dbl ! -(dbl, sht) : dbl ! -(dbl, bte) : dbl ! -(dbl, chr) : dbl ! -(flt, dbl) : dbl ! -(flt, flt) : flt ! -(flt, lng) : flt ! -(flt, wrd) : flt ! -(flt, int) : flt ! -(flt, sht) : flt ! -(flt, bte) : flt ! -(flt, chr) : flt ! -(wrd, dbl) : dbl ! -(wrd, flt) : flt ! -(wrd, lng) : lng ! -(wrd, wrd) : wrd ! -(wrd, int) : wrd ! -(wrd, sht) : wrd ! -(wrd, bte) : wrd ! -(wrd, chr) : wrd ! -(int, dbl) : dbl ! -(int, flt) : flt ! -(int, lng) : lng ! -(int, wrd) : wrd ! -(int, int) : int ! -(int, sht) : int ! -(int, bte) : int ! -(int, chr) : int ! -(sht, dbl) : dbl ! -(sht, flt) : flt ! -(sht, lng) : lng ! -(sht, wrd) : wrd ! -(sht, int) : int ! -(sht, sht) : sht ! -(sht, bte) : sht ! -(sht, chr) : sht ! -(bte, dbl) : dbl ! -(bte, flt) : flt ! -(bte, lng) : lng ! -(bte, wrd) : wrd ! -(bte, int) : int ! -(bte, sht) : sht ! -(bte, chr) : bte ! -(bte, bte) : bte ! -(chr, dbl) : dbl ! -(chr, flt) : flt ! -(chr, lng) : lng ! -(chr, wrd) : wrd ! -(chr, int) : int ! -(chr, sht) : sht ! -(chr, bte) : bte ! -(chr, chr) : chr Timer 632991.583 msec xquery>\q <persons> is the root node of the document 'persons.xml', which contains 234599 xmark <person> nodes. So, actually, only one large node is inserted. It looks quite slow. Is this the expected behaviour or did I do something wrong? I'm using the latest stable version of MonetDB/XQuery, compiled and installed with 'monet-install.sh --enable-xquery --enale-optimize -- nightly=stable --prefix=...'. The document 'xmark2mb.xml' was shredded as an updatable doc. with 10% holes, and the document 'persons.xml' was shredded as a read-only doc. Both documents were already loaded, by executing the query 'count(doc("[docname]")// person)'. MonetDB/XQuery is running on my CWI PC (i.e., FC10, Intel(R) Core(TM)2 Quad CPU Q6600 @2.40GHz, 8GM RAM). During the execution, one CPU is constantly busy for 100%, Mserver uses 22% ~ 27% of MEM (according to 'top'). Does anyone have an idea how to get insert faster? Regards, Jennie

1 0

[MonetDB-users] Long query response time with 'in' statement
by mkurtulus 02 Sep '09

02 Sep '09

Hi, I'm trying to create a benchmark MonetDB vs Postgres and for many types of queries, MonetDB quite faster than Postgres.But there is an interesting result when i try a query which contains an 'in' statement.The response times are MonetDB - 58 sec Postgres - 3 sec for the query : select RFOADV_10.rfoadvsup as c0, sum((case when cabact___rfountide = 'NB_E' then cabactqte else 0 end)) as m0 from RFOADV as RFOADV_10, CABACT as CABACT where (cabact___rforefide = 'FHSJ' and cabact___rteprcide = 'CPTANA' and cabact___rtestdide = '100' and cabact___rfovsnide = '200805_001') and CABACT.cabact_c2rfodstide = RFOADV_10.rfoadvinf and RFOADV_10.rfoadvsup in ('5030', '5031', '5032', '5033', '5034', '5035', '5036', '5037', '5038') group by RFOADV_10.rfoadvsup i reform the query so that it can give the same result without 'in' : select RFOADV_10.rfoadvsup as c0, sum((case when cabact___rfountide = 'NB_E' then cabactqte else 0 end)) as m0 from RFOADV as RFOADV_10 join CABACT on (CABACT.cabact_c2rfodstide = RFOADV_10.rfoadvinf) join (select '5031' as pole UNION select '5032' as pole UNION select '5033' as pole UNION select '5034' as pole UNION select '5035' as pole UNION select '5036' as pole UNION select '5037' as pole UNION select '5038' as pole ) sub ON (RFOADV_10.rfoadvsup = sub.pole) where (cabact___rforefide = 'FHSJ' and cabact___rteprcide = 'CPTANA' and cabact___rtestdide = '100' and cabact___rfovsnide = '200805_001') group by RFOADV_10.rfoadvsup the response time for MonetDB decreases 100 times (0.6 sec). Do you have any idea about it ? I run both Monetdb and Postgres on a server with 10GB Ram and the tables have CABACT : 677000 RFOADV : 140000 rows. Thanks, Mehmet -- Open WebMail Project (http://openwebmail.org)

2 5

[MonetDB-users] COPY...INTO with auto increment
by Matthew Jones 31 Aug '09

31 Aug '09

I noticed that COPY...INTO for bulk loading requires that all fields be present in the data file. Is there any way to use bulk loading and have it honor the auto increment column or at least not have to specify every column in the data file? 73, Matthew W. Jones (KI4ZIB) http://matburt.net

3 9

[MonetDB-users] Function overloading
by Alex Bo. 30 Aug '09

30 Aug '09

Hi, I am trying to create an overloaded iif function, so I created these custom functions: 1. create function iifnew(tv timestamp, fv timestamp, cond boolean) returns timestamp begin if cond then return tv; else return fv; end if; end 2. create function iifnew(tv int, fv int, cond boolean) returns int begin if cond then return tv; else return fv; end if; end 3. create function iifnew(tv string, fv string, cond boolean) returns string begin if cond then return tv; else return fv; end if; end But now, if I do something like this: update table1 set "Column1" = iifnew('hello1', 'hello2', ("Column2" = "Column3")) I get this: !SQLException:int:conversion of string 'hello1' failed Is this a bug in function overloading? I am running Feb2009 from CSV on Windows. Thanks. -- View this message in context: http://www.nabble.com/Function-overloading-tp25210862p25210862.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] tijah phrase search problem
by Roy Walter 27 Aug '09

27 Aug '09

The following query: tijah:queryall("//p[about(., 'drug treatment')]") returns a number of results from my sample document. Some of these results contain the phrase "drug misuse". The following query: tijah:queryall("//p[about(., 'drug misuse')]") returns zero results from the sample document, which is clearly incorrect since some results returned by the first query should be returned by the second. I have deleted and reloaded the sample document and I have recreated the tijah index and the result is consistently incorrect. Is this a bug? -- Roy

2 5

[MonetDB-users] What's the best file system and sector size for monetdb?
by Allen Zhang 26 Aug '09

26 Aug '09

Hi, What is the best suitable file system and sector size for monet dbfarm? Can anyone share the experience? Thanks Allen

1 0

[MonetDB-users] Performance vs postgresql
by jatin patni 24 Aug '09

24 Aug '09

Hi, I am in the process of evaluating two major databases....monetdb and postgresql for building a backend database system for backtesting on huge historical data sets around 100GB. I copied some test data(a 250mb table) using bulk copy in both and monetdb was way faster. But when I did a simple query "SELECT * from tablename", it took around 3 minutes for 1 lakh rows via mclient and a gui interface (aqua studio based on JVM simply said out of memory). The bulk copy file was in the format collumns seperated by pipes in a text file. While using postgresql, at first it was slow but once I did a vacuum(function in postgresql), the (select * from tablename) was much faster than monetdb. So, what am I missing here, Do I need to do something to enhance the performance in Monetdb....... I have high hopes from monetdb, so please help. Thanks -- Jatin Patni Tel: 91 9911 649 657 jatinpatni(a)gmail.com www.jatinpatni.co.nr

3 4

Re: [MonetDB-users] Performance vs postgresql(Stefan Manegold)
by jatin patni 23 Aug '09

23 Aug '09

Hi Stefan, Thanks for your reply. Well, I understand that a simple dump of the table wouldn't be that fast in monetdb cuz it was not built for that purpose. I am evaluating monetdb 5 and postgresql plus standard server from enterprise db. I have not yet tested performance of running complex queries on both systems. I am testing on windows 32 bit, core2duo processor, 2.8 ghz, with 3gb ram 2.8 ghz I hope this config would work fine for backtesting with around 100 gb databases. Will post a detailed result of using both postgresql and monetdb later. Let me go into some detail.....my database would have 4 collumns(sno, price, name, volume) and my backtesting would generally involve querying this dataset and checking for moving average crossovers of price with the last n days moving averages, and may grow to more complex querying involving volumes. My concern is, if I need all the collumns for the queries, will monetdb perform better or should I stick with postgresql plus standard. I'll post the pperformance results once I have copmp[leted populating the databases in postgresql......But I want to try out monetdb also, I know that the postgresql interpreter may perform very slow..... Anyways, thanks for this amazing product.....Also, when will the X100 be available as an extension in Monetdb --------------------------------------------------------- *Hi Jatin, thank you very much for your interest in MonetDB! We are glad to hear that you found MonetDB "way faster" than PostgreSQL with bulk loading your 250 MB dataset --- btw, which versions of MonetDB and PostgreSQL are you comparing on what kind of system (OS, hardware (CPU, RAM, I/O system))? With a simple select * from tablename, you basically evaluate to ability of both server and client to pump your 250 MB of data from the server to the client. That is probably an interesting measurement in case you mostly do select * from table queries. However, we do not consider such queries the "major challenges" for DBMSs and designed MonetDB not for plainly pumping all data from the server to the client in the most efficient way. Rather, we assume that the major part of data-management, i.e., processing (more) complex queries including selections, joins, aggregation, etc. are done by the DBMSs (server) and only the rather small results of such (analytical) queries are then sent to the server. Moreover, as opposed to "classical" row-stores, column-stores in general are not necessarily designed with a major focus on most efficiently re-constructing the whole table. They rather assume that most (analytical) queries usually only access a subset of all column of a table. Being able to access only the requested data and hence not having to carry-around excess-luggage of non-used columns during query processing is one of the key design differences of column-stores over row-stores. Hence, to speed up simple select * from tablename queries in MonetDB, you'd probably (at least) need to re-design and -implement MonetDB's client-server protocol (MAPI). We are curious, though, to also hear about your experiences with more complex queries that return much smaller (i.e., "more reasonable"?) result sets. Stefan ps: It is interesting to hear that the "vacuum" command in PostgreSQL had a significant impact on a simple select * from table query over bulk-loaded data, i.e., without any updates being performed --- I wouldn't know wht akind of "garbage" bulk-loading leaves behind that needs to be cleaned-up ... On Fri, Aug 21, 2009 at 07:18:46PM +0530, jatin patni wrote:* > Hi, I am in the process of evaluating two major databases....monetdb > and postgresql for building a backend database system for backtesting > on huge historical data sets around 100GB. I copied some test data(a > 250mb table) using bulk copy in both and monetdb was way faster. But > when I did a simple query "SELECT * from tablename", it took around 3 > minutes for 1 lakh rows via mclient and a gui interface (aqua studio > based on JVM simply said out of memory). The bulk copy file was in the > format collumns seperated by pipes in a text file. > While using postgresql, at first it was slow but once I did a > vacuum(function in postgresql), the (select * from tablename) was much > faster than monetdb. > > So, what am I missing here, Do I need to do something to enhance the > performance in Monetdb....... > I have high hopes from monetdb, so please help. > Thanks > > -- > Jatin Patni > Tel: 91 9911 649 657 > jatinpatni(a)gmail.com > www.jatinpatni.co.nr > > ------------------------------ ------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users > > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/<http://www.cwi.nl/%7Emanegold/> | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 | -- Jatin Patni Tel: 91 9911 649 657 jatinpatni(a)gmail.com www.jatinpatni.co.nr

2 1

[MonetDB-users] serial vs auto_increment
by Matthew Jones 22 Aug '09

22 Aug '09

After creating a table with a 'serial' type id field I noticed this when describing it: sql>CREATE TABLE "schtest"."testt" ("id" serial, ... sql>\d testt CREATE TABLE "schtest"."testt" ( "id" int NOT NULL DEFAULT next value for "schtest"."seq_4291", ... The following page: http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Data-Types.html Says this about the serial data type: "special 64 bit integer (sequence generator)" and this about the 'int' data type: "32 bit integer" This looks like it created a table with a 32-bit integer sequence rather than a 64-bit integer sequence. If you use the auto_increment method you can set the type explicitly to be bigint, but should "serial" generate a bigint column also? 73, Matthew W. Jones (KI4ZIB) http://matburt.net

3 3

[MonetDB-users] Announcement: New Aug2009 feature release of MonetDB suite
by Stefan Manegold 20 Aug '09

20 Aug '09

Dear all, The MonetDB team at CWI/MonetDB BV are pleased to announce the new "Aug2009" feature release of the MonetDB suite of programs. This feature release is backward compatible with the previous releases (Nov2008 through May2009-SP2). Caveat: When upgrading from a release older than May2009 (i.e., Nov2008 through Feb2009-SP2), you need to move your write-ahead log following the "recommended" instructions for SQL (<http://monetdb.cwi.nl/Development/Releases/May2009/#SQL>) and/or XQuery (<http://monetdb.cwi.nl/Development/Releases/May2009/#XQuery>). More information on the new release is available at <http://monetdb.cwi.nl/Development/Releases/Aug2009/>. The sources and binaries are available at <http://monetdb.cwi.nl/Download/>. Enjoy! The MonetDB team at CWI/MonetDB BV. -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [MonetDB-users] MonetDB Installation
by listanand＠gmail.com 19 Aug '09

19 Aug '09

Thanks Stefan and Stefan :) Unfortunately, I still have not been able to install MonetDB. After installing PCRE and OpenSSL, I ran the install script again and I still get the error that OpenSSL library is not being found. This is clearly not the case as I even added it (OpenSSL's bin directory) to the system path, and am able to get to the OpenSSL prompt. Am I missing something here? Thanks again.

5 4

[MonetDB-users] MonetDB Installation
by listanand＠gmail.com 18 Aug '09

18 Aug '09

Hello all, I am trying to install MonetDB (from http://monetdb.cwi.nl/downloads/sources/May2009-SP2/MonetDB-May2009-SuperBa…) on Ubuntu Linux (Intrepid), and am running into one issue after another. First, after I ran the install script, I got an error saying that I need to install PCRE. After installing PCRE, I tried running the script again and then got an error saying that I need to install OpenSSL. Is there a way I could figure out what things are needed in advance, so I can install them all at one go? Alternatively, is there an easier way to install MonetDB? Thanks in advance. Andy

3 2

[MonetDB-users] may2009sp2 suberball patch
by Lazaros Koromilas 14 Aug '09

14 Aug '09

hello all, i needed to workaround a libtool `directory not ending in' error by adding an extra slash in a path. the ``patch'' is attached. i successfully built monetdb may 2009 sp2 with # ./monetdb-install.sh --enable-sql --enable-xquery on freebsd 7.2 release. in the attachment i include some installed packages/dependencies in case someone needs them. thanx, lazaros. -- http://www.ics.forth.gr/~koromil

1 0

[MonetDB-users] PHP XQuery error
by Gene Stevens 14 Aug '09

14 Aug '09

Hi everyone, I am a new MonetDB user. I am specifically interested in MonetDB's XQuery support with client access through PHP. I currently get parsing errors when trying any kind of XQuery through the PHP module. I'm wondering if this is a a bug in the client or if I am possibly doing something wrong. E.g.: #!/usr/bin/env php <?php $db = monetdb_connect('xquery', 'localhost', 50000, 'monetdb', 'monetdb') or die ("Failed to connect\n"); $query = 'count(1,2,3,4)'; $res = monetdb_query($query); ?> Results in: Warning: monetdb_query(): Query failed: parse error: syntax error, unexpected ;, expecting $end on line 1, column 15 (next token is `;') !parse error: XQuery parsing failed in /home/user/monet.php on line 6 ... for any variation of an XQuery. I have tried the server from the Ubuntu repository as well as I've built it from source with the same results. Here is my environment: PHP 5.2.6-3ubuntu4.1 with Suhosin-Patch 0.9.6.2 (cli) (built: Apr 23 2009 14:37:14) Ubuntu 9.04: Linux ubuntu 2.6.28-11-server #42-Ubuntu SMP Fri Apr 17 02:45:36 UTC 2009 x86_64 GNU/Linux Mserver --dbinit="module(pathfinder);" # MonetDB Server v4.30.4 # based on GDK v1.30.4 # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-2009, MonetDB B.V.. All rights reserved. # Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. # PF/Tijah module v0.13.0 loaded. http://dbappl.cs.utwente.nl/pftijah # MonetDB/XQuery module v0.28.3 loaded (default back-end is 'algebra') # XRPC administrative console at http://127.0.0.1:50001/admin MonetDB> Thanks for any insight! - Gene Stevens

4 11

Re: [MonetDB-users] MonetDB/XQuery Scaleability
by listanand＠gmail.com 14 Aug '09

14 Aug '09

Hi Wouter, Thanks for your note. I will definitely give it a try. 2 more questions though. Is MonetDB amenable to being accessed in parallel? I will need to run many queries on the fly, and will certainly need multiple connections to the database. Also, how well does MonetDB/XQuery work with Perl? Is it better to stick to Java/Python for now? Thanks again for your help. Andy

2 1

[MonetDB-users] ODBC error (specified driver could not be loaded due to system error 126)
by fadk 13 Aug '09

13 Aug '09

I read that there was a bug like this before, but its been fixed. Its seems like installing ODBC drivers is a problem for windows. Can you assist with this ? I am running winXP using the MonetDB 32 installer. http://sourceforge.net/tracker/?func=detail&atid=482468&aid=1902879&group_i… Also, is it possible to only build the client (to use mapi) on winXP given that I have MonetDB installed. ? Thanks for your help. -- View this message in context: http://www.nabble.com/ODBC-error-%28specified-driver-could-not-be-loaded-du… Sent from the monetdb-users mailing list archive at Nabble.com.

4 4

[MonetDB-users] Phrase searching with 'or'
by Roy Walter 13 Aug '09

13 Aug '09

Consider the following XQuery using two phrases: tijah:queryall("//p[about(., 'wind turbine') or about(., 'wind farm')]") It returns a restricted result set where only 'wind turbine' AND 'wind farm' are present. Substituting 'and' for 'or' in the query returns the same number of rows. Is this a bug? -- Roy

2 1

[MonetDB-users] Phrase searching with 'or'
by Roy Walter 13 Aug '09

13 Aug '09

Consider the following XQuery using two phrases: tijah:queryall("//p[about(., 'wind turbine') or about(., 'wind farm')]") It returns a restricted result set where only 'wind turbine' AND 'wind farm' are present. Substituting 'and' for 'or' in the query returns the same number of rows. Is this a bug? -- Roy

1 0

[MonetDB-users] optimizer.exportChunk exception
by Alex Bo. 11 Aug '09

11 Aug '09

Hi, I got this error on running "Select * from tables": !TypeException:user.s6_2[154]:'optimizer.exportChunk' undefined in: _237:any := optimizer.exportChunk() !TypeException:user.s6_2[155]:'optimizer.affectedRows' undefined in: _241:any := optimizer.affectedRows() Consequent queries were successful. Seems like a bug. -- View this message in context: http://www.nabble.com/optimizer.exportChunk-exception-tp24915518p24915518.h… Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] Query speed up
by Allen Zhang 11 Aug '09

11 Aug '09

Hi, All, I have a client program generates the following query against monetdb, can I create index on fact columns to speed thing up? What¹s the best approach to resolve this kind performance issue? SELECT DISTINCT t1.column1 FROM (fact t0 LEFT JOIN dimension1 t1 ON t0.header_id = t1.header_id) WHERE t0.column3 = 'xxxxxx' And t0.column5 IN ('item1¹, OEitem2¹, OEitem3¹, OEitem4¹); Thanks in advance. Allen

2 4

[MonetDB-users] MonetDB/XQuery Scaleability
by listanand＠gmail.com 10 Aug '09

10 Aug '09

Dear all, I am new to MonetDB/XQuery and am considering using it for storing and processing a large number of webpages (~1million) in XML format. I am hoping to know if this is indeed the right tool, and how well it will scale to handle tasks of this magnitude. Thanks in advance

2 3

[MonetDB-users] COPY...INTO from remote
by Matthew Jones 08 Aug '09

08 Aug '09

I noticed that COPY...INTO from a file, when executed from a remote MonetDB mclient instance tries to load the file from the system that the database is actually running on rather than the system running the remote client. Is this the expected behavior? Has anyone dealt with this or found another way to batch-load from a remote client? 73, Matthew W. Jones (KI4ZIB) http://matburt.net

3 3

[MonetDB-users] MonetDB Scaleability
by Calum Miller 06 Aug '09

06 Aug '09

Hi, I've been doing performance tests on MondetDB to see how it scales. I've been running tests on Amazon EC2 (7GB of memory, 64-Bit, CentOS 5.2) The table I am using has 60 columns with most being just simple characters of length 2, here is the query: select CollectionDEPOTID as c0, CollectionCountryID as c1, sum(ParcelCount) as m0 from parcel_stage_short as parcel_stage_short group by c0, c1; Here are the load time in batches of 8,000,000 using the following command: COPY 8000000 RECORDS INTO parcel_stage_short FROM '/mnt/ parcel_stage_short.txt' USING DELIMITERS '\t','\n'; Rows Load Time Increase % Increase 8000000 240434.17 8000000 424937.54 184503.37 76.74% 8000000 599621.98 359187.81 149.39% 8000000 769276.70 528842.53 219.95% 8000000 889600.24 889600.24 209.35% msecs msecs As can be seen the load time increases by around 200,000 msec for each additional 8Million rows added. Any tips on how to reduce the load speed? Would it be faster to load the table in one go (tried loading in bigger batches but loader fails)? Here are the performance times for each additional batch of 8,000,000 rows: Rows 1st Query 1st Increase % 1st Increase 2nd Query 2nd Increase % Increase 08000000 1176.53 16000000 4838.52 3661.99 311.25% 2239.61 1168.30 109.05% 24000000 33947.84 32771.31 2785.43% 9323.29 8251.98 770.27% 32000000 837114.13 835937.61 71051.29% 5456.96 4385.65 409.37% 40000000 668380.26 667203.73 56709.60% 8538.02 7466.71 696.97% msecs msecs msecs msecs The performance of the 1st query is unsurprisingly poor just after the data has been copied in The performance of the same query a second time yields much faster results The performance of the monetDb with 1st/2nd query degrades as load increases. Are these results typical? Is there anything I can do to increase performance on the 1st or 2nd queries? Thanks in advance Calum

3 5

[MonetDB-users] tijah exact matching
by Roy Walter 06 Aug '09

06 Aug '09

Is there a way to force a tijah query to return only exact matches? For example, if I search for "wind farm", as in: ("tijah:queryall[about(., wind farm)]") I get matches for "wind farm", "wind" and "farm" but say I only want matches for "wind farm"? I can of course loop through the result with contains(., "wind farm") to exclude unwanted results but that has performance implications. -- Roy

2 1

[MonetDB-users] Get attribute value as text how?
by Roy Walter 06 Aug '09

06 Aug '09

The following XQuery fragment will add the speakername attribute as an attribute of the tag: {$res/../@speakername}: {$res} becomes: Some text... What I want is: Roy Walter: Some text... How does MonetDB/XQuery handle this? I tried: {xs:string($res/../@speakername)}: {$res} but it errors. -- Roy

2 4

[MonetDB-users] how to read/write blob data ?
by 李坤 04 Aug '09

04 Aug '09

I want to store image files into monetdb sql server. I think there are two approaches to do it: the first one is to store the file's full path in a column with varchar type, the second one is to store the image data in a column with blob type. I don't want to see a lot of small image files in the directory, so I choose the second approach. After reading the monetdb manual, I find some examples like this: sql> insert into t1 values (1, blob '012'); I think this is not enough. I also try to use odbc api to store binary data into monetdb, but failed. So please help me to write the blob data into monetdb, as well as the read operation. Maybe there are other ways I don't know, please tell me, thanks!

2 1

[MonetDB-users] problem in extract second
by fatar fatar 03 Aug '09

03 Aug '09

query: select extract(second from '2009-07-24 16:03:35.0000'); result : 0.00 could you please tell me why the result is zero??? and how can i get more spesific result??? Akses email lebih cepat. Yahoo! menyarankan Anda meng-upgrade browser ke Internet Explorer 8 baru yang dioptimalkan untuk Yahoo! Dapatkan di sini! http://downloads.yahoo.com/id/internetexplorer

1 0

[MonetDB-users] underlying storage
by Mag Gam 01 Aug '09

01 Aug '09

What is the recommended storage for MonetDB? We are planning to buy a Sun storage appliance and were wondering if it would work with MonetDB

4 7

Re: [MonetDB-users] server requires 'SHA512' hash, but client support was not compiled in
by Calum Miller 31 Jul '09

31 Jul '09

Hi, Managed to work around this issue by changing the default hashing algorithm in the configure file from SHA512 to MD. Needed a server rebuild. Calum

2 1

[MonetDB-users] server requires 'SHA512' hash, but client support was not compiled in
by Calum Miller 30 Jul '09

30 Jul '09

Hi, I built monetDb from source on Centos 5.0 but get the following error when I try to connect to the server via "mclient -lsql --time -d demo" server requires 'SHA512' hash, but client support was not compiled in I can't find a reference anywhere on how to resolve this, help much appreciated! Thanks Calum Miller

2 1

[MonetDB-users] Executing tijah query from module fails
by Roy Walter 29 Jul '09

29 Jul '09

[This is a new thread following on from "XRPC issues"] Executing a tijah query in a module from both old and new front ends fails. Using the old front end (\g) produces the following error: xquery>import module namespace test="tj" at "http://localhost:50001/export/tj.xq "; more>execute at {"localhost"} {test:tijahSearch("Heathrow")} more><> doLoopLiftedRPC: error occurred at localhost: MAPI = monetdb@localhost:50000 QUERY = import module namespace test="tj" at "http://localhost:50001/export/tj.x q"; ERROR = !ERROR: HTTP Error Code : 404 Bad Request !ERROR: SOAP Fault Code : env:Sender !ERROR: SOAP Fault Reason: !ERROR: Error occurred during execution. !ERROR: interpret: no matching MIL operator to 'tj_query_handler(bit, BA T[void,BAT], BAT[oid,BAT], BAT[void,BAT], BAT[oid,oid], BAT[oid,BAT], BAT[oid,ln g], BAT[oid,dbl], BAT[oid,str], void)'. !MAYBE YOU MEAN: ! tj_query_handler(bit, BAT[void,BAT], BAT[void,BAT], BAT[void,BAT ], BAT[oid,any], BAT[oid,BAT], BAT[void,lng], BAT[void,dbl], BAT[void,str], BAT[ void,BAT]) : BAT[void,BAT] ! ! !ERROR: CMDhttp_post: operation failed. MAPI = monetdb@localhost:50000 QUERY = import module namespace test="tj" at "http://localhost:50001/export/tj.x q"; ERROR = !ERROR: doLoopLiftedRPC: execution failed at all destinations: !ERROR: localhost: !ERROR: HTTP Error Code : 404 Bad Request !ERROR: SOAP Fault Code : env:Sender !ERROR: SOAP Fault Reason: !ERROR: Error occurred during execution. !ERROR: interpret: no matching MIL operator to 'tj_query_handler(bit, BA T[void,BAT], BAT[oid,BAT], BAT[void,BAT], BAT[oid,oid], BAT[oid,BAT], BAT[oid,ln g], BAT[oid,dbl], BAT[oid,str], void)'. !MAYBE YOU MEAN: ! tj_query_handler(bit, BAT[void,BAT], BAT[void,BAT], BAT[void,BAT ], BAT[oid,any], BAT[oid,BAT], BAT[void,lng], BAT[void,dbl], BAT[void,str], BAT[ void,BAT]) : BAT[void,BAT] ! ! !ERROR: CMDhttp_post: operation failed. !ERROR: !ERROR: xquery> Has anyone succeeded in executing a tijah query from within a module? -- Roy

3 8

[MonetDB-users] massive data loss on stop, start
by Matthew Jones 29 Jul '09

29 Jul '09

I added this information as a comment to bug *2825243* but I'm not sure if it's the same so I thought I'd post it here also to see about getting some feedback: I am experiencing widespread data corruption when restarting the May2009-SP1 MonetDB release also, but mine is much simpler. On 64-bit ubuntu: Linux dsvm01 2.6.24-23-server #1 SMP Wed Apr 1 22:14:30 UTC 2009 x86_64 GNU/Linux With a table defined as follows: CREATE TABLE "tablespace"."test_table" ( "col1" varchar(50), "col2" varchar(50), "col3" varchar(50), "col4" varchar(50), "col5" varchar(50), "col6" int, "col7" timestamp(7), "col8" int, "col9" int, "col10" int ); I imported 20998687 records into this table with all columns populated and ran a couple of queries to check the data: select count(*) from test_table ; [ 20998687 ] select count(*) from test_table where col1 = '' or col2 = '' or col3 = ''; [ 0 ] select max(col7), min(col7) from test_table ; [ 2009-07-25 14:17:15.538000, 2009-07-24 15:29:12.524000 ] During the time I loaded the data and ran these queries I did not restart the database, it had been up for about 3 days I then issued: monetdb stop db and monetdb start db and re-ran the queries: select count(*) from raw_plays ; [ 20998687 ] select count(*) from raw_plays where col1 = '' or col2 = '' or col3 = ''; [ 20852061 ] select max(col7), min(col7) from test_table ; [ 2009-07-25 14:17:15.538000, -1-01-01 00:00:00.000000 ] This is some serious data corruption, I've lost data in the vast majority of these records! 73, Matthew W. Jones (KI4ZIB) http://matburt.net

2 3

[MonetDB-users] Announcement: May2009-SP2 bug fix release
by Sjoerd Mullender 29 Jul '09

29 Jul '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the May 2009-SP2 bug fix release of the MonetDB suite of programs. This is the second bug fix release for the May2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/May2009/#May200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[MonetDB-users] can not delete data
by Allen Zhang 28 Jul '09

28 Jul '09

Hi, We had such a weird issue here, we are using Feb2009-SuperBall package, we managed get our data into monetdb, but some how when we try to delete data, it reappears under single user or readonly mode. Here is what we did, we put database in normal mode without gdk_single_user and gdk_readonly in monetdb5.conf. Issue a delete sql statement in mclient, now we query the data, seem the data is gone, and then we stop the database server, and start it in readonly mode. Then query the data again, the data come back!!! Seems to us the monetdb did not sync the memory with disk. Any ideas? Allen

1 0

[MonetDB-users] XRPC issues
by Roy Walter 28 Jul '09

28 Jul '09

Hi A couple of tijah related issues with query modules. 1. The following query when run from xrpc.html appears to ignore the $term argument and returns a very large result! module namespace tj = "tj"; declare function tj:tijahSearch($term as xs:string) as node()* { tijah:queryall("//speech[about(., $term)]") }; 2. Running the above query sometimes produces the following error: !ERROR: interpret: no matching MIL operator to 'tj_query_handler(bit BAT[void BAT], ... Thanks, Roy

2 10

[MonetDB-users] string coercion error
by Alex Bo. 27 Jul '09

27 Jul '09

Hi, What does the following exception mean: !SyntaxException: convertConstant: no string coercion for 'any' !SyntaxException:convertConstant:conversion error !SyntaxException efConstant:constant coercion error from void to any I can't reproduce it - I am getting this from time to time on simple queries that usually work. Thanks. -- View this message in context: http://www.nabble.com/string-coercion-error-tp24684760p24684760.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

Re: [MonetDB-users] result cache?
by Allen Zhang 27 Jul '09

27 Jul '09

Thanks Milena, Is that means monetdb does not provide final result cache? We have sql client will query same query to the database multiple times, imaging each query took 2 minutes to run, that¹s will be really painful when the client ask 10 times, since our database is readonly, so a real result cache will really help us. Regards Allen

3 6

[MonetDB-users] Segfault interpreting sql query
by Franck Routier 27 Jul '09

27 Jul '09

Hi, Monetdb is segfaulting, probably while interpreting a query or planning it. I first thought it had to do with data, but after emptying the tables, the query still makes monetdb segfault. Error in syslog says: [ 1230.812708] mserver5[5369]: segfault at 7fab4c2b5ff8 ip 00007fab4f894285 sp 00007fab4c2b6000 error 6 in lib_sql.so.2.30.2[7fab4f7e3000+116000] Following is the faulty ddl / query. Is there anything I can do to help debug this ? Franck The ddl is the following: CREATE TABLE cabact ( cabactcsu integer NOT NULL, cabact___rforefide character varying(32) NOT NULL, cabact___rteprcide character varying(32) NOT NULL, cabact___rtestdide character varying(32) NOT NULL, cabact___rfovsnide character varying(32) NOT NULL, cabactlil character varying(100) NOT NULL, cabactlic character varying(32) NOT NULL, cabacttxt character varying(1500), cabact___rfontride character varying(32), cabact_f1rfodstide character varying(32), cabact_f2rfodstide character varying(32), cabact_f3rfodstide character varying(32), cabact_f4rfodstide character varying(32), cabact_f5rfodstide character varying(32), cabact_f6rfodstide character varying(32), cabact_f7rfodstide character varying(32), cabact_f8rfodstide character varying(32), cabact_f9rfodstide character varying(32), cabact_c1rfodstide character varying(32), cabact_c2rfodstide character varying(32), cabact_c3rfodstide character varying(32), cabact_c4rfodstide character varying(32), cabact_c5rfodstide character varying(32), cabact_c6rfodstide character varying(32), cabact_c7rfodstide character varying(32), cabact_c8rfodstide character varying(32), cabact_c9rfodstide character varying(32), cabactqte double, cabact___rfountide character varying(32), cabactdtd timestamp with time zone NOT NULL, cabactdtf timestamp with time zone NOT NULL, cabactax1 integer NOT NULL DEFAULT 1, cabactax2 integer NOT NULL DEFAULT 2, cabactax3 integer NOT NULL DEFAULT 3, cabactax4 integer NOT NULL DEFAULT 4, cabactax5 integer NOT NULL DEFAULT 5, cabactax6 integer NOT NULL DEFAULT 6, cabactax7 integer NOT NULL DEFAULT 7, cabactax8 integer NOT NULL DEFAULT 8, cabactax9 integer NOT NULL DEFAULT 9 ); CREATE TABLE rfoade ( rfoade___rforefide character varying(50) NOT NULL, rfoade___rfovdeide character varying(50) NOT NULL, rfoade_i_rfodstide character varying(50) NOT NULL, rfoadeaxe integer DEFAULT 0 NOT NULL, rfoadervs integer NOT NULL, rfoadenpm integer DEFAULT 1, rfoade_s_rfodstide character varying(32) NOT NULL, rfoadegch character varying(120) DEFAULT 'AAAAA' NOT NULL, rfoadedrt character varying(120) DEFAULT 'ZZZZZ' NOT NULL, rfoadeniv integer DEFAULT 0 NOT NULL, rfoadetxt character varying(1800), rfoadenum integer DEFAULT 99999 NOT NULL, rfoadeden integer DEFAULT 999 NOT NULL, rfoadechm character varying(5500) DEFAULT 'INVALID' NOT NULL, rfoadeord integer DEFAULT 999999 NOT NULL ); And the query is: select * from cabact where cabact___rforefide = 'FHSJ' and cabact___rteprcide = 'CPTANA' and cabact___rtestdide = '100' and cabact___rfovsnide = '200805_001' and (cabact_f1rfodstide IS NULL or cabact_f1rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_f2rfodstide IS NULL or cabact_f2rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_f3rfodstide IS NULL or cabact_f3rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_f4rfodstide IS NULL or cabact_f4rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_f5rfodstide IS NULL or cabact_f5rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_f6rfodstide IS NULL or cabact_f6rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_f7rfodstide IS NULL or cabact_f7rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_f8rfodstide IS NULL or cabact_f8rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_f9rfodstide IS NULL or cabact_f9rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_c1rfodstide IS NULL or cabact_c1rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_c2rfodstide IS NULL or cabact_c2rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_c3rfodstide IS NULL or cabact_c3rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_c4rfodstide IS NULL or cabact_c4rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_c5rfodstide IS NULL or cabact_c5rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_c6rfodstide IS NULL or cabact_c6rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_c7rfodstide IS NULL or cabact_c7rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1')) and (cabact_c8rfodstide IS NULL or cabact_c8rfodstide IN (select rfoade_i_rfodstide from rfoade where rfoade___rfovdeide='SECA' and rfoade___rforefide = 'FHSJ' and rfoadervs='1'))

5 13

[MonetDB-users] JDBC InvalidCredentialsException
by McKennirey.Matthew 27 Jul '09

27 Jul '09

2 3

[MonetDB-users] result cache?
by Allen Zhang 24 Jul '09

24 Jul '09

Hi, Does monetDB provide result cache? How to enable it? Best Regards Allen

2 1

[MonetDB-users] Segfaulting Embedded MonetDB/SQL
by Charles Samuels 23 Jul '09

23 Jul '09

Greetings, I ran the attached program. I compiled it like so: c++ -g3 monetembedded.cpp `monetdb-sql-config --cflags --libs` `monetdb- clients-config --cflags --libs` `monetdb-config --cflags --libs` `monetdb5-config --cflags --libs` -lMapi -lembeddedsql5 -lmutils MonetDB is compiled from MonetDB-May2009-SuperBall-SP1 And it segfaults before getting out of embedded_sql(). Is my program wrong, or is there a known (or unknown) problem in MonetDB with Embedded SQL? Here're the stack traces: Program received signal SIGSEGV, Segmentation fault. [Switching to Thread 0xb169bb90 (LWP 20796)] 0xb7f039fc in sql_find_subtype () from /home/charles/.local/lib/libembeddedsql5.so.2 (gdb) bt #0 0xb7f039fc in sql_find_subtype () from /home/charles/.local/lib/libembeddedsql5.so.2 #1 0xb1c1af1e in SQLinitClient () from /usr/lib/MonetDB5/lib/lib_sql.so #2 0x09a8df68 in ?? () (gdb) info thr * 3 Thread 0xb169bb90 (LWP 20796) 0xb7f039fc in sql_find_subtype () from /home/charles/.local/lib/libembeddedsql5.so.2 1 Thread 0xb6ec78e0 (LWP 20792) 0xb7f68424 in __kernel_vsyscall () (gdb) thr 1 [Switching to thread 1 (Thread 0xb6ec78e0 (LWP 20792))]#0 0xb7f68424 in __kernel_vsyscall () (gdb) bt #0 0xb7f68424 in __kernel_vsyscall () #1 0xb7c9e48b in read () from /lib/i686/cmov/libc.so.6 #2 0xb7a24fdd in pipe_read () from /home/charles/.local/lib/libstream.so.1 #3 0xb7a238ac in stream_readSht () from /home/charles/.local/lib/libstream.so.1 #4 0xb7a23950 in bs_read () from /home/charles/.local/lib/libstream.so.1 Thanks for your help, Charles -- Charles Samuels

1 0

[MonetDB-users] put()
by Roy Walter 23 Jul '09

23 Jul '09

Hi What is the argument list for the fn:put() function? -- Roy

2 3

Re: [MonetDB-users] Database size
by Charles Samuels 23 Jul '09

23 Jul '09

On Wednesday 2009 July 22 12:25:23 pm Martin Kersten wrote: > Charles Samuels wrote: > > Hi, > > > > I have read previously that monetdb is intended to be used only when the > > data can fit in memory. I'm not sure how to interpret this statement - > > does this mean that the entire database must fit in memory, or does it > > mean that only the data being operated on when selected from the database > > must fit in memory? > > MonetDB does *not* limit your database to fit in main memory. > > However, it uses main memory techniques to address the elements in > tables loaded for processing. This means that the hot-set accessed > during query execution is limited when you run on 32-bit machines. Can you elaborate a little bit? Does hot-set mean that a select on the database can only span the chunk that can fit in a 32-bit process's address space? (This seems like a perfectly reasonable limitation, I'm just making sure). > > > We are wanting to store *huge* amounts of data, ultimately several TBs. > > The actual data being select at any given time will only be several > > hundred MBs, however. Is this a reasonable usage of MonetDB? > > The largest database we use internally to experiment with is a 6TB > astronomical database. It contains two large tables, one with 400M rows of > 500 columns and another of 20 B rows and 6 columns. Both tables are larger > then 1TB each. That's really great to hear :) > > This runs on a Linux dual quadcore with 64G Ram and lots of disk space. > Ofcourse, at some point you well notice IO behavior ;) For what kind of operations do you need that amount of memory? If you were to do a select on just a few thousand rows on that same mega-database, would it be happy with more "mundane" amounts of memory? > > > But most importantly, I have noticed that all the row ID indexes are > > "int" - why the 32 bit limitation? This just seems like a symptom of the > > above problem; that the entire database must fit in memory. > > You can use the system with both 32- and 64- bit oids. Ah, I previously had a bit of a brain failure. When reading Mapi.h, I noticed that "mapi_get_row_count" returned an int - obviously you wouldn't want select to return 2^32 rows, which is what this function counts the rows of. Thanks Martin (and also Lefteris), Charles -- Charles Samuels

2 1

[MonetDB-users] Database size
by Charles Samuels 22 Jul '09

22 Jul '09

Hi, I have read previously that monetdb is intended to be used only when the data can fit in memory. I'm not sure how to interpret this statement - does this mean that the entire database must fit in memory, or does it mean that only the data being operated on when selected from the database must fit in memory? We are wanting to store *huge* amounts of data, ultimately several TBs. The actual data being select at any given time will only be several hundred MBs, however. Is this a reasonable usage of MonetDB? But most importantly, I have noticed that all the row ID indexes are "int" - why the 32 bit limitation? This just seems like a symptom of the above problem; that the entire database must fit in memory. Thanks a lot for your advice, Charles -- Charles Samuels

4 3

Re: [MonetDB-users] Performance
by Roy Walter 22 Jul '09

22 Jul '09

OK so this is interesting. I don't have a dbfarm directory. I looked in monetdb.conf and noticed a couple of things. The MonetDB installation path value appears as: prefix=c:\documents and settings\sjoerd\my documents\src\stable\icc32\nt32 This means that neither the datadir nor the gdk_dbfarm entries can be properly processed. Might this explain why I [and others] have to start the XQuery Server from the command line and load the modules manually? So right now I can't find my data :) What file extensions does MonetDB use? -- Roy Lefteris wrote: > Hi, > > it looks that something got corrupted in the process. This is starting > to be very usual with windows installations. Anyway, you should delete > the contents of the dbfarm directory in the monetdb installation > directory. This will *delete* all data in your database (i guess you > dont have any important data still in cause you are testing). After > you delete dbfarm, start mserver, that will populate again dbfarm with > the default files. then, add again your data with the usual > pf:add-doc, then create the tijah indices and then run your queries:) > > If this does not work, we will have to try to "wake up" the pf/tijah > people to help us. > > Hope this will help, > > lefteris > > On Tue, Jul 21, 2009 at 10:35 AM, Roy Walter<garliestonhouse(a)yahoo.co.uk> wrote: > >> OK, I restarted and got an error message that pointed to a problem document >> in a collection. I deleted the offending document and then tried to generate >> the default index with tijah:create-ft-index(). This failed because, >> apparently, the DFLT_FT_INDEX already exists. >> >> So I thought that even though the index compilation appeared to have failed >> at the earlier error an index must have been created. >> >> I tried a tijah:query(). That failed because the DFLT_FT_INDEX does not >> exist. >> >> Hmm, so I tried tijah:delete-ft-index() and it too told me that >> DFLT_FT_INDEX does not exist. >> >> tijah:create-ft-index() still fails with: !ERROR tj_init_collection, pftijah >> collection already exists: DFLT_FT_INDEX >> >> How do I reset? >> >> -- Roy >> >> >> Lefteris wrote: >> >> This is not expected. >> >> Did you try to restart the server and retry? >> >> You might also have a corrupted dbfarm or the documents didn't shred >> correctly to begin with. Which version of monet are you using? how did >> you installed it? >> >> lefteris >> >> On Mon, Jul 20, 2009 at 8:52 PM, Roy Walter<garliestonhouse(a)yahoo.co.uk> >> wrote: >> >> >> Hi lefteris >> >> Well that seems to tick all the boxes. >> >> I tried the global index creation: >> >> tijah:create-ft-index() >> >> and it crashed the server with: >> >> !WARNING: readClient: unexpected end of file; discarding partial input >> >> Hmm... >> >> R. >> >> Lefteris wrote: >> >> >> Hi Roy, >> >> I suggest that you try the pf/tijah module for MonetDB/XQuery. >> >> http://dbappl.cs.utwente.nl/pftijah/ >> >> This will create specific indices for your queries to facilitate text >> search. >> >> Hope this helps for now. We will also investigate were the time is >> spent in your case (without pf/tijah) and come back to you. How many p >> elements your documents have? The problem might be that because monet >> does not build inverted indices on text by itself, it has to visit >> each p element and search with the help of the pcre library. Pf/tijah >> was build for that purpose and should help alot. >> >> Please feel free to contact us for further clarification and new >> findings from your tests:) >> >> cheers, >> >> lefteris >> >> On Mon, Jul 20, 2009 at 6:28 PM, Roy Walter<garliestonhouse(a)yahoo.co.uk> >> wrote: >> >> >> >> Running MonetDB/XQuery on a 2.6GHz 32-bit Windows XP box with 1GB of RAM. >> >> What is the best way to organise XML in MonetDB for rapid text searching? >> A >> run down of my recent experience might help. >> >> I created a collection of around 450 documents (153MB approx.). I ran the >> following query from the command line: >> >> collection("papers")//p[contains(., 'wind farm')] >> >> The query time is at best 19 seconds. That's bad. (It's worse than >> querying >> a Postgres database with documents stored in the XML field type.) >> >> So to get a reference point I loaded up the 114MB XMark document and ran >> this query: >> >> doc("standard")//text[contains(., "yoke")] >> >> The query time varies from 2 to 4 seconds. Better, but still not great. >> >> Now, adding more RAM (and moving to 64-bit) would speed things up I hope! >> But hardware aside: >> >> 1. Is it better to have big documents rather than big collections? >> >> 2. Is having small collections (<10 docs) of big documents also >> inefficient? >> >> Ideally I need to query collections comprising several thousand documents >> using 'text search' predicates. Are there other, better ways to run this >> type of query against a MonetDB XML database? Or should I really be using >> some other platform for this task? >> >> Thanks in advance for any pointers. >> >> -- Roy >> >> >> ------------------------------------------------------------------------------ >> Enter the BlackBerry Developer Challenge >> This is your chance to win up to $100,000 in prizes! For a limited time, >> vendors submitting new applications to BlackBerry App World(TM) will have >> the opportunity to enter the BlackBerry Developer Challenge. See full >> prize >> details at: http://p.sf.net/sfu/Challenge >> _______________________________________________ >> MonetDB-users mailing list >> MonetDB-users(a)lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/monetdb-users >> >> >> >> >> >> >> >> >> > >

3 9

[MonetDB-users] Linux memory overcommit settings
by Franck Routier 21 Jul '09

21 Jul '09

Hi, Does anyone know, when using monetdb, what would be the common wisdom regarding the memory-overcommit settings on a Linux platform, regarding the performance impacts ? Franck

1 0

[MonetDB-users] Wrong callHistory information ?
by Franck Routier 21 Jul '09

21 Jul '09

Hi, testing monetdb, I've come accross a query that takes several minutes on my dev machine (with only 2 GB of RAM). So it will swap for a while, and finally produce the result. I wanted to get the duration of the request, so I did 'set history=true;' The request takes a few minutes, and returns 464 tuples. But when I select from callHistory, here is the outcome : +---------+----------------------------+------------------+-------------+-------+------+--------+--------+---------+---------+ | id | ctime | arguments | xtime | rtime | foot | memory | tuples | inblock | oublock | +=========+============================+==================+============= +=======+======+========+========+=========+=========+ | 6776676 | 2009-07-21 13:25:27.000000 | user.s6_1(); | 22108050926 | 0 | 0 | 0 | 1 | 0 | 0 | +---------+----------------------------+------------------+-------------+-------+------+--------+--------+---------+---------+ Obviously, xtime is wrong (the query did not last for 6 hours). I guess rtime is also a bit quick :-) And the number of tuples is also wrong... Running the same query with \t in mclient gives: Timer 322316.803 msec 464 rows This seems more like truth. Well, I am conscious that with that information, it's hard to tell where the problem is.... So my question is rather: is the information in callHistory expected to be reliable, or more like an indication ? Franck

1 0

[MonetDB-users] Performance
by Roy Walter 20 Jul '09

20 Jul '09

Running MonetDB/XQuery on a 2.6GHz 32-bit Windows XP box with 1GB of RAM. What is the best way to organise XML in MonetDB for rapid text searching? A run down of my recent experience might help. I created a collection of around 450 documents (153MB approx.). I ran the following query from the command line: collection("papers")//p[contains(., 'wind farm')] The query time is at best 19 seconds. That's bad. (It's worse than querying a Postgres database with documents stored in the XML field type.) So to get a reference point I loaded up the 114MB XMark document and ran this query: doc("standard")//text[contains(., "yoke")] The query time varies from 2 to 4 seconds. Better, but still not great. Now, adding more RAM (and moving to 64-bit) would speed things up I hope! But hardware aside: 1. Is it better to have big documents rather than big collections? 2. Is having small collections (<10 docs) of big documents also inefficient? Ideally I need to query collections comprising several thousand documents using 'text search' predicates. Are there other, better ways to run this type of query against a MonetDB XML database? Or should I really be using some other platform for this task? Thanks in advance for any pointers. -- Roy

3 5

[MonetDB-users] XQuery performance
by Roy Walter 20 Jul '09

20 Jul '09

Hi I'm just trying out MonetDB and I have a performance question. I'm running the software on an 2.6GHz 32-bit XP box with 1GB RAM. I have created a small collection of 480 documents, approx. 153MB. Using the console client I run the following query: for $p in collection("papers")//p where contains($p, 'wind farm') return($p) Enabling the timer I see that the query time is 29675 msec. In other words, way too slow to be useful. Clearly there is something fundamentally wrong here. Any pointers? -- Roy Walter

1 0

[MonetDB-users] Has someone already made the jdbkc driver compile with recent jdk-1.5 or newer?
by Marc Weber 19 Jul '09

19 Jul '09

Hi, I tried compiling monetdb with jdbc support today using jdk-1.5.0.19. However the build failed because many abstract methods are not implemented. Has someone already done some work on this? Marc Weber

2 2

[MonetDB-users] server crash
by dariuszs 19 Jul '09

19 Jul '09

Hi, What does this mean 'too many open files'? !SABAOTHgetMyStatus: IOException:sabaoth.getStatus:Unable to open directory /vol1/MonetDB5/dbfarm: Too many open files Thanks. Dariusz.

3 2

[MonetDB-users] merovingian / php
by dariuszs 18 Jul '09

18 Jul '09

Hi, If merovingian starts database on demand after a crash then how would I know which port to use for connection in php script, it errors out for port 50000? $db = monetdb_connect("sql", "localhost", 50000,"monetdb", "monetdb_password");

2 1

[MonetDB-users] production server
by dariuszs 18 Jul '09

18 Jul '09

Hi, Does anybody use MonetDB in production environment? Thanks. Dariusz.

3 4

[MonetDB-users] varchar type with copy into + misleading error message
by Franck Routier 17 Jul '09

17 Jul '09

Hi, using copy into, I run into a problem where a string does not fit into my varchar column. So the first point is that the error message is quite misleading, as it states 'field 4 not inserted, expecting type str'. Well, it is a string, but the length is too long... Using insert into, the error message will be 'SQLException:str_cast:value too long for type (var)char(100)' which is much more helpful. The second point is that my string is 99 characters long, and utf-8 with accented characters. So its length is less than 100 characters but more than 100 bytes. In postgresql, where my data come from, varchar(100) means 100 characters, whatever encoding the database happen to be in. Oracle gives the choise with varchar2(100 char) or varchar2(100 byte) and will default to NLS_LENGTH_SEMANTICS (which in turn is BYTE by default). I guess in monetdb, it means 100 bytes... Am I right stating that, and is it the expected behaviour or a bug ? Franck

2 2

[MonetDB-users] Merovingian Neighbour discovery
by Ross Bates 17 Jul '09

17 Jul '09

Trying to get Merovingian to act as a front end to MonetDB cluster. When I start the Mero service this shows up in the log. 2009-07-16 11:28:10 ERR merovingian[2276]: HELO message: error while sending message: Network is unreachable 2009-07-16 11:28:10 ERR merovingian[2276]: ANNC message: error while sending message: Network is unreachable I can connect back and forth between the two Mero/Monet instances using mclient --lsql, but for some reason the instances of Mero can't discover eachother. I think Mero is using UDP which could be contributing to the issue. Any tips for troubleshooting Mero connectivity over UDP? Related to this, is there anyway I can just tell one instance of Mero about the other without auto discovery and proxy that way? Thanks! -Ross

2 2

[MonetDB-users] Jdbc errors : no prepared statement
by Franck Routier 15 Jul '09

15 Jul '09

Hi, trying to populate my database using jdbc, I encounter the following error : java.sql.SQLException: no prepared statement with the given id at nl.cwi.monetdb.jdbc.MonetConnection $ResponseList.executeQuery(MonetConnection.java:2219) at nl.cwi.monetdb.jdbc.MonetConnection $ResponseList.processQuery(MonetConnection.java:1978) at nl.cwi.monetdb.jdbc.MonetConnection.commit(MonetConnection.java:348) The error comes at a seemingly random time, depending on the run, I could insert 22000 rows, then 9800, etc. I am using the latest published version (MaySP1). Is this a know problem ? Franck

3 6

[MonetDB-users] Inner join & nulls performance question
by Alex Bo. 15 Jul '09

15 Jul '09

Hi, I want to do a join between tables on a column that contains nulls. What should I expect performance-wise when running SELECT ... FROM... INNER JOIN... ON (a.f1 = b.f1 OR (a.f1 is null AND b.f1 is null)) compared to a normal join: SELECT ... FROM... INNER JOIN... ON (a.f1 = b.f1) Thanks. -- View this message in context: http://www.nabble.com/Inner-join---nulls-performance-question-tp24496517p24… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Select * ... LIMIT takes long time
by Alex Bo. 15 Jul '09

15 Jul '09

Hi, I am running the May2009 SP on Windows. I have populated a table with 40M rows and 20 columns. It takes 'SELECT * FROM table LIMIT 10' 2.5 minutes to return, in which memory and cpu consumption seems to be at a standstill. Why does it take so long? -- View this message in context: http://www.nabble.com/Select-*-...-LIMIT--takes-long-time-tp24493160p244931… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] server messages
by dariuszs 14 Jul '09

14 Jul '09

Hi, What do these mean? >#GDKmmap(394264576) fails, try to free up space [memory in use=36011928,virtual memory in use=511214485504] #GDKmmap(394264576) fails, try to free up space [memory in use=36011952,virtual memory in use=511214485504] #GDKmmap(394264576) result [mem=34705504,vm=286633623552] #GDKmmap: recovery ok. Continuing.. #GDKmmap(394264576) result [mem=34379040,vm=228672143360] #GDKmmap: recovery ok. Continuing.. Thanks. Dariusz.

2 1

[MonetDB-users] server crash/lib_sql.so.2.30.0
by dariuszs 14 Jul '09

14 Jul '09

Hi, What does this mean? Jul 14 11:41:05 monetdb kernel: [78349.487006] mserver5[18645]: segfault at 18 i p 00007f2ed339d62d sp 00007f2ed2cd3dc0 error 4<6>mserver5[18651]: segfault at 18 ip 00007f2ed339d62d sp 00007f2ed20cddc0 error 4 in lib_sql.so.2.30.0[7f2ed32da0 00+103000] Thanks. Dariusz.

2 3

[MonetDB-users] Data Loss after Restarting MonetDB
by JLee 14 Jul '09

14 Jul '09

Hi: We are running into an interesting problem that we can’t seem to resolve. We have a large number of xml files that we are parsing and loading to MonetDB Feb2009-SP2 sql server running on Redhat with 40gigs of memory. Basically, everything looks fine while the files are being loaded. But, once the server is shutdown and restarted (after the data load has been finished), all the data is simply gone! We have done a dump and restored the db before restarting the db, then loaded more data on top of it; and the data that was restored is intact. But, the newly loaded data is simply gone. It doesn’t seem to matter how small or large the data set being loaded is (tried as small as 1.5 gig of xml files resulting in 1.2M rows). Which leads me to believe our data is not persistent! (a minor problem.. J) We also noticed that as our parser (java app using JDBC with hibernate) is loading the data, that the memory use continues to grow and never shrinks after the data load is complete. So, it seems like the all the data being loaded is being kept in the memory; but never becomes persistent. We tried waiting 4 hours after loading 1.2M rows, thinking that there may be a lag in syncing to the disk (which seem odd, in case of a sudden server failure); but the data simply is gone. Can you provide some assistance in troubleshooting this problem? Thanks. Best regards, H

1 0

[MonetDB-users] merovingian/vaultkey
by dariuszs 14 Jul '09

14 Jul '09

Hi, How do I set vaultkey? Thanks. Dariusz.

2 4

[MonetDB-users] pcre.lib vs. pcred.lib
by Alex Bo. 13 Jul '09

13 Jul '09

Hi, I have built PCRE on windows with CMAKE as instructed by your documentation. Installing PCRE as instructed results in a "pcred.lib" file in the lib directory, and no "pcre.lib" file. When I try to build the MonetDB5 module, I get an linker error that pcre.lib wasn't found (even though I pointed the nmake command to pcred.lib with the LIB_PCRE flag). Why is it looking for pcre.lib if I defined pcred.lib in LIB_PCRE? What do I need to do to get PCRE and Monet work together on Windows? Please help me out. Thanks. (I used pcre 7.8 and CMAKE 2.6) -- View this message in context: http://www.nabble.com/pcre.lib-vs.-pcred.lib-tp24461629p24461629.html Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Server only runs on machine it was built on.
by Alex Bo. 13 Jul '09

13 Jul '09

Hi, I successfully built the May2009 SP on Windows from CVS. However, when I copy the files and run MSQLserver.bat on other machines, I get the following error from the server which fails to start: #WARNING: LoaderException:loadLibrary:Loading errorThe application has failed to start because its side-by-side configuration is incorrect. Please see the appli cation event log for more detail. .pcre #WARNING: LoaderException:loadLibrary:Loading errorThe application has failed to start because its side-by-side configuration is incorrect. Please see the appli cation event log for more detail. .pcre Please help. Thanks. -- View this message in context: http://www.nabble.com/Server-only-runs-on-machine-it-was-built-on.-tp244592… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] select count(*) not understood by squirrelsql
by Franck Routier 13 Jul '09

13 Jul '09

Hi, using squirrelsql to access Monetdb (so, via jdbc), the tool fails to display the result for select count(*) from table; Instead it will display <Other>. On the metadata tab, it says the result is seen as culumnType = 1111, columnTypeName = wrd Issuing the same command in montdb command line display the result. Any idea ? Franck

3 6

[MonetDB-users] mserver5/ubuntu crash
by dariuszs 12 Jul '09

12 Jul '09

Hi, mserver5 crashed on ubuntu 64bit while running this query select count(*) from table1 where c1 like 'New Y%'; root@monetdb:~# mserver5 --dbinit="include sql;" # MonetDB server v5.12.0, based on kernel v1.30.0 # Serving database 'svnp', using 8 threads # Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://monetdb:50000/ # MonetDB/SQL module v2.30.0 loaded >Bus error root@monetdb:~# /var/log/messages Jul 9 10:52:38 monetdb kernel: [260266.738514] mserver5[18561] general protection ip:7f1fa5f8996c sp:7f1f910989d8 error:0 in libbat.so.1.30.0[7f1fa5699000+d5f000] Jul 9 10:54:30 monetdb kernel: [260377.889355] mserver5[18577] trap stack segment ip:7fc1d0d161d3 sp:7fc1c8996d50 error:0

3 5

[MonetDB-users] sql module of May2009 SP doesn't compile on windows
by Alex Bo. 12 Jul '09

12 Jul '09

Hi, When building the sql module of MonetDB May2009 SP from CVS on Windows, I get the following compilation errors: sql_gencode.c .\..\..\..\..\src\backends\monet5\sql_gencode.mx(1027) : error C2065: 'leftjoinR ef' : undeclared identifier .\..\..\..\..\src\backends\monet5\sql_gencode.mx(1027) : warning C4047: 'functio n' : 'char *' differs in levels of indirection from 'int' .\..\..\..\..\src\backends\monet5\sql_gencode.mx(1027) : warning C4024: 'newStmt 2' : different types for formal and actual parameter 3 Please help. -- View this message in context: http://www.nabble.com/sql-module-of-May2009-SP-doesn%27t-compile-on-windows… Sent from the monetdb-users mailing list archive at Nabble.com.

2 6

[MonetDB-users] Is monetDB nativeXML or not?
by Mtekel 10 Jul '09

10 Jul '09

Hello, I have a question, whether MonetDB/XQuery is native XML database or not. To clarify what is native or not, http://en.wikipedia.org/wiki/XML_database : " Two major classes of XML database exist: XML-enabled: these map all XML to a traditional database (such as a relational database), accepting XML as input and rendering XML as output. This term implies that the database does the conversion itself (as opposed to relying on middleware). Native XML (NXD): the internal model of such databases depends on XML and uses XML documents as the fundamental unit of storage, which are, however, not necessarily stored in the form of text files. " Then according to this page, monetDB is native XML: http://monetdb.cwi.nl/MonetDB/Version4/Documentation/monet/index.html " 2 MonetDB Features MonetDB is database engine geared at high performance on systems with (complex) queries that have to analyze large amounts of data (i.e. OLAP, not OLTP). The features in which it most differs from other DBMSs are summarized below: Independence of SQL: MonetDB has a front-end/back-end design allowing the storage of more than just relational tables (such as object-oriented or native XML data), and allowing the use of querying paradigms other than just SQL (such as OQL and XQuery). " Whereas according to this one, it is not: http://monetdb.cwi.nl/projects/monetdb/XQuery/Documentation/Separate-Documen ts-vs-Document-Collections.html#Separate-Documents-vs-Document-Collections : " 2.9.1.1 Storage Overhead In MonetDB/XQuery all XML is stored in relational tables. " Is then monetDB really native? Thanks in advance for clarification... Regards, M. Tekel

3 2

[MonetDB-users] Jdbc error
by Franck Routier 08 Jul '09

08 Jul '09

Hi, I am trying to populate a table using jdbc and CloverETL, but I get the following message : Caused by: java.sql.SQLException: SQLException:sql.prepare:wrong argument for prepared statement (expected decimal instead of decimal) So, Monetdb is expecting decimal, but gets ... decimal :-) What can be the problem ? Thanks, Franck

2 4

Re: [MonetDB-users] PCRE
by idf＠synctrading.com 04 Jul '09

04 Jul '09

I can't get much to work on windows version of MonetDB. It is terribly documented. On Sat Jul 4 8:39 , 'Alex Bo.' <alex.bodinner(a)gmail.com> sent: > >Hi, > >I am trying to build the new May2009 SP from CVS on Windows64, however, >building the MonetDB5 module fails because of pcre. >I built pcre successfully, and have it in 'C:\PCRE'. Then I added >'LIBPCRE=C:\PCRE' and 'PCRE_LIBS=C:\PCRE\lib\pcre.lib' to my nmake command, >but I get the following errors: > > Creating library lib_pcre.lib and object lib_pcre.exp >pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_compile >referen >ced in function _pcre_compile_wrap >pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_exec >referenced > in function _pcre_exec_wrap >pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_study >reference >d in function _pcre_uselect >pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_fullinfo >refere >nced in function _pcre_replace >pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_free >referenced > in function _pcre_init >pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_malloc >referenc >ed in function _pcre_init >lib_pcre.dll : fatal error LNK1120: 6 unresolved externals > >Please help. >Thanks. > >-- >View this message in context: http://www.nabble.com/PCRE-tp24334669p24334669.html >Sent from the monetdb-users mailing list archive at Nabble.com. > > >------------------------------------------------------------------------------ >_______________________________________________ >MonetDB-users mailing list >MonetDB-users(a)lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/monetdb-users

1 0

[MonetDB-users] PCRE
by Alex Bo. 04 Jul '09

04 Jul '09

Hi, I am trying to build the new May2009 SP from CVS on Windows64, however, building the MonetDB5 module fails because of pcre. I built pcre successfully, and have it in 'C:\PCRE'. Then I added 'LIBPCRE=C:\PCRE' and 'PCRE_LIBS=C:\PCRE\lib\pcre.lib' to my nmake command, but I get the following errors: Creating library lib_pcre.lib and object lib_pcre.exp pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_compile referen ced in function _pcre_compile_wrap pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_exec referenced in function _pcre_exec_wrap pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_study reference d in function _pcre_uselect pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_fullinfo refere nced in function _pcre_replace pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_free referenced in function _pcre_init pcre.obj : error LNK2019: unresolved external symbol __imp__pcre_malloc referenc ed in function _pcre_init lib_pcre.dll : fatal error LNK1120: 6 unresolved externals Please help. Thanks. -- View this message in context: http://www.nabble.com/PCRE-tp24334669p24334669.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] zlib dll problems in May2009 SP
by Alex Bo. 02 Jul '09

02 Jul '09

Hi, There seems to be a bug in the new service pack. Trying to compile it from CVS fails because zlib1.dll isn't found, even though it is found with the same configuration in the original May2009 release. I noticed that winrulesm.msc in the MonetDB folder doesn't handle the zlib dlls correctly for 32 bit machines. Moving the #!IFDEF HAVE_LIBZ portion of the file back to how it is the the May2009 non SP release solved the problem. -- View this message in context: http://www.nabble.com/zlib-dll-problems-in-May2009-SP-tp24307397p24307397.h… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Announcement: May2009-SP1 bug fix release
by Sjoerd Mullender 30 Jun '09

30 Jun '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the May21009-SP1 bug fix release of the MonetDB suite of programs. This is a bug fix release for last month's May2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/May2009/#May200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

Re: [MonetDB-users] problem with MonetDB
by Stefan Manegold 29 Jun '09

29 Jun '09

Dear Christoph, I'm currently traveling, hence only a quick reply. Most probably, the reason that your haven't receive any answer to your question, yet, is that noone seems to have an answer, yet. Looking at your report, again, I do have a couple of questions and suggestions (inlined below) that might help you and us to locate the origin of your problem. On Mon, Jun 29, 2009 at 05:37:56PM +0200, Christoph Beekmans wrote: > Dear Mr. Manegold, > > i have a problem with MonetDB and i sent my problem to the user-mailing > list. > Unfortunately nobody answered on my topic and this is a few weeks ago and > i wasn't the first to mail the problem. > > So i decided to contact someone of the cwi-team directly and i hope you > are able > to help me in some way. > > Here the message i sent to the mailing list: > >> Hi everybody, >> >> I posted my issue a few weeks ago, but i got no answer, so >> i try i again. >> >> I installed MonetDB on Windows with the geom module and Which version of MonetDB are you using/talking about? >> afterwards i tried to execute a query with some geometric data types. >> But after a few changes to the query and execution i got an error. What data did you load? What kind of queries did you run? Which error did you get? >> After that i had to restart MonetDB but i got an error message that >> the system tables couldn`t be loaded. Could you quote the exact error message? >> If i start the server without geom support it starts fine but the sql >> client >> can`t connect: >> >> "Connection terminated >> Press any key to continue . . . " Does the server continue running, or does it crash in that case? If the latter, is there any error message on the server console/window? If so, which? >> If i start the server with geom support it loads the sql and geom modules >> but shuts down after that without error message. Could you try running the server on a new empty database? Does that work? If so, could you then replay the steps you did before to see, whether you can reproduce the crash and (potential) corruption of the database? >> Even a reinstall didn't fix it so the error must be somewhere else. did you remove your database before/after the reistall, or are you (still) using the same (possibly corrupoted) database? >> Has anyone an idea about that? >> >> Please help, >> Thanks. > > I would be grateful for an answer, > Christoph Hope this helps for now ... Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[MonetDB-users] String performance
by Alex Bo. 29 Jun '09

29 Jun '09

Hi, How can I know if a string field in a table has a hash table or not? I am asking this because I noticed that string fields with millions of unique values run very slowly, and from your documentation I understood that if I add too many unique strings to a column, then internally Monet will stop using a hash-table, and performance will be affected. Thanks. -- View this message in context: http://www.nabble.com/String-performance-tp24256780p24256780.html Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Missing JDBC-driver
by Sten Hjelmqvist 25 Jun '09

25 Jun '09

Hello, I've downloaded MonetDB5-SQL-Installer-i386-20090530.msi <http://monetdb.cwi.nl/downloads/Windows/May2009/MonetDB5-SQL-Installer-i386…> for windows. However there was no JDBC-driver in the package. After some searching on Google I found one called "jdbcclient.jar". But I still cannot connect to the database as I get a error message saying that the "demo"-database does not exist. What am I missing? Thanks in advance. --------------------------------------- Sten Hjelmqvist DataKonsult MERdata AB Sveavägen 33, 111 34 Stockholm Mobil : 0708 305616 E-mejl : sten.hjelmqvist(a)merdata.se <mailto:sten.hjelmqist@merdata.se> Webb : www.merdata.se <http://www.main.se/> ---------------------------------------

3 7

[MonetDB-users] disk usage
by dariuszs 25 Jun '09

25 Jun '09

Hi, I've loaded 60 GB of data file into a table. On Windows (NTFS) the size of dbfarm changed to 80GB but on Linux (ext4 or reiserfs) dbfarm changed to 180GB. Why is that? Thanks. Dariusz.

5 15

[MonetDB-users] connection terminated
by Christoph Beekmans 25 Jun '09

25 Jun '09

Hi everybody, I posted my issue a few weeks ago, but i got no answer, so i try i again. I installed MonetDB on Windows with the geom module and afterwards i tried to execute a query with some geometric data types. But after a few changes to the query and execution i got an error. After that i had to restart MonetDB but i got an error message that the system tables couldn`t be loaded. If i start the server without geom support it starts fine but the sql client can`t connect: "Connection terminated Press any key to continue . . . " If i start the server with geom support it loads the sql and geom modules but shuts down after that without error message. Even a reinstall didn't fix it so the error must be somewhere else. Has anyone an idea about that? Please help, Thanks.

1 0

[MonetDB-users] Deployment of MonetDB
by Martin Kersten 24 Jun '09

24 Jun '09

Dear users, In our ongoing effort to improve the MonetDB software suite we would like to hear from you. It appears that MonetDB is used for teaching, and customers use it for/within their products. Also, the divergence in primary platform is crucial for us to keep focus. We would greately appreciate if you could replay with a short message how you deploy the software and your top priorities for a next release. Thank you for you cooperation, Martin Kersten

3 6

[MonetDB-users] May2009 - can't connect on Windows64
by Alex Bo. 24 Jun '09

24 Jun '09

Hi, I installed the new May2009 release. On Windows32 I have no problem connecting through Mapi. On Windows64, however, I can't connect. I get a 'Setup connection failed' error from Mapi. (I had no problem connecting on Windows64 with the Feb09 release) Please help, Thanks. -- View this message in context: http://www.nabble.com/May2009---can%27t-connect-on-Windows64-tp24056525p240… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

Re: [MonetDB-users] [Monetdb-checkins] load data from a file to a table
by Stefan Manegold 24 Jun '09

24 Jun '09

Hi Pedro, A) Thanks for using MonetDB. B) The users mailing list is "monetdb-users(a)lists.sourceforge.net", not "monetdb-checkins(a)lists.sourceforge.net". C) I'm afraid your report contains too little information (basically none) for us to provide any help. The least we'd (obviously) need to know is which version of MonetDB you're using on wich operating system and, in particular, what the exact problem is, i.e., the a detailed description of the symptoms and/or the error messages that you encounter. Stefan On Tue, Jun 16, 2009 at 02:54:01PM +0000, Pedro Bramao wrote: > > I'm trying to load data into a table from a file, named criminoso.sql, to a table named criminos stored in MonetDB. > I'm doing the following coomand : > > copy 2 records into criminoso from '/home/pedro/Escola/tabd/criminoso1.sql' using delimiters tuple_separator ',' record_separator ';'; > > But it's not working... i nedd some help!!!! > > thanks > > _________________________________________________________________ > Conheça os novos produtos Windows Live! Clique aqui. > http://www.windowslive.com.br > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [MonetDB-users] disk usage
by Jens Oehlschlägel 23 Jun '09

23 Jun '09

> > http://www.fusionio.com/Products.aspx If this SSD sits on the bus, it is not compatible with i-core7, is it?

2 1

[MonetDB-users] Schema Changes Through JDBC
by Scott Stephens 22 Jun '09

22 Jun '09

I've been seeing some weird behavior when using Eclipse SQL Explorer to execute statements that modify the schema with the MonetDB May2009 release and the monetdb-1.10-jdbc.jar file. For instance, the statement CREATE TABLE Archive.Test ( var1 int, var2 varchar(100) ); yields a pop-up error message titled "Error Executing SQL" with the text "Schema statements are directly executed and therefor cannot be debugged, explained, profiled, traced, or used in a prepare statement". I'm not a Java user and haven't tried this in Java code as opposed to through SQL Explorer, so I can't conclusively link it to the JDBC driver as opposed to the SQL Explorer code, but I seem to recall this working in previous versions of MonetDB with SQL Explorer. Thoughts anyone? Is this supposed to work? Scott

2 1

Re: [MonetDB-users] CRT and GKLoad errors
by Florian Joßbächer 16 Jun '09

16 Jun '09

Hey, this issue is still unsolved. Are there any ideas or hints? Best regards, Florian.

1 0

[MonetDB-users] Is MonetDB for me?
by Bohák András 12 Jun '09

12 Jun '09

Dear Community, I plan to bulid a database of stock market data. The database structure is very simple, there will be a main table with columns like timestamp, stockID, price, volume. The size of the database is about 4 TB. I would like to use the database to search certain patterns, like "5% stock price change in 5 minutes", so all my queries will likely touch all the data in the database. Is MonetDB for me? Is it considerably faster than an OLTP database (Mysql, Oracle)? Another question: would you use cheap SATA hard drives for this, or is it worth to invest in 15k SAS drives? Is HDD an important performance factor? Thanks in advance for all your answers, Andras Bohak

2 1

[MonetDB-users] Crash after recurring column updates
by Alex Bo. 11 Jun '09

11 Jun '09

Hi, I am working on MonetDB Feb2009SP2 compiled and run on windows64 from CVS. After Creating a 40 Million row table, I did a series of ADD COLUMN and UPDATE operations on all 40M rows. After a few update queries the server crashed. I noticed that for each query a lot of memory was allocated, but not all of it freed after the query returned, so that after each update query the total amount of memory used by MonetDB has gone up, until eventually the server crashed. (The machine is 64 bit with 8GB of RAM) I then tried to reproduce it on a smaller database with 20 Million rows. I ran this query over and over: UPDATE testtable set testtable."MonthColumn" = "month"("DateColumn"); This too eventually crashed. I attached an image of the memory consumption from task manager that was taken right after the crash. http://www.nabble.com/file/p23984181/MonetMemory.jpg Any ideas on why this happens and how I can work around it? Is it at all a memory issue like I suspected? Thanks. -- View this message in context: http://www.nabble.com/Crash-after-recurring-column-updates-tp23984181p23984… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Slow import of large XML documents
by John van Schie (DT) 11 Jun '09

11 Jun '09

Hi, Today I tried to shred a XML document of 1.6 giga bytes using mclient and it took more than 3 hours (~150 kb/s) on a quite fast machine. I was a bit suprised. because for smaller documents shredding is quite fast. Are these numbers expected? I know that it can be hard to say something about this case without the document itself. So I'm currently working to anonymize the document, but what is the prefered way to get the document to the CWI? System information: - Fedora Core 10, x86_64, 32 GB RAM (24G cached/free), 5.5 GB disk free (after import) - MonetDB4 / XQuery v4.28.4, 64bit OIDs (RPM version) Commands: $ time mclient -p 50000 -l xq -s"pf:add-doc('/tmp/structure.xml', 'structure3.xml')" real 198m49.543s user 0m0.002s sys 0m0.003s [user@host tmp]$ ls -lah /tmp/structure.xml -rw-r--r-- 1 user user 1.6G 2009-06-08 16:26 /tmp/structure.xml Regards, John van Schie

3 3

[MonetDB-users] Insert tuples with special characters especially umlauts
by Sebastian Bräuer 09 Jun '09

09 Jun '09

Hallo everybody, I would like to know whether there exist any possibilities to add tuples with umlauts as characters (ä,ö,ü) or other special characters like ß to tables. I tried to use the regular INSERT-statement as well as the COPY INTO-statement with a csv input file but without success (unexpected end of input error or missing ' to close the string). Example: CREATE TABLE Umlautnamelist(CUST_ID numeric(9,0) not null, CUST_NAME varchar(100) not null, constraint Umlautnamelist_PK primary key (CUST_ID)); INSERT INTO Umlautnamelist (123456789,'Bräuer'); Are there any chances to get it working? Thank you in advance. Sebastian

4 3

[MonetDB-users] possible bug in monetdb-install.sh
by Ying Zhang 09 Jun '09

09 Jun '09

Hi, I was using moentdb-install.sh to install the May 2009 release with the following command, which ends in an error: ================================ $ monetdb-install.sh --prefix=[pathto]/mdb_may2009 --enable-optimize --enable-xquery --22:11:36-- http://www.ins.cwi.nl/~monet/tars/latest/release/MonetDB.tar.bz2 => `/private/var/tmp/MonetDB-1244491895/MonetDB/ MonetDB.tar.bz2' Resolving www.ins.cwi.nl... 192.16.196.21 Connecting to www.ins.cwi.nl|192.16.196.21|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 882,241 (862K) [application/x-bzip2] 0K ........ ..... 100% 780.55 KB/s 22:11:37 (780.55 KB/s) - `/private/var/tmp/MonetDB-1244491895/MonetDB/ MonetDB.tar.bz2' saved [882241/882241] fetching http://www.ins.cwi.nl/~monet/tars/latest/release/MonetDB.tar {,bz2:bzip2,gz:gzip} failed! Please refer to the full log at /private/var/tmp/MonetDB-1244491895/log If you believe this is an error in the script or the software, file a bug and attach the logfile. Terminated ================================ The following code in the 'fetch()' function seems incorrect to me: for c in $LZMA $BZIP2 $GZIP ; do wget --progress=dot:mega -t 5 --passive-ftp $1.${c%:*} -P "$BUILDROOT"/$f > $QUIET ... done [[ ! -f "$BUILDROOT"/$f/$f.tar ]] && \ die "fetching $1 {$LZMA,$BZIP2,$GZIP} failed!" First, in the for-loop, e.g., MonetDB.tar.bz2 is fetched. Then, the code following the for-loop checks if ".../MonetDB.tar" exists, if not, it complains that fetching ".../MonetDB.tar.bz2" has failed, returning the error I got. Kind regards, Jennie

2 3

[MonetDB-users] connecting to mserver
by Henrik Vendelbo 08 Jun '09

08 Jun '09

I've installed mserver in a fresh Ubuntu Jaunty running in vmware, but cannot seem to connect. At first I thought it was just because I hadn't opened port 50000 in iptables, but things are a bit odd even now that I have opened the port. within Ubuntu port 50000 only seems to be open on the lo interface, while on the eth0 interface it is closed. Can this be an issue with mserver or is it just my iptables conf that is screwed?

3 2

[MonetDB-users] CRT and GKLoad errors
by Florian Joßbächer 08 Jun '09

08 Jun '09

Hi, I am trying to run the Star Schema Benchmark with Scale Factor 10 on MonetDB and get the following errors while loading the tables from a csv. The GKLoad-Errors occur just once in a while, the CRT-error is reproducible. Every time I try to run SF10, the server crashes while loading the lineorder-table (SF10) - with SF1 everything works fine. I googled this issue but only found a hint deleting a registry-key which is not existing on my machine. What can I do? Best regards, Florian. "# MonetDB server v5.10.4, based on kernel v1.28.4 # Serving database 'ssb', using 1 thread # Compiled for i686-pc-win32/64bit with 32bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see D:\MonetDB5\etc\monetdb5.conf) # Listening for connection requests on mapi:monetdb://CS-MONETDB:50000/ # MonetDB/SQL module v2.28.4 loaded >!ERROR: GDKload: cannot read: name=65\6560, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3440) for sys_customer_custkey !ERROR: GDKload: cannot read: name=65\6547, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3431) for sys_customer_name !ERROR: GDKload: cannot read: name=65\6553, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3435) for sys_customer_address !ERROR: GDKload: cannot read: name=65\6554, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3436) for sys_customer_city !ERROR: GDKload: cannot read: name=65\6557, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3439) for sys_customer_nation !ERROR: GDKload: cannot read: name=66\6672, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3514) for sys_customer_region !ERROR: GDKload: cannot read: name=70\7067, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3639) for sys_customer_phone !ERROR: GDKload: cannot read: name=70\7070, ext=tail, 800000 bytes missing. !OS: The operation completed successfully. !ERROR: logger: could not use bat (3640) for sys_customer_mktsegment runtime error R6031 - Attempt to initialize the CRT more than once. This indicates a bug in your application."

4 10

Re: [MonetDB-users] [Monetdb-developers] problems with starting the monetDB4xquery server
by Mtekel 07 Jun '09

07 Jun '09

Hello, I have carefully read the link you have sent me. Too bad comments are closed. I have now uninstalled my 20090424 version and installed the newest 20090530. However I still have problems running the server. The 2009 4 24 version wouldn't start even after loading all the modules by hand from the Mserver interactive commandline - nor the client or browser would connect. They would just hang, connecting forever. Now this works for the 05 30 version, but I can't use the web interface (which now works) for adding the files - I get a bug (I'm not sure If I am allowed to send attachements, so I'll include them in the next mail). Adding from commandline, mclient --language=xquery -I %1 -C WOcollection < %1 , where %1 is filename, works, but the collection name is %1 WOcollection (e.g. three different files end up in different collections instead of one). What is more interresting, if I try to run pf:add-doc("DATA_wo3.xml", "DATA_wo3.xml", "WOcollection", 1) from the client's interactive commandline, I get this error (no matter where the file really is): MAPI = monetdb@localhost:50000 QUERY = pf:add-doc("DATA_wo3.xml", "DATA_wo3.xml", "WOcollection", 1) ERROR = !ERROR: interpret: no matching MIL operator to 'ws_create(int)'. I have run procmon and created trace as described in the link, the file is attached (to the second mail). I hope this issue can be solved somehow, Best regards, Michael -----Original Message----- From: Ying Zhang [mailto:Y.Zhang@cwi.nl] Sent: 2. júna 2009 10:41 To: Mtekel Cc: monetdb-developers(a)lists.sourceforge.net Subject: Re: [Monetdb-developers] problems with starting the monetDB4xquery server Hello Michael, Thanks for using MonetDB, and sorry for the inconvenience! Your problem has been reported earlier. Unfortunately, we don't have a solution for this problem at this moment. However, there is a workaround, which seems to work according to other users. So please have a look at the following bug report (the workaround is in the report): http://sourceforge.net/tracker/index.php?func=detail&aid=2693363&group_id=56 967&atid=482468 Kind regards, Jennie On Mon, Jun 01, 2009 at 10:55:45AM +0200, Mtekel wrote: > Hello, > > I have problems starting the monetDB xquery server under windowsXP sp3. When > I click on the link in the start menu, dos window appears but then it closes > immediatelly and I can't see what's there (after pausing I can see only the > first 6 lines of the program output as described below, then after unpausing > it immediatelly quits and closes the window). If I run MXQserver.bat, or > Mserver.bat --dbinit="module(pathfinder);" I get only this: > > # MonetDB Server v4.28.4 > # based on GDK v1.28.4 > # Copyright (c) 1993-July 2008, CWI. All rights reserved. > # Copyright (c) August 2008-2009, MonetDB B.V.. All rights reserved. > # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. > # Visit http://monetdb.cwi.nl/ for further information. > # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah > > That's all. The server immediatelly ends. However If I run only Mserver.bat, > the server "runs" - I get the prompt, but for example I can't connect to the > web interface on the port 50000. > > Does anyone have any advice what to do? How to make it work? > Any advice appreciated, > > Best regards > > Michael > > > ---------------------------------------------------------------------------- -- > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp as they present alongside digital heavyweights like Barbarian > Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers

2 3

Re: [MonetDB-users] connection terminated
by Christoph Beekmans 05 Jun '09

05 Jun '09

> hi, > i started to have suddenly following problem with the M5Server. I can > start > the server and get the following screen which seems fine: > > # MonetDB server v5.10.2, based on kernel v1.28.2 > # Serving database 'demo', using 1 thread > # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked > # Copyright (c) 1993-July 2008 CWI. > # Copyright (c) August 2008- MonetDB B.V., all rights reserved > # Visit http://monetdb.cwi.nl/ for further information > #warning: please don't forget to set your vault key! > #(see C:\Program Files\MonetDB\MonetDB5\etc\monetdb5.conf) > # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ > # MonetDB/SQL module v2.28.2 loaded > > When i start the client I get following message and the server shuts down: > > Connection terminated > Press any key to continue . . . > > I have tried to reinstall monetDb but it does not help. can anyone > point me > into the right direction? > Thanks Hi, i have the same problem. It started after i sent a query refering to the geom module. Maybe someone has an idea? Thanks

1 0