October 2010 - developers-list

[Monetdb-developers] Basics about MonetDB
by 叶亮 01 Jun '11

01 Jun '11

Hi, I'm a new comer with some questions about basic conceptions of MonetDB. 1. The executor I've ever found the executor of postgreSQL at src\backend\executor, but cannot make sure where it is like that in MonetDB src. MonetDB\MonetDB\src\gdk or MonetDB5-server\MonetDB5\src\mal ? 3. MAL MAL (MonetDB Assembly Language) is a script tool only for MonetDB or a common script language that can be applied to other softwares. Why it is a must in MonetDB ? 4. .mx files In MonetDB, .mx files are compiled to make .h and .c files generated.(in this way ?) Why is this routines ? (not just coding in .h and .c files directly) Yel ---- Best Regards richardroky(a)gmail.com

8 10

Re: [Monetdb-developers] MonetDB: Oct2010 - approved output
by Stefan Manegold 30 Oct '10

30 Oct '10

Niels, is it by accedent or by design that with mitosis & mergetable, mat.slice() is not longer used with LIMIT ? If by design, we'd need to change (or even drop) test mat.slice_limit1.Bug-2645, that fails single-threaded since you below checkin; cf., http://monetdb.cwi.nl/testing/projects/monetdb/Candidate/sql/.mTests103/GNU… If by accident, we'd need to investigate whether this is indeed OK ... Stefan On Wed, Sep 15, 2010 at 03:18:54PM +0200, Niels Nes wrote: > Changeset: d3918481778e for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=d3918481778e > Modified Files: > sql/src/test/BugTracker-2010/Tests/LIMIT_OFFSET_big-endian.Bug-2622.stable.out > sql/src/test/BugTracker-2010/Tests/copy-into-too-long-string.Bug-2358.sql > sql/src/test/BugTracker-2010/Tests/mat.slice_limit1.Bug-2645.stable.out > sql/src/test/BugTracker-2010/Tests/with_row_number_crash.Bug-2631.stable.out > Branch: Oct2010 > Log Message: > > approved output > [...] > diff -r b3f860694c8a -r d3918481778e sql/src/test/BugTracker-2010/Tests/mat.slice_limit1.Bug-2645.stable.out > --- a/sql/src/test/BugTracker-2010/Tests/mat.slice_limit1.Bug-2645.stable.out Wed Sep 15 15:12:37 2010 +0200 > +++ b/sql/src/test/BugTracker-2010/Tests/mat.slice_limit1.Bug-2645.stable.out Wed Sep 15 15:18:49 2010 +0200 > @@ -112,7 +112,7 @@ > % L6 # name > % wrd # type > % 1 # length > -[ 1 ] > +[ 0 ] > #TRACE select cast(x as string)||'-bla-'||cast(y as string) from slice_test limit 1; > % sys. # table_name > % concat_concat_x # name > @@ -127,7 +127,7 @@ > % L6 # name > % wrd # type > % 1 # length > -[ 1 ] > +[ 0 ] > #drop function GetTrace; > #drop table slice_test; > [...] -- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

1 0

[Monetdb-developers] help troubleshoot: cannot connect to MonetDB
by Tripathi, Jaya 25 Oct '10

25 Oct '10

C:\Proximity\bin>gui.bat localhost:30000 0 [main] WARN kdl.prox.util.Util - * log config file not found (using defaults) : C:\Proximity\bin\prox.lcf' Exception in thread "main" Unable to connect: Connection refused: connect at kdl.prox.monet.BlockedModeStream.<init>(BlockedModeStream.java:162) at kdl.prox.monet.Connection.open(Connection.java:401) at kdl.prox.db.DB.open(DB.java:935) at kdl.prox.db.DB.open(DB.java:914) at kdl.prox.app.GUI2App.main(GUI2App.java:238)

1 0

[Monetdb-developers] MonetDB deadlocks on clients, now what?
by Stefan de Konink 19 Oct '10

19 Oct '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Lately MonetDB starts to deadlock on the clients. Bugs were reported, typically I have connected ~8 clients connected at the same time. http://bugs.monetdb.org/show_bug.cgi?id=2670 Do other people observe this? Is there a good way to debug where it comes from, or show how it hangs? Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEAREKAAYFAky9jXwACgkQYH1+F2Rqwn0DogCglDldSCPcnkRxFIGbtTG/P6ER 3XgAn3uMX45p6UmJrK0aNSFwo6SglSPz =ldsT -----END PGP SIGNATURE-----

1 0

[Monetdb-developers] test missing on pkg-config in clients configure
by Jan Rittinger 10 Oct '10

10 Oct '10

Hi all, I got the following error message due to a missing pkg-config installation—Perhaps there could be a better error message: /home/rittinge/MonetDB.hg/clients/configure: line 2894: syntax error near unexpected token `monetdbtools,' /home/rittinge/MonetDB.hg/clients/configure: line 2894: `PKG_CHECK_MODULES(monetdbtools, monetdb-stream >= $req_monetdb_ver' -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

2 5

[Monetdb-developers] write error
by Mark Bucciarelli 07 Oct '10

07 Oct '10

Hi, I'm getting a "write error" when running a fairly large and complex query (five tables and subselect in where). I run $ mclient -l sql -d <db> -u <usr> < t.sql password: ... % 6, 26, 1, 103, 229, 5 # length write error $ echo $? 1 I've run the exact query on SQLite, so I'm pretty sure the SQL is good. This is Feb2010. I'm thinking about upgrading, but I'm close to a release so I'd prefer not to. Does this description remind anyone of a commit to Jun2010 that may have fixed such an issue? Trying to boil the (complex) SQL down to a small reproduceable test case will take a lot of time. Is there another approach I can use to debug that would be faster? There is nothing in the merovingian log. Thanks, m

3 2

[Monetdb-developers] Obsolete reference to buildtools\conf\winrules.msc
by Sander Kruseman 06 Oct '10

06 Oct '10

Dear MonetDB team, I am trying to build a MonetDB client on Windows, following the instructions in "1.24 Building MonetDB On Windows". In every package's folder named "NT" is a file named "rules.msc" which references: \..\..\buildtools\conf\winrules.msc. But none of the (nightly or release) tarballs contains the buildtools folder. My question: are the tarballs not expected to be built from, and should I choose a different route, or is the reference obsolete and can I fix this myself until the distro is fixed? Background: Actually all I need is the file mapilib.lib, in order to be able to use the mapi programming interface using mapilib.dll. Since this file is not provided, I hope to create it myself by building the clients component (on Win64). cheers, Sander Kruseman

3 3

[Monetdb-developers] Why the Speed of Mapi Lib is so lower?
by peter qin 06 Oct '10

06 Oct '10

Dear all, Yesterday,I had done a test about the speed of MonetDB.I used the example code make a test.the red part is my adding code. #include <mapilib/Mapi.h> #include <stdio.h> #include <stdlib.h> void die(Mapi dbh, MapiHdl hdl) { if (hdl != NULL) { mapi_explain_query(hdl, stderr); do { if (mapi_result_error(hdl) != NULL) mapi_explain_result(hdl, stderr); } while (mapi_next_result(hdl) == 1); mapi_close_handle(hdl); mapi_destroy(dbh); } else if (dbh != NULL) { mapi_explain(dbh, stderr); mapi_destroy(dbh); } else { fprintf(stderr, "command failed\n"); } exit(-1); } MapiHdl query(Mapi dbh, char *q) { MapiHdl ret = NULL; if ((ret = mapi_query(dbh, q)) == NULL || mapi_error(dbh) != MOK) die(dbh, ret); return(ret); } void update(Mapi dbh, char *q) { MapiHdl ret = query(dbh, q); if (mapi_close_handle(ret) != MOK) die(dbh, ret); } int main(int argc, char *argv[]) { Mapi dbh; MapiHdl hdl = NULL; char *name; char *age; dbh = mapi_connect("localhost", 50000, "monetdb", "monetdb", "sql", "demo"); if (mapi_error(dbh)) die(dbh, hdl); update(dbh, "CREATE TABLE emp (name VARCHAR(20), age INT)"); for(int i = 0;i<10000;i++) { update(dbh, "INSERT INTO emp VALUES ('John', 23)"); } //why this cast more then serveral minutes .can you help me? hdl = query(dbh, "SELECT * FROM emp"); while (mapi_fetch_row(hdl)) { name = mapi_fetch_field(hdl, 0); age = mapi_fetch_field(hdl, 1); printf("%s is %s\n", name, age); } mapi_close_handle(hdl); mapi_destroy(dbh); return(0); } Peter Qin peterqin1980(a)gmail.com

3 2

Re: [Monetdb-developers] MonetDB: Oct2010 - Approve -5 option.
by Stefan Manegold 04 Oct '10

04 Oct '10

Thanks, Sjoerd! ... as question mainly towards the pathfinder developers in Tübingen: -5, --m5-sql: generate MIL code ^^ ^^^ ^^^ Does the "-5" option generate SQL, MIL, or MAL code? Looking at the actual output of, e.g., `echo '1+2' | pf -5`, it does not look like either of the above to me, but rather like dot output... Thanks in advance for clearifying! Stefan On Mon, Oct 04, 2010 at 09:56:19AM +0200, Sjoerd Mullender wrote: > Changeset: abe5327b4915 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=abe5327b4915 > Modified Files: > pathfinder/compiler/Tests/usageH.stable.out > Branch: Oct2010 > Log Message: > > Approve -5 option. > > > diffs (11 lines): > > diff -r 69feea05a494 -r abe5327b4915 pathfinder/compiler/Tests/usageH.stable.out > --- a/pathfinder/compiler/Tests/usageH.stable.out Sun Oct 03 21:41:14 2010 +0200 > +++ b/pathfinder/compiler/Tests/usageH.stable.out Mon Oct 04 09:40:25 2010 +0200 > @@ -18,6 +18,7 @@ > Reads from standard input if FILE is omitted. > > = -A, --mil: generate MIL code (default) > + -5, --m5-sql: generate MIL code > = -M, --mil_2004: generate MIL code (directly from XQuery Core) > = -S, --sql: generate SQL code > > _______________________________________________ > Checkin-list mailing list > Checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

[Monetdb-developers] Large XML instances with MonetDB/XQuery 4.38.5
by Christian Grün 02 Oct '10

02 Oct '10

Hi everyone, is it still possible to shred large XML instances with MonetDB/XQuery, or do I need more memory for shredding? I was just trying to the 1GB instance of XMark with WinXP 32Bit and 2GB RAM, and this is what I got: MonetDB>shred_doc("1gb.xml", "xmark"); #GDKmmap(536870912) fails, try to free up space [memory in use=36143780,virtual memory in use=1015480320] #GDKmmap(536870912) result [mem=26016940,vm=1005387776] !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0@0. !ERROR: [shred_url]: first error was: !ERROR: HEAPextend: failed to extend to 536870912 for 06\632theap !ERROR: shredBAT_append_str: APPEND-STR[_prop_text]( follow murders prov shoes p resent eager delivered defy bend viol here marquis powers complexion pillar cran ts agate ), BUNappend fails !ERROR: CMDshred_url: operation failed. pf:add-doc(...) produces the same output; the XML document itself is well-formed. Thanks, Christian

2 6