- developers-list - monetdb.org

mapi.connect() MAL Statement
by Stephen P. Morgan 08 Mar '13

08 Mar '13

I'm in the early stages of trying to write a MAL program to access a remote database using mapi.* modules, mainly to test out the function, but also for future work on distributed query processing. I find that if I issue the mapi,connect() call as follows: mal> ... mal> mid=mapi.connect("localhost",50000,"monetdb","monetdb","mal"); I get the following response: MAPI = (monetdb) /tmp/.s.monetdb.50000 QUERY = mid:=mapi.connect("localhost",50000,"monetdb","monetdb","mal"); ERROR = !IOException:mapi.connect:Could not connect: monetdbd: please specify a database The "please specify a database" part seems to be coming from tools/merovingian/daemon/client.c, i.e., the connection was attempted but was rejected by monetdbd because a database parameter was not specified. I( noticed that mapi.connect() calls SERVERconnet() which calls SERVERconnectAll() which calls mapi_connect() with NULL as the database parameter. Should SERVERconnect() (i.e., mapi.connect()) be altered to accept another parameter, database, which would be passed through SERVERconnectAll() and mapi_connect()? Or am I missing something altogether about mapi.connect()? P.S. Please excuse me if this is a foolish question. I am new to MonetDB. Thank you, Steve Morgan

1 0

Adding data types (maybe to core), probably BUG
by Mike Gomez 08 Mar '13

08 Mar '13

Hi, i am working on monetdb so as it can be used efficiently by more users(myself included).However, the issue i seem to face ( as maybe others) is the data types. for many weeks now,I have been going through the source code, understanding and learning it.Data types in monetdb can be extended in 2 types, external and core GDK. external method problem ( maybe bug in monetdb) ======================== I have created new data type, say unsigned int 32 bit, using extensions (such as inet,color and so on).However, the bug is monetdb system doesn't use my comparison operation, instead uses the default inbuilt operators. eg. in the uint mal file( MonetDB/monetdb5/modules/atoms/uint.mal), i have declared -------------- atom uint:int; .. ..............skipped source code however, when i sort the table, the system still places negative values ahead, means instead of using my declared comparison algos, it's using internal algos. my question is how do i override that ( or is it even possible to do it). core GDK method =============== After failing that, i thought lets add the core data type uint in the gdk_atoms.c. i modified the parsor(& everything else) and the system recognizes my data type. however,when i run simple insert query such as below, i get insert into test1 values('2'); TypeException:user.s1_1[3]:'calc.uint' undefined in: _5:any := calc.uint(_4:str) however, i have got completely stuck in the MAL operators and language. so, how do i get the algebra, operations and everything right, so it works? Any pointers will help. let me know if something more is required. i am working on this out of my interest,so eventually if i get it to work somehow, the code goes back to project. Thanks for help. mike

2 3

Announcement: New Feb2013-SP1 Bugfix release of MonetDB suite
by Sjoerd Mullender 07 Mar '13

07 Mar '13

The MonetDB team at CWI/MonetDB BV is pleased to announce the Feb2013-SP1 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Feb 2013-SP1 bugfix release Bug Fixes * 3228: Python client - mapi.Connection.__getbyes should throw exception when 0 bytes received from socket * 3229: GRANT does not work for UPDATE * 3230: GRANT SELECT priveleges not set in SQL FUNCTIONs * 3233: getting a crash of server with segmentation fault on SLES 11 64 SP2 * 3235: MapiPP.pm unquote '0' as 'undef' * 3236: mclient \d produces no output * 3237: Assertion on BATgroup_internal * 3241: SEGFAULT on string processing when using optimizer.reduce()

1 0

Re: MonetDB: Feb2013 - Make MALresource independent of cntxt and mb
by Fabian Groffen 04 Mar '13

04 Mar '13

Any reason for undoing 0f30e64e9bb2? On 26-02-2013 14:52:15 +0100, Martin Kersten wrote: > Changeset: 33a1b7bfcb28 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=33a1b7bfcb28 > Modified Files: > monetdb5/mal/mal_dataflow.c > monetdb5/mal/mal_interpreter.c > monetdb5/mal/mal_resource.c > monetdb5/mal/mal_resource.h > Branch: Feb2013 > Log Message: > > Make MALresource independent of cntxt and mb > > > diffs (87 lines): > > diff --git a/monetdb5/mal/mal_dataflow.c b/monetdb5/mal/mal_dataflow.c > --- a/monetdb5/mal/mal_dataflow.c > +++ b/monetdb5/mal/mal_dataflow.c > @@ -328,13 +328,13 @@ DFLOWworker(void *t) > } > MT_lock_unset(&flow->flowlock, "MALworker"); > > + q_enqueue(flow->done, fe); > if ( fnxt == 0) { > if (todo->last == 0) > profilerHeartbeatEvent("wait"); > else > - MALresourceFairness(flow->cntxt, flow->mb, usec); > + MALresourceFairness(usec); > } > - q_enqueue(flow->done, fe); > } > GDKfree(GDKerrbuf); > GDKsetbuf(0); -- Fabian Groffen fabian(a)monetdb.org column-store pioneer http://www.monetdb.org/Home

4 6

Announcement: New Feb2013 Feature release of MonetDB suite
by Sjoerd Mullender 19 Feb '13

19 Feb '13

The MonetDB team at CWI/MonetDB BV is pleased to announce the Feb2013 feature release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Feb 2013 feature release Testing Environment * enabled "top-level" Mtest.py So far, while Mtest.py could be called in any subdirectory of the MonetDB source tree (and could then run all tests in the entire sub-tree), it was not possible to call Mtest.py in the top-level MonetDB source directory to run all tests. Instead, to run all tests, Mtest.py had to be called at least 4 times, once in each of these directories: "clients", "monetdb5", "sql", "geom". Now, it is possible to call Mtest.py once in the top-level MonetDB source directory to run all tests in one go. The behaviour of calling Mtest.py in any subdirectory, including the four mentioned above, did not changed, other than that now obsolete command line options "-p / --package <package>" and "-5 / --monetdb5" have been removed. Java Module * merocontrol was changed to return server URIs, and lastStop time. Connections and dbpath were removed. * Mapi protocol v8 support was removed from MapiSocket. Protocol v8 has not been used by the servers any more since Apr2012 release Client Package * Mapi protocol v8 support was removed from all client drivers. Protocol v8 has not been used by the servers any more since Apr2012 release * The tool mnc was removed from installations * msqldump: Implmented an option (--table/-t) to dump a single table. * Changed msqdump's trace option to be in line with mclient. In both cases, the long option is --Xdebug and the short option is -X. MonetDB5 Server * mserver5: The --dbname and --dbfarm options have been replaced by the single --dbpath option. * The scheduler of mserver5 was changed to use a fixed set of workers to perform the work for all connected clients. Previously, each client connection had its own set of workers, easily causing resource problems upon multiple connections to the server. Merovingian * Upgrade support for dbfarms from Mar2011 and Aug2011 was dropped * monetdb status now uses a more condensed output, to cater for the uris being shown, and prints how long a database is stopped, or how long ago it crashed * monetdb status now prints the connection uri for each database, when available. The connections and database path properties have been dropped. * monetdb status now prints last crash date only if the database has not been started since. Bug Fixes * 2291: small doubles end up as NULL after arithmetic * 3215: Calculation Date function using interval and year * 3033: stethoscope needs better documentation * 3084: Timestamp arithmetic very slow (especially on Windows) * 3125: Python tests fail after recent Python API changes * 3172: assertion fails on table function with subselects as parameters * 3178: one scan is enough to implement ALGstdev_@1 in monetdb5/modules/kernel/algebra.mx * 3179: LIKE: batstr.like+algebra.uselect called instead of pcre.like_filter * 3193: Expressions not supported in the GROUP BY or ORDER BY clause. * 3216: "unknown property" error setting format and width in .monetdb file * 3217: gdk_posix fails to compile under NetBSD * 3221: can no execute large statements * 3227: MT_set_lock() call on an non-initialized lock

1 0

Au sujet MonetDB
by Bouslah Ahmed 17 Feb '13

17 Feb '13

Bonsoir, Je travaille depuis peu de temps sur MonetDB et je rencontre des difficultés à comprendre le principe de fonctionnement, pour cela j'ai des questions à vous poser. 1 - Où puis-je trouver le code source; 2 - Comment le compiler; 3 - Pour information j'utilise Windows comme système d'exploitation. Merci de me répondre. Cordialement a.bouslah(a)yahoo.fr

2 2

Re: MonetDB: default - Merge with Feb2013 branch.
by Martin Kersten 14 Feb '13

14 Feb '13

Thx On 2/14/13 11:24 PM, Sjoerd Mullender wrote: > Changeset: f334ca6b1b90 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=f334ca6b1b90 > Added Files: > sql/test/Users/Tests/privs.sql.src > sql/test/Users/Tests/privs.stable.err > sql/test/Users/Tests/privs.stable.out > sql/test/Users/Tests/privs2.sql.src > sql/test/Users/Tests/privs2.stable.err > sql/test/Users/Tests/privs2.stable.out > sql/test/Users/Tests/test_privs2_p1.SQL.py > sql/test/Users/Tests/test_privs2_p1.stable.err > sql/test/Users/Tests/test_privs2_p1.stable.out > sql/test/Users/Tests/test_privs2_p2.SQL.py > sql/test/Users/Tests/test_privs2_p2.stable.err > sql/test/Users/Tests/test_privs2_p2.stable.out > sql/test/Users/Tests/test_privs_p1.SQL.py > sql/test/Users/Tests/test_privs_p1.stable.err > sql/test/Users/Tests/test_privs_p1.stable.out > sql/test/Users/Tests/test_privs_p2.SQL.py > sql/test/Users/Tests/test_privs_p2.stable.err > sql/test/Users/Tests/test_privs_p2.stable.out > sql/test/Users/privs.sql > sql/test/Users/privs2.sql > sql/test/Users/test_privs.sql > sql/test/Users/test_privs2.sql > Modified Files: > monetdb5/mal/mal_dataflow.c > monetdb5/mal/mal_interpreter.c > monetdb5/mal/mal_resource.c > sql/backends/monet5/rel_bin.c > sql/backends/monet5/sql_gencode.c > sql/backends/monet5/sql_gencode.h > sql/backends/monet5/sql_scenario.c > sql/common/sql_backend.c > sql/common/sql_backend.h > sql/server/rel_updates.c > sql/test/Users/Tests/All > Branch: default > Log Message: > > Merge with Feb2013 branch. > > > diffs (truncated from 1336 to 300 lines): > > diff --git a/sql/backends/monet5/rel_bin.c b/sql/backends/monet5/rel_bin.c > --- a/sql/backends/monet5/rel_bin.c > +++ b/sql/backends/monet5/rel_bin.c > @@ -1033,8 +1033,6 @@ rel_parse_value(mvc *m, char *query, cha > m->argc = 0; > m->sym = NULL; > m->errstr[0] = '\0'; > - /* via views we give access to protected objects */ > - m->user_id = USER_MONETDB; > > (void) sqlparse(m); /* blindly ignore errors */ > > @@ -2648,8 +2646,6 @@ sql_parse(mvc *m, sql_allocator *sa, cha > m->sym = NULL; > m->errstr[0] = '\0'; > m->errstr[ERRSIZE-1] = '\0'; > - /* via views we give access to protected objects */ > - m->user_id = USER_MONETDB; > > /* create private allocator */ > m->sa = (sa)?sa:sa_create(); > diff --git a/sql/backends/monet5/sql_gencode.c b/sql/backends/monet5/sql_gencode.c > --- a/sql/backends/monet5/sql_gencode.c > +++ b/sql/backends/monet5/sql_gencode.c > @@ -54,7 +54,8 @@ > #include <rel_bin.h> > > static int _dumpstmt(backend *sql, MalBlkPtr mb, stmt *s); > -static void backend_dumpstmt(backend *be, MalBlkPtr mb, stmt *s); > +static int backend_dumpstmt(backend *be, MalBlkPtr mb, stmt *s); > +static int backend_create_func(backend *be, sql_func *f); > > /* > * @+ MAL code support > @@ -261,7 +262,7 @@ relational_func_create_result( mvc *sql, > } > > > -static void > +static int > _create_relational_function(mvc *m, char *name, sql_rel *rel, stmt *call) > { > sql_rel *r; > @@ -314,16 +315,18 @@ _create_relational_function(mvc *m, char > } > } > > - backend_dumpstmt(be, curBlk, s); > + if (backend_dumpstmt(be, curBlk, s) < 0) > + return -1; > /* SQL function definitions meant for inlineing should not be optimized before */ > varSetProp(curBlk, getArg(curInstr, 0), sqlfunctionProp, op_eq, NULL); > addQueryToCache(c); > if (backup) > c->curprg = backup; > + return 0; > } > > /* stub and remote function */ > -static void > +static int > _create_relational_remote(mvc *m, char *name, sql_rel *rel, stmt *call, prop *prp) > { > Client c = MCgetClient(m->clientid); > @@ -346,7 +349,8 @@ _create_relational_remote(mvc *m, char * > /* dirty hack, rename (change first char of name) L->l, local > * functions name start with 'l' */ > name[0] = 'l'; > - _create_relational_function(m, name, rel, call); > + if (_create_relational_function(m, name, rel, call) < 0) > + return -1; > > /* create stub */ > name[0] = old; > @@ -462,18 +466,19 @@ _create_relational_remote(mvc *m, char * > if (backup) > c->curprg = backup; > name[0] = old; /* make sure stub is called */ > + return 0; > } > > -static void > +static int > monet5_create_relational_function(mvc *m, char *name, sql_rel *rel, stmt *call) > > { > prop *p = NULL; > > if (rel && (p = find_prop(rel->p, PROP_REMOTE)) != NULL) > - _create_relational_remote(m, name, rel, call, p); > + return _create_relational_remote(m, name, rel, call, p); > else > - _create_relational_function(m, name, rel, call); > + return _create_relational_function(m, name, rel, call); > } > > /* > @@ -663,7 +668,8 @@ dump_joinN(backend *sql, MalBlkPtr mb, s > InstrPtr q; > int op1, op2, op3 = 0; > > - backend_create_func(sql, s->op4.funcval->func); > + if (backend_create_func(sql, s->op4.funcval->func) < 0) > + return -1; > mod = sql_func_mod(s->op4.funcval->func); > fimp = sql_func_imp(s->op4.funcval->func); > > @@ -1121,7 +1127,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > node *n; > char *mod, *fimp; > > - backend_create_func(sql, s->op4.funcval->func); > + if (backend_create_func(sql, s->op4.funcval->func) < 0) > + return -1; > mod = sql_func_mod(s->op4.funcval->func); > fimp = sql_func_imp(s->op4.funcval->func); > > @@ -1632,7 +1639,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > char *mod, *fimp; > int l = _dumpstmt(sql, mb, s->op1); > > - backend_create_func(sql, s->op4.funcval->func); > + if (backend_create_func(sql, s->op4.funcval->func) < 0) > + return -1; > mod = sql_func_mod(s->op4.funcval->func); > fimp = sql_func_imp(s->op4.funcval->func); > if (s->op1->nrcols && strcmp(fimp, "not_uniques") == 0) { > @@ -1666,7 +1674,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > int l = _dumpstmt(sql, mb, s->op1); > int r = _dumpstmt(sql, mb, s->op2); > > - backend_create_func(sql, s->op4.funcval->func); > + if (backend_create_func(sql, s->op4.funcval->func) < 0) > + return -1; > mod = sql_func_mod(s->op4.funcval->func); > fimp = sql_func_imp(s->op4.funcval->func); > > @@ -1713,7 +1722,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > /* dump operands */ > _dumpstmt(sql, mb, s->op1); > > - backend_create_func(sql, f->func); > + if (backend_create_func(sql, f->func) < 0) > + return -1; > mod = sql_func_mod(f->func); > fimp = sql_func_imp(f->func); > if (s->nrcols) { > @@ -1769,7 +1779,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > /* dump args */ > if (s->op1) > _dumpstmt(sql, mb, s->op1); > - monet5_create_relational_function(sql->mvc, fimp, rel, s); > + if (monet5_create_relational_function(sql->mvc, fimp, rel, s) < 0) > + return -1; > > q = newStmt(mb, mod, fimp); > q = relational_func_create_result(sql->mvc, mb, q, rel); > @@ -1791,7 +1802,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > int restype = s->op4.aggrval->res.type->localtype; > int complex_aggr = 0; > > - backend_create_func(sql, s->op4.aggrval->aggr); > + if (backend_create_func(sql, s->op4.aggrval->aggr) < 0) > + return -1; > mod = s->op4.aggrval->aggr->mod; > aggrfunc = s->op4.aggrval->aggr->imp; > > @@ -2242,7 +2254,8 @@ static void setCommitProperty(MalBlkPtr > varSetProperty(mb, getArg(getInstrPtr(mb,0),0), "autoCommit","=", &cst); > } > > -static void backend_dumpstmt(backend *be, MalBlkPtr mb, stmt *s) > +static int > +backend_dumpstmt(backend *be, MalBlkPtr mb, stmt *s) > { > mvc *c = be->mvc; > stmt **stmts = stmt_array(c->sa, s); > @@ -2259,9 +2272,11 @@ static void backend_dumpstmt(backend *be > clear_stmts(stmts); > while(stmts[nr]) { > stmt *s = stmts[nr++]; > - (void)_dumpstmt(be, mb, s); > + if (_dumpstmt(be, mb, s) < 0) > + return -1; > } > - (void)_dumpstmt(be, mb, s); > + if (_dumpstmt(be, mb, s) < 0) > + return -1; > > be->mvc_var = old_mv; > if (c->caching && (c->type == Q_SCHEMA || c->type == Q_TRANS)) { > @@ -2276,9 +2291,10 @@ static void backend_dumpstmt(backend *be > q->barrier = RETURNsymbol; > } > pushEndInstruction(mb); > + return 0; > } > > -void > +int > backend_callinline(backend *be, Client c, stmt *s ) > { > mvc *m = be->mvc; > @@ -2312,8 +2328,10 @@ backend_callinline(backend *be, Client c > } > } > } > - backend_dumpstmt(be, curBlk, s); > + if (backend_dumpstmt(be, curBlk, s) < 0) > + return -1; > c->curprg->def = curBlk; > + return 0; > } > > Symbol > @@ -2336,8 +2354,9 @@ backend_dumpproc(backend *be, Client c, > sql_subfunc *cq = sql_find_func(m->sa, sys, "keepcall", NR_KEEPCALL_ARGS, F_PROC); > > assert(kq && cq); > - backend_create_func(be, kq->func); > - backend_create_func(be, cq->func); > + if (backend_create_func(be, kq->func) < 0 || > + backend_create_func(be, cq->func) < 0) > + return NULL; > /* only needed once */ > m->history = 2; > } > @@ -2383,7 +2402,8 @@ backend_dumpproc(backend *be, Client c, > } > } > > - backend_dumpstmt(be, mb, s); > + if (backend_dumpstmt(be, mb, s) < 0) > + return NULL; > Toptimize = GDKusec(); > Tparse = Toptimize - m->Tparse; > > @@ -2460,53 +2480,6 @@ backend_call(backend *be, Client c, cq * > } > } > > -void > -monet5_create_table_function(ptr M, char *name, sql_rel *rel, sql_table *t) > -{ > - sql_rel *r; > - mvc *m = (mvc*)M; > - Client c = MCgetClient(m->clientid); > - backend *be = (backend *) c->sqlcontext; > - MalBlkPtr curBlk = 0; > - InstrPtr curInstr = 0; > - Symbol backup = NULL; > - stmt *s; > - > - (void)t; > - r = rel_optimizer(m, rel); > - s = rel_bin(m, r); > - > - if (s->type == st_list && s->nrcols == 0 && s->key) { > - /* row to columns */ > - node *n; > - list *l = sa_list(m->sa); > - > - for(n=s->op4.lval->h; n; n = n->next) > - list_append(l, const_column(m->sa, n->data)); > - s = stmt_list(m->sa, l); > - } > - s = stmt_table(m->sa, s, 1); > - s = stmt_return(m->sa, s, 0); > - > - backup = c->curprg; > - c->curprg = newFunction(userRef,putName(name,strlen(name)), FUNCTIONsymbol); > - > - curBlk = c->curprg->def; > - curInstr = getInstrPtr(curBlk, 0); > - > - curInstr = table_func_create_result(curBlk, curInstr, t); > - setVarUDFtype(curBlk,0); > - > - /* no ops */ > - > - backend_dumpstmt(be, curBlk, s); > - /* SQL function definitions meant for inlineing should not be optimized before */ > - varSetProp(curBlk, getArg(curInstr, 0), sqlfunctionProp, op_eq, NULL); > - addQueryToCache(c); > - if (backup) > - c->curprg = backup; > -} > - > int > monet5_resolve_function(ptr M, sql_func *f) > { > @@ -2549,7 +2522,7 @@ monet5_resolve_function(ptr M, sql_func > } > > /* TODO handle aggr */ > -void > +static int > backend_create_func(backend *be, sql_func *f) > { > mvc *m = be->mvc; > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list >

1 0

Re: MonetDB: Feb2013 - fixes and test added for bug 3230
by Stefan Manegold 13 Feb '13

13 Feb '13

Niels, could you please also check in the missing file sql/test/Users/privs2.sql Thanks! Stefan On Wed, Feb 13, 2013 at 04:00:35PM +0100, Niels Nes wrote: > Changeset: fffd420f1ee8 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=fffd420f1ee8 > Added Files: > sql/test/Users/Tests/privs2.sql.src > sql/test/Users/Tests/privs2.stable.err > sql/test/Users/Tests/privs2.stable.out > sql/test/Users/Tests/test_privs2_p1.SQL.py > sql/test/Users/Tests/test_privs2_p1.stable.err > sql/test/Users/Tests/test_privs2_p1.stable.out > sql/test/Users/Tests/test_privs2_p2.SQL.py > sql/test/Users/Tests/test_privs2_p2.stable.err > sql/test/Users/Tests/test_privs2_p2.stable.out > Modified Files: > sql/backends/monet5/rel_bin.c > sql/backends/monet5/sql_gencode.c > sql/backends/monet5/sql_gencode.h > sql/backends/monet5/sql_scenario.c > sql/common/sql_backend.c > sql/common/sql_backend.h > sql/test/Users/Tests/All > Branch: Feb2013 > Log Message: > > fixes and test added for bug 3230 > > > diffs (truncated from 901 to 300 lines): > > diff --git a/sql/backends/monet5/rel_bin.c b/sql/backends/monet5/rel_bin.c > --- a/sql/backends/monet5/rel_bin.c > +++ b/sql/backends/monet5/rel_bin.c > @@ -1124,8 +1124,6 @@ rel_parse_value(mvc *m, char *query, cha > m->argc = 0; > m->sym = NULL; > m->errstr[0] = '\0'; > - /* via views we give access to protected objects */ > - m->user_id = USER_MONETDB; > > (void) sqlparse(m); /* blindly ignore errors */ > > @@ -2741,8 +2739,6 @@ sql_parse(mvc *m, sql_allocator *sa, cha > m->sym = NULL; > m->errstr[0] = '\0'; > m->errstr[ERRSIZE-1] = '\0'; > - /* via views we give access to protected objects */ > - m->user_id = USER_MONETDB; > > /* create private allocator */ > m->sa = (sa)?sa:sa_create(); > diff --git a/sql/backends/monet5/sql_gencode.c b/sql/backends/monet5/sql_gencode.c > --- a/sql/backends/monet5/sql_gencode.c > +++ b/sql/backends/monet5/sql_gencode.c > @@ -54,7 +54,8 @@ > #include <rel_bin.h> > > static int _dumpstmt(backend *sql, MalBlkPtr mb, stmt *s); > -static void backend_dumpstmt(backend *be, MalBlkPtr mb, stmt *s); > +static int backend_dumpstmt(backend *be, MalBlkPtr mb, stmt *s); > +static int backend_create_func(backend *be, sql_func *f); > > /* > * @+ MAL code support > @@ -261,7 +262,7 @@ relational_func_create_result( mvc *sql, > } > > > -static void > +static int > _create_relational_function(mvc *m, char *name, sql_rel *rel, stmt *call) > { > sql_rel *r; > @@ -314,16 +315,18 @@ _create_relational_function(mvc *m, char > } > } > > - backend_dumpstmt(be, curBlk, s); > + if (backend_dumpstmt(be, curBlk, s) < 0) > + return -1; > /* SQL function definitions meant for inlineing should not be optimized before */ > varSetProp(curBlk, getArg(curInstr, 0), sqlfunctionProp, op_eq, NULL); > addQueryToCache(c); > if (backup) > c->curprg = backup; > + return 0; > } > > /* stub and remote function */ > -static void > +static int > _create_relational_remote(mvc *m, char *name, sql_rel *rel, stmt *call, prop *prp) > { > Client c = MCgetClient(m->clientid); > @@ -346,7 +349,8 @@ _create_relational_remote(mvc *m, char * > /* dirty hack, rename (change first char of name) L->l, local > * functions name start with 'l' */ > name[0] = 'l'; > - _create_relational_function(m, name, rel, call); > + if (_create_relational_function(m, name, rel, call) < 0) > + return -1; > > /* create stub */ > name[0] = old; > @@ -462,18 +466,19 @@ _create_relational_remote(mvc *m, char * > if (backup) > c->curprg = backup; > name[0] = old; /* make sure stub is called */ > + return 0; > } > > -static void > +static int > monet5_create_relational_function(mvc *m, char *name, sql_rel *rel, stmt *call) > > { > prop *p = NULL; > > if (rel && (p = find_prop(rel->p, PROP_REMOTE)) != NULL) > - _create_relational_remote(m, name, rel, call, p); > + return _create_relational_remote(m, name, rel, call, p); > else > - _create_relational_function(m, name, rel, call); > + return _create_relational_function(m, name, rel, call); > } > > /* > @@ -663,7 +668,8 @@ dump_joinN(backend *sql, MalBlkPtr mb, s > InstrPtr q; > int op1, op2, op3 = 0; > > - backend_create_func(sql, s->op4.funcval->func); > + if (backend_create_func(sql, s->op4.funcval->func) < 0) > + return -1; > mod = sql_func_mod(s->op4.funcval->func); > fimp = sql_func_imp(s->op4.funcval->func); > > @@ -1121,7 +1127,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > node *n; > char *mod, *fimp; > > - backend_create_func(sql, s->op4.funcval->func); > + if (backend_create_func(sql, s->op4.funcval->func) < 0) > + return -1; > mod = sql_func_mod(s->op4.funcval->func); > fimp = sql_func_imp(s->op4.funcval->func); > > @@ -1632,7 +1639,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > char *mod, *fimp; > int l = _dumpstmt(sql, mb, s->op1); > > - backend_create_func(sql, s->op4.funcval->func); > + if (backend_create_func(sql, s->op4.funcval->func) < 0) > + return -1; > mod = sql_func_mod(s->op4.funcval->func); > fimp = sql_func_imp(s->op4.funcval->func); > if (s->op1->nrcols && strcmp(fimp, "not_uniques") == 0) { > @@ -1666,7 +1674,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > int l = _dumpstmt(sql, mb, s->op1); > int r = _dumpstmt(sql, mb, s->op2); > > - backend_create_func(sql, s->op4.funcval->func); > + if (backend_create_func(sql, s->op4.funcval->func) < 0) > + return -1; > mod = sql_func_mod(s->op4.funcval->func); > fimp = sql_func_imp(s->op4.funcval->func); > > @@ -1713,7 +1722,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > /* dump operands */ > _dumpstmt(sql, mb, s->op1); > > - backend_create_func(sql, f->func); > + if (backend_create_func(sql, f->func) < 0) > + return -1; > mod = sql_func_mod(f->func); > fimp = sql_func_imp(f->func); > if (s->nrcols) { > @@ -1769,7 +1779,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > /* dump args */ > if (s->op1) > _dumpstmt(sql, mb, s->op1); > - monet5_create_relational_function(sql->mvc, fimp, rel, s); > + if (monet5_create_relational_function(sql->mvc, fimp, rel, s) < 0) > + return -1; > > q = newStmt(mb, mod, fimp); > q = relational_func_create_result(sql->mvc, mb, q, rel); > @@ -1791,7 +1802,8 @@ _dumpstmt(backend *sql, MalBlkPtr mb, st > int restype = s->op4.aggrval->res.type->localtype; > int sum_or_prod = 0; > > - backend_create_func(sql, s->op4.aggrval->aggr); > + if (backend_create_func(sql, s->op4.aggrval->aggr) < 0) > + return -1; > mod = s->op4.aggrval->aggr->mod; > aggrfunc = s->op4.aggrval->aggr->imp; > > @@ -2241,7 +2253,8 @@ static void setCommitProperty(MalBlkPtr > varSetProperty(mb, getArg(getInstrPtr(mb,0),0), "autoCommit","=", &cst); > } > > -static void backend_dumpstmt(backend *be, MalBlkPtr mb, stmt *s) > +static int > +backend_dumpstmt(backend *be, MalBlkPtr mb, stmt *s) > { > mvc *c = be->mvc; > stmt **stmts = stmt_array(c->sa, s); > @@ -2258,9 +2271,11 @@ static void backend_dumpstmt(backend *be > clear_stmts(stmts); > while(stmts[nr]) { > stmt *s = stmts[nr++]; > - (void)_dumpstmt(be, mb, s); > + if (_dumpstmt(be, mb, s) < 0) > + return -1; > } > - (void)_dumpstmt(be, mb, s); > + if (_dumpstmt(be, mb, s) < 0) > + return -1; > > be->mvc_var = old_mv; > if (c->caching && (c->type == Q_SCHEMA || c->type == Q_TRANS)) { > @@ -2275,9 +2290,10 @@ static void backend_dumpstmt(backend *be > q->barrier = RETURNsymbol; > } > pushEndInstruction(mb); > + return 0; > } > > -void > +int > backend_callinline(backend *be, Client c, stmt *s ) > { > mvc *m = be->mvc; > @@ -2311,8 +2327,10 @@ backend_callinline(backend *be, Client c > } > } > } > - backend_dumpstmt(be, curBlk, s); > + if (backend_dumpstmt(be, curBlk, s) < 0) > + return -1; > c->curprg->def = curBlk; > + return 0; > } > > Symbol > @@ -2335,8 +2353,9 @@ backend_dumpproc(backend *be, Client c, > sql_subfunc *cq = sql_find_func(m->sa, sys, "keepcall", NR_KEEPCALL_ARGS, F_PROC); > > assert(kq && cq); > - backend_create_func(be, kq->func); > - backend_create_func(be, cq->func); > + if (backend_create_func(be, kq->func) < 0 || > + backend_create_func(be, cq->func) < 0) > + return NULL; > /* only needed once */ > m->history = 2; > } > @@ -2382,7 +2401,8 @@ backend_dumpproc(backend *be, Client c, > } > } > > - backend_dumpstmt(be, mb, s); > + if (backend_dumpstmt(be, mb, s) < 0) > + return NULL; > Toptimize = GDKusec(); > Tparse = Toptimize - m->Tparse; > > @@ -2459,53 +2479,6 @@ backend_call(backend *be, Client c, cq * > } > } > > -void > -monet5_create_table_function(ptr M, char *name, sql_rel *rel, sql_table *t) > -{ > - sql_rel *r; > - mvc *m = (mvc*)M; > - Client c = MCgetClient(m->clientid); > - backend *be = (backend *) c->sqlcontext; > - MalBlkPtr curBlk = 0; > - InstrPtr curInstr = 0; > - Symbol backup = NULL; > - stmt *s; > - > - (void)t; > - r = rel_optimizer(m, rel); > - s = rel_bin(m, r); > - > - if (s->type == st_list && s->nrcols == 0 && s->key) { > - /* row to columns */ > - node *n; > - list *l = sa_list(m->sa); > - > - for(n=s->op4.lval->h; n; n = n->next) > - list_append(l, const_column(m->sa, n->data)); > - s = stmt_list(m->sa, l); > - } > - s = stmt_table(m->sa, s, 1); > - s = stmt_return(m->sa, s, 0); > - > - backup = c->curprg; > - c->curprg = newFunction(userRef,putName(name,strlen(name)), FUNCTIONsymbol); > - > - curBlk = c->curprg->def; > - curInstr = getInstrPtr(curBlk, 0); > - > - curInstr = table_func_create_result(curBlk, curInstr, t); > - setVarUDFtype(curBlk,0); > - > - /* no ops */ > - > - backend_dumpstmt(be, curBlk, s); > - /* SQL function definitions meant for inlineing should not be optimized before */ > - varSetProp(curBlk, getArg(curInstr, 0), sqlfunctionProp, op_eq, NULL); > - addQueryToCache(c); > - if (backup) > - c->curprg = backup; > -} > - > int > monet5_resolve_function(ptr M, sql_func *f) > { > @@ -2548,7 +2521,7 @@ monet5_resolve_function(ptr M, sql_func > } > > /* TODO handle aggr */ > -void > +static int > backend_create_func(backend *be, sql_func *f) > { > mvc *m = be->mvc; > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list -- | Stefan.Manegold(a)CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

1 0

Coercions optimizer name bug
by Pete Hollobon 12 Feb '13

12 Feb '13

Hi, The name of the coercions optimizer in the codes array in opt_wrapper.c is wrong (currently it's "coercion"), and so it is never run. This patch fixes: diff -r 6e9b305e92e2 monetdb5/optimizer/opt_wrapper.c --- a/monetdb5/optimizer/opt_wrapper.c Sun Feb 10 17:39:23 2013 +0100 +++ b/monetdb5/optimizer/opt_wrapper.c Tue Feb 12 11:33:20 2013 +0000 @@ -84,7 +84,7 @@ {"aliases", &OPTaliasesImplementation}, {"centipede", &OPTcentipedeImplementation}, {"cluster", &OPTclusterImplementation}, - {"coercion", &OPTcoercionImplementation}, + {"coercions", &OPTcoercionImplementation}, {"commonTerms", &OPTcommonTermsImplementation}, {"compression", &OPTcompressionImplementation}, {"costModel", &OPTcostModelImplementation}, Regards, Pete

1 0

No mclient prompt. Connection hangs.
by Tapomay Dey 06 Feb '13

06 Feb '13

I have started facing issues when trying to connect to the DB using mclient remotely/locally. All my services have started failing as the DB is no longer responding(using JDBC). There is hardly any load on the DB - no memory/cpu usage. Although the monetdb status shows a health of only 47%(What does this mean?) When I do a sockstat on the merovingian I can see the client's socket. But when I sockstat on the mserver5 process I don't see that. (FYI- when I am able to connect using mclient I see this socket in mserver's sockstat instead of monetdbd) I do get the mclient prompt sometimes with full functionality. But most of the times it just gets stuck and the prompt never occurs. Any more diagnostics that I can perform to resolve this? When I ctrl+c on the mclient the mclient process stops but socket stays in ESTABLISHED state on server. Verified it by comparign port no. before and after killing mclient and making sure no one else is connected. Regards, Tapomay.

1 1