- developers-list - monetdb.org

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/rdf rdf_shredder.mx, Feb2010, 1.13, 1.13.2.1
by Lefteris 22 Feb '10

22 Feb '10

the tokenizer has been removed from the Makefile.ag of the stable branch, and this #include can be deleted all the way. I have said many times that none of this code is ready for stable branches and yes they should have never been propagate to the stable. We haven't announced any MonetDB/RDF module official so it should not be used by any user. For me the #if 0 is not a problem On Mon, Feb 22, 2010 at 4:46 PM, Fabian Groffen <Fabian.Groffen(a)cwi.nl> wrote: > On 22-02-2010 15:43:44 +0000, Lefteris Sidirourgos wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/rdf >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv32552/src/modules/mal/rdf >> >> Modified Files: >> Tag: Feb2010 >> rdf_shredder.mx >> Log Message: >> disable the tokenizer.mx from m5 > > Dunno if this was/is discussed, but isn't it a much cleaner solution to > just remove it from the code base in this branch, and keep it as is in > the HEAD (e.g. request to prevent propagation?). The 'if 0's and > commented out code look a bit messy. > > >> Index: rdf_shredder.mx >> =================================================================== >> RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/rdf/rdf_shredder.mx,v >> retrieving revision 1.13 >> retrieving revision 1.13.2.1 >> diff -u -d -r1.13 -r1.13.2.1 >> --- rdf_shredder.mx 8 Jan 2010 12:08:58 -0000 1.13 >> +++ rdf_shredder.mx 22 Feb 2010 15:43:41 -0000 1.13.2.1 >> @@ -27,7 +27,9 @@ >> #include "url.h" >> #include "rdf.h" >> #include "raptor.h" >> +#if 0 >> #include "../tokenizer.h" >> +#endif > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel calc.mx, Feb2010, 1.96, 1.96.2.1
by Stefan Manegold 21 Feb '10

21 Feb '10

On Sun, Feb 21, 2010 at 08:41:08AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv5630 > > Modified Files: > Tag: Feb2010 > calc.mx > Log Message: > The semantics assumed overflow to produce nil-values, not an exception. Is this in line with SQL semantic (requirements)? AFAIK, SQL standard requires to report under-/overflows during casts as execption/errors. Moreover, our SQL compiler/front-end cannot (easily) destinguish between NULL (NIL) values that have been in the input and NULL (NIL) values that are added to the result of a cast to indicate under-/overflows. This might have been the reason why this execption was added by Niels ... Just my €0.02 (or less) Stefan > > Index: calc.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/calc.mx,v > retrieving revision 1.96 > retrieving revision 1.96.2.1 > diff -u -d -r1.96 -r1.96.2.1 > --- calc.mx 10 Jan 2010 15:30:59 -0000 1.96 > +++ calc.mx 21 Feb 2010 08:41:02 -0000 1.96.2.1 > @@ -1273,8 +1273,10 @@ > { > if (*a == @2_nil @3) { > *res= @1_nil; > +/* obey semantics above, don't check for information loss > if (*a != @2_nil) > throw(MAL, "calc.@1", ARGUMENT_TOO_LARGE); > +*/ > } else { > *res= @4; > } > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer/Tests All, Feb2010, 1.79, 1.79.2.1
by Stefan Manegold 21 Feb '10

21 Feb '10

On Sun, Feb 21, 2010 at 08:41:49AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer/Tests > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv5697 > > Modified Files: > Tag: Feb2010 > All > Log Message: > Datacyclotron testing is not for this release. prevented propagations > > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/Tests/All,v > retrieving revision 1.79 > retrieving revision 1.79.2.1 > diff -u -d -r1.79 -r1.79.2.1 > --- All 10 Jan 2010 19:14:21 -0000 1.79 > +++ All 21 Feb 2010 08:41:47 -0000 1.79.2.1 > @@ -39,7 +39,7 @@ > reorder00 > reorder01 > > -cycloon00 > +#cycloon00 > #mat00 > #mat01 > #mat02 > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_posix.mx, Feb2010, 1.176.2.24, 1.176.2.25 gdk_storage.mx, Feb2010, 1.149.2.36, 1.149.2.37
by Stefan Manegold 19 Feb '10

19 Feb '10

On Fri, Feb 19, 2010 at 03:40:10PM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv10221 > > Modified Files: > Tag: Feb2010 > gdk_posix.mx gdk_storage.mx > Log Message: > - fix newly introduced bug (BUF_SEQUENTIAL passed to posix_madvise iso MMAP_SEQUENTIAL) > most of this was done by Stefan, but the intent of the code was when all users > are gone, to give uniform (sequential) advise to the whole heap > - make sure the length of advise is page aligned (not strictly needed for > Linux, but maybe of other Un*ces) > - in case of shared vheaps (as done by leftfetchjoin into a string bat), assume that > access to the string heap will be random. shouldn't len & ~MT_pagesize() then rather be len & ~(MT_pagesize()-1) (assuming pages size is usually a power of 2) ? Stefan > > > Index: gdk_storage.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_storage.mx,v > retrieving revision 1.149.2.36 > retrieving revision 1.149.2.37 > diff -u -d -r1.149.2.36 -r1.149.2.37 > --- gdk_storage.mx 19 Feb 2010 13:13:38 -0000 1.149.2.36 > +++ gdk_storage.mx 19 Feb 2010 15:40:07 -0000 1.149.2.37 > @@ -707,17 +707,19 @@ > * Peter Feb2010: I tried to do prefetches further apart, to trigger multiple readahead > * units in parallel, but it does improve performance visibly > */ > -static size_t access_heap(str id, str hp, Heap *h, char* base, size_t sz, int touch, int preload, int advise) { > +static size_t access_heap(str id, str hp, Heap *h, char* base, size_t sz, int touch, int preload, int adv) { > size_t v0 = 0, v1 = 0, v2 = 0, v3 = 0, v4 = 0, v5 =0, v6 = 0, v7 = 0, page = MT_pagesize(); > + str advise = (adv==MMAP_WILLNEED)?"WILLNEED":(adv==MMAP_SEQUENTIAL)?"SEQUENTIAL":(adv==MMAP_RANDOM)?"RANDOM":(adv==MMAP_NORMAL)?"NORMAL":NULL; > int t = GDKms(); > + assert(advise); > if (h->storage != STORE_MEM && h->size > MT_MMAP_TILE) { > - MT_mmap_inform(h->base, h->size, preload, advise, 0); > + MT_mmap_inform(h->base, h->size, preload, adv, 0); > if (preload > 0) { > - void* alignedbase = (void*) (((size_t) base) & ~(page-1)); > - size_t alignedsz = (sz + (page-1)) & ~(page-1); > - int ret = posix_madvise(alignedbase, sz, advise); > - if (ret) THRprintf(GDKerr, "#MT_mmap_inform: posix_madvise(file=%s, base="PTRFMT", len="SZFMT"MB, advice=%d) = %d\n", > - h->filename, PTRFMTCAST alignedbase, alignedsz >> 20, advise, errno); > + size_t alignskip = (page - (((size_t) base) & (page-1))) & (page-1); > + size_t alignedsz = (size_t) (((sz < alignskip)?0:((size_t) (sz-alignskip))) & ~(page-1)); > + int ret = posix_madvise(base + alignskip, alignedsz, adv); > + if (ret) THRprintf(GDKerr, "#MT_mmap_inform: posix_madvise(file=%s, base="PTRFMT", len="SZFMT"MB, advice=%s) = %d\n", > + h->filename, PTRFMTCAST (base + alignskip), alignedsz >> 20, advise, errno); > } > } > if (touch && preload > 0) { > @@ -731,8 +733,7 @@ > } > for (hi += 7*page; lo <= hi; lo +=page) v0 += *lo; > } > - IODEBUG THRprintf(GDKout,"#BATpreload(%s->%s,preload=%d,sz=%dMB,%s) = %dms \n", id, hp, preload, (int) (sz>>20), > - (advise==MMAP_WILLNEED)?"WILLNEED":(advise==MMAP_SEQUENTIAL)?"SEQUENTIAL":"UNKNOWN", GDKms()-t); > + IODEBUG THRprintf(GDKout,"#BATpreload(%s->%s,preload=%d,sz=%dMB,%s) = %dms \n", id, hp, preload, (int) (sz>>20), advise, GDKms()-t); > return v0+v1+v2+v3+v4+v5+v6+v7; > } > > @@ -743,7 +744,6 @@ > str id = BATgetId(b); > BATiter bi = bat_iterator(b); > > - assert(advise==MMAP_NORMAL||advise==MMAP_RANDOM||advise==MMAP_SEQUENTIAL||advise==MMAP_WILLNEED||advise==MMAP_DONTNEED); > if (BATcount(b) == 0) return 0; > > /* HASH indices (inherent random access). handle first as they *will* be access randomly (one can always hope for locality on the other heaps) */ > @@ -760,30 +760,46 @@ > gdk_unset_lock(GDKhashLock(ABS(b->batCacheid) & BBP_BATMASK), "BATaccess"); > } > > - /* we only touch stuff that is going to be read randomly (WILLNEED). Note varheaps are sequential wrt to the references, or small */ > - if ( what&USE_HEAD) { > + /* vheaps next, as shared vheaps are not seq-correlated needing WILLNEED (use prefetch budget for this first) */ > + if ( what&USE_HEAD ) { > + if (b->H->vheap && b->H->vheap->base) { > + char *lo = BUNhead(bi, BUNfirst(b)), *hi = BUNhead(bi, BUNlast(b)-1); > + int heap_advise = advise; > + if (b->H->vheap->copied) { /* shared string heaps are not (likely) to be sequentially correlated */ > + lo = b->H->vheap->base; hi = lo + b->H->vheap->free; > + heap_advise = MADV_WILLNEED; > + } > + budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > + v += access_heap(id, "hheap", b->H->vheap, lo, sz, (advise == BUF_WILLNEED), preload, heap_advise); > + } > + } > + if ( what&USE_TAIL ) { > + if (b->T->vheap && b->T->vheap->base) { > + char *lo = BUNtail(bi, BUNfirst(b)), *hi = BUNtail(bi, BUNlast(b)-1); > + int heap_advise = advise; > + if (b->T->vheap->copied) { /* shared string heaps are not (likely) to be sequentially correlated */ > + lo = b->T->vheap->base; hi = lo + b->T->vheap->free; > + heap_advise = MADV_WILLNEED; > + } > + budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > + v += access_heap(id, "theap", b->T->vheap, lo, sz, (advise == BUF_WILLNEED), preload, heap_advise); > + } > + } > + > + /* BUN heaps are last in line for prefetch budget */ > + if ( what&USE_HEAD ) { > if (b->H->heap.base) { > char *lo = BUNhloc(bi, BUNfirst(b)), *hi = BUNhloc(bi, BUNlast(b)-1); > budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > v += access_heap(id, "hbuns", &b->H->heap, lo, sz, (advise == MMAP_WILLNEED), preload, advise); > } > - if (b->H->vheap && b->H->vheap->base) { > - char *lo = BUNhead(bi, BUNfirst(b)), *hi = BUNhead(bi, BUNlast(b)-1); > - budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > - v += access_heap(id, "hheap", b->H->vheap, lo, sz, (advise == MMAP_WILLNEED), preload, advise); > - } > } > - if ( what&USE_TAIL) { > + if ( what&USE_TAIL ) { > if (b->T->heap.base) { > char *lo = BUNtloc(bi, BUNfirst(b)), *hi = BUNtloc(bi, BUNlast(b)-1); > budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > v += access_heap(id, "tbuns", &b->T->heap, lo, sz, (advise == MMAP_WILLNEED), preload, advise); > } > - if (b->T->vheap && b->T->vheap->base) { > - char *lo = BUNtail(bi, BUNfirst(b)), *hi = BUNtail(bi, BUNlast(b)-1); > - budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > - v += access_heap(id, "theap", b->T->vheap, lo, sz, (advise == MMAP_WILLNEED), preload, advise); > - } > } > return v; > } > > Index: gdk_posix.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_posix.mx,v > retrieving revision 1.176.2.24 > retrieving revision 1.176.2.25 > diff -u -d -r1.176.2.24 -r1.176.2.25 > --- gdk_posix.mx 19 Feb 2010 13:13:38 -0000 1.176.2.24 > +++ gdk_posix.mx 19 Feb 2010 15:40:07 -0000 1.176.2.25 > @@ -675,7 +675,7 @@ > #ifdef HAVE_POSIX_FADVISE > if (!do_not_use_posix_fadvise && MT_mmap_tab[victim].fd >= 0) { > /* tell the OS quite clearly that you want to drop this */ > - ret = posix_fadvise(MT_mmap_tab[victim].fd, 0LL, MT_mmap_tab[victim].len, POSIX_FADV_DONTNEED); > + ret = posix_fadvise(MT_mmap_tab[victim].fd, 0LL, MT_mmap_tab[victim].len & ~MT_pagesize(), POSIX_FADV_DONTNEED); > #ifdef MMAP_DEBUG > stream_printf(GDKerr, "#MT_mmap_del: posix_fadvise(%s,fd=%d,%uMB,POSIX_FADV_DONTNEED) = %d\n", MT_mmap_tab[victim].path, MT_mmap_tab[victim].fd, (unsigned int) (MT_mmap_tab[victim].len >> 20), ret); > #endif > @@ -709,7 +709,7 @@ > i = MT_mmap_idx(base, len); > if (i >= 0) { > if (MT_mmap_tab[i].fd >= 0) { > - ret = posix_fadvise(MT_mmap_tab[i].fd, 0, len, advice); > + ret = posix_fadvise(MT_mmap_tab[i].fd, 0, len & ~MT_pagesize(), advice); > #ifdef MMAP_DEBUG > stream_printf(GDKerr, "#MT_fadvise: posix_fadvise(%s,fd=%d,%uMB,%d) = %d\n", MT_mmap_tab[i].path, MT_mmap_tab[i].fd, (unsigned int) (len >> 20), advice, ret); > #endif > @@ -733,7 +733,7 @@ > { > size_t len = MIN((size_t) MT_MMAP_TILE, MT_mmap_tab[i].len - off); > /* tell Linux to please stop caching this stuff */ > - int ret = posix_madvise(MT_mmap_tab[i].base + off, len, POSIX_MADV_DONTNEED); > + int ret = posix_madvise(MT_mmap_tab[i].base + off, len & ~MT_pagesize(), POSIX_MADV_DONTNEED); > > if (err) { > stream_printf(err, "#MT_mmap_unload_tile: posix_madvise(%s,off=%uMB,%uMB,fd=%d,POSIX_MADV_DONTNEED) = %d\n", > @@ -743,7 +743,7 @@ > #ifdef HAVE_POSIX_FADVISE > if (!do_not_use_posix_fadvise) { > /* tell the OS quite clearly that you want to drop this */ > - ret = posix_fadvise(MT_mmap_tab[i].fd, off, len, POSIX_FADV_DONTNEED); > + ret = posix_fadvise(MT_mmap_tab[i].fd, off, len & ~MT_pagesize(), POSIX_FADV_DONTNEED); > if (err) { > stream_printf(err, "#MT_mmap_unload_tile: posix_fadvise(%s,off=%uMB,%uMB,fd=%d,POSIX_MADV_DONTNEED) = %d\n", > MT_mmap_tab[i].path, (unsigned int) (off >> 20), > @@ -908,10 +908,9 @@ > MT_mmap_tab[i].random += preload * (advise == MMAP_WILLNEED); /* done as a counter to keep track of multiple threads */ > MT_mmap_tab[i].usecnt += preload; /* active thread count */ > unload = MT_mmap_tab[i].usecnt == 0; > + if (unload) ret = posix_madvise(MT_mmap_tab[i].base, MT_mmap_tab[i].len & ~MT_pagesize(), MMAP_SEQUENTIAL); > } > (void) pthread_mutex_unlock(&MT_mmap_lock); > - if (unload) > - ret = posix_madvise(base, len, MMAP_SEQUENTIAL); > if (ret) { > stream_printf(GDKerr, "#MT_mmap_inform: posix_madvise(file=%s, fd=%d, base="PTRFMT", len="SZFMT"MB, advice=%d) = %d\n", > (i >= 0 ? MT_mmap_tab[i].path : ""), (i >= 0 ? MT_mmap_tab[i].fd : -1), > @@ -1156,7 +1155,7 @@ > > if (ret != (void *) -1L) { > if (hdl->mode & MMAP_ADVISE) { > - (void) MT_madvise(ret, len, hdl->mode & MMAP_ADVISE); > + (void) MT_madvise(ret, len & ~MT_pagesize(), hdl->mode & MMAP_ADVISE); > } > hdl->fixed = (void *) ((char *) ret + len); > } > @@ -1199,7 +1198,7 @@ > int > MT_madvise(void *p, size_t len, int advise) > { > - int ret = posix_madvise(p, len, advise); > + int ret = posix_madvise(p, len & ~MT_pagesize(), advise); > > #ifdef MMAP_DEBUG > stream_printf(GDKerr, "#posix_madvise(" PTRFMT "," SZFMT ",%d) = %d\n", PTRFMTCAST p, len, advise, ret); > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime shredder.mx, Feb2010, 1.162, 1.162.2.1
by Jan Rittinger 19 Feb '10

19 Feb '10

Hi Sjoerd, as far as I can remember we only use the DTD to resolve entities and id references. So if no DTD is available an error is triggered, but the document is still imported. Just my two cents... Jan On Feb 18, 2010, at 10:50, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv30011 > > Modified Files: > Tag: Feb2010 > shredder.mx > Log Message: > If there is no DTD, I guess there is not much point continuing. > Found by Coverity. > > > Index: shredder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/shredder.mx,v > retrieving revision 1.162 > retrieving revision 1.162.2.1 > diff -u -d -r1.162 -r1.162.2.1 > --- shredder.mx 7 Jan 2010 15:24:29 -0000 1.162 > +++ shredder.mx 18 Feb 2010 09:50:12 -0000 1.162.2.1 > @@ -1362,8 +1362,10 @@ > ctx->myDoc = xmlNewDoc(ctx->version); > } > > - if (!dtd) > + if (!dtd) { > GDKerror("shred_external_subset: problem with reading external DTD (\"%s\")\n", SystemID); > + BAILOUT(shredCtx); > + } > > if (ctx->myDoc->extSubset) { > stream_printf(GDKout, "!WARNING: double external subset (\"%s\") may cause problems.\n", SystemID); > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

3 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah pftijah.mx, , 1.256, 1.257
by Stefan Manegold 19 Feb '10

19 Feb '10

Jan, out of curiosity: - on nwhich architectures and/or in which cases does semijoin not propagate the 'sorted' properties? - shouldn't this checkin have gone as bug fix to the release branch such that is would be included in the next release? Thanks. Stefan On Fri, Feb 19, 2010 at 08:22:08AM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv19238 > > Modified Files: > pftijah.mx > Log Message: > - temporary patch to fix a case where on architectures a semijoin does not > propagate the 'sorted' properties. > > > > Index: pftijah.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/pftijah.mx,v > retrieving revision 1.256 > retrieving revision 1.257 > diff -u -d -r1.256 -r1.257 > --- pftijah.mx 12 Feb 2010 10:25:43 -0000 1.256 > +++ pftijah.mx 19 Feb 2010 08:22:06 -0000 1.257 > @@ -4337,6 +4337,7 @@ > # get collection count of term > var t_pre := _getTermPositions($h); > e_pre := e_pre.@5(_getTermDoc_@1_@2(e_pre, e_size, t_pre)); > + e_pre := e_pre.chk_order(); # jf order patch > } > > var res := e_pre; > @@ -4536,6 +4537,7 @@ > # get collection count of term > var t_pre := _getConceptPositions($h); > e_pre := e_pre.@5(_getTermDoc_@1_@2(e_pre, e_size, t_pre)); > + e_pre := e_pre.chk_order(); # jf order patch > } > > var res := e_pre; > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_posix.mx, Feb2010, 1.176.2.21, 1.176.2.22 gdk_storage.mx, Feb2010, 1.149.2.32, 1.149.2.33
by Stefan Manegold 19 Feb '10

19 Feb '10

Peter, I have some questions to make sure I understand your new code correctly: 1) I don't see any plance in the hash code (at least not in gdk_search.mx) where the "free" element of a hash heap is set (or used) other than the initialization to 0 in HEAPalloc; thus, I guess, "free" for hash heaps is always 0; hence, shouln't we use "size" instead of "free" for the madvise & preload size of hash heaps (as we did in the original BATpreload/BATaccess code)? 2) Am I right that for string heaps you conclude from a strong order correlation between the off-heap and the string heap (due sequential load/insertion) that also the first and last BUN in the offset point to the "first" and "last" string in the string heap? Well, indeed, since access is to be considered in page size granularity, this might be reasonable ... 3) (This was the same in the previous version of the code) For BUN heaps, in case of views (slices), the base pointer of the view's heap might not be the same as the parent's heap, in fact, it might not be page-aligned. If I understand the MT_mmap_tab[] array correctly, it identifies heap by their page-aligned base pointer of the parent's heap. Hence, BATaccess() on a slice view BAT with non-aligned heap->base pointer calls MT_mmap_inform() (through access_heap()) with a non-aligned heap->base, which is not found in MT_mmap_tab[], and hence MT_mmap_inform() does nothing with that heap. With preload==1 it does hence not resgister the posix_madvise() call that access_heap() does. COnsequently, with preload==-1, MT_mmap_inform() will never reset the advise set via slice views, unless there is (also) access to the original parent's heap (i.e., with page-aligned heap->base pointer. I jjust noticed this, but do not yet understand, whether and if so which consequences this (might) have ... Stefan On Thu, Feb 18, 2010 at 10:39:22PM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv28734 > > Modified Files: > Tag: Feb2010 > gdk_posix.mx gdk_storage.mx > Log Message: > did experimentation with sequential mmap I/O. > - on very fast subsystems (such as 16xssd) it is three times slower than optimally tuned direct I/O (1GB/s vs 3GB/s) > - with less disks the difference is smaller (e.g. 140 vs 200MB/s) > regrettably, nothing helped to get it higher. > > the below checkin makes the following changes: > - simplified BATaccess code by separating out routine > - made BATaccess more precies in what to preload (ionly BUNfirst-BUNlast) > - observe that large string heaps have a high sequential correletaion > hense always WILLNEED fetching is overkill > - move the madvise() call back to BATaccess at the start of the access but removing > the advise is done in vmtrim, as you need the overview when the last user is away. > - the basic advise is SEQUENTIAL (ie decent I/O) > > > > Index: gdk_storage.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_storage.mx,v > retrieving revision 1.149.2.32 > retrieving revision 1.149.2.33 > diff -u -d -r1.149.2.32 -r1.149.2.33 > --- gdk_storage.mx 18 Feb 2010 01:04:11 -0000 1.149.2.32 > +++ gdk_storage.mx 18 Feb 2010 22:39:08 -0000 1.149.2.33 > @@ -697,156 +697,95 @@ > return BATload_intern(i); > } > @- BAT preload > -To avoid random disk access to large (memory-mapped) BATs it may help to issue a preload > -request. > -Of course, it does not make sense to touch more then we can physically accomodate. > +To avoid random disk access to large (memory-mapped) BATs it may help to issue a preload request. > +Of course, it does not make sense to touch more then we can physically accomodate (budget). > @c > -size_t > -BATaccess(BAT *b, int what, int advise, int preload) { > - size_t *i, *limit; > - size_t v1 = 0, v2 = 0, v3 = 0, v4 = 0; > - size_t step = MT_pagesize()/sizeof(size_t); > - size_t pages = (size_t) (0.8 * MT_npages()); > - > - assert(advise==MMAP_NORMAL||advise==MMAP_RANDOM||advise==MMAP_SEQUENTIAL||advise==MMAP_WILLNEED||advise==MMAP_DONTNEED); > - > - /* VAR heaps (inherent random access) */ > - if ( what&USE_HEAD && b->H->vheap && b->H->vheap->base ) { > - if (b->H->vheap->storage != STORE_MEM && b->H->vheap->size > MT_MMAP_TILE) { > - MT_mmap_inform(b->H->vheap->base, b->H->vheap->size, preload, MMAP_WILLNEED, 0); > - } > - if (preload > 0 && pages > 0) { > - IODEBUG THRprintf(GDKout,"#BATaccess(%s,%d): H->vheap\n", BATgetId(b), advise); > - limit = (size_t *) (b->H->vheap->base + b->H->vheap->free) - 4 * step; > - /* we need to ensure alignment, here, as b might be a view and heap.base of views are not necessarily aligned */ > - i = (size_t *) (((size_t)b->H->vheap->base + sizeof(size_t) - 1) & (~(sizeof(size_t) - 1))); > - for (; i <= limit && pages > 3 ; i+= 4*step, pages-= 4) { > - v1 += *i; > - v2 += *(i + step); > - v3 += *(i + 2*step); > - v4 += *(i + 3*step); > - } > - limit += 4 * step; > - for (; i <= limit && pages > 0; i+= step, pages--) { > - v1 += *i; > - } > +/* modern linux tends to use 128K readaround = 64K readahead > + * changes have been going on in 2009, towards true readahead > + * http://tomoyo.sourceforge.jp/cgi-bin/lxr/source/mm/readahead.c > + * > + * Peter Feb2010: I tried to do prefetches further apart, to trigger multiple readahead > + * units in parallel, but it does improve performance visibly > + */ > +static size_t access_heap(str id, str hp, Heap *h, char* base, size_t sz, int touch, int preload, int advise) { > + size_t v0 = 0, v1 = 0, v2 = 0, v3 = 0, v4 = 0, v5 =0, v6 = 0, v7 = 0, page = MT_pagesize(); > + int t = GDKms(); > + if (h->storage != STORE_MEM && h->size > MT_MMAP_TILE) { > + MT_mmap_inform(h->base, h->size, preload, advise, 0); > + if (preload > 0) { > + void* alignedbase = (void*) (((size_t) base) & ~(page-1)); > + size_t alignedsz = (sz + (page-1)) & ~(page-1); > + int ret = posix_madvise(alignedbase, sz, advise); > + if (ret) THRprintf(GDKerr, "#MT_mmap_inform: posix_madvise(file=%s, base="PTRFMT", len="SZFMT"MB, advice=%d) = %d\n", > + h->filename, PTRFMTCAST alignedbase, alignedsz >> 20, advise, errno); > } > } > - if ( what&USE_TAIL && b->T->vheap && b->T->vheap->base ) { > - if (b->T->vheap->storage != STORE_MEM && b->T->vheap->size > MT_MMAP_TILE) { > - MT_mmap_inform(b->T->vheap->base, b->T->vheap->size, preload, MMAP_WILLNEED, 0); > - } > - if (preload > 0 && pages > 0) { > - IODEBUG THRprintf(GDKout,"#BATaccess(%s,%d): T->vheap\n", BATgetId(b), advise); > - limit = (size_t *) (b->T->vheap->base + b->T->vheap->free - sizeof(size_t)) - 4 * step; > - /* we need to ensure alignment, here, as b might be a view and heap.base of views are not necessarily aligned */ > - i = (size_t *) (((size_t)b->T->vheap->base + sizeof(size_t) - 1) & (~(sizeof(size_t) - 1))); > - for (; i <= limit && pages > 3; i+= 4*step, pages-= 4) { > - v1 += *i; > - v2 += *(i + step); > - v3 += *(i + 2*step); > - v4 += *(i + 3*step); > - } > - limit += 4 * step; > - for (; i <= limit && pages > 0; i+= step, pages--) { > - v1 += *i; > - } > + if (touch && preload > 0) { > + /* we need to ensure alignment, here, as b might be a view and heap.base of views are not necessarily aligned */ > + size_t *lo = (size_t *) (((size_t) base + sizeof(size_t) - 1) & (~(sizeof(size_t) - 1))); > + size_t *hi = (size_t *) (base + sz); > + for (hi -= 8*page; lo <= hi; lo += 8*page) { > + /* try to trigger loading of multiple pages without blocking */ > + v0 += lo[0*page]; v1 += lo[1*page]; v2 += lo[2*page]; v3 += lo[3*page]; > + v4 += lo[4*page]; v5 += lo[5*page]; v6 += lo[6*page]; v7 += lo[7*page]; > } > + for (hi += 7*page; lo <= hi; lo +=page) v0 += *lo; > } > + IODEBUG THRprintf(GDKout,"#BATpreload(%s->%s,preload=%d,sz=%dMB,%s) = %dms \n", id, hp, preload, (int) (sz>>20), > + (advise==BUF_WILLNEED)?"WILLNEED":(advise==BUF_SEQUENTIAL)?"SEQUENTIAL":"UNKNOWN", GDKms()-t); > + return v0+v1+v2+v3+v4+v5+v6+v7; > +} > > - /* BUN heaps (no need to preload for sequential access) */ > - if ( what&USE_HEAD && b->H->heap.base ) { > - if (b->H->heap.storage != STORE_MEM && b->H->heap.size > MT_MMAP_TILE) { > - MT_mmap_inform(b->H->heap.base, b->H->heap.size, preload, advise, 0); > - } > - if (preload > 0 && pages > 0 && advise != MMAP_SEQUENTIAL) { > - IODEBUG THRprintf(GDKout,"#BATaccess(%s,%d): H->heap\n", BATgetId(b), advise); > - limit = (size_t *) (Hloc(b, BUNlast(b)) - sizeof(size_t)) - 4 * step; > - /* we need to ensure alignment, here, as b might be a view and heap.base of views are not necessarily aligned */ > - i = (size_t *) (((size_t)Hloc(b, BUNfirst(b)) + sizeof(size_t) - 1) & (~(sizeof(size_t) - 1))); > - for (; i <= limit && pages > 3 ; i+= 4*step, pages-= 4) { > - v1 += *i; > - v2 += *(i + step); > - v3 += *(i + 2*step); > - v4 += *(i + 3*step); > - } > - limit += 4 * step; > - for (; i <= limit && pages > 0; i+= step, pages--) { > - v1 += *i; > - } > - } > - } > - if ( what&USE_TAIL && b->T->heap.base ) { > - if (b->T->heap.storage != STORE_MEM && b->T->heap.size > MT_MMAP_TILE) { > - MT_mmap_inform(b->T->heap.base, b->T->heap.size, preload, advise, 0); > +size_t > +BATaccess(BAT *b, int what, int advise, int preload) { > + ssize_t budget = (ssize_t) (0.8 * MT_npages()); > + size_t v = 0, sz; > + str id = BATgetId(b); > + BATiter bi = bat_iterator(b); > + > + assert(advise==MMAP_NORMAL||advise==MMAP_RANDOM||advise==MMAP_SEQUENTIAL||advise==MMAP_WILLNEED||advise==MMAP_DONTNEED); > + if (BATcount(b) == 0) return 0; > + > + /* HASH indices (inherent random access). handle first as they *will* be access randomly (one can always hope for locality on the other heaps) */ > + if ( what&USE_HHASH || what&USE_THASH ) { > + gdk_set_lock(GDKhashLock(ABS(b->batCacheid) & BBP_BATMASK), "BATaccess"); > + if ( what&USE_HHASH && b->H->hash && b->H->hash->heap && b->H->hash->heap->base) { > + budget -= sz = (b->H->hash->heap->free > (size_t) budget)?budget:(ssize_t)b->T->hash->heap->free; > + v += access_heap(id, "hhash", b->H->hash->heap, b->H->hash->heap->base, sz, 1, preload, MMAP_WILLNEED); > } > - if (preload > 0 && pages > 0 && advise != MMAP_SEQUENTIAL) { > - IODEBUG THRprintf(GDKout,"#BATaccess(%s,%d): T->heap\n", BATgetId(b), advise); > - limit = (size_t *) (Tloc(b, BUNlast(b)) - sizeof(size_t)) - 4 * step; > - /* we need to ensure alignment, here, as b might be a view and heap.base of views are not necessarily aligned */ > - i = (size_t *) (((size_t)Tloc(b, BUNfirst(b)) + sizeof(size_t) - 1) & (~(sizeof(size_t) - 1))); > - for (; i <= limit && pages > 3; i+= 4*step, pages-= 4) { > - v1 += *i; > - v2 += *(i + step); > - v3 += *(i + 2*step); > - v4 += *(i + 3*step); > - } > - limit += 4 * step; > - for (; i <= limit && pages > 0; i+= step, pages--) { > - v1 += *i; > - } > + if ( what&USE_THASH && b->T->hash && b->T->hash->heap && b->T->hash->heap->base) { > + budget -= sz = (b->T->hash->heap->free > (size_t) budget)?budget:(ssize_t)b->T->hash->heap->free; > + v += access_heap(id, "thash", b->T->hash->heap, b->T->hash->heap->base, sz, 1, preload, MMAP_WILLNEED); > } > + gdk_unset_lock(GDKhashLock(ABS(b->batCacheid) & BBP_BATMASK), "BATaccess"); > } > > - /* HASH indices (inherent random access) */ > - if ( what&USE_HHASH || what&USE_THASH ) > - gdk_set_lock(GDKhashLock(ABS(b->batCacheid) & BBP_BATMASK), "BATaccess"); > - if ( what&USE_HHASH && b->H->hash && b->H->hash->heap && b->H->hash->heap->base ) { > - if (b->H->hash->heap->storage != STORE_MEM && b->H->hash->heap->size > MT_MMAP_TILE) { > - MT_mmap_inform(b->H->hash->heap->base, b->H->hash->heap->size, preload, MMAP_WILLNEED, 0); > + /* we only touch stuff that is going to be read randomly (WILLNEED). Note varheaps are sequential wrt to the references, or small */ > + if ( what&USE_HEAD) { > + if (b->H->heap.base) { > + char *lo = BUNhloc(bi, BUNfirst(b)), *hi = BUNhloc(bi, BUNlast(b)-1); > + budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > + v += access_heap(id, "hbuns", &b->H->heap, lo, sz, (advise == BUF_WILLNEED), preload, advise); > } > - if (preload > 0 && pages > 0) { > - IODEBUG THRprintf(GDKout,"#BATaccess(%s,%d): H->hash\n", BATgetId(b), advise); > - limit = (size_t *) (b->H->hash->heap->base + b->H->hash->heap->size - sizeof(size_t)) - 4 * step; > - /* we need to ensure alignment, here, as b might be a view and heap.base of views are not necessarily aligned */ > - i = (size_t *) (((size_t)b->H->hash->heap->base + sizeof(size_t) - 1) & (~(sizeof(size_t) - 1))); > - for (; i <= limit && pages > 3 ; i+= 4*step, pages-= 4) { > - v1 += *i; > - v2 += *(i + step); > - v3 += *(i + 2*step); > - v4 += *(i + 3*step); > - } > - limit += 4 * step; > - for (; i <= limit && pages > 0; i+= step, pages--) { > - v1 += *i; > - } > + if (b->H->vheap && b->H->vheap->base) { > + char *lo = BUNhead(bi, BUNfirst(b)), *hi = BUNhead(bi, BUNlast(b)-1); > + budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > + v += access_heap(id, "hheap", b->H->vheap, lo, sz, (advise == BUF_WILLNEED), preload, advise); > } > } > - if ( what&USE_THASH && b->T->hash && b->T->hash->heap && b->T->hash->heap->base ) { > - if (b->T->hash->heap->storage != STORE_MEM && b->T->hash->heap->size > MT_MMAP_TILE) { > - MT_mmap_inform(b->T->hash->heap->base, b->T->hash->heap->size, preload, MMAP_WILLNEED, 0); > + if ( what&USE_TAIL) { > + if (b->T->heap.base) { > + char *lo = BUNtloc(bi, BUNfirst(b)), *hi = BUNtloc(bi, BUNlast(b)-1); > + budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > + v += access_heap(id, "tbuns", &b->T->heap, lo, sz, (advise == BUF_WILLNEED), preload, advise); > } > - if (preload > 0 && pages > 0) { > - IODEBUG THRprintf(GDKout,"#BATaccess(%s,%d): T->hash\n", BATgetId(b), advise); > - limit = (size_t *) (b->T->hash->heap->base + b->T->hash->heap->size - sizeof(size_t)) - 4 * step; > - /* we need to ensure alignment, here, as b might be a view and heap.base of views are not necessarily aligned */ > - i = (size_t *) (((size_t)b->T->hash->heap->base + sizeof(size_t) - 1) & (~(sizeof(size_t) - 1))); > - for (; i <= limit && pages > 3 ; i+= 4*step, pages-= 4) { > - v1 += *i; > - v2 += *(i + step); > - v3 += *(i + 2*step); > - v4 += *(i + 3*step); > - } > - limit += 4 * step; > - for (; i <= limit && pages > 0; i+= step, pages--) { > - v1 += *i; > - } > + if (b->T->vheap && b->T->vheap->base) { > + char *lo = BUNtail(bi, BUNfirst(b)), *hi = BUNtail(bi, BUNlast(b)-1); > + budget -= sz = ((hi-lo) > budget)?budget:(hi-lo); > + v += access_heap(id, "theap", b->T->vheap, lo, sz, (advise == BUF_WILLNEED), preload, advise); > } > } > - if ( what&USE_HHASH || what&USE_THASH ) > - gdk_unset_lock(GDKhashLock(ABS(b->batCacheid) & BBP_BATMASK), "BATaccess"); > - > - return v1 + v2 + v3 + v4; > + return v; > } > @} > > > Index: gdk_posix.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_posix.mx,v > retrieving revision 1.176.2.21 > retrieving revision 1.176.2.22 > diff -u -d -r1.176.2.21 -r1.176.2.22 > --- gdk_posix.mx 18 Feb 2010 01:03:55 -0000 1.176.2.21 > +++ gdk_posix.mx 18 Feb 2010 22:38:53 -0000 1.176.2.22 > @@ -909,10 +909,8 @@ > unload = MT_mmap_tab[i].usecnt == 0; > } > (void) pthread_mutex_unlock(&MT_mmap_lock); > - if (i >= 0 && preload > 0) > - ret = posix_madvise(base, len, advise); > - else if (unload) > - ret = posix_madvise(base, len, MMAP_NORMAL); > + if (unload) > + ret = posix_madvise(base, len, BUF_SEQUENTIAL); > if (ret) { > stream_printf(GDKerr, "#MT_mmap_inform: posix_madvise(file=%s, fd=%d, base="PTRFMT", len="SZFMT"MB, advice=%d) = %d\n", > (i >= 0 ? MT_mmap_tab[i].path : ""), (i >= 0 ? MT_mmap_tab[i].fd : -1), > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

3 4

[Monetdb-developers] Single column select vs aggregation
by Stefan de Konink 18 Feb '10

18 Feb '10

Attached is a trace of a single column select operation, with a max, avg and equality. The equality takes about 4 times more time than the avg operation. From the plan I see that the operation is executed paralel, but I do wonder why suddenly the uselect takes such a high amount of time. Stefan

3 7

[Monetdb-developers] Maximum length of /any/ entry
by Stefan de Konink 16 Feb '10

16 Feb '10

Hi, Is the maximum length of a str (intmax) equal to maximum length of any other object we can currently store? Stefan

1 0

[Monetdb-developers] ODBC call-failed
by filippo.zonta＠it.abb.com 16 Feb '10

16 Feb '10

Hello, I installed the ODBC driver for windows32 (MonetDB-ODBC-Installer-i386-20100112.msi) and configured an ODBC data source linked to 'demo' database, but using the connection in MS Access I obtain an error ODBC CONFIGURATION DB SERVER WINDOWS RUNNING MS ACCESS LINK TABLE : ONLY 1 TABLE IS LISTED Using the same connection in Excel instead, the odbc driver works: Let me know if the ODBC driver doesn't support MS Access table links. Thanks Best Regards Filippo Il Gruppo ABB in Italia ha adottato il Modello Organizzativo ai sensi del D.Lgs. 231/2001, in forza del quale l'assunzione di obbligazioni da parte di societa' ABB avviene a firma congiunta di due procuratori muniti di idonei poteri, con la sola eccezione delle persone che rivestono la carica di Amministratore Delegato o di Direttore Generale.Le informazioni contenute in questo messaggio di posta elettronica sono riservate e confidenziali e ne e' vietata la diffusione in qualunque modo eseguita.Qualora Lei non fosse la persona cui il presente messaggio e' destinato, e' invitata a non diffonderlo, e ad eliminarlo, dandone gentilmente comunicazione al mittente.ABB Group in Italy adopts a Compliance Programme under the Italian Law (D.Lgs.231/2001). According to this ABB Compliance Programme, any commitment of ABB Italian Companies is taken by the double signature of ABB Representatives granted by a proper Power of Attorney with the only exception of Managing Director or General Manager.The information included in this e-mail and any attachments are confidential and may also be privileged. If you are not the correct recipient, you are kindly requested to notify the sender immediately, to cancel it and not to disclose the contents to any other person.

2 1

[Monetdb-developers] BATpreload_ and _BATpreload
by Sjoerd Mullender 15 Feb '10

15 Feb '10

I am quite unhappy with the names BATpreload, BATpreload_, and _BATpreload. I really don't like names that differ only by an initial or final _. I would much rather see more descriptive names. BATpreload_ is now more an interface to give advice to the underlying system about how the BAT is going to be accessed in the near future, and _BATpreload is telling the underlying system that you're done with accessing the BAT according to the advice given. Names such as BATaccessadvice/BATendaccessadvice, though longer, are more descriptive. I have seen some checkins fixing the incorrect use of BATpreload_ and _BATpreload, proofing my point. Now we still have a chance to fix this. -- Sjoerd Mullender

4 7

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_posix.mx, Feb2010, 1.176.2.14, 1.176.2.15
by Stefan Manegold 15 Feb '10

15 Feb '10

On Sun, Feb 14, 2010 at 09:23:10PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv28118 > > Modified Files: > Tag: Feb2010 > gdk_posix.mx > Log Message: > Move the load advice outside the lock. FYI: This checkin also changes the semantics of MT_mmap_inform() such that, now, (1) with preload > 0, posix_madvise(base, len, advise) is also called on areas that are not maintained in MT_mmap_tab[] (2) with preload < 0, posix_madvise(base, len, BUF_NORMAL) is never called on areas that are not maintained in MT_mmap_tab[] Was this intended? Stefan > > Index: gdk_posix.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_posix.mx,v > retrieving revision 1.176.2.14 > retrieving revision 1.176.2.15 > diff -u -d -r1.176.2.14 -r1.176.2.15 > --- gdk_posix.mx 14 Feb 2010 13:17:50 -0000 1.176.2.14 > +++ gdk_posix.mx 14 Feb 2010 21:22:29 -0000 1.176.2.15 > @@ -884,7 +884,7 @@ > void > MT_mmap_inform(void *base, size_t len, int preload, int advise, int writable) > { > - int i; > + int i, unload =0; > > (void) pthread_mutex_lock(&MT_mmap_lock); > i = MT_mmap_idx(base, len); > @@ -892,12 +892,13 @@ > if (writable) MT_mmap_tab[i].writable = (writable > 0); > MT_mmap_tab[i].random += preload * (advise == BUF_WILLNEED); /* done as a counter to keep track of multiple threads */ > MT_mmap_tab[i].usecnt += preload; /* active thread count */ > - if (preload > 0) > - (void) posix_madvise(base, len, advise); > - else if (MT_mmap_tab[i].usecnt == 0) > - (void) posix_madvise(base, len, BUF_NORMAL); > + unload = MT_mmap_tab[i].usecnt == 0; > } > (void) pthread_mutex_unlock(&MT_mmap_lock); > + if (preload > 0) > + (void) posix_madvise(base, len, advise); > + else if (unload) > + (void) posix_madvise(base, len, BUF_NORMAL); > > } > > > > ------------------------------------------------------------------------------ > SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, > Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW > http://p.sf.net/sfu/solaris-dev2dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel group.mx, Feb2010, 1.146.2.14, 1.146.2.15
by Martin Kersten 15 Feb '10

15 Feb '10

Stefan Manegold wrote: > when BATpreloading the sequentially accessed outer BAT, > make sure we also BATpreload the (often) randomly > accessed "inner" BAT We probably also have to inject advice for the target variable(s), because it is likely to be used in the future a BUF_WILLNEED might be appropriate to avoid early eviction. This advice should be given when we create them, e.g. in BATnew?

1 0

[Monetdb-developers] cracking pipeline
by Isidor Zeuner 13 Feb '10

13 Feb '10

Dear MonetDB developers, I'd like to write some words of gratitude for your work on the cracking code. I have read your paper describing the approach, which looks promising. And current code already seems to be somehow stable (I could get it to segfault using integer equality, and got wrong results using integer comparisons, but both were easy to work around .. nothing serious compared with the MALexception whack-a-mole I experienced with mitosis_pipe). Is there a roadmap somewhere for this part of the code, so I could see what to expect, or where to test/patch/contribute most appropriately? Best regards, Isidor Zeuner

1 0

[Monetdb-developers] working with the SQL engine's MAL explanations
by Isidor Zeuner 13 Feb '10

13 Feb '10

Dear MonetDB developers, when using the EXPLAIN keyword within "mclient --language=sql", I get output like: % .explain # table_name % mal # name % clob # type % 0 # length function user.s0_2{autoCommit=true}():void; .. .. Most notably, apart from the lines starting with %, the syntax resembles the code "mclient --language=mal" would expect. So, a naive approach to use this observation would be to filter out the % lines and feed the output together with some boilerplate code into "mclient --language=mal" (example using a bash unix shell): echo "EXPLAIN SELECT 1;"| mclient --language=sql| ( echo "sql.init();" grep -v ^% echo "user.s0_2();" )| mclient --language=mal For very simple SQL statements, this works and creates the expected output. However, as soon as tables come into play, I'm getting errors because of uninitialized variables. So there seem to be at least semantical differences between EXPLAIN's MAL output and the MAL "mclient --language=mal" expects. Is this difference documented somewhere? Is there a better way for ad-hoc translation from executable SQL to executable MAL? Best regards, Isidor Zeuner

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk.mx, Feb2010, 1.301.2.9, 1.301.2.10 gdk_bat.mx, Feb2010, 1.236.2.4, 1.236.2.5 gdk_batop.mx, Feb2010, 1.180.2.15, 1.180.2.16 gdk_bbp.mx, Feb2010, 1.269.2.5, 1.269.2.6 gdk_posix.mx, Feb2010, 1.176.2.11, 1.176.2.12 gdk_relop.mx, Feb2010, 1.179.2.13, 1.179.2.14 gdk_storage.mx, Feb2010, 1.149.2.21, 1.149.2.22 gdk_utils.mx, Feb2010, 1.262.2.10, 1.262.2.11
by Stefan Manegold 12 Feb '10

12 Feb '10

Peter, > +/* a thread informs it is goin to (preload==1) or stops (preload==-1) using a range of memory */ > void > -MT_mmap_pin(void *base, size_t len) > +MT_mmap_inform(void *base, size_t len, int preload, int advise, int writable) > { > int i; > > (void) pthread_mutex_lock(&MT_mmap_lock); > i = MT_mmap_idx(base, len); > if (i >= 0) { > - MT_mmap_tab[i].pincnt++; > + if (writable) MT_mmap_tab[i].writable = (writable > 0); > + MT_mmap_tab[i].random += (advise == BUF_WILLNEED); /* done as a counter to keep track of multiple threads */ ^^^^^^^^^^^^^^^^^^^^^^^^ shouldn't this rather be something like MT_mmap_tab[i].random += preload * (advise == BUF_WILLNEED); ? Otherwise (i.e., in the current case), both BATpreload_() & _BATpreload() only increment MT_mmap_tab[i].random, but never decrement it, right? Stefan > + MT_mmap_tab[i].usecnt += preload; /* active thread count */ > + if (preload > 0) (void) posix_madvise(base, len, advise); > } > (void) pthread_mutex_unlock(&MT_mmap_lock); > > } -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

2 2

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/mapiclient MapiClient.mx, , 1.194, 1.195
by Stefan de Konink 12 Feb '10

12 Feb '10

Op 12-02-10 18:01, Fabian Groffen schreef: > On 12-02-2010 16:37:28 +0000, Stefan de Konink wrote: >> Update of /cvsroot/monetdb/clients/src/mapiclient >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv30000 >> >> Modified Files: >> MapiClient.mx >> Log Message: >> Minor issue with save_history = false. > > you forgot a changelog entry for this feature. I didn't know there was a changelog ;) But it looks that that is branch related? And I just checked it into head? Stefan

2 1

[Monetdb-developers] @= atomtostr memory usage
by Stefan de Konink 11 Feb '10

11 Feb '10

Hi, While creating some new code and seeing unexpected, but interesting, behavior I stumbled upon the @= atomtostr code, some simple questions regarding this. It seems that the memory requested in @= atommem is rather pessimistic. It seems that for a regular integer 24 characters are allocated. Now since this integer seems to go up to 2^31 (10 chars) + sign + \0 (2 chars), why is the double amount needed if a per type approach is available in MAL? The actual toStr code finishes with a strlen, now this is nice behavior, but if we now know what the length of the string actually is, why not shoot a GDKrealloc on it, and make the *len the actual size? Regarding to memory management and memory function calling, the code isn't very efficient. Effectively all the functions seem to introduce their own buffers. If we look from a perspective of for example strConcat, the value is copied several times from serveral position. We could overcome this bahavior if we would return a maximum length for a type, the concat function would add the length of the second string alloc this buffer, forwards the pointer to the typical atomToStr call, and instead of allocing a new string, using the prealloced buffer. (...and yes, doing a GDKrealloc after that function wouldn't be good.) I took the liberty to come up with a patch for the second issue; Since snprintf will return the amount of bytes written, and since we have established that there is no numeric type overflowing the string space, we can ommit the strlen, use the amount of bytes + 1 from snprintf, realloc, and return the actual amount of bytes representing the string. Catches; 1) Old implementation resulted bestcase in an off by one return vs len 2) Is there any code dependent on the *len or that length will include the \0 value? If there are no objections, I'll check in that patch later today in head. >From benchmarking point of view, it might be worthwhile to test with and without the realloc. Stefan

2 2

[Monetdb-developers] confused by Timer/QueryHistory/CallHistory
by Mo Zhou 08 Feb '10

08 Feb '10

Hi, Sorry for bothering you again... I am confused by the time shown in Timer/queryHistory/callHistory. In queryHistory, there are two time: parse time and optimization time. In callHistory, there are two important time: xtime and rtime. These times should not overlap each other. but when I sum up these times, the number is different from the one returned by Timer. I wonder which time should I use for performance test. Thank you very much. -- Thanks, Mo

1 1

[Monetdb-developers] \f none not working
by Mo Zhou 08 Feb '10

08 Feb '10

Hi, I found "\f none" not working in XQuery. here is my commands: >\f none >\f Current formatter: none >for $t in doc("...")//Product return <pid> {pf:nid($t)} <XQueryResult>.....</pid><pid>1711511</pid></XQueryResult> >\f >Current formatter: none The results should not be printed according to the manual. "none: Finally, the none mode suppresses any output. This mode is mostly useful for performance measurements, if one wants to exclude the result serialization time." Could you please let me know if there are any solutions? Thanks! -- Thanks, Mo

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel batcast.mx, Feb2010, 1.31, 1.31.2.1 batstr.mx, Feb2010, 1.68, 1.68.2.1
by Stefan Manegold 06 Feb '10

06 Feb '10

On Sat, Feb 06, 2010 at 10:17:54AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv685 > > Modified Files: > Tag: Feb2010 > batcast.mx batstr.mx > Log Message: > All string BATs should be preloaded to avoid random access to disk. Preloading their string heap(s) is indeed a good idea (unless they exceeds memory size, anyway) due to their inherently random access. However, preloading sequentially traversed BUN heaps might just create an unnecessarily huge memory footprint, in particular with large BATs. Hence, we might want to consider extending BATpreload to not uncoditionally preload all heaps of a BAT (up to four right now, since we ignore hash tables), but rather allow selective preload of those heaps that are (a) accessed at all, and (b) access randomly (or not accessed sequentially). I'll look into this later ... Stefan > > Index: batstr.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/batstr.mx,v > retrieving revision 1.68 > retrieving revision 1.68.2.1 > diff -u -d -r1.68 -r1.68.2.1 > --- batstr.mx 7 Jan 2010 15:24:26 -0000 1.68 > +++ batstr.mx 6 Feb 2010 10:17:49 -0000 1.68.2.1 > @@ -239,6 +239,7 @@ > > bi = bat_iterator(b); > > + BATpreload(b); > BATloop(b, p, q) { > ptr h = BUNhead(bi,p); > x = (@3) BUNtail(bi,p); > @@ -275,6 +276,7 @@ > > bi = bat_iterator(b); > > + BATpreload(b); > BATloop(b, p, q) { > ptr h = BUNhead(bi,p); > str y = (str)str_nil, *yp = &y; > @@ -322,6 +324,7 @@ > > if (strcmp(*cst, str_nil) == 0) > isnil = 1; > + BATpreload(b); > BATloop(b, p, q) { > ptr h = BUNhead(bi, p); > > @@ -369,6 +372,8 @@ > lefti = bat_iterator(left); > righti = bat_iterator(right); > > + BATpreload(left); > + BATpreload(right); > BATloop(left, p, q) { > bit y = TRUE; > ptr h = BUNhead(lefti, p); > @@ -411,6 +416,8 @@ > lefti = bat_iterator(left); > righti = bat_iterator(right); > > + BATpreload(left); > + BATpreload(right); > BATloop(left, p, q) { > ptr h = BUNhead(lefti,p); > ptr tl = BUNtail(lefti,p); > @@ -444,6 +451,7 @@ > > lefti = bat_iterator(left); > > + BATpreload(left); > BATloop(left, p, q) { > ptr h = BUNhead(lefti,p); > ptr tl = BUNtail(lefti,p); > @@ -476,6 +484,8 @@ > lefti = bat_iterator(left); > righti = bat_iterator(right); > > + BATpreload(left); > + BATpreload(right); > BATloop(left, p, q) { > ptr h = BUNhead(lefti,p); > str tl = (str) BUNtail(lefti,p); > @@ -509,6 +519,7 @@ > > lefti = bat_iterator(left); > > + BATpreload(left); > BATloop(left, p, q) { > ptr h = BUNhead(lefti,p); > str tl = (str) BUNtail(lefti,p); > @@ -539,6 +550,7 @@ > > righti = bat_iterator(right); > > + BATpreload(right); > BATloop(right, p, q) { > ptr h = BUNhead(righti,p); > str tr = (str) BUNtail(righti,p); > @@ -579,6 +591,7 @@ > > bi = bat_iterator(b); > > + BATpreload(b); > BATloop(b, p, q) { > ptr h = BUNhead(bi, p); > str y = (str)str_nil, *yp = &y; > @@ -622,6 +635,7 @@ > > bi = bat_iterator(b); > > + BATpreload(b); > BATloop(b, p, q) { > ptr h = BUNhead(bi, p); > ptr t = BUNtail(bi, p); > @@ -666,6 +680,7 @@ > bn->tsorted = b->tsorted; > > bi = bat_iterator(b); > + BATpreload(b); > BATloop(b, p, q) { > ptr h = BUNhead(bi, p); > str t = (str) BUNtail(bi, p); > @@ -720,6 +735,7 @@ > lefti = bat_iterator(left); > starti = bat_iterator(start); > lengthi = bat_iterator(length); > + BATpreload(left); > BATloop(left, p, q) { > ptr h = BUNhead(lefti,p); > str tl = (str) BUNtail(lefti,p); > @@ -764,6 +780,7 @@ > bn->tsorted=0; > > li = bat_iterator(left); > + BATpreload(left); > BATloop(left, p, q) { > ptr h = BUNhead(li,p); > str tl = (str) BUNtail(li,p); > > Index: batcast.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/batcast.mx,v > retrieving revision 1.31 > retrieving revision 1.31.2.1 > diff -u -d -r1.31 -r1.31.2.1 > --- batcast.mx 7 Jan 2010 15:24:26 -0000 1.31 > +++ batcast.mx 6 Feb 2010 10:17:47 -0000 1.31.2.1 > @@ -253,6 +253,7 @@ > @:voidresultBAT(TYPE_@1,"batcalc.@1")@ > bi = bat_iterator(b); > > + BATpreload(b); > BATloop(b, p, q) { > ptr v = NULL; > int len = 0; > > > ------------------------------------------------------------------------------ > The Planet: dedicated and managed hosting, cloud storage, colocation > Stay online with enterprise data centers and the best network in the business > Choose flexible plans and management services without long-term contracts > Personal 24x7 support from experience hosting pros just a phone call away. > http://p.sf.net/sfu/theplanet-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

2 1

[Monetdb-developers] Build MonetDB on Linux
by zhangyuan 06 Feb '10

06 Feb '10

I'm trying to build MonetDB default branch(HEAD) on Linux, and I have built buildtools, but when I go on with MonetDB, I met some trouble. When run the ./bootstrap under /MonetDB directory, it produces the following errors: [root@node1 MonetDB]# ./bootstrap automake 1.5 is 1.5 or newer. OK, unless you want to compile with Intel's icc (on Linux), which requires automake 1.7 or newer. autoconf 2.60 is 2.57 or newer. Good. libtool 1.5 is 1.4 or newer. Good. Python 2.5.1 is 2.0.0 or newer. Good. /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB/src /root/monetDB/MonetDB/MonetDB/src /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB/src/common /root/monetDB/MonetDB/MonetDB/src/common /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB/src/gdk /root/monetDB/MonetDB/MonetDB/src/gdk /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB/conf /root/monetDB/MonetDB/MonetDB/conf /root/monetDB/MonetDB/MonetDB You should add the contents of `/usr/local/share/aclocal/libtool.m4' to `aclocal.m4'. Putting files in AC_CONFIG_AUX_DIR, `conf'. aclocal: configure.in: 63: macro `AM_MONETDB_XQ_VARS_1' not found in library aclocal: configure.in: 66: macro `AM_MONETDB_DEFAULTS' not found in library aclocal: configure.in: 69: macro `AM_MONETDB_COMPILER' not found in library aclocal: configure.in: 70: macro `AM_MONETDB_TOOLS' not found in library aclocal: configure.in: 71: macro `AM_MONETDB_OPTIONS' not found in library aclocal: configure.in: 72: macro `AM_MONETDB_UTILS' not found in library aclocal: configure.in: 85: macro `AM_MONETDB_LIBS' not found in library aclocal: configure.in: 119: macro `AM_MONETDB_XQ_VARS_2' not found in library [root@node1 MonetDB]# I must be doing something wrong, but I can't figure out the problem. Any help would be appreciated. 2010-02-06 zhangyuan

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server rel_schema.mx, Feb2010, 1.2, 1.2.2.1
by Wouter Alink 05 Feb '10

05 Feb '10

fantastisch! 2010/2/5 Niels Nes <nielsnes(a)users.sourceforge.net>: > Update of /cvsroot/monetdb/sql/src/server > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv25790/src/server > > Modified Files: > Tag: Feb2010 > rel_schema.mx > Log Message: > fixed bug in handeling topn in create table as select with data. > > > > Index: rel_schema.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/rel_schema.mx,v > retrieving revision 1.2 > retrieving revision 1.2.2.1 > diff -u -d -r1.2 -r1.2.2.1 > --- rel_schema.mx 11 Jan 2010 10:29:17 -0000 1.2 > +++ rel_schema.mx 5 Feb 2010 10:18:16 -0000 1.2.2.1 > @@ -127,9 +127,14 @@ > static char * > as_subquery( mvc *sql, sql_table *t, sql_rel *sq, dlist *column_spec ) > { > + sql_rel *r = sq; > + > + if (is_topn(r->op)) > + r = sq->l; > + > if (column_spec) { > dnode *n = column_spec->h; > - node *m = sq->exps->h; > + node *m = r->exps->h; > > for (; n; n = n->next, m = m->next) { > char *cname = n->data.sval; > @@ -143,7 +148,7 @@ > } else { > node *m; > > - for (m = sq->exps->h; m; m = m->next) { > + for (m = r->exps->h; m; m = m->next) { > sql_exp *e = m->data; > char *cname = exp_name(e); > sql_subtype *tp = exp_subtype(e); > > > ------------------------------------------------------------------------------ > The Planet: dedicated and managed hosting, cloud storage, colocation > Stay online with enterprise data centers and the best network in the business > Choose flexible plans and management services without long-term contracts > Personal 24x7 support from experience hosting pros just a phone call away. > http://p.sf.net/sfu/theplanet-com > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > >

2 1

[Monetdb-developers] How to know the database size and use indexes?
by Mo Zhou 04 Feb '10

04 Feb '10

Hi, I wonder if there is a way to get the size of a database (SQL/XQuery)? And I wonder if I can ask MonetDB (SQL/XQuery) to use a specific index explicitly? -- Thanks, Mo

2 3

[Monetdb-developers] build MonetDB on linux
by zhangyuan 03 Feb '10

03 Feb '10

Dear Sir/Madam, I want to compile and install from CVS source on Linux,but when I build buildtools with "./bootstrap" have an error as "can't find the file or directory".I have set up the shell environment. look forward to your feedbacds and suggestios soon! Thank you! 2010-02-03 zhangyuan

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/Tests fbterms.xq, , NONE, 1.1 All, , 1.14, 1.15 procs.stable.out, , 1.62, 1.63
by Stefan Manegold 03 Feb '10

03 Feb '10

Henning, could you please also provide / approved the expected/correct stable output for your new test? Thanks! Stefan On Wed, Jan 06, 2010 at 01:59:11PM +0000, Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/Tests > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv7682/Tests > > Modified Files: > All procs.stable.out > Added Files: > fbterms.xq > Log Message: > added implementation for tijah:fb-terms() > > the current implementation follows the divergation minimization approach of > zhai and lafferty to find the best feeback terms. > > used parameters: returnNumber and collection-lambda. > > > > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/All,v > retrieving revision 1.14 > retrieving revision 1.15 > diff -u -d -r1.14 -r1.15 > --- All 22 Dec 2009 11:47:23 -0000 1.14 > +++ All 6 Jan 2010 13:59:09 -0000 1.15 > @@ -43,4 +43,5 @@ > tf2 > tfall > terms_tf > +fbterms > cleanup > > Index: procs.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/procs.stable.out,v > retrieving revision 1.62 > retrieving revision 1.63 > diff -u -d -r1.62 -r1.63 > --- procs.stable.out 22 Dec 2009 11:47:23 -0000 1.62 > +++ procs.stable.out 6 Jan 2010 13:59:09 -0000 1.63 > @@ -738,6 +738,7 @@ > [ "tj_dump_collection(str) : void" ] > [ "tj_ent2tid(BAT[str,dbl]) : BAT[oid,dbl]" ] > [ "tj_extend_collection(str, BAT[void,str]) : void" ] > +[ "tj_fb_terms(str, BAT[int,BAT], int, dbl) : BAT[void,str]" ] > [ "tj_get_collection_lock(str) : lock" ] > [ "tj_get_ft_index(BAT[str,str], bit) : str" ] > [ "tj_global_delete() : void" ] > > --- NEW FILE: fbterms.xq --- > let $d := pf:collection("thesis.xml") > let $opt1 := <TijahOptions ft-index="porter" returnNumber="4"/> > let $opt2 := <TijahOptions ft-index="snowball" returnNumber="4"/> > let $opt3 := <TijahOptions ft-index="nostem" returnNumber="4"/> > let $opts := ($opt1, $opt2, $opt3) > return <res> > { > for $opt in $opts > for $e in $d//section > return <bubble stemming="{$opt/@ft-index}"> { tijah:fb-terms($e, $opt) } > </bubble> > } > </res> > > > ------------------------------------------------------------------------------ > This SF.Net email is sponsored by the Verizon Developer Community > Take advantage of Verizon's best-in-class app development support > A streamlined, 14 day to market process makes app distribution fast and easy > Join now and get one step closer to millions of Verizon customers > http://p.sf.net/sfu/verizon-dev2dev > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/Tests options_test.xq.in, , NONE, 1.1 terms2.xq, , NONE, 1.1 terms3.xq, , NONE, 1.1 terms4.xq, , NONE, 1.1 terms_tf.xq, , NONE, 1.1 tf1.xq, , NONE, 1.1 tf2.xq, , NONE, 1.1 tfall.xq, , NONE, 1.1
by Stefan Manegold 03 Feb '10

03 Feb '10

Henning, could you please also provide / approved the expected/correct stable output for your new tests? Thanks! Stefan On Tue, Dec 22, 2009 at 11:49:07AM +0000, Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/Tests > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv29234 > > Added Files: > options_test.xq.in terms2.xq terms3.xq terms4.xq terms_tf.xq > tf1.xq tf2.xq tfall.xq > Log Message: > adding test cases for new functions > > > > --- NEW FILE: tfall.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > let $e := $d//thesis > for $s in ("XML","Tijah","Pathfinder") > return (tijah:tf-all($s, $opt), tijah:tf($e, $s, $opt)) > > --- NEW FILE: terms4.xq --- > let $d := pf:collection("thesis.xml") > let $opt1 := <TijahOptions ft-index="porter"/> > let $opt2 := <TijahOptions ft-index="snowball"/> > let $opt3 := <TijahOptions ft-index="nostem"/> > let $opts := ($opt1, $opt2, $opt3) > return <res> > { > for $opt in $opts > for $e in $d//section > return <section stemming="{$opt/@ft-index}"> { tijah:terms($e, $opt) } > </section> > } > </res> > > --- NEW FILE: tf1.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > let $e := $d//section > for $s in ("XML","Tijah") > return tijah:tf($e, $s, $opt) > > --- NEW FILE: tf2.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > let $s := "XML" > for $e in $d//section > return tijah:tf($e, $s, $opt) > > --- NEW FILE: terms_tf.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions stemmedterms="true" ft-index="snowball"/> > return <terms> > { > for $e at $r in $d//section > return <section num="{$r}"> > { > for $t in tijah:terms($e, $opt) > return <term name="{$t}"> {tijah:tf($e, $t, $opt)} </term> > } > </section> > } > </terms> > > --- NEW FILE: options_test.xq.in --- > tijah:create-ft-index( > ("thesis.xml"), > <TijahOptions > ft-index="porter" > tokenizer="fast" > stemmer="porter-english" > /> > ) > <> > tijah:create-ft-index( > ("thesis.xml"), > <TijahOptions > ft-index="snowball" > stemmer="snowball-english" > /> > ) > <> > tijah:create-ft-index( > ("thesis.xml"), > <TijahOptions > ft-index="nostem" > /> > ) > > > --- NEW FILE: terms3.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > return <res> > { > for $e in $d//section > return <section> { tijah:terms($e, $opt) } > </section> > } > </res> > > --- NEW FILE: terms2.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > return tijah:terms($d//section, $opt) > > > ------------------------------------------------------------------------------ > This SF.Net email is sponsored by the Verizon Developer Community > Take advantage of Verizon's best-in-class app development support > A streamlined, 14 day to market process makes app distribution fast and easy > Join now and get one step closer to millions of Verizon customers > http://p.sf.net/sfu/verizon-dev2dev > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

[Monetdb-developers] problems in windows intallation
by zhangyuan 01 Feb '10

01 Feb '10

Dear Sir/Madam, I want to build MonetDB on Windows.I have download "MonetDB-Nov2009-SuperBall-SP2.tar.bz2" and have carefully checked the FAQ and installation guide. I do as the follow website said: http://monetdb.cwi.nl/SQL/Documentation/Windows-Installation.html, but failed to installed; otherwise,I couldt't find the folder "buildtools"and the file "configure.gy" etc. look forward to your feedbacds and suggestios soon! Thank you! Sincerely, yuan zhang zhangyuan(a)dameng.com

3 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_storage.mx, Feb2010, 1.149.2.6, 1.149.2.7
by Stefan Manegold 01 Feb '10

01 Feb '10

On Mon, Feb 01, 2010 at 08:03:42AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv3139 > > Modified Files: > Tag: Feb2010 > gdk_storage.mx > Log Message: > Difference between free and size often too high to justify pre-read. ;-) > > Index: gdk_storage.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_storage.mx,v > retrieving revision 1.149.2.6 > retrieving revision 1.149.2.7 > diff -u -d -r1.149.2.6 -r1.149.2.7 > --- gdk_storage.mx 31 Jan 2010 16:43:27 -0000 1.149.2.6 > +++ gdk_storage.mx 1 Feb 2010 08:02:57 -0000 1.149.2.7 > @@ -709,25 +709,25 @@ > > if ( b->T->vheap && b->T->vheap->base && pages){ > IODEBUG THRprintf(GDKout,"#BATpreloaded(%s): T->vheap\n", BATgetId(b)); > - limit = (size_t *) (b->T->vheap->base + b->T->vheap->size); > + limit = (size_t *) (b->T->vheap->base + b->T->vheap->free); > for ( i = (size_t *) b->T->vheap->base; i < limit && pages > 0; i+= step, pages--) > dummy += *i; > } > if ( b->T->heap.base && pages ){ > IODEBUG THRprintf(GDKout,"#BATpreload(%s): T->heap\n", BATgetId(b)); > - limit = (size_t *) (b->T->heap.base + b->T->heap.size); > + limit = (size_t *) (b->T->heap.base + b->T->heap.free); > for ( i = (size_t *) b->T->heap.base; i < limit && pages > 0; i+= step, pages--) > dummy += *i; > } > if ( b->H->heap.base && pages ){ > IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->heap\n", BATgetId(b)); > - limit = (size_t *) (b->H->heap.base + b->H->heap.size); > + limit = (size_t *) (b->H->heap.base + b->H->heap.free); > for ( i = (size_t *) b->H->heap.base; i < limit && pages > 0 ; i+= step, pages--) > dummy += *i; > } > if ( b->H->vheap && b->H->vheap->base && pages ){ > IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->vheap\n", BATgetId(b)); > - limit = (size_t *) (b->H->vheap->base + b->H->vheap->size); > + limit = (size_t *) (b->H->vheap->base + b->H->vheap->free); > for ( i = (size_t *) b->H->vheap->base; i < limit && pages > 0 ; i+= step, pages--) > dummy += *i; > } > > > ------------------------------------------------------------------------------ > The Planet: dedicated and managed hosting, cloud storage, colocation > Stay online with enterprise data centers and the best network in the business > Choose flexible plans and management services without long-term contracts > Personal 24x7 support from experience hosting pros just a phone call away. > http://p.sf.net/sfu/theplanet-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_storage.mx, Feb2010, 1.149.2.5, 1.149.2.6
by Stefan Manegold 31 Jan '10

31 Jan '10

On Sun, Jan 31, 2010 at 04:43:29PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv28035 > > Modified Files: > Tag: Feb2010 > gdk_storage.mx > Log Message: > A pity that the first code was not properly checked, because it did not > even tried to force the preload by memory touching properly. > As per request (though admittedly belated ...): Wouldn't it be sufficient (and faster and less memory consuming) to preload only that part of the heaps that is indeed used (i.e., holds useful/relevant data) instead of preloading the whole (possibly consciously over-allocated) heaps? I.e., replacing ...heap->size by ...heap->free (as it was in the original code, only that the original code incorrecly assumed ...heap->free to be an absolute address instead of a relative byte offset ...) Stefan > > Index: gdk_storage.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_storage.mx,v > retrieving revision 1.149.2.5 > retrieving revision 1.149.2.6 > diff -u -d -r1.149.2.5 -r1.149.2.6 > --- gdk_storage.mx 31 Jan 2010 15:50:19 -0000 1.149.2.5 > +++ gdk_storage.mx 31 Jan 2010 16:43:27 -0000 1.149.2.6 > @@ -703,28 +703,32 @@ > @c > size_t > BATpreload_(BAT *b) { > - size_t dummy = 0, *i; > + size_t dummy = 0, *i, *limit; > size_t step = MT_pagesize()/sizeof(size_t); > size_t pages = (size_t) (0.8 * MT_npages()); > > - if ( b->T->vheap && b->T->vheap->base ){ > - IODEBUG THRprintf(GDKout,"#BATpreload(%s): T->vheap\n", BATgetId(b)); > - for ( i = (size_t *) b->T->vheap->base; i < (size_t *) b->T->vheap->free && pages > 0; i+= step, pages--) > + if ( b->T->vheap && b->T->vheap->base && pages){ > + IODEBUG THRprintf(GDKout,"#BATpreloaded(%s): T->vheap\n", BATgetId(b)); > + limit = (size_t *) (b->T->vheap->base + b->T->vheap->size); > + for ( i = (size_t *) b->T->vheap->base; i < limit && pages > 0; i+= step, pages--) > dummy += *i; > } > - if ( b->H->vheap && b->H->vheap->base ){ > - IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->vheap\n", BATgetId(b)); > - for ( i = (size_t *) b->H->vheap->base; i < (size_t *) b->H->vheap->free && pages > 0 ; i+= step, pages--) > + if ( b->T->heap.base && pages ){ > + IODEBUG THRprintf(GDKout,"#BATpreload(%s): T->heap\n", BATgetId(b)); > + limit = (size_t *) (b->T->heap.base + b->T->heap.size); > + for ( i = (size_t *) b->T->heap.base; i < limit && pages > 0; i+= step, pages--) > dummy += *i; > } > - if ( b->hheap && b->hheap->base ){ > - IODEBUG THRprintf(GDKout,"#BATpreload(%s): hheap\n", BATgetId(b)); > - for ( i = (size_t *) b->hheap->base; i < (size_t *)b->hheap->free && pages > 0 ; i+= step, pages--) > + if ( b->H->heap.base && pages ){ > + IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->heap\n", BATgetId(b)); > + limit = (size_t *) (b->H->heap.base + b->H->heap.size); > + for ( i = (size_t *) b->H->heap.base; i < limit && pages > 0 ; i+= step, pages--) > dummy += *i; > } > - if ( b->theap && b->theap->base ){ > - IODEBUG THRprintf(GDKout,"#BATpreload(%s): theap\n", BATgetId(b)); > - for ( i = (size_t *) b->theap->base; i < (size_t *) b->theap->free && pages > 0; i+= step, pages--) > + if ( b->H->vheap && b->H->vheap->base && pages ){ > + IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->vheap\n", BATgetId(b)); > + limit = (size_t *) (b->H->vheap->base + b->H->vheap->size); > + for ( i = (size_t *) b->H->vheap->base; i < limit && pages > 0 ; i+= step, pages--) > dummy += *i; > } > return dummy; > > > ------------------------------------------------------------------------------ > The Planet: dedicated and managed hosting, cloud storage, colocation > Stay online with enterprise data centers and the best network in the business > Choose flexible plans and management services without long-term contracts > Personal 24x7 support from experience hosting pros just a phone call away. > http://p.sf.net/sfu/theplanet-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

2 1

[Monetdb-developers] How to not print on screen?
by Mo Zhou 29 Jan '10

29 Jan '10

Hi, I wonder if there is a way to not print query results on screen? -- Thanks, Mo

4 5

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel aggr.mx, , 1.41, 1.42
by Stefan Manegold 29 Jan '10

29 Jan '10

On Fri, Jan 29, 2010 at 04:41:00AM +0000, Stefan de Konink wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv5117 > > Modified Files: > aggr.mx > Log Message: > Fixes typo's and/or inconsistent throw references to function names. > Please propagate to stable. The standard policy is to check in bug fixes to the latest release branch; propagation will than happen automa[tgn]ically. Back-porting such changes by hand creates quite some overhead. Stefan > > > Index: aggr.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/aggr.mx,v > retrieving revision 1.41 > retrieving revision 1.42 > diff -u -d -r1.41 -r1.42 > --- aggr.mx 7 Jan 2010 15:24:26 -0000 1.41 > +++ aggr.mx 29 Jan 2010 04:40:58 -0000 1.42 > @@ -276,7 +276,7 @@ > } > BBPreleaseref(b->batCacheid); > BBPreleaseref(e->batCacheid); > - throw(MAL, "aggrX3_sum.@4",GDK_EXCEPTION); > + throw(MAL, "aggrX3_prod.@4",GDK_EXCEPTION); > } > @- > @= AX3sumprod > @@ -548,7 +548,7 @@ > BBPreleaseref(b->batCacheid); > BBPreleaseref(e->batCacheid); > BBPreleaseref(g->batCacheid); > - throw(MAL, "aggrX3_prod3",GDK_EXCEPTION); > + throw(MAL, "aggrX3_avg3",GDK_EXCEPTION); > } > @c > @:AX3arithavg3(bte,loc)@ > @@ -590,7 +590,7 @@ > BBPreleaseref(b->batCacheid); > BBPreleaseref(e->batCacheid); > BBPreleaseref(g->batCacheid); > - throw(MAL, "aggrX3_prod3",GDK_EXCEPTION); > + throw(MAL, "aggrX3_@13",GDK_EXCEPTION); > } > @c > @:AX3extreme3(min,<)@ > @@ -627,7 +627,7 @@ > BBPreleaseref(b->batCacheid); > BBPreleaseref(e->batCacheid); > BBPreleaseref(g->batCacheid); > - throw(MAL, "aggrX3_prod3", GDK_EXCEPTION); > + throw(MAL, "aggrX3_count3", GDK_EXCEPTION); > } > @- > The remainder contains the few MIL proc translations > > > ------------------------------------------------------------------------------ > The Planet: dedicated and managed hosting, cloud storage, colocation > Stay online with enterprise data centers and the best network in the business > Choose flexible plans and management services without long-term contracts > Personal 24x7 support from experience hosting pros just a phone call away. > http://p.sf.net/sfu/theplanet-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

[Monetdb-developers] Announcement: New Nov2009-SP2 bugfix release of MonetDB suite
by Sjoerd Mullender 28 Jan '10

28 Jan '10

The MonetDB team at CWI/MonetDB BV is pleased to announce the Nov2009-SP2 bug fix release of the MonetDB suite of programs. More information on this release will be available at <http://monetdb.cwi.nl/Development/Releases/Nov2009/>. Fixes include: - No need to require bash for running the *-config scripts. (SF bug #2914563) - MonetDB5 development package now contains all development include files. (SF RFE #2929558) - Added support for compiling on OpenBSD (contributed, i.e. not tested by us). - General code improvements, partly inspired by running Coverity Scan. - mclient -D will exit with a non-zero exit code if dumping failed. (SF bug #2925674) - The Python interface now uses the same socket options as the C version, giving a boost in performance. (SF bug #2925750) - Fixed a bug in the Python interface to deal with fields with embedded newline characters. (SF bug #2917219) - Added initial support to the Python client interface for specifying the encoding. - Fixed a bug in execute argument parsing in Python interface. - Added missing .sql files to the Windows installer. - In MonetDB/SQL, fixed bug in not(invalidtable). (SF bug #2927174) -- Sjoerd Mullender

1 0

[Monetdb-developers] Regarding indexes in MonetDB XQuery
by Mo Zhou 27 Jan '10

27 Jan '10

Hi, Does MonetDB XQuery support any type of structural indexes? Or caching results of a frequently queried path (with branches)? -- Thanks, M

1 0

[Monetdb-developers] mmap region resizing
by Isidor Zeuner 26 Jan '10

26 Jan '10

While figuring out some things related to memory management, I stumbled upon a line in MonetDB/src/gdk/gdk_posix.mx which I don't fully understand: munmap(p + oldsize, oldsize - newsize); ..which is called from MT_vmrealloc when the old size is larger than the new size. This would unmap a region as large as the size difference between both sizes, but after the currently mapped region [p; p + oldsize[ (which is probably not mapped, or is mapped to something unrelated). The attached patch changes this behavior so the resulting mapped region will be [p; p + newsize[, with the now unneeded [p + newsize; p + oldsize[ region being unmapped (which is a behavior I find more intuitive). Please review and use as it fits. Best regards, Isidor Zeuner

1 0

[Monetdb-developers] GDKupgradevarheap allocate/copy inconsistency
by Isidor Zeuner 23 Jan '10

23 Jan '10

Dear MonetDB developers, please see the newly created tracker item [1]. I haven't seen relevant design documentation which would have allowed me to deduce if BATs from VIEWcreate_ are actually supposed to end up in GDKupgradevarheap, as it happened to me. Still, I could imagine the suggested fix to be a step in the right direction as it helps modularity by making the function working with less preassumptions on the inputs. However, if it fits into the global design, the capacity argument can (should?) be removed from the function signature. Best regards, Isidor Zeuner [1] https://sourceforge.net/tracker/?func=detail&aid=2936616&group_id=56967&ati…

3 6

[Monetdb-developers] sql_delta ibase issue
by Isidor Zeuner 21 Jan '10

21 Jan '10

Dear MonetDB developers, using MonetDB-SQL Feb2010, I occasionally encounter this error message: bat_storage.mx:1274: tr_update_delta: Assertion `obat->ibase == cbat->ibase' failed It occurs only seldomly, so I'll probably not have an isolated test case all too soon. I wonder if someone with more insight into the SQL engine has some pointers on where to look at. Many thanks, Isidor Zeuner

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal groupby.mx, , 1.2, 1.3
by Lefteris 17 Jan '10

17 Jan '10

it still calls GROUPmin and not GROUPavg is that the intention? On Sun, Jan 17, 2010 at 8:32 PM, Niels Nes <nielsnes(a)users.sourceforge.net> wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv30908/src/modules/mal > > Modified Files: > groupby.mx > Log Message: > fix cut/paste bug > > > Index: groupby.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/groupby.mx,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- groupby.mx 7 Jan 2010 15:24:26 -0000 1.2 > +++ groupby.mx 17 Jan 2010 19:32:16 -0000 1.3 > @@ -74,7 +74,7 @@ > > pattern avg(pivot:bat[:oid,:any_1],b:bat[:oid,:any_2]...) :bat[:oid,:any_2] > address GROUPmin > -comment "Derive the grouping of all tuples in the BATs and determine minimum value. > +comment "Derive the grouping of all tuples in the BATs and determine average value. > The group oid is materialized."; > > @- > > > ------------------------------------------------------------------------------ > Throughout its 18-year history, RSA Conference consistently attracts the > world's best and brightest in the field, creating opportunities for Conference > attendees to learn about information security's most important issues through > interactions with peers, luminaries and emerging and established companies. > http://p.sf.net/sfu/rsaconf-dev2dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel algebra.mx, , 1.231, 1.232
by Lefteris 17 Jan '10

17 Jan '10

I guess this has been since the dawn of time there:) The thing is that I am implementing standard deviation support on the aggregation functions and this new functionality goes in the dev head, thats why this commit went there too. I am trying to stay clear from stable branches for now On Sun, Jan 17, 2010 at 11:48 AM, Sjoerd Mullender <sjoerd(a)acm.org> wrote: > Wouldn't this have been appropriate on one of the branches? I'd even go > so far as suggesting the Nov2009 branch. > > On 2010-01-17 11:40, Lefteris Sidirourgos wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv5751 >> >> Modified Files: >> algebra.mx >> Log Message: >> We export the algebra avg functions twice. there is no need for that, so delete one of the two export statements >> >> >> Index: algebra.mx >> =================================================================== >> RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/algebra.mx,v >> retrieving revision 1.231 >> retrieving revision 1.232 >> diff -u -d -r1.231 -r1.232 >> --- algebra.mx 12 Jan 2010 09:13:49 -0000 1.231 >> +++ algebra.mx 17 Jan 2010 10:40:06 -0000 1.232 >> @@ -1081,17 +1081,6 @@ >> algebra_export str ALGidentity(int *ret, int *bid); >> algebra_export str ALGmaterialize(int *ret, int *bid); >> algebra_export str ALGreuse(int *ret, int *bid); >> - >> -@= avg_export >> -algebra_export str ALGavg_@1(dbl *res, int *bid) { >> -@h >> -@:avg_export(bte)@ >> -@:avg_export(sht)@ >> -@:avg_export(int)@ >> -@:avg_export(wrd)@ >> -@:avg_export(lng)@ >> -@:avg_export(flt)@ >> -@:avg_export(dbl)@ >> #endif >> @c >> #include "mal_config.h" >> >> >> ------------------------------------------------------------------------------ >> Throughout its 18-year history, RSA Conference consistently attracts the >> world's best and brightest in the field, creating opportunities for Conference >> attendees to learn about information security's most important issues through >> interactions with peers, luminaries and emerging and established companies. >> http://p.sf.net/sfu/rsaconf-dev2dev >> _______________________________________________ >> Monetdb-checkins mailing list >> Monetdb-checkins(a)lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > -- > Sjoerd Mullender > > ------------------------------------------------------------------------------ > Throughout its 18-year history, RSA Conference consistently attracts the > world's best and brightest in the field, creating opportunities for Conference > attendees to learn about information security's most important issues through > interactions with peers, luminaries and emerging and established companies. > http://p.sf.net/sfu/rsaconf-dev2dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

2 1

[Monetdb-developers] MonetDB/XQuery on Ruby with DataMapper
by Tinco Andringa 17 Jan '10

17 Jan '10

Darn, just when I decided to announce my port of the monetdb-ruby-sql gem to xquery, you release a fix of your own :P Anyway it's here: http://github.com/d-snp/ruby-monetdb-xquery There's still some differences between the official one and mine, I think mine handles errors a bit more gracefully, but it could be I missed something. I will look at the other changes as soon as possible to see if mine has any odd behaviour. In the following weeks I will be working on making XQuery and MonetDB work on DataMapper (since DataMapper is a nicer framework than ActiveRecord, and also ActiveRecord depends heavily on SQL) If anyone has any comments on this or any questions or would like to help out then please let me hear. I plan on putting the datamapper implementation on github too somewhere this week. Kind regards, Tinco Andringa

2 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah pftijah_stem.mx, , 1.15, 1.16
by Stefan Manegold 15 Jan '10

15 Jan '10

On Fri, Jan 15, 2010 at 03:54:05PM +0000, Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv4282 > > Modified Files: > pftijah_stem.mx > Log Message: > remove dublicates from stopword list Is this a new feature for the May2010 release, or should this rather be a bug fix for the Feb2010 release? Stefan > > Index: pftijah_stem.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/pftijah_stem.mx,v > retrieving revision 1.15 > retrieving revision 1.16 > diff -u -d -r1.15 -r1.16 > --- pftijah_stem.mx 20 Apr 2009 23:30:46 -0000 1.15 > +++ pftijah_stem.mx 15 Jan 2010 15:54:03 -0000 1.16 > @@ -135,7 +135,6 @@ > "does",\ > "done",\ > "down",\ > -"down",\ > "downed",\ > "downing",\ > "downs",\ > @@ -208,8 +207,6 @@ > "here",\ > "herself",\ > "high",\ > -"high",\ > -"high",\ > "higher",\ > "highest",\ > "him",\ > @@ -284,7 +281,6 @@ > "needs",\ > "never",\ > "new",\ > -"new",\ > "newer",\ > "newest",\ > "next",\ > @@ -351,7 +347,6 @@ > "rather",\ > "really",\ > "right",\ > -"right",\ > "room",\ > "rooms",\ > "s",\ > @@ -391,7 +386,6 @@ > "state",\ > "states",\ > "still",\ > -"still",\ > "such",\ > "sure",\ > "t",\ > > > ------------------------------------------------------------------------------ > Throughout its 18-year history, RSA Conference consistently attracts the > world's best and brightest in the field, creating opportunities for Conference > attendees to learn about information security's most important issues through > interactions with peers, luminaries and emerging and established companies. > http://p.sf.net/sfu/rsaconf-dev2dev > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

2 1

[Monetdb-developers] New stable branch created
by Sjoerd Mullender 13 Jan '10

13 Jan '10

I have created new stable branches for the next feature release. This branch was created in order to stabilize the code before the feature release. From now on *only* bug fixes may go to this new stable branch. I reserve the right to undo any changes that do not comply with this rule. I also reserve the right to admit changes that are not strictly bug fixes. However, these are only allowed after consultation with me, and only before the first relese from this branch. All packages use the same name for the branch: Feb2010. So in each of your stable checkout directories you can do cvs update -rFeb2010 to update to this new branch. I have created branches for the following packages: MonetDB clients testing MonetDB4 MonetDB5 buildtools pathfinder sql geom java template TestTools. Note that datacell is missing from this list. It is not yet released and will not be released in this round. -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/rdf rdf_shredder.mx, , 1.10, 1.11
by Lefteris 06 Jan '10

06 Jan '10

That explains a lot:) Thank you! On Wed, Jan 6, 2010 at 10:34 AM, Fabian <mr-meltdown(a)users.sourceforge.net> wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/rdf > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv21323 > > Modified Files: > rdf_shredder.mx > Log Message: > maintainer timeout > > warning: dereferencing type-punned pointer will break strict-aliasing rules > > triple->{predicate,subject,object} are of type void*, first cast to > string pointer, then get the pointer address. > > > Index: rdf_shredder.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/rdf/rdf_shredder.mx,v > retrieving revision 1.10 > retrieving revision 1.11 > diff -u -d -r1.10 -r1.11 > --- rdf_shredder.mx 4 Jan 2010 17:06:23 -0000 1.10 > +++ rdf_shredder.mx 6 Jan 2010 09:33:59 -0000 1.11 > @@ -148,7 +148,10 @@ > } > > @= rdf_tknzr_insert > -TKNZRdeposit(&bun,(str *)&(@1)); > +{ > + str t = @1; > + TKNZRdeposit(&bun,&t); > +} > > @= rdf_BUNappend > {@1 = BUNappend(@1, @2, TRUE);} > @@ -166,7 +169,7 @@ > > if (triple->subject_type == RAPTOR_IDENTIFIER_TYPE_RESOURCE > || triple->subject_type == RAPTOR_IDENTIFIER_TYPE_ANONYMOUS) { > - @:rdf_insert(graph[MAP_LEX],triple->subject)@ > + @:rdf_insert(graph[MAP_LEX],(str)triple->subject)@ > @:rdf_BUNappend(graph[S_sort], &bun)@ > bun = BUN_NONE; > } else { > @@ -174,7 +177,7 @@ > } > > if (triple->predicate_type == RAPTOR_IDENTIFIER_TYPE_RESOURCE) { > - @:rdf_insert(graph[MAP_LEX],triple->predicate)@ > + @:rdf_insert(graph[MAP_LEX],(str)triple->predicate)@ > @:rdf_BUNappend(graph[P_sort], &bun)@ > bun = BUN_NONE; > } else { > @@ -183,7 +186,7 @@ > > if (triple->object_type == RAPTOR_IDENTIFIER_TYPE_RESOURCE > || triple->object_type == RAPTOR_IDENTIFIER_TYPE_ANONYMOUS) { > - @:rdf_insert(graph[MAP_LEX],triple->object)@ > + @:rdf_insert(graph[MAP_LEX],(str)triple->object)@ > @:rdf_BUNappend(graph[O_sort], &bun)@ > bun = BUN_NONE; > } else if (triple->object_type == RAPTOR_IDENTIFIER_TYPE_LITERAL) { > > > ------------------------------------------------------------------------------ > This SF.Net email is sponsored by the Verizon Developer Community > Take advantage of Verizon's best-in-class app development support > A streamlined, 14 day to market process makes app distribution fast and easy > Join now and get one step closer to millions of Verizon customers > http://p.sf.net/sfu/verizon-dev2dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk.mx, , 1.294, 1.295 gdk_atoms.mx, , 1.168, 1.169 gdk_bbp.mx, , 1.267, 1.268 gdk_heap.mx, , 1.129, 1.130 gdk_search.mx, , 1.89, 1.90
by Stefan de Konink 05 Jan '10

05 Jan '10

Op 05-01-10 20:54, Sjoerd Mullender schreef: > There is also code in there to store the string length before the hash > value, but this is not enabled in this version. It would increase the > space requirements for probably very little (if any) gain. As in the feature request was suggested, the stringlength will significantly help LIKE operations, if a preselection is made based on this value. (Hence a like operation with % would always be equal or longer than the specified constant length + the single character modification count, if not present: equal) How can I enable the length storage? Stefan

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB4/src/modules/plain aggr.mx, , 1.12, 1.13 ascii_io.mx, , 1.34, 1.35 bat.mx, , 1.37, 1.38 mkey.mx, , 1.17, 1.18 radix.mx, , 1.11, 1.12 xtables.mx, , 1.22, 1.23
by Sjoerd Mullender 04 Jan '10

04 Jan '10

I forgot to say, a full rebuild will be necessary (some essential macros deep in gdk were changed). Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB4/src/modules/plain > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv28677/MonetDB4/src/modules/plain > > Modified Files: > aggr.mx ascii_io.mx bat.mx mkey.mx radix.mx xtables.mx > Log Message: > Changed the implementation of the offset heap for type string. > > Before, the offset heap would contain values of type var_t (typically > equal in size to oid), so if there are lots of entries but not that > many different strings, a lot of space was wasted, since only the > lower few bytes of the values in the offset heap would be used, the > rest being zero. > > In this version, the offset heap has a dynamic width. It starts off > as a single byte value, and when the offsets become too large to fit > in a single byte, the heap is upgraded to a short, then an int, and > finally (if the system uses 64 bit oids) to lng. > > There are tags to mark this change: > before_variable_string_offset and after_variable_string_offset. > > Only MonetDB* and pathfinder needed to be changes, so the tags are > only added there. -- Sjoerd Mullender

1 0

[Monetdb-developers] Open source database survey - response requested from a MonetDB developer!
by Selena Deckelmann 01 Jan '10

01 Jan '10

Hi! My name is Selena Deckelmann, and I'm giving a talk at LinuxConf AU 2010 called "A Survey of Open Source Databases". The goal of the talk is to give developers and software architects an overview of the open source tools that are out there, and a sense of which types of problems your software is intended to solve. I'm contacting over 30 projects. If there is a better person or mailing list to direct my questions to, please point the way! I've done some basic research, but it would very much help me to have answers to questions I've included below in your own words. Also, if a representative from your project has time for a short phone call, I'd be happy to get answers to these questions by voice (Skype/Jabber/regular old phone all works for me). Anyway - the survey is here: http://bit.ly/8yarGr Even just responding to the first few questions would be helpful, if you don't have time for them all. About me: I primarily volunteer with the PostgreSQL project for creation of user groups, advocacy and support our project's systems infrastructure, and I contribute to a replication system called Bucardo. I'm also President of Technocation, a 501(c)3 non-profit in the US that helps organize OpenSQLCamp, WhereCampPDX and other un-conference events, and distributes free video for open source technical events we're able to record. -- http://chesnok.com/daily - me http://endpoint.com - work

1 0

[Monetdb-developers] memory usage question
by Mark Bucciarelli 23 Dec '09

23 Dec '09

I'm seeing some behavior that makes me wonder if mserver5 leaks. I'm using Ubuntu 9.04 w/ 32-bit i386 and 500 MB of RAM. This is 2009Nov CVS. Does this sequence of steps and memory usage look right? 1. Reboot the server and start merovingian 0m -- mserver5 RSS (not running) 417m -- free memory reported by top 78m -- used 5m -- buffers 2. Destroy then create database 15m -- mserver5 RSS 392m -- free memory reported by top 3. Add tables to database 21m -- mserver5 RSS 378m -- free memory reported by top 4. Import a small table (38,000 rows, autoincr int + varchar(1024)) 29m -- mserver5 RSS 350m -- free memory reported by top 5. Repeat steps 2 through 4 three times. 29m -- mserver5 RSS !!! 225m -- free memory reported by top 6. Shut down merovingian !!! 251m -- free memory reported by top 242m -- used 136m -- buffers Why is top only showing 251m of free memory? Yesterday, the system started to swap when free memory, as reported by top, was exhausted. And I bet I could get it to swap if I ran lots more iterations in step 5 above. I know that having free close to zero is a good thing, as it means you are using your RAM, but that swapping is never good on a database server. :) I'm not using the server for anything else at the moment, other than SSH and transferring data from SQLite to MonetDB via mclient and files of SQL commands. As a related question, what is the minimum RAM need to run MonetDB? I'd like to get it running on an old slow computer running OpenBSD to check how well Monet handles memory pressure and to turn on OpenBSD's paranoid malloc options. Are there some knobs I can turn to make monetdb5 run when there is only 100MB of free memory after the OS starts up? That swapping yesterday got me a nervous about stability, especially since stopping and restarting merovingian didn't give the memory back. Thanks, m

1 0

[Monetdb-developers] Stable tree?
by Mark Bucciarelli 21 Dec '09

21 Dec '09

Hi, I've been using CVS HEAD to test against, but now I'm wondering if I should switch the Nov2009 branch. I'm going to use Monet DB in production for an in-house project, so I would prefer a reasonable level of stability. Which source tree should I track? Thanks! m

3 2

[Monetdb-developers] hashjoin and strHash
by Wouter Alink 19 Dec '09

19 Dec '09

Dear developers, I would like to propose a change in GDK and hear opinions. It is about the following issue: in the BATjoin code, if there is no possibility to do a fetch or merge join, a hashjoin is performed. A hashtable is created for the smallest BAT. The reasons (i could think of) for choosing the smallest BAT for the hashtable are that less space is required for the hashtable (which in turn causes less cache misses when doing a lookup) and also because the hashfunction used is assumed to be very inexpensive (it needs to be calculated for each item in the large bat each time a join is performed). I can see that the hashfunction can be very efficient for data types without indirection, but I feel that for data types like strings in some cases this is a little different. If a string BAT for example contains many different values (i.e. is not a bat which contains enumeration values) the hashfunction will not be inexpensive anymore (many cache misses), as each hashfunction call needs to hash a whole (arbitrary long) string at an arbitrary place in the heap. Is it perhaps possible to specify that, when a BAT of type 'str' has many different values a hashtable may be build on the large BAT instead of on the small BAT? Reason that I ask this: I was analysing costs of a query in which I had a few short strings (26 tuples, 1-column table: varchar) which I wanted to look up in a dictionary (9M tuples, 2-column table: int,varchar). "SELECT a.id FROM longlist AS a JOIN smalllist as b ON a.strvalue=b.strvalue;" The result is a small list of integers (26 or less tuples). This operation currently takes roughly 1.5 seconds for a hot run, mostly due to 9M strHash operations. By applying the patch below the execution time for a hot run dropped down to .01 seconds. The performance gain is caused by only having to perform strHash on the items in the small bat once the hashtable for the large bat has been created. Any suggestions whether such a change is useful? Which benchmarks will be influenced? I guess this code change is probably not useful for large string BATs with only few different values, but perhaps a guess could be made how diverse the strings in a bat are (by taking a sample or perhaps simply by looking at the ratio batsize/heapsize), and based on that determine whether to build it on the large or small BAT? Greetings, Wouter Index: src/gdk/gdk_relop.mx =================================================================== RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_relop.mx,v retrieving revision 1.167.2.4 diff -u -r1.167.2.4 gdk_relop.mx --- src/gdk/gdk_relop.mx 20 Nov 2009 13:04:06 -0000 1.167.2.4 +++ src/gdk/gdk_relop.mx 18 Dec 2009 14:59:13 -0000 @@ -1232,7 +1232,12 @@ @- hash join: the bread&butter join of monet @c - /* Simple rule, always build hash on the smallest */ + /* Simple rule, always build hash on the smallest, + except when it is a string-join, then we do the opposite */ + if (swap && rcount < lcount && l->ttype == TYPE_str) { + ALGODEBUG THRprintf(GDKout, "#BATjoin: BATmirror(BAThashjoin(BATmirror(r), BATmirror(l)," BUNFMT "));\n", estimate); + return BATmirror(BAThashjoin(BATmirror(r), BATmirror(l), estimate)); + } if (swap && rcount > lcount) { ALGODEBUG THRprintf(GDKout, "#BATjoin: BATmirror(BAThashjoin(BATmirror(r), BATmirror(l)," BUNFMT "));\n", estimate);

5 8

[Monetdb-developers] Memory use
by Voornaam Achternaam 19 Dec '09

19 Dec '09

When I try to fill a database with the COPY INTO command, the data will (depending on the file used) either go: - Fully into Memory. - To HDD. - A combination of Memory and HDD space. Is there a way to configure MonetDB so that it always uses Memory only? Thanks in advance. -- View this message in context: http://old.nabble.com/Memory-use-tp26843876p26843876.html Sent from the monetdb-developers mailing list archive at Nabble.com.

2 1

[Monetdb-developers] Announcement: New Nov2009-SP1 bugfix release of MonetDB suite
by Sjoerd Mullender 18 Dec '09

18 Dec '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the Nov2009-SP1 bug fix release of the MonetDB suite of programs. More information on this release will be available at <http://monetdb.cwi.nl/Development/Releases/Nov2009/>. Fixes include: - The Windows installers for MonetDB/SQL in the Nov2009 release were incomplete. The missing files have been added. - Fixed performance issue with loading complex schemas in readonly mode in MonetDB/SQL. - Fixed performance issue with grouping in MonetDB/SQL when one of the columns is sorted. - Fixed problems with LIKE joins in MonetDB/SQL. - Load all files in a multi-file COPY INTO query. - Fix error reporting of unexpected input in XQuery queries to be Unicode aware. - Correctly handle circular dependencies in FD property check. (SF bug #2908615.) - Fixes throughout the code base to better cope with unexpected situations (such as memory shortage). -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_system.mx, , 1.120, 1.121
by Runqing Zou 16 Dec '09

16 Dec '09

The lines +# else +# error "don't know how to get the amount of physical memory for your OS" +# endif will break on Windows. Thanks, Ren Zou Fabian wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv17611 > > Modified Files: > gdk_system.mx > Log Message: > If there is a limit get on the memory usage, take it into account, such that the GDK kernel can make the proper decisions. Indented ifdefs to make nesting structure clear. Added comment on probably obsolete piece of code. > > Index: gdk_system.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_system.mx,v > retrieving revision 1.120 > retrieving revision 1.121 > diff -u -d -r1.120 -r1.121 > --- gdk_system.mx 4 Nov 2009 16:49:24 -0000 1.120 > +++ gdk_system.mx 15 Dec 2009 12:38:37 -0000 1.121 > @@ -339,9 +339,9 @@ > _MT_pagesize = sysInfo.dwPageSize; > } > #else > -#if defined(HAVE_SYSCONF) && defined(_SC_PAGESIZE) > +# if defined(HAVE_SYSCONF) && defined(_SC_PAGESIZE) > _MT_pagesize = sysconf(_SC_PAGESIZE); > -#endif > +# endif > #endif > if (_MT_pagesize <= 0) > _MT_pagesize = 4096; /* default */ > @@ -366,14 +366,40 @@ > #if defined(HAVE_SYSCONF) && defined(_SC_PHYS_PAGES) > _MT_npages = sysconf(_SC_PHYS_PAGES); > #else > -#ifdef HAVE_GETRLIMIT > +# if defined(HAVE_GETRLIMIT) && defined(RLIMIT_RSS) > { > struct rlimit rl; > > + /* Specifies the limit (in pages) of the process's resident set > + * (the number of virtual pages resident in RAM). This limit > + * only has effect in Linux 2.4.x, x < 30, and there only > + * affects calls to madvise() specifying MADV_WILLNEED */ > + /* FIXME: this looks like a total wrong thing to check in any > + * case to me */ > getrlimit(RLIMIT_RSS, &rl); > _MT_npages = rl.rlim_cur / _MT_pagesize; > } > +# else > +# error "don't know how to get the amount of physical memory for your OS" > +# endif > #endif > +#ifdef HAVE_GETRLIMIT > + { > + struct rlimit rl; > + size_t memlim; > + > + /* The environment can be limited memory wise. In such case the > + * physically available memory, is not necessarily what we can > + * also use. */ > + getrlimit(RLIMIT_DATA, &rl); > + if (rl.rlim_cur != (rlim_t)RLIM_INFINITY) { > + /* rlimit returns in bytes, recalculate */ > + memlim = rl.rlim_cur / _MT_pagesize; > + /* if it's more restrictive, take that as value */ > + if (memlim < _MT_npages) > + _MT_npages = memlim; > + } > + } > #endif > } > > > > ------------------------------------------------------------------------------ > Return on Information: > Google Enterprise Search pays you back > Get the facts. > http://p.sf.net/sfu/google-dev2dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > >

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB configure.ag, Nov2009, 1.208.2.2, 1.208.2.3
by Stefan Manegold 14 Dec '09

14 Dec '09

On Thu, Nov 12, 2009 at 09:06:23AM +0000, Fabian wrote: > Update of /cvsroot/monetdb/MonetDB > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25980 > > Modified Files: > Tag: Nov2009 > configure.ag > Log Message: > Yippy yay for messing with this at this stage of the development cycle... Revert my yesterday's commit here as it not only breaks compilation on OSX 10.6 (the original problem), but also Solaris 10. We need to facilitate people doing cross-compilation in some other way. Might simply using AC_CHECK_FUNCS(fdatasync) be an option, here? Stefan > Index: configure.ag > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/configure.ag,v > retrieving revision 1.208.2.2 > retrieving revision 1.208.2.3 > diff -u -d -r1.208.2.2 -r1.208.2.3 > --- configure.ag 11 Nov 2009 11:17:52 -0000 1.208.2.2 > +++ configure.ag 12 Nov 2009 09:06:21 -0000 1.208.2.3 > @@ -94,17 +94,15 @@ > > # Checks for library functions. > > -# OSX 10.6 (Snow Leopard) somehow makes configure believe that fdatasync > -# exists, in reality however, it does not on this platform. > -AC_CACHE_CHECK([for fdatasync],[ac_cv_func_fdatasync],[ > - AC_COMPILE_IFELSE([AC_LANG_PROGRAM([[ > +# Fix for OSX 10.6 (Snow Leopard) stolen from: > +# http://blogs.sun.com/elambert/entry/drizzle_in_the_snow_how > +AC_RUN_IFELSE([AC_LANG_PROGRAM([[ > #include <unistd.h> > ]],[[ > fdatasync(4); > ]])], > [ac_cv_func_fdatasync=yes], > [ac_cv_func_fdatasync=no]) > -]) > AS_IF([test "x${ac_cv_func_fdatasync}" = "xyes"], > [AC_DEFINE([HAVE_FDATASYNC],[1],[If the system has a working fdatasync])]) > > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 5

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_recycler.mx, , 1.59, 1.60
by Milena.Ivanova＠cwi.nl 11 Dec '09

11 Dec '09

> Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory > sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv5440/MonetDB5/src/optimizer > > Modified Files: > opt_recycler.mx > Log Message: > > recycleSeq is stored in MalBlkRecord.recid; > since the latter is of type int, > it does not make much sense > to have the former of type lng. > > Or should both be of type lng? Thanks, the intention was they all to be of type lng. Milena > > And what about QryStat.recid? > That is (currently) of type lng > and used to store MalBlkRecord.recid > ... > > (found by Microsoft's Visual Studio compiler on Windows) > > > Index: opt_recycler.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_recycler.mx,v > retrieving revision 1.59 > retrieving revision 1.60 > diff -u -d -r1.59 -r1.60 > --- opt_recycler.mx 2 Dec 2009 13:39:29 -0000 1.59 > +++ opt_recycler.mx 10 Dec 2009 22:05:27 -0000 1.60 > @@ -104,7 +104,7 @@ > #include "opt_recycler.h" > #include "mal_instruction.h" > > -static lng recycleSeq = 0; > +static int recycleSeq = 0; > > static int > OPTrecycleImplementation(Client cntxt, MalBlkPtr mb, MalStkPtr stk, > InstrPtr p) > > > ------------------------------------------------------------------------------ > Return on Information: > Google Enterprise Search pays you back > Get the facts. > http://p.sf.net/sfu/google-dev2dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal pma.mx, , 1.7, 1.8
by Sjoerd Mullender 06 Dec '09

06 Dec '09

I noticed that you return constant strings when an error occurs. This doesn't work since the interpreter expects that strings are allocated with GDKmalloc (i.e., it calls GDKfree on the error messages). When you want to return an error, use the macro throw() (see numerous examples in the code). Also, I noticed that there are calls to PMAnew in your code that don't check the return value (which could be an allocated string per the above), so there is a potential memory leak here. (Plus, when PMAnew fails for whatever reason, you may not want to continue.) This latter remark might be true for other functions. I didn't check. Tang Nan wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv28068/src/modules/mal > > Modified Files: > pma.mx > Log Message: > fix some bugs about type conversion failure on Windows > > > Index: pma.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/pma.mx,v > retrieving revision 1.7 > retrieving revision 1.8 > diff -u -d -r1.7 -r1.8 > --- pma.mx 2 Nov 2009 16:53:38 -0000 1.7 > +++ pma.mx 4 Dec 2009 08:52:46 -0000 1.8 > @@ -75,10 +75,6 @@ > @:pma_mal(lng)@ > @:pma_mal(flt)@ > @:pma_mal(dbl)@ > -@( > -StM: disabled as the code clearly cannot handle type str (yet?) > -@:pma_mal(str)@ > -@) > > @+ PMA API > @h > @@ -115,10 +111,6 @@ > @:pma_decl(lng)@ > @:pma_decl(flt)@ > @:pma_decl(dbl)@ > -@( > -StM: disabled as the code clearly cannot handle type str (yet?) > -@:pma_decl(str)@ > -@) > #endif /* _PMA_H_ */ > > @+ PMA implementation > @@ -155,10 +147,6 @@ > for (cnt = PMA_SEG; cnt < *sz; cnt <<= 1); /* figure out the size */ > b = BATnew(TYPE_void, *tpe, cnt); > if (b) { > -@( > -StM: disabled as the code clearly cannot handle other than fixed-size linear types (yet?) > - var_t nil_off; > -@) > switch(ATOMstorage(*tpe)) { > case TYPE_chr: @:fillnill(chr, chr_nil)@ > case TYPE_bte: @:fillnill(bte, bte_nil)@ > @@ -168,15 +156,8 @@ > case TYPE_flt: @:fillnill(flt, flt_nil)@ > case TYPE_dbl: @:fillnill(dbl, dbl_nil)@ > case TYPE_ptr: @:fillnill(ptr, ptr_nil)@ > - default: > - BBPunfix(b->batCacheid); > - return "PMAnew: type not supported (yet?)"; > -@( > -StM: disabled as the code clearly cannot handle other than fixed-size linear types (yet?) > - BUNins(b, NULL, (ptr)str_nil, FALSE); > - nil_off = *(var_t*) Tloc(b, BUNfirst(b)); > - @:fillnill(wrd, nil_off)@ > -@) > + default: BBPunfix(b->batCacheid); > + return "PMAnew: type not supported (yet?)"; > } > BATsetcount(b, cnt); > b->tsorted = 0; > @@ -417,7 +398,7 @@ > bat ret; > BAT *b, *bn; > @1 *base, *basen; > - (void)dummy; > + dummy = 0; > b = BATdescriptor(*bid); > if (b == NULL) return "PMAdel: illegal bat parameter"; > psz = BATcount(b); > @@ -725,9 +706,9 @@ > pma_export str > PMAbulkins_@1(oid *pos_res, bat *bid, oid *pos, bat *ibid) { > bit fgw, fg; > - int tpe, size; > + int tpe, size, slen; > oid i, j, k, ht, sz, isz, psz, cnt, icnt, lv, wsz, snum, scl, scr, wbeg, mpos, cur; > - dbl dens, dent, step, dstep, slen; > + dbl dens, dent, step, dstep; > bat ret; > BAT *b, *bi, *bn; > @1 *base, *basei, *basen; > @@ -795,7 +776,7 @@ > cur = i; > } > } else { > - if (fg && (i - cur >= slen)) { > + if (fg && ((int)(i - cur) >= slen)) { > base[cur] = base[i]; > base[i] = (@1)@1_nil; > cur += slen; > @@ -815,7 +796,7 @@ > cur = i; > } > } else { > - if (fg && (cur - i >= slen)) { > + if (fg && ((int)(cur - i) >= slen)) { > base[cur] = base[i]; > base[i] = (@1)@1_nil; > cur -= slen; > @@ -839,7 +820,7 @@ > while (TaoMin * size < cnt + icnt) size <<= 1; > dstep = (dbl)size / (cnt + icnt); > slen = ceil(dstep); > - if ((cnt + icnt) * slen > size) slen--; > + if ((int)(cnt + icnt) * slen > size) slen--; > tpe = TYPE_@1; > PMAnew(&ret, &tpe, &size); > bn = BATdescriptor(ret); > @@ -877,7 +858,7 @@ > BAT *b; > oid lo, hi, lo_res, hi_res, pos_res; > int i; > - (void)dummy; > + dummy = 0; > b = BATdescriptor(*bid); > if (b == NULL) return "PMAfnd: illegal bat parameter"; > for (i = 0; i < *num; i++) { > @@ -916,7 +897,3 @@ > @:pma_impl(lng)@ > @:pma_impl(flt)@ > @:pma_impl(dbl)@ > -@( > -StM: disabled as the code clearly cannot handle type str (yet?) > -@:pma_impl(str)@ > -@) > > > ------------------------------------------------------------------------------ > Join us December 9, 2009 for the Red Hat Virtual Experience, > a free event focused on virtualization and cloud computing. > Attend in-depth sessions from your desk. Your couch. Anywhere. > http://p.sf.net/sfu/redhat-sfdev2dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

3 3

Re: [Monetdb-developers] [Monetdb-checkins] buildtools/conf mchangelog, Nov2009, NONE, 1.1.2.1 Makefile.am, Nov2009, 1.8.8.1, 1.8.8.2
by Sjoerd Mullender 01 Dec '09

01 Dec '09

You couldn't wait for the script I was creating? Also, my script does not depend on Perl (yet another dependency). Fabian wrote: > Update of /cvsroot/monetdb/buildtools/conf > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv23498/conf > > Modified Files: > Tag: Nov2009 > Makefile.am > Added Files: > Tag: Nov2009 > mchangelog > Log Message: > Added mchangelog script that I use to add ChangeLog entries. The script is a highly modified version of Gentoo's echangelog script. > > --- NEW FILE: mchangelog --- > #!/usr/bin/env perl > # > # shameless echangelog rip from Gentoo with modifications for MonetDB > # > # echangelog: Update the ChangeLog for an ebuild. For example: > # > # $ echangelog 'Add ~alpha to KEYWORDS' > # 4a5,7 > # > 10 Feb 2003; Aron Griffis <agriffis(a)gentoo.org> oaf-0.6.8-r1.ebuild : > # > Add ~alpha to KEYWORDS > # > > > use strict; > use POSIX qw(strftime getcwd setlocale); > > # Fix bug 21022 by restricting to C locale > setlocale(&POSIX::LC_ALL, "C"); > > use Text::Wrap; > $Text::Wrap::columns = 77; > $Text::Wrap::unexpand = 0; > > # Global variables > my (@files, @ebuilds, @conflicts, @trivial, @unknown, %actions); > my ($input, $editor, $entry, $user, $date, $text, $version, $year); > > my $ChangeLog = 'ChangeLog'; > if (-f 'CVS/Tag') { > open I, '<CVS/Tag' or die "Can't open CVS/Tag for input: $!\n"; > { local $/ = undef; $text = <I>; } > close I; > $text =~ s/^T//; > $text =~ s/\s+$//; > $ChangeLog .= '.'.$text; > } > # Read the current ChangeLog > if (-f $ChangeLog) { > open I, '<'.$ChangeLog or die "Can't open $ChangeLog for input: $!\n"; > { local $/ = undef; $text = <I>; } > close I; > } else { > die "please copy a $ChangeLog skeleton file\n"; > } > > # Figure out what has changed around here > if (-d 'CVS') { > open C, 'cvs -fn up 2>&1 |' or die "Can't run cvs -fn up: $!\n"; > while (<C>) { > if (/^C (\S+)/) { > push @conflicts, $1; > next; > } elsif (/^\? (\S+)/) { > push @unknown, $1; > $actions{$1} = '+'; > next; > } elsif (/^([ARM]) (\S+)/) { > push @files, $2; > ($actions{$2} = $1) =~ tr/ARM/+-/d; > } > } > } elsif (-d '.svn') { > open C, 'svn status 2>&1 |' or die "Can't run svn status: $!\n"; > while (<C>) { > if (/^ ?C +(\S+)/) { > push @conflicts, $1; > next; > } elsif (/^\? +(\S+)/) { > push @unknown, $1; > $actions{$1} = '+'; > next; > } elsif (/^([ADRM])[ \+]+(\S+)/) { > push @files, $2; > ($actions{$2} = $1) =~ tr/ADRM/+-/d; > } > } > } > > # Separate out the trivial files for now > @files = grep { > !/files.digest|Manifest|ChangeLog.*/ or do { push @trivial, $_; 0; } > } @files; > @unknown = grep { > !/files.digest|Manifest|ChangeLog.*/ or do { push @trivial, $_; 0; } > } @unknown; > > # Don't allow any conflicts > if (@conflicts) { > print STDERR <<EOT; > Cvs reports the following conflicts. Please resolve them before > running echangelog. > EOT > print STDERR map "C $_\n", @conflicts; > exit 1; > } > > # Don't allow unknown files (other than the trivial files that were separated > # out above) > if (@unknown) { > print STDERR <<EOT; > cvs/svn reports the following unknown files. Please review and use > "cvs/svn add" when these files should be committed before running > mchangelog. > EOT > print STDERR map "? $_\n", @unknown; > } > > close C; > > # Check if we have any files left, otherwise re-insert ebuild list > # (of course, both might be empty anyway) > @files = @ebuilds unless (@files); > > # Allow ChangeLog entries with no changed files, but give a fat warning > unless (@files) { > print STDERR "**\n"; > print STDERR "** NOTE: No non-trivial changed files found. Normally mchangelog\n"; > print STDERR "** should be run after all affected files have been added and/or\n"; > print STDERR "** modified. Did you forget to cvs/svn add?\n"; > print STDERR "**\n"; > @files = sort sortfunc @trivial; > @files = qw/ChangeLog.*/ unless @files; # last resort to put something in the list > } > > # Get the input from the cmdline, editor or stdin > if ($ARGV[0]) { > $input = "@ARGV"; > } else { > # Testing for defined() allows ECHANGELOG_EDITOR='' to cancel EDITOR > $editor = defined($ENV{'ECHANGELOG_EDITOR'}) ? $ENV{'ECHANGELOG_EDITOR'} : > $ENV{'EDITOR'} || undef; > if ($editor) { > system("$editor ChangeLog.new"); > if ($? != 0) { > # This usually happens when the editor got forcefully killed; and > # the terminal is probably messed up: so we reset things. > system('/usr/bin/stty sane'); > print STDERR "Editor died! Reverting to stdin method.\n"; > undef $editor; > } else { > if (open I, "<ChangeLog.new") { > local $/ = undef; > $input = <I>; > close I; > } else { > print STDERR "Error opening ChangeLog.new: $!\n"; > print STDERR "Reverting to stdin method.\n"; > undef $editor; > } > unlink 'ChangeLog.new'; > } > } > unless ($editor) { > print "Please type the log entry: use Ctrl-d to finish, Ctrl-c to abort...\n"; > local $/ = undef; > $input = <>; > } > } > die "Empty entry; aborting\n" unless $input =~ /\S/; > > # If there are any long lines, then wrap the input at $columns chars > # (leaving 2 chars on left, one char on right, after adding indentation below). > $input =~ s/^\s*(.*?)\s*\z/$1/s; # trim whitespace > $input = Text::Wrap::fill('', '', $input) if ($input =~ /^.{80}/m); > $input =~ s/^/ /gm; # add indentation > > # Prepend the user info to the input > unless ($user = $ENV{'MCHANGELOG_USER'}) { > my ($fullname, $username) = (getpwuid($<))[6,0]; > $fullname =~ s/,.*//; # remove GECOS, bug 80011 > $user = sprintf "%s <%s\(a)cwi.nl>", $fullname, $username; > } > # Make sure that we didn't get "root" > die "Please set MCHANGELOG_USER or run as non-root\n" if $user =~ /<root@/; > $date = strftime("%d %b %Y", gmtime); > $entry = "$date; $user "; > $entry .= join ', ', map "$actions{$_}$_", @files; > $entry .= ':'; > $entry = Text::Wrap::fill(' ', ' ', $entry); # does not append a \n > $entry .= "\n$input"; # append user input > > # Each one of these regular expressions will eat the whitespace > # leading up to the next entry (except the two-space leader on the > # front of a dated entry), so it needs to be replaced with a > # double carriage-return. This helps to normalize the spacing in > # the ChangeLogs. > $text =~ s/^( .*? ) # grab header > \s*\n(?=\ \ \d|\*|\z) # suck up trailing whitespace > /$1\n\n$entry\n\n/sx > or die "Failed to insert new entry (3)\n"; > > # Write the new ChangeLog > open O, '>ChangeLog.new' or die "Can't open ChangeLog.new for output: $!\n"; > print O $text or die "Can't write ChangeLog.new: $!\n"; > close O or die "Can't close ChangeLog.new: $!\n"; > > # Move things around and show the ChangeLog diff > system 'diff -Nu '.$ChangeLog.' ChangeLog.new'; > rename 'ChangeLog.new', $ChangeLog or die "Can't rename ChangeLog.new: $!\n"; > > # Okay, now we have a starter ChangeLog to work with. > # The text will be added just like with any other ChangeLog below. > # Add the new ChangeLog to cvs/svn before continuing. > if (-d 'CVS') { > if (open F, "CVS/Entries") { > system("cvs -f add $ChangeLog") unless (scalar grep /^\/$ChangeLog\//, <F>); > } > } elsif (-d '.svn') { > if (open F, ".svn/entries") { > system("svn add $ChangeLog") unless (scalar grep /^$ChangeLog$/, <F>); > } > } > > # vim:sw=4 ts=8 expandtab > > Index: Makefile.am > =================================================================== > RCS file: /cvsroot/monetdb/buildtools/conf/Makefile.am,v > retrieving revision 1.8.8.1 > retrieving revision 1.8.8.2 > diff -u -d -r1.8.8.1 -r1.8.8.2 > --- Makefile.am 6 Nov 2009 14:02:43 -0000 1.8.8.1 > +++ Makefile.am 1 Dec 2009 13:13:58 -0000 1.8.8.2 > @@ -18,7 +18,7 @@ > ## Please run automake on this file to produce a Makefile.in > > dist_pkgdata_DATA = rules.mk MonetDB.m4 > -dist_bin_SCRIPTS = Mdebootstrap Mbootstrap buildtools-config > +dist_bin_SCRIPTS = Mdebootstrap Mbootstrap buildtools-config mchangelog > > MonetDB-release-1.0.tar.gz: MonetDB-release.spec MonetDB-release-1.0/monetdb.repo MonetDB-release-1.0/MonetDB-GPG-KEY > tar czf MonetDB-release-1.0.tar.gz -C $(srcdir) MonetDB-release.spec MonetDB-release-1.0/monetdb.repo MonetDB-release-1.0/MonetDB-GPG-KEY > > > ------------------------------------------------------------------------------ > Join us December 9, 2009 for the Red Hat Virtual Experience, > a free event focused on virtualization and cloud computing. > Attend in-depth sessions from your desk. Your couch. Anywhere. > http://p.sf.net/sfu/redhat-sfdev2dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

2 1

[Monetdb-developers] Announcement: New Nov2009 feature release of MonetDB suite
by Stefan Manegold 30 Nov '09

30 Nov '09

Dear all, The MonetDB team at CWI/MonetDB BV are pleased to announce the new "Nov2009" feature release of the MonetDB suite of programs. This feature release is backward compatible with the previous releases (Nov2008 through Aug2009-SP2). Caveat 1: In MonetDB/XQuery, we extended and improved the use of value indices on comparisions between a value and an XPath ending in text() or attribute access (e.g., doc(x)//x/y[z/text() = "foo"] and for $x in doc//x/y where $x/@z = "bar" return $x); such queries do not need scanning data, but start at the index and navigate backwards from there. This required a change in the physical database storage. While the Nov2009 release of MonetDB/XQuery can still read older (pre-Nov2009) databases, it is recommended to (back-up and) re-shred all documents to benefit from the new indices and achieve optimal performance. Caveat 2: When upgrading from a release older than May2009 (i.e., Nov2008 through Feb2009-SP2), you need to move your write-ahead log following the "recommended" instructions for SQL (<http://monetdb.cwi.nl/Development/Releases/May2009/#SQL>) and/or XQuery (<http://monetdb.cwi.nl/Development/Releases/May2009/#XQuery>). More information on the new release is available at <http://monetdb.cwi.nl/Development/Releases/Nov2009/>. The sources and binaries are available at <http://monetdb.cwi.nl/Download/>. Enjoy! The MonetDB team at CWI/MonetDB BV. -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] other than bug things...
by Wouter Alink 27 Nov '09

27 Nov '09

Hello Developers, Usually I try to report bugs (and try to find the worst of the system), but just this morning I noticed my mserver5 instance (Aug2009), which I have been intensively querying over the last days with ten-thousands of reasonably complex queries and sometimes with more than 20 queries in parallel. It just passed the 4800 minutes of actual cpu time (= 80 hours of hard work) and still going strong. I thought it was worth mentioning! Cheers, Wouter p.s. roberto, actually it's your mserver instance...

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/crackers crackers_sortmerge.mx, , 1.3, 1.4
by Sjoerd Mullender 20 Nov '09

20 Nov '09

On 2009-11-20 18:51, Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/crackers > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv26391/crackers > > Modified Files: > crackers_sortmerge.mx > Log Message: > this is probably not the proper fix, but I want to get rid of the error mails I get from buildbot > > Index: crackers_sortmerge.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/crackers/crackers_sortmerge.mx,v > retrieving revision 1.3 > retrieving revision 1.4 > diff -u -d -r1.3 -r1.4 > --- crackers_sortmerge.mx 19 Nov 2009 13:53:14 -0000 1.3 > +++ crackers_sortmerge.mx 20 Nov 2009 17:51:50 -0000 1.4 > @@ -338,7 +338,7 @@ > printf("found "SZFMT" tuples, all tuples : "SZFMT" \n",totalTuples, totalLowerTuples+totalHigherTuples+totalTuples); > > view = BATslice(br, totalLowerTuples, totalLowerTuples+totalTuples); > - printf("result size is %ld \n",BATcount(view)); > + printf("result size is %ld \n",(long)BATcount(view)); use BUNFMT instead of %ld. > *vid = view->batCacheid; > BBPkeepref(*vid); > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] testing/src quicktest, , NONE, 1.1
by Sjoerd Mullender 20 Nov '09

20 Nov '09

On 2009-11-20 15:55, Fabian wrote: > Update of /cvsroot/monetdb/testing/src > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv28457 > > Added Files: > quicktest > Log Message: > Time to show what I'm hiding. (Also nice to finally get revision control) > > My efforts of the last few days resulted in this initial version of > "quicktest", the not-even-close-to-Mtest.py fast mtest emulator. > > Basically it started all out of frustration of not being able to > implement many ideas in Mtest.py, so I decided to see how far I'd come > by rewriting from scratch (incidentially also in a language I actually > can read and understand). Are you also going to port this to Windows? There is a reason to use Python, you know. -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql.mx, Nov2009, 1.358.2.10, 1.358.2.11 sql_optimizer.mx, Nov2009, 1.230.2.8, 1.230.2.9
by Stefan Manegold 15 Nov '09

15 Nov '09

After this checkin (and the related output approval), the following 4 tests do fail, now: sql/src/backends/monet5/Tests/optimizers.sql Please double check the error messages, whether they are indeed as desired. sql/src/test/Tests/setoptimizer.sql.src Please double check output and error messages, whether they are indeed as desired. sql/src/benchmarks/tpch/Tests/01-22.SQL.sh ERROR = !MALException:!ERROR: BATpropcheck: BAT tmpr_1636(-926)[oid,oid] with 55 tuples was incorrectly marked nonil! sql/src/test/BugTracker-2009/Tests/leftjoin_undefined.SF-2879011.sql ERROR = !TypeException:user.s2_1[42]:'algebra.leftjoin' undefined in: _55:any := algebra.leftjoin(_54:bat[:oid,:void], _27:bat[:oid,:str], _50:lng) !SQLException:SQLengine:Program contains errors Stefan On Sun, Nov 15, 2009 at 04:55:29PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5 > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv27458 > > Modified Files: > Tag: Nov2009 > sql.mx sql_optimizer.mx > Log Message: > Move the validation of the optimizer pipeline to the assignment itself, > rather then checking them on the first call. > > > Index: sql_optimizer.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql_optimizer.mx,v > retrieving revision 1.230.2.8 > retrieving revision 1.230.2.9 > diff -u -d -r1.230.2.8 -r1.230.2.9 > --- sql_optimizer.mx 8 Nov 2009 14:36:34 -0000 1.230.2.8 > +++ sql_optimizer.mx 15 Nov 2009 16:55:27 -0000 1.230.2.9 > @@ -136,7 +136,7 @@ > sql5_export void addQueryToCache(Client c); > sql5_export str SQLoptimizer(Client c); > sql5_export void SQLsetAccessMode(Client c); > -sql5_export int SQLvalidatePipeline(void); > +sql5_export str SQLvalidatePipeline(void); > sql5_export str setOptimizers(str optimizer); > > #endif /* _SQL_OPTIMIZER_H_ */ > @@ -441,6 +441,7 @@ > Additional pipelines are defined in the monetdb.conf file. > The optimizers can be turned on/off, leaving the minimal plan > active. > +The first error in the optimizer string is shown. > @c > str minimalPlan= "inline,remap,deadcode,multiplex"; > > @@ -448,17 +449,17 @@ > static str optimizerpipe; /* reference to last pipeline string */ > static char *previouspipe = 0; > > -int > +str > SQLvalidatePipeline(void){ > - int error= 0; > int mitosis= FALSE, deadcode= FALSE, mergetable= FALSE, replication= FALSE; > int i; > > mal_set_lock(sql_contextLock,"SQL optimizer"); > - if (optimizers[0] && strcmp(optimizers[0],"inline") ){ > - showException(SQL,"optimizer"," 'inline' should be the first\n"); > - error++; > + if (optimizers[0] && strcmp(optimizers[0],"inline") ) { > + mal_unset_lock(sql_contextLock,"SQL optimizer"); > + throw(SQL,"optimizer"," 'inline' should be the first\n"); > } > + > /* deadcode should be used */ > for ( i=0; optimizers[i]; i++) > if (strcmp(optimizers[i],"deadcode") == 0) > @@ -476,34 +477,34 @@ > #ifdef WIN32 > else > if (strcmp(optimizers[i],"octopus") == 0){ > - showException(SQL,"optimizer"," 'octopus' needs Linux\n"); > - error++; > + mal_unset_lock(sql_contextLock,"SQL optimizer"); > + throw(SQL,"optimizer"," 'octopus' needs Linux\n"); > } > #endif > if (optimizers[0] && mitosis == TRUE && mergetable == FALSE) { > - showException(SQL,"optimizer"," 'mitosis' needs 'mergetable'\n"); > - error++; > + mal_unset_lock(sql_contextLock,"SQL optimizer"); > + throw(SQL,"optimizer"," 'mitosis' needs 'mergetable'\n"); > } > > if ( --i >= 0 && optimizers[i] && strcmp(optimizers[i],"multiplex") ){ > - showException(SQL,"optimizer"," 'multiplex' should be the last\n"); > - error++; > + mal_unset_lock(sql_contextLock,"SQL optimizer"); > + throw(SQL,"optimizer"," 'multiplex' should be the last\n"); > } > if (optimizers[0] && deadcode == FALSE ){ > - showException(SQL,"optimizer"," 'deadcode' should be used at least once\n"); > - error++; > + mal_unset_lock(sql_contextLock,"SQL optimizer"); > + throw(SQL,"optimizer"," 'deadcode' should be used at least once\n"); > } > @- > For replicated databases we need to ensure that the corresponding optimizer > is enabled. > @c > if ( MASTERroleEnabled() && replication == FALSE){ > - showException(SQL,"optimizer"," 'replication' should be part of the pipeline\n"); > - error++; > + mal_unset_lock(sql_contextLock,"SQL optimizer"); > + throw(SQL,"optimizer"," 'replication' should be part of the pipeline\n"); > } > > mal_unset_lock(sql_contextLock,"SQL optimizer"); > - return error; > + return MAL_SUCCEED; > } > > @- > @@ -558,25 +559,21 @@ > nxt++; > } > if ((nme = putName(optimizer,strlen(optimizer))) == 0) > - showException(SQL,"optimizer"," '%s' does not exist\n",optimizer); > + showException(SQL,"optimizer"," '%s' pipeline does not exist\n",optimizer); > else if (top<255) > optimizers[top++] = nme; > optimizer = nxt; > } > optimizers[top] = 0; > GDKfree(base); > - if (top == 1 && pipe == NULL){ > - showException(SQL,"optimizer","Optimizer '%s' does not exist, use default pipe instead\n", optimizerpipe?optimizerpipe:"undefined"); > + if (top <= 1 && pipe == NULL){ > + showException(SQL,"optimizer","Optimizer '%s' pipeline does not exist, use default pipe instead\n", optimizerpipe?optimizerpipe:"undefined"); > setOptimizers("default_pipe"); > }else > if (top == 256){ > showException(SQL,"optimizer","Too many optimizer steps, use default pipe instead\n"); > setOptimizers("default_pipe"); > - } else > - if (SQLvalidatePipeline() ) { > - showException(SQL,"optimizer"," Invalid pipeline, use default_pipe instead\n"); > - setOptimizers("default_pipe"); > - } > + } > return GDKstrdup(optimizerpipe); > } > > > Index: sql.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql.mx,v > retrieving revision 1.358.2.10 > retrieving revision 1.358.2.11 > diff -u -d -r1.358.2.10 -r1.358.2.11 > --- sql.mx 8 Nov 2009 13:38:52 -0000 1.358.2.10 > +++ sql.mx 15 Nov 2009 16:55:27 -0000 1.358.2.11 > @@ -1180,6 +1180,7 @@ > #include <sql_storage.h> > #include <sql_scenario.h> > #include <store_sequence.h> > +#include <sql_optimizer.h> > #include <sql_datetime.h> > #include <rel_optimizer.h> > #include <rel_select.h> > @@ -1416,6 +1417,14 @@ > > if (mtype < 0 || mtype >= 255) > throw(SQL, "sql.setVariable", "failed"); > + if ( strcmp("optimizer", varname)== 0) { > + setOptimizers(*(str *) getArgReference(stk,pci,2)); > + msg = SQLvalidatePipeline(); > + if ( msg ){ > + setOptimizers("default_pipe"); > + return msg; > + } > + } > src = &stk->stk[getArg(pci, 2)]; > if (stack_find_var(m, varname)) { > stack_set_var(m, varname, src); > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime/xrpc/admin/Tests All, Nov2009, 1.3.10.1, 1.3.10.2
by Ying Zhang 15 Nov '09

15 Nov '09

On Nov 15, 2009, at 14:59 , Stefan Manegold wrote: > Update of /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv15431 > > Modified Files: > Tag: Nov2009 > All > Log Message: > > conditionally disabled backup_restore_noxrpc test > for Algebra, as it required fn:put, > which it not (yet?) available for Algebra; > please re-enable once fn:put becomes available > also with Algebra > > ps: > does this also means that since XRPC and module > queries not longer automatically fall back to MPS, > the XRPC-/module-based administrative console > does no longer offer all its functionallity > when server by a default ALG MonetDB/XQuery? The intension is to disable automatic fall back to MPS *only* for module queries. This does not apply to XPRC queries (incl. the admin functions), which should thus still be available in ALG. > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/All,v > retrieving revision 1.3.10.1 > retrieving revision 1.3.10.2 > diff -u -d -r1.3.10.1 -r1.3.10.2 > --- All 24 Oct 2009 15:07:19 -0000 1.3.10.1 > +++ All 15 Nov 2009 13:58:58 -0000 1.3.10.2 > @@ -1,6 +1,7 @@ > add_del_doc_noxrpc > NOT_ALGEBRA?add_del_doc > -backup_restore_noxrpc > +# fn:put() > +NOT_ALGEBRA?backup_restore_noxrpc > NOT_ALGEBRA?backup_restore > # pf:mil() > NOT_ALGEBRA?db_stats_noxrpc > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins

2 4

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime pathfinder.mx, Nov2009, 1.462.4.8, 1.462.4.9
by Stefan Manegold 15 Nov '09

15 Nov '09

On Sun, Nov 15, 2009 at 01:45:26PM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13456 > > Modified Files: > Tag: Nov2009 > pathfinder.mx > Log Message: > modified the disable of MPS (which was until recently still used by queries that triggered the module cache) > - it remains disabled, but queries that explicitly request MPS now again get the module code again I guess, something went wrong with this one, bug I wasn't able to locate the problem, yet. Before this checkin, I (as expected) go some output with `mclient -lx`, e.g.: $ mclient -lx Welcome to mclient, the MonetDB/XQuery interactive terminal Type \q to quit, \? for a list of available commands xquery>1+2 more><> 3 xquery> After this checkin, I don't get any output at all any more, e.g.: $ mclient -lx Welcome to mclient, the MonetDB/XQuery interactive terminal Type \q to quit, \? for a list of available commands xquery>1+2 more><> xquery> Likewise, before `Mtest.py -r` resulted in 23 out of 1861 tests produced SIGNIFICANTLY different output now it results in 1010 out of 1863 tests produced SIGNIFICANTLY different output mainly as most tests don't produce any output at all (as indicated above). Stefan > > > Index: pathfinder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/pathfinder.mx,v > retrieving revision 1.462.4.8 > retrieving revision 1.462.4.9 > diff -u -d -r1.462.4.8 -r1.462.4.9 > --- pathfinder.mx 12 Nov 2009 01:45:16 -0000 1.462.4.8 > +++ pathfinder.mx 15 Nov 2009 13:45:21 -0000 1.462.4.9 > @@ -5917,7 +5917,6 @@ > return p+1; > } > > -#ifdef XQUERY_PREPARE > /* > * parse an XML datamodel numeric, and determine its minimal type (xs:integer, xs:decimal or xs:double) > */ > @@ -5950,7 +5949,6 @@ > * from a cached MIL tree. Otherwise use pathfinder to compile. Returns error string (NULL if ok). > */ > static char xquery_too_complex[80] = "xquery_prepare: xquery is too complex for cached execution.\n"; > -#endif > #define xquery_nondescriptive_error ((char*) -1) > > static char* > @@ -5959,11 +5957,24 @@ > char* query) > { > char *err = NULL; > -#ifdef XQUERY_PREPARE > int nsbuf = 0, loaded_modules = 0, len; > char *ns = (char*)&nsbuf, *nsend = ns, *locend, *loc = NULL, *q, *p = query; > char val[1024], url1[1024], url2[1024]; > > + /* Setting the Algebra flag; server setting overules compile-time default; client choice overrules server setting */ > + int options = 0; > +#if MILPRINT_SUMMER_IS_DEFAULT > + if (((ctx->mode & XQ_ALGEBRA) != 0) || \ > + (((ctx->mode & XQ_MILPRINT_SUMMER) == 0) && \ > + (GDKgetenv("xquery_backend") != NULL) && (strcmp(GDKgetenv("xquery_backend"),"algebra") == 0))) > + options = COMPILE_OPTION_ALGEBRA; > +#else /* ALGEBRA_IS_DEFAULT */ > + if (((ctx->mode & XQ_MILPRINT_SUMMER) == 0) && \ > + (((ctx->mode & XQ_ALGEBRA) != 0) || \ > + (GDKgetenv("xquery_backend") == NULL) || (strcmp(GDKgetenv("xquery_backend"),"milprint_summer") != 0))) > + options = COMPILE_OPTION_ALGEBRA; > +#endif > +if (options != COMPILE_OPTION_ALGEBRA) { > if (ctx->mode&XQ_DEBUG) { > /* for debugging purposes, we simulate a full MIL on the log; even if parts are cached */ > char *prologue = (char*) PFinitMIL(); > @@ -6145,29 +6156,13 @@ > */ > if (err == xquery_function_error) /* MIL execution failed, do not generate error in PF compiler */ > return xquery_nondescriptive_error; > - if (err) > -#else > - (void) usec; > -#endif > - { > +} > + if (err) { > char *sec1 = NULL; > char *sec2 = NULL; > char *sec3 = NULL; > - int options = 0; > /* compile and execute the query (minus module imports) */ > err = xquery_nondescriptive_error; > - /* Setting the Algebra flag; server setting overules compile-time default; client choice overrules server setting */ > -#if MILPRINT_SUMMER_IS_DEFAULT > - if (((ctx->mode & XQ_ALGEBRA) != 0) || \ > - (((ctx->mode & XQ_MILPRINT_SUMMER) == 0) && \ > - (GDKgetenv("xquery_backend") != NULL) && (strcmp(GDKgetenv("xquery_backend"),"algebra") == 0))) > - options = COMPILE_OPTION_ALGEBRA; > -#else /* ALGEBRA_IS_DEFAULT */ > - if (((ctx->mode & XQ_MILPRINT_SUMMER) == 0) && \ > - (((ctx->mode & XQ_ALGEBRA) != 0) || \ > - (GDKgetenv("xquery_backend") == NULL) || (strcmp(GDKgetenv("xquery_backend"),"milprint_summer") != 0))) > - options = COMPILE_OPTION_ALGEBRA; > -#endif > if (xquery_compile_exec(ctx, options, query, 0, &sec1, &sec2, &sec3, NULL)) > err = NULL; > if (sec1) free(sec1); > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Bugs & Tests: Your resposibility
by Stefan Manegold 15 Nov '09

15 Nov '09

Dear all, lacking the time to constantly check each bug report and each failing test, I'll as of now leave it to the resposibility of - bug report submitters and - developers that fix and close bugs, as well as - those that develope new code and get detailed TestWeb emails about the consequences of their changes, to ensure that - each failing test is documented in a bug report, and - each closed (fixed) bug report is backed-up by a test in CVS to monitor the status of that very query or usage scenario. Thank you for understanding my decision and for helping us all to maintain and improve the stability, correctness and quality of the MonetDB code base. Kind regards, Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Bug- & Test- status assessment: Please help!
by Stefan Manegold 15 Nov '09

15 Nov '09

Dear fellow MonetDB developers, Dear MonetDB users, preparing for the upcming Nov2009 release we spent quite some time and efford in cleaning-up the "Stable" TestWeb ( cf., http://monetdb.cwi.nl/Development/TestWeb/Stable/ ) and fixing as many open bugs as possible. Big thansk go to all of you that were actively involved! To further assess the status of (failing) tests and in particular open bug reports ( cf., https://sourceforge.net/tracker/?words=tracker_browse&sort=priority&sortdir… ) I ask all of you to 1) check the open bugs submitted by you, https://sourceforge.net/tracker/?words=tracker_browse&sort=submitted_by&sor… a) whether there is a test in CVS for this bug or not; b) whether the problem still occurs, i.e., whether the test still fails, or whether the problem still occurs for you with the latest Nov2009 CVS code base. Please report any findings in detail via the bug tracker. 2) check the open bugs assigned to you https://sourceforge.net/tracker/?words=tracker_browse&sort=assigned_to&sort… a) whether there is a test in CVS for this bug or not; b) whether the problem still occurs, i.e., whether the test still fails, or whether the problem still occurs for you with the latest Nov2009 CVS code base. Please report any findings in detail via the bug tracker. 3) check all bug reports closed since Aug2009, whether they are (if applicable) backed-up by a test in CVS. 4) check all failing test in the TestWeb http://monetdb.cwi.nl/Development/TestWeb/Stable/ whether they are documented by a bug report. Thank you very much in advance! Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/tests/BugTracker/Tests function_parameter_without_type.SF-1898518.stable.err, Nov2009, 1.2, 1.2.8.1 function_parameter_without_type.SF-1898518.stable.out, Nov2009, 1.2, 1.2.8.1
by Martin Kersten 14 Nov '09

14 Nov '09

Stefan Manegold wrote: > Update of /cvsroot/monetdb/pathfinder/tests/BugTracker/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv5625 > > Modified Files: > Tag: Nov2009 > function_parameter_without_type.SF-1898518.stable.err > function_parameter_without_type.SF-1898518.stable.out > Log Message: > > approved error message of first version of the query > after Peter's "will not be fixed" verdict; ^^^^^^^^^^^^^^^^^^^^ Differentiate between errors that won't be fixed and feature requests. The latter belong to a different list.

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal mal_mapi.mx, Nov2009, 1.37.2.3, 1.37.2.4
by Romulo Goncalves 11 Nov '09

11 Nov '09

Hello, One remark for a broken test in SQL. Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv27989 > > Modified Files: > Tag: Nov2009 > mal_mapi.mx > Log Message: > Free resources allocated for Mapi struct before returning. Found by Coverity. (I have no clue how to update this so it is recorded as handled in the Coverity webpage, someone please fill me in.) > > Index: mal_mapi.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mal_mapi.mx,v > retrieving revision 1.37.2.3 > retrieving revision 1.37.2.4 > diff -u -d -r1.37.2.3 -r1.37.2.4 > --- mal_mapi.mx 30 Oct 2009 18:48:31 -0000 1.37.2.3 > +++ mal_mapi.mx 3 Nov 2009 18:27:14 -0000 1.37.2.4 > @@ -407,7 +407,7 @@ > bstream *bs; > int len = 0; > > - if ( buf == NULL){ > + if (buf == NULL){ > GDKsyserror("SERVERlisten:"MAL_MALLOC_FAIL); > return; > } > @@ -922,6 +922,7 @@ > if (err[0] == '!') > err = err + 1; > SERVERsessions[i].c = NULL; > + mapi_destroy(mid); You are freeing here mid, but err is dependent of it. Because the complete if clause is like this: if (mapi_error(mid)) { str err = mapi_error_str(mid); if (err == NULL) err = "(no reason given)"; if (err[0] == '!') err = err + 1; SERVERsessions[i].c = NULL; mapi_destroy(mid); throw(IO, "mapi.connect", "Could not connect: %s", err); } and mapi_error returns: 926 str err = mapi_error_str(mid); (gdb) s mapi_error_str (mid=0x1277af0) at /ufs/goncalve/MonetDB/stable/clients/src/mapilib/Mapi.mx:1352 1352 assert(mid); (gdb) n 1353 return mid->errorstr; (gdb) 1354 } This is the reason why connection is broken and gives the following error message: ERROR = !IOException:mapi.connect:Could not connect: `Ú¶08 instead of: ERROR = !IOException:mapi.connect:Could not connect: Setup connection failed Correct if I am wrong... Ro > throw(IO, "mapi.connect", "Could not connect: %s", err); > } > > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

2 1

[Monetdb-developers] MonetDB PHP interface
by Stefan Manegold 10 Nov '09

10 Nov '09

Gabriele, is your new native PHP interface for MonetDB complete in the Nov2009 branch, and does it replace the old Cimpl-/SWIG-based one completely? If so, we should consider removing the old Cimpl-/SWIG-based PHP interface for MonetDB in the Nov2009 release ... Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/crackers crackers_partial_sideways.mx, , 1.7, 1.8
by Martin Kersten 10 Nov '09

10 Nov '09

stratos wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/crackers > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv26417 > > Modified Files: > crackers_partial_sideways.mx > Log Message: > more safety checks from coverity > > > Index: crackers_partial_sideways.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/crackers/crackers_partial_sideways.mx,v > retrieving revision 1.7 > retrieving revision 1.8 > diff -u -d -r1.7 -r1.8 > --- crackers_partial_sideways.mx 9 Nov 2009 22:06:57 -0000 1.7 > +++ crackers_partial_sideways.mx 10 Nov 2009 00:05:34 -0000 1.8 > @@ -647,9 +647,9 @@ > oid i; > > if (nodeLow == NULL) > - printf("\n crackers.createPieceMap Unexpected case: Low node is NULL\n "); Printf is not to be used for this. Either you want to leave a debugging message, then use stream_printf(GDKout,"\n..... or return an exception string so the upper layers can deal with it > + return NULL; > if (nodeHgh == NULL) > - printf("\n crackers.createPieceMap Unexpected case: Hgh node is NULL \n "); > + return NULL; > > if (nodeLow->indexLocal == 0) pos1 = 0; > else pos1 = nodeLow->indexLocal + 1; > @@ -920,7 +920,7 @@ > return 0; > > if ((h = BATdescriptor(cur->tape)) == NULL) > - printf("\n\n crackers.sync Cannot access tape \n\n"); > + return -1; > > /* check if the current pair is already synced */ > cursor = getTapeCursor(cur,tailBatId); > @@ -936,7 +936,7 @@ > } > /* Take the index of the bat */ > if ((c = BATdescriptor(CrackerIndex[m].cid)) == NULL) > - printf(" \n\n crackers.sync Cannot access crack index \n\n"); > + return -1; > > syncs = size - cursor; > > @@ -1057,7 +1057,8 @@ > > @= EnrichMaxTailResultIncrementalSideways > size+=@5; > - > + if (pairt==NULL) > + throw(MAL,"pcrack", "Unexpected error during max. Empty input."); > if (BATcount(p) == 0){ > *maxt = *pairt; > j = 1; > @@ -1070,6 +1071,8 @@ > *maxt = *pairt; > pairt ++; > } > + if(piece==NULL) > + throw(MAL,"pcrack", "Unexpected error. Cur piece is NULL."); > if (newPiece) > BBPkeepref(piece->batCacheid); > else > @@ -1106,6 +1109,8 @@ > if (*inclusiveLow2==FALSE && *inclusiveHgh2==FALSE){ > @:analyzeTailConjunction(@2,@3,@4,GT,LT,@5)@ > } > + if(piece==NULL) > + throw(MAL,"pcrack", "Unexpected error. Cur piece is NULL."); > if (newPiece) > BBPkeepref(piece->batCacheid); > else > @@ -1143,6 +1148,8 @@ > @:analyzeTailConjunctionPivot(@2,@3,@4,GT,LT,@5)@ > } > > + if(piece==NULL) > + throw(MAL,"pcrack", "Unexpected error. Cur piece is NULL."); > if (newPiece) > BBPkeepref(piece->batCacheid); > else > @@ -1159,6 +1166,8 @@ > pivott ++; > > } > + if(piece==NULL) > + throw(MAL,"pcrack", "Unexpected error in projection. Cur piece is NULL."); > if (newPiece) > BBPkeepref(piece->batCacheid); > else > @@ -1177,6 +1186,8 @@ > pivott ++; > > } > + if(piece==NULL) > + throw(MAL,"pcrack", "Unexpected error. Cur piece is NULL."); > if (newPiece) > BBPkeepref(piece->batCacheid); > else > @@ -1271,11 +1282,19 @@ > @ > > @= SyncAndCrackBasedonFirstBound > - SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, FALSE); > + syncs=SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, FALSE); > + if (syncs<0) > + throw(MAL,"pcrack", "Failed to access cracker index or tape during syncing."); > + > foundLow = GetLowNodes_@1(*low, *inclusiveLow, CrackerIndex[h].Tree, cm, BUNfirst(cm), &localNodeLow1, &localNodeHgh1, NULL, NULL); > - if (foundLow == 0) > - if ((SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, TRUE))>0) > + > + if (foundLow == 0){ > + syncs=SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, TRUE); > + if (syncs<0) > + throw(MAL,"pcrack", "Failed to access cracker index or tape during syncing."); > + if (syncs>0) > foundLow = GetLowNodes_@1(*low, *inclusiveLow, CrackerIndex[h].Tree, cm, BUNfirst(cm), &localNodeLow1, &localNodeHgh1, NULL, NULL); > + } > foundHgh = 1; > base = nodeLow1->indexLocal; > CrackPiece = SyncAndCrackBasedonFirstBound = TRUE; > @@ -1288,7 +1307,9 @@ > @ > > @= SyncAndCrackBasedonLastBound > - SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, FALSE); > + syncs=SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, FALSE); > + if (syncs<0) > + throw(MAL,"pcrack", "Failed to access cracker index or tape during syncing."); > > /* if the high bound falls in here we crack this piece */ > if ( (*(@1*)Tloc(c, BUNfirst(c)+nodeHgh1->position)) > *hgh || > @@ -1296,9 +1317,13 @@ > nodeHgh1->inclusive == HBound) ){ > foundHgh = GetHghNodes_@1(*hgh, *inclusiveHgh, CrackerIndex[h].Tree, cm, BUNfirst(cm), &localNodeLow2, &localNodeHgh2, NULL, NULL); > > - if (foundHgh == 0) > - if ((SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, TRUE)) > 0) > + if (foundHgh == 0){ > + syncs = SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, TRUE); > + if (syncs<0) > + throw(MAL,"pcrack", "Failed to access cracker index or tape during syncing."); > + if (syncs > 0) > foundHgh = GetHghNodes_@1(*hgh, *inclusiveHgh, CrackerIndex[h].Tree, cm, BUNfirst(cm), &localNodeLow2, &localNodeHgh2, NULL, NULL); > + } > > foundLow = 1; > base = nodeLow1->indexLocal; > @@ -1317,13 +1342,19 @@ > @ > > @= SyncAndCrackBasedonBothBounds > - SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, FALSE); > + syncs=SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, FALSE); > + if (syncs<0) > + throw(MAL,"pcrack", "Failed to access cracker index or tape during syncing."); > + > /* get the new node after the sync */ > foundLow = GetLowNodes_@1(*low, *inclusiveLow, CrackerIndex[h].Tree, cm, BUNfirst(cm), &localNodeLow1, &localNodeHgh1, NULL, NULL); > foundHgh = GetHghNodes_@1(*hgh, *inclusiveHgh, CrackerIndex[h].Tree, cm, BUNfirst(cm), &localNodeLow2, &localNodeHgh2, NULL, NULL); > > if (foundLow == 0 || foundHgh == 0){ > - if ((SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, TRUE)) > 0 ){ > + syncs=SyncPiece_@1_@2(h, piece, nodeLow1, m, *pbid, TRUE); > + if (syncs<0) > + throw(MAL,"pcrack", "Failed to access cracker index or tape during syncing."); > + if (syncs > 0 ){ > foundLow = GetLowNodes_@1(*low, *inclusiveLow, CrackerIndex[h].Tree, cm, BUNfirst(cm), &localNodeLow1, &localNodeHgh1, NULL, NULL); > foundHgh = GetHghNodes_@1(*hgh, *inclusiveHgh, CrackerIndex[h].Tree, cm, BUNfirst(cm), &localNodeLow2, &localNodeHgh2, NULL, NULL); > } > @@ -1341,6 +1372,8 @@ > @= makeNewMapPiece1 > /*printStorageInfo(); can be used to what is in the Storage management structure */ > piece = createPieceMap_@1_@2(b, tailBAT, nodeLow1, nodeHgh1, m); > + if (piece==NULL) > + throw(MAL,"pcracking","Failed to create map piece"); > newPiece = TRUE; > > localFirst = addCrackerIndexIncrementalSideways_@1(h, *(@1*)Tloc(c, BUNfirst(c)+nodeLow1->position), nodeLow1->inclusive, 0, nodeLow1->indexLocal, cm, FALSE, TRUE, piece->batCacheid); > @@ -1350,6 +1383,8 @@ > > @= makeNewMapPiece2 > piece = createPieceMap_@1_@2(b, tailBAT, nodeLow1, nodeHgh1, m); > + if (piece==NULL) > + throw(MAL,"pcracking","Failed to create map piece"); > newPiece = TRUE; > localNodeLow1->first = TRUE; > localNodeLow1->indexLocal = 0; > @@ -1421,12 +1456,16 @@ > crkTwoLTree = TRUE; > else{ > posl = 0; > + if (nodeHgh1==NULL) > + throw(MAL,"pcrack", "Unexpected error. High node is NULL."); > posh = nodeHgh1->indexLocal; > crkThreeTree = TRUE; > } > done = TRUE; > }else > if (nodeHgh1 == NULL && nodeHgh2 == NULL) { > + if (nodeLow1==NULL) > + throw(MAL,"pcrack", "Unexpected error. Low node is NULL."); > if (foundLow != 0){ > nodeLow1->first = TRUE; > crkTwoRTree = TRUE; > @@ -1442,6 +1481,8 @@ > else > /* A previous query has already created a piece for this area */ > if (nodeLow1->first == TRUE){ > + if (nodeHgh1==NULL) > + throw(MAL,"pcrack", "Unexpected error. High node is NULL."); > > @:makeNewMapPiece1(@1,@2)@ > > @@ -1463,6 +1504,8 @@ > nodeLow1->first = TRUE; > else > if (foundLow == 0 && foundHgh ==0){ > + if (nodeHgh1==NULL) > + throw(MAL,"pcrack", "Unexpected error. High node is NULL."); > posl = nodeLow1->indexLocal+1; > posh = nodeHgh1->indexLocal; > crkThreeTree = TRUE; > @@ -1533,6 +1576,7 @@ > bit AnalyzeRemainingPiece = FALSE; > bit crkTwoLTree, crkTwoRTree, crkThreeTree; > bit CrackPiece = FALSE, SyncAndCrackBasedonFirstBound = FALSE, SyncAndCrackBasedonBothBounds = FALSE, SyncAndCrackBasedonLastBound = FALSE; > + lng syncs=0; > > if (@3_GT(low,hgh,@4@1)) > throw(MAL, "crackers.crack", "illegal range"); > @@ -1662,6 +1706,8 @@ > curPieceNodeLast = getNextNonLocalNode(localNodeHgh1); > } else > if (localNodeLow1->localBound == FALSE && localNodeLow1->first == FALSE){ > + if (localNodeLow2==NULL) > + throw(MAL,"pcrack", "Unexpected error. Low node is NULL."); > if (*(oid*)Hloc(cm,BUNfirst(cm)+localNodeLow1->position) == *(oid*)Hloc(cm,BUNfirst(cm)+localNodeLow2->position)) > /* Both bounds fall within a non materialized area of the map */ > BothBoundsWithinAnExistingArea=TRUE; > @@ -1716,14 +1762,15 @@ > Each piece in this area needs to be synced if necessary and enrich the result > If the hgh bound falls in a piece then we also have to crack it */ > while(done == FALSE){ > + if (curPieceNodeLast==NULL || curCBatNodeLast ==NULL) > + throw(MAL,"pcrack", "Unexpected error. Low node is NULL."); > + > LastBoundWithinAnExistingArea = FALSE; > localNodeLow1 = curPieceNodeLast; > localNodeHgh1 = getNextNonLocalNode(findNextPiece(localNodeLow1)); > nodeLow1 = curCBatNodeLast; > nodeHgh1 = findNextPiece(nodeLow1); > > - if (localNodeLow1==NULL) > - throw(MAL, "partial sideways cracking", "Unexpected error while traversing cracker map. Low node is NULL."); > > if (localNodeHgh1==NULL){ > if (nodeHgh1 == NULL){ > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/BugTracker-2009/Tests All, Nov2009, 1.51.2.4, 1.51.2.5
by Stefan Manegold 09 Nov '09

09 Nov '09

On Mon, Nov 09, 2009 at 10:22:40PM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/test/BugTracker-2009/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv16258 > > Modified Files: > Tag: Nov2009 > All > Log Message: > disable a few more test (no propagation) I took care of preventing the propagation. Stefan > > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/BugTracker-2009/Tests/All,v > retrieving revision 1.51.2.4 > retrieving revision 1.51.2.5 > diff -u -d -r1.51.2.4 -r1.51.2.5 > --- All 8 Nov 2009 20:11:51 -0000 1.51.2.4 > +++ All 9 Nov 2009 22:22:38 -0000 1.51.2.5 > @@ -58,9 +58,9 @@ > missing_column_name.SF-2776100 > dumping_tables.SF-2776908 > dumping_tables.SF-2776908--performance > -dumping_tables.SF-2776908--optimizers > +#dumping_tables.SF-2776908--optimizers > name_clash_with_dump.SF-2780395 > -temporary_table_leftover.SF-2779437 > +#temporary_table_leftover.SF-2779437 > temporary_table_leftover.SF-2734713 > multi-column_join_with_expression.SF-2783279 > BOM.SF-2787813 > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/BugDay_2005-10-06_2.9.3/Tests All, Nov2009, 1.15, 1.15.2.1
by Stefan Manegold 09 Nov '09

09 Nov '09

On Mon, Nov 09, 2009 at 10:13:36PM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/test/BugDay_2005-10-06_2.9.3/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv15481/src/test/BugDay_2005-10-06_2.9.3/Tests > > Modified Files: > Tag: Nov2009 > All > Log Message: > disable test (should not be propagated) I took care of preventing the propagation. Stefan > > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/BugDay_2005-10-06_2.9.3/Tests/All,v > retrieving revision 1.15 > retrieving revision 1.15.2.1 > diff -u -d -r1.15 -r1.15.2.1 > --- All 14 Aug 2009 12:50:04 -0000 1.15 > +++ All 9 Nov 2009 22:13:34 -0000 1.15.2.1 > @@ -1,7 +1,7 @@ > jdbc_crashes_on_getTables.SF_944316 > variable_arg_substring.SF_942981 > UNION_JOIN_vs_plain_set_UNION-2.SF-920585 > -huge_expression_and_column_name.SF-921173 > +#huge_expression_and_column_name.SF-921173 > CrashMe_SQL_server_crash-2.SF-921673 > CrashMe_SQL_server_crash-1.SF-921673 > inserts_with_defaults.SF-921977 > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/Tests All, Nov2009, 1.61, 1.61.6.1
by Stefan Manegold 09 Nov '09

09 Nov '09

On Mon, Nov 09, 2009 at 10:12:30PM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/test/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv15428/src/test/Tests > > Modified Files: > Tag: Nov2009 > All > Log Message: > Disabled crashme test (should not be propagated) I took care of preventing the propagation. Stefan > > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/Tests/All,v > retrieving revision 1.61 > retrieving revision 1.61.6.1 > diff -u -d -r1.61 -r1.61.6.1 > --- All 9 Apr 2009 18:48:49 -0000 1.61 > +++ All 9 Nov 2009 22:12:28 -0000 1.61.6.1 > @@ -87,7 +87,7 @@ > setoptimizer > load_dec_as_int > string > -NOT_WIN32?crashme > +#NOT_WIN32?crashme > 50ways > load_with_offset > copy_into > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/mapiclient dump.c, Nov2009, 1.50.2.2, 1.50.2.3
by Stefan Manegold 06 Nov '09

06 Nov '09

On Fri, Nov 06, 2009 at 09:10:01PM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/clients/src/mapiclient > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv11170 > > Modified Files: > Tag: Nov2009 > dump.c > Log Message: > cap needs to be an int. Solving the problem by adding a cast. Thanks for watching & fixing! ... and sorry for not paying sufficient attention myself (relied to much on the compilers, none complained, neither on Windows nor on Linux ...) Stefan > > Index: dump.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/mapiclient/dump.c,v > retrieving revision 1.50.2.2 > retrieving revision 1.50.2.3 > diff -u -d -r1.50.2.2 -r1.50.2.3 > --- dump.c 6 Nov 2009 19:58:34 -0000 1.50.2.2 > +++ dump.c 6 Nov 2009 21:09:56 -0000 1.50.2.3 > @@ -293,8 +293,8 @@ > char *view = NULL; > size_t maxquerylen; > char *sname = NULL; > - ssize_t cap; > -#define CAP(X) ((cap = (X)) < 0 ? 0 : cap) > + int cap; > +#define CAP(X) ((cap = (int) (X)) < 0 ? 0 : cap) > > > if (schema == NULL) { > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal mal_io.mx, Nov2009, 1.48.6.2, 1.48.6.3 mal_mapi.mx, Nov2009, 1.37.2.6, 1.37.2.7 recycle.mx, Nov2009, 1.66.2.1, 1.66.2.2
by Sjoerd Mullender 06 Nov '09

06 Nov '09

Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv8920 > > Modified Files: > Tag: Nov2009 > mal_io.mx mal_mapi.mx recycle.mx > Log Message: > A few Coverity changes. > > > Index: mal_mapi.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mal_mapi.mx,v > retrieving revision 1.37.2.6 > retrieving revision 1.37.2.7 > diff -u -d -r1.37.2.6 -r1.37.2.7 > --- mal_mapi.mx 3 Nov 2009 20:15:01 -0000 1.37.2.6 > +++ mal_mapi.mx 6 Nov 2009 15:17:13 -0000 1.37.2.7 > @@ -402,8 +402,8 @@ > char *buf = (char *) GDKmalloc(BLOCK + 1); > char *challenge; > char *algos; > - stream *fdin = block_stream(in); > - stream *fdout = block_stream(out); > + stream *fdin; > + stream *fdout; > bstream *bs; > int len = 0; > > @@ -411,10 +411,12 @@ > GDKsyserror("SERVERlisten:"MAL_MALLOC_FAIL); > return; > } > + fdin = block_stream(in); > if (!fdin || !fdout) { > GDKsyserror("SERVERlisten:fdin or fdout problems"); > return; > } > + fdout = block_stream(out); > > assert(buf); > > You're assigning to fdout *after* checking whether it is NULL. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal mal_io.mx, Nov2009, 1.48.6.2, 1.48.6.3 mal_mapi.mx, Nov2009, 1.37.2.6, 1.37.2.7 recycle.mx, Nov2009, 1.66.2.1, 1.66.2.2
by Stefan Manegold 06 Nov '09

06 Nov '09

On Fri, Nov 06, 2009 at 03:17:16PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv8920 > > Modified Files: > Tag: Nov2009 > mal_io.mx mal_mapi.mx recycle.mx > Log Message: > A few Coverity changes. > > > Index: mal_mapi.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mal_mapi.mx,v > retrieving revision 1.37.2.6 > retrieving revision 1.37.2.7 > diff -u -d -r1.37.2.6 -r1.37.2.7 > --- mal_mapi.mx 3 Nov 2009 20:15:01 -0000 1.37.2.6 > +++ mal_mapi.mx 6 Nov 2009 15:17:13 -0000 1.37.2.7 > @@ -402,8 +402,8 @@ > char *buf = (char *) GDKmalloc(BLOCK + 1); > char *challenge; > char *algos; > - stream *fdin = block_stream(in); > - stream *fdout = block_stream(out); > + stream *fdin; > + stream *fdout; ^^^^^ > bstream *bs; > int len = 0; > > @@ -411,10 +411,12 @@ > GDKsyserror("SERVERlisten:"MAL_MALLOC_FAIL); > return; > } > + fdin = block_stream(in); > if (!fdin || !fdout) { ^^^^^ without even running a compiler (let alone coverity): "fdout is used without/before being initialized" Stefan > GDKsyserror("SERVERlisten:fdin or fdout problems"); > return; > } > + fdout = block_stream(out); ^^^^^ > > assert(buf); > > > Index: mal_io.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mal_io.mx,v > retrieving revision 1.48.6.2 > retrieving revision 1.48.6.3 > diff -u -d -r1.48.6.2 -r1.48.6.3 > --- mal_io.mx 30 Oct 2009 08:19:02 -0000 1.48.6.2 > +++ mal_io.mx 6 Nov 2009 15:17:13 -0000 1.48.6.3 > @@ -779,8 +779,12 @@ > str > IOdatafile(str *ret, str *fnme){ > stream *s = open_rstream(*fnme); > - if (s == NULL || stream_errnr(s)) { > - *ret = 0; > + *ret = 0; > + if (s == NULL ) > + throw(MAL, "io.export", RUNTIME_FILE_NOT_FOUND ":%s", fnme); > + > + if (stream_errnr(s)) { > + stream_close(s); > throw(MAL, "io.export", RUNTIME_FILE_NOT_FOUND ":%s", fnme); > } > *ret= GDKstrdup(*fnme); > @@ -793,13 +797,20 @@ > IOexport(bit *ret, int *bid, str *fnme) > { > BAT *b; > - stream *s = open_wastream(*fnme); > + stream *s; > > - if ((b = BATdescriptor(*bid)) == NULL) { > + *ret = FALSE; > + if ((b = BATdescriptor(*bid)) == NULL) > throw(MAL, "io.export", RUNTIME_OBJECT_MISSING); > + > + s = open_wastream(*fnme); > + if (s == NULL ){ > + BBPunfix(b->batCacheid); > + throw(MAL, "io.export", RUNTIME_FILE_NOT_FOUND ":%s", fnme); > } > - if (s == NULL || stream_errnr(s)) { > - *ret = FALSE; > + if (stream_errnr(s)) { > + stream_close(s); > + BBPunfix(b->batCacheid); > throw(MAL, "io.export", RUNTIME_FILE_NOT_FOUND ":%s", fnme); > } > BATprintf(s, b); > @@ -822,13 +833,11 @@ > int (*hconvert) (str, int *, ptr *), (*tconvert) (str, int *, ptr *); > size_t bufsize = 2048; /* NIELS:tmp change used to be 1024 */ > char *base, *cur, *end; > - char *buf = (char *) GDKmalloc(bufsize); > + char *buf; > ptr h = 0, t = 0; > int lh = 0, lt = 0; > FILE *fp = fopen(*fnme, "r"); > > - if ( buf == NULL) > - throw(MAL,"io.import",MAL_MALLOC_FAIL); > if ((b = BATdescriptor(*bid)) == NULL) > throw(MAL, "io.import", RUNTIME_OBJECT_MISSING); > > @@ -844,6 +853,12 @@ > int fn; > struct stat st; > > + buf = (char *) GDKmalloc(bufsize); > + if ( buf == NULL) { > + BBPunfix(b->batCacheid); > + throw(MAL,"io.import",MAL_MALLOC_FAIL); > + } > + > if ((fn = fileno(fp)) <= 0) { > BBPunfix(b->batCacheid); > throw(MAL, "io.import", OPERATION_FAILED " fileno()"); > > Index: recycle.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/recycle.mx,v > retrieving revision 1.66.2.1 > retrieving revision 1.66.2.2 > diff -u -d -r1.66.2.1 -r1.66.2.2 > --- recycle.mx 25 Oct 2009 10:02:32 -0000 1.66.2.1 > +++ recycle.mx 6 Nov 2009 15:17:13 -0000 1.66.2.2 > @@ -272,8 +272,11 @@ > if (pci->argc >1){ > fname = * (str*) getArgReference(stk, pci,1); > s = open_wastream(fname); > - if (s == NULL || stream_errnr(s)) > + if (s == NULL || stream_errnr(s)) { > + if ( s ) > + stream_close(s); > throw(MAL,"recycle", RUNTIME_FILE_NOT_FOUND "%s", fname); > + } > } > RECYCLEdump(s); > if( s != cntxt->fdout) > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/core core.c, , 1.68, 1.69 coreopt.brg, , 1.77, 1.78 fs.brg, , 1.78, 1.79 simplify.brg, , 1.44, 1.45
by Jan Rittinger 06 Nov '09

06 Nov '09

Hi Anandeshwar, thanks a lot for extending pathfinder with full-text functionality. I'm however a little bit taken by surprise and your checkin in my opinion leaves some questions open: - Why did you change the translation of PFcore_some in core.c? - Why did this rewrite touch any file in the algebra folder? - Whitespace removal is not ftcontains support as your message suggests. Additionally disabling consistency checks without an explanation isn't a nice thing. - Why did you duplicate the translation of a for loop? - Isn't the score just an optional modification like the positional variable? I at least don't like this code duplication as it will make code maintenance a lot harder. - As far as I can oversee you did break the compositionality of the compilation scheme. Now the different rules provide different result schemas. I think (mainly because of the last issue) this checkin should better go into a separate branch instead of the CVS HEAD until the translation is more mature. Jan On Nov 5, 2009, at 17:24, Anandeshwar Singh wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/core > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7749/core > > Modified Files: > core.c coreopt.brg fs.brg simplify.brg > Log Message: > XQuery full-text search support initial version! > > This initial version provides support to > > -ftcontains keyword, > > e.g., for $f in doc("menu.xml")//food[./name ftcontains "Belgian > Waffles"] > return $f > The above query will return all the food nodes that has some > relevancy over "Belgian Waffles" > > -initial score variable support > > e.g., for $f score $s in doc("menu.xml")//food[./name ftcontains > "Belgian Waffles"] > return $s > The above query will return the relevancy score of all the matched > food nodes, however since its an initial version, the support to > this score variable is very limited. > > > > Index: core.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/core/core.c,v > retrieving revision 1.68 > retrieving revision 1.69 > diff -u -d -r1.68 -r1.69 > --- core.c 7 May 2009 14:26:37 -0000 1.68 > +++ core.c 5 Nov 2009 16:23:58 -0000 1.69 > @@ -614,6 +614,7 @@ > * @param bindvar variable bound in the for clause > * @param pos positional variable > */ > + > PFcnode_t * > PFcore_forvars (const PFcnode_t *bindvar, const PFcnode_t *pos) > { > @@ -624,6 +625,23 @@ > } > > /** > + * Variables bound in a for clause with score variable > + * > + * @param bindvar variable bound in the for clause > + * @param pos positional variable > + * @param score full-text score variable > + */ > +PFcnode_t * > +PFcore_forvars2 (const PFcnode_t *bindvar, const PFcnode_t *pos, > const PFcnode_t *score) > +{ > + assert (bindvar); assert (bindvar->kind == c_var); > + assert (pos); assert (pos->kind == c_var || pos->kind == c_nil); > + assert (score); assert (score->kind == c_var || score->kind == > c_nil); > + > + return PFcore_wire2 (c_forvars, bindvar, PFcore_wire2(c_vars, > pos, score)); > +} > + > +/** > * Create a core tree node representing a let binding: > * > * let v := e1 return e2 > @@ -1669,20 +1687,26 @@ > PFcnode_t * > PFcore_some (const PFcnode_t *v, const PFcnode_t *expr, const > PFcnode_t *qExpr) > { > - PFfun_t *fn_exists = PFcore_function (PFqname (PFns_fn, > "exists")); > > - return APPLY (fn_exists, > - PFcore_flwr ( > - PFcore_for ( > - PFcore_forbind ( > - PFcore_forvars ( > - v, > - PFcore_nil ()), > - expr), > - PFcore_nil ()), > - PFcore_where ( > - PFcore_ebv (qExpr), > - PFcore_num (1)))); > + PFfun_t *fn_not = PFcore_function (PFqname (PFns_fn, "not")); > + PFfun_t *fn_empty = PFcore_function (PFqname (PFns_fn, "empty")); > + > + return APPLY (fn_not, > + APPLY (fn_empty, > + PFcore_flwr ( > + PFcore_for ( > + PFcore_forbind ( > + PFcore_forvars ( > + v, > + PFcore_nil ()), > + expr), > + PFcore_nil ()), > + PFcore_if > + (PFcore_ebv (qExpr), > + PFcore_then_else ( > + PFcore_num (1), > + PFcore_empty ()))))); > + > } > > /** > > Index: simplify.brg > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/core/simplify.brg,v > retrieving revision 1.44 > retrieving revision 1.45 > diff -u -d -r1.44 -r1.45 > --- simplify.brg 7 May 2009 14:26:52 -0000 1.44 > +++ simplify.brg 5 Nov 2009 16:23:58 -0000 1.45 > @@ -221,6 +221,9 @@ > /* Pathfinder extension: XRPC */ > %term xrpc = 76 /**< XRPC calls: "execute at" */ > > + /* Associated For variable holders */ > +%term vars = 77 /**< variable pair (position. var + > score. var) of a for */ > + > %% > > Query: main (FunctionDecls, CoreExpr) = > 1 (10); > @@ -230,7 +233,7 @@ > > CoreExpr: flwr (OptBindExpr, WhereExpr) = > 32 (10); > CoreExpr: flwr (OptBindExpr, OrdWhereExpr) = > 33 (10); > - > + > OptBindExpr: for_ (forbind (forvars (var, nil), > LiteralValue), > OptBindExpr) = > 2 (10); > @@ -378,6 +381,20 @@ > /* Pathfinder extension: XRPC */ > CoreExpr: xrpc (CoreExpr, FunExpr) = > 124 (10); > > +/* full-text score variable extension */ > +OptBindExpr: for_ (forbind (forvars (var, > + vars (nil, OptVar)), > + LiteralValue), > + OptBindExpr) = > 125 (10); > +OptBindExpr: for_ (forbind (forvars (var, > + vars (var, OptVar)), > + LiteralValue), > + OptBindExpr) = > 126 (10); > +OptBindExpr: for_ (forbind (forvars (var, vars( > + OptVar, OptVar)), > + CoreExpr), > + OptBindExpr) = > 127 (10); > + > %% > > /** Maximum number of pattern leaves */ > @@ -719,6 +736,27 @@ > */ > p->sem.fun->core = R(p); > break; > + > + /* OptBindExpr: for_ (forbind (forvars (var, > + vars > (nil, var)), > + LiteralValue), > + OptBindExpr) */ > + case 125: > + *p = *let (letbind (LLL(p), LR(p)), R(p)); > + relabel (p, kids); > + rewrite_again = true; > + break; > + > + /* OptBindExpr: for_ (forbind (forvars (var, vars( > + var, > var)), > + LiteralValue), > + OptBindExpr) */ > + case 126: > + *p = *let (letbind (LLL(p), LR(p)), > + let (letbind (LLRL(p), num (1)), R(p))); > + relabel (p, kids); > + rewrite_again = true; > + break; > > default: > break; > > Index: coreopt.brg > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/core/coreopt.brg,v > retrieving revision 1.77 > retrieving revision 1.78 > diff -u -d -r1.77 -r1.78 > --- coreopt.brg 12 Oct 2009 16:15:14 -0000 1.77 > +++ coreopt.brg 5 Nov 2009 16:23:58 -0000 1.78 > @@ -222,6 +222,9 @@ > /* Pathfinder extension: XRPC */ > %term xrpc = 76 /**< XRPC calls: "execute at" */ > > + /* Associated For variable holders */ > +%term vars = 77 /**< variable pair (position. var + > score. var) of a for */ > + > %% > > /* all rules starting from rule 40 are never used > @@ -244,7 +247,7 @@ > OptBindExpr: for_ (forbind (forvars (var, OptVar), > CoreExpr), > OptBindExpr) = > 5 (10); > - > + > OptVar: nil = > 42(10); > OptVar: var = > 43(10); > > @@ -383,6 +386,19 @@ > /* Pathfinder extension: XRPC */ > CoreExpr: xrpc (CoreExpr, FunExpr) = > 116(10); > > +/* Pathfinder full-text score var */ > +CoreExpr: flwr (for_ (forbind (forvars (var, > + vars (nil, nil)), > + CoreExpr), > + nil), var) = > 117 (10); > + > +OptBindExpr: for_ (forbind (forvars (var, > + vars (OptVar, > + OptVar) > + ), > + CoreExpr), > + OptBindExpr) = > 118 (10); > + > %% > > /** Type of a core tree node */ > @@ -1141,7 +1157,7 @@ > *p = *LL(p); > TY(p) = ty; > rewritten = true; > - break; > + break; > } > } > > @@ -1543,6 +1559,56 @@ > break; > } > break; > + > + /* CoreExpr: flwr (for_ (forbind (forvars (var, > + vars (nil, nil)), > + CoreExpr), > + nil), var) */ > + case 117: > + /* replace for loops of the form > + 'for $a in ... return $a' by its input '...' */ > + if (LLLL(p)->sem.var == R(p)->sem.var) { > + *p = *LLR(p); > + relabel (p, kids); > + rewritten = true; > + } > + break; > + > + /* OptBindExpr: for_ (forbind (forvars (var, > + vars (OptVar, > + OptVar) > + ), > + CoreExpr), > + OptBindExpr) */ > + case 118: > + /* > + * If we iterate over a sequence that we know (from > static > + * typing) to always have length 1, replace the `for' by > + * a corresponding `let'. > + */ > + if (PFty_subtype (TY(LR(p)), PFty_xs_anyItem ())) { > + > + PFcnode_t *c = R(p); > + > + if (LLRL(p)->kind != c_nil ) > + c = let (letbind (LLRL(p), num (1)), c); > + > + *p = *let (letbind (LLL(p), LR(p)), c); > + > + /* type-check what we just created */ > + PFty_check (flwr (p, num(1))); > + > + rewritten = true; > + > + /* > + * Re-label entire subtree. Type-checking may have > + * modified all the state labels in the subtree, so > + * we have to restore them. > + */ > + PFcoreopt_label (p); > + break; > + } > + break; > > default: > break; > @@ -1662,8 +1728,32 @@ > > /* a for loop increases the nesting depth */ > base++; > - > - if (LLR(c)->kind == c_var) { > + > + if (LLR(c)->kind == c_vars) { > + if (LLRL(c)->kind == c_var) { > + /* add variable to the environment */ > + *((bind_t *) PFarray_add (unused_var_env)) > + = (bind_t) { .var = LLRL(c)->sem.var, > + .atom = parent, > + .child = child }; > + /* reset reference counter */ > + LLRL(c)->sem.var->used = 0; > + /* record the current scope */ > + LLRL(c)->sem.var->base = base; > + } > + > + if (LLRR(c)->kind == c_var) { > + /* add variable to the environment */ > + *((bind_t *) PFarray_add (unused_var_env)) > + = (bind_t) { .var = LLRR(c)->sem.var, > + .atom = parent, > + .child = child }; > + /* reset reference counter */ > + LLRR(c)->sem.var->used = 0; > + /* record the current scope */ > + LLRR(c)->sem.var->base = base; > + } > + } else if (LLR(c)-> kind == c_var) { > /* add variable to the environment */ > *((bind_t *) PFarray_add (unused_var_env)) > = (bind_t) { .var = LLR(c)->sem.var, > @@ -1791,7 +1881,18 @@ > > unused_var = true; > } else if (n->kind == c_for) { > - LLR(n) = nil (); > + if(LLR(n)->kind == c_var) > + LLR(n) = nil(); > + else { > + if(LLRL(n)->sem.var == var) > + LLRL(n) = nil (); > + else > + LLRR(n) = nil (); > + if(LLRL(n)->kind == c_nil && LLRR(n)->kind == > c_nil) > + LLR(n) = nil(); > + else if(LLRR(n)->kind == c_nil) > + LLR(n) = LLRL(n); > + } > unused_var = true; > } > } else if (var->used == 1 && n->kind == c_let) > > Index: fs.brg > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/core/fs.brg,v > retrieving revision 1.78 > retrieving revision 1.79 > diff -u -d -r1.78 -r1.79 > --- fs.brg 19 Oct 2009 09:30:38 -0000 1.78 > +++ fs.brg 5 Nov 2009 16:23:58 -0000 1.79 > @@ -46,6 +46,7 @@ > #include "abssyn.h" > #include "qname.h" > #include "mem.h" > + > #include "options.h" /* extract option declarations from parse > tree */ > #include "string_utils.h" /* trimming for pragmas */ > > @@ -220,6 +221,13 @@ > %term seed = 128 > %term xrpc = 129 > %term docmgmt_ty = 130 > +%term ftcontains = 131 > +%term ftfilter = 132 > +%term ftignore = 133 > +%term ftor = 134 > +%term ftand = 135 > +%term ftmildnot = 136 > +%term ftnot = 137 > > %% > > @@ -355,7 +363,7 @@ > OptPosVar), > OptExpr), > OptBindExpr) > = 66 (10); > - > + > OptPosVar: nil > = 68 (10); > OptPosVar: Var > = 69 (10); > > @@ -439,22 +447,22 @@ > AndExpr: ComparisonExpr > = 104 (10); > AndExpr: and (ComparisonExpr, AndExpr) > = 105 (10); > > -ComparisonExpr: RangeExpr > = 106 (10); > -ComparisonExpr: eq (RangeExpr, RangeExpr) > = 107 (10); > -ComparisonExpr: ne (RangeExpr, RangeExpr) > = 108 (10); > -ComparisonExpr: lt (RangeExpr, RangeExpr) > = 109 (10); > -ComparisonExpr: le (RangeExpr, RangeExpr) > = 110 (10); > -ComparisonExpr: gt (RangeExpr, RangeExpr) > = 111 (10); > -ComparisonExpr: ge (RangeExpr, RangeExpr) > = 112 (10); > -ComparisonExpr: val_eq (RangeExpr, RangeExpr) > = 113 (10); > -ComparisonExpr: val_ne (RangeExpr, RangeExpr) > = 114 (10); > -ComparisonExpr: val_lt (RangeExpr, RangeExpr) > = 115 (10); > -ComparisonExpr: val_le (RangeExpr, RangeExpr) > = 116 (10); > -ComparisonExpr: val_gt (RangeExpr, RangeExpr) > = 117 (10); > -ComparisonExpr: val_ge (RangeExpr, RangeExpr) > = 118 (10); > -ComparisonExpr: is (RangeExpr, RangeExpr) > = 119 (10); > -ComparisonExpr: ltlt (RangeExpr, RangeExpr) > = 121 (10); > -ComparisonExpr: gtgt (RangeExpr, RangeExpr) > = 122 (10); > +ComparisonExpr: FTContainsExpr > = 106 (10); > +ComparisonExpr: eq (FTContainsExpr, FTContainsExpr) > = 107 (10); > +ComparisonExpr: ne (FTContainsExpr, FTContainsExpr) > = 108 (10); > +ComparisonExpr: lt (FTContainsExpr, FTContainsExpr) > = 109 (10); > +ComparisonExpr: le (FTContainsExpr, FTContainsExpr) > = 110 (10); > +ComparisonExpr: gt (FTContainsExpr, FTContainsExpr) > = 111 (10); > +ComparisonExpr: ge (FTContainsExpr, FTContainsExpr) > = 112 (10); > +ComparisonExpr: val_eq (FTContainsExpr, FTContainsExpr) > = 113 (10); > +ComparisonExpr: val_ne (FTContainsExpr, FTContainsExpr) > = 114 (10); > +ComparisonExpr: val_lt (FTContainsExpr, FTContainsExpr) > = 115 (10); > +ComparisonExpr: val_le (FTContainsExpr, FTContainsExpr) > = 116 (10); > +ComparisonExpr: val_gt (FTContainsExpr, FTContainsExpr) > = 117 (10); > +ComparisonExpr: val_ge (FTContainsExpr, FTContainsExpr) > = 118 (10); > +ComparisonExpr: is (FTContainsExpr, FTContainsExpr) > = 119 (10); > +ComparisonExpr: ltlt (FTContainsExpr, FTContainsExpr) > = 121 (10); > +ComparisonExpr: gtgt (FTContainsExpr, FTContainsExpr) > = 122 (10); > > RangeExpr: AdditiveExpr > = 123 (10); > RangeExpr: range (RangeExpr, RangeExpr) > = 124 (10); > @@ -634,6 +642,58 @@ > /* Pathfinder extension: statement type for document management > functions */ > SequenceType: seq_ty (docmgmt_ty (nil)) > = 238 (10); > > +/* Pathfinder full-text support */ > +FTContainsExpr: RangeExpr > = 239 (10); > +FTContainsExpr: ftcontains (RangeExpr, FTSelectionExpr) > = 240 (10); > +FTContainsExpr: ftcontains (RangeExpr, FTFilterExpr) > = 241 (10); > + > +OptBindExpr: binds (bind (vars (vars (var_type (Var, > + nil), > + OptPosVar), > + OptFTScoreVar), > + OptExpr), > + OptBindExpr) > = 242 (10); > +OptBindExpr: binds (bind (vars (vars (var_type > + (Var, > + TypeDeclaration), > + OptPosVar), > + OptFTScoreVar), > + OptExpr), > + OptBindExpr) > = 243 (10); > + > +OptFTScoreVar: nil > = 244 (10); > +OptFTScoreVar: Var > = 245 (10); > + > +FTFilterExpr: ftfilter (FTSelectionExpr, > + FTIgnoreOption) > = 246 (10); > +FTIgnoreOption: ftignore (UnionExpr) > = 247 (10); > + > +FTSelectionExpr: FTOrExpr > = 248 (10); > + > +FTOrExpr: FTAndExpr > = 249 (10); > +FTOrExpr: ftor (FTOrExpr, FTAndExpr) > = 250 (10); > + > +FTAndExpr: FTMildNot > = 251 (10); > +FTAndExpr: ftand (FTAndExpr, FTMildNot) > = 252 (10); > + > +FTMildNot: FTUnaryNot > = 253 (10); > +FTMildNot: ftmildnot (FTMildNot, FTUnaryNot) > = 254 (10); > + > +FTUnaryNot: FTPrimaryWithOptions > = 255 (10); > +FTUnaryNot: ftnot (FTPrimaryWithOptions) > = 256 (10); > + > +FTPrimaryWithOptions: FTPrimaryExpr > = 257 (10); > + > +FTPrimaryExpr: FTWordsExpr > = 258 (10); > +FTPrimaryExpr: FTSelectionExpr > = 259 (10); > + > +FTWordsExpr: FTWordsValueExpr > = 260 (10); > + > +FTWordsValueExpr: Literal > = 261 (10); > + > +OptBindExpr: binds (let (Var, OptExpr), > + OptBindExpr) > = 262 (10); > + > %% > > /** Access the Core representation of any node */ > @@ -1446,7 +1506,7 @@ > C(R(p)))); > > } break; > - > + > /* OptBindExpr: binds (bind (vars (var_type (Var, > nil), > OptPosVar), > @@ -3906,6 +3966,156 @@ > C(p) = seqtype (PFty_star (PFty_docmgmt ())); > break; > > + /* FTContainsExpr: RangeExpr */ > + case 239: > + break; > + > + /* FTContainsExpr: ftcontains (RangeExpr, > FTSelectionExpr) */ > + case 240: > + { > + PFfun_t *op_ftcontains = function (PFqname (PFns_fts, > "ftcontains")); > + two_arg_fun_worker (p, op_ftcontains); > + > + } break; > + > + /* FTContainsExpr: ftcontains (RangeExpr, > FTFilterExpr) */ > + case 241: > + break; > + > + /* OptBindExpr: binds (bind (vars (vars > (var_type (Var, > + > nil > ), > + > OptPosVar), > + OptFTScoreVar), > + OptExpr), > + OptBindExpr) */ > + case 242: > + C(p) = for_ (forbind (forvars2 (C(LLLLL(p)), > C(LLLR(p)), C(LLR(p))), > + C(LR(p))), > + C(R(p))); > + break; > + > + /* OptBindExpr: binds (bind (vars (vars > (var_type ( > + > Var, > + > TypeDeclaration), > + > OptPosVar), > + OptFTScoreVar), > + OptExpr), > + OptBindExpr) */ > + case 243: > + { > + PFvar_t *v = new_var (NULL); > + > + C(p) = for_ (forbind (forvars2 (var (v), C(LLLR(p)), > C(LLR(p))), > + C(LR(p))), > + let (letbind (C(LLLLL(p)), > + proof (subty (var (v), > + C(LLLLR(p))), > + seqcast (C(LLLLR(p)), > + var (v)))), > + C(R(p)))); > + } break; > + > + /* OptFTScoreVar: nil */ > + case 244: > + C(p) = nil (); > + break; > + > + /* OptFTScoreVar: Var */ > + case 245: > + break; > + > + /*FTFilterExpr: ftfilter (FTSelectionExpr, > + OptFTIgnoreOption) */ > + case 246: > + break; > + > + /*FTIgnoreOption: ftignore (UnionExpr) */ > + case 247: > + PFoops_loc (OOPS_NOTSUPPORTED, p->loc, > + "Full text ignore options not yet > implemented"); > + break; > + > + /*FTSelectionExpr: FTOrExpr */ > + case 248: > + break; > + > + /*FTOrExpr: FTAndExpr */ > + case 249: > + break; > + > + /*FTOrExpr: ftor (FTAndExpr, FTAndExpr) */ > + case 250: > + PFoops_loc (OOPS_NOTSUPPORTED, p->loc, > + "Full text Or operator not yet supported"); > + break; > + > + /*FTAndExpr: FTMildNot */ > + case 251: > + break; > + > + /*FTAndExpr: ftand (FTMildNot, FTMildNot) */ > + case 252: > + PFoops_loc (OOPS_NOTSUPPORTED, p->loc, > + "Full text And operator not yet supported"); > + break; > + > + /*FTMildNot: FTUnaryNot */ > + case 253: > + break; > + > + /*FTMildNot: ftmildnot ( FTUnaryNot, > FTUnaryNot) */ > + case 254: > + PFoops_loc (OOPS_NOTSUPPORTED, p->loc, > + "Full text mild-not not yet supported"); > + break; > + > + /*FTUnaryNot: FTPrimaryWithOptions */ > + case 255: > + break; > + > + /*FTUnaryNot: ftnot (FTPrimaryWithOptions) */ > + case 256: > + PFoops_loc (OOPS_NOTSUPPORTED, p->loc, > + "Full text Not operator not yet supported"); > + break; > + > + /*FTPrimaryWithOptions: FTPrimaryExpr */ > + case 257: > + break; > + > + /*FTPrimaryExpr: FTWordsExpr */ > + case 258: > + break; > + > + /*FTPrimaryExpr: FTSelectionExpr */ > + case 259: > + assert (C(p)); > + break; > + > + /*FTWordsExpr: FTWordsValueExpr */ > + case 260: > + break; > + > + /*FTWordsValueExpr: Literal */ > + case 261: > + assert (C(p)); > + break; > + > + /* OptBindExpr: binds (let (Var, OptExpr), > + OptBindExpr) */ > + case 262: > + { > + PFfun_t *op_score = function (PFqname (PFns_fts, > "score")); > + > + /*C(p) = APPLY (op_plus, > + num (0), > + fs_convert_op_by_type ( > + fn_data (C(L(p))), > + PFty_xs_double ()));*/ > + C(p) = let (letbind (C(LL(p)), APPLY (op_score, > C(LR(p)))), C(R(p))); > + > + } break; > + > default: > PFoops_loc (OOPS_FATAL, p->loc, "untranslated > expression"); > break; > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 > 30-Day > trial. Simplify your report design, integration and deployment - and > focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

2 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_interpreter.mx, Nov2009, 1.319.2.6, 1.319.2.7
by Sjoerd Mullender 06 Nov '09

06 Nov '09

Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv348 > > Modified Files: > Tag: Nov2009 > mal_interpreter.mx > Log Message: > Silence compiler by fixing the call > > > Index: mal_interpreter.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_interpreter.mx,v > retrieving revision 1.319.2.6 > retrieving revision 1.319.2.7 > diff -u -d -r1.319.2.6 -r1.319.2.7 > --- mal_interpreter.mx 5 Nov 2009 13:11:15 -0000 1.319.2.6 > +++ mal_interpreter.mx 6 Nov 2009 07:00:51 -0000 1.319.2.7 > @@ -1319,7 +1319,7 @@ > stream_printf(cntxt->fdout,"start thread in background\n"); > #endif > if (stk == NULL){ > - GDKerror(MAL, "mal.interpreter", MAL_STACK_FAIL); > + GDKerror(MAL, "mal.interpreter:" MAL_STACK_FAIL); > return; > } > sve= stk->keepAlive; > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins Adding a colon to the string is hardly fixing the call. The problem is, GDKerror is not createException: the first argument is a format string. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5/merovingian ChangeLog.Nov2009, Nov2009, 1.1.2.4, 1.1.2.5 merovingian.c, Nov2009, 1.65.2.3, 1.65.2.4 merovingian_forkmserver.c, Nov2009, 1.3.2.5, 1.3.2.6 monetdb.c, Nov2009, 1.65.2.6, 1.65.2.7 properties.c, Nov2009, 1.13.2.2, 1.13.2.3
by Sjoerd Mullender 04 Nov '09

04 Nov '09

Fabian wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5/merovingian > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30904 > > Modified Files: > Tag: Nov2009 > ChangeLog.Nov2009 merovingian.c merovingian_forkmserver.c > monetdb.c properties.c > Log Message: > -----------------------!!!!!---------------------- > !!!!!! THIS COMMIT SHOULD NOT BE PROPAGATED !!!!!! > ================================================== I took care of that. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, Nov2009, 1.82.4.3, 1.82.4.4
by Martin Kersten 03 Nov '09

03 Nov '09

Fabian Groffen wrote: > On 03-11-2009 20:16:25 +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/mal >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv5258 >> >> Modified Files: >> Tag: Nov2009 >> mal_authorize.mx >> Log Message: >> Test the language argument. Possibly null check. Discovered by Coverity > > I think this commit breaks the original logic since the scenario bat may > be empty for e.g. the superuser. there is/should always be a scenario. The default being 'mal' > > >> Index: mal_authorize.mx >> =================================================================== >> RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_authorize.mx,v >> retrieving revision 1.82.4.3 >> retrieving revision 1.82.4.4 >> diff -u -d -r1.82.4.3 -r1.82.4.4 >> --- mal_authorize.mx 31 Oct 2009 09:08:59 -0000 1.82.4.3 >> +++ mal_authorize.mx 3 Nov 2009 20:16:23 -0000 1.82.4.4 >> @@ -394,16 +394,14 @@ >> /* now see if the scenario is permitted (if restrictions for that >> * apply) >> */ >> + if (scenario == NULL || *scenario == NULL || strNil(*scenario)) >> + /* of course we DO NOT tell the exact reason here again */ >> + throw(INVCRED, "checkCredentials", INVCRED_INVALID_USER " '%s'",*username); >> + >> b = BATselect(scen, id, id); >> if (b && BATcount(b) > 0) { >> BATiter bi = bat_iterator(b); >> >> - if (*scenario == NULL || strNil(*scenario)) { >> - BBPunfix(b->batCacheid); >> - /* of course we DO NOT tell the exact reason here again */ >> - throw(INVCRED, "checkCredentials", INVCRED_INVALID_USER " '%s'",*username); >> - } >> - >> /* ok, there are some tuples that we have to consider */ >> BATloop(b, p, q) { >> tmp = (str)BUNtail(bi, p); >> >> >> ------------------------------------------------------------------------------ >> Come build with us! The BlackBerry(R) Developer Conference in SF, CA >> is the only developer event you need to attend this year. Jumpstart your >> developing skills, take BlackBerry mobile applications to market and stay >> ahead of the curve. Join us from November 9 - 12, 2009. Register now! >> http://p.sf.net/sfu/devconference >> _______________________________________________ >> Monetdb-checkins mailing list >> Monetdb-checkins(a)lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

2 2

[Monetdb-developers] Announcement: New Aug2009-SP2 bugfix release of MonetDB suite
by Sjoerd Mullender 01 Nov '09

01 Nov '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the Aug2009-SP2 bug fix release of the MonetDB suite of programs. This is the second bug fix release for the Aug2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb//Development/Releases/Aug2009/#Aug20…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, Nov2009, 1.82.4.1, 1.82.4.2 mal_box.mx, Nov2009, 1.98.4.1, 1.98.4.2 mal_factory.mx, Nov2009, 1.89.6.1, 1.89.6.2 mal_session.mx, Nov2009, 1.200.2.1, 1.200.2.2
by Fabian Groffen 31 Oct '09

31 Oct '09

On 31-10-2009 09:06:11 +0000, Martin Kersten wrote: [snip] > obj->name= GDKstrdup(name); what if the GDKstrdup fails here? > obj->sym= newMalBlk(MAXVARS,STMT_INCREMENT); > obj->val = newGlobalStack(MAXVARS); > + if ( obj->val == NULL) > + showException(MAL,"box.new", MAL_MALLOC_FAIL); I've been looking at mal_sabaoth to deal with GDKmalloc failures, and there is a question to me in cases like this. malloc failed, now the only right way to communicate that to the caller is to throw an exception. However, doing that requires memory too (it GDKmallocs too), so that will most probably fail too. Hence, the throw will die, crash, or even worse, return NULL, which happens to mean MAL_SUCCEED. What should we do here? define a MAL_MALLOC_FAIL constant that we can always return and that's recognised (and hence never freed), or do we redefine MAL_SUCCEED to be non-NULL such that a real NULL means real trouble, and thus an out of memory condition?

2 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_milprint.c, , 1.21, 1.22
by Stefan Manegold 26 Oct '09

26 Oct '09

On Mon, Oct 26, 2009 at 04:49:49PM +0000, Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv28326 > > Modified Files: > tjc_milprint.c > Log Message: > try to fix compilation problem In case you refer to this compilation problem http://monetdb.cwi.nl/testing/projects/monetdb/Candidate/pathfinder/.GNU.64… http://www.ins.cwi.nl/~monet/permastore/2009-10-26/Candidate/make-pathfinde… please note that this problem occurs with Candidate testing, i.e., (also) in the Nov2009 release candidate branch, not (only) in the development trunk, where your checkin went ... Stefan > > Index: tjc_milprint.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_milprint.c,v > retrieving revision 1.21 > retrieving revision 1.22 > diff -u -d -r1.21 -r1.22 > --- tjc_milprint.c 25 Sep 2009 07:22:33 -0000 1.21 > +++ tjc_milprint.c 26 Oct 2009 16:49:47 -0000 1.22 > @@ -306,11 +306,11 @@ > // for old index management > if (tjc_c->maxfrag < 0) { > TJCPRINTF(MILOUT,"ftindex := ftiName;\n"); > - TJCPRINTF(MILOUT,&tjc_c->milfragBUFF[0]); > + TJCPRINTF(MILOUT,"%s", &tjc_c->milfragBUFF[0]); > } > for (c = 0; c <= tjc_c->maxfrag; c++) { > TJCPRINTF(MILOUT,"ftindex := ftiName + \"%d\";\n", c); > - TJCPRINTF(MILOUT,&tjc_c->milfragBUFF[0]); > + TJCPRINTF(MILOUT,"%s", &tjc_c->milfragBUFF[0]); > milprint_end_frag (tjc_c, tree, c); > } > > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] How to register new "bulk" function with SQL?
by Stefan Manegold 22 Oct '09

22 Oct '09

Hoi Niels (and other SQL experts), I implemented the "bulk" version of ogc constructor function point(x:dbl,y:dbl) :wkb i.e. point(x:bat[:oid,:dbl],y:bat[:oid,:dbl]) :bat[:oid,:wkb] in the geom module (see below). How do I get SQL to use this function, e.g., in a scenario like this: CREATE TABLE coords (x double, y double); CREATE TABLE points (p point); INSERT INTO points SELECT POINT(x,y) FROM coords; For now, EXPLAIN still shows the explicit MAL interation calling the original scalar function: [...] | _67 := bat.new(nil:oid,nil:wkb); | | barrier (_71,_72,_73) := bat.newIterator(_16); | | _75 := algebra.find(_24,_72); | | _77 := geom.point(_73,_75); | | bat.insert(_67,_72,_77); | | redo (_71,_72,_73) := bat.hasMoreElements(_16); | | exit (_71,_72,_73); | | _25:bat[:oid,:wkb] := _67; | [...] Thanks in advance! Stefan ps: Eventually, we should consider implemeting bulk versions of all scalar functions in geom in the same (or a similar) way --- assuming that this might improve the performance ... On Thu, Oct 22, 2009 at 04:15:30PM +0000, Stefan Manegold wrote: > Update of /cvsroot/monetdb/geom/src/monetdb5 > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25812/geom/src/monetdb5 > > Modified Files: > geom.mx > Log Message: > > implemented bulk version of ogc constructor function > point(x:dbl,y:dbl) :wkb > i.e. > point(x:bat[:oid,:dbl],y:bat[:oid,:dbl]) :bat[:oid,:wkb] > > Open question: > How to make SQL use this bulk function instead of an explicit > MAL iterator over the scalar function, e.g., in queries like > INSERT INTO points SELECT POINT(x, y) FROM coords; > > > Index: geom.mx > =================================================================== > RCS file: /cvsroot/monetdb/geom/src/monetdb5/geom.mx,v > retrieving revision 1.29 > retrieving revision 1.30 > diff -u -d -r1.29 -r1.30 > --- geom.mx 26 Jun 2009 07:37:52 -0000 1.29 > +++ geom.mx 22 Oct 2009 16:15:28 -0000 1.30 > @@ -170,6 +170,10 @@ > address wkbcreatepoint > comment "Construct a point from two geometries"; > > +command point(x:bat[:oid,:dbl],y:bat[:oid,:dbl]) :bat[:oid,:wkb] > +address wkbcreatepoint_bat > +comment "Construct a point-BAT from two geometry-BATs"; > + > @+ ogc information methods > @mal > command X(g:wkb) :dbl > @@ -1010,6 +1014,76 @@ > } > > geom_export str > +wkbcreatepoint_bat(int *out, int *x,int *y); > + > +str > +wkbcreatepoint_bat(int *out, int *ix,int *iy) > +{ > + BAT *bo = NULL, *bx = NULL, *by = NULL; > + dbl *x = NULL, *y = NULL; > + BUN i, o; > + wkb *p = NULL; > + > + if ((bx = BATdescriptor(*ix)) == NULL) { > + throw(MAL, "geom.point", RUNTIME_OBJECT_MISSING); > + } > + if ((by = BATdescriptor(*iy)) == NULL) { > + BBPreleaseref(bx->batCacheid); > + throw(MAL, "geom.point", RUNTIME_OBJECT_MISSING); > + } > + if (!BAThdense(bx) || !BAThdense(by) || bx->hseqbase != by->hseqbase || BATcount(bx) != BATcount(by)) { > + BBPreleaseref(bx->batCacheid); > + BBPreleaseref(by->batCacheid); > + throw(MAL, "geom.point", "both arguments must have dense and aligned heads"); > + } > + > + if ((bo = BATnew(TYPE_void, ATOMindex("wkb"), BATcount(bx))) == NULL) { > + BBPreleaseref(bx->batCacheid); > + BBPreleaseref(by->batCacheid); > + throw(MAL, "geom.point", MAL_MALLOC_FAIL); > + } > + BATseqbase(bo, bx->hseqbase); > + bo->hdense = TRUE; > + bo->hsorted = TRUE; > + bo->H->nonil = TRUE; > + BATkey(bo, TRUE); > + > + x = (dbl*) Tloc(bx, BUNfirst(bx)); > + y = (dbl*) Tloc(by, BUNfirst(bx)); > + for (i = 0, o = BUNlast(bo); i < BATcount(bx); i++, o++) { > + str err = NULL; > + if ((err = wkbcreatepoint(&p, &x[i], &y[i])) != MAL_SUCCEED) { > + BBPreleaseref(bx->batCacheid); > + BBPreleaseref(by->batCacheid); > + BBPreleaseref(bo->batCacheid); > + throw(MAL, "geom.point", err); > + } > + tfastins_nocheck(bo, o, p, Tsize(bo)); > + GDKfree(p); > + p = NULL; > + } > + > + BATsetcount(bo, BATcount(bx)); > + bo->batDirty = TRUE; > + bo->tdense = FALSE; > + bo->tsorted = FALSE; > + bo->T->nonil = FALSE; > + BATkey(BATmirror(bo), FALSE); > + > + BBPreleaseref(bx->batCacheid); > + BBPreleaseref(by->batCacheid); > + BBPkeepref(*out = bo->batCacheid); > + return MAL_SUCCEED; > + > + bunins_failed: > + if (p) GDKfree(p); > + BBPreleaseref(bx->batCacheid); > + BBPreleaseref(by->batCacheid); > + BBPreleaseref(bo->batCacheid); > + throw(MAL, "geom.point", "bunins failed"); > +} > + > +geom_export str > mbroverlaps( bit *out, mbr *b1, mbr *b2); > > str > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

[Monetdb-developers] web-page: Broken link....
by Romulo Goncalves 22 Oct '09

22 Oct '09

Hello, In this page: http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Start-and-Stop.htm… I click on See for a more complete session "VOC demo." and I end up in the same page, I think the right link should be: http://monetdb.cwi.nl/projects/monetdb/SQL/QuickTour/VOC/index.html Regards, Romulo

2 2

[Monetdb-developers] web-page: mclient options
by Romulo Goncalves 22 Oct '09

22 Oct '09

In monetdb web-page I read the VOC tutorial and I see the the following: shell> mclient -lsql -uvoc -Pvoc sql> \< voc_dump.sql Then I went to: http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/MAPI-Client.html#M… And for client options I see: -P passwd | --passwd=passwd password I just tried in my cvs head version and the option -P does not work. Reading some check ins in clients module, it seems we have to use .monetdb file to avoid typing the password. However, the syntax of the file was not specified. I create the file .monetdb with following content: monetdb monetdb And I get the following message: [goncalve@sirius scripts]$ ./mclient current debug sql .monetdb:1: syntax error: monetdb .monetdb:2: syntax error: monetdb password: I think we need some extra information about this new feature ;) Regards, Romulo

3 3

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/mapiclient dump.c, Aug2009, 1.45.2.1, 1.45.2.2
by Milena Ivanova 22 Oct '09

22 Oct '09

Fabian wrote: > Update of /cvsroot/monetdb/clients/src/mapiclient > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv31397 > > Modified Files: > Tag: Aug2009 > dump.c > Log Message: > Stefan dK ran into a 'table is not unique' message, which IMO can only indicate something is seriously fubared > > Would you please write in English? http://www.merriam-webster.com/dictionary/ showed empty result on 'fubared' and International Maritime Organization for the shortening IMO, Thanks, Milena > Index: dump.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/mapiclient/dump.c,v > retrieving revision 1.45.2.1 > retrieving revision 1.45.2.2 > diff -u -d -r1.45.2.1 -r1.45.2.2 > --- dump.c 22 Sep 2009 08:26:36 -0000 1.45.2.1 > +++ dump.c 22 Oct 2009 08:37:26 -0000 1.45.2.2 > @@ -342,9 +342,10 @@ > > if (cnt != 1) { > if (cnt == 0) > - fprintf(stderr, "Table %s.%s does not exist.\n", schema, tname); > + fprintf(stderr, "table %s.%s does not exist\n", schema, tname); > else > - fprintf(stderr, "Table %s.%s not unique.\n", schema, tname); > + fprintf(stderr, "table %s.%s is not unique, corrupt catalog?\n", > + schema, tname); > goto bailout; > } > > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

2 2

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/python/monetdb mapi2.py, , NONE, 1.1 mapi.py, , 1.17, 1.18
by Sjoerd Mullender 22 Oct '09

22 Oct '09

Sounds like something that should have gone to the Candidate (Nov2009) branch? Gijs Molenaar wrote: > Update of /cvsroot/monetdb/clients/src/python/monetdb > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12494 > > Modified Files: > mapi.py > Added Files: > mapi2.py > Log Message: > > Both python2 and python3 can do import monetdb.mapi now. Change is backwards > compatible. > > Previously you needed to do import monetdb.mapi3 in python3. > > > > --- NEW FILE: mapi2.py --- > # The contents of this file are subject to the MonetDB Public License > # Version 1.1 (the "License"); you may not use this file except in > # compliance with the License. You may obtain a copy of the License at > # http://monetdb.cwi.nl/Legal/MonetDBLicense-1.1.html > # > # Software distributed under the License is distributed on an "AS IS" > # basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the > # License for the specific language governing rights and limitations > # under the License. > # > # The Original Code is the MonetDB Database System. > # > # The Initial Developer of the Original Code is CWI. > # Portions created by CWI are Copyright (C) 1997-July 2008 CWI. > # Copyright August 2008-2009 MonetDB B.V. > # All Rights Reserved. > > """ > this is the python 2.* implementation of the mapi API. > > If you use python 3.* you should use mapi3.py > """ > > import socket > import logging > import struct > > from monetdb.monetdb_exceptions import * > > > logger = logging.getLogger("monetdb") > > MAX_PACKAGE_LENGTH = (1024*8)-2 > > MSG_PROMPT = "" > MSG_INFO = "#" > MSG_ERROR = "!" > MSG_Q = "&" > MSG_QTABLE = "&1" > MSG_QUPDATE = "&2" > MSG_QSCHEMA = "&3" > MSG_QTRANS = "&4" > MSG_QPREPARE = "&5" > MSG_QBLOCK = "&6" > MSG_HEADER = "%" > MSG_TUPLE = "[" > MSG_REDIRECT = "^" > > STATE_INIT = 0 > STATE_READY = 1 > > > class Server: > def __init__(self): > self.state = STATE_INIT > self._result = None > > def connect(self, hostname, port, username, password, database, language): > """ connect to a MonetDB database using the mapi protocol""" > > self.hostname = hostname > self.port = port > self.username = username > self.password = password > self.database = database > self.language = language > > self.socket = socket.socket(socket.AF_INET, socket.SOCK_STREAM) > > try: > self.socket.connect((hostname, port)) > except socket.error, error: > (error_code, error_str) = error > raise OperationalError(error_str) > > self.__login() > > > def __login(self, iteration=0): > """ Reads challenge from line, generate response and check if > everything is okay """ > > challenge = self.__getblock() > response = self.__challenge_response(challenge) > self.__putblock(response) > prompt = self.__getblock().strip() > > if len(prompt) == 0: > # Empty response, server is happy > pass > elif prompt.startswith(MSG_INFO): > logger.info("II %s" % prompt[1:]) > > elif prompt.startswith(MSG_ERROR): > logger.error(prompt[1:]) > raise DatabaseError(prompt[1:]) > > elif prompt.startswith(MSG_REDIRECT): > # a redirect can contain multiple redirects, for now we only use > # the first > response = prompt.split()[0][1:].split(':') > if response[1] == "merovingian": > logger.debug("II: merovingian proxy, restarting " + > "authenticatiton") > if iteration <= 10: > self.__login(iteration=iteration+1) > else: > raise OperationalError("maximal number of redirects " + > "reached (10)") > > elif response[1] == "monetdb": > self.hostname = response[2][2:] > self.port, self.database = response[3].split('/') > self.port = int(self.port) > logger.info("II: merovingian redirect to monetdb://%s:%s/%s" % > (self.hostname, self.port, self.database)) > self.socket.close() > self.connect(self.hostname, self.port, self.username, > self.password, self.database, self.language) > > else: > logger.error('!' + prompt[0]) > raise ProgrammingError("unknown redirect: %s" % prompt) > > else: > logger.error('!' + prompt[0]) > raise ProgrammingError("unknown state: %s" % prompt) > > self.state = STATE_READY > return True > > > def disconnect(self): > """ disconnect from the monetdb server """ > self.state = STATE_INIT > self.socket.close() > > > def cmd(self, operation): > """ put a mapi command on the line""" > logger.debug("II: executing command %s" % operation) > > if self.state != STATE_READY: > raise(ProgrammingError, "Not connected") > > self.__putblock(operation) > response = self.__getblock() > if not len(response): > return > if response[0] in [MSG_Q, MSG_HEADER, MSG_TUPLE]: > return response > elif response[0] == MSG_ERROR: > raise OperationalError(response[1:]) > else: > raise ProgrammingError("unknown state: %s" % response) > > > def __challenge_response(self, challenge): > """ generate a response to a mapi login challenge """ > challenges = challenge.split(':') > salt, identity, protocol, hashes, endian = challenges[:5] > > password = self.password > > if protocol == '9': > algo = challenges[5] > if algo == 'SHA512': > import hashlib > password = hashlib.sha512(password).hexdigest() > elif algo == 'SHA384': > import hashlib > password = hashlib.sha384(password).hexdigest() > elif algo == 'SHA256': > import hashlib > password = hashlib.sha256(password).hexdigest() > elif algo == 'SHA224': > import hashlib > password = hashlib.sha224(password).hexdigest() > elif algo == 'SHA1': > import hashlib > password = hashlib.sha1(password).hexdigest() > elif algo == 'MD5': > import hashlib > password = hashlib.md5(password).hexdigest() > else: > raise NotSupportedError("The %s hash algorithm is not " + > "supported" % algo) > elif protocol != "8": > raise NotSupportedError("We only speak protocol v8 and v9") > > h = hashes.split(",") > if "SHA1" in h: > import hashlib > s = hashlib.sha1() > s.update(password.encode()) > s.update(salt.encode()) > pwhash = "{SHA1}" + s.hexdigest() > elif "MD5" in h: > import hashlib > m = hashlib.md5() > m.update(password.encode()) > m.update(salt.encode()) > pwhash = "{MD5}" + m.hexdigest() > elif "crypt" in h: > import crypt > pwhash = "{crypt}" + crypt.crypt((password+salt)[:8], salt[-2:]) > else: > pwhash = "{plain}" + password + salt > > return ":".join(["BIG", self.username, pwhash, self.language, > self.database]) + ":" > > > def __getblock(self): > """ read one mapi encoded block """ > result = [] > last = 0 > while not last: > flag = self.__getbytes(2) > if len(flag) != 2: > raise OperationalError("server returned %s bytes, I need 2" % > len(flag)) > > # unpack (little endian short) > unpacked = struct.unpack('<H', flag)[0] > length = unpacked >> 1 > last = unpacked & 1 > logger.debug("II: reading %i bytes" % length) > if length > 0: > result.append(self.__getbytes(length)) > > result_str = "".join(result) > logger.debug("RX: %s" % result_str) > return result_str > > > def __getbytes(self, bytes): > """Read an amount of bytes from the socket""" > try: > return self.socket.recv(bytes) > except socket.error, error: > raise OperationalError(error[1]) > > > def __putblock(self, block): > """ wrap the line in mapi format and put it into the socket """ > pos = 0 > last = 0 > while not last: > data = block[pos:pos+MAX_PACKAGE_LENGTH] > length = len(data) > if length < MAX_PACKAGE_LENGTH: > last = 1 > flag = struct.pack( '<H', ( length << 1 ) + last ) > try: > logger.debug("II: sending %i bytes, last: %s" % (length, last)) > logger.debug("TX: %s" % data) > self.socket.send(flag) > self.socket.send(data) > except socket.error, error: > raise OperationalError(error[1]) > pos += length > > > Index: mapi.py > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/python/monetdb/mapi.py,v > retrieving revision 1.17 > retrieving revision 1.18 > diff -u -d -r1.17 -r1.18 > --- mapi.py 7 Jul 2009 11:15:45 -0000 1.17 > +++ mapi.py 22 Oct 2009 10:25:35 -0000 1.18 > @@ -1,263 +1,10 @@ > -# The contents of this file are subject to the MonetDB Public License > -# Version 1.1 (the "License"); you may not use this file except in > -# compliance with the License. You may obtain a copy of the License at > -# http://monetdb.cwi.nl/Legal/MonetDBLicense-1.1.html > -# > -# Software distributed under the License is distributed on an "AS IS" > -# basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the > -# License for the specific language governing rights and limitations > -# under the License. > -# > -# The Original Code is the MonetDB Database System. > -# > -# The Initial Developer of the Original Code is CWI. > -# Portions created by CWI are Copyright (C) 1997-July 2008 CWI. > -# Copyright August 2008-2009 MonetDB B.V. > -# All Rights Reserved. > - > -""" > -this is the python 2.* implementation of the mapi API. > - > -If you use python 3.* you should use mapi3.py > -""" > - > -import socket > -import logging > -import struct > - > -from monetdb.monetdb_exceptions import * > - > - > -logger = logging.getLogger("monetdb") > - > -MAX_PACKAGE_LENGTH = (1024*8)-2 > - > -MSG_PROMPT = "" > -MSG_INFO = "#" > -MSG_ERROR = "!" > -MSG_Q = "&" > -MSG_QTABLE = "&1" > -MSG_QUPDATE = "&2" > -MSG_QSCHEMA = "&3" > -MSG_QTRANS = "&4" > -MSG_QPREPARE = "&5" > -MSG_QBLOCK = "&6" > -MSG_HEADER = "%" > -MSG_TUPLE = "[" > -MSG_REDIRECT = "^" > - > -STATE_INIT = 0 > -STATE_READY = 1 > - > - > -class Server: > - def __init__(self): > - self.state = STATE_INIT > - self._result = None > - > - def connect(self, hostname, port, username, password, database, language): > - """ connect to a MonetDB database using the mapi protocol""" > - > - self.hostname = hostname > - self.port = port > - self.username = username > - self.password = password > - self.database = database > - self.language = language > - > - self.socket = socket.socket(socket.AF_INET, socket.SOCK_STREAM) > - > - try: > - self.socket.connect((hostname, port)) > - except socket.error, error: > - (error_code, error_str) = error > - raise OperationalError(error_str) > - > - self.__login() > - > - > - def __login(self, iteration=0): > - """ Reads challenge from line, generate response and check if > - everything is okay """ > - > - challenge = self.__getblock() > - response = self.__challenge_response(challenge) > - self.__putblock(response) > - prompt = self.__getblock().strip() > - > - if len(prompt) == 0: > - # Empty response, server is happy > - pass > - elif prompt.startswith(MSG_INFO): > - logger.info("II %s" % prompt[1:]) > - > - elif prompt.startswith(MSG_ERROR): > - logger.error(prompt[1:]) > - raise DatabaseError(prompt[1:]) > - > - elif prompt.startswith(MSG_REDIRECT): > - # a redirect can contain multiple redirects, for now we only use > - # the first > - response = prompt.split()[0][1:].split(':') > - if response[1] == "merovingian": > - logger.debug("II: merovingian proxy, restarting " + > - "authenticatiton") > - if iteration <= 10: > - self.__login(iteration=iteration+1) > - else: > - raise OperationalError("maximal number of redirects " + > - "reached (10)") > - > - elif response[1] == "monetdb": > - self.hostname = response[2][2:] > - self.port, self.database = response[3].split('/') > - self.port = int(self.port) > - logger.info("II: merovingian redirect to monetdb://%s:%s/%s" % > - (self.hostname, self.port, self.database)) > - self.socket.close() > - self.connect(self.hostname, self.port, self.username, > - self.password, self.database, self.language) > - > - else: > - logger.error('!' + prompt[0]) > - raise ProgrammingError("unknown redirect: %s" % prompt) > - > - else: > - logger.error('!' + prompt[0]) > - raise ProgrammingError("unknown state: %s" % prompt) > - > - self.state = STATE_READY > - return True > - > - > - def disconnect(self): > - """ disconnect from the monetdb server """ > - self.state = STATE_INIT > - self.socket.close() > - > - > - def cmd(self, operation): > - """ put a mapi command on the line""" > - logger.debug("II: executing command %s" % operation) > - > - if self.state != STATE_READY: > - raise(ProgrammingError, "Not connected") > - > - self.__putblock(operation) > - response = self.__getblock() > - if not len(response): > - return > - if response[0] in [MSG_Q, MSG_HEADER, MSG_TUPLE]: > - return response > - elif response[0] == MSG_ERROR: > - raise OperationalError(response[1:]) > - else: > - raise ProgrammingError("unknown state: %s" % response) > - > - > - def __challenge_response(self, challenge): > - """ generate a response to a mapi login challenge """ > - challenges = challenge.split(':') > - salt, identity, protocol, hashes, endian = challenges[:5] > - > - password = self.password > - > - if protocol == '9': > - algo = challenges[5] > - if algo == 'SHA512': > - import hashlib > - password = hashlib.sha512(password).hexdigest() > - elif algo == 'SHA384': > - import hashlib > - password = hashlib.sha384(password).hexdigest() > - elif algo == 'SHA256': > - import hashlib > - password = hashlib.sha256(password).hexdigest() > - elif algo == 'SHA224': > - import hashlib > - password = hashlib.sha224(password).hexdigest() > - elif algo == 'SHA1': > - import hashlib > - password = hashlib.sha1(password).hexdigest() > - elif algo == 'MD5': > - import hashlib > - password = hashlib.md5(password).hexdigest() > - else: > - raise NotSupportedError("The %s hash algorithm is not " + > - "supported" % algo) > - elif protocol != "8": > - raise NotSupportedError("We only speak protocol v8 and v9") > - > - h = hashes.split(",") > - if "SHA1" in h: > - import hashlib > - s = hashlib.sha1() > - s.update(password.encode()) > - s.update(salt.encode()) > - pwhash = "{SHA1}" + s.hexdigest() > - elif "MD5" in h: > - import hashlib > - m = hashlib.md5() > - m.update(password.encode()) > - m.update(salt.encode()) > - pwhash = "{MD5}" + m.hexdigest() > - elif "crypt" in h: > - import crypt > - pwhash = "{crypt}" + crypt.crypt((password+salt)[:8], salt[-2:]) > - else: > - pwhash = "{plain}" + password + salt > - > - return ":".join(["BIG", self.username, pwhash, self.language, > - self.database]) + ":" > - > - > - def __getblock(self): > - """ read one mapi encoded block """ > - result = [] > - last = 0 > - while not last: > - flag = self.__getbytes(2) > - if len(flag) != 2: > - raise OperationalError("server returned %s bytes, I need 2" % > - len(flag)) > - > - # unpack (little endian short) > - unpacked = struct.unpack('<H', flag)[0] > - length = unpacked >> 1 > - last = unpacked & 1 > - logger.debug("II: reading %i bytes" % length) > - if length > 0: > - result.append(self.__getbytes(length)) > - > - result_str = "".join(result) > - logger.debug("RX: %s" % result_str) > - return result_str > - > - > - def __getbytes(self, bytes): > - """Read an amount of bytes from the socket""" > - try: > - return self.socket.recv(bytes) > - except socket.error, error: > - raise OperationalError(error[1]) > > +import sys > > - def __putblock(self, block): > - """ wrap the line in mapi format and put it into the socket """ > - pos = 0 > - last = 0 > - while not last: > - data = block[pos:pos+MAX_PACKAGE_LENGTH] > - length = len(data) > - if length < MAX_PACKAGE_LENGTH: > - last = 1 > - flag = struct.pack( '<H', ( length << 1 ) + last ) > - try: > - logger.debug("II: sending %i bytes, last: %s" % (length, last)) > - logger.debug("TX: %s" % data) > - self.socket.send(flag) > - self.socket.send(data) > - except socket.error, error: > - raise OperationalError(error[1]) > - pos += length > +# a ugly hack to support python 2 and 3 at the same time > +(major, minor, micro, level, serial) = sys.version_info > +if (major == 3): > + from monetdb.mapi3 import * > +else: > + from monetdb.mapi2 import * > > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry(R) Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9 - 12, 2009. Register now! > http://p.sf.net/sfu/devconference > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal tablet_sql.mx, , 1.9, 1.10
by Sjoerd Mullender 06 Oct '09

06 Oct '09

Shouldn't this have gone to the Nov2009 branch? Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv8289 > > Modified Files: > tablet_sql.mx > Log Message: > Handle the case that an integer column is fed a string value that > appears to match the null string. > > > U tablet_sql.mx > Index: tablet_sql.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/tablet_sql.mx,v > retrieving revision 1.9 > retrieving revision 1.10 > diff -u -d -r1.9 -r1.10 > --- tablet_sql.mx 2 Oct 2009 14:31:39 -0000 1.9 > +++ tablet_sql.mx 6 Oct 2009 13:33:45 -0000 1.10 > @@ -88,12 +88,21 @@ > #endif > adt = fmt->nildata; > fmt->c[0]->T->nonil = 0; > - } else if ( quote && *s == quote ) { > - s++; /* find the last quote */ > + } else > + if ( quote && *s == quote ) { > + /* strip the quotes when present */ > + s++; > for ( t = e = s; *t ; t++) > if ( *t == quote) e = t; > *e = 0; > adt = fmt->frstr(fmt, fmt->adt, s, e, 0); > + /* The user might have specified a null string escape > + e.g. NULL as '', which should be tested */ > + if (adt == NULL && s == e && fmt->nullstr && > + strncasecmp(s, fmt->nullstr, fmt->null_length+1) == 0){ > + adt = fmt->nildata; > + fmt->c[0]->T->nonil = 0; > + } > } else { > for( e=s; *e; e++) > ; > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry® Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9-12, 2009. Register now! > http://p.sf.net/sfu/devconf > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql_result.mx, , 1.127, 1.128
by Sjoerd Mullender 06 Oct '09

06 Oct '09

Shouldn't this have gone to the Nov2009 branch? Martin Kersten wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5 > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7452 > > Modified Files: > sql_result.mx > Log Message: > The loader now properly recognizes decimals read as integer values. > > > U sql_result.mx > Index: sql_result.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql_result.mx,v > retrieving revision 1.127 > retrieving revision 1.128 > diff -u -d -r1.127 -r1.128 > --- sql_result.mx 23 Sep 2009 07:36:21 -0000 1.127 > +++ sql_result.mx 6 Oct 2009 13:30:13 -0000 1.128 > @@ -381,8 +381,17 @@ > } > > len = (*BATatoms[type].atomFromStr)(s, &c->len, (ptr) &c->data); > - if (len == 0 || len != e-s) > + if (len == 0 || len != e-s){ > + /* decimals can be converted to integers when *.000 */ > + if ( s[len++] == '.') > + switch( type ){ > + case TYPE_bte: case TYPE_int: case TYPE_lng: case TYPE_sht: > + while (s[len]=='0') len++; > + if ( s[len] == 0) > + return c->data; > + } > return NULL; > + } > return c->data; > } > > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry® Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9-12, 2009. Register now! > http://p.sf.net/sfu/devconf > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5/merovingian ChangeLog.Aug2009, Aug2009, NONE, 1.1.2.1 ChangeLog, Aug2009, 1.18.2.2, NONE
by Sjoerd Mullender 30 Sep '09

30 Sep '09

Fabian wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5/merovingian > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13466 > > Added Files: > Tag: Aug2009 > ChangeLog.Aug2009 > Removed Files: > Tag: Aug2009 > ChangeLog > Log Message: > switch to branch specific ChangeLog (please don't remove ChangeLog in HEAD) I took care of the not removing part. -- Sjoerd Mullender

1 0

[Monetdb-developers] Important Announcement: New release branch
by Sjoerd Mullender 29 Sep '09

29 Sep '09

I have created a new branch which is to be used for the upcoming Nov2009 release. This branch is called "Nov2009". There are now two "stable" branches, the Aug2009 and Nov2009 branch. The Aug2009 branch will be used for the Aug2009-SP2 release which is scheduled for October. The Nov2009 branch will be used for the Nov2009 feature release in November (and the Nov2009-SP1 and Nov2009-SP2 releases in December and January). The reason for making the Nov2009 branch now, and not waiting until after the Aug2009-SP2 release is that this way there is more time to stabilize the code for the release. There are a number of new features that are planned for the November release. Some of these features are not completed yet, and all of these features have to be properly tested and fixed if they're broken. The not-yet-completed features *must* be completed before the end of October, or else they *will* be removed from the release. New features for the November 2009 release are: - new SQL import from CSV files - new code for large joins - monetdb/merovingian distribution - database replication - native PHP client - others? Features that will definitely not be part of the November 2009 release include: - Stratos's slicing and histogram stuff - more? These will be removed from the Nov2009 branch but of course kept in the development trunk. All developers *must* now decide where each change they want to make to the code belongs. If a bug occurs in the Aug2009 branch, the bug *must* be fixed in that branch. If a bug does not occur in the Aug2009 branch, but it does occur in the Nov2009 branch, it *must* be fixed in the Nov2009 branch (this includes fixes to complete the above-mentioned features). All other changes *must* go to the development trunk. Propagation will be done from the Aug2009 branch to the Nov2009 branch, and from the Nov2009 branch to the development trunk. -- Sjoerd Mullender

3 2

[Monetdb-developers] Announcement: New Aug2009-SP1 bugfix release of MonetDB suite
by Sjoerd Mullender 28 Sep '09

28 Sep '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the Aug2009-SP1 bug fix release of the MonetDB suite of programs. This is the first bug fix release for the Aug2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb//Development/Releases/Aug2009/#Aug20…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[Monetdb-developers] Remote Merovingian control
by Fabian Groffen 25 Sep '09

25 Sep '09

This message only applies to the current development branch of MonetDB, and is informational only, mainly addressed to others working with the current development branch. monetdb[1] goes abroad After quite some hacking to move code back and forth between components, we now got the first version of merovingian[2] and monetdb[1] that can do remote control. I will give some small examples here so everyone that is interested can get up to speed fast, and/or get an idea on the possibilities. Basically, all functionality that used to be implemented in monetdb, is now implemented in merovingian. That means, for instance creation of a database is performed by merovingian. A positive side-effect of this is that the discovery aspect of databases is now real-time, e.g.: % monetdb release dumptest taken database out of maintenance mode: dumptest 2009-09-25 11:54:10 MSG control[8590]: (local): released database 'dumptest' 2009-09-25 11:54:10 MSG discovery[8590]: new database mapi:monetdb://pegasus.ins.cwi.nl:50000/dumptest (ttl=660s) We can see that when database is released again using monetdb release, it is immediately announced in the network, making it available for use. Locking a database has the oposite effect, of course. Next, the "(local)" string indicates that this control command was received over the local UNIX socket, as was the case in previous releases of merovingian. In addition to this local access, monetdb now also can connect over a TCP socket, which needs not to be remote, e.g.: % monetdb -hjarl.ins.cwi.nl -Pxxxxxx status name state uptime health last crash testdbatjenniesmachine stopped 100%, 4m - 2009-09-25 11:56:19 MSG control[11449]: pegasus.ins.cwi.nl:49652: served status list Here we can see that the merovingian at jarl reports it served a status list to pegasus, which is the host I performed the monetdb status at. Note the -Pxxxxxxxx in there, which is the passphrase of the remote merovingian. This passphrase is by default a random string, but can be set to something else by editing the .merovingian_pass file in the dbfarm and restarting merovingian. The way to find other merovingians in the vincinity is by using monetdb discover. Its output now includes how to reach each merovingian, if remote control is enabled for them. Remote control over TCP can be disabled in monetdb5.conf by unsetting mero_controlport. Control entries can be recognised in discover's output by the trailing asterisk, which one can also glob for: % monetdb discover "*\*" location pegasus.ins.cwi.nl:50001* volund.ins.cwi.nl:50001* jarl.ins.cwi.nl:64001* This command just returned all merovingians that have remote control enabled and reports their hostname and port to connect to. The remote control protocol is very simple, and I'm planning to make at least a Java library available to perform these commands, such that monetdb[1] no longer needs to be the only application to perform commands with merovingian. [1] http://homepages.cwi.nl/~fabian/MonetDB/Man%20Pages.html/monetdb.html [2] http://homepages.cwi.nl/~fabian/MonetDB/Man%20Pages.html/merovingian.html

1 0

[Monetdb-developers] Embedded MonetDb under Windows
by Andzej Tatul 22 Sep '09

22 Sep '09

Hello I have installed MonedDB Sql (32 bit) under Windows (xp), but cannot run it as embedded server. In MonetDB documentation it is mentioned that embedded monetDb engine is available. How can I get embedded server installation for windows? Best regards Andzej _________________________________________________________________ Daugiau nei pranešimai – išbandykite likusias „Windows Live™“ dalis. http://www.microsoft.com/windows/windowslive/

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/crackers crackers.mx, , 1.16, 1.17 crackers_sideways.mx, , 1.21, 1.22
by Stefan Manegold 17 Sep '09

17 Sep '09

Stratos (and others ;-)), please find below some comments, hints and questions. Stefan On Wed, Sep 16, 2009 at 09:53:56PM +0000, stratos wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/crackers > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv11656/src/modules/mal/crackers > > Modified Files: > crackers.mx crackers_sideways.mx > Log Message: > position-based tuple reconstruction to use in sideways plans with crack joins > > > U crackers.mx > Index: crackers.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/crackers/crackers.mx,v > retrieving revision 1.16 > retrieving revision 1.17 > diff -u -d -r1.16 -r1.17 > --- crackers.mx 30 Apr 2009 18:43:40 -0000 1.16 > +++ crackers.mx 16 Sep 2009 21:53:53 -0000 1.17 > @@ -504,6 +504,10 @@ > address CRKdProject_@1_@2 > comment "Sync the cracking pair and project the tail. Use for disjunctive queries that require a larger bit vector"; > > +command positionproject( b:bat[:oid,:@1],bp:bat[:oid,:@2],pivot:bat[:oid,:oid]):bat[:oid,:@2] > +address CRKdPositionProject_@1_@2 > +comment "Sync the cracking pair and project the tail. Use position based pivot"; > + > command projectH( b:bat[:oid,:@1],bp:bat[:oid,:@2],l:@1,h:@1,li:bit,hi:bit):bat[:oid,:@1] > address CRKProjectH_@1_@2 > comment "Sync the cracking pair and project the head"; > > U crackers_sideways.mx > Index: crackers_sideways.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/crackers/crackers_sideways.mx,v > retrieving revision 1.21 > retrieving revision 1.22 > diff -u -d -r1.21 -r1.22 > --- crackers_sideways.mx 30 Apr 2009 18:43:40 -0000 1.21 > +++ crackers_sideways.mx 16 Sep 2009 21:53:53 -0000 1.22 > @@ -153,6 +153,7 @@ > crackers_export str CRKMarkedProject_@1_@2(int *res, int *bid, int *pbid, int *pivot, @1 *low, @1 *hgh, bit *inclusiveLow, bit *inclusiveHgh); > crackers_export str CRKPositionProject_@1_@2(int *res, int *bid, int *pbid, int *PositionPivot, @1 *low, @1 *hgh, bit *inclusiveLow, bit *inclusiveHgh); > crackers_export str CRKdProject_@1_@2(int *res, int *bid, int *pbid, int *pivot); > +crackers_export str CRKdPositionProject_@1_@2(int *res, int *bid, int *pbid, int *pivot); > @ > > @{ > @@ -1025,6 +1026,63 @@ > > return MAL_SUCCEED; > } > + > +str > +CRKdPositionProject_@1_@2(int *res, int *bid, int *pbid,int *pivot){ > + BAT *b, *p, *r, *c; > + @2 *pairt, *rest; > + oid *pivott; > + oid size; > + int m; > + oid j; > + > + /* If the necessary map does not exits, then create it */ > + m = existsCrackerIndexSideways(*bid, *pbid); > + if (m==-1){ > + @:CreateCrackerMap(@1,@2)@ > + BBPkeepref(b->batCacheid); > + BBPkeepref(c->batCacheid); > + } > + > + /* Align the map based on the cracker tape of this set */ > + Sync_@1_@2(m,existsCrackerIndexSideways(*bid, -1)); > + > + /* Get the map */ > + if ((b = BATdescriptor(CrackerIndex[m].cbid)) == NULL) > + throw(MAL, "crackers.CRKProject", "Cannot access descriptor"); > + > + if ((p = BATdescriptor(*pivot)) == NULL) > + throw(MAL, "crackers.CRKProject", "Cannot access descriptor"); > + > + size = BATcount(p); > + r = BATnew(TYPE_void,b->ttype,size); This might fail. Error handling? > + > + pairt = (@2 *)Tloc(b, BUNfirst(b)); > + pivott = (oid*)Tloc(p, BUNfirst(p)); > + rest = (@2 *)Tloc(r, BUNfirst(r)); > + > + for (j = 0; j<size; j++){ > + *rest = *(pairt + *pivott); > + rest ++; > + pivott ++; What about replacing the above three lines by rest[j] = pairt[pivott[j]]; ? > + } > + > + BATmark(BATmirror(p),0); ^^^^^^^^^^^^^^^^^^!^^^^^ What's is the purpose/intention of this statement? It IMHO represents a side-effect, since it marks one of the input operands ... Stefan > + > + BATsetcount(r, size); > + > + r->hsorted = FALSE; > + r->tsorted = FALSE; > + r->hdense = FALSE; > + r->tdense = FALSE; > + > + *res = r->batCacheid; > + BBPkeepref(r->batCacheid); > + BBPunfix(p->batCacheid); > + BBPunfix(b->batCacheid); > + > + return MAL_SUCCEED; > +} > @ > > @- Local support functions and macros > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry® Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9-12, 2009. Register now! > http://p.sf.net/sfu/devconf > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] monentdb autocommit
by 颜勋 07 Sep '09

07 Sep '09

Hi all, I use BenchmarkFactory and ODBC to test the monentdb performance. But it seems the default option of monentdb is autocommit, so some test scripts seems not work. How should i change the autocommit option (not only use "set autocommit 0" and just change it in the range of one transaction )? Does anyone know the details(that'are tools, scripts, monetdb enviroment) of TPC-H test in monentdb website? Many thanks~ Regards Yan

3 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal/Tests pithole.mal, Aug2009, NONE, 1.1.2.1 All, Aug2009, 1.113, 1.113.2.1
by Stefan Manegold 06 Sep '09

06 Sep '09

Martin, this checkin seems to contain only the new test. Did you by accident forget to checkin the related code changes? Stefan On Sun, Sep 06, 2009 at 07:40:28AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv29612 > > Modified Files: > Tag: Aug2009 > All > Added Files: > Tag: Aug2009 > pithole.mal > Log Message: > Defense against recursion segfaults. > > > --- NEW FILE: pithole.mal --- > #challenge the runtime stack protection > user.main(); > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/Tests/All,v > retrieving revision 1.113 > retrieving revision 1.113.2.1 > diff -u -d -r1.113 -r1.113.2.1 > --- All 28 Jun 2009 20:53:50 -0000 1.113 > +++ All 6 Sep 2009 07:40:23 -0000 1.113.2.1 > @@ -250,3 +250,4 @@ > flowchk > > dynamicload > +pithole.mal > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] Think someone forgot something again...
by Stefan de Konink 04 Sep '09

04 Sep '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 !SyntaxException:slave.close[0]:RETURN missing Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkqgR5MACgkQYH1+F2Rqwn2RSQCeKz0nIOwSoT51GTAA3w6nWHz1 WKgAn3uV7MmDc2vwQz0YALzwDf3AOYly =HqhO -----END PGP SIGNATURE-----

2 2

[Monetdb-developers] New login intentional?
by Stefan de Konink 04 Sep '09

04 Sep '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 It seems to be that there is a new mechanism that basically doesn't allow mclient to connect directly anymore. Is this behavior intentional? The workaround seems to be -umonetdb with monetdb as password. Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkqgSCkACgkQYH1+F2Rqwn3bGgCeIIj438dKmOp1lasT7sGbgdgE Ow0An1BBzIVLAr7cuLRhsOcexCP287GY =qRmk -----END PGP SIGNATURE-----

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal replicator.mx, , 1.14, 1.15
by Stefan de Konink 29 Aug '09

29 Aug '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 ../../../../src/modules/mal/replicator.mx: In function ‘MASTERreplay’: ../../../../src/modules/mal/replicator.mx:551: error: ‘msg’ may be used uninitialized in this function make[8]: *** [lib_replicator_la-replicator.lo] Error 1 I get the following nag from the compiler. Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkqZWRYACgkQYH1+F2Rqwn2GYACcCyJVoQQzXV72lthLqcuzzCGx ef0AniCCaJy8qHd0IZYjeccYOFwvRCgo =xUjB -----END PGP SIGNATURE-----

2 1

[Monetdb-developers] MonetDB/XQuery: reading XML files from TAR archives
by Wouter Alink 27 Aug '09

27 Aug '09

Hello devs, Roberto and I yesterday discussed that it would be useful to be able to load (compressed) XML collections directly into MonetDB/XQuery. The attached diff provides a new feature for loading multiple XML docs directly from tar files. Usage: "mclient -lxq -C <colname>" and pass a tarfile via stdin, see example below. My question: is this useful enough to make it into MonetDB? And if so, is the current syntax appropriate. Comments are appreciated. Greetings, Wouter $ mkdir xmlfiles $ echo "<abc/>" > xmlfiles/aap.xml $ echo "<abc/>" > xmlfiles/beer.xml $ tar cf xmlfiles.tar xmlfiles $ mclient -lxq -C xmlfiles < xmlfiles.tar Copying TAR file into collection: 'xmlfiles' Name: xmlfiles/beer.xml Length: 7 Name: xmlfiles/aap.xml Length: 7 $ echo 'pf:documents("xmlfiles")' | mclient -lxq <document updatable="false" url="xmlfiles/aap.xml" collection="xmlfiles">xmlfiles/aap.xml</document>, <document updatable="false" url="xmlfiles/beer.xml" collection="xmlfiles">xmlfiles/beer.xml</document> $

2 2

[Monetdb-developers] Announcement: New Aug2009 feature release of MonetDB suite
by Stefan Manegold 20 Aug '09

20 Aug '09

Dear all, The MonetDB team at CWI/MonetDB BV are pleased to announce the new "Aug2009" feature release of the MonetDB suite of programs. This feature release is backward compatible with the previous releases (Nov2008 through May2009-SP2). Caveat: When upgrading from a release older than May2009 (i.e., Nov2008 through Feb2009-SP2), you need to move your write-ahead log following the "recommended" instructions for SQL (<http://monetdb.cwi.nl/Development/Releases/May2009/#SQL>) and/or XQuery (<http://monetdb.cwi.nl/Development/Releases/May2009/#XQuery>). More information on the new release is available at <http://monetdb.cwi.nl/Development/Releases/Aug2009/>. The sources and binaries are available at <http://monetdb.cwi.nl/Download/>. Enjoy! The MonetDB team at CWI/MonetDB BV. -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_interpreter.mx, Aug2009, 1.313.2.2, 1.313.2.3
by Stefan Manegold 18 Aug '09

18 Aug '09

Martin, just for info: while chasing other property checking errors, I happened to notice that this checkin makes tests MonetDB5/src/mal/Tests/tst911.mal MonetDB5/src/mal/Tests/tst912.mal fail with !MALException:mal.propertyCheck:Object not found Stefan On Tue, Aug 18, 2009 at 06:10:37AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv1398 > > Modified Files: > Tag: Aug2009 > mal_interpreter.mx > Log Message: > The accidental loss of a BAT was ignored, while it should lead to an > exception. All other GDKerrors are already converted in a MALexception > with catchKernelException before the interpreter loop terminates. > > > U mal_interpreter.mx > Index: mal_interpreter.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_interpreter.mx,v > retrieving revision 1.313.2.2 > retrieving revision 1.313.2.3 > diff -u -d -r1.313.2.2 -r1.313.2.3 > --- mal_interpreter.mx 17 Aug 2009 13:53:47 -0000 1.313.2.2 > +++ mal_interpreter.mx 18 Aug 2009 06:10:35 -0000 1.313.2.3 > @@ -1615,8 +1615,10 @@ > if( stk->stk[getArg(pci,i)].vtype == TYPE_bat && > stk->stk[getArg(pci,i)].val.bval ){ > b= BATdescriptor(stk->stk[getArg(pci,i)].val.bval); > - if( b == NULL) > + if( b == NULL){ > + ret = createException(MAL, "mal.propertyCheck", RUNTIME_OBJECT_MISSING); > continue; > + } > if( b->batStamp <= stamp){ > if( GDKdebug & 8) > @:batpropcheck(b)@ > @@ -1624,9 +1626,6 @@ > if( GDKdebug & 2) > @:batpropcheck(b)@ > BBPunfix(b->batCacheid); > - if( cntxt->errbuf && cntxt->errbuf[0]) { > - ret = createException(MAL, "mal.propertyCheck", RUNTIME_OBJECT_MISSING); > - } > } > } > #endif > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Module dependencies in Aug2009 release branch/candidate
by Stefan Manegold 17 Aug '09

17 Aug '09

Sjoerd, fellow developers, I just realize the following: (at least) due to my recent changes, (at least) MonetDB4 & MonetDB5 in the Aug2009 release branch (most probably) do no longer compile with an earlier version of MonetDB common (GDK), mainly because I added (for convenience) the assert_shift_width() C macro to gdk.mx/gdk.h . It could well be, that binary build of the latest versions of MonetDB4 & MonetDB5 still work with binary builds of earlier versions of MonetDB common (GDK); at least I'm not aware of any interface changes. Hence, unless we remove the assert_shift_width() C macro, again (and implement its functionlity differently), we'd need to make the upcoming MonetDB-4.32.0 and MonetDB-5.14.0 requiring MonetDB-1.32.0. However, this also changes the dependencies for the binaries. Well, given our regular release cycle, and Windows installers and super source balls that contain "everything", anyway, I don't expect too many users that would like to upgrade only M4 or M5 or sql, while keeping the "old" GDK ... Hence, to be on the save side, I'd propose to update all dependecies in the Aug2009 branch to require part from that very branch (and possibly introduce this as a standard procedure, unless/until we indeed do partial releases). Any thoughs, comments, objections? Thanks! Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_joinpath.mx, Aug2009, 1.50, 1.50.2.1
by Stefan de Konink 16 Aug '09

16 Aug '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Martin Kersten schreef: > For key-valued columns the max join result size is known. > /* foreign key joins are common */ > if( l->ttype== TYPE_oid || r->htype == TYPE_oid || r->htype== TYPE_void) > return MAX(lc,rc); > + if (l->tkey || r->hkey) > + return MAX(lc,rc); Is there a reason not to merge this in the previous if? Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkqIBOQACgkQYH1+F2Rqwn1GvwCfQVokOe6Z1nw9fzn1gALoxKN1 nl8An38ArAJcdAtlQgJWXOdg2XBOMx4V =SZZ9 -----END PGP SIGNATURE-----

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal tablet.mx, , 1.226, 1.227
by Sjoerd Mullender 14 Aug '09

14 Aug '09

Is this correct? What about the case where you have a field which ends in \\, such as \\,more data which is two fields separated by a comma. On 2009-08-14 08:17, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv11440 > > Modified Files: > tablet.mx > Log Message: > Only start looking at the escape if you really have to. > > > U tablet.mx > Index: tablet.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/tablet.mx,v > retrieving revision 1.226 > retrieving revision 1.227 > diff -u -d -r1.226 -r1.227 > --- tablet.mx 14 Aug 2009 05:50:11 -0000 1.226 > +++ tablet.mx 14 Aug 2009 06:17:10 -0000 1.227 > @@ -2278,21 +2278,21 @@ > /* we split based on simple character separators for speed */ > if ( rseplen == 1 ){ > for (; *e; e++) > - if ( *e == '\\') > - e++; > - else > - if ( *e == *rsep) > + if ( *e == *rsep) { > + if ( e> s&& *(e-1) == '\\') > + continue; > break; > + } > if (*e == 0) > e = 0; > } else > do { > for ( ; *e ; e++) > - if ( *e == '\\') > - e++; > - else > - if ( *e == *rsep&& strncmp(e,rsep,rseplen) == 0 ) > + if ( *e == *rsep&& strncmp(e,rsep,rseplen) == 0 ) { > + if ( e> s&& *(e-1) == '\\') > + continue; > break; > + } > > if ( *e ) break; > e = 0; > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

3 3

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_heap.mx, Aug2009, 1.125, 1.125.2.1
by Stefan Manegold 13 Aug '09

13 Aug '09

Sjoerd, this checkin seems to fix the following tests, while not harming any others (on my 64-bit Fedora 10 desktop): MonetDB4/src/gdk/malloc_mmap_priv.milS MonetDB4/src/modules/plain/bat.py sql/src/test/BugTracker-2009/union_leak.SF-2540169.SQL.sh Stefan On Thu, Aug 13, 2009 at 02:41:08PM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv31891 > > Modified Files: > Tag: Aug2009 > gdk_heap.mx > Log Message: > Experimental checkin. > > Memory maps come in two flavors: normal and private > (a.k.a. copy-on-write). The former are more efficient when saving > since less data needs to be copied, but they can be a pain when > dealing with pre-existing heaps, since then a backup needs to be made > before starting to update the data. > > When switching from malloced to memory mapped allocation in a heap, we > now see whether the heap file already existed, and if so, we use a > private memory map (as before), but if the file did not exist, we now > use a normal memory map. We don't need to make a backup first, > because there is no pre-existing data to backup, so this should work. > > The result of this change is that loading data into fresh bats should > be quicker. Since the new heaps are now "normal" memory maps, less > copying takes place when the data is saved. A quick test suggests > that this is indeed the case: the loading part of the 15M Periscope > test took longer than the timeout (1800 seconds) allowed without this > change, but was finished in about 1000 seconds with the change. > > Tonight's testing will hopefully show whether this idea does indeed > work. > > > U gdk_heap.mx > Index: gdk_heap.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_heap.mx,v > retrieving revision 1.125 > retrieving revision 1.125.2.1 > diff -u -d -r1.125 -r1.125.2.1 > --- gdk_heap.mx 25 Jul 2009 21:51:40 -0000 1.125 > +++ gdk_heap.mx 13 Aug 2009 14:41:05 -0000 1.125.2.1 > @@ -206,13 +206,26 @@ > } > /* too big: convert it to a disk-based temporary heap */ > if (can_mmap) { > - FILE *fp = GDKfilelocate(nme, "wb", ext); > + FILE *fp; > char *of = h->filename; > + int existing = 0; > + > + /* if the heap file already exists, we want to > + switch to STORE_PRIV (copy-on-write memory > + mapped files), but if the heap file doesn't > + exist yet, the BAT is new and we can use > + STORE_MMAP */ > + fp = GDKfilelocate(nme, "rb", ext); > + if (fp != NULL) { > + existing = 1; > + fclose(fp); > + } > h->filename = NULL; > + fp = GDKfilelocate(nme, "wb", ext); > if (fp != NULL) { > fclose(fp); > if (h->storage == STORE_MEM) { > - int newmode = (h->newstorage != STORE_MMAP)?h->newstorage:STORE_PRIV; > + int newmode = h->newstorage == STORE_MMAP && existing ? STORE_PRIV : h->newstorage; > /* make sure we realy MMAP */ > if (must_mmap && h->newstorage == STORE_MEM) > newmode = STORE_MMAP; > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/examples/C sample0.c, Aug2009, 1.9, 1.9.2.1 sample1.c, Aug2009, 1.9, 1.9.2.1 sample2.c, Aug2009, 1.9, 1.9.2.1 sample3.c, Aug2009, 1.11, 1.11.2.1 sample4.c, Aug2009, 1.10
by Stefan de Konink 13 Aug '09

13 Aug '09

Could this also be fixed with the same construction? Stefan On Thu, 13 Aug 2009, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/clients/src/examples/C > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30784/src/examples/C > > Modified Files: > Tag: Aug2009 > sample0.c sample1.c sample2.c sample3.c sample4.c smack00.c > smack01.c > Log Message: > We don't need clients_config.h for HAVE_LONG_LONG/HAVE___INT64 anymore, but we do need to define LLFMT. > > U sample0.c > Index: sample0.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/examples/C/sample0.c,v > retrieving revision 1.9 > retrieving revision 1.9.2.1 > diff -u -d -r1.9 -r1.9.2.1 > --- sample0.c 26 Jul 2009 07:47:10 -0000 1.9 > +++ sample0.c 13 Aug 2009 14:28:00 -0000 1.9.2.1 > @@ -17,7 +17,6 @@ > * All Rights Reserved. > */ > > -#include <clients_config.h> > #include <stdlib.h> > #include <stdio.h> > #include <string.h> > > U smack00.c > Index: smack00.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/examples/C/smack00.c,v > retrieving revision 1.12 > retrieving revision 1.12.2.1 > diff -u -d -r1.12 -r1.12.2.1 > --- smack00.c 28 Jul 2009 09:08:16 -0000 1.12 > +++ smack00.c 13 Aug 2009 14:28:00 -0000 1.12.2.1 > @@ -17,7 +17,6 @@ > * All Rights Reserved. > */ > > -#include <clients_config.h> > #include <stdlib.h> > #include <stdio.h> > #include <string.h> > > U smack01.c > Index: smack01.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/examples/C/smack01.c,v > retrieving revision 1.11 > retrieving revision 1.11.2.1 > diff -u -d -r1.11 -r1.11.2.1 > --- smack01.c 28 Jul 2009 08:20:06 -0000 1.11 > +++ smack01.c 13 Aug 2009 14:28:00 -0000 1.11.2.1 > @@ -17,7 +17,6 @@ > * All Rights Reserved. > */ > > -#include <clients_config.h> > #include <stdlib.h> > #include <stdio.h> > #include <string.h> > > U sample4.c > Index: sample4.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/examples/C/sample4.c,v > retrieving revision 1.10 > retrieving revision 1.10.2.1 > diff -u -d -r1.10 -r1.10.2.1 > --- sample4.c 29 Jul 2009 08:03:37 -0000 1.10 > +++ sample4.c 13 Aug 2009 14:28:00 -0000 1.10.2.1 > @@ -17,13 +17,15 @@ > * All Rights Reserved. > */ > > -#include <clients_config.h> > #include <stdlib.h> > #include <stdio.h> > #include <string.h> > #include <mapilib/Mapi.h> > #ifdef _MSC_VER > #define snprintf _snprintf > +#define LLFMT "%I64d" > +#else > +#define LLFMT "%lld" > #endif > > #define die(dbh,hdl) do { \ > > U sample1.c > Index: sample1.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/examples/C/sample1.c,v > retrieving revision 1.9 > retrieving revision 1.9.2.1 > diff -u -d -r1.9 -r1.9.2.1 > --- sample1.c 26 Jul 2009 07:47:10 -0000 1.9 > +++ sample1.c 13 Aug 2009 14:28:00 -0000 1.9.2.1 > @@ -17,7 +17,6 @@ > * All Rights Reserved. > */ > > -#include <clients_config.h> > #include <stdlib.h> > #include <stdio.h> > #include <string.h> > > U sample2.c > Index: sample2.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/examples/C/sample2.c,v > retrieving revision 1.9 > retrieving revision 1.9.2.1 > diff -u -d -r1.9 -r1.9.2.1 > --- sample2.c 26 Jul 2009 07:47:10 -0000 1.9 > +++ sample2.c 13 Aug 2009 14:28:00 -0000 1.9.2.1 > @@ -17,7 +17,6 @@ > * All Rights Reserved. > */ > > -#include <clients_config.h> > #include <stdlib.h> > #include <stdio.h> > #include <string.h> > > U sample3.c > Index: sample3.c > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/examples/C/sample3.c,v > retrieving revision 1.11 > retrieving revision 1.11.2.1 > diff -u -d -r1.11 -r1.11.2.1 > --- sample3.c 29 Jul 2009 10:40:17 -0000 1.11 > +++ sample3.c 13 Aug 2009 14:28:00 -0000 1.11.2.1 > @@ -17,13 +17,15 @@ > * All Rights Reserved. > */ > > -#include <clients_config.h> > #include <stdlib.h> > #include <stdio.h> > #include <string.h> > #include <mapilib/Mapi.h> > #ifdef _MSC_VER > #define snprintf _snprintf > +#define LLFMT "%I64d" > +#else > +#define LLFMT "%lld" > #endif > > #define die(dbh,hdl) do { \ > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

2 3

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/Tests setoptimizer.stable.out, Aug2009, 1.10, 1.10.2.1
by Stefan Manegold 12 Aug '09

12 Aug '09

On Tue, Aug 11, 2009 at 07:57:41PM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/test/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv6957/Tests > > Modified Files: > Tag: Aug2009 > setoptimizer.stable.out > Log Message: > approved output (no propagation, as its related to the optimizer list) propagation prevented. Stefan > > U setoptimizer.stable.out > Index: setoptimizer.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/Tests/setoptimizer.stable.out,v > retrieving revision 1.10 > retrieving revision 1.10.2.1 > diff -u -d -r1.10 -r1.10.2.1 > --- setoptimizer.stable.out 2 Aug 2009 20:26:41 -0000 1.10 > +++ setoptimizer.stable.out 11 Aug 2009 19:57:39 -0000 1.10.2.1 > @@ -33,8 +33,8 @@ > % . # table_name > % single_value # name > % varchar # type > -% 177 # length > -[ "inline,remap,evaluate,costModel,coercions,emptySet,cluster,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex" ] > +% 169 # length > +[ "inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex" ] > % . # table_name > % single_value # name > % varchar # type > @@ -43,13 +43,13 @@ > % . # table_name > % single_value # name > % varchar # type > -% 177 # length > -[ "inline,remap,evaluate,costModel,coercions,emptySet,cluster,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex" ] > +% 169 # length > +[ "inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex" ] > % . # table_name > % single_value # name > % varchar # type > -% 177 # length > -[ "inline,remap,evaluate,costModel,coercions,emptySet,cluster,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex" ] > +% 169 # length > +[ "inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex" ] > > # 20:30:45 > > # 20:30:45 > Done. > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5/Tests optimizers.stable.err, Aug2009, 1.5, 1.5.2.1 optimizers.stable.out, Aug2009, 1.10, 1.10.2.1
by Stefan Manegold 12 Aug '09

12 Aug '09

On Tue, Aug 11, 2009 at 07:54:17PM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv6586/Tests > > Modified Files: > Tag: Aug2009 > optimizers.stable.err optimizers.stable.out > Log Message: > approved output (no propagation, as its related to the optimizer list) propagation prevented. Stefan > > U optimizers.stable.out > Index: optimizers.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/Tests/optimizers.stable.out,v > retrieving revision 1.10 > retrieving revision 1.10.2.1 > diff -u -d -r1.10 -r1.10.2.1 > --- optimizers.stable.out 2 Aug 2009 20:25:23 -0000 1.10 > +++ optimizers.stable.out 11 Aug 2009 19:54:14 -0000 1.10.2.1 > @@ -43,8 +43,8 @@ > % ., . # table_name > % single_value, single_value # name > % char, varchar # type > -% 15, 177 # length > -[ "optimizer test:", "inline,remap,evaluate,costModel,coercions,emptySet,cluster,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex" ] > +% 15, 169 # length > +[ "optimizer test:", "inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex" ] > % ., . # table_name > % single_value, single_value # name > % char, varchar # type > > U optimizers.stable.err > Index: optimizers.stable.err > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/Tests/optimizers.stable.err,v > retrieving revision 1.5 > retrieving revision 1.5.2.1 > diff -u -d -r1.5 -r1.5.2.1 > --- optimizers.stable.err 2 Aug 2009 20:25:23 -0000 1.5 > +++ optimizers.stable.err 11 Aug 2009 19:54:13 -0000 1.5.2.1 > @@ -12,11 +12,11 @@ > # 08:05:50 > Mtimeout -timeout 60 MapiClient -lsql -umonetdb -Pmonetdb --host=gio --port=35043 > # 08:05:50 > > > -MAPI = monetdb@alf:35564 > +MAPI = monetdb@alf:31035 > QUERY = set optimizer='coercions,emptySet,accessmode,aliases,commonTerms,accumulators,joinPath,deadcode,reduce,garbageCollector,'; > ERROR = !SQLException:optimizer: 'inline' should be the first > !SQLException:optimizer: 'multiplex' should be the last > - !SQLException:optimizer: pipeline set to 'inline,remap,evaluate,costModel,coercions,emptySet,cluster,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex' > + !SQLException:optimizer: pipeline set to 'inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex' > > # 08:05:51 > > # 08:05:51 > Done. > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/conf monetdb5.conf.in, Aug2009, 1.61, 1.61.2.1
by Stefan Manegold 11 Aug '09

11 Aug '09

On Tue, Aug 11, 2009 at 06:49:24AM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/MonetDB5/conf > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv10254/conf > > Modified Files: > Tag: Aug2009 > monetdb5.conf.in > Log Message: > we don't want to release with the cluster optimizer enabled by default. > (please do not forward to the HEAD) I just prevented the propagation. Stefan > > U monetdb5.conf.in > Index: monetdb5.conf.in > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/conf/monetdb5.conf.in,v > retrieving revision 1.61 > retrieving revision 1.61.2.1 > diff -u -d -r1.61 -r1.61.2.1 > --- monetdb5.conf.in 25 Jul 2009 22:05:24 -0000 1.61 > +++ monetdb5.conf.in 11 Aug 2009 06:49:21 -0000 1.61.2.1 > @@ -236,9 +236,12 @@ > # sql_optimizer=inline,remap,deadcode,multiplex > > # The default pipeline > -sql_optimizer=inline,remap,evaluate,costModel,coercions,emptySet,cluster,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex > +sql_optimizer=inline,remap,evaluate,costModel,coercions,emptySet,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex > > #experimental pipelines stressing various components > +# The cluster pipeline for Skyserver loading > +#sql_optimizer=inline,remap,evaluate,costModel,coercions,emptySet,cluster,aliases,mergetable,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex > +# > # The Recycle pipeline for Skyserver > #sql_optimizer=inline,remap,evaluate,costModel,coercions,emptySet,aliases,deadcode,constants,commonTerms,joinPath,deadcode,recycle,reduce,garbageCollector,dataflow,history,multiplex > # > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal tablet.mx, , 1.208, 1.209
by Sjoerd Mullender 10 Aug '09

10 Aug '09

Was this a current-only bug or should this be backported? On 2009-08-07 16:16, Niels Nes wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv8974/src/modules/mal > > Modified Files: > tablet.mx > Log Message: > also field numbers start at 1 (not 0) > > > U tablet.mx > Index: tablet.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/tablet.mx,v > retrieving revision 1.208 > retrieving revision 1.209 > diff -u -d -r1.208 -r1.209 > --- tablet.mx 7 Aug 2009 14:10:01 -0000 1.208 > +++ tablet.mx 7 Aug 2009 14:16:26 -0000 1.209 > @@ -2140,7 +2140,7 @@ > mal_set_lock(mal_contextLock,"tablet insert value"); > if ( *err == NULL){ > snprintf(buf,BUFSIZ, "value '%s' while parsing '%s' from line " BUNFMT > - " field %d not inserted, expecting type %s\n", val, s, BATcount(fmt->c)+1, c, fmt->type); > + " field %d not inserted, expecting type %s\n", val, s, BATcount(fmt->c)+1, c+1, fmt->type); > *err= GDKstrdup(buf); > } > mal_unset_lock(mal_contextLock,"tablet insert value"); > @@ -2155,7 +2155,7 @@ > } > return 0; > bunins_failed: > - snprintf(buf,BUFSIZ, "while parsing '%s' from line " BUNFMT " field %d not inserted\n", s, BATcount(fmt->c)+1, c); > + snprintf(buf,BUFSIZ, "while parsing '%s' from line " BUNFMT " field %d not inserted\n", s, BATcount(fmt->c)+1, c+1); > *err= GDKstrdup(buf); > return -1; > } > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

3 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal tablet.mx, , 1.207, 1.208
by Sjoerd Mullender 10 Aug '09

10 Aug '09

Was this a current-only bug or should this be backported? On 2009-08-07 16:10, Niels Nes wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv6865/src/modules/mal > > Modified Files: > tablet.mx > Log Message: > output correct line numbers > > > U tablet.mx > Index: tablet.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/tablet.mx,v > retrieving revision 1.207 > retrieving revision 1.208 > diff -u -d -r1.207 -r1.208 > --- tablet.mx 7 Aug 2009 06:25:15 -0000 1.207 > +++ tablet.mx 7 Aug 2009 14:10:01 -0000 1.208 > @@ -2140,7 +2140,7 @@ > mal_set_lock(mal_contextLock,"tablet insert value"); > if ( *err == NULL){ > snprintf(buf,BUFSIZ, "value '%s' while parsing '%s' from line " BUNFMT > - " field %d not inserted, expecting type %s\n", val, s, BATcount(fmt->c), c, fmt->type); > + " field %d not inserted, expecting type %s\n", val, s, BATcount(fmt->c)+1, c, fmt->type); > *err= GDKstrdup(buf); > } > mal_unset_lock(mal_contextLock,"tablet insert value"); > @@ -2155,7 +2155,7 @@ > } > return 0; > bunins_failed: > - snprintf(buf,BUFSIZ, "while parsing '%s' from line " BUNFMT " field %d not inserted\n", s, BATcount(fmt->c), c); > + snprintf(buf,BUFSIZ, "while parsing '%s' from line " BUNFMT " field %d not inserted\n", s, BATcount(fmt->c)+1, c); > *err= GDKstrdup(buf); > return -1; > } > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

2 1

[Monetdb-developers] ODBC in Vista / Windows 2003 using Excel 2007
by Tim Wilson 06 Aug '09

06 Aug '09

Hi, Thanks for the contribution of MonetDB to the community. I have MonetDB set up on a Windows 2003 32-bit OS and am having difficulty using the ODBC driver. The message I get in Vista 32-bit when I try and add an ODBC data source in Excel 2007 is the following: "Specified driver could not be loaded due to system error 182 (MonetDB ODBC Driver)." That's as far as I get. I get this same error message on Windows XP 64-bit using Excel 2007. To troubleshoot this, I tried the ODBC directly from the Windows 2003 database host using Excel 2007 and I get a bit further. "Unable to obtain list of tables from the data source" I see that the ODBC is connecting to the database as, when I use Access 2007 from the same server, I can see the tables, but get an error message when trying to import or link to the tables. To me, it looks like the driver is not loading at all in Windows Vista 32-bit or XP 64-bit. But, in Windows 2003 32-bit, it is loading but unable to correctly access the data. I have done some searching on the Internet and tried a few recommendations but have not found a lot on this issue. MonetDB is a great product and I think it has tremendous BI potential if these issues were corrected. Is there active work on the ODBC driver? I would be happy to help out in any way. I do have C programming skills but no driver or ODBC experience. Thanks, -Tim

1 0

[Monetdb-developers] GooglePerformanceTools with MonetDB?
by Stefan de Konink 04 Aug '09

04 Aug '09

GooglePerformanceTools gives an alternative (threaded) implementation of malloc under a BSD License. Has it even been tested with MonetDB before? http://code.google.com/p/google-perftools/wiki/GooglePerformanceTools I mean, it looks very simple to use and test :) And implements the ideas I have heard before by doing memory management with big chunks of memory instead of small allocations. Stefan

3 5

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/debug logdebug.c, , 1.131, 1.132
by Stefan Manegold 04 Aug '09

04 Aug '09

Hi Tom, this looks like a bug fix to me. Shouldn't that checkin then have gone to the new Aug2009 release branch? Otherwise, this fix will surely not be in the next releases (Aug2009, Aug2009-SP1, Aug2009-SP2) ... Let me know, in case you need advice or help with back-porting this one to the Aug2009 release branch (using CVS commands, only, to prevent conflicts), and with checkin in future bug fixes to the release branch. Thanks! Stefan On Tue, Aug 04, 2009 at 08:50:10AM +0000, Tom Schreiber wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/debug > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12470/compiler/debug > > Modified Files: > logdebug.c > Log Message: > -- Fixed a small bug in the dot output for algebra plans: planheader-port-id's and their references were unaligned (causing warnings from the dot executable). > > U logdebug.c > Index: logdebug.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/debug/logdebug.c,v > retrieving revision 1.131 > retrieving revision 1.132 > diff -u -d -r1.131 -r1.132 > --- logdebug.c 31 Jul 2009 13:06:21 -0000 1.131 > +++ logdebug.c 4 Aug 2009 08:50:07 -0000 1.132 > @@ -2621,7 +2621,7 @@ > for (unsigned int j = 0; j < clsize (root->sem.ser_rel.items); j++) > fprintf (f, "%s <item%u> %s ", > (j ? "|" : ""), > - j, > + j + 1, > PFcol_str (clat (root->sem.ser_rel.items, j))); > fprintf (f, "}}}\"];\n" > "subgraph clusterPlan%i {\n", id); > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 4

[Monetdb-developers] New stable branch created
by Sjoerd Mullender 03 Aug '09

03 Aug '09

I have created new stable branches for the upcoming release. From now on *all* bug fixes and *only* bug fixes *must* go to this new stable branch. I reserve the right to undo any changes that do not comply with this rule. All packages use the same name for the branch: Aug2009. So in each of your stable checkout directories you can do cvs update -rAug2009 to update to the new branch. I have created branches for the following packages: MonetDB MonetDB4 MonetDB5 TestTools buildtools clients geom java pathfinder sql template testing. Note that datacell is missing from this list. It is not yet released and will not be released in this round. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal pcre.mx, , 1.86, 1.87
by Stefan Manegold 02 Aug '09

02 Aug '09

On Sat, Aug 01, 2009 at 03:45:42PM +0000, Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv22620 > > Modified Files: > pcre.mx > Log Message: > Always use PCRE for case insensitive matches, even though they don't use > any wildcards. As far as I know there are no case insensitive versions > of BAT*select, so fixing that up would be more efforts than just going > through PCRE. Once / in case that turns[C out to be(come) a performance bottleneck, we could probably add a BAT(u)iselect (for string-tailed BATs, only) that is based on strcasecmp(3) with not too much efford ... Stefan > > U pcre.mx > Index: pcre.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/pcre.mx,v > retrieving revision 1.86 > retrieving revision 1.87 > diff -u -d -r1.86 -r1.87 > --- pcre.mx 1 Aug 2009 14:43:08 -0000 1.86 > +++ pcre.mx 1 Aug 2009 15:45:40 -0000 1.87 > @@ -1267,20 +1267,36 @@ > > if (!r) { > if (strcmp(ppat, (char*)str_nil) == 0) { > - BAT *bp = BATdescriptor(*b); > - BAT *res = NULL; > - > - if (bp == NULL) > - throw(MAL, "pcre.like", OPERATION_FAILED); > - if (us) > - res = BATuselect(bp, *pat, *pat); > - else > - res = BATselect(bp, *pat, *pat); > - > - *ret = res->batCacheid; > - BBPkeepref(res->batCacheid); > - BBPreleaseref(bp->batCacheid); > - r = MAL_SUCCEED; > + /* there is no pattern or escape involved, fall back to > + * simple (no PCRE) match */ > + /* FIXME: we have a slight problem here if we need a case > + * insensitive match, so even though there is no pattern, > + * just fall back to PCRE for the moment. If there is a > + * case insensitive BAT*select, we should use that instead */ > + if (ignore) { > + GDKfree(ppat); > + ppat = GDKmalloc(sizeof(char) * (strlen(*pat) + 3)); > + sprintf(ppat, "^%s$", *pat); > + if (us) > + r = PCREuselect(ret, &ppat, b, &ignore); > + else > + r = PCREselect(ret, &ppat, b, &ignore); > + } else { > + BAT *bp = BATdescriptor(*b); > + BAT *res = NULL; > + > + if (bp == NULL) > + throw(MAL, "pcre.like", OPERATION_FAILED); /*operation?*/ > + if (us) > + res = BATuselect(bp, *pat, *pat); > + else > + res = BATselect(bp, *pat, *pat); > + > + *ret = res->batCacheid; > + BBPkeepref(res->batCacheid); > + BBPreleaseref(bp->batCacheid); > + r = MAL_SUCCEED; > + } > } else { > if (us) > r = PCREuselect(ret, &ppat, b, &ignore); > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 4

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server rel_select.mx, May2009, 1.143.2.4, 1.143.2.5
by Stefan de Konink 31 Jul '09

31 Jul '09

On Fri, 31 Jul 2009, Niels Nes wrote: Here you still asign something that could be NULL. > dnode *n = selection->h; > > - (void) where; > + if (!selection) > + return sql_error(sql, 02, "SELECT: the selection or from part is missing"); So the asignment should be after the check. Stefan

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/Tests All, , 1.73, 1.74
by Stefan Manegold 30 Jul '09

30 Jul '09

On Thu, Jul 30, 2009 at 06:36:20PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7859 > > Modified Files: > All > Log Message: > Move remote88 out of sight. It needs sql. maybe, it [cs]ould be move to the SQL tree, then? Stefan > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/Tests/All,v > retrieving revision 1.73 > retrieving revision 1.74 > diff -u -d -r1.73 -r1.74 > --- All 14 Jul 2009 15:21:04 -0000 1.73 > +++ All 30 Jul 2009 18:36:16 -0000 1.74 > @@ -30,8 +30,8 @@ > remote03 > remote04 > remote06 > -remote88 > -# needs Merovingian > +# needs Merovingian and aims at SQL > +#remote88 > #remote89 > remote99 > > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_datacyclotron.mx, , 1.10, 1.11
by Stefan Manegold 30 Jul '09

30 Jul '09

On Thu, Jul 30, 2009 at 06:34:36PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7647 > > Modified Files: > opt_datacyclotron.mx > Log Message: > Use the proper length for symbols. > > > U opt_datacyclotron.mx > Index: opt_datacyclotron.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_datacyclotron.mx,v > retrieving revision 1.10 > retrieving revision 1.11 > diff -u -d -r1.10 -r1.11 > --- opt_datacyclotron.mx 14 Jul 2009 09:09:09 -0000 1.10 > +++ opt_datacyclotron.mx 30 Jul 2009 18:34:34 -0000 1.11 > @@ -88,7 +88,7 @@ > #ifdef BIND_DATAFLOW_OPT > setFunctionId(p, putName("bind",7)); ^^^^ ^ > #else > - setFunctionId(p, putName("copy",7)); > + setFunctionId(p, putName("copy",4)); ^^^^ ^ non-educated question: why is "bind" longer than "copy" ? ... or is that parameter not the length of that symbol? Stefan > #endif > used[getArg(p,0)] = 1; > actions++; > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_octopus.mx, , 1.57, 1.58 opt_macro.mx, , 1.47, 1.48
by Martin Kersten 30 Jul '09

30 Jul '09

Fabian Groffen wrote: > On 29-07-2009 20:19:48 +0000, Martin Kersten wrote: >> octopus - check if the head is managed by merovingian > >> - if (list == NULL || needed == NULL){ >> + /* check if the head is properly administered for Octopus */ >> + SABAOTHgetLocalConnection(&name); > > This check will (almost) always succeed, setting name to non-NULL and > by no means checks for merovingian. Is this what you intended to > happen? well, OPCinitcode uses this call and got a null pointer in the situation that 1) 2 legs were created through monetdb and 2) the head was an mserver5 started separately and not createdb with monetdb. So, the test was for this null string and abandon octopus code. Otherwise, the final derived code would contain a remoter.connect(nil,"monetdb",.... > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

2 1

[Monetdb-developers] Announcement: May2009-SP2 bug fix release
by Sjoerd Mullender 29 Jul '09

29 Jul '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the May 2009-SP2 bug fix release of the MonetDB suite of programs. This is the second bug fix release for the May2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/May2009/#May200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal algebraExtensions.mx, , 1.60, 1.61
by Martin Kersten 28 Jul '09

28 Jul '09

Should i restart the 400Mx400M experiment? I see a lot of BBPtrims passing by Stefan Manegold wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv1551/MonetDB5/src/modules/mal > > Modified Files: > algebraExtensions.mx > Log Message: > > revive 1Gx1G by creating less partitions in the first step > > > U algebraExtensions.mx > Index: algebraExtensions.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/algebraExtensions.mx,v > retrieving revision 1.60 > retrieving revision 1.61 > diff -u -d -r1.60 -r1.61 > --- algebraExtensions.mx 28 Jul 2009 17:01:05 -0000 1.60 > +++ algebraExtensions.mx 28 Jul 2009 18:45:50 -0000 1.61 > @@ -780,7 +780,6 @@ > } > else > { > - int n = 0; > /* smaller exceeds L2 > * => partition for L2 in n steps (depth-first) such that no step > * generates more than 1024 new partitions per partition > @@ -803,8 +802,10 @@ > parts <<= 1; > } > @) > - n = ((p - 1) / 10) + 1; > - p /= n; > + p = p % 10; > + if (p == 0) { > + p = 10; > + } > parts = 1 << p; > } > > > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel unix.mx, , 1.24, 1.25
by Sjoerd Mullender 28 Jul '09

28 Jul '09

Why do you want to be able to flush all changed files to disk? MonetDB already does flushes when they are needed for transaction support. I don't think we need to tell the kernel to synchronize any other files with the disk. This function doesn't do anything with memory management within the process. Furthermore, this function is not available on Windows. Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv20459 > > Modified Files: > unix.mx > Log Message: > We want to experiment with complete flushing memory in out of memory > queries. > > > U unix.mx > Index: unix.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/unix.mx,v > retrieving revision 1.24 > retrieving revision 1.25 > diff -u -d -r1.24 -r1.25 > --- unix.mx 7 Jan 2009 14:15:12 -0000 1.24 > +++ unix.mx 27 Jul 2009 06:29:44 -0000 1.25 > @@ -35,6 +35,10 @@ > address UNIXsetenv > comment "Set the environment variable string."; > > +command sync() :void > +address UNIXsync > +comment "Flush memory, expensive but sometimes needed"; > + > @- Implementation > The remainder is a straight forward mapping to the underlying > facilities > @@ -113,4 +117,10 @@ > return MAL_SUCCEED; > } > > +unix_export str UNIXsync(int *res); > +str UNIXsync(int *res){ > + (void) res; > + sync(); > + return MAL_SUCCEED; > +} > @} > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

2 1

[Monetdb-developers] Connection fails
by Riham Abdel Kader 27 Jul '09

27 Jul '09

Hi all, I have lately re-installed the Jun2008 release of MonetDB/XQuery. I can start Mserver successfully and connect to it with mclient to execute XQueries. When I try to connect to it using a MapiSocket from my java program, I get the following error: "java.net.ConnectException: Connection refused". I also tried: > telnet localhost 50000 and I get: Trying ::1... telnet: connect to address ::1: Connection refused Any idea what I could be doing wrong? Thanks for your time, Riham

3 3

[Monetdb-developers] Suggestion to ditch SHA-1, and embrace SHA-2
by Stefan de Konink 24 Jul '09

24 Jul '09

As already found in the news SHA-1 is advised to migrated off by 2010. I would suggest SHA-2 in protocol 9. Stefan

6 19

Re: [Monetdb-developers] [ monetdb-Bugs-2787825 ] mclient: stdin + statement
by Wouter Alink 23 Jul '09

23 Jul '09

The bug (#2787825) seems to be closed for comments, but I think this bug should not be closed until the documentation gets updated. typing "man mclient" on the stable branch tells me: --statement=stmt (-s stmt) Execute the specified query. The query is run before any queries from files specified on the command line are run, and before the interactive session is started (if the --interactive option is given). This is not in line with Martin's latest comment. Martin, could you re-open the bug (I don't have the permissions to do so)? Greetings, Wouter 2009/7/20 SourceForge.net <noreply(a)sourceforge.net>: > Bugs item #2787825, was opened at 2009-05-06 14:21 > Message generated for change (Comment added) made by mlkersten > You can respond by visiting: > https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2787825&group_… > > Please note that this message will contain a full copy of the comment thread, > including the initial issue submission, for this request, > not just the latest update. > Category: Mapi > Group: Clients CVS Head >>Status: Closed >>Resolution: Wont Fix > Priority: 5 > Private: No > Submitted By: Wouter Alink (vzzzbx) > Assigned to: Nobody/Anonymous (nobody) > Summary: mclient: stdin + statement > > Initial Comment: > It seems that there is a problem with both providing data via stdin and via the -s feature in mclient. (see example below). > > A possible solution could perhaps be to forbid this use. Another solution would be to define a behaviour: either read the '-s' first or the stdin first. (perhaps this already is the case, but I couldn't find any documentation about it) > > $ cat data.dat > 1 > 2 > 3 > 4 > 5 > $ N=4; head -n $N data.dat | mclient -lsql -p50151 -dtest -s "copy $N records into aap from STDIN;" > MAPI = monetdb@localhost:50151 > QUERY = copy 4 records into aap from STDIN; > ERROR = !SQLException:sql:value ';' while parsing ';' from line 0 field 0 not inserted, expecting type int > !SQLException:importTable:failed to import table > > > ---------------------------------------------------------------------- > >>Comment By: Martin Kersten (mlkersten) > Date: 2009-07-20 21:48 > > Message: > Standard input is ignored in combination with -s. > Closing it as at best it can be considered a niche feature request. > > ---------------------------------------------------------------------- > > Comment By: Wouter Alink (vzzzbx) > Date: 2009-05-07 21:55 > > Message: > as discussed on the monetdb-users list, using either the -s _or_ the stdin > works fine (except for other reported/unreported bugs), but the combination > fails. (stefan's example works fine). > > I can very well imagine that using a combination should not be allowed > (and should not even become a feature request), but I feel that the current > message is not very helpful. > > And, actually (I hadn't thought of this option before), if I would have > specified "-i" then the documentation (mclient --help) says it reads from > stdin _after_ reading the command line args, but it generates the same > error. > > After some more tests I discovered that: > - when using the command line args + stdin + mentioning '-i', the > semi-colon after "copy $N records into aap from STDIN;" should be left out, > so the following does work: > > $ echo "1 > 2 > 3 > 4 > 5" | mclient -lsql -dtest -hskadi -p50151 -i -s "COPY 5 RECORDS INTO aap > FROM STDIN" > > (notice the omission of ';' after the COPY statement) > > If I do exactly the same, but leave out the '-i', no error is displayed, > but nothing gets inserted either. > > If I use only stdin only: > > $ echo "COPY 5 RECORDS INTO aap FROM STDIN; > 1 > 2 > 3 > 4 > 5" | mclient -lsql -dtest -hskadi -p50151 > > then this works (only if the ';' after the COPY statement is present). > > I don't know whether there are two different bugs mentioned in this > explanation, but I think there definitely is something wrong. > > by the way: the create statement for aap is: "CREATE TABLE aap (x int);" > > ---------------------------------------------------------------------- > > Comment By: Stefan Manegold (stmane) > Date: 2009-05-07 19:30 > > Message: > What about: > > { N=4 ; echo "copy $N records into aap from STDIN;" ; head -n $N data.dat > ; } | mclient -lsql -p50151 -dtest > > ? > > > ---------------------------------------------------------------------- > > Comment By: Sjoerd Mullender (sjoerd) > Date: 2009-05-07 14:26 > > Message: > Where does it say that this is supported? > If it doesn't say anywhere, this is a feature request, not a bug. > > ---------------------------------------------------------------------- > > You can respond by visiting: > https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2787825&group_… >

2 3

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_inline.mx, , 1.22, 1.23
by Sjoerd Mullender 20 Jul '09

20 Jul '09

Should this be applied to the Stable branch? Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv11631 > > Modified Files: > opt_inline.mx > Log Message: > Protect lower levels against compound inline functions as well. > > > U opt_inline.mx > Index: opt_inline.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_inline.mx,v > retrieving revision 1.22 > retrieving revision 1.23 > diff -u -d -r1.22 -r1.23 > --- opt_inline.mx 16 May 2009 08:54:40 -0000 1.22 > +++ opt_inline.mx 20 Jul 2009 14:37:32 -0000 1.23 > @@ -50,6 +50,21 @@ > > extern int OPTinlineMultiplex(Client cntxt, MalBlkPtr mb, InstrPtr p); > > +static int > +isCorrectInline(MalBlkPtr mb){ > + /* make sure we have a simple inline function with a singe return */ > + InstrPtr p; > + int i, retseen=0; > + > + for( i= 1; i < mb->stop; i++){ > + p= getInstrPtr(mb,i); > + if ( p->token == RETURNsymbol || p->token == YIELDsymbol || > + p->barrier == RETURNsymbol || p->barrier == YIELDsymbol) > + retseen++; > + } > + return retseen == 1; > +} > + > int > OPTinlineImplementation(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p) > { > @@ -85,7 +100,8 @@ > Check if the function definition is tagged as being inlined. > @c > if (sig->token == FUNCTIONsymbol && > - varGetProp(q->blk, getArg(sig, 0), inlineProp) != NULL) { > + varGetProp(q->blk, getArg(sig, 0), inlineProp) != NULL && > + isCorrectInline(q->blk) ) { > (void) inlineMALblock(mb,i,q->blk); > i--; > actions++; > > > ------------------------------------------------------------------------------ > Enter the BlackBerry Developer Challenge > This is your chance to win up to $100,000 in prizes! For a limited time, > vendors submitting new applications to BlackBerry App World(TM) will have > the opportunity to enter the BlackBerry Developer Challenge. See full prize > details at: http://p.sf.net/sfu/Challenge > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal algebraExtensions.mx, , 1.32, 1.33
by Stefan Manegold 18 Jul '09

18 Jul '09

On Sat, Jul 18, 2009 at 10:21:00AM +0000, Lefteris Sidirourgos wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30235 > > Modified Files: > algebraExtensions.mx > Log Message: > load and unload the bats in each round of bloom prejoin, assuming that both dont fit in memory at the same time > ... results in (when comfigured with optimization enabled): ======== gcc -DHAVE_CONFIG_H -I. -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal -I../../.. -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal -I../atoms -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/../atoms -I../kernel -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/../kernel -I../../mal -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/../../mal -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/include/MonetDB -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/include/MonetDB/mapilib -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/include/MonetDB -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/include/MonetDB/common -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/include/MonetDB/gdk -I/usr/include/libxml2 -std=c99 -DLIBALGEBRAEXTENSIONS -O2 -Wall -Wextra -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -D_REENTRANT -c algebraExtensions.c -fPIC -DPIC -o .libs/lib_algebraExtensions_la-algebraExtensions.o cc1: warnings being treated as errors /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx: In function ‘GDKbloomfilter_int_l’: /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:406: error: ‘blim’ may be used uninitialized in this function /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:660: note: ‘blim’ was declared here /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:410: error: ‘blog’ may be used uninitialized in this function /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:661: note: ‘blog’ was declared here /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:416: error: ‘bv’ may be used uninitialized in this function /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:658: note: ‘bv’ was declared here /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:423: error: ‘clim’ may be used uninitialized in this function /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:660: note: ‘clim’ was declared here /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:425: error: ‘cv’ may be used uninitialized in this function /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:658: note: ‘cv’ was declared here /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:443: error: ‘clog’ may be used uninitialized in this function /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:661: note: ‘clog’ was declared here /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/algebraExtensions.mx:659: error: ‘b’ may be used uninitialized in this function make[8]: *** [lib_algebraExtensions_la-algebraExtensions.lo] Error 1 make[8]: Leaving directory `/net/rig.ins.cwi.nl/export/scratch0/manegold/Monet/Testing/Current/build.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/MonetDB5/src/modules/mal' make[7]: *** [all-recursive] Error 1 make[7]: Leaving directory `/net/rig.ins.cwi.nl/export/scratch0/manegold/Monet/Testing/Current/build.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/MonetDB5/src/modules/mal' make[6]: *** [all] Error 2 make[6]: Leaving directory `/net/rig.ins.cwi.nl/export/scratch0/manegold/Monet/Testing/Current/build.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/MonetDB5/src/modules/mal' make[5]: *** [all-recursive] Error 1 make[5]: Leaving directory `/net/rig.ins.cwi.nl/export/scratch0/manegold/Monet/Testing/Current/build.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/MonetDB5/src/modules' make[4]: *** [all] Error 2 make[4]: Leaving directory `/net/rig.ins.cwi.nl/export/scratch0/manegold/Monet/Testing/Current/build.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/MonetDB5/src/modules' make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory `/net/rig.ins.cwi.nl/export/scratch0/manegold/Monet/Testing/Current/build.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/MonetDB5/src' make[2]: *** [all] Error 2 make[2]: Leaving directory `/net/rig.ins.cwi.nl/export/scratch0/manegold/Monet/Testing/Current/build.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/MonetDB5/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/net/rig.ins.cwi.nl/export/scratch0/manegold/Monet/Testing/Current/build.--enable-strict_--disable-debug_--enable-optimize_--disable-assert/MonetDB5' make: *** [all] Error 2 ======== Stefan > > U algebraExtensions.mx > Index: algebraExtensions.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/algebraExtensions.mx,v > retrieving revision 1.32 > retrieving revision 1.33 > diff -u -d -r1.32 -r1.33 > --- algebraExtensions.mx 18 Jul 2009 08:43:03 -0000 1.32 > +++ algebraExtensions.mx 18 Jul 2009 10:20:58 -0000 1.33 > @@ -110,7 +110,7 @@ > is calculated for the heap(s) only. > @c > > -/* #define DEBUG_BLOOMFILTER*/ > +#define DEBUG_BLOOMFILTER > > static > size_t GDKbatfootprint(BAT *b){ > @@ -274,7 +274,7 @@ > cp = BATslice(cr, cl, cl+blk); > j = BATjoin(b,cp, BUN_NONE); > #ifdef DEBUG_BLOOMFILTER > - stream_printf(GDKout,"result " SZFMT " " SZFMT " " SZFMT "\n", bl, cl, BATcount(j)); > + stream_printf(GDKout,"result " SZFMT " " SZFMT " " SZFMT "\n", blk, cl, BATcount(j)); > #endif > if (bn == 0) > bn = BATnew( j->htype, j->ttype, BATcount(j)*blim/blk); > @@ -375,6 +375,30 @@ > } > > #define bloomhash(x,y,z) ((unsigned int) ((x)*(y))%(z)) > +#define bloomhash1(x,y,z) ((int) ((((x)*((double)y))-((int)((x)*(y))))*(z))) > +/* #define bloomhash1(x,y,z) ((unsigned int) ((x)*(y))%(z)) */ > + > +/*static double primes[]= {19,29,31,41,43,53,59,61};*/ > + > +@= print_bbloom > +#ifdef DEBUG_BLOOMFILTER > +counter = 0; > +for (i = 0; i < mb; i++) { > + counter += bbloom[i]; > +} > +stream_printf(GDKout,"bbloom has %d 1's and %d 0's\n", counter, mb-counter); > +counter = 0; > +#endif > + > +@= print_cbloom > +#ifdef DEBUG_BLOOMFILTER > +counter = 0; > +for (i = 0; i < mc; i++) { > + counter += cbloom[i]; > +} > +stream_printf(GDKout,"cbloom has %d 1's and %d 0's\n", counter, mc-counter); > +counter = 0; > +#endif > > @= body_smallsubset > char *bbloom; > @@ -474,42 +498,91 @@ > > @= body_outofmemory > char * cbloom, *bbloom; > - int bp[4]; > - int cp[4]; > + char bit; > + /*int bp[4]; > + int cp[4];*/ > + double bp[4]; > + double cp[4]; > int counter = 0; > + > + b = BATdescriptor(*bid); > + bv = (int*) Tloc(b, BUNfirst(b)); > + blim = BATcount(b); > + blog = (int) log(blim); > + > mb = blim*2; > - mc = clim*2; > + //mc = clim*2; > bbloom = (char *) GDKmalloc(mb); > - cbloom = (char *) GDKmalloc(mc); > + //cbloom = (char *) GDKmalloc(mc); > memset(bbloom, 0, mb); > - memset(cbloom, 0, mc); > + //memset(cbloom, 0, mc); > for (i = 0; i < 4; i++) { > bp[i] = (1 << (blog + i))+1; > - cp[i] = (1 << (clog + i))+1; > + //cp[i] = (1 << (clog + i))+1; > + /* > + bp[i] = primes[i]/((double) (sizeof(wrd)*8)); > + cp[i] = primes[i+1]/((double) (sizeof(wrd)*8)); > + */ > } > > - /* for (b) { built bloom } */ > + /* for (b) { built bloom } */ > for (i = 0; i < blim; i++) { > setBit(bbloom, bloomhash(bp[0],bv[i],mb), 1); > } > + /*@:print_bbloom@*/ > + BBPunfix(*bid); > + > + c = BATdescriptor(*cid); > + cv = (int*) Tloc(c, BUNfirst(c)); > + clim = BATcount(c); > + clog = (int) log(clim); > + mc = clim*2; > + cbloom = (char *) GDKmalloc(mc); > + memset(cbloom, 0, mc); > + > + for (i = 0; i < 4; i++) { > + cp[i] = (1 << (clog + i))+1; > + } > > /* for (c) { test bbloom; built cbloom } */ > for (i = 0; i < clim; i++) { > - if (tstBit(bbloom, bloomhash(bp[0],cv[i],mb))) { > + bit = tstBit(bbloom, bloomhash(bp[0],cv[i],mb)); > + setBit(cbloom, bloomhash(cp[0],cv[i],mc), > + bit | tstBit(cbloom, bloomhash(cp[0],cv[i],mc))); > + setBit(cbloom, bloomhash(cp[1],cv[i],mc), > + bit | tstBit(cbloom, bloomhash(cp[1],cv[i],mc))); > + /*if (tstBit(bbloom, bloomhash(bp[0],cv[i],mb))) { > setBit(cbloom, bloomhash(cp[0],cv[i],mc), 1); > setBit(cbloom, bloomhash(cp[1],cv[i],mc), 1); > counter++; > - } > + }*/ > } > + /*@:print_cbloom@*/ > + BBPunfix(*cid); > > #ifdef DEBUG_BLOOMFILTER > stream_printf(GDKout, "1st round c %d\n", counter); > counter = 0; > #endif > > + b = BATdescriptor(*bid); > + bv = (int*) Tloc(b, BUNfirst(b)); > memset(bbloom, 0, mb); > /* for (b) { test cbloom; rebuilt bbloom } */ > for (i = 0; i < blim; i++) { > + /* > + bit = tstBit(cbloom, bloomhash(cp[0],bv[i],mc)) && > + tstBit(cbloom, bloomhash(cp[1],bv[i],mc)); > + > + setBit(bbloom, bloomhash(bp[0],bv[i],mb), > + bit | tstBit(bbloom, bloomhash(bp[0],bv[i],mb))); > + setBit(bbloom, bloomhash(bp[1],bv[i],mb), > + bit | tstBit(bbloom, bloomhash(bp[1],bv[i],mb))); > + setBit(bbloom, bloomhash(bp[2],bv[i],mb), > + bit | tstBit(bbloom, bloomhash(bp[2],bv[i],mb))); > + setBit(bbloom, bloomhash(bp[3],bv[i],mb), > + bit | tstBit(bbloom, bloomhash(bp[3],bv[i],mb))); > + */ > if ((tstBit(cbloom, bloomhash(cp[0],bv[i],mc)) && > tstBit(cbloom, bloomhash(cp[1],bv[i],mc)))) { > setBit(bbloom, bloomhash(bp[0],bv[i],mb), 1); > @@ -519,13 +592,18 @@ > counter++; > } > } > + /*@:print_bbloom@*/ > + BBPunfix(*bid); > > #ifdef DEBUG_BLOOMFILTER > stream_printf(GDKout, "1st round b %d\n", counter); > counter = 0; > #endif > > + > /* for (c) { check bbloom } */ > + c = BATdescriptor(*cid); > + cv = (int*) Tloc(c, BUNfirst(c)); > *cn = BATnew(TYPE_oid,TYPE_int, clim/4); > memset(cbloom, 0, mc); > for (i = 0; i < clim; i++) { > @@ -542,12 +620,17 @@ > counter++; > } > } > + /*@:print_cbloom@*/ > + BBPunfix(*cid); > + GDKfree(bbloom); > > #ifdef DEBUG_BLOOMFILTER > stream_printf(GDKout, "2nd round c %d\n", counter); > counter = 0; > #endif > > + b = BATdescriptor(*bid); > + bv = (int*) Tloc(b, BUNfirst(b)); > *bn = BATnew(TYPE_oid,TYPE_int, blim/4); > /* for (b) {check cbloom} */ > for (i = 0; i < blim; i++) { > @@ -560,28 +643,30 @@ > counter++; > } > } > + BBPunfix(*bid); > + GDKfree(cbloom); > > #ifdef DEBUG_BLOOMFILTER > stream_printf(GDKout, "2nd round b %d\n", counter); > counter = 0; > #endif > > - > @c > > void > -GDKbloomfilter_int_l(BAT *b, BAT *c, BAT **bn, BAT **cn, int algo) { > +GDKbloomfilter_int_l(bat *bid, bat *cid, BAT **bn, BAT **cn, int algo) { > int *bv, *cv; > + BAT *b, *c; > BUN i, blim, clim; > int clog, blog; > BUN mb, mc; > mb = mc = 0; > > - /* b is the smaller one */ > + /* b is the smaller one > if ( BATcount(b) > BATcount(c) ) { > GDKbloomfilter_int_l(c, b, cn, bn, algo); > return; > - } > + } */ > > /* consider it an out-of-memory situation > if ( b->ttype != TYPE_int || GDKbatfootprint(b) < 25 ){ > @@ -592,12 +677,13 @@ > return; > }*/ > > + /* > bv = (int*) Tloc(b, BUNfirst(b)); > cv = (int*) Tloc(c, BUNfirst(c)); > blim= BATcount(b); > clim= BATcount(c); > clog = (int) log(clim); > - blog = (int) log(blim); > + blog = (int) log(blim); */ > > if (algo == 2) { > /* only build one bloom filter on the smaller BAT, > @@ -653,6 +739,7 @@ > (void) cntxt; > (void) mb; > > + > if ((b = BATdescriptor(*bid)) == NULL) > throw(MAL, "bbp.prejoin", INTERNAL_BAT_ACCESS); > if ( (c = BATdescriptor(*cid)) == NULL) { > @@ -667,7 +754,7 @@ > case 2: /* lefteris 1st */ > case 3: /* 2nd */ > case 4: /* 3rd */ > - GDKbloomfilter_int_l(b, c, &bn, &cn, algo); > + GDKbloomfilter_int_l(bid, cid, &bn, &cn, algo); > break; > case 5: /* blocked join */ > bn = GDKblockjoin(b,c); > > > ------------------------------------------------------------------------------ > Enter the BlackBerry Developer Challenge > This is your chance to win up to $100,000 in prizes! For a limited time, > vendors submitting new applications to BlackBerry App World(TM) will have > the opportunity to enter the BlackBerry Developer Challenge. See full prize > details at: http://p.sf.net/sfu/Challenge > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] testing/src Mtest.py.in, , 1.26, 1.27
by Stefan Manegold 17 Jul '09

17 Jul '09

On Thu, Jul 16, 2009 at 12:54:20PM +0000, Fabian wrote: > Update of /cvsroot/monetdb/testing/src > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv5974/src > > Modified Files: > Mtest.py.in > Log Message: > Have you ever wanted your machine to nearly die under a load of 20+ by > running Mtest? Now you can, using --jobs=<huge-number>. > > Implemented Parallel Mtest (r), parallelising where no Mtest has tested > before, using X worker jobs, where X defaults to 1. > > Parallelisation currently is done over directories only (inter-directory > dependencies are hard to track). No more chdirs are performed, so all > arguments are made absolute paths, resulting in some long output paths > here and there, compared to the old behaviour of Mtest. This might require quite a bunch of tests to be adapted accordingly, because so far basically all tests assumed that they were executed in the TSTTRGDIR (though there are tests that "don't care")... ... you already fixed some; but I guess there are (many?) more to do ... Wasn't there a chance to do a per-thread chdir? Or does Python not allow that? Stefan > Please test, enjoy and fix (preferably in parallel ;) ) > > > U Mtest.py.in > Index: Mtest.py.in > =================================================================== > RCS file: /cvsroot/monetdb/testing/src/Mtest.py.in,v > retrieving revision 1.26 > retrieving revision 1.27 > diff -u -d -r1.26 -r1.27 > --- Mtest.py.in 3 Jun 2009 11:42:33 -0000 1.26 > +++ Mtest.py.in 16 Jul 2009 12:54:18 -0000 1.27 > @@ -46,6 +46,9 @@ > import socket > import struct > import select > +from threading import Thread > +import copy > +import string > #import signal > #import getpass > import Mfilter > @@ -107,18 +110,22 @@ > [...1251 lines suppressed...] > + w.join() > + t = w.getTime() > + elem = w.getElem() > t_ = t_ + t > if elem is not None: > body.append(elem) > @@ -3756,7 +3832,7 @@ > if THISFILE == "Mtest.py": > env['TSTDIR'] = "" > env['TSTTRGDIR'] = os.path.join(env['TSTTRGBASE'],TSTPREF) > - CreateHtmlIndex(env, *body) > + CreateHtmlIndex(htmlenv, env, *body) > > Failed = 0 > for f in Failure[1:]: > @@ -3843,3 +3919,4 @@ > > # END > ############################################################################# > +# vim: set ts=4 sw=4 expandtab : > > > ------------------------------------------------------------------------------ > Enter the BlackBerry Developer Challenge > This is your chance to win up to $100,000 in prizes! For a limited time, > vendors submitting new applications to BlackBerry App World(TM) will have > the opportunity to enter the BlackBerry Developer Challenge. See full prize > details at: http://p.sf.net/sfu/Challenge > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 3

[Monetdb-developers] Connection string for ODBC
by Chebbi, Pavan 14 Jul '09

14 Jul '09

HI, Could anybody give me a connection string to use with ODBC DSN ? I am not able to connect even after I installed and configured ODBC driver. Thanks, Pavan

3 2

[Monetdb-developers] Is monetDB nativeXML or not?
by Mtekel 10 Jul '09

10 Jul '09

Hello, I have a question, whether MonetDB/XQuery is native XML database or not. To clarify what is native or not, http://en.wikipedia.org/wiki/XML_database : " Two major classes of XML database exist: XML-enabled: these map all XML to a traditional database (such as a relational database), accepting XML as input and rendering XML as output. This term implies that the database does the conversion itself (as opposed to relying on middleware). Native XML (NXD): the internal model of such databases depends on XML and uses XML documents as the fundamental unit of storage, which are, however, not necessarily stored in the form of text files. " Then according to this page, monetDB is native XML: http://monetdb.cwi.nl/MonetDB/Version4/Documentation/monet/index.html " 2 MonetDB Features MonetDB is database engine geared at high performance on systems with (complex) queries that have to analyze large amounts of data (i.e. OLAP, not OLTP). The features in which it most differs from other DBMSs are summarized below: Independence of SQL: MonetDB has a front-end/back-end design allowing the storage of more than just relational tables (such as object-oriented or native XML data), and allowing the use of querying paradigms other than just SQL (such as OQL and XQuery). " Whereas according to this one, it is not: http://monetdb.cwi.nl/projects/monetdb/XQuery/Documentation/Separate-Documen ts-vs-Document-Collections.html#Separate-Documents-vs-Document-Collections : " 2.9.1.1 Storage Overhead In MonetDB/XQuery all XML is stored in relational tables. " Is then monetDB really native? Thanks in advance for clarification... Regards, M. Tekel

3 2

[Monetdb-developers] Python breaks clients?
by Stefan de Konink 03 Jul '09

03 Jul '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 make[9]: *** No rule to make target `mapi25.py', needed by `install-exec-local-mapi25.py'. Stop. Does anyone have this currently? I do have python2.6 installed. Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.12 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkpNJx0ACgkQYH1+F2Rqwn0KRACfdFMjhXlYnsrihaIM88Bls50N mlgAn0eJ9p45+n2wKY8mNZi4PzS6aeSP =v+Uj -----END PGP SIGNATURE-----

2 2

[Monetdb-developers] Mapilib example
by Fabian Groffen 02 Jul '09

02 Jul '09

Hi all, Triggered by a request from a user I changed the mapilib example somewhat. In particular, I tried to make the example more "school style", e.g. don't use a define for something which could have been a function. More important, I added code to walk multi-resultset handles in case there is an error, such that it eventually gets printed. I also closed the handle in the die function as proper cleanup example. I removed some mapi_error checks that I thought were redundant, but I'm not sure. Hence, please review the attached diff and comment before I commit this. The example compiles without warnings for me now, and also works for as far as I can see.

3 3

[Monetdb-developers] Announcement: May2009-SP1 bug fix release
by Sjoerd Mullender 30 Jun '09

30 Jun '09

The MonetDB team at CWI/MonetDB BV is pleased to announce the May21009-SP1 bug fix release of the MonetDB suite of programs. This is a bug fix release for last month's May2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/May2009/#May200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer Makefile.ag, , 1.74, 1.75 opt_selcrack.mx, , 1.2, 1.3
by Stefan Manegold 29 Jun '09

29 Jun '09

On Mon, Jun 29, 2009 at 05:35:40PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13608 > > Modified Files: > Makefile.ag opt_selcrack.mx > Log Message: > A first cracker inconvenience solved. > What about types void, bit, bte, chr, bat, ptr? Stefan > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/Makefile.ag,v > retrieving revision 1.74 > retrieving revision 1.75 > diff -u -d -r1.74 -r1.75 > --- Makefile.ag 30 Apr 2009 18:42:48 -0000 1.74 > +++ Makefile.ag 29 Jun 2009 17:35:38 -0000 1.75 > @@ -15,7 +15,7 @@ > # Copyright August 2008-2009 MonetDB B.V. > # All Rights Reserved. > > -INCLUDES = -I../mal -I../modules/mal -I../modules/kernel $(MONETDB_INCS) \ > +INCLUDES = -I../mal -I../modules/atoms -I../modules/mal -I../modules/kernel $(MONETDB_INCS) \ > $(Z_CFLAGS) $(BZ_CFLAGS) $(PCL_FLAGS) $(PCRE_CFLAGS) > > > > U opt_selcrack.mx > Index: opt_selcrack.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_selcrack.mx,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- opt_selcrack.mx 30 Apr 2009 12:56:43 -0000 1.2 > +++ opt_selcrack.mx 29 Jun 2009 17:35:38 -0000 1.3 > @@ -74,22 +74,27 @@ > > /* add a property "can be cracked" to every base relation that is a candidate for selection cracking */ > /* also, for every candidate bat, maintain the table name */ > - if ( match2(p, batRef, newRef) || match2(p, sqlRef, bindRef) ){ > + if ( match2(p, sqlRef, bindRef) ){ > ValRecord v, *vp; > > /* crack only supported data types */ > - if ( getTailType(mb->var[getArg(p,0)]->type)==TYPE_str ) > + switch( getTailType(mb->var[getArg(p,0)]->type) ){ > + case TYPE_int: case TYPE_lng: case TYPE_sht: > + case TYPE_flt: case TYPE_dbl: case TYPE_oid: What about types void, bit, bte, chr, bat, ptr? Stefan > + break; > + case TYPE_wrd: /* to be moved up */ > + default: > continue; > + } > > /* avoid cracking delta bats used for updates */ > - if (getModuleId(p)== sqlRef && mb->var[getArg(p,4)]->value.val.ival != 0 ) > + if (mb->var[getArg(p,4)]->value.val.ival != 0 ) > continue; > > varSetProp(mb, getArg(p, 0), canBeCrackedProp, 0, NULL); > > vp = VALset(&v, TYPE_str, GDKstrdup(getVar(mb,getArg(p,2))->value.val.sval)); > - varSetProp(mb, getArg(p,0), tableProp, op_eq, vp); > - > + varSetProp(mb, getArg(p,0), tableProp, op_eq, vp); > continue; > } > > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] OSS Usability Evaluation
by Arif Raza 28 Jun '09

28 Jun '09

Hi there Please find below a link to a survey related to my PhD research work to evaluate OSS usability evaluation from OSS developer's point of view. It shall not not take more than 5 minutes of your precious time. Your identity is neither required nor recorded. The participation is highly valued and appreciated. http://www.kwiksurveys.com/online-survey.php?surveyID=ILJEM_ba6da4db Thank you and Best Regards Arif Raza P.S. Please ignore this mail if you've already this mail and responded to the survey.

1 0

[Monetdb-developers] OSS Usability Evaluation - Developers' Perspective
by Arif Raza 27 Jun '09

27 Jun '09

Hi there Please find below a link to a survey related to my PhD research work to evaluate OSS usability improvement from OSS developer's point of view. It shall not not take more than 5 minutes of your precious time. Your identity is neither required nor recorded. The participation is highly valued and appreciated. http://www.kwiksurveys.com/online-survey.php?surveyID=ILJEM_ba6da4db Thank you and Best Regards Arif Raza

1 0

[Monetdb-developers] Deployment of MonetDB
by Martin Kersten 24 Jun '09

24 Jun '09

Dear users, In our ongoing effort to improve the MonetDB software suite we would like to hear from you. It appears that MonetDB is used for teaching, and customers use it for/within their products. Also, the divergence in primary platform is crucial for us to keep focus. We would greately appreciate if you could replay with a short message how you deploy the software and your top priorities for a next release. Thank you for you cooperation, Martin Kersten

3 6

Re: [Monetdb-developers] [Monetdb-checkins] load data from a file to a table
by Sjoerd Mullender 24 Jun '09

24 Jun '09

Wrong list. Please use monetdb-users(a)lists.sourceforge.net. Pedro Bramao wrote: > I'm trying to load data into a table from a file, named criminoso.sql, > to a table named criminos stored in MonetDB. > I'm doing the following coomand : > > copy 2 records into criminoso from > '/home/pedro/Escola/tabd/criminoso1.sql' using delimiters > tuple_separator ',' record_separator ';'; > > But it's not working... i nedd some help!!!! > > thanks > > ------------------------------------------------------------------------ > Novo Internet Explorer 8: mais rápido e muito mais seguro. Baixe agora, > é grátis! > <http://brasil.microsoft.com.br/IE8/mergulhe/?utm_source=MSN%3BHotmail&utm_m…> > > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------------ > > > ------------------------------------------------------------------------ > > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] load data from a file to a table
by Niels Nes 24 Jun '09

24 Jun '09

On Tue, Jun 16, 2009 at 02:54:01PM +0000, Pedro Bramao wrote: > I'm trying to load data into a table from a file, named criminoso.sql, > to a table named criminos stored in MonetDB. > I'm doing the following coomand : > > copy 2 records into criminoso from '/home/pedro/Escola/tabd/ > criminoso1.sql' using delimiters tuple_separator ',' record_separator > ';'; Try copy 2 records into criminoso from '/home/pedro/Escola/tabd/criminoso1.sql' using delimiters ',',';'; Niels > > But it's not working... i nedd some help!!!! > > thanks > > ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ > Novo Internet Explorer 8: mais rápido e muito mais seguro. Baixe agora, > é grátis! > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Niels Nes, Centre for Mathematics and Computer Science (CWI) Science Park 123, 1098 XG Amsterdam, The Netherlands room C0.02/M3.46, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl

1 0

Re: [Monetdb-developers] [Monetdb-checkins] load data from a file to a table
by Arjen de Rijke 24 Jun '09

24 Jun '09

Pedro Bramao <pedrobramao(a)hotmail.com> writes: > I'm trying to load data into a table from a file, named criminoso.sql, to a > table named criminos stored in MonetDB. > I'm doing the following coomand : > > copy 2 records into criminoso from '/home/pedro/Escola/tabd/criminoso1.sql' > using delimiters tuple_separator ',' record_separator ';'; > Hello Pedro, It should be: copy 2 records into criminoso from '/home/pedro/Escola/tabd/criminoso1.sql' using delimiters ',',';'; Regards, Arjen de Rijke > But it's not working... i nedd some help!!!! > > thanks > > ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ > Novo Internet Explorer 8: mais rápido e muito mais seguro. Baixe agora, é > grátis! > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- ==================================================================== CWI, Kamer C0.03 Centrum voor Wiskunde en Informatica Science Park 123 Email: arjen.de.rijke(a)cwi.nl 1098 XG Amsterdam tel: +31-(0)20-5924305 Nederland +31-(0)6-51899284 fax: +31-(0)20-5924312 ===================== http://www.cwi.nl/~rijke/ ====================

1 0

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/python/monetdb mapi.py, May2009, 1.4.2.4, 1.4.2.5 mapi25.py, May2009, 1.1.2.4, 1.1.2.5
by Stefan Manegold 13 Jun '09

13 Jun '09

On Fri, Jun 12, 2009 at 01:23:36PM +0000, Gijs Molenaar wrote: > Update of /cvsroot/monetdb/clients/src/python/monetdb > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13219/monetdb > > Modified Files: > Tag: May2009 > mapi.py mapi25.py > Log Message: > > * Fixed python3.0 errors. Please also run the tests with python3 when you > commit something Just for info: None of the machines in our testing pool runs/provides Python3.0 (as default), yet; nightly testing uses Python 2.4, 2.5, 2.6. Stefan > * Unicode/UTF-8 should be working now, except for a small python3 problem > > * python2.6 uses the mapi25.py now, since this is easier to manage. > mapi25.py will be renamed in the future > > * added unicode and UTF-8 test > > > U mapi.py > Index: mapi.py > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/python/monetdb/mapi.py,v > retrieving revision 1.4.2.4 > retrieving revision 1.4.2.5 > diff -u -d -r1.4.2.4 -r1.4.2.5 > --- mapi.py 29 May 2009 12:01:20 -0000 1.4.2.4 > +++ mapi.py 12 Jun 2009 13:23:34 -0000 1.4.2.5 > @@ -130,7 +130,7 @@ > logging.debug("II: executing command %s" % operation) > > if self.state != STATE_READY: > - raise(ProgrammingError, "Not connected") > + raise ProgrammingError("Not connected") > > self.__putblock(operation) > response = self.__getblock() > @@ -154,24 +154,19 @@ > > if protocol == '9': > algo = challenges[5] > + import hashlib > if algo == 'SHA512': > - import hashlib > - password = hashlib.sha512(password).hexdigest() > + password = hashlib.sha512(password.encode()).hexdigest() > elif algo == 'SHA384': > - import hashlib > - password = hashlib.sha384(password).hexdigest() > + password = hashlib.sha384(password.encode()).hexdigest() > elif algo == 'SHA256': > - import hashlib > - password = hashlib.sha256(password).hexdigest() > + password = hashlib.sha256(password.encode()).hexdigest() > elif algo == 'SHA224': > - import hashlib > - password = hashlib.sha224(password).hexdigest() > + password = hashlib.sha224(password.encode()).hexdigest() > elif algo == 'SHA1': > - import hashlib > - password = hashlib.sha1(password).hexdigest() > + password = hashlib.sha1(password.encode()).hexdigest() > elif algo == 'MD5': > - import hashlib > - password = hashlib.md5(password).hexdigest() > + password = hashlib.md5(password.encode()).hexdigest() > else: > raise NotSupportedError("The %s hash algorithm is not supported" % algo) > elif protocol != "8": > @@ -187,8 +182,8 @@ > elif "MD5" in h: > import hashlib > m = hashlib.md5() > - m.update(password) > - m.update(salt) > + m.update(password.encode()) > + m.update(salt.encode()) > pwhash = "{MD5}" + m.hexdigest() > elif "crypt" in h: > import crypt > @@ -212,28 +207,29 @@ > if length > 0: > result_bytes.write(self.__getbytes(length)) > > - result = result_bytes.getvalue().decode() > + result = result_bytes.getvalue() > logging.debug("RX: %s" % result) > - return result > + return result.decode() > > > def __getbytes(self, bytes): > """Read an amount of bytes from the socket""" > try: > return self.socket.recv(bytes) > - except socket.error(errorStr): > - raise OperationalError(errorStr[1]) > + except socket.error as error_str: > + raise OperationalError(error_str) > > > def __putblock(self, block): > """ wrap the line in mapi format and put it into the socket """ > pos = 0 > last = 0 > + logging.debug("TX: %s" % block) > while not last: > - data = block[pos:MAX_PACKAGE_LENGTH] > + data = block[pos:MAX_PACKAGE_LENGTH].encode() > if len(data) < MAX_PACKAGE_LENGTH: > last = 1 > flag = struct.pack( '<h', ( len(data) << 1 ) + last ) > self.socket.send(flag) > - self.socket.send(bytes(data.encode())) > + self.socket.send(data) > pos += len(data) > > U mapi25.py > Index: mapi25.py > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/python/monetdb/mapi25.py,v > retrieving revision 1.1.2.4 > retrieving revision 1.1.2.5 > diff -u -d -r1.1.2.4 -r1.1.2.5 > --- mapi25.py 29 May 2009 12:01:21 -0000 1.1.2.4 > +++ mapi25.py 12 Jun 2009 13:23:34 -0000 1.1.2.5 > @@ -191,8 +191,8 @@ > elif "MD5" in h: > import hashlib > m = hashlib.md5() > - m.update(password) > - m.update(salt) > + m.update(password.encode()) > + m.update(salt.encode()) > pwhash = "{MD5}" + m.hexdigest() > elif "crypt" in h: > import crypt > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensing option that enables unlimited > royalty-free distribution of the report engine for externally facing > server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_joinpath.mx, May2009, 1.47.2.1, 1.47.2.2
by Stefan Manegold 08 Jun '09

08 Jun '09

On Mon, Jun 08, 2009 at 05:53:42PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7310 > > Modified Files: > Tag: May2009 > opt_joinpath.mx > Log Message: > Experimental stable code to deal with too large intermediate joins. > It marks them as 'postpone' until at least one other join in the path > has been executed. Multiple variations can be envisioned. > > > U opt_joinpath.mx > Index: opt_joinpath.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_joinpath.mx,v > retrieving revision 1.47.2.1 > retrieving revision 1.47.2.2 > diff -u -d -r1.47.2.1 -r1.47.2.2 > --- opt_joinpath.mx 8 Jun 2009 10:56:25 -0000 1.47.2.1 > +++ opt_joinpath.mx 8 Jun 2009 17:53:40 -0000 1.47.2.2 > @@ -408,7 +408,9 @@ > { > BAT *b; > BUN estimate, e; > - int i, j; > + int i, j, k; > + int *postpone= (int*) GDKzalloc(sizeof(int) *top); > + int postponed=0; > > /* solve the join by pairing the smallest first */ > while (top > 2) { > @@ -426,7 +428,7 @@ > stream_printf(cntxt->fdout,"#joinPath estimate join(%d,%d) %d\n", joins[i]->batCacheid, > joins[i+1]->batCacheid,(int)e); > #endif > - if (e < estimate) { > + if (e < estimate && ( !(postpone[i] && postpone[i+1]) || postponed==top-1)) { > estimate = e; > j = i; > } > @@ -434,10 +436,28 @@ > @- > BEWARE. you may not use a size estimation, because it > may fire a BATproperty check in a few cases. > +In case a join fails, we may try another order first before > +abandoning the task. > @c > b = BATjoin(joins[j], joins[j + 1], BUN_NONE); > - if (b==NULL) > - return NULL; /* something seriously went wrong */ > + if (b==NULL){ > + if ( postpone[j]){ ^^^^^^^^^^^ shouldn't this be (e.g.) postpone[j] && postpone[j+1] i.e., bailout (only) if the exact join has failed before, not if an other join with the same (i.e., join(j-1,j)) has failed before? ... just a spontaneous idea ... Stefan > + GDKfree(postpone); > + return NULL; > + } > + /* clear the GDKerrors */ > + if( cntxt->errbuf ) > + cntxt->errbuf[0]=0; > + postpone[j] = TRUE; > + postpone[j+1] = TRUE; > + postponed++; > + continue; > + } else { > + /* reset the postponed joins */ > + for( k=0; k<top; k++) > + postpone[k]=FALSE; > + postponed = 0; > + } > #ifdef DEBUG_OPT_JOINPATH > stream_printf(cntxt->fdout, "#joinPath %d:= join(%d,%d)\n", > b->batCacheid, joins[j]->batCacheid, joins[j + 1]->batCacheid); > @@ -450,6 +470,7 @@ > for (i = j + 1; i < top; i++) > joins[i] = joins[i + 1]; > } > + GDKfree(postpone); > #ifdef DEBUG_OPT_JOINPATH > stream_printf(cntxt->fdout, "#joinPath final join %d and %d\n", joins[0]->batCacheid, joins[1]->batCacheid); > #endif > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensing option that enables unlimited > royalty-free distribution of the report engine for externally facing > server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/BugTracker-2009/Tests primekeyconstraint.SF-2783425.sql, , 1.1, 1.2 primekeyconstraint.SF-2783425.stable.err, , 1.1, 1.2 primekeyconstraint.SF-2783425.stable.out, , 1.1, 1.2 random.SF-2737889.sql, , NONE, 1.1 All, , 1.30, 1.31
by Stefan Manegold 07 Jun '09

07 Jun '09

On Sun, Jun 07, 2009 at 06:18:45PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/sql/src/test/BugTracker-2009/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv8305 > > Modified Files: > All > Added Files: > primekeyconstraint.SF-2783425.sql > primekeyconstraint.SF-2783425.stable.err > primekeyconstraint.SF-2783425.stable.out FYI: You added the above files this morning to the May2009 branch. (Since then, there has not been any propagation, yet ...) Stefan > random.SF-2737889.sql > Log Message: > Addition of new tests. > > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/BugTracker-2009/Tests/All,v > retrieving revision 1.30 > retrieving revision 1.31 > diff -u -d -r1.30 -r1.31 > --- All 30 May 2009 04:29:16 -0000 1.30 > +++ All 7 Jun 2009 18:18:43 -0000 1.31 > @@ -61,3 +61,5 @@ > having_min_crash.SF-2795951 > insert_type_exception.SF-2789976 > explain_gives_crash.SF-2741829 > +primekeyconstraint.SF-2783425 > +random.SF-2737889 > > --- NEW FILE: primekeyconstraint.SF-2783425.stable.out --- > stdout of test 'primekeyconstraint.SF-2783425` in directory 'src/test/BugTracker-2009` itself: > > > # 08:02:34 > > # 08:02:34 > mserver5 "--config=/ufs/mk/monet5//Linux/etc/monetdb5.conf" --debug=10 --set gdk_nr_threads=0 --set "monet_mod_path=/ufs/mk/monet5//Linux/lib/MonetDB5:/ufs/mk/monet5//Linux/lib/MonetDB5/lib:/ufs/mk/monet5//Linux/lib/MonetDB5/bin" --set "gdk_dbfarm=/ufs/mk/monet5//Linux/var/MonetDB5/dbfarm" --set mapi_open=true --set xrpc_open=true --set mapi_port=30582 --set xrpc_port=46770 --set monet_prompt= --trace "--dbname=mTests_src_test_BugTracker-2009" --set mal_listing=0 "--dbinit= include sql;" ; echo ; echo Over.. > # 08:02:34 > > > # MonetDB server v5.13.0, based on kernel v1.31.0 > # Serving database 'mTests_src_test_BugTracker-2009', using 4 threads > # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked > # Copyright (c) 1993-July 2008 CWI. > # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved > # Visit http://monetdb.cwi.nl/ for further information > # Listening for connection requests on mapi:monetdb://eir.ins.cwi.nl:30582/ > # MonetDB/SQL module v2.31.0 loaded > > Ready. > #function user.main():void; > # clients.quit(); > #end main; > > Over.. > > # 08:02:34 > > # 08:02:34 > mclient -lsql -umonetdb -Pmonetdb --host=eir --port=30582 > # 08:02:34 > > > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > % sys.way_nds, sys.way_nds # table_name > % way, idx # name > % int, int # type > % 1, 1 # length > [ 1, 1 ] > [ 1, 1 ] > [ 2, 2 ] > [ 3, 3 ] > [ 4, 3 ] > [ NULL, 3 ] > [ NULL, 3 ] > [ 5, NULL ] > [ 5, NULL ] > % sys.way_nds, sys.way_nds, sys.way_nds # table_name > % L4, way, idx # name > % wrd, int, int # type > % 1, 1, 1 # length > [ 2, 1, 1 ] > [ 2, NULL, 3 ] > [ 2, 5, NULL ] > > # 08:02:34 > > # 08:02:34 > Done. > # 08:02:34 > > > > --- NEW FILE: primekeyconstraint.SF-2783425.stable.err --- > stderr of test 'primekeyconstraint.SF-2783425` in directory 'src/test/BugTracker-2009` itself: > > > # 08:02:34 > > # 08:02:34 > mserver5 "--config=/ufs/mk/monet5//Linux/etc/monetdb5.conf" --debug=10 --set gdk_nr_threads=0 --set "monet_mod_path=/ufs/mk/monet5//Linux/lib/MonetDB5:/ufs/mk/monet5//Linux/lib/MonetDB5/lib:/ufs/mk/monet5//Linux/lib/MonetDB5/bin" --set "gdk_dbfarm=/ufs/mk/monet5//Linux/var/MonetDB5/dbfarm" --set mapi_open=true --set xrpc_open=true --set mapi_port=30582 --set xrpc_port=46770 --set monet_prompt= --trace "--dbname=mTests_src_test_BugTracker-2009" --set mal_listing=0 "--dbinit= include sql;" ; echo ; echo Over.. > # 08:02:34 > > > # builtin opt gdk_arch = 64bitx86_64-unknown-linux-gnu > # builtin opt gdk_version = 1.31.0 > # builtin opt prefix = /ufs/mk/monet5//Linux > # builtin opt exec_prefix = ${prefix} > # builtin opt gdk_dbname = tst > # builtin opt gdk_dbfarm = ${prefix}/var/MonetDB > # builtin opt gdk_debug = 8 > # builtin opt gdk_alloc_map = yes > # builtin opt gdk_vmtrim = yes > # builtin opt monet_admin = adm > # builtin opt monet_prompt = > > # builtin opt monet_welcome = yes > # builtin opt monet_mod_path = ${exec_prefix}/lib/MonetDB > # builtin opt monet_daemon = yes > # builtin opt host = localhost > # builtin opt mapi_port = 50000 > # builtin opt mapi_noheaders = no > # builtin opt mapi_debug = 0 > # builtin opt mapi_clients = 2 > # builtin opt sql_debug = 0 > # builtin opt sql_logdir = sql_logs > # builtin opt xquery_logdir = xquery_logs > # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > # builtin opt standoff_start = start > # builtin opt standoff_end = end > # config opt prefix = /ufs/mk/monet5//Linux > # config opt config = ${prefix}/etc/monetdb5.conf > # config opt prefix = /ufs/mk/monet5//Linux > # config opt exec_prefix = ${prefix} > # config opt gdk_dbfarm = ${prefix}/var/MonetDB5/dbfarm > # config opt gdk_dbname = demo > # config opt gdk_alloc_map = no > # config opt gdk_embedded = no > # config opt gdk_debug = 0 > # config opt monet_mod_path = ${exec_prefix}/lib/MonetDB5:${exec_prefix}/lib/MonetDB5/lib:${exec_prefix}/lib/MonetDB5/bin > # config opt monet_daemon = no > # config opt monet_welcome = yes > # config opt mero_msglog = ${prefix}/var/log/MonetDB/merovingian.log > # config opt mero_errlog = ${prefix}/var/log/MonetDB/merovingian.log > # config opt mero_pidfile = ${prefix}/var/run/MonetDB/merovingian.pid > # config opt mal_init = ${exec_prefix}/lib/MonetDB5/mal_init.mal > # config opt mal_listing = 2 > # config opt mapi_port = 50000 > # config opt mapi_open = false > # config opt sql_optimizer = inline,remap,evaluate,costModel,coercions,emptySet,aliases,deadcode,constants,commonTerms,joinPath,deadcode,reduce,garbageCollector,dataflow,history,multiplex > # config opt sql_logdir = sql_logs > # cmdline opt config = /ufs/mk/monet5//Linux/etc/monetdb5.conf > # cmdline opt gdk_nr_threads = 0 > # cmdline opt monet_mod_path = /ufs/mk/monet5//Linux/lib/MonetDB5:/ufs/mk/monet5//Linux/lib/MonetDB5/lib:/ufs/mk/monet5//Linux/lib/MonetDB5/bin > # cmdline opt gdk_dbfarm = /ufs/mk/monet5//Linux/var/MonetDB5/dbfarm > # cmdline opt mapi_open = true > # cmdline opt xrpc_open = true > # cmdline opt mapi_port = 30582 > # cmdline opt xrpc_port = 46770 > # cmdline opt monet_prompt = > # cmdline opt gdk_dbname = mTests_src_test_BugTracker-2009 > # cmdline opt mal_listing = 0 > #warning: please don't forget to set your vault key! > #(see /ufs/mk/monet5//Linux/etc/monetdb5.conf) > > # 08:02:34 > > # 08:02:34 > mclient -lsql -umonetdb -Pmonetdb --host=eir --port=30582 > # 08:02:34 > > > MAPI = monetdb@eir:30582 > QUERY = ALTER TABLE way_nds ADD CONSTRAINT pk_way_nds PRIMARY KEY (way, idx); > > > # 08:02:34 > > # 08:02:34 > Done. > # 08:02:34 > > > > --- NEW FILE: random.SF-2737889.sql --- > create table nr (nr int); > insert into nr values (1); > insert into nr values (2); > insert into nr values (3); > insert into nr values (4); > insert into nr values (5); > insert into nr values (6); > insert into nr values (7); > insert into nr values (8); > insert into nr values (9); > insert into nr values (10); > SELECT nr, RAND() FROM nr; > SELECT nr, RAND() AS rnd FROM nr; > drop table nr; > > --- NEW FILE: primekeyconstraint.SF-2783425.sql --- > CREATE TABLE way_nds ( > way int, > idx int, > payload string > ); > > insert into way_nds values(1,1,'abc'); > insert into way_nds values(1,1,'abc'); > insert into way_nds values(2,2,'abc'); > insert into way_nds values(3,3,'abc'); > insert into way_nds values(4,3,'abc'); > insert into way_nds values(null,3,'abc'); > insert into way_nds values(null,3,'abc'); > insert into way_nds values(5,null,'abc'); > insert into way_nds values(5,null,'abc'); > > ALTER TABLE way_nds ADD CONSTRAINT pk_way_nds PRIMARY KEY (way, idx); > > select way,idx from way_nds; > select count(way), way, idx from way_nds group by way, idx having > count(way) > 1; > drop table way_nds; > > > ------------------------------------------------------------------------------ > OpenSolaris 2009.06 is a cutting edge operating system for enterprises > looking to deploy the next generation of Solaris that includes the latest > innovations from Sun and the OpenSource community. Download a copy and > enjoy capabilities such as Networking, Storage and Virtualization. > Go to: http://p.sf.net/sfu/opensolaris-get > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5/merovingian monetdb.c, , 1.12, 1.13
by Martin Kersten 06 Jun '09

06 Jun '09

octopus errors on sql test set down to 50

1 0

[Monetdb-developers] problems with starting the monetDB4 xquery server
by Mtekel 04 Jun '09

04 Jun '09

Hello, I have problems starting the monetDB xquery server under windowsXP sp3. When I click on the link in the start menu, dos window appears but then it closes immediatelly and I can't see what's there (after pausing I can see only the first 6 lines of the program output as described below, then after unpausing it immediatelly quits and closes the window). If I run MXQserver.bat, or Mserver.bat --dbinit="module(pathfinder);" I get only this: # MonetDB Server v4.28.4 # based on GDK v1.28.4 # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-2009, MonetDB B.V.. All rights reserved. # Compiled for i686-pc-win32/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah That's all. The server immediatelly ends. However If I run only Mserver.bat, the server "runs" - I get the prompt, but for example I can't connect to the web interface on the port 50000. Does anyone have any advice what to do? How to make it work? Any advice appreciated, Best regards Michael

3 4

[Monetdb-developers] Announcement: New feature release of MonetDB suite
by Sjoerd Mullender 03 Jun '09

03 Jun '09

The MonetDB team at CWI/MonetDB BV are pleased to announce the new "May2009" feature release of the MonetDB suite of programs. This is a feature release, however it is is (mostly) backward compatible with the previous releases (Nov2008 and Feb2009). The two slight incompatibilities are: - The way string data is stored was changed for 64-bit architectures with 32-bit OIDs. There is however an automatic conversion on startup of the server. The biggest problem is, you can't go back to an older version once the new version has run. This incompatibility affects only the Windows 64 bit build (the other 64 bit builds use 64-bit OIDs). - The default location of the write-ahead log (WAL) has changed. This is relevant for both MonetDB5/SQL and MonetDB4/XQuery on all platforms. When the server first starts on an existing database, it will notice that the WAL is missing and will refuse to continue with a message which indicates where the WAL is now expected. You can either use a command line option to tell the server where the WAL is, or you can manually move the WAL to the new location. This latter option is done automatically on Windows when you use the Start menu to start the server. More information on the new release (and the above mentioned incompatibilities) is available at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/May2009/>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5/merovingian utils.c, , 1.1, 1.2 utils.h, , 1.1, 1.2
by Stefan Manegold 29 May '09

29 May '09

On Fri, May 29, 2009 at 08:15:22AM +0000, Fabian wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5/merovingian > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv9054 > > Modified Files: > utils.c utils.h > Log Message: > don't include xxx_config.h in .h files to avoid redeclarations, hopefully this fixes some misc complaints on Debian and co. > > U utils.c > Index: utils.c > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/merovingian/utils.c,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- utils.c 28 May 2009 12:20:46 -0000 1.1 > +++ utils.c 29 May 2009 08:15:20 -0000 1.2 > @@ -24,6 +24,7 @@ > */ > > #include "utils.h" > +#include "sql_config.h" xxx_config.h should (must) be the *first* include in each .c source file (and it must be include only once). Stefan > #include <stdio.h> /* fprintf, fgets */ > #include <string.h> /* memcpy */ > #include <gdk.h> /* GDKmalloc */ > > U utils.h > Index: utils.h > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/merovingian/utils.h,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- utils.h 28 May 2009 12:20:46 -0000 1.1 > +++ utils.h 29 May 2009 08:15:20 -0000 1.2 > @@ -20,7 +20,6 @@ > #ifndef _SEEN_UTILS_H > #define _SEEN_UTILS_H 1 > > -#include "sql_config.h" > #include <stdio.h> /* FILE* */ > #include <sys/types.h> /* time_t */ > > > > ------------------------------------------------------------------------------ > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp as they present alongside digital heavyweights like Barbarian > Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] mclient mem-usage during --dump
by Wouter Alink 28 May '09

28 May '09

Hello, Question: is there any reason for mclient to use (large) amounts of memory during a dump of a sql database? syntax used: $ mclient -lsql -D -dsomedatabase > dump.sql I observe >12 GB of resident memory use when dumping a 2GB (in dump text format) database (it steadily grows), using the May2009 stable branch (of last week) Top shows: 28371 walink 16 0 12.2g 12g 2944 R 87 4.0 10:48.58 mclient I haven't investigated it any further, but I was first of all wondering whether it actually needs these amounts of memory? Greetings, Wouter

2 2

[Monetdb-developers] release show stopper
by Sjoerd Mullender 27 May '09

27 May '09

I have a serious problem with the release on Windows. If I first install the old (April 2009, ie Feb2009-SP2) version, create a table and insert a value (the latter probably not necessary): create table foo (s varchar (10)); insert into foo values ('test'); exit client and server, then upgrade to new version, the table gets lost: sq1>select * from foo; !SELECT: no such table 'foo' When I tried this on Linux, it worked. select * from tables; works and looks good, except that there is no mention of the foo table. So far I've only tried this on 32 bit Windows and 64 bit Fedora 10. It could be that the problem is a 32/64 bit problem, or a Windows/Linux problem. In any case, this is a show stopper. The problem persists if I first have the logger flush itself before the upgrade, so I don't think it's a logger problem. (On Windows, the log directory is moved automatically by the command script. This works.) -- Sjoerd Mullender

1 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/algebra algebra_cse.c, , 1.82, 1.83
by Jan Rittinger 27 May '09

27 May '09

Tom, please include all semantical information (also tcols) in this test. On May 27, 2009, at 16:02, Tom Schreiber wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/algebra > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv27564/compiler/ > algebra > > Modified Files: > algebra_cse.c > Log Message: > -- Fixed the equality-check for the referenced-table-operator > (la_ref_tbl). > > U algebra_cse.c > Index: algebra_cse.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/algebra/algebra_cse.c,v > retrieving revision 1.82 > retrieving revision 1.83 > diff -u -d -r1.82 -r1.83 > --- algebra_cse.c 7 May 2009 14:22:39 -0000 1.82 > +++ algebra_cse.c 27 May 2009 14:02:41 -0000 1.83 > @@ -183,11 +183,20 @@ > return true; > break; > > - > - case la_ref_tbl: > - > - return (strcmp(a->sem.ref_tbl.name, b- > >sem.ref_tbl.name) == 0); > - break; > + case la_ref_tbl: > + > + if (strcmp(a->sem.ref_tbl.name, b->sem.ref_tbl.name) != 0) > + return false; > + > + if (a->schema.count != b->schema.count) > + return false; > + > + for (unsigned int i = 0; i < a->schema.count; i++) > + if (a->schema.items[i].name != b->schema.items[i].name || > + a->schema.items[i].type != b->schema.items[i].type) > + return false; > + return true; > + break; > > case la_attach: > return (a->sem.attach.res == b->sem.attach.res && > > > ------------------------------------------------------------------------------ > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity > professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp as they present alongside digital heavyweights like > Barbarian > Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

1 0

Re: [Monetdb-developers] autogen.py
by RichardGUO Fei 26 May '09

26 May '09

The problem is resolved. I just edited the Makefile.am directly and then use automake. From: gladiatorcn(a)hotmail.com To: monetdb-developers(a)lists.sourceforge.net Subject: autogen.py Date: Mon, 25 May 2009 17:52:00 +0000 Hi, I am new to MonetDB development. I add some source files to MonetDB/MonetDB/src/gdk, which rely on the external libraries. When I try to modify Makefile.am in order to add the relevant link information. It says that it was generated by autogen.py. To be honest, I do not know autogen.py and I could not find any useful information from Google. Could you guys give a little hint please? Thank you very much! Fei 把MSN装进手机，更多聊天乐趣等你挖掘！立刻下载！ _________________________________________________________________ 打工，挣钱，买房子，快来MClub一起”金屋藏娇”！ http://club.msn.cn/?from=10

2 2

[Monetdb-developers] autogen.py
by RichardGUO Fei 25 May '09

25 May '09

Hi, I am new to MonetDB development. I add some source files to MonetDB/MonetDB/src/gdk, which rely on the external libraries. When I try to modify Makefile.am in order to add the relevant link information. It says that it was generated by autogen.py. To be honest, I do not know autogen.py and I could not find any useful information from Google. Could you guys give a little hint please? Thank you very much! Fei _________________________________________________________________ 打工，挣钱，买房子，快来MClub一起”金屋藏娇”！ http://club.msn.cn/?from=10

1 0

Re: [Monetdb-developers] Installing MonetDB5 (Stable) failed on Int.32.32.d.1-Windows5.1 Mic.32.32.d.1-Windows5.1 Int.64.32.d.1-Windows5.2 Mic.64.32.d.1-Windows5.2 Mic.64.64.d.1-Windows5.2
by Stefan Manegold 25 May '09

25 May '09

Dear all, removing the *_export macro definitions from .c source files seems to have broken M5 compilation on Windows --- I'm busy fixing it by re-adding these definitions in .h header files... Stefan On Mon, May 25, 2009 at 05:06:19AM +0200, Testweb Compilation wrote: > copy "lib_streams.lib" "g:\monet\monet.Int.32.32.d.1.28441\MonetDB5\.Int.32.32.d.1-Windows5.1\lib\MonetDB5\lib_streams.lib" > The system cannot find the file specified. > NMAKE : fatal error U1077: 'copy' : return code '0x1' > > http://www.ins.cwi.nl/~monet/permastore/2009-05-25/Stable/install-MonetDB5-… > > CVS committers: manegold(a)cwi.nl mk(a)cwi.nl niels(a)cwi.nl > > module maintainers: mk(a)cwi.nl niels(a)cwi.nl > > An identical error message was detected on the following systems: > Int.32.32.d.1-Windows5.1 Mic.32.32.d.1-Windows5.1 Int.64.32.d.1-Windows5.2 Mic.64.32.d.1-Windows5.2 Mic.64.64.d.1-Windows5.2 > > -- > At this time you cannot configure Testing mail, sorry > You are receiving this mail because: > - you checked in some code on MonetDB5 (Stable) > - you are a fixed recipient > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 4

[Monetdb-developers] GDK::BAT_select_ problem
by RichardGUO Fei 24 May '09

24 May '09

Hi, I am doing some developments in GDK. More concretely, I want to modify the behavior of a SQL select statement. I print some messages in BAT_select_ as I think that most of SQL selects would be compiled into plusieur BATselects. Is that right? I used mserver --dbinit 'include sql;' to start, and saw some messages coming out (BAT_select_ is also used for authentication). However, after I logged in by using mclient -l sql, no matter what kind of SELECT I performed, there was just no message. Was BAT_select_ called after all in this case? Thank you very much for your responses. Regards, Richard _________________________________________________________________ MSN 表情魔法书，改变你的对话时代！ http://im.live.cn/emoticons/

2 2

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/Tests All, May2009, 1.61, 1.61.2.1
by Sjoerd Mullender 24 May '09

24 May '09

On 2009-05-24 11:43, Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/test/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv15423/src/test/Tests I took care of the (non-)propagation of this and the other three All files. > Modified Files: > Tag: May2009 > All > Log Message: > disabled tests (should not be propagated!) > > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/Tests/All,v > retrieving revision 1.61 > retrieving revision 1.61.2.1 > diff -u -d -r1.61 -r1.61.2.1 > --- All 9 Apr 2009 18:48:49 -0000 1.61 > +++ All 24 May 2009 09:43:11 -0000 1.61.2.1 > @@ -87,7 +87,7 @@ > setoptimizer > load_dec_as_int > string > -NOT_WIN32?crashme > +#NOT_WIN32?crashme > 50ways > load_with_offset > copy_into > > > ------------------------------------------------------------------------------ > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian > Group, R/GA, & Big Spaceship. http://www.creativitycat.com > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_interpreter.mx, , 1.303, 1.304
by Sjoerd Mullender 23 May '09

23 May '09

Is this a bug fix? On 2009-05-23 11:56, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv19871 > > Modified Files: > mal_interpreter.mx > Log Message: > We better protect global variables in the interpreter. > > > U mal_interpreter.mx > Index: mal_interpreter.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_interpreter.mx,v > retrieving revision 1.303 > retrieving revision 1.304 > diff -u -d -r1.303 -r1.304 > --- mal_interpreter.mx 16 May 2009 18:26:23 -0000 1.303 > +++ mal_interpreter.mx 23 May 2009 09:55:57 -0000 1.304 > @@ -734,11 +734,12 @@ > #endif > @:performanceVariables@ > > -#ifdef DEBUG_FLOW2 > + pci = getInstrPtr(flow->mb, stkpc); > +#ifdef DEBUG_FLOW > stream_printf(cntxt->fdout,"#execute thread %d \n", tid); > + printInstruction(GDKstdout, flow->mb, 0, pci, LIST_MAL_ALL); > #endif > THRset_errbuf(THRget(THRgettid()), cntxt->errbuf); /* where to leave errors */ > - pci = getInstrPtr(flow->mb, stkpc); > if (stk->cmd || mb->trap) { > lng tm = 0; > if( oldtimer) > @@ -857,9 +858,13 @@ > { > int i; > > - assert(worker == NULL); > + mal_set_lock(mal_contextLock, "DFLOWcreate"); > + if ( work != NULL){ > + mal_unset_lock(mal_contextLock, "DFLOWcreate"); > + return; > + } > > - work = q_create(256); > + work = q_create(256); /* seems enough for the time being */ > > nway = GDKnr_threads; > worker = (FlowTask *) GDKzalloc(sizeof(FlowTask)*nway); > @@ -868,6 +873,7 @@ > /* create the thread and let it wait */ > MT_create_thread(&worker[i].tid, runDFLOWworker, worker+i); > } > + mal_unset_lock(mal_contextLock, "DFLOWcreate"); > } > > static void > > > ------------------------------------------------------------------------------ > Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT > is a gathering of tech-side developers & brand creativity professionals. Meet > the minds behind Google Creative Lab, Visual Complexity, Processing, & > iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian > Group, R/GA, & Big Spaceship. http://www.creativitycat.com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

2 1

[Monetdb-developers] ODBC windows build script
by Stefan de Konink 23 May '09

23 May '09

Is there any 'asset' available that allows to build the Windows ODBC driver from within Linux or a howto to build it in Windows? Especially related to the recent authentication changes. Stefan

3 3

[Monetdb-developers] DBSlayer for MonetDB
by Stefan de Konink 22 May '09

22 May '09

Hi, I have set up a development server for OpenStreetMap that allows 'Joe Regular' to perform /any/ SQL request on a dataset limited to the borders of The Netherlands, Belgium and Luxembourgh. That means around 700MB of data. Because OpenStreetMap mainly targets webdevelopment, making it easy-to-use and efficient-to-parse become key issues. Because my favorite webserver [1] implemented DBSlayer [2] technology for MySQL; I could plugin an architecture layer to support different databases. MonetDB is in beta phase, and PostgreSQL is coded. The output is available in native PHP, Python and Ruby arrays; JSON, and XML-RPC is coded but not yet in production. The attached script shows a trivial example how to query a database farm over the web. Hanging more servers under the webserver, automatically increases performance and redundancy. I configured the webserver in such way that a rewrite takes place if no LIMIT was specified. Because the requests are URIs, every request is logged, what makes it possible to analyse the performance and benchmark the test set against new releases. With this platform I am able to plugin my multicolumn 'optimizer' idea, so we all benefit. To the outside Mapi is available, for accessing it by our mclient or ODBC client. If our 'native' Ruby/Python MAPI implementations are ready for testing, I can promote them on the site, or provide a sandbox. The site itself is still boring; http://xapi.openstreet.nl:8000/ Stefan [1] http://www.cherokee-project.com/ [2] http://code.nytimes.com/projects/dbslayer #!/usr/bin/env python import urllib sql="SELECT lat, long FROM nodes_legacy, node_tags WHERE id = node AND k = 'amenity' and v = 'atm';" query = urllib.quote(sql) print 'Original:', sql print 'Encoded:', query url = 'http://xapi.openstreet.nl:8000/python/%s'%(query) response = urllib.urlopen(url) print 'RESPONSE:', response print 'URL :', response.geturl() headers = response.info() print 'DATE :', headers['date'] print 'HEADERS :' print '---------' print headers data = response.read() print 'LENGTH :', len(data) print 'DATA :' print '---------' obj = eval(data) print obj

1 0

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/ruby activerecord-monetdb-adapter-0.1.gem, , NONE, 1.1 activerecord-monetdb-adapter-0.1.gemspec, , NONE, 1.1 Changelog, , 1.2, 1.3 README, , 1.3, 1.4 TODO, , 1.2, 1.3 ruby-monetdb-sql-0.1.gem, , 1.2, 1.3
by Stefan Manegold 20 May '09

20 May '09

On Wed, May 20, 2009 at 11:17:14AM +0000, Gabriele Modena wrote: > Update of /cvsroot/monetdb/clients/src/ruby > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30426 > > Modified Files: > Changelog README TODO ruby-monetdb-sql-0.1.gem > Added Files: > activerecord-monetdb-adapter-0.1.gem > activerecord-monetdb-adapter-0.1.gemspec > Log Message: > Fixed bugs that prevented the correct working of activerecords' migration; The activerecord connector now supports insertion, update and alter table operations; Type casting is working in activerecord; Added a rubygem and rakefile for activerecord-monetdb-adapter; Added a new usage example for activerecord to the README file; Added an example directory to the cvs tree; The driver now correctly works with merovingian. ^^^^^^^^^^ Shouldn't this checkin then have gone to the May2009 release branch? See `man cvs` and/or pages 8 - 16 of http://homepages.cwi.nl/~manegold/Presentations/MonetDBdevTTT.pdf for information about how to use CVS branches in genral and/or with MonetDB in particular. Don't hesitate to ask if you have questions. Please check with Sjoerd, whether a(n execptional!) back-port is desired; if so, see the above references (or ask) how to do this using CVS commands, only. If required, I can help. Stefan > > U Changelog > Index: Changelog > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/ruby/Changelog,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- Changelog 9 May 2009 14:49:30 -0000 1.2 > +++ Changelog 20 May 2009 11:17:12 -0000 1.3 > @@ -1,3 +1,13 @@ > +* Mon 18 May 2009 15:22:31 CEST > +Fixed bugs that prevented the correct working of activerecords' migration; > +The activerecord connector now supports insertion, update and alter table operations; > +Type casting is working in activerecord; > +Added a rubygem and rakefile for activerecord-monetdb-adapter; > +Added a new usage example for activerecord to the README file; > +Added an example directory to the cvs tree; > +The driver now correctly works with merovingian. > + > + > * Sat 9 May 2009 15:58:36 CEST > Fixed bugs with the query processing in the standalone driver; > Added INSERT and UPDATE methods in the activerecord connector. > > --- NEW FILE: activerecord-monetdb-adapter-0.1.gemspec --- > Gem::Specification.new do |s| > s.required_ruby_version = '>= 1.8.0' > s.name = %q{activerecord-monetdb-adapter} > s.version = "0.1" > s.date = %q{2009-05-18} > s.authors = ["G Modena"] > s.email = %q{gm(a)cwi.nl} > s.summary = %q{ActiveRecord Connector for MonetDB} > s.homepage = %q{http://monetdb.cwi.nl/} > s.description = %q{ActiveRecord Connector for MonetDB built on top of the pure Ruby database driver} > s.files = [ "adapter/active_record/connection_adapters/monetdb_adapter.rb" ] > s.has_rdoc = true > s.require_path = './lib' > s.add_dependency(%q<activerecord>, [">= 2.3.2"]) > s.add_dependency(%q<ruby-monetdb-sql>, [">= 0.1"]) > end > > U ruby-monetdb-sql-0.1.gem > Index: ruby-monetdb-sql-0.1.gem > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/ruby/ruby-monetdb-sql-0.1.gem,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > Binary files /tmp/cvs9arhWX and /tmp/cvsfjZs3J differ > > --- NEW FILE: activerecord-monetdb-adapter-0.1.gem --- > (This appears to be a binary file; contents omitted.) > > U README > Index: README > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/ruby/README,v > retrieving revision 1.3 > retrieving revision 1.4 > diff -u -d -r1.3 -r1.4 > --- README 7 May 2009 15:06:41 -0000 1.3 > +++ README 20 May 2009 11:17:12 -0000 1.4 > @@ -2,7 +2,6 @@ > This directory contains the a ruby interface to monetdb5 > written in pure ruby. > > - > lib/MonetDB.rb > lib/MonetDBConnection.rb > lib/MonetDBStatements.rb > @@ -16,54 +15,8 @@ > > doc/: rubydoc in HTML format > > -== ActiveRecord adapter == > -Active Record connects business objects and database tables to create a persistable domain model where logic and data are presented in one wrapping. It‘s an implementation of the object-relational mapping (ORM) pattern. > - > -Required files: > -adapter/lib/active_record/monetdb_adapter.rb > - > -At the moment connection and SELECT queries are supported. > - > -Usage example follows: > - > - > -require 'active_record' > - > -ActiveRecord::Base.establish_connection( > - :adapter => "monetdb", > - :host => "localhost", > - :database => "demo" > -) > - > -# map the tables schema to a class > -class Tables < ActiveRecord::Base > -end > - > -# return the first result of the query SELECT * from tables > -puts Tables.find(:first) > - > - > - > - > -== Rubygem == > - > -The standalone ruby driver can be distributed as a ruby gem. > -A gem file is already available; however, it can be generated > -starting from the ruby-monetdb-sql-0.1.gemspec file: > - > -$ gem build ruby-monetdb-sql-0.1.gemspec > - > -To install the file run the command: > - > -$ gem install ruby-monetdb-sql-0.1.gem > - > -Documentation in ri and html format will be generated and installed as well > - > == Usage == > -To use the driver import the 'MonetDB' class and 'rubygems' (in case you installed it using gems). > - > - > -* Processing Statements that Return a Result Set > +To use the standalone driver import the 'MonetDB' class and 'rubygems' (in case you installed it using gems). > > A typical sequence of events is as follows: > Invoke query using the database handle to send the statement to the server and get back a result set object. > @@ -104,3 +57,85 @@ > db.close > > See lib/demo.rb and the MonetDBDatar class documentation for more examples. > + > + > + > +== ActiveRecord connector adapter == > +Active Record connects business objects and database tables to create a persistable domain model where logic and data are presented in one wrapping. It‘s an implementation of the object-relational mapping (ORM) pattern. > + > +Required files: > + > +adapter/lib/active_record/monetdb_adapter.rb > + > +Usage example follows: > +require 'active_record' > + > +ActiveRecord::Base.logger = Logger.new(STDERR) > +ActiveRecord::Base.colorize_logging = true > + > +ActiveRecord::Base.establish_connection( > + :adapter => "monetdb", > + :host => "localhost", > + :database => "demo" > +) > + > +# Create a new table > +class AddTests < ActiveRecord::Migration > + def self.up > + create_table :tests do |table| > + table.column :name, :string > + table.column :surname, :string > + end > + end > + > + def self.down > + drop_table :tests > + end > + > +end > + > +AddTests.up > + > +# Migration: add a column name with a default value > +class AddAge < ActiveRecord::Migration > + def self.up > + add_column :tests, :age, :smallint, :default => 18 > + end > + > + def self.down > + remove_column :tests, :age > + end > + > +end > + > +class Test < ActiveRecord::Base > +end > + > +# Insert an entry in the table > +Test.create(:name => 'X', :surname => 'Y') > + > +# add a column > +AddAge.up > + > +# return the first result of the query SELECT * from tables > +row = Test.find(:first) > +printf "SELECT * from tests LIMIT 1:\n" > +printf "Name: %s, Surname: %s, Age: %s\n", row.name, row.surname, row.age > + > +# Drop the table > +AddTests.down > + > +== Rubygem == > + > +The standalone ruby driver can be distributed as a ruby gem. > +A gem file is already available; however, it can be generated > +starting from the ruby-monetdb-sql-0.1.gemspec file: > + > +$ gem build ruby-monetdb-sql-0.1.gemspec > + > +To install the file run the command: > + > +$ gem install ruby-monetdb-sql-0.1.gem > + > +Documentation in ri and html format will be generated and installed as well > + > > U TODO > Index: TODO > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/ruby/TODO,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- TODO 7 May 2009 15:06:41 -0000 1.2 > +++ TODO 20 May 2009 11:17:12 -0000 1.3 > @@ -1,5 +1,15 @@ > +* implement PROTOCOL 9 login changes > + > * improve activerecord driver > + > * profiling and performance tuning > + > * improve type conversion (do conversion "on demand" as in jdbc driver) > + > * improve tests > + > * code and documentation cleanup > + > +* fix syntax errors with ruby 1.9 > + > +* OSM on rails demo > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensing option that enables > unlimited royalty-free distribution of the report engine > for externally facing server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

[Monetdb-developers] OpenSSL header check
by Stefan de Konink 20 May '09

20 May '09

I was just compiling MonetDB head on this distro called `Debian' (poor me). In the middle of the compilation I had missing headers. Wouldn't it be feasible to check for them like we check for PCRE presence? Stefan

2 4

Re: [Monetdb-developers] [Monetdb-checkins] buildtools/conf MonetDB.m4, May2009, 1.118, 1.118.2.1
by Jan Rittinger 19 May '09

19 May '09

That's no solution in my eyes... Now I get the following configure output for the clients module... checking for OpenSSL >= 0x0090800f... configure: error: not sufficient > ... and cannot build the clients code anymore. Jan On May 18, 2009, at 20:40, Fabian wrote: > Update of /cvsroot/monetdb/buildtools/conf > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv29422 > > Modified Files: > Tag: May2009 > MonetDB.m4 > Log Message: > check for >openssl-0.9.8, sha-2 is only implemented there, thanks > Jan Rittinger > > U MonetDB.m4 > Index: MonetDB.m4 > =================================================================== > RCS file: /cvsroot/monetdb/buildtools/conf/MonetDB.m4,v > retrieving revision 1.118 > retrieving revision 1.118.2.1 > diff -u -d -r1.118 -r1.118.2.1 > --- MonetDB.m4 6 May 2009 16:08:00 -0000 1.118 > +++ MonetDB.m4 18 May 2009 18:39:58 -0000 1.118.2.1 > @@ -2402,6 +2402,19 @@ > fi > if test "x$have_openssl" != xno; then > AC_DEFINE(HAVE_OPENSSL, 1, [Define if you have the OpenSSL library]) > + dnl SHA-2 is implemented starting from version 0.9.8 > + req_openssl_ver=0x0090800f > + AC_MSG_CHECKING([for OpenSSL >= $req_openssl_ver]) > + AC_TRY_COMPILE([#include <openssl/opensslv.h>],[ > +#if !defined(OPENSSL_VERSION_NUMBER) > +#error "Hmmm no OpenSSL version?" > +#endif > +#if (OPENSSL_VERSION_NUMBER < ${req_openssl_ver}L) > +#error "Need more recent version than " OPENSSL_VERSION_TEXT > +#endif], > + [AC_MSG_RESULT(OK)], > + [AC_MSG_ERROR([not sufficient])] > + ) > else > OPENSSL_LIBS="" > OPENSSL_INCS="" > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensing option that enables > unlimited royalty-free distribution of the report engine > for externally facing server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

4 7

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal mkey.mx, May2009, 1.15, 1.15.2.1
by Stefan Manegold 19 May '09

19 May '09

Martin, maybe the compiler reminded us that you originally intended the following, i.e., propagation the actual error message of CMDbulk_rotate_xor_hash() upwards instead of just saying OPERATION_FAILED: ======== $ cvs diff MonetDB5/src/modules/mal/mkey.mx Index: MonetDB5/src/modules/mal/mkey.mx =================================================================== RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mkey.mx,v retrieving revision 1.15.2.1 diff -u -r1.15.2.1 mkey.mx --- MonetDB5/src/modules/mal/mkey.mx 19 May 2009 05:52:49 -0000 1.15.2.1 +++ MonetDB5/src/modules/mal/mkey.mx 19 May 2009 07:39:01 -0000 @@ -584,6 +584,7 @@ str MKEYbulk_rotate_xor_hash(int *ret, int *hid, int *nbits, int *bid){ BAT *hn, *b, *bn=0; + str msg= MAL_SUCCEED; if ((hn = BATdescriptor(*hid)) == NULL) { throw(MAL, "mkey.bulk_rotate_xor_hash", RUNTIME_OBJECT_MISSING); @@ -593,15 +594,15 @@ throw(MAL, "mkey.bulk_rotate_xor_hash", RUNTIME_OBJECT_MISSING); } - if( CMDbulk_rotate_xor_hash(&bn,hn,nbits,b) != MAL_SUCCEED){ + if( (msg= CMDbulk_rotate_xor_hash(&bn,hn,nbits,b)) != MAL_SUCCEED){ BBPreleaseref(hn->batCacheid); BBPreleaseref(b->batCacheid); - throw(MAL, "mkey.bulk_rotate_xor_hash", OPERATION_FAILED); + throw(MAL, "mkey.bulk_rotate_xor_hash", msg); } BBPreleaseref(hn->batCacheid); BBPreleaseref(b->batCacheid); *ret= bn->batCacheid; BBPkeepref(bn->batCacheid); - return MAL_SUCCEED; + return msg; } @} ======== ? Stefan On Tue, May 19, 2009 at 05:52:51AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30928 > > Modified Files: > Tag: May2009 > mkey.mx > Log Message: > Silence compiler > > > U mkey.mx > Index: mkey.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mkey.mx,v > retrieving revision 1.15 > retrieving revision 1.15.2.1 > diff -u -d -r1.15 -r1.15.2.1 > --- mkey.mx 17 May 2009 21:14:54 -0000 1.15 > +++ mkey.mx 19 May 2009 05:52:49 -0000 1.15.2.1 > @@ -584,7 +584,6 @@ > str > MKEYbulk_rotate_xor_hash(int *ret, int *hid, int *nbits, int *bid){ > BAT *hn, *b, *bn=0; > - str msg= MAL_SUCCEED; > > if ((hn = BATdescriptor(*hid)) == NULL) { > throw(MAL, "mkey.bulk_rotate_xor_hash", RUNTIME_OBJECT_MISSING); > @@ -594,7 +593,7 @@ > throw(MAL, "mkey.bulk_rotate_xor_hash", RUNTIME_OBJECT_MISSING); > } > > - if( (msg= CMDbulk_rotate_xor_hash(&bn,hn,nbits,b)) != MAL_SUCCEED){ > + if( CMDbulk_rotate_xor_hash(&bn,hn,nbits,b) != MAL_SUCCEED){ > BBPreleaseref(hn->batCacheid); > BBPreleaseref(b->batCacheid); > throw(MAL, "mkey.bulk_rotate_xor_hash", OPERATION_FAILED); > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensing option that enables > unlimited royalty-free distribution of the report engine > for externally facing server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] New stable branch created
by Sjoerd Mullender 18 May '09

18 May '09

I have created new stable branches for the upcoming release. From now on *all* bug fixes and *only* bug fixes *must* go to this new stable branch. I reserve the right to undo any changes that do not comply with this rule. All packages use the same name for the branch: May2009. So in each of your stable checkout directories you can do cvs update -rMay2009 to update to the new branch. I have created branches for the following packages: MonetDB MonetDB4 MonetDB5 TestTools buildtools clients geom java pathfinder sql template testing. Note that datacell is missing from this list. It is not yet released and will not be released in this round. -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_datacyclotron.mx, , 1.6, 1.7 opt_derivepath.mx, , 1.4, 1.5 opt_joinpath.mx, , 1.46, 1.47 opt_macro.mx, , 1.46, 1.47 opt_prejoin.mx, , 1.7, 1.8 opt_remap.mx, , 1.47, 1.48 opt_statistics.mx, , 1.18, 1.19 opt_support.mx, , 1.100, 1.101 opt_trace.mx, , 1.12, 1.13 optimizer.mx, , 1.83, 1.84 optimizerWrapper.mx, , 1.29, 1.30
by Sjoerd Mullender 17 May '09

17 May '09

Where are the definitions of ILLARG_CONSTANTS, PROGRAM_NYI and OPTIMIZER_CYCLE? On 2009-05-16 23:02, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv2012 > > Modified Files: > opt_datacyclotron.mx opt_derivepath.mx opt_joinpath.mx > opt_macro.mx opt_prejoin.mx opt_remap.mx opt_statistics.mx > opt_support.mx opt_trace.mx optimizer.mx optimizerWrapper.mx > Log Message: > The next batch of straightforward error clean up and condensation. > > > U opt_derivepath.mx > Index: opt_derivepath.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_derivepath.mx,v > retrieving revision 1.4 > retrieving revision 1.5 > diff -u -d -r1.4 -r1.5 > --- opt_derivepath.mx 3 Apr 2009 16:48:41 -0000 1.4 > +++ opt_derivepath.mx 16 May 2009 21:02:04 -0000 1.5 > @@ -141,6 +141,6 @@ > (void) mb; > (void) stk; > (void) pci; > - throw(MAL,"group.derivePath","nyi"); > + throw(MAL,"group.derivePath",PROGRAM_NYI); > } > @} > > U opt_support.mx > Index: opt_support.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_support.mx,v > retrieving revision 1.100 > retrieving revision 1.101 > diff -u -d -r1.100 -r1.101 > --- opt_support.mx 6 May 2009 16:54:13 -0000 1.100 > +++ opt_support.mx 16 May 2009 21:02:04 -0000 1.101 > @@ -628,7 +628,7 @@ > sprintf(buf,"%-20s actions=%2d time=" LLFMT " usec",name,actions,usec); > newComment(mb,buf); > if (mb->errors) > - throw(MAL,name,"failed\n"); > + throw(MAL, name, PROGRAM_GENERAL); > } > /* code to collect all last versions to study code coverage in SQL > {stream *fd; > @@ -677,7 +677,7 @@ > } > } while (qot && cnt++ < mb->stop); > if (cnt >= mb->stop) > - throw(MAL, "optimizer.MALoptimizer", "too many optimization cycles\n"); > + throw(MAL, "optimizer.MALoptimizer", OPTIMIZER_CYCLE); > return 0; > } > > > U optimizerWrapper.mx > Index: optimizerWrapper.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/optimizerWrapper.mx,v > retrieving revision 1.29 > retrieving revision 1.30 > diff -u -d -r1.29 -r1.30 > --- optimizerWrapper.mx 16 May 2009 08:54:40 -0000 1.29 > +++ optimizerWrapper.mx 16 May 2009 21:02:04 -0000 1.30 > @@ -57,9 +57,7 @@ > !isVarConstant(mb,getArg(p,1)) || > !isVarConstant(mb,getArg(p,2)) > ) { > - char buf[1024]; > - snprintf(buf,1024, "Optimizer requires constant string arguments\n"); > - throw(MAL, "optimizer.@1",buf); > + throw(MAL, "optimizer.@1", ILLARG_CONSTANTS); > } > if( stk != 0){ > modnme= *(str*)getArgReference(stk,p,1); > @@ -72,8 +70,8 @@ > > if( s == NULL) { > char buf[1024]; > - snprintf(buf,1024, "Could not find %s.%s\n",modnme,fcnnme); > - throw(MAL, "optimizer.@1",buf); > + snprintf(buf,1024, "%s.%s",modnme,fcnnme); > + throw(MAL, "optimizer.@1", RUNTIME_OBJECT_UNDEFINED, buf); > } > #ifdef _DEBUG_OPTIMIZER_ > stream_printf(cntxt->fdout,"@1 %s %s\n",modnme,fcnnme); > > U opt_remap.mx > Index: opt_remap.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_remap.mx,v > retrieving revision 1.47 > retrieving revision 1.48 > diff -u -d -r1.47 -r1.48 > --- opt_remap.mx 16 May 2009 08:54:40 -0000 1.47 > +++ opt_remap.mx 16 May 2009 21:02:04 -0000 1.48 > @@ -529,7 +529,7 @@ > #else > (void) cntxt; > #endif > - throw(MAL,"opt.remap","no implementation present"); > + throw(MAL, "opt.remap", PROGRAM_NYI); > } > @include optimizerWrapper.mx > @h > > U opt_prejoin.mx > Index: opt_prejoin.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_prejoin.mx,v > retrieving revision 1.7 > retrieving revision 1.8 > diff -u -d -r1.7 -r1.8 > --- opt_prejoin.mx 12 Apr 2009 20:22:29 -0000 1.7 > +++ opt_prejoin.mx 16 May 2009 21:02:04 -0000 1.8 > @@ -62,11 +62,11 @@ > > *rl = *rr = 0; > if( (bl= BATdescriptor(*l)) == NULL ){ > - throw(MAL, "algebra.prejoin", "Cannot access descriptor"); > + throw(MAL, "algebra.prejoin", INTERNAL_BAT_ACCESS); > } > if( (br= BATdescriptor(*r)) == NULL ){ > BBPreleaseref(bl->batCacheid); > - throw(MAL, "algebra.prejoin", "Cannot access descriptor"); > + throw(MAL, "algebra.prejoin", INTERNAL_BAT_ACCESS); > } > lpages= (BUN) ((bl->H->heap.size + bl->T->heap.size)/MT_pagesize()); > rpages= (BUN) ((br->H->heap.size + br->T->heap.size)/MT_pagesize()); > > U opt_macro.mx > Index: opt_macro.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_macro.mx,v > retrieving revision 1.46 > retrieving revision 1.47 > diff -u -d -r1.46 -r1.47 > --- opt_macro.mx 16 May 2009 08:54:40 -0000 1.46 > +++ opt_macro.mx 16 May 2009 21:02:04 -0000 1.47 > @@ -388,7 +388,7 @@ > retseen = p->token == RETURNsymbol || p->token == YIELDsymbol || p->barrier == RETURNsymbol || p->barrier == YIELDsymbol; > } > if (retseen && i != mb->stop - 1) > - throw(MAL, "optimizer.MACROvalidate", "RETURN statement is not the last one"); > + throw(MAL, "optimizer.MACROvalidate", MACRO_SYNTAX_ERROR); > return MAL_SUCCEED; > } > > @@ -417,13 +417,13 @@ > stream_printf(cntxt->fdout,"Hit, replace macro call %s\n", t->name); > #endif > if (i == last) > - throw(MAL, "optimizer.MACROoptimizer", "duplicate macro expansion"); > + throw(MAL, "optimizer.MACROoptimizer", MACRO_DUPLICATE); > > last = i; > i = inlineMALblock(mb, i, t->def); > cnt++; > if (cnt > MAXEXPANSION) > - throw(MAL, "optimizer.MACROoptimizer", "too many macro expansions"); > + throw(MAL, "optimizer.MACROoptimizer", MACRO_TOO_DEEP); > } > } > return msg; > > U opt_trace.mx > Index: opt_trace.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_trace.mx,v > retrieving revision 1.12 > retrieving revision 1.13 > diff -u -d -r1.12 -r1.13 > --- opt_trace.mx 7 Jan 2009 14:15:13 -0000 1.12 > +++ opt_trace.mx 16 May 2009 21:02:04 -0000 1.13 > @@ -90,7 +90,7 @@ > > trace= fopen(defaultLog,"a"); > if( trace == 0) > - throw(MAL,"mdb.collect","Could not create trace file"); > + throw(MAL, "mdb.collect", RUNTIME_FILE_NOT_FOUND); > fprintf(trace,"#-------- \n"); > fflush(trace); > } > > U optimizer.mx > Index: optimizer.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/optimizer.mx,v > retrieving revision 1.83 > retrieving revision 1.84 > diff -u -d -r1.83 -r1.84 > --- optimizer.mx 16 May 2009 08:54:40 -0000 1.83 > +++ optimizer.mx 16 May 2009 21:02:04 -0000 1.84 > @@ -151,7 +151,7 @@ > } > s = findSymbol(cntxt->nspace, putName(modnme,strlen(modnme)), fcnnme); > if (s == NULL) > - throw(MAL, "optimizer.optimize", "operation not found\n"); > + throw(MAL, "optimizer.optimize", SEMANTIC_OPERATION_MISSING); > removeInstruction(mb, pci); > return optimizeMALBlock(cntxt, s->def); > } > @@ -180,8 +180,8 @@ > > if (s == NULL) { > char buf[1024]; > - snprintf(buf,1024, "Could not find %s.%s\n", modnme, fcnnme); > - throw(MAL, "optimizer.showFlowGraph", buf); > + snprintf(buf,1024, "%s.%s", modnme, fcnnme); > + throw(MAL, "optimizer.showFlowGraph", RUNTIME_OBJECT_UNDEFINED, buf); > } > showFlowGraph(s->def, stk, fname); > return MAL_SUCCEED; > @@ -209,8 +209,8 @@ > > if (s == NULL) { > char buf[1024]; > - snprintf(buf,1024, "Could not find %s.%s\n", modnme, fcnnme); > - throw(MAL, "optimizer.showPlan", buf); > + snprintf(buf,1024, "%s.%s", modnme, fcnnme); > + throw(MAL, "optimizer.showPlan", RUNTIME_OBJECT_UNDEFINED, buf); > } > mb= s->def; > } > @@ -271,7 +271,7 @@ > #endif > if( s== 0) > return throwException(MALEXCEPTION,"optimizer.@1optimizer", > - "module '%s' not found\n",fcn); > + RUNTIME_OBJECT_UNDEFINED, fcn); > if( s->subscope){ > j = getSubScope(fcn); > for(t= s->subscope[j];t!=NULL;t=t->peer) > > U opt_joinpath.mx > Index: opt_joinpath.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_joinpath.mx,v > retrieving revision 1.46 > retrieving revision 1.47 > diff -u -d -r1.46 -r1.47 > --- opt_joinpath.mx 29 Apr 2009 07:41:50 -0000 1.46 > +++ opt_joinpath.mx 16 May 2009 21:02:04 -0000 1.47 > @@ -484,7 +484,7 @@ > for( --top; top>=0; top--) > BBPreleaseref(joins[top]->batCacheid); > GDKfree(joins); > - throw(MAL, "algebra.joinPath", "Cannot access descriptor"); > + throw(MAL, "algebra.joinPath", INTERNAL_BAT_ACCESS); > } > joins[top++] = b; > } > > U opt_datacyclotron.mx > Index: opt_datacyclotron.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_datacyclotron.mx,v > retrieving revision 1.6 > retrieving revision 1.7 > diff -u -d -r1.6 -r1.7 > --- opt_datacyclotron.mx 5 May 2009 14:20:06 -0000 1.6 > +++ opt_datacyclotron.mx 16 May 2009 21:02:04 -0000 1.7 > @@ -114,14 +114,14 @@ > (void) tab; > (void) col; > (void) kind; > - throw(MAL,"datacyclotron.request","nyi"); > + throw(MAL,"datacyclotron.request",PROGRAM_NYI); > } > > str > DCpin(int *ret, int *bid){ > (void) ret; > (void) bid; > - throw(MAL,"datacyclotron.pin","nyi"); > + throw(MAL,"datacyclotron.pin",PROGRAM_NYI); > } > > > @@ -129,6 +129,6 @@ > DCunpin(int *ret, int *bid){ > (void) ret; > (void) bid; > - throw(MAL,"datacyclotron.unpin","nyi"); > + throw(MAL,"datacyclotron.unpin",PROGRAM_NYI); > } > > > U opt_statistics.mx > Index: opt_statistics.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_statistics.mx,v > retrieving revision 1.18 > retrieving revision 1.19 > diff -u -d -r1.18 -r1.19 > --- opt_statistics.mx 7 Jan 2009 14:15:13 -0000 1.18 > +++ opt_statistics.mx 16 May 2009 21:02:04 -0000 1.19 > @@ -192,10 +192,8 @@ > int idx; > QOTstatisticsInit(); > idx= QOTindex(*nme); > - if( idx < 0) > - throw(MAL,"optimizer.getStatistics","Illegal property"); > - if( qotStat[idx] == 0) > - throw(MAL,"optimizer.getStatistics","Statistics table not valid"); > + if( idx < 0 || qotStat[idx] == 0 ) > + throw(ILLARG,"optimizer.getStatistics",RUNTIME_OBJECT_MISSING); > BBPincref(*ret= qotStat[idx]->batCacheid, TRUE); > return MAL_SUCCEED; > } > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensing option that enables > unlimited royalty-free distribution of the report engine > for externally facing server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, , 1.73, 1.74 mal_client.mx, , 1.195, 1.196 mal_debugger.mx, , 1.263, 1.264 mal_exception.mx, , 1.54, 1.55 mal_factory.mx, , 1.87, 1.88 mal_interpreter.mx, , 1.302, 1.303 mal_linker.mx, , 1.110, 1.111 mal_profiler.mx, , 1.128, 1.129 mal_sabaoth.mx, , 1.53, 1.54 mal_scenario.mx, , 1.123, 1.124 mal_session.mx, , 1.195, 1.196
by Martin Kersten 16 May '09

16 May '09

Fabian Groffen wrote: > On 16-05-2009 18:26:25 +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/mal >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv27406 >> >> Modified Files: >> mal_authorize.mx mal_client.mx mal_debugger.mx >> mal_exception.mx mal_factory.mx mal_interpreter.mx >> mal_linker.mx mal_profiler.mx mal_sabaoth.mx mal_scenario.mx >> mal_session.mx >> Log Message: >> Collecting the exception/errors messages in one place leads to easier detection >> of duplicates and can be used later for internationalization efforts > > Why not do it the gettext way, in that case? Yes, i am fully aware of gettext. It is a multi-step process, first condense..... and gettext() performs translations based on strings e.g. the ones now identified. > >> U mal_linker.mx >> Index: mal_linker.mx >> =================================================================== >> RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_linker.mx,v >> retrieving revision 1.110 >> retrieving revision 1.111 >> diff -u -d -r1.110 -r1.111 >> --- mal_linker.mx 7 Jan 2009 14:15:12 -0000 1.110 >> +++ mal_linker.mx 16 May 2009 18:26:23 -0000 1.111 >> @@ -251,7 +251,7 @@ >> >> if (fullname == NULL) { >> if( flag) >> - throw(LOADER, "loadLibrary", "%s: file not found", filename); >> + throw(LOADER, "loadLibrary", RUNTIME_FILE_NOT_FOUND, filename); > > I think this is prone to errors and mistakes, since you no longer know > how many %X are in the constant, of what type, etc. true... see how many are really needed after condensation > > I do think consistency is good, I doubt about translations, but I think > this approach is a good solution. Please look into gettext, see > applications like mutt for an example how to use it. > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensing option that enables > unlimited royalty-free distribution of the report engine > for externally facing server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

2 5

[Monetdb-developers] new release branch
by Sjoerd Mullender 15 May '09

15 May '09

I am planning to create a new "stable" branch today or tomorrow for the upcoming May feature release. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah pftijah.mx, , 1.228, 1.229
by Sjoerd Mullender 14 May '09

14 May '09

It's slightly more complex than this. At the MIL level you're right, you need to use wrd instead of int for bat counts. On the C level however, you should use the BUN type and also check for overflow when converting a wrd parameter to BUN (if sizeof(wrd) > sizeof(BUN) which is entirely possible). And then the real bug in your checkin: you use OIDFMT to print some value of type wrd. This is incorrect. You must use LLFMT together with a cast to lng for that. (Better would be to use BUN and BUNFMT.) I guess we could introduce a WRDFMT for printing wrd values, but we don't have that currently. On 2009-05-14 19:42, Roberto Cornacchia wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25786 > > Modified Files: > pftijah.mx > Log Message: > This commit is a temporary fix for the incorrect definition of count() mil proc: > count(BAT b) : int > > This should be instead: > > count(BAT b) : wrd > > !! Note that the problem should be solved properly in algebra.mx, changing the definition of count() and fixing all related code. > > In addition, this commit fixes some more incorrect usage of the int type, for example all bat offsets should be wrd and not int. > > > > U pftijah.mx > Index: pftijah.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/pftijah.mx,v > retrieving revision 1.228 > retrieving revision 1.229 > diff -u -d -r1.228 -r1.229 > --- pftijah.mx 13 May 2009 07:35:03 -0000 1.228 > +++ pftijah.mx 14 May 2009 17:42:09 -0000 1.229 > @@ -117,7 +117,7 @@ > : BAT[oid,oid] = CMDpf2tijah_node; > "Translate Pathfinder node sequence to tijah node sequence" > > -.COMMAND offsetindex( BAT[void,oid] offset_tid, int res_size) > +.COMMAND offsetindex( BAT[void,oid] offset_tid, wrd res_size) > : BAT[void,oid] = CMDoffsetindex; > > "PARAMETERS: > @@ -127,7 +127,7 @@ > creates an offset index. > [...972 lines suppressed...] > BATiter tidprei, tidsizei, oldindexi, oldprei, oldsizei; > oid *s_newindex, *lst_newindex, *s_newpre, *lst_newpre; > @@ -5238,7 +5249,7 @@ > newsize = BATnew(TYPE_void, TYPE_int, ressize); > if (newsize == NULL) > { > - GDKerror("%s: could not allocate a result BAT[void,int] of size %d.\n", name, ressize); > + GDKerror("%s: could not allocate a result BAT[void,int] of size "OIDFMT".\n", name, ressize); > BATfree(res); > BATfree(newpre); > return(GDK_FAIL); > @@ -5248,7 +5259,7 @@ > newindex = BATnew(TYPE_void, TYPE_oid, ressize); > if (newindex == NULL) > { > - GDKerror("%s: could not allocate a result BAT[void,oid] of size %d.\n", name, ressize); > + GDKerror("%s: could not allocate a result BAT[void,oid] of size "OIDFMT".\n", name, ressize); > BATfree(res); > BATfree(newpre); > BATfree(newsize); > > > ------------------------------------------------------------------------------ > The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your > production scanning environment may not be a perfect world - but thanks to > Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 > Series Scanner you'll get full speed at 300 dpi even with all image > processing features enabled. http://p.sf.net/sfu/kodak-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal mal_mapi.mx, , 1.27, 1.28
by Stefan Manegold 12 May '09

12 May '09

On Sun, May 10, 2009 at 06:59:05PM +0000, Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv28294/src/modules/mal > > Modified Files: > mal_mapi.mx > Log Message: > refine protocol v9 to use the hash the server told the client > > The hash algorithm can be chosen at configure time, defaulting to > SHA512, mainly because conversion between hashes is impossible, and this > way we are forward compatible for a long time, by allowing the DBA to > keep on using an older/weaker hash algorithm in favour of dumping and > restoring the database. > > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > !!! TRUNK USERS, BEWARE: !!! > !!! !!! > !!! If you want to keep on using an existing trunk database, you !!! > !!! have to configure MonetDB5 with --with-password-backend=SHA1 !!! > !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! > > > U mal_mapi.mx > Index: mal_mapi.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mal_mapi.mx,v > retrieving revision 1.27 > retrieving revision 1.28 > diff -u -d -r1.27 -r1.28 > --- mal_mapi.mx 6 May 2009 19:59:51 -0000 1.27 > +++ mal_mapi.mx 10 May 2009 18:59:03 -0000 1.28 > @@ -440,16 +440,17 @@ > /* generate the challenge string */ > challenge = alloca(sizeof(char) * (12 + 1)); > generateChallenge(challenge, 8, 12); > - if (AUTHgetHashAlgorithms(&algos) != MAL_SUCCEED) assert (0); > - /* note that we claim to speak proto 9 here for SHA-1 passwords */ > - stream_printf(fdout, "%s:mserver:9:%s:%s", > + assert(AUTHgetHashAlgorithms(&algos) == MAL_SUCCEED); ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ This call will only be executed (and hence variable algos initialized, in case assertions are enabled. Maybe, this is not was you intended... (Assertions are (by default) disabled in released binary distributions and source tarballs.) Stefan > + /* note that we claim to speak proto 9 here for hashed passwords */ > + stream_printf(fdout, "%s:mserver:9:%s:%s:%s:", > challenge, > algos, > #ifdef WORDS_BIGENDIAN > - "BIG" > + "BIG", > #else > - "LIT" > + "LIT", > #endif > + MONETDB5_PASSWDHASH > ); > GDKfree(algos); > stream_flush(fdout); > > > ------------------------------------------------------------------------------ > The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your > production scanning environment may not be a perfect world - but thanks to > Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 > Series Scanner you'll get full speed at 300 dpi even with all image > processing features enabled. http://p.sf.net/sfu/kodak-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] Mapi wire protocol level 9
by Fabian.Groffen＠cwi.nl 11 May '09

11 May '09

Hi, As I'm working on changing the password backend of M5 to use hashes instead of cypher3d clear text passwords[1], I have to bump the wire protocol level from 8 to 9, since the client will have to construct the challenge response differently. Since this is a bump, this is a good time to also incorporate (or prepara) any other changes that we would like to see in the wire protocol for the next feature release. [1] to allow sql to dump users and passwords in a safe manner, the dump needs to be able restore passwords from a hash, which are then stored in the backend. Hence the backend needs to work with those hashes instead of clear text passwords, as it currently does.

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql_user.mx, , 1.42, 1.43
by Stefan de Konink 11 May '09

11 May '09

Fabian wrote: > int len = strlen(passwd); > - if ((ret = AUTHSHA1Sum(&pwd, &passwd, &len)) != MAL_SUCCEED) { > + if ((ret = AUTHBackendSum(&pwd, &passwd, &len)) != MAL_SUCCEED) { A sum of 0 will not work. Stefan

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/include Makefile.ag, , 1.52, 1.53 logdebug.h, , 1.9, 1.10 properties.h, , 1.51, 1.52 xml2lalg.h, , 1.6, 1.7
by Stefan Manegold 07 May '09

07 May '09

Jan, could you please also check in the below included header file "plan_bundle.h" ? Thanks! Stefan On Thu, May 07, 2009 at 08:00:19PM +0000, Jan Rittinger wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/include > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv23317/include > > Modified Files: > Makefile.ag logdebug.h properties.h xml2lalg.h > Log Message: > -- Extend Pathfinder (and the binaries pfopt and pfsql) to cope > with query plan bundles (generated by ferry). Multiple algebraic > plans bundled together form a query with a nested result type. > > We can now import the XML representation of a query plan bundle > and optimize all plans in the bundle. Furthermore we can generate > a DOT, an XML, and a SQL representation of the query plan bundle. > > NOTE: The XML import for 'normal' query plans as well as the code > and output generation still works as before. > > > U xml2lalg.h > Index: xml2lalg.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/include/xml2lalg.h,v > retrieving revision 1.6 > retrieving revision 1.7 > diff -u -d -r1.6 -r1.7 > --- xml2lalg.h 8 Jan 2009 16:54:12 -0000 1.6 > +++ xml2lalg.h 7 May 2009 20:00:16 -0000 1.7 > @@ -39,6 +39,7 @@ > #define XML2ALG_H > > #include "logical.h" > +#include "plan_bundle.h" > > #include "array.h" > > @@ -53,10 +54,10 @@ > XML2LALGContext* > PFxml2la_xml2lalgContext(void); > > -PFla_op_t* > +PFla_pb_t* > PFxml2la_importXMLFromFile(XML2LALGContext* ctx, const char *filename); > > -PFla_op_t* > +PFla_pb_t* > PFxml2la_importXMLFromMemory(XML2LALGContext* ctx, const char* xml, int size); > > #endif > > U logdebug.h > Index: logdebug.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/include/logdebug.h,v > retrieving revision 1.9 > retrieving revision 1.10 > diff -u -d -r1.9 -r1.10 > --- logdebug.h 8 Jan 2009 16:54:12 -0000 1.9 > +++ logdebug.h 7 May 2009 20:00:16 -0000 1.10 > @@ -4,7 +4,7 @@ > * @file > * > * Declarations for logdebug.c; dump Algebra > - * tree in AY&T dot format. > + * tree in AT&T dot or XML format. > * > * > * Copyright Notice: > @@ -43,10 +43,15 @@ > #include <stdio.h> > > #include "logical.h" > +#include "plan_bundle.h" > > void PFla_dot (FILE *, PFla_op_t *, char *prop_args); > void PFla_xml (FILE *, PFla_op_t *, char *prop_args); > > +/* Declaration for debug printing of plan bundles */ > +void PFla_dot_bundle (FILE *, PFla_pb_t *, char *prop_args); > +void PFla_xml_bundle (FILE *, PFla_pb_t *, char *prop_args); > + > #endif /* LOGDEBUG_H */ > > /* vim:set shiftwidth=4 expandtab: */ > > U properties.h > Index: properties.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/include/properties.h,v > retrieving revision 1.51 > retrieving revision 1.52 > diff -u -d -r1.51 -r1.52 > --- properties.h 31 Jan 2009 00:01:15 -0000 1.51 > +++ properties.h 7 May 2009 20:00:16 -0000 1.52 > @@ -374,7 +374,7 @@ > * Write domain-subdomain relationships of property container @a prop > * to in AT&T dot notation to character array @a f. > */ > -void PFprop_write_dom_rel_dot (PFarray_t *f, const PFprop_t *prop); > +void PFprop_write_dom_rel_dot (PFarray_t *f, const PFprop_t *prop, int id); > > /** > * Write domain-subdomain relationships of property container @a prop > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/include/Makefile.ag,v > retrieving revision 1.52 > retrieving revision 1.53 > diff -u -d -r1.52 -r1.53 > --- Makefile.ag 8 Jan 2009 16:54:12 -0000 1.52 > +++ Makefile.ag 7 May 2009 20:00:16 -0000 1.53 > @@ -82,6 +82,7 @@ > physical.h \ > physical_mnemonic.h \ > planner.h \ > + plan_bundle.h \ > prettyp.h \ > properties.h \ > qname.h \ > > > ------------------------------------------------------------------------------ > The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your > production scanning environment may not be a perfect world - but thanks to > Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 > Series Scanner you'll get full speed at 300 dpi even with all image > processing features enabled. http://p.sf.net/sfu/kodak-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Workaround for JDK6 Bug 6795561
by Bram Van Dam 07 May '09

07 May '09

Howdy, When using the MonetDB JDBC driver on JDK6 (or JRE6) > 6.10 you will get IndexOutOfBoundsExceptions when using transactions (possibly in other cases as well). This happens because there is a bug in CharBuffer.subSequence(), which is used in StartOfHeaderParser.java The following patch remedies this problem, without any regressions as far as I can tell. Recompiling the JDBC driver is all that's required. You'll still have to compile with the 1.5 option because the JDBC interface changed quite a bit between 5 and 6, but if I have time left I might fix that as well. Hope this'll help someone. --- MonetDB-java/java/src/nl/cwi/monetdb/mcl/parser/StartOfHeaderParser.java Wed Mar 04 12:21:50 2009 +++ MonetDB-java/java/src/nl/cwi/monetdb/mcl/parser/StartOfHeaderParser.java Thu May 07 11:57:47 2009 @@ -141,8 +141,7 @@ while (soh.hasRemaining() && soh.get() != ' ') { cnt++; } - soh.reset(); - return(soh.subSequence(0, cnt).toString()); + return(soh.slice().subSequence(0, cnt).toString()); } }

3 2

Re: [Monetdb-developers] Compiling pathfinder (Stable) failed on GNU.32.32.d.1-Debian4.0
by Stefan Manegold 07 May '09

07 May '09

On Fri, May 01, 2009 at 05:56:16AM +0200, Testweb Compilation wrote: > from lex.pf.c:19: > /usr/include/features.h:150:1: error: this is the location of the previous definition > make[5]: *** [libparser_la-scanner.yy.lo] Error 1 > > http://www.ins.cwi.nl/~monet/permastore/2009-05-01/Stable/make-pathfinder-G… > > CVS committers: fabian(a)cwi.nl manegold(a)cwi.nl > > module maintainers: lsidir(a)cwi.nl zhang(a)cwi.nl henning(a)cwi.nl The problem here is that in pathfinder, pf_config.h is in most C files (possibly at least all C files in pathfinder/compiler/ not included directly, but via pathfinder/compilier/include/pathfinder.h . Hence, our "trick" in buildtools/conf/rules.mk, to push the inclusion of pf_config.h (also) for flex, bison, swig, etc. -generated C files to the veru front of the file, does not work properly, i.e., pf_config.h get includes twice, once "forced" directly at the beginning of the (generated) C file, and once via pathfinder.h . I see three solutions: 1) Remove '#include "pf_config.h"' from pathfinder/compilier/include/pathfinder.h and add '#include "pf_config.h"' as first include in all source files in pathfinder// (e.g., just before the existing '#include "pathfinder.h"'. 2) Make buildtools/conf/rules.mk, aware of pathfinder.h and handle is just like $(CONFIG_H) 3) (Try to) make bootstrap (i.e., auto*) a conf/config.h.in (or make configure create the <pkg>_config.h from conf/config.h.in) in such a way that it is resistent against multiple inclusion, e.g., using the usual #ifndef #define ... #endif mechanism. I have a strong preference for solution one, as that is what we do the the remainder of the code base. Any comments? Any volunteers? Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal remote.mx, , 1.95, 1.96
by Sjoerd Mullender 07 May '09

07 May '09

Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv8081 > > Modified Files: > remote.mx > Log Message: > remote - simplified the RMT connection setup > in RMTquery first check for connnection errors, otherwise the handler > seems rubish. Question, is mapi_query() thread safe? I seriously doubt it. Use multiple connection handles if you want to use multiple threads. We could look into thread safety in mapilib sometime. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal pcre.mx, , 1.77, 1.78
by Stefan Manegold 06 May '09

06 May '09

Peter, I do not like this change very much. To ensure portability, we require that <PKG>_config.h (here: mal_config.h) is the very first include in each C file. Moving '#include "mal_config.h"' behind '#include "mal_config.h"' might cause unintended/unexpected problems now or in the future on other systems than Red Hat 4.3.2-7. Likewise, a hardwired and unconditional '#define _GNU_SOURCE 1' will not work on all systems. If Red Hat 4.3.2-7 indeed needs some special treatment, we should better try to fix our configure script(s) accordingly than have these hardcode fixes in the code itself. Stefan On Wed, May 06, 2009 at 01:10:59PM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv1809 > > Modified Files: > pcre.mx > Log Message: > make it compile on Red Hat 4.3.2-7 > > > > U pcre.mx > Index: pcre.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/pcre.mx,v > retrieving revision 1.77 > retrieving revision 1.78 > diff -u -d -r1.77 -r1.78 > --- pcre.mx 4 May 2009 13:53:25 -0000 1.77 > +++ pcre.mx 6 May 2009 13:10:53 -0000 1.78 > @@ -123,9 +123,10 @@ > @+ Implementation > @include prelude.mx > @c > -#include "mal_config.h" > +#define _GNU_SOURCE 1 > #include <string.h> > > +#include "mal_config.h" > #include "mal.h" > #include "mal_exception.h" > > @@ -142,6 +143,7 @@ > > #include <pcre.h> > > + > pcre_export str PCREquote(str *r, str *v); > pcre_export str PCREselect(int *res, str *pattern, int *bid); > pcre_export str PCREuselect(int *res, str *pattern, int *bid); > > > ------------------------------------------------------------------------------ > The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your > production scanning environment may not be a perfect world - but thanks to > Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 > Series Scanner you'll get full speed at 300 dpi even with all image > processing features enabled. http://p.sf.net/sfu/kodak-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 1

[Monetdb-developers] removing a BAT from C for real
by Fabian Groffen 05 May '09

05 May '09

Can someone tell me how to remove a BAT in MonetDB from C code for good and for REAL? I'll probably miss something trivial, as I tried about 20 combinations of how to get rid of a previously persistent BAT, but everytime I restart my server it comes back again like a BIOS virus. Place in the source: monetdb5/src/mal/mal_authorize.mx, I want to remove an old M5system_auth_* BAT after I created a new one with converted data in the initTables function. My latest incarnation looks like this (copied and pasted from destroyImmediate): BBPlogical(b->batCacheid, buf); BBPreleaseref(b->batCacheid); BBPfix(bid); if (BBPindex(buf) == bid) { BAT *t = (BAT*)BBPgetdesc(ABS(bid)); BATmode(t, TRANSIENT); } BBPunfix(bid); said BAT looks gone in the session, but returns next time the server starts. Can I (sub)commit the removed BAT? Any hint on this strong persistence would be nice.

1 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal remote.mx, , 1.96, 1.97
by Martin Kersten 05 May '09

05 May '09

Fabian Groffen wrote: > On 05-05-2009 12:31:13 +0000, Martin Kersten wrote: >> - if (mapi_error(conn) != MOK) >> + if (mapi_error(conn) != MOK){ >> + mapi_explain(conn,stderr); > > better ifdef such statements IMO... # MonetDB/SQL module v2.29.0 loaded [ 0 ] [ 1 ] [ 2 ] [ 3 ] [ 4 ] [ 5 ] [ 6 ] MAPI = monetdb@127.0.0.1:50000 REMOTE GET error: io.print(rmt_octopus_exec__9_bat__oid__int_); IOException:remote.get:an error occurred on connection: (null) !MALException:remote.get:IOException:remote.get:an error occurred on connection: (null) Dit is wat er dus gebeurd in RMTget -> RMTquery is herhaalbaar, maar in iedergeval een gevolg van parallel processing, onduidelijk waarom de connectie er al uitgaat. > > > ------------------------------------------------------------------------------ > The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your > production scanning environment may not be a perfect world - but thanks to > Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 > Series Scanner you'll get full speed at 300 dpi even with all image > processing features enabled. http://p.sf.net/sfu/kodak-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal remote.mx, , 1.96, 1.97
by Martin Kersten 05 May '09

05 May '09

Fabian Groffen wrote: > On 05-05-2009 12:31:13 +0000, Martin Kersten wrote: >> - if (mapi_error(conn) != MOK) >> + if (mapi_error(conn) != MOK){ >> + mapi_explain(conn,stderr); > > better ifdef such statements IMO... ja..... probeer die race conditie te pinnen.... :(( > > > ------------------------------------------------------------------------------ > The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your > production scanning environment may not be a perfect world - but thanks to > Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700 > Series Scanner you'll get full speed at 300 dpi even with all image > processing features enabled. http://p.sf.net/sfu/kodak-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

[Monetdb-developers] MonetDB on Darwin/ARM
by Stefan de Konink 04 May '09

04 May '09

With a bit of hacking in the C compiler, and doing a variety of --enable-shared vs --disabled-shared I am able to come up to this point: iPod-van-Stefan-de-Konink:/Applications/MonetDB.app/bin root# ./mserver5 !ERROR: BBPdiskscan: stat(bat/)!OS: No such file or directory !ERROR: BBPdiskscan: stat(bat/)!OS: No such file or directory !ERROR: BBPdiskscan: stat(bat/)!OS: No such file or directory # MonetDB server v5.11.0, based on kernel v1.29.0 # Serving database 'demo', using 1 thread # Compiled for arm-apple-darwin/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /Applications/MonetDB.app/etc/monetdb5.conf) !ERROR: GDKremovedir: rmdir(bat/DELETE_ME) failed. !OS: Directory not empty !ERROR: GDKremovedir: rmdir(bat/DELETE_ME) failed. !OS: Directory not empty !ERROR: BBPsync: rename(bat/BACKUP/SUBCOMMIT,bat/DELETE_ME) failed. #WARNING: LoaderException:loadLibrary:mmath: loader error dlopen(/Applications/MonetDB.app/lib/MonetDB5/lib/lib_mmath.dylib, 10): Symbol not found: ___fpclassifyd Referenced from: /Applications/MonetDB.app/lib/MonetDB5/lib/lib_mmath.dylib Expected in: flat namespace #WARNING: LoaderException:loadLibrary:optimizer: file not found #WARNING: LoaderException:loadLibrary:run_isolate: file not found #WARNING: LoaderException:loadLibrary:run_memo: file not found #WARNING: LoaderException:loadLibrary:run_octopus: file not found #WARNING: LoaderException:loadLibrary:mmath: loader error dlopen(/Applications/MonetDB.app/lib/MonetDB5/lib/lib_mmath.dylib, 10): Symbol not found: ___fpclassifyd Referenced from: /Applications/MonetDB.app/lib/MonetDB5/lib/lib_mmath.dylib Expected in: flat namespace # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ Bus error All this was compiled using a cross compiler, because I didn't trust gdkscanselect compiling to the device. If someone sees from the above output where I should start looking, I'm happy to take a peak there, my guess is some chdir gets wrong. I was a bit minimalistic with compiling; but mclient works ;) [without readline] iPod-van-Stefan-de-Konink:/Applications/MonetDB.app/bin root# ./mclient -lsql -h 192.168.1.2 select * from tables; % .tables, .tables, .tables, .tables, .tables, .tables, .tables, .tables # table_name % id, name, schema_id, query, type, system, commit_action, temporary # name % int, varchar, int, varchar, smallint, boolean, smallint, tinyint # type % 4, 29, 4, 168, 1, 5, 1, 1 # length [ 1062, "schemas", 1061, NULL, 0, true, 0, 0 ] [ 1067, "types", 1061, NULL, 0, true, 0, 0 ] [ 1076, "functions", 1061, NULL, 0, true, 0, 0 ] [ 1085, "args", 1061, NULL, 0, true, 0, 0 ] ..... Stefan

4 9

Re: [Monetdb-developers] ! Testing 'Current' sql: Results DIFFER from 2009.04.26_08-58-59's !
by Stefan Manegold 01 May '09

01 May '09

FYI: these tests seem to fail since Mon, Apr 27, 2009, i.e., after checkins on Sun, Apr 26, 2009, most probably because since then, mserver5 quits instantly after processing a MAL file given on the commandline: $ cat /tmp/x.mal io.print(123); $ mserver5 /tmp/x.mal ; echo $? # MonetDB server v5.11.0, based on kernel v1.29.0 # Serving database 'demo', using 4 threads # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-optimize_--enable-debug_--enable-assert/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ function user.main():void; io.print(123); end main; [ 123 ] 0 $ Stefan On Mon, Apr 27, 2009 at 02:05:16PM +0200, Project account wrote: > Testing results of sql in /ufs/monet/Testing/Current DIFFER from those of 2009.04.26_08-58-59 ! > > Summary: > ======== > > !! 893 Tests are WORSE than before !! > > * 514 Tests ran better than before > > * 7 Systems still don't produce output > * 4 New tests > > * Results for 4 new tests > - No output for 28 tests > - Failed output for 28 tests > > * 95 Tests still don't run > * 786 Tests still fail > * 11 Tests still timeout > * 2 Tests still have minor differences > > > Maybe YOUR checkins since 26.04.2009, 08:58:59 caused some of the problems: > > buildtools > MonetDB > testing manegold(a)cwi.nl > java > clients manegold(a)cwi.nl > MonetDB4 > MonetDB5 mk(a)cwi.nl > sql manegold(a)cwi.nl mk(a)cwi.nl > > Check http://monetdb.cwi.nl/Development/TestWeb/Current/sql/ for details ! > > > Details: > ======== > > 893 Tests are WORSE than before: > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > 80 different tests > 14 different systems > > F10 G32/32d1 72 tests > D9.6.0 G64/64d1 65 tests > D4.0 G32/32d1 64 tests > F10 G64/64d1 64 tests > F8 G64/64d0 64 tests > F8 G64/64d1 64 tests > F8 I64/64d1 64 tests > D9.6.0 G32/32d1 63 tests > G2.0.0 G64/64d1 63 tests > S5.11 G32/32d1 63 tests > W5.2 I64/64d1 63 tests > F8 I64/32d1 62 tests > W5.1 I32/32d1 62 tests > F8 G64/32d1 60 tests > > 59 tests are WORSE than before on 14 systems > 1 test is WORSE than before on 13 systems > 2 tests are WORSE than before on 12 systems > 1 test is WORSE than before on 11 systems > 2 tests are WORSE than before on 2 systems > 15 tests are WORSE than before on 1 system > > o o X X D4.0 G32/32d1 src/benchmarks/ATIS/load > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/ATIS/select_distinct > o o X X D9.6.0 G32/32d1 > X o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > X o X X F10 G64/64d1 > X o X X F8 G64/32d1 > X o X X F8 G64/64d0 > X o X X F8 G64/64d1 > X o X X F8 I64/32d1 > X o X X F8 I64/64d1 > X o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/ATIS/select_join > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/ATIS/select_key_prefix_join > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/ATIS/select_simple_join > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/01 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/02 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/03 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/04 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/05 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/06 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/07 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/08 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/09 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/10 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/11 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/12 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/13 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/14 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/15 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/16 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/17 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/18 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/20 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/21 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/25 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/26 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/31 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/32 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/36 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/37 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/41 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/42 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/47 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/48 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/52 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/53 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/57 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/58 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/62 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/63 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/67 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/68 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/72 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/73 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/77 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/78 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/82 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/83 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/87 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/88 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/check1 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/arno/insert_ATOM > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/arno/insert_BOND > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/benchmarks/arno/queries_depth2 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G32/32d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > o o X o W5.1 I32/32d1 > o o X o W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/arno_flt/init > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/moa/load > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/wisconsin/load > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/32d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/32d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/wisconsin/wisconsin-update > o o X X D9.6.0 G32/32d1 > X o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > X o X X F10 G64/64d1 > X o X X F8 G64/32d1 > X o X X F8 G64/64d0 > X o X X F8 G64/64d1 > X o X X F8 I64/32d1 > X o X X F8 I64/64d1 > X o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/ATIS/select_group > o o X X D9.6.0 G32/32d1 > X o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > X o X X F10 G64/64d1 > X o X X F8 G64/64d0 > X o X X F8 G64/64d1 > X o X X F8 I64/32d1 > X o X X F8 I64/64d1 > X o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/moa/moa_ordered > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X X D4.0 G32/32d1 src/benchmarks/wisconsin/wisconsin-select > o o X X D9.6.0 G32/32d1 > o o X X D9.6.0 G64/64d1 > o o X X F10 G32/32d1 > o o X X F10 G64/64d1 > o o X X F8 G64/64d0 > o o X X F8 G64/64d1 > o o X X F8 I64/64d1 > o o X X G2.0.0 G64/64d1 > o o X X S5.11 G32/32d1 > o o X X W5.1 I32/32d1 > o o X X W5.2 I64/64d1 > o o X o D4.0 G32/32d1 src/test/BugTracker-2009/set_history_and_drop_table.SF-2607045 > o o X o D9.6.0 G32/32d1 > o o X o D9.6.0 G64/64d1 > o o X o F10 G64/64d1 > o o X o F8 G64/32d1 > o o X o F8 G64/64d0 > o o X o F8 G64/64d1 > o o X o F8 I64/32d1 > o o X o F8 I64/64d1 > o o X o G2.0.0 G64/64d1 > o o X o S5.11 G32/32d1 > X T X X D4.0 G32/32d1 src/test/BugTracker/jdbc_no_debug.SF-1739356 > - - --- F10 G32/32d1 > X o X X D9.6.0 G64/64d1 src/test/VOC/VOC > - - --- F10 G32/32d1 > X o X X F10 G64/64d1 src/benchmarks/tpch/01-22 > o o o S F8 G64/64d1 src/test/BugDay_2005-10-06_2.9.3/CrashMe_SQL_server_crash-2.SF-921673 > - - --- F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/alter_table_describe.SF-1146092 > - - --- F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/not_null.SF-933194 > - - --- F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/type_dump_test.SF-989257 > o o o X D9.6.0 G64/64d1 src/test/BugTracker-2009/segfault_when_quitting_debugger.SF-2538837 > - - --- F10 G32/32d1 src/test/BugTracker/authorization.SF-1430616 > - - --- F10 G32/32d1 src/test/BugTracker/drop_schema_crash.SF-1504794 > - - --- F10 G32/32d1 src/test/BugTracker/explain.SF-1739353 > X o X T W5.2 I64/64d1 src/test/BugTracker/mdb_starts_with_sql_debug_64.SF-1999354 > o X X X F8 G64/64d0 src/test/Skyserver/Skyserver > X T X X F8 I64/32d1 src/test/Skyserver/Skyserver_v6 > - - --- F10 G32/32d1 src/test/bugs/except-union-intersect-bug-sf-1146079 > - - --- F10 G32/32d1 src/test/bugs/unicode_varchar-bug-sf-1041324_JdbcClient > o o o S F8 I64/64d1 src/test/mapi/smack01 > > > 514 Tests ran better than before: > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > 500 different tests > 13 different systems > > F10 G32/32d1 499 tests > F8 G64/32d1 2 tests > F8 G64/64d1 2 tests > F8 I64/32d1 2 tests > D4.0 G32/32d1 1 test > D9.6.0 G32/32d1 1 test > D9.6.0 G64/64d1 1 test > F10 G64/64d1 1 test > F8 G64/64d0 1 test > F8 I64/64d1 1 test > G2.0.0 G64/64d1 1 test > S5.11 G32/32d1 1 test > W5.1 I32/32d1 1 test > > 1 test ran better than before on 9 systems > 1 test ran better than before on 3 systems > 4 tests ran better than before on 2 systems > 494 tests ran better than before on 1 system > > X X X o D9.6.0 G64/64d1 src/test/octopus/squid00 > - - X o F10 G32/32d1 > X X X o F10 G64/64d1 > X X X o F8 G64/32d1 > X X X o F8 G64/64d0 > X X X o F8 G64/64d1 > X X X o F8 I64/32d1 > X X X o F8 I64/64d1 > X X X o G2.0.0 G64/64d1 > - - X X F10 G32/32d1 src/test/Skyserver/Skyserver > X X o X F8 G64/64d1 > X X o X F8 I64/32d1 > - - X o F10 G32/32d1 src/test/BugTracker-2009/AVG_of_SQRT.SF-2757642.test > X T X o S5.11 G32/32d1 > - - o o F10 G32/32d1 src/test/BugTracker-2009/AVG_of_SQRT.SF-2757642.unpack_csv > X T o o W5.1 I32/32d1 > X T X o D4.0 G32/32d1 src/test/BugTracker-2009/parallel_bulk-load.SF-2771052.test > - - X o F10 G32/32d1 > - - X X F10 G32/32d1 src/test/Skyserver/Skyserver_v6 > X X X T F8 G64/32d1 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/BATpropcheck_error.SF-1012739 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/affected_rows_count.SF-1149757 > - - o T F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/bad_sql_logdir.SF-927371 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/bool_boolean.SF-935601 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/case.SF-929151 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/cast_to_interval.SF-1019079 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/comment_only.SF-931619 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/create_drop_schema.SF-933546 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/create_table_default.SF-931573 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/create_view_with_check_options.SF-1314951 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/cross_product.SF-1122802 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/custom_function_in_where.SF-937859 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/div_by_zero.SF-987304 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/drop_index.SF-929243 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/error_in_sql_parser.SF-1019122 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/fk_without_notnull_constraint.SF-1016842 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/foreign_key_in_frontend_crashes_backend.SF-935578 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/foreign_key_null.SF-1164646 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/max_min_sum_null.SF-1123132 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/multiple_select_cast.SF-938419 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/multiple_select_on_view.SF-935639 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/reserved_words.SF-939112 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/select_not_true.SF-1314945 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/sesamstr_parser_error.SF-993366 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/set_types.SF-932360 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/simple_union.SF-1005596 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/singleton_view.SF-933573 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/slow_counting_1.SF-923709 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/slow_counting_2.SF-923709 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/string2float_coercions.SF-928850 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/var_char_cast_truncate.SF-1150907 > - - o o F10 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/view_on_deleted_table.SF-938583 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.8/ORDER_BY_evaluation_error.SF-1023658 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.8/crash_in_case.SF-1097749 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.8/crash_with_wrong_nesting.SF-1097883 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.8/delete_with_auto_commit.SF-1096337 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.8/insert_from_no-existing_tables.SF-1037020 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.8/overflow_checking.SF-1089334 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.8/updating_views.SF-1023645 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/alias_union_join.SF-1063089 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/alter_table.SF-1040057 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/date_functions.SF-967145 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/delete_x_2.SF-1082915 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/drop_column_alter_table.SF-1114557 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/empty_avg.SF-1207887 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/grant_public.SF-1114580 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/hang_on_copy_into.SF-1100504 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/having_clause_quirks.SF-947601 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/history_table_escape.SF-1072089 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/integer_overflow.SF-1048671 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/interval_on_time_stamp.SF-1080488 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/like_doesnot_like_strings.SF-1076605 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/or_select.SF-1114540 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/phantom_rows.SF-1044534 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/schema_change.SF-1026845 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/schema_change_grant_crash.SF-963620 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/sql_server_abort.SF-1080025 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/sql_server_crash.SF-1080024 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/union-duplicates.SF-1119186 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/updates_got_lost.SF-1119178 > - - o o F10 G32/32d1 src/test/BugDay_2005-11-09_2.9.3/varchar_length_calculation.SF-1028461 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/NULL_in_CASE.SF-1211335 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/aggregate_functions_with_limit.SF-1367127 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/bogus_prepare.SF-1377079 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/cast_bigint_to_int.SF-1211903 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/cast_interval.SF.1280682 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/crash_on_incorrect_SQL.SF-1314904 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/default_next_value_for_non_ex_seq.SF.1246631 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/delete_cascade.SF-1296395 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/delete_where_1_equals_1.SF-1240162 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/in_operator.SF-1211925 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/interval_times_int.SF-1281996 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/prepare-where.SF-1238867.1238959.1238965.1240124 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/prepare_doesnot_like_LIKE.SF-1234205 > - - X X F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/select_from_env.SF-1240701.1242164 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/subquery_syntax.SF-1296390 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/timestamp_fraction.SF-1357342 > - - o o F10 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/weird_reponse_on_limit.SF-1314643 > - - o o F10 G32/32d1 src/test/BugTracker-2008/About_CHAR.SF-2075268 > - - o o F10 G32/32d1 src/test/BugTracker-2008/OOM_query.SF-2457195 > - - o o F10 G32/32d1 src/test/BugTracker-2008/aborting_process.SF-2130710 > - - o o F10 G32/32d1 src/test/BugTracker-2008/alter_add_constraint_should_check_existing_data.SF-2075241 > - - o o F10 G32/32d1 src/test/BugTracker-2008/alter_view_not_allowed.SF-2075195 > - - o o F10 G32/32d1 src/test/BugTracker-2008/auto_coersion_bug.SF-2075157 > - - o o F10 G32/32d1 src/test/BugTracker-2008/between_no_columns.SF2102101 > - - o o F10 G32/32d1 src/test/BugTracker-2008/blob_insert_crash.SF-2388542 > - - o o F10 G32/32d1 src/test/BugTracker-2008/col_from_another_inside_function_body.SF-2420768 > - - o o F10 G32/32d1 src/test/BugTracker-2008/constraint_with_schemas.SF-2080219 > - - o o F10 G32/32d1 src/test/BugTracker-2008/copy-count.SF-2485215 > - - o o F10 G32/32d1 src/test/BugTracker-2008/copy-format.SF-2468513 > - - o o F10 G32/32d1 src/test/BugTracker-2008/correlated_exists.SF-2075147 > - - o o F10 G32/32d1 src/test/BugTracker-2008/count_with_order_by_and_limit_crashes.SF-2229936 > - - o o F10 G32/32d1 src/test/BugTracker-2008/decimal_cast_in_view.SF-2075223 > - - o o F10 G32/32d1 src/test/BugTracker-2008/extract_bug.SF-2075266 > - - o o F10 G32/32d1 src/test/BugTracker-2008/group_by_in_subquery_fails.SF-2219131 > - - o o F10 G32/32d1 src/test/BugTracker-2008/groupby_with_NULL.SF-2155606 > - - o o F10 G32/32d1 src/test/BugTracker-2008/incorrect_default_value_inserted.SF-2075075 > - - o o F10 G32/32d1 src/test/BugTracker-2008/insert-null-byte.SF-2233581 > - - o o F10 G32/32d1 src/test/BugTracker-2008/insert_decimal_into_int.SF-2075104 > - - o o F10 G32/32d1 src/test/BugTracker-2008/insert_into_unique_column.SF-2075180 > - - o o F10 G32/32d1 src/test/BugTracker-2008/invalid_qualified_column_name.SF-2183288 > - - o o F10 G32/32d1 src/test/BugTracker-2008/is_distinct_broken.SF-2430201 > - - o o F10 G32/32d1 src/test/BugTracker-2008/mul_div_bug.SF-2075135 > - - o o F10 G32/32d1 src/test/BugTracker-2008/select_between_wrong_result.SF-2080189 > - - o o F10 G32/32d1 src/test/BugTracker-2008/select_in_wrong_result.SF-2080168 > - - o o F10 G32/32d1 src/test/BugTracker-2008/select_not_wrong_result.SF-2080151 > - - o o F10 G32/32d1 src/test/BugTracker-2008/server_aborts_on_nested_query_without_from_in_subquery.SF-2183292 > - - o o F10 G32/32d1 src/test/BugTracker-2008/sql_command_kills_db.SF-2233677 > - - o o F10 G32/32d1 src/test/BugTracker-2008/string_length_not_checked.SF-2075078 > - - o o F10 G32/32d1 src/test/BugTracker-2008/subselect_with_or.SF-2466725 > - - o o F10 G32/32d1 src/test/BugTracker-2008/table_update.SF-2080207 > - - o o F10 G32/32d1 src/test/BugTracker-2008/too_may_nested_operators.SF-2102167 > - - o o F10 G32/32d1 src/test/BugTracker-2008/update_error.SF-2254506 > - - o o F10 G32/32d1 src/test/BugTracker-2008/update_set_negative.SF-2075197 > - - o o F10 G32/32d1 src/test/BugTracker-2008/varchar.SF-2471371 > - - o o F10 G32/32d1 src/test/BugTracker-2008/varchar_char_semantics.SF-2075085 > - - o o F10 G32/32d1 src/test/BugTracker-2008/view_reply_incorrect.SF-2075097 > - - o o F10 G32/32d1 src/test/BugTracker-2008/year_overflow_bug.SF-2075133 > - - o o F10 G32/32d1 src/test/BugTracker-2009/AVG_ReturnsNoLines.SF-2596084 > - - o o F10 G32/32d1 src/test/BugTracker-2009/COPY_INTO_char_NULL.SF-2560780 > - - o o F10 G32/32d1 src/test/BugTracker-2009/IS_NULL_in_CASE > - - o o F10 G32/32d1 src/test/BugTracker-2009/LE_vs_GE_in_CASE.SF-2562264 > - - X o F10 G32/32d1 src/test/BugTracker-2009/POWER_vs_prod.SF-2596114 > - - X o F10 G32/32d1 src/test/BugTracker-2009/TribooleanFailureWithSubquery.SF-2679434 > - - o o F10 G32/32d1 src/test/BugTracker-2009/TypeException_having_count_distinct.SF-2494227 > - - o o F10 G32/32d1 src/test/BugTracker-2009/ambiguous_view > - - o o F10 G32/32d1 src/test/BugTracker-2009/avg-bug.SF-2132666 > - - o o F10 G32/32d1 src/test/BugTracker-2009/binop.SF.2499537 > - - o o F10 G32/32d1 src/test/BugTracker-2009/bool-str-bug > - - o o F10 G32/32d1 src/test/BugTracker-2009/cardinality_of_expression_is_wrong.SF-2581617 > - - o o F10 G32/32d1 src/test/BugTracker-2009/caselessthen > - - o o F10 G32/32d1 src/test/BugTracker-2009/coercion > - - o o F10 G32/32d1 src/test/BugTracker-2009/correlated-selection-bug > - - o o F10 G32/32d1 src/test/BugTracker-2009/count_bug.SF-2604583 > - - o o F10 G32/32d1 src/test/BugTracker-2009/decimal_needs_truncation.SF-2605686 > - - o o F10 G32/32d1 src/test/BugTracker-2009/distinct.SF-2546483 > - - o o F10 G32/32d1 src/test/BugTracker-2009/error_while_drop_func_returns_table_type.SF-2604573 > - - o o F10 G32/32d1 src/test/BugTracker-2009/having_or_bug > - - o o F10 G32/32d1 src/test/BugTracker-2009/incomplete.SF.2536893 > - - o o F10 G32/32d1 src/test/BugTracker-2009/insert_into_done_by_procedure.SF-2607293 > - - o o F10 G32/32d1 src/test/BugTracker-2009/insert_order_by.SF-2658243 > - - o o F10 G32/32d1 src/test/BugTracker-2009/join_topn.SF-2654133 > - - o o F10 G32/32d1 src/test/BugTracker-2009/limit_in_subquery.SF-2620437 > - - o o F10 G32/32d1 src/test/BugTracker-2009/lookup_column_name_bug_1.SF-2654300 > - - o o F10 G32/32d1 src/test/BugTracker-2009/lookup_column_name_bug_2.SF-2656762 > - - o o F10 G32/32d1 src/test/BugTracker-2009/missing_column_name.SF-2776100 > - - o o F10 G32/32d1 src/test/BugTracker-2009/not_equal.SF-2678502 > - - o o F10 G32/32d1 src/test/BugTracker-2009/nullstr.SF-2704016 > - - o o F10 G32/32d1 src/test/BugTracker-2009/number_between_col1_and_col2 > - - o o F10 G32/32d1 src/test/BugTracker-2009/order_by_column_position > - - o o F10 G32/32d1 src/test/BugTracker-2009/order_by_column_position_rel_name_bug > - - o o F10 G32/32d1 src/test/BugTracker-2009/parallel_bulk-load.SF-2771052.unpack_csv > - - o o F10 G32/32d1 src/test/BugTracker-2009/push-select-div-down.SF-2593341 > - - o o F10 G32/32d1 src/test/BugTracker-2009/push_select_down_crash > - - o o F10 G32/32d1 src/test/BugTracker-2009/rollback_bug > - - o o F10 G32/32d1 src/test/BugTracker-2009/row_number_bug.SF-2546109 > - - o o F10 G32/32d1 src/test/BugTracker-2009/segfault_when_quitting_debugger.SF-2538837 > - - o o F10 G32/32d1 src/test/BugTracker-2009/select_from_history.SF-2556566 > - - o o F10 G32/32d1 src/test/BugTracker-2009/serial_with_order_by_not_working.SF-2585592 > - - X o F10 G32/32d1 src/test/BugTracker-2009/set_history_and_drop_table.SF-2607045 > - - o o F10 G32/32d1 src/test/BugTracker-2009/subquery_returns_table_crash.SF-2513620 > - - o o F10 G32/32d1 src/test/BugTracker-2009/subtraction_between_two_columns.SF-2582389 > - - o o F10 G32/32d1 src/test/BugTracker-2009/union_leak.SF-2540169 > - - o o F10 G32/32d1 src/test/BugTracker-2009/update-crash > - - o o F10 G32/32d1 src/test/BugTracker-2009/wrong_error_message.SF-2637051 > - - o o F10 G32/32d1 src/test/BugTracker/BETWEEN_error.SF-1911991 > - - o o F10 G32/32d1 src/test/BugTracker/add_and_drop_the_same_constraint.SF-1850789 > - - o o F10 G32/32d1 src/test/BugTracker/alter-default.SF-1695290 > - - o o F10 G32/32d1 src/test/BugTracker/alter_col_to_set_same_constraint.SF-1850781 > - - o o F10 G32/32d1 src/test/BugTracker/alter_table_add_fkey.SF-1737668 > - - o o F10 G32/32d1 src/test/BugTracker/alter_table_set_not_null.SF-1997030 > - - o o F10 G32/32d1 src/test/BugTracker/ambiguous_join.SF-1580565 > - - o o F10 G32/32d1 src/test/BugTracker/assert_fails_on_algebra_version.SF-2019349 > - - o o F10 G32/32d1 src/test/BugTracker/auto_commit.SF-1724151 > - - o o F10 G32/32d1 src/test/BugTracker/auto_increment.SF-1834820 > - - o o F10 G32/32d1 src/test/BugTracker/bat_descriptor_problem.SF-1997643 > - - o o F10 G32/32d1 src/test/BugTracker/between_having_problem.SF-1959391 > - - o o F10 G32/32d1 src/test/BugTracker/between_on_strings.SF-2021508 > - - o o F10 G32/32d1 src/test/BugTracker/between_with_column.SF-1959410 > - - o o F10 G32/32d1 src/test/BugTracker/bind_with_cast.SF-1720934 > - - o o F10 G32/32d1 src/test/BugTracker/blob_corner_cases.SF-1613902 > - - o o F10 G32/32d1 src/test/BugTracker/broken_join.SF-1373391 > - - o o F10 G32/32d1 src/test/BugTracker/bug_in_selection.SF-1892413 > - - o o F10 G32/32d1 src/test/BugTracker/cache > - - o o F10 G32/32d1 src/test/BugTracker/caching.SF-1651599 > - - o X F10 G32/32d1 src/test/BugTracker/cardinality_violation.SF-1240701 > - - o o F10 G32/32d1 src/test/BugTracker/cascade_operations_in_different_sessions.SF-1823387_create > - - o o F10 G32/32d1 src/test/BugTracker/cascade_operations_in_different_sessions.SF-1823387_drop > - - o o F10 G32/32d1 src/test/BugTracker/case_in_aggr_bug.SF-1506545 > - - o o F10 G32/32d1 src/test/BugTracker/case_with_aggr.SF-1876779 > - - o o F10 G32/32d1 src/test/BugTracker/cast_interval2time.SF-1488247 > - - o o F10 G32/32d1 src/test/BugTracker/coalesce_equal_coalesce.SF-1907905 > - - o o F10 G32/32d1 src/test/BugTracker/connect_crash.SF-1436626 > - - o o F10 G32/32d1 src/test/BugTracker/convert_dec2varchar.SF-1774312 > - - o o F10 G32/32d1 src/test/BugTracker/convert_dec2varchar_crash.SF-1775550 > - - o o F10 G32/32d1 src/test/BugTracker/copy_decimal.SF-1582957 > - - o o F10 G32/32d1 src/test/BugTracker/copy_into_crash.SF-1993999 > - - o o F10 G32/32d1 src/test/BugTracker/copy_overflow_null_bug.SF-1842550 > - - o o F10 G32/32d1 src/test/BugTracker/count_crash.SF-1918780 > - - o o F10 G32/32d1 src/test/BugTracker/crash_on_cast.SF-1357271 > - - o o F10 G32/32d1 src/test/BugTracker/crash_on_delete.SF-1639108 > - - o o F10 G32/32d1 src/test/BugTracker/crash_on_delete.SF-1651567 > - - o o F10 G32/32d1 src/test/BugTracker/crash_on_fkey_update.SF-1703497 > - - o o F10 G32/32d1 src/test/BugTracker/crash_on_fkey_update2.SF-1703497 > - - o o F10 G32/32d1 src/test/BugTracker/crash_on_insert.SF-1639113 > - - o o F10 G32/32d1 src/test/BugTracker/create_column.SF-1643542 > - - o o F10 G32/32d1 src/test/BugTracker/create_column_name_data.SF-1440214 > - - o o F10 G32/32d1 src/test/BugTracker/create_same_temp_tab_after_its_drop.SF-1850809 > - - o o F10 G32/32d1 src/test/BugTracker/create_table_with_data.SF-1715679 > - - o o F10 G32/32d1 src/test/BugTracker/creation_of_exeception_for_select.SF-1841749 > - - o o F10 G32/32d1 src/test/BugTracker/decimal.SF-1718253 > - - o o F10 G32/32d1 src/test/BugTracker/decimal_prepare.SF-1655818 > - - o o F10 G32/32d1 src/test/BugTracker/decl_sec_tab_in_func_body.SF-1907858 > - - o o F10 G32/32d1 src/test/BugTracker/drop_function.SF-1910396 > - - o o F10 G32/32d1 src/test/BugTracker/drop_sequence_crash.SF-1505973 > - - o o F10 G32/32d1 src/test/BugTracker/drop_sequence_crash_2.SF-1505973 > - - o o F10 G32/32d1 src/test/BugTracker/drop_system_tables.SF-1550768 > - - o o F10 G32/32d1 src/test/BugTracker/full_join_crash.SF-1841754 > - - o o F10 G32/32d1 src/test/BugTracker/groupby_orderby_nonselected.SF-1723863 > - - o o F10 G32/32d1 src/test/BugTracker/groupby_with_alias.SF-1520575 > - - o o F10 G32/32d1 src/test/BugTracker/huge_math_expre.SF-1907048 > - - o o F10 G32/32d1 src/test/BugTracker/insert_date.SF-1838785 > - - o o F10 G32/32d1 src/test/BugTracker/insert_not_exists.SF-1380287 > - - o o F10 G32/32d1 src/test/BugTracker/insert_text_with_repeat.SF-1841759 > - - o o F10 G32/32d1 src/test/BugTracker/insert_values.SF-1578838 > - - o o F10 G32/32d1 src/test/BugTracker/inserting_invalid_timestamp.SF-1363557 > - - o o F10 G32/32d1 src/test/BugTracker/intersect_in_subquery.SF-1339411 > - - o o F10 G32/32d1 src/test/BugTracker/is_not_null_syntax_error.SF-1959456 > - - o o F10 G32/32d1 src/test/BugTracker/join_table_with_floats.SF-1907060 > - - o o F10 G32/32d1 src/test/BugTracker/large_prepare.SF-1363729 > - - o o F10 G32/32d1 src/test/BugTracker/large_prepare_2.SF-1363729 > - - o o F10 G32/32d1 src/test/BugTracker/like_exp.SF-1613949 > - - o o F10 G32/32d1 src/test/BugTracker/like_for_time_values.SF-1715659 > - - o o F10 G32/32d1 src/test/BugTracker/like_join.SF-1684798 > - - o o F10 G32/32d1 src/test/BugTracker/like_perl.SF-1907051 > - - o o F10 G32/32d1 src/test/BugTracker/limit_timestampz.SF-1774217 > - - o o F10 G32/32d1 src/test/BugTracker/limits_of_decimal.SF-1685357 > - - o o F10 G32/32d1 src/test/BugTracker/local_global_temporary_table.SF-1715672 > - - o o F10 G32/32d1 src/test/BugTracker/local_temp_table.SF-1865953 > - - o o F10 G32/32d1 src/test/BugTracker/mapi_connect_errors_vanish.SF-1432134 > - - o o F10 G32/32d1 src/test/BugTracker/mdb_starts_with_sql_debug_64.SF-1999354 > - - o o F10 G32/32d1 src/test/BugTracker/ms_round.SF-1907063 > - - o o F10 G32/32d1 src/test/BugTracker/multi-column-constraint.SF-1964587 > - - o o F10 G32/32d1 src/test/BugTracker/multivalue_insert.SF-1509864 > - - o o F10 G32/32d1 src/test/BugTracker/nested_views_algebra_version.SF-1993765 > - - o o F10 G32/32d1 src/test/BugTracker/number_null_first_row.SF-1833286 > - - o o F10 G32/32d1 src/test/BugTracker/order_by_over_table_from_another_function.SF-1959822 > - - o o F10 G32/32d1 src/test/BugTracker/orderby_in_function.SF-1892708 > - - o o F10 G32/32d1 src/test/BugTracker/pkey_in_temp_table.SF-1841727 > - - o o F10 G32/32d1 src/test/BugTracker/prepare_decimal_float.SF-1675795 > - - o o F10 G32/32d1 src/test/BugTracker/proc_insert_into.SF-1958572 > - - X X F10 G32/32d1 src/test/BugTracker/python_escape.SF-1916844 > - - o o F10 G32/32d1 src/test/BugTracker/rand_not_executed_for_every_row.SF-1723791 > - - o o F10 G32/32d1 src/test/BugTracker/range_join_any.SF-2041785 > - - o o F10 G32/32d1 src/test/BugTracker/range_predicate.SF-1711242 > - - o o F10 G32/32d1 src/test/BugTracker/range_select.SF-1907006 > - - o o F10 G32/32d1 src/test/BugTracker/rank_over.SF-1691098 > - - o o F10 G32/32d1 src/test/BugTracker/reset_session_vars.SF-1505987 > - - o o F10 G32/32d1 src/test/BugTracker/revoke_role.SF-1691646 > - - o o F10 G32/32d1 src/test/BugTracker/rows_affected.SF-1377180 > - - o o F10 G32/32d1 src/test/BugTracker/savepoint-SF.1898533 > - - o o F10 G32/32d1 src/test/BugTracker/schema_from_declared_table.SF-1983341 > - - o o F10 G32/32d1 src/test/BugTracker/select_crashes_in_the_optimization.SF-1848553 > - - o o F10 G32/32d1 src/test/BugTracker/select_extract.SF-1263796 > - - o o F10 G32/32d1 src/test/BugTracker/select_id_not_in_another_select.SF-1737777 > - - o o F10 G32/32d1 src/test/BugTracker/select_mod.SF-1838813 > - - o o F10 G32/32d1 src/test/BugTracker/select_multiple_not_null_constraints.SF-1926074 > - - o o F10 G32/32d1 src/test/BugTracker/select_with_coalesce.SF-1841734 > - - o o F10 G32/32d1 src/test/BugTracker/sequence_not_stored_1.SF-1509894 > - - o o F10 G32/32d1 src/test/BugTracker/sequence_not_stored_2.SF-1509894 > - - o o F10 G32/32d1 src/test/BugTracker/sequence_not_stored_3.SF-1509894 > - - o o F10 G32/32d1 src/test/BugTracker/set_a_new_user_password.SF-1844050 > - - o o F10 G32/32d1 src/test/BugTracker/set_default_value.SF-1715553 > - - o o F10 G32/32d1 src/test/BugTracker/set_operation_coersions.SF-1543216 > - - o o F10 G32/32d1 src/test/BugTracker/set_session_vars.SF-1505987 > - - o o F10 G32/32d1 src/test/BugTracker/set_sql_debug_64__breaking_the_DB.SF-1906287 > - - o o F10 G32/32d1 src/test/BugTracker/sql_div.SF-1959357 > - - o o F10 G32/32d1 src/test/BugTracker/sql_prepare_prob.SF-1909638 > - - o o F10 G32/32d1 src/test/BugTracker/string2int_conversion.SF-1356068 > - - o o F10 G32/32d1 src/test/BugTracker/subquery_orderby.SF-1688915 > - - o o F10 G32/32d1 src/test/BugTracker/table_dependency_inside_union.SF-1884382 > - - o o F10 G32/32d1 src/test/BugTracker/table_function_column_crash.SF-1913572 > - - o o F10 G32/32d1 src/test/BugTracker/temporary_tables.SF-1715669 > - - o o F10 G32/32d1 src/test/BugTracker/timestamp_default_time.SF-1841191 > - - o o F10 G32/32d1 src/test/BugTracker/union_order > - - o o F10 G32/32d1 src/test/BugTracker/update_fkey_with_value_not_in_the_pkey.SF-1734143 > - - o o F10 G32/32d1 src/test/BugTracker/update_pkey_bug.SF-1733712 > - - o o F10 G32/32d1 src/test/BugTracker/update_with_correlated_subselect.SF-1284791 > - - o o F10 G32/32d1 src/test/BugTracker/update_with_subselect.SF-1362771 > - - o o F10 G32/32d1 src/test/BugTracker/variable_names.SF-1838816 > - - o o F10 G32/32d1 src/test/BugTracker/variable_stack_crash.SF-1711251 > - - o o F10 G32/32d1 src/test/BugTracker/variable_stack_crash.SF-1711251-2 > - - o o F10 G32/32d1 src/test/BugTracker/variable_stack_crash_drop.SF-1711251 > - - o o F10 G32/32d1 src/test/BugTracker/variable_stack_crash_load.SF-1711251 > - - o o F10 G32/32d1 src/test/BugTracker/variables.SF-1508160 > - - o o F10 G32/32d1 src/test/BugTracker/view_creation_using_func.SF-1714814 > - - o o F10 G32/32d1 src/test/BugTracker/with_only_once.SF-1720293 > - - o o F10 G32/32d1 src/test/BugTracker/with_row_number.SF-1898089 > - - o o F10 G32/32d1 src/test/Connections/connections > - - o o F10 G32/32d1 src/test/Dependencies/Dependencies > - - o o F10 G32/32d1 src/test/Dependencies/dependency_loop > - - o o F10 G32/32d1 src/test/DropCascade/drop_columns_cascade > - - o o F10 G32/32d1 src/test/DropCascade/drop_function_cascade > - - o o F10 G32/32d1 src/test/DropCascade/drop_pkey_cascade > - - o o F10 G32/32d1 src/test/DropCascade/drop_table_cascade > - - o o F10 G32/32d1 src/test/DropCascade/drop_view_cascade > - - o o F10 G32/32d1 src/test/Dump/clean > - - o o F10 G32/32d1 src/test/Dump/dump > - - o o F10 G32/32d1 src/test/Dump/load > - - o o F10 G32/32d1 src/test/Dump/reload > - - o o F10 G32/32d1 src/test/Dump/test > - - o o F10 G32/32d1 src/test/Skyserver/bugs/load_dbobjects > - - o o F10 G32/32d1 src/test/Skyserver/bugs/load_objmask > - - o o F10 G32/32d1 src/test/Triggers/cascaded_triggers > - - o X F10 G32/32d1 src/test/Triggers/recursive_triggers > - - X X F10 G32/32d1 src/test/Triggers/referencing_clause_new > - - X X F10 G32/32d1 src/test/Triggers/referencing_clause_old > - - X X F10 G32/32d1 src/test/Triggers/trigger_action > - - X X F10 G32/32d1 src/test/Triggers/trigger_activation > - - X X F10 G32/32d1 src/test/Triggers/trigger_insert > - - o X F10 G32/32d1 src/test/Triggers/trigger_owner > - - X X F10 G32/32d1 src/test/Triggers/triggers_schema_operations > - - o o F10 G32/32d1 src/test/Update_Delete_action/delete_cascade > - - o o F10 G32/32d1 src/test/Update_Delete_action/delete_no_action > - - o o F10 G32/32d1 src/test/Update_Delete_action/delete_restrict > - - o o F10 G32/32d1 src/test/Update_Delete_action/delete_set_default > - - o o F10 G32/32d1 src/test/Update_Delete_action/delete_set_null > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_cascade > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_delete_cascade > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_delete_set_null > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_delete_set_null_crash > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_no_action > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_restrict > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_set_default > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_set_default_crash > - - o o F10 G32/32d1 src/test/Update_Delete_action/update_set_null > - - o o F10 G32/32d1 src/test/Users/role1 > - - o o F10 G32/32d1 src/test/Users/role2 > - - o o F10 G32/32d1 src/test/Users/schema > - - o o F10 G32/32d1 src/test/Users/table > - - o o F10 G32/32d1 src/test/Users/unknown_user > - - o o F10 G32/32d1 src/test/Views/Views > - - o o F10 G32/32d1 src/test/broken_delete/broken_delete_0 > - - o o F10 G32/32d1 src/test/broken_delete/broken_delete_1 > - - o o F10 G32/32d1 src/test/broken_delete/broken_delete_2 > - - o o F10 G32/32d1 src/test/broken_delete/broken_delete_3 > - - o o F10 G32/32d1 src/test/broken_delete/broken_delete_4 > - - o o F10 G32/32d1 src/test/broken_delete/broken_delete_5 > - - o o F10 G32/32d1 src/test/bugs/aggr_single_value > - - o o F10 G32/32d1 src/test/bugs/alter_add_column-bug > - - o o F10 G32/32d1 src/test/bugs/alter_drop_column_insert_crash > - - o o F10 G32/32d1 src/test/bugs/alter_table_add_column > - - o o F10 G32/32d1 src/test/bugs/alter_view > - - o o F10 G32/32d1 src/test/bugs/arith-bug-sf-949228 > - - o o F10 G32/32d1 src/test/bugs/autocommit_illegal_statements-bug-sf-953545 > - - o o F10 G32/32d1 src/test/bugs/blob_not_null > - - o o F10 G32/32d1 src/test/bugs/bug-sf-938733 > - - o o F10 G32/32d1 src/test/bugs/bug-sf-972833 > - - o o F10 G32/32d1 src/test/bugs/case_cast-bug-sf-1019506 > - - o o F10 G32/32d1 src/test/bugs/case_parenthesis-bug-sf-1023056 > - - o o F10 G32/32d1 src/test/bugs/case_substring > - - o o F10 G32/32d1 src/test/bugs/cast_bool2int-bug-sf-1000576 > - - o o F10 G32/32d1 src/test/bugs/cast_bool2int-bug-sf-951800 > - - o o F10 G32/32d1 src/test/bugs/cast_varchar2int-bug-sf-964165 > - - o o F10 G32/32d1 src/test/bugs/copy_into_quote > - - o o F10 G32/32d1 src/test/bugs/copy_into_with_schema > - - o o F10 G32/32d1 src/test/bugs/create_index > - - o o F10 G32/32d1 src/test/bugs/create_insert_select-bug-sf-900198 > - - o o F10 G32/32d1 src/test/bugs/create_insert_select_aggr-bug-00001 > - - o o F10 G32/32d1 src/test/bugs/date_parsing-bug-sf-960166 > - - o o F10 G32/32d1 src/test/bugs/dbl_sht_cast_bug > - - o o F10 G32/32d1 src/test/bugs/decimal_copy_into_bug > - - o o F10 G32/32d1 src/test/bugs/default_with_cast.SF-1334486 > - - o o F10 G32/32d1 src/test/bugs/distinct_count > - - o o F10 G32/32d1 src/test/bugs/div_zero_bug > - - o o F10 G32/32d1 src/test/bugs/drop_foreignkey_selfreferencing > - - o o F10 G32/32d1 src/test/bugs/escape_quote-bug-sf-1006469 > - - o o F10 G32/32d1 src/test/bugs/extract_interval_bug-sf-1274088 > - - o o F10 G32/32d1 src/test/bugs/float2dec > - - o o F10 G32/32d1 src/test/bugs/float_arith_cast2int-bug-sf-949255 > - - o o F10 G32/32d1 src/test/bugs/floor-bug-sf-967066 > - - o o F10 G32/32d1 src/test/bugs/foreignkey_leftjoin-bug-sf-854312 > - - o o F10 G32/32d1 src/test/bugs/groupby_having-bug-sf-947600 > - - o o F10 G32/32d1 src/test/bugs/groupby_having_charlength-bug-sf-943566 > - - o o F10 G32/32d1 src/test/bugs/ifthenelse_bug > - - o o F10 G32/32d1 src/test/bugs/innerjoin_between-bug-sf-960672 > - - o o F10 G32/32d1 src/test/bugs/innerjoin_multiple-bug-sf-943661 > - - o o F10 G32/32d1 src/test/bugs/insert_delete-bug-sf-904025 > - - o o F10 G32/32d1 src/test/bugs/insert_into_groupby-bug-sf-949135 > - - o o F10 G32/32d1 src/test/bugs/insert_into_select-bug-sf-978043 > - - o o F10 G32/32d1 src/test/bugs/insert_update_arith-bug-sf-900206 > - - o o F10 G32/32d1 src/test/bugs/interval_convert_bugs-sf-1274077-1274085 > - - o o F10 G32/32d1 src/test/bugs/interval_data_commutative_add_bug-sf-1263928 > - - o o F10 G32/32d1 src/test/bugs/interval_parse_bug-sf-1263967 > - - o o F10 G32/32d1 src/test/bugs/leftjoinbug > - - o o F10 G32/32d1 src/test/bugs/like-bug-sf-1031435 > - - o o F10 G32/32d1 src/test/bugs/not > - - o o F10 G32/32d1 src/test/bugs/not_in_null_bug > - - o o F10 G32/32d1 src/test/bugs/numeric-bug-sf-952758 > - - o o F10 G32/32d1 src/test/bugs/object_name-bug-sf-985242 > - - o o F10 G32/32d1 src/test/bugs/offset_bug > - - o o F10 G32/32d1 src/test/bugs/or_in_crash > - - o o F10 G32/32d1 src/test/bugs/order_disjunctive_bug.SF-1338309 > - - o o F10 G32/32d1 src/test/bugs/order_limit_offset_bug > - - o o F10 G32/32d1 src/test/bugs/predicate_or-sf-1409824 > - - o o F10 G32/32d1 src/test/bugs/primary_key-bug-sf-975308 > - - o o F10 G32/32d1 src/test/bugs/profile_bug-SF.1314649 > - - o o F10 G32/32d1 src/test/bugs/rangejoin_optimize_bug > - - o o F10 G32/32d1 src/test/bugs/redirect > - - o o F10 G32/32d1 src/test/bugs/references-bug > - - o o F10 G32/32d1 src/test/bugs/reljoin_join2_bug > - - o o F10 G32/32d1 src/test/bugs/savepoint_release-bug-sf-953560 > - - o o F10 G32/32d1 src/test/bugs/savepoint_rollback-bug-sf-1023652 > - - o o F10 G32/32d1 src/test/bugs/savepoint_rollback-bug-sf-953553 > - - o o F10 G32/32d1 src/test/bugs/scalar_and_predicate_bug > - - o o F10 G32/32d1 src/test/bugs/seconds2timestamp > - - o o F10 G32/32d1 src/test/bugs/select_constant_from_where_1=1-bug-sf-1019529 > - - o o F10 G32/32d1 src/test/bugs/select_from_values > - - o o F10 G32/32d1 src/test/bugs/select_into > - - o o F10 G32/32d1 src/test/bugs/select_not_equal > - - o o F10 G32/32d1 src/test/bugs/select_orderby_alias-bug-sf-1024615 > - - o o F10 G32/32d1 src/test/bugs/selectlist_subquery-sf-1208599 > - - o o F10 G32/32d1 src/test/bugs/simple_view > - - o o F10 G32/32d1 src/test/bugs/start_transaction-bug-sf-952755 > - - o o F10 G32/32d1 src/test/bugs/subselect_ambigious_columns-bug-sf-949071 > - - o o F10 G32/32d1 src/test/bugs/subselect_column-bug-sf-951206 > - - o o F10 G32/32d1 src/test/bugs/subselect_multiple_unionall_where_1=1-bug-sf-1005596 > - - o o F10 G32/32d1 src/test/bugs/subselect_single_value-bug-sf-941791 > - - o o F10 G32/32d1 src/test/bugs/subselect_single_value-bug-sf-962099 > - - o o F10 G32/32d1 src/test/bugs/subselect_union-bug-sf-941826 > - - o o F10 G32/32d1 src/test/bugs/temporal > - - o o F10 G32/32d1 src/test/bugs/timestamp_comparison-bug-sf-1158581 > - - o o F10 G32/32d1 src/test/bugs/trimtest-bug-sf-1023588 > - - o o F10 G32/32d1 src/test/bugs/unicode_varchar-bug-sf-1041324_MapiClient > - - o o F10 G32/32d1 src/test/bugs/union-bug-sf-978045 > - - o o F10 G32/32d1 src/test/bugs/union_all-bug-sf-941788 > - - o o F10 G32/32d1 src/test/bugs/union_all_where_1=1-bug-sf-936386 > - - o o F10 G32/32d1 src/test/bugs/unique-bug-sf-1043512 > - - o o F10 G32/32d1 src/test/bugs/update_where-bug-sf-976963 > - - o o F10 G32/32d1 src/test/bugs/view_case-bug-sf-1023058 > - - o o F10 G32/32d1 src/test/bugs/view_error_limit.SF-1345861 > - - o o F10 G32/32d1 src/test/bugs/view_join-bug-sf-990096 > - - o o F10 G32/32d1 src/test/bugs/view_limit.SF-1345861 > - - o o F10 G32/32d1 src/test/bugs/view_selfjoin-bug-sf-937835 > - - o o F10 G32/32d1 src/test/bugs/zero_or_one_bug > - - X X F10 G32/32d1 src/test/concurrent/crash_on_concurrent_use.SF-1411926 > - - X X F10 G32/32d1 src/test/concurrent/simple_select > - - o o F10 G32/32d1 src/test/copy/int_parse > - - o o F10 G32/32d1 src/test/copy/null_as_string > - - o o F10 G32/32d1 src/test/copy/null_as_string_errors > - - o o F10 G32/32d1 src/test/copy/null_as_string_output > X X X T D9.6.0 G32/32d1 src/test/crashme > - - o o F10 G32/32d1 src/test/leaks/bbp > - - X o F10 G32/32d1 src/test/leaks/check0 > - - X o F10 G32/32d1 src/test/leaks/check1 > - - X o F10 G32/32d1 src/test/leaks/check2 > - - X o F10 G32/32d1 src/test/leaks/check3 > - - X o F10 G32/32d1 src/test/leaks/check4 > - - X o F10 G32/32d1 src/test/leaks/check5 > - - X o F10 G32/32d1 src/test/leaks/drop3 > - - X o F10 G32/32d1 src/test/leaks/select1 > - - X o F10 G32/32d1 src/test/leaks/select2 > - - X o F10 G32/32d1 src/test/leaks/temp1 > - - X o F10 G32/32d1 src/test/leaks/temp2 > - - X o F10 G32/32d1 src/test/leaks/temp3 > - - o o F10 G32/32d1 src/test/mapi/mclient-lsql--help > - - o o F10 G32/32d1 src/test/mapi/perl_dbi > - - o o F10 G32/32d1 src/test/mapi/php_monetdb > - - X X F10 G32/32d1 src/test/mapi/python_dbapi > - - X X F10 G32/32d1 src/test/mapi/python_dbapi_embedded > - - o o F10 G32/32d1 src/test/mapi/sample0 > - - o o F10 G32/32d1 src/test/mapi/sample1 > - - o o F10 G32/32d1 src/test/mapi/sample2 > - - o o F10 G32/32d1 src/test/mapi/sample3 > - - o o F10 G32/32d1 src/test/mapi/sample4 > - - o o F10 G32/32d1 src/test/mapi/smack00 > - - o o F10 G32/32d1 src/test/mapi/smack01 > - - o o F10 G32/32d1 src/test/mapi/utf8test > - - o o F10 G32/32d1 src/test/null/coalesce > - - o o F10 G32/32d1 src/test/null/coalesce2 > - - X o F10 G32/32d1 src/test/null/coalesce3 > - - o o F10 G32/32d1 src/test/null/null_in_case > - - o o F10 G32/32d1 src/test/octopus/squid > - - o o F10 G32/32d1 src/test/osm/delete_alter_bug > - - o o F10 G32/32d1 src/test/osm/drop_constraint_bug > - - o o F10 G32/32d1 src/test/osm/exp_name_bug > - - X o F10 G32/32d1 src/test/snodgrass/cast_select > - - o o F10 G32/32d1 src/test/sql_xml/funcs > - - o o F10 G32/32d1 src/test/sql_xml/load > - - o o F10 G32/32d1 src/test/sql_xml/xml > - - o o F10 G32/32d1 src/test/sql_xml/xml_attribute_parsing.SF-1855673 > - - o o F10 G32/32d1 src/test/xquery/create > - - o o F10 G32/32d1 src/test/xquery/drop > - - o o F10 G32/32d1 src/test/xquery/q01 > > > 7 Systems still don't produce output: > F8-G64/64s1, R4-I64/64d1, S5.11-G64/64d1, S5.11-S32/32d1, W5.1-M32/32d1, W5.2-M64/32d1, W5.2-M64/64d1 > > 4 New tests: > src/test/BugTracker-2009/dumping_tables.SF-2776908, src/test/BugTracker-2009/dumping_tables.SF-2776908--performance, src/test/BugTracker-2009/dumping_tables.SF-2776908--optimizers, src/test/BugTracker-2009/name_clash_with_dump.SF-2780395 > > > Results for 4 new tests: > ------------------------ > Summary: > - No output for 28 tests > - Failed output for 28 tests > Details: > 28 Tests produced no output: > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > 4 different tests > 7 different systems > > F8 G64/64s1 4 tests > R4 I64/64d1 4 tests > S5.11 G64/64d1 4 tests > S5.11 S32/32d1 4 tests > W5.1 M32/32d1 4 tests > W5.2 M64/32d1 4 tests > W5.2 M64/64d1 4 tests > > 4 tests produced no output on 7 systems > > - - F8 G64/64s1 src/test/BugTracker-2009/dumping_tables.SF-2776908 > - - R4 I64/64d1 > - - S5.11 G64/64d1 > - - S5.11 S32/32d1 > - - W5.1 M32/32d1 > - - W5.2 M64/32d1 > - - W5.2 M64/64d1 > - - F8 G64/64s1 src/test/BugTracker-2009/dumping_tables.SF-2776908--optimizers > - - R4 I64/64d1 > - - S5.11 G64/64d1 > - - S5.11 S32/32d1 > - - W5.1 M32/32d1 > - - W5.2 M64/32d1 > - - W5.2 M64/64d1 > - - F8 G64/64s1 src/test/BugTracker-2009/dumping_tables.SF-2776908--performance > - - R4 I64/64d1 > - - S5.11 G64/64d1 > - - S5.11 S32/32d1 > - - W5.1 M32/32d1 > - - W5.2 M64/32d1 > - - W5.2 M64/64d1 > - - F8 G64/64s1 src/test/BugTracker-2009/name_clash_with_dump.SF-2780395 > - - R4 I64/64d1 > - - S5.11 G64/64d1 > - - S5.11 S32/32d1 > - - W5.1 M32/32d1 > - - W5.2 M64/32d1 > - - W5.2 M64/64d1 > > > 28 Tests failed: > ~~~~~~~~~~~~~~~~ > 4 different tests > 14 different systems > > D4.0 G32/32d1 4 tests > F10 G64/64d1 4 tests > G2.0.0 G64/64d1 4 tests > S5.11 G32/32d1 4 tests > F8 G64/32d1 3 tests > D9.6.0 G32/32d1 1 test > D9.6.0 G64/64d1 1 test > F10 G32/32d1 1 test > F8 G64/64d0 1 test > F8 G64/64d1 1 test > F8 I64/32d1 1 test > F8 I64/64d1 1 test > W5.1 I32/32d1 1 test > W5.2 I64/64d1 1 test > > 1 test failed on 14 systems > 2 tests failed on 5 systems > 1 test failed on 4 systems > > X o D4.0 G32/32d1 src/test/BugTracker-2009/dumping_tables.SF-2776908--optimizers > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G32/32d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/BugTracker-2009/dumping_tables.SF-2776908 > X o F10 G64/64d1 > X X F8 G64/32d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o D4.0 G32/32d1 src/test/BugTracker-2009/dumping_tables.SF-2776908--performance > X o F10 G64/64d1 > X X F8 G64/32d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X T D4.0 G32/32d1 src/test/BugTracker-2009/name_clash_with_dump.SF-2780395 > X T F10 G64/64d1 > X T G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > > > > > 95 Tests still don't run: > ~~~~~~~~~~~~~~~~~~~~~~~~~ > 33 different tests > 14 different systems > > S5.11 G32/32d1 31 tests > F10 G64/64d1 29 tests > F10 G32/32d1 19 tests > D9.6.0 G64/64d1 3 tests > W5.2 I64/64d1 3 tests > W5.1 I32/32d1 2 tests > D4.0 G32/32d1 1 test > D9.6.0 G32/32d1 1 test > F8 G64/32d1 1 test > F8 G64/64d0 1 test > F8 G64/64d1 1 test > F8 I64/32d1 1 test > F8 I64/64d1 1 test > G2.0.0 G64/64d1 1 test > > 1 test still doesn't run on 14 systems > 18 tests still don't run on 3 systems > 13 tests still don't run on 2 systems > 1 test still doesn't run on 1 system > > --- D4.0 G32/32d1 src/test/load_dec_as_int > --- D9.6.0 G32/32d1 > --- D9.6.0 G64/64d1 > --- F10 G32/32d1 > --- F10 G64/64d1 > --- F8 G64/32d1 > --- F8 G64/64d0 > --- F8 G64/64d1 > --- F8 I64/32d1 > --- F8 I64/64d1 > --- G2.0.0 G64/64d1 > --- S5.11 G32/32d1 > --- W5.1 I32/32d1 > --- W5.2 I64/64d1 > --- F10 G32/32d1 src/jdbc/tests/BugConcurrent_clients_SF_1504657 > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/BugConcurrent_sequences > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Cautocommit > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Clargequery > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Cmanycon > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Creplysize > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Csavepoints > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Ctransaction > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_JdbcClient > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_PStimedate > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_PStimezone > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_PStypes > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Rbooleans > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Rmetadata > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Rpositioning > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Rtimedate > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/jdbc/tests/Test_Sbatching > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- F10 G32/32d1 src/test/bogus-auto-generated-keys > --- F10 G64/64d1 > --- S5.11 G32/32d1 > --- D9.6.0 G64/64d1 src/benchmarks/tpch/01-22 > --- S5.11 G32/32d1 > --- D9.6.0 G64/64d1 src/benchmarks/tpch/14 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/BugDay_2005-10-06_2.9.3/alter_table_describe.SF-1146092 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/BugDay_2005-10-06_2.9.3/not_null.SF-933194 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/BugDay_2005-10-06_2.9.3/type_dump_test.SF-989257 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/BugTracker/authorization.SF-1430616 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/BugTracker/drop_schema_crash.SF-1504794 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/BugTracker/explain.SF-1739353 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/BugTracker/jdbc_no_debug.SF-1739356 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/VOC/VOC > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/bugs/except-union-intersect-bug-sf-1146079 > --- S5.11 G32/32d1 > --- F10 G64/64d1 src/test/bugs/unicode_varchar-bug-sf-1041324_JdbcClient > --- S5.11 G32/32d1 > --- W5.1 I32/32d1 src/test/crashme > --- W5.2 I64/64d1 > --- W5.2 I64/64d1 src/test/mapi/php_monetdb > > > 786 Tests still fail: > ~~~~~~~~~~~~~~~~~~~~~ > 124 different tests > 14 different systems > > F8 G64/32d1 94 tests > F8 I64/32d1 79 tests > D9.6.0 G64/64d1 67 tests > G2.0.0 G64/64d1 64 tests > F8 I64/64d1 63 tests > F8 G64/64d0 61 tests > F8 G64/64d1 61 tests > F10 G64/64d1 55 tests > W5.1 I32/32d1 53 tests > W5.2 I64/64d1 51 tests > D4.0 G32/32d1 48 tests > D9.6.0 G32/32d1 46 tests > S5.11 G32/32d1 37 tests > F10 G32/32d1 7 tests > > 4 tests still fail on 14 systems > 22 tests still fail on 13 systems > 1 test still fails on 12 systems > 7 tests still fail on 11 systems > 4 tests still fail on 10 systems > 3 tests still fail on 9 systems > 20 tests still fail on 8 systems > 2 tests still fail on 7 systems > 2 tests still fail on 6 systems > 2 tests still fail on 5 systems > 2 tests still fail on 4 systems > 2 tests still fail on 3 systems > 25 tests still fail on 2 systems > 28 tests still fail on 1 system > > X o D4.0 G32/32d1 src/backends/monet5/optimizers > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G32/32d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/ADT2006/bram > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G32/32d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/huge_expression_and_column_name.SF-921173 > X T D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X X F10 G32/32d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/setoptimizer > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G32/32d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/BugDay_2005-12-19_2.9.3/select_from_env.SF-1240701.1242164 > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/BugTracker-2009/POWER_vs_prod.SF-2596114 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/BugTracker-2009/TribooleanFailureWithSubquery.SF-2679434 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > o X D4.0 G32/32d1 src/test/BugTracker/cardinality_violation.SF-1240701 > o X D9.6.0 G32/32d1 > o X D9.6.0 G64/64d1 > o X F10 G64/64d1 > o X F8 G64/32d1 > o X F8 G64/64d0 > o X F8 G64/64d1 > o X F8 I64/32d1 > o X F8 I64/64d1 > o X G2.0.0 G64/64d1 > o X S5.11 G32/32d1 > o X W5.1 I32/32d1 > o X W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/BugTracker/python_escape.SF-1916844 > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/concurrent/crash_on_concurrent_use.SF-1411926 > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/concurrent/simple_select > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/check0 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/check1 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/check2 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/check3 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/check4 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/check5 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/drop3 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/select1 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/select2 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/temp1 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/temp2 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/leaks/temp3 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/mapi/python_dbapi > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/mapi/python_dbapi_embedded > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/snodgrass/cast_select > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o S5.11 G32/32d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X o D9.6.0 G32/32d1 src/test/BugTracker-2009/parallel_bulk-load.SF-2771052.test > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X T S5.11 G32/32d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X o D4.0 G32/32d1 src/jdbc/tests/BugConcurrent_sequences > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/type_dump_test.SF-989257 > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/BugTracker/explain.SF-1739353 > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/Skyserver/Skyserver_v6 > X X D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F10 G64/64d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/bogus-auto-generated-keys > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/bugs/except-union-intersect-bug-sf-1146079 > X o D9.6.0 G32/32d1 > X o D9.6.0 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/crashme > X T D9.6.0 G64/64d1 > X X F10 G32/32d1 > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X X D9.6.0 G32/32d1 src/test/BugTracker/jdbc_no_debug.SF-1739356 > X X D9.6.0 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/Skyserver/Skyserver > X T D9.6.0 G32/32d1 > X X D9.6.0 G64/64d1 > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X X S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/VOC/VOC > X o D9.6.0 G32/32d1 > X X F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X o D9.6.0 G64/64d1 src/test/xquery/q01 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X X D4.0 G32/32d1 src/test/Triggers/referencing_clause_new > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X D4.0 G32/32d1 src/test/Triggers/referencing_clause_old > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X D4.0 G32/32d1 src/test/Triggers/trigger_action > X o D9.6.0 G64/64d1 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/benchmarks/tpch/12 > X o F10 G64/64d1 > X X F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X X F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/benchmarks/tpch/18 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/benchmarks/tpch/21 > X o F10 G64/64d1 > X X F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X X F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D4.0 G32/32d1 src/benchmarks/viam/viam > X o D9.6.0 G32/32d1 > X o F10 G32/32d1 > X o F8 G64/32d1 > X o F8 I64/32d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X X D9.6.0 G64/64d1 src/test/ADT2006/slam > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/BugTracker-2008/is_distinct_broken.SF-2430201 > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/Dependencies/Dependencies > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/Update_Delete_action/delete_cascade > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X D9.6.0 G64/64d1 src/test/Update_Delete_action/delete_restrict > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/Update_Delete_action/delete_set_default > X o F10 G64/64d1 > X X F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X X F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/Update_Delete_action/delete_set_null > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/Update_Delete_action/update_cascade > X o F10 G64/64d1 > X X F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X X F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/Update_Delete_action/update_delete_cascade > X o F10 G64/64d1 > X X F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X X F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X D9.6.0 G64/64d1 src/test/Update_Delete_action/update_delete_set_null_crash > X X F10 G64/64d1 > X X F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/Update_Delete_action/update_no_action > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X D9.6.0 G64/64d1 src/test/Update_Delete_action/update_restrict > X X F10 G64/64d1 > X o F8 G64/32d1 > X X F8 G64/64d0 > X X F8 G64/64d1 > X X F8 I64/32d1 > X X F8 I64/64d1 > X X G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/big-example > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/bugs/offset_bug > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D9.6.0 G64/64d1 src/test/osm/delete_alter_bug > X o F10 G64/64d1 > X o F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X D9.6.0 G64/64d1 src/test/sql_xml/xml > X o F10 G64/64d1 > X X F8 G64/32d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D4.0 G32/32d1 src/test/marcin1 > X o D9.6.0 G32/32d1 > X o F10 G32/32d1 > X o F8 G64/32d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D9.6.0 G64/64d1 src/test/median_stdev > X o F10 G64/64d1 > X o F8 G64/64d0 > X o F8 G64/64d1 > X o F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X X F8 G64/32d1 src/benchmarks/tpch/01-22 > X o F8 G64/64d0 > X o F8 G64/64d1 > X X F8 I64/32d1 > X o F8 I64/64d1 > X o G2.0.0 G64/64d1 > X o D4.0 G32/32d1 src/test/null/coalesce3 > X o D9.6.0 G32/32d1 > X o F8 G64/32d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X T D4.0 G32/32d1 src/test/BugTracker-2009/AVG_of_SQRT.SF-2757642.test > X T F10 G64/64d1 > X T G2.0.0 G64/64d1 > X X W5.1 I32/32d1 > X X W5.2 I64/64d1 > X o D4.0 G32/32d1 src/test/octopus/squid00 > X o D9.6.0 G32/32d1 > X o S5.11 G32/32d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D9.6.0 G32/32d1 src/test/bugs/unicode_varchar-bug-sf-1041324_JdbcClient > X o D9.6.0 G64/64d1 > X o W5.1 I32/32d1 > X o W5.2 I64/64d1 > X o D9.6.0 G32/32d1 src/test/mapi/php_monetdb > X o D9.6.0 G64/64d1 > X o F8 G64/32d1 > X o F8 I64/32d1 > o X S5.11 G32/32d1 src/test/coalesce > o X W5.1 I32/32d1 > o X W5.2 I64/64d1 > X X D9.6.0 G32/32d1 src/test/mapi/perl_dbi > X X D9.6.0 G64/64d1 > X X G2.0.0 G64/64d1 > X X F8 G64/32d1 src/benchmarks/moa/moa_ordered > X X F8 I64/32d1 > X X F8 G64/32d1 src/benchmarks/tpch/10 > X X F8 I64/32d1 > X o F8 G64/32d1 src/benchmarks/tpch/16 > X o F8 I64/32d1 > X X F8 G64/32d1 src/benchmarks/wisconsin/wisconsin-select > X X F8 I64/32d1 > X X F8 G64/32d1 src/jdbc/tests/Test_JdbcClient > X X F8 I64/32d1 > X X F8 G64/32d1 src/test/BugDay_2005-10-06_2.8/MapiClient-dump.SF-905851 > X X F8 I64/32d1 > X X F8 G64/32d1 src/test/BugDay_2005-10-06_2.9.3/UNION_JOIN_vs_plain_set_UNION-2.SF-920585 > X o F8 I64/32d1 > X X F8 G64/32d1 src/test/BugDay_2005-10-06_2.9.3/alter_table_describe.SF-1146092 > X X F8 I64/32d1 > X X W5.1 I32/32d1 src/test/BugDay_2005-10-06_2.9.3/bad_sql_logdir.SF-927371 > X X W5.2 I64/64d1 > X X F8 G64/32d1 src/test/BugDay_2005-10-06_2.9.3/not_null.SF-933194 > X X F8 I64/32d1 > X X D9.6.0 G64/64d1 src/test/BugTracker-2008/OOM_query.SF-2457195 > X X S5.11 G32/32d1 > o X F8 I64/32d1 src/test/BugTracker-2008/too_may_nested_operators.SF-2102167 > o X F8 I64/64d1 > X o W5.1 I32/32d1 src/test/BugTracker-2009/set_history_and_drop_table.SF-2607045 > X o W5.2 I64/64d1 > X o D9.6.0 G32/32d1 src/test/BugTracker-2009/union_leak.SF-2540169 > X o W5.1 I32/32d1 > X o W5.1 I32/32d1 src/test/BugTracker/connect_crash.SF-1436626 > X o W5.2 I64/64d1 > X o W5.1 I32/32d1 src/test/BugTracker/set_a_new_user_password.SF-1844050 > X o W5.2 I64/64d1 > X o F8 G64/32d1 src/test/BugTracker/set_default_value.SF-1715553 > X o F8 I64/32d1 > X o W5.1 I32/32d1 src/test/BugTracker/set_sql_debug_64__breaking_the_DB.SF-1906287 > X o W5.2 I64/64d1 > X X W5.1 I32/32d1 src/test/Connections/connections > X X W5.2 I64/64d1 > X X F8 G64/32d1 src/test/Update_Delete_action/update_set_default_crash > X o F8 I64/32d1 > X o F8 G64/32d1 src/test/bugs/order_limit_offset_bug > X o F8 I64/32d1 > X X F8 G64/32d1 src/test/bugs/rangejoin_optimize_bug > X X F8 I64/32d1 > X o F8 G64/32d1 src/test/bugs/subselect_ambigious_columns-bug-sf-949071 > X o F8 I64/32d1 > X o F8 G64/32d1 src/test/orderby_non_selection_column > X o F8 I64/32d1 > o X W5.1 I32/32d1 src/test/xquery/drop > o X W5.2 I64/64d1 > X X F8 G64/32d1 src/benchmarks/ATIS/select_group > X X F8 I64/32d1 src/benchmarks/tpch/02 > X o F8 G64/32d1 src/benchmarks/tpch/06 > X o F8 G64/32d1 src/benchmarks/tpch/07 > X X F8 G64/32d1 src/benchmarks/tpch/14 > X X F8 G64/32d1 src/benchmarks/tpch/20 > X o D9.6.0 G32/32d1 src/jdbc/tests/Test_PStimezone > X o F8 G64/32d1 src/odbc/samples/odbcsample1 > X o F8 G64/32d1 src/test/BugDay_2005-10-06_2.9.3/cross_product.SF-1122802 > X T S5.11 G32/32d1 src/test/BugTracker-2009/AVG_of_SQRT.SF-2757642.unpack_csv > X o F8 G64/32d1 src/test/BugTracker-2009/join_topn.SF-2654133 > X o F8 G64/32d1 src/test/BugTracker/insert_not_exists.SF-1380287 > X T W5.1 I32/32d1 src/test/BugTracker/mdb_starts_with_sql_debug_64.SF-1999354 > o X D4.0 G32/32d1 src/test/Triggers/recursive_triggers > X X D4.0 G32/32d1 src/test/Triggers/trigger_activation > X X D4.0 G32/32d1 src/test/Triggers/trigger_insert > o X D4.0 G32/32d1 src/test/Triggers/trigger_owner > X X D4.0 G32/32d1 src/test/Triggers/triggers_schema_operations > X X F8 G64/32d1 src/test/Update_Delete_action/update_delete_set_null > X X F8 G64/32d1 src/test/Update_Delete_action/update_set_null > X o F8 G64/32d1 src/test/bugs/create_insert_select_aggr-bug-00001 > X o F8 G64/32d1 src/test/bugs/subselect_multiple_unionall_where_1=1-bug-sf-1005596 > X o F8 G64/32d1 src/test/bugs/zero_or_one_bug > X o F8 G64/32d1 src/test/like_tests > X o D9.6.0 G32/32d1 src/test/mapi/mclient-lsql--help > X X D9.6.0 G64/64d1 src/test/mapi/utf8test > X X D9.6.0 G64/64d1 src/test/sql_xml/funcs > X X D9.6.0 G64/64d1 src/test/sql_xml/xml_attribute_parsing.SF-1855673 > > > > 11 Tests still time out: > ~~~~~~~~~~~~~~~~~~~~~~~~ > 1 different tests > 11 different systems > > D4.0 G32/32d1 1 test > D9.6.0 G32/32d1 1 test > D9.6.0 G64/64d1 1 test > F10 G64/64d1 1 test > F8 G64/32d1 1 test > F8 G64/64d0 1 test > F8 G64/64d1 1 test > F8 I64/32d1 1 test > F8 I64/64d1 1 test > G2.0.0 G64/64d1 1 test > S5.11 G32/32d1 1 test > > 1 test still times out on 11 systems > > o T D4.0 G32/32d1 src/test/BugDay_2005-10-06_2.9.3/bad_sql_logdir.SF-927371 > o T D9.6.0 G32/32d1 > o T D9.6.0 G64/64d1 > o T F10 G64/64d1 > o T F8 G64/32d1 > o T F8 G64/64d0 > o T F8 G64/64d1 > o T F8 I64/32d1 > o T F8 I64/64d1 > o T G2.0.0 G64/64d1 > o T S5.11 G32/32d1 > > > 2 Tests still have minor differences: > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > 1 different tests > 2 different systems > > W5.1 I32/32d1 1 test > W5.2 I64/64d1 1 test > > 1 test still has minor differences on 2 systems > > o x W5.1 I32/32d1 src/test/BugTracker-2008/too_may_nested_operators.SF-2102167 > o x W5.2 I64/64d1 > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] Monetdb-developers Digest, Vol 35, Issue 14
by Peter Boncz 28 Apr '09

28 Apr '09

Good morning Lefteris, > before checking in the changes in the serializer it is bettter to > check in the original code, also mark the serielizer in the original > location as M42M5, and then check in the chabges from the original > file This does not apply here, as there are no changes or replication. xquery_shredder.mx just contains the MAL wrappers, uses the M4 shredder API, and links with ../../runtime/libserialize Peter > > On Tue, Apr 28, 2009 at 2:30 AM, Peter Boncz > <boncz(a)users.sourceforge.net> wrote: > > Update of /cvsroot/monetdb/pathfinder/backends/monet5 > > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30055 > > > > Modified Files: > > ? ? ?Tag: M5XQ > > ? ? ? ?Makefile.ag xquery.mx xquery_shredder.mx > > Added Files: > > ? ? ?Tag: M5XQ > > ? ? ? ?xquery_serialize.mx > > Log Message: > > - add the serializer (finally), in the end opted to leave the code > > ?for now in M4, just added the wrappers > > - propagated some bugs that got lost in the shredder

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/backends/monet5 xquery_serialize.mx, M5XQ, NONE, 1.1.2.1 Makefile.ag, M5XQ, 1.3, 1.3.2.1 xquery.mx, M5XQ, 1.4.2.1, 1.4.2.2 xquery_shredder.mx, M5XQ, 1.3, 1.3.2.1
by Lefteris 28 Apr '09

28 Apr '09

Goodmorning, before checking in the changes in the serializer it is bettter to check in the original code, also mark the serielizer in the original location as M42M5, and then check in the chabges from the original file On Tue, Apr 28, 2009 at 2:30 AM, Peter Boncz <boncz(a)users.sourceforge.net> wrote: > Update of /cvsroot/monetdb/pathfinder/backends/monet5 > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30055 > > Modified Files: > Tag: M5XQ > Makefile.ag xquery.mx xquery_shredder.mx > Added Files: > Tag: M5XQ > xquery_serialize.mx > Log Message: > - add the serializer (finally), in the end opted to leave the code > for now in M4, just added the wrappers > - propagated some bugs that got lost in the shredder > > > > > U xquery.mx > Index: xquery.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/backends/monet5/Attic/xquery.mx,v > retrieving revision 1.4.2.1 > retrieving revision 1.4.2.2 > diff -u -d -r1.4.2.1 -r1.4.2.2 > --- xquery.mx 26 Apr 2009 18:54:12 -0000 1.4.2.1 > +++ xquery.mx 28 Apr 2009 00:30:00 -0000 1.4.2.2 > @@ -36,22 +36,64 @@ > @- XQuery shredder interface (xquery_shredder.mx) > @mal > command shred_url(doc:bat[:str,:bat], url:str, percentage:lng) :void > -address XQUERYShredURL > +address XQUERY_ShredURL > comment "Shred an XML document from a URL. Parameters: URL - document located at this URL is shredded, percentage - a number [0,100] indicating the amount of free space to reserve for updates (percentage=0 leads to a read-only document)" > > command shred_str(doc:bat[:str,:bat], buffer:str, percentage:lng) : void > -address XQUERYShredStr > +address XQUERY_ShredStr > comment "Shred an XML document from a string. Parameters: buffer - the XML string to shred, percentage - a number [0,100] indicating the amount of free space to reserve for updates (percentage=0 leads to a read-only document)" > > - > command shred_stream(doc:bat[:str,:bat], s:streams, percentage:lng) : void > -address XQUERYShredStream > +address XQUERY_ShredStream > comment "Shred an XML document from a stream. Parameters: s - XML input stream, percentage - a number [0,100] indicating the amount of free space to reserve for updates (percentage=0 leads to a read-only document)" > > + > +@- XML print functions (serialize.mx) > +@mal > +command print_doc(genType:str, ws:bat[:oid,:bat], docname:str) : void > +address XQUERY_PrintDocMain > +comment "C interface to Workset print routine" > + > +command print_result(genType:str, ws:bat[:oid,:bat], > + loop:bat[:oid,:any], iter:bat[:oid,:oid], item:bat[:oid,:oid] item, kind:BAT[:oid,int], > + int_values:bat[:oid,:lng], dbl_values:bat[:oid,:dbl], str_values:bat[:oid,:str]) : void > +address XQUERY_PrintResultLoop > +comment "C interface to Workset result print routine, that can print multiple iters" > + > +command print_result(genType:str, ws:bat[:oid,:bat], > + loop:bat[:oid,:any], iter:bat[:oid,:oid], item:bat[:oid,:oid] item, kind:BAT[:oid,int], > + int_values:bat[:oid,:lng], dbl_values:bat[:oid,:dbl], str_values:bat[:oid,:str], > + xrpc_module:str, xrpc_method:str, xrpc_qid:str, xrpc_caller:str, xrpc_mode:str, > + xrpc_hostport:str, xrpc_updating:bit, xrpc_seqnr:lng, xrpc_timeout:lng, xrpc_start:lng) : void > +address XQUERY_PrintResultXRPC > +comment "C interface to Workset result print routine, that can print multiple iters" > + > +command print_result(genType:str, ws:bat[:oid,:bat], > + item:bat[:oid,:oid] item, kind:BAT[:oid,int], > + int_values:bat[:oid,:lng], dbl_values:bat[:oid,:dbl], str_values:bat[:oid,:str]) : void > +address XQUERY_PrintResultMain > +comment "C interface to Workset result print routine" > + > +command print_result(file:str, genType:str, ws:bat[:oid,:bat], > + item:bat[:oid,:oid] item, kind:BAT[:oid,int], > + int_values:bat[:oid,:lng], dbl_values:bat[:oid,:dbl], str_values:bat[:oid,:str]) : void > +address XQUERY_PrintResultFile > +comment "C interface to Workset result print routine, but print to a file" > + > +command fn_deep_eq(ws:bat[:oid,:bat], > + litem:bat[:oid,:oid], lkind bat[:oid,:int], > + ritem:bat[:oid,:oid], rkind:bat[:oid,:int]) : bat[:oid,:bit] > +address XQUERY_fn_deep_eq > +command "C interface to fn:deep_eq() implementation using the serializer" > + > @h > #ifndef _XQUERY_H > #define _XQUERY_H > > +#include "pf_config.h" > +#include <mal_exception.h> > +#include "temp.h" /* TEMPORY DEFINITIONS TO MAKE THE M42M5 WORK */ > + > #define DEBUG_XQ > > #ifdef WIN32 > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/backends/monet5/Attic/Makefile.ag,v > retrieving revision 1.3 > retrieving revision 1.3.2.1 > diff -u -d -r1.3 -r1.3.2.1 > --- Makefile.ag 16 Apr 2009 11:26:50 -0000 1.3 > +++ Makefile.ag 28 Apr 2009 00:30:00 -0000 1.3.2.1 > @@ -30,9 +30,7 @@ > > lib__xquery = { > DIR = libdir/MonetDB5 > - SOURCES = \ > - xquery.mx temp.h \ > - xquery_shredder.mx > + SOURCES = xquery.mx temp.h xquery_shredder.mx xquery_serialize.mx > LIBS = \ > $(PF_LIBS) \ > $(MONETDB5_MODS) -l_optimizer -l_bat5 \ > > U xquery_shredder.mx > Index: xquery_shredder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/backends/monet5/Attic/xquery_shredder.mx,v > retrieving revision 1.3 > retrieving revision 1.3.2.1 > diff -u -d -r1.3 -r1.3.2.1 > --- xquery_shredder.mx 21 Apr 2009 08:39:14 -0000 1.3 > +++ xquery_shredder.mx 28 Apr 2009 00:30:00 -0000 1.3.2.1 > @@ -43,18 +43,15 @@ > #include "xquery.h" > > /* MAL commands to shred XML from a {uri,string,stream} */ > -xquery_export str XQUERYShredUrl(int retval, bat *doc, str location, lng *percentage); > -xquery_export str XQUERYShredStr(int retval, bat *doc, str buffer, lng *percentage); > -xquery_export str XQUERYShredStream(int retval, bat *doc, stream *s, lng *percentage); > +xquery_export str XQUERY_ShredUrl(int retval, bat *doc, str location, lng *percentage); > +xquery_export str XQUERY_ShredStr(int retval, bat *doc, str buffer, lng *percentage); > +xquery_export str XQUERY_ShredStream(int retval, bat *doc, stream *s, lng *percentage); > > #endif /* _XQ_SHREDDER_H */ > @c > -#include "pf_config.h" > -#include <mal_exception.h> > #include "xquery_shredder.h" > #include "libxml/parser.h" /* SAX parser interface(libxml2) */ > #include "libxml/parserInternals.h" > -#include "temp.h" /* TEMPORY DEFINITIONS TO MAKE THE M42M5 WORK */ > #include "serialize.h" /* for struct serializeFunStruct & struct XqueryCtx */ > > > @@ -1536,10 +1533,10 @@ > sb->bat->theap->free = sb->heapSize; > if (sb->heapBackup) { > /* restore internal hash table to pre-state */ > - memcpy(sb->bat->theap->base, sb->heapBackup, GDK_STRHASHTABLE*sizeof(var_t)); > + memcpy(sb->bat->theap->base, sb->heapBackup, GDK_STRHASHTABLE*sizeof(stridx_t)); > } else { > /* zap internal hash table. is not critical */ > - memset(sb->bat->theap->base, 0, GDK_STRHASHTABLE*sizeof(var_t)); > + memset(sb->bat->theap->base, 0, GDK_STRHASHTABLE*sizeof(stridx_t)); > } > } > shredBAT_setcount(sb, sb->abortSize); > @@ -1642,12 +1639,12 @@ > if (sb->def->tailType == TYPE_str) { > sb->heapSize = sb->bat->theap->free; > if (GDK_ELIMDOUBLES(sb->bat->theap)) { > - sb->heapBackup = GDKmalloc(GDK_STRHASHTABLE*sizeof(var_t)); > + sb->heapBackup = GDKmalloc(GDK_STRHASHTABLE*sizeof(stridx_t)); > if (!sb->heapBackup) { > GDKerror("shredder_create: malloc failure\n"); > return shredder_free(shredCtx,0); > } > - memcpy(sb->heapBackup, sb->bat->theap->base, GDK_STRHASHTABLE*sizeof(var_t)); > + memcpy(sb->heapBackup, sb->bat->theap->base, GDK_STRHASHTABLE*sizeof(stridx_t)); > } > } > } else { > @@ -1987,7 +1984,7 @@ > } > > str > -XQUERYShredUrl (int retval, bat *doc, str location, lng *percentage) > +XQUERY_ShredUrl (int retval, bat *doc, str location, lng *percentage) > { > int res; > BAT *docBAT; > @@ -2000,6 +1997,7 @@ > } > > res = shred(docBAT, location, NULL, NULL, *percentage, NULL, NULL); > + BBPreleaseref(*doc); > > if (res == GDK_FAIL) > throw(XQUERY, "xquery.shred_url", "unable to shred the specified url"); > @@ -2007,7 +2005,7 @@ > } > > str > -XQUERYShredStr (int retval, bat *doc, str buffer, lng *percentage) > +XQUERY_ShredStr (int retval, bat *doc, str buffer, lng *percentage) > { > int res; > BAT *docBAT; > @@ -2020,6 +2018,7 @@ > } > > res = shred(docBAT, NULL, buffer, NULL, *percentage, NULL, NULL); > + BBPreleaseref(*doc); > > if (res == GDK_FAIL) > throw(XQUERY, "xquery.shred_str", > @@ -2028,7 +2027,7 @@ > } > > str > -XQUERYShredStream (int retval, bat *doc, stream *s, lng *percentage) > +XQUERY_ShredStream (int retval, bat *doc, stream *s, lng *percentage) > { > int res; > BAT *docBAT; > @@ -2041,6 +2040,7 @@ > } > > res = shred(docBAT, NULL, NULL, s, *percentage, NULL, NULL); > + BBPreleaseref(*doc); > > if (res == GDK_FAIL) > throw(XQUERY, "xquery.shred_stream", > > --- NEW FILE: xquery_serialize.mx --- > @' Copyright Notice: > @' ----------------- > @' > @' The contents of this file are subject to the Pathfinder Public License > @' Version 1.1 (the "License"); you may not use this file except in > @' compliance with the License. You may obtain a copy of the License at > @' http://monetdb.cwi.nl/Legal/PathfinderLicense-1.1.html > @' > @' Software distributed under the License is distributed on an "AS IS" > @' basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See > @' the License for the specific language governing rights and limitations > @' under the License. > @' > @' The Original Code is the Pathfinder system. > @' > @' The Original Code has initially been developed by the Database & > @' Information Systems Group at the University of Konstanz, Germany and > @' the Database Group at the Technische Universitaet Muenchen, Germany. > @' It is now maintained by the Database Systems Group at the Eberhard > @' Karls Universitaet Tuebingen, Germany. Portions created by the > @' University of Konstanz, the Technische Universitaet Muenchen, and the > @' Universitaet Tuebingen are Copyright (C) 2000-2005 University of > @' Konstanz, (C) 2005-2008 Technische Universitaet Muenchen, and (C) > @' 2008-2009 Eberhard Karls Universitaet Tuebingen, respectively. All > @' Rights Reserved. > @' > > @f xquery_serialize > @a Peter Boncz > @t MAL serialize wrappers > @h > #ifndef _XQ_SERIALIZE_H > #define _XQ_SERIALIZE_H > > #include "xquery.h" > > /* MAL commands to serialize XML */ > xquery_export str > XQUERY_PrintResultXRPC( > str mode, > bat* ws_batid, > bat* loop_batid, > bat* iter_batid, > bat* item_batid, > bat* kind_batid, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid, > /* xrpc response header things */ > str xrpc_module, > str xrpc_method, > str xrpc_qid, > str xrpc_caller, > str xrpc_mode, > str xrpc_hostport, > bit *xrpc_updating, > lng *xrpc_seqnr, > lng *xrpc_timeout, > lng *xrpc_start); > > xquery_export str > XQUERY_PrintResultLoop( > str mode, > bat* ws_batid, > bat* loop_batid, > bat* iter_batid, > bat* item_batid, > bat* kind_batid, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid); > > xquery_export str > XQUERY_PrintResultMain( > str mode, > bat* ws_batid, > bat* item_batid, > bat* kind_batid, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid); > > xquery_export str > XQUERY_PrintResultFile ( > str file, > str mode, > bat* ws_batid, > oid* item, > int* kind, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid); > > xquery_export str > XQUERY_PrintDocMain ( > str mode, > bat* ws_batid, > str docName); > > xquery_export str > XQUERY_fn_deep_eq( > bat* res_batid, > bat* ws_batid, > bat* litem_batid, > bat* lkind_batid, > bat* ritem_batid, > bat* rkind_batid); > > > #endif /* _XQ_SERIALIZE_H */ > @c > #include "xquery_serialize.h" > #include "serialize.h" > > /* the main MAL wrapper with all BAT fixing/Unfixing */ > static str > XQUERY_PrintResult( > BUN niters, > str mode, > bat* ws_batid, > bat* loop_batid, > bat* iter_batid, > bat* item_batid, > bat* kind_batid, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid, > /* xrpc response header things */ > str xrpc_module, > str xrpc_method, > str xrpc_qid, > str xrpc_caller, > str xrpc_mode, > str xrpc_hostport, > bit *xrpc_updating, > lng *xrpc_seqnr, > lng *xrpc_timeout, > lng *xrpc_start) > { > int ret = GDK_FAIL; > BAT* ws; > assert(ws_batid); > assert(loop_batid); > assert(iter_batid); > assert(item_batid); > assert(kind_batid); > assert(intVAL_batid); > assert(dblVAL_batid); > assert(strVAL_batid); > ws = BATdescriptor(*ws_batid); > if (ws) { > BAT* loop = BATdescriptor(*loop_batid); > if (loop) { > BAT* iter = BATdescriptor(*iter_batid); > if (niters == 0) niters = BATcount (loop); > if (iter) { > BAT* item = BATdescriptor(*item_batid); > if (item) { > BAT* kind = BATdescriptor(*kind_batid); > if (kind) { > BAT* intVAL = BATdescriptor(*intVAL_batid); > if (intVAL) { > BAT* dblVAL = BATdescriptor(*dblVAL_batid); > if (dblVAL) { > BAT* strVAL = BATdescriptor(*strVAL_batid); > if (strVAL) { > ret = xquery_print_result_DRIVER ( > mode, > NULL, /* set of printing callback function */ > NULL, /* optional arguments for the callback functions */ > ws, > niters?niters:1, /* number of iterations */ > loop, /* loop relation */ > iter, /* iter relation */ > item, /* item relation */ > kind, /* kind relation */ > intVAL, > dblVAL, > strVAL, > xrpc_module, > xrpc_method, > xrpc_qid, > xrpc_caller, > xrpc_mode, > xrpc_hostport, > xrpc_updating, > xrpc_seqnr, > xrpc_timeout, > xrpc_start); > } > BBPreleaseref(*strVAL_batid); > } > BBPreleaseref(*dblVAL_batid); > } > BBPreleaseref(*intVAL_batid); > } > BBPreleaseref(*kind_batid); > } > BBPreleaseref(*item_batid); > } > BBPreleaseref(*iter_batid); > } > BBPreleaseref(*loop_batid); > } > BBPreleaseref(*ws_batid); > > if (ret == GDK_FAIL) > throw(XQUERY, "xquery.print_result", "unable to print XML"); > return MAL_SUCCEED; > } > > str > XQUERY_PrintResultXRPC( > str mode, > bat* ws_batid, > bat* loop_batid, > bat* iter_batid, > bat* item_batid, > bat* kind_batid, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid, > /* xrpc response header things */ > str xrpc_module, > str xrpc_method, > str xrpc_qid, > str xrpc_caller, > str xrpc_mode, > str xrpc_hostport, > bit *xrpc_updating, > lng *xrpc_seqnr, > lng *xrpc_timeout, > lng *xrpc_start) > { > assert(xrpc_module); > assert(xrpc_method); > assert(xrpc_qid); > assert(xrpc_caller); > assert(xrpc_mode); > assert(xrpc_hostport); > assert(xrpc_updating); > assert(xrpc_seqnr); > assert(xrpc_timeout); > assert(xrpc_start); > return XQUERY_PrintResult(0, mode, > ws_batid, > loop_batid, > iter_batid, > item_batid, > kind_batid, > intVAL_batid, > dblVAL_batid, > strVAL_batid, > xrpc_module, > xrpc_method, > xrpc_qid, > xrpc_caller, > xrpc_mode, > xrpc_hostport, > xrpc_updating, > xrpc_seqnr, > xrpc_timeout, > xrpc_start); > } > > str > XQUERY_PrintResultLoop( > str mode, > bat* ws_batid, > bat* loop_batid, > bat* iter_batid, > bat* item_batid, > bat* kind_batid, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid) > { > return XQUERY_PrintResult(0, > mode, > ws_batid, > loop_batid, /* loop relation */ > iter_batid, /* iter relation */ > item_batid, /* item relation */ > kind_batid, /* kind relation */ > intVAL_batid, > dblVAL_batid, > strVAL_batid, > NULL, /* xrpc_module */ > NULL, /* xrpc_method */ > NULL, /* xrpc_qid */ > NULL, /* xrpc_caller */ > NULL, /* xrpc_mode */ > NULL, /* xrpc_hostport */ > NULL, /* xrpc_updating */ > NULL, /* xrpc_seqnr */ > NULL, /* xrpc_timeout */ > NULL);/* xrpc_start */ > } > > str > XQUERY_PrintResultMain( > str mode, > bat* ws_batid, > bat* item_batid, > bat* kind_batid, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid) > { > return XQUERY_PrintResult(1, > mode, > ws_batid, > item_batid, /* loop relation */ > item_batid, /* iter relation */ > item_batid, /* item relation */ > kind_batid, /* kind relation */ > intVAL_batid, > dblVAL_batid, > strVAL_batid, > NULL, /* xrpc_module */ > NULL, /* xrpc_method */ > NULL, /* xrpc_qid */ > NULL, /* xrpc_caller */ > NULL, /* xrpc_mode */ > NULL, /* xrpc_hostport */ > NULL, /* xrpc_updating */ > NULL, /* xrpc_seqnr */ > NULL, /* xrpc_timeout */ > NULL);/* xrpc_start */ > } > > str > XQUERY_PrintResultFile ( > str file, > str mode, > bat* ws_batid, > oid* item, > int* kind, > bat* intVAL_batid, > bat* dblVAL_batid, > bat* strVAL_batid) > { > int ret = GDK_FAIL; > BAT *ws; > > assert(file); > assert(mode); > assert(ws_batid); > assert(item); > assert(kind); > assert(intVAL_batid); > assert(dblVAL_batid); > assert(strVAL_batid); > > ws = BATdescriptor(*ws_batid); > if (ws) { > BAT* intVAL = BATdescriptor(*intVAL_batid); > if (intVAL) { > BAT* dblVAL = BATdescriptor(*dblVAL_batid); > if (dblVAL) { > BAT* strVAL = BATdescriptor(*strVAL_batid); > if (strVAL) { > int len = strlen(file); > if (DIR_SEP != '/') { > char *s = file; /* normalize path on windows to windows DIR_SEP */ > do { if (*s == '/') *s = DIR_SEP; } while(*(++s)); > } > if (*file == DIR_SEP) { > GDKerror("xquery_print_result_file: %s cannot have an absolute name.\n", file); > } else if (len < 4 || (strcmp(file+len-4, ".xml") && strcmp(file+len-4, ".XML"))) { > GDKerror("xquery_print_result_file: %s name does not end in .xml\n", file); > } else if (GDKcreatedir(file)) { > FILE *fp = fopen(file, "wb"); > if (fp) { > stream *s = file_wastream(fp, file); > if (s) { > BAT* i = BATnew(TYPE_void,TYPE_oid,1); > if (i) { > BAT* k = BATnew(TYPE_void,TYPE_int,1); > if (k) { > BATseqbase(k, 0); > BATseqbase(i, 0); > BUNappend(k, kind, FALSE); > BUNappend(i, item, FALSE); > ret = xquery_print_result_driver ( > s, > mode, > NULL, /* set of printing callback function */ > NULL, /* optional arguments for the callback functions */ > ws, > 1, /* number of iterations */ > i, /* loop relation */ > i, /* iter relation */ > i, /* item relation */ > k, /* kind relation */ > intVAL, > dblVAL, > strVAL, > NULL, /* xrpc_module */ > NULL, /* xrpc_method */ > NULL, /* xrpc_qid */ > NULL, /* xrpc_caller */ > NULL, /* xrpc_mode */ > NULL, /* xrpc_hostport */ > NULL, /* xrpc_updating */ > NULL, /* xrpc_seqnr */ > NULL, /* xrpc_timeout */ > NULL);/* xrpc_start */ > stream_destroy(s); > } > BBPreclaim(k); > } > BBPreclaim(i); > } > fclose(fp); > } else { > GDKsyserror("xquery_print_result_file: %s", file); > } > } > BBPreleaseref(*strVAL_batid); > } > BBPreleaseref(*dblVAL_batid); > } > BBPreleaseref(*intVAL_batid); > } > BBPreleaseref(*ws_batid); > } > if (ret == GDK_FAIL) > throw(XQUERY, "xquery.print_result", "unable to write XML to file"); > return MAL_SUCCEED; > } > > str > XQUERY_PrintDocMain ( > str mode, > bat* ws_batid, > str docName) > { > int ret = GDK_FAIL; > BAT *ws; > assert(mode); > assert(ws_batid); > assert(docName); > ws = BATdescriptor(*ws_batid); > if (ws) { > ret = xquery_print_doc_DRIVER(mode,NULL,NULL,ws,docName); > BBPreleaseref(*ws_batid); > } > if (ret == GDK_FAIL) > throw(XQUERY, "xquery.print_doc", "unable to print XML document"); > return MAL_SUCCEED; > } > > xquery_export str > XQUERY_fn_deep_eq( > bat* res_batid, > bat* ws_batid, > bat* litem_batid, > bat* lkind_batid, > bat* ritem_batid, > bat* rkind_batid) > { > int ret = GDK_FAIL; > BAT *ws = BATdescriptor(*ws_batid); > if (ws) { > BAT *litem = BATdescriptor(*litem_batid); > if (litem) { > BAT *lkind = BATdescriptor(*lkind_batid); > if (lkind) { > BAT *ritem = BATdescriptor(*ritem_batid); > if (ritem) { > BAT *rkind = BATdescriptor(*rkind_batid); > if (rkind) { > BAT *resbat = NULL; > ret = do_fn_deep_eq(&resbat, ws, litem, lkind, ritem, rkind); > if (ret == GDK_SUCCEED) { > *res_batid = resbat->batCacheid; > BBPkeepref(*res_batid); > } > BBPreleaseref(*rkind_batid); > } > BBPreleaseref(*ritem_batid); > } > BBPreleaseref(*lkind_batid); > } > BBPreleaseref(*litem_batid); > } > BBPreleaseref(*ws_batid); > } > if (ret == GDK_FAIL) > throw(XQUERY, "xquery.fn_deep_eq", "unable compare sequences"); > return MAL_SUCCEED; > } > > > ------------------------------------------------------------------------------ > Register Now & Save for Velocity, the Web Performance & Operations > Conference from O'Reilly Media. Velocity features a full day of > expert-led, hands-on workshops and two days of sessions from industry > leaders in dedicated Performance & Operations tracks. Use code vel09scf > and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins >

1 0

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/ruby README, , NONE, 1.1 Makefile.ag, , 1.4, NONE
by Stefan Manegold 28 Apr '09

28 Apr '09

Gabriele, Am I right that you (accidently) only added one file (clients/src/ruby/README) of the new ruby interface so far? See also https://sourceforge.net/tracker/?func=detail&aid=2782529&group_id=56967&ati… Stefan On Mon, Apr 27, 2009 at 04:09:31PM +0000, Gabriele Modena wrote: > Update of /cvsroot/monetdb/clients/src/ruby > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12362 > > Added Files: > README > Removed Files: > Makefile.ag > Log Message: > Imported the pure Ruby monetdb5/sql driver; the old Cimpl has been removed. Please see the README file for a description of the directory structure > > --- NEW FILE: README --- > == Standalone driver == > > - Required files: > > monetdb/MonetDB.rb > monetdb/MonetDBConnection.rb > monetdb/MonetDBStatements.rb > monetdb/MonetDBData.rb > monetdb/MonetDBExceptions.rb > monetdb/hasher.rb > > monetdb/demo.rb: demo application how to interact with the database > monetdb/ruby-monetdb-sql-0.1.gemspec: make file for rubygems > monetdb/ruby-monetdb-sql-0.1.gem: actual gem; enables to install the driver and the documentation > > doc/: rubydoc in HTML format > > > --- Makefile.ag DELETED --- > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensign option that enables unlimited > royalty-free distribution of the report engine for externally facing > server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Announcement: New bug fix release of MonetDB suite
by Sjoerd Mullender 27 Apr '09

27 Apr '09

The MonetDB team at CWI is pleased to announce the Feb2009-SP2 bug fix release of the MonetDB suite of programs. This is the second bug fix release of the Feb2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Feb2009/#Feb200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/mil milgen.brg, Feb2009, 1.201.2.10, 1.201.2.11
by Sjoerd Mullender 24 Apr '09

24 Apr '09

Is this a reason to rebuild the release? Yesterday I built release candidates and I don't really want to do that again if I can avoid it. Jan Rittinger wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/mil > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7388/mil > > Modified Files: > Tag: Feb2009 > milgen.brg > Log Message: > -- Fix alignment problem in the MIL generation of the slice() operator. > > Scary, but true: Some rules in the MIL generation require the head > values to start with 0@0 as they add new columns with offset 0. > > > U milgen.brg > Index: milgen.brg > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/mil/milgen.brg,v > retrieving revision 1.201.2.10 > retrieving revision 1.201.2.11 > diff -u -d -r1.201.2.10 -r1.201.2.11 > --- milgen.brg 18 Mar 2009 09:16:50 -0000 1.201.2.10 > +++ milgen.brg 24 Apr 2009 10:12:15 -0000 1.201.2.11 > @@ -4708,7 +4708,11 @@ > assgn (var (tmp->name), > slice (var (env_at (L(p)->env, i).mvar->name), > lit_int (p->sem.slice.low), > - lit_int (p->sem.slice.high)))); > + lit_int (p->sem.slice.high))), > + /* scary but true -- we need to let the seqbases start > + with 0@0 as otherwise alignment problems arise */ > + assgn (var (tmp->name), > + tmark (var (tmp->name), lit_oid (0)))); > > env_add (p->env, > env_at (L(p)->env, i).col, > > > ------------------------------------------------------------------------------ > Crystal Reports - New Free Runtime and 30 Day Trial > Check out the new simplified licensign option that enables unlimited > royalty-free distribution of the report engine for externally facing > server and web deployment. > http://p.sf.net/sfu/businessobjects > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/storage store.mx, Feb2009, 1.25.2.1, 1.25.2.2
by Sjoerd Mullender 22 Apr '09

22 Apr '09

On 2009-04-22 10:28, Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/storage > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv10533/src/storage > > Modified Files: > Tag: Feb2009 > store.mx > Log Message: > fixing bad concurrency bug Bad enough to rebuild the release candidates? > 1) we lost updates > Problem was in the handling of the update bat, ie we need to always > keep updates in the update bat. But already apply asap. > > 2) we got extra inserts (the hard problem) > We incorrectly kept using an 'empty' bat. These are bats which should > stay empty and are shared. But we incorrectly inserted data in it > instead of replacing it with a new bat with data. > > > U store.mx > Index: store.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/storage/store.mx,v > retrieving revision 1.25.2.1 > retrieving revision 1.25.2.2 > diff -u -d -r1.25.2.1 -r1.25.2.2 > --- store.mx 27 Feb 2009 22:23:00 -0000 1.25.2.1 > +++ store.mx 22 Apr 2009 08:28:22 -0000 1.25.2.2 > @@ -1850,8 +1850,8 @@ > > t->name = NULL; > if (bs_debug) > - fprintf(stderr, "trans init (%d,%d)\n", > - t->stime, t->schema_number ); > + fprintf(stderr, "trans (%p) init (%d,%d)\n", > + t, t->stime, t->schema_number ); > return t; > } > > @@ -2710,13 +2710,12 @@ > sql_schema *s = n->data; > sql_schema *os; > > - > if (isTempSchema(s)) > continue; > > os = find_sql_schema(tr->parent, s->base.name); > if (os/* || (s->base.wtime == 0 && s->base.rtime == 0)*/) { > - if (!validate_tables(s, os)) > + if (!validate_tables(s, os)) > return 0; > } > } > > > ------------------------------------------------------------------------------ > Stay on top of everything new and different, both inside and > around Java (TM) technology - register by April 22, and save > $200 on the JavaOne (SM) conference, June 2-5, 2009, San Francisco. > 300 plus technical and hands-on sessions. Register today. > Use priority code J9JMT32. http://p.sf.net/sfu/p > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- Sjoerd Mullender

3 4

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/python/tests - New directory
by Sjoerd Mullender 21 Apr '09

21 Apr '09

This is a problem. There is already a directory Tests here, so you can't also have a directory tests. It will not work on case-challenged file systems (i.e. Windows). On 2009-04-20 15:51, Gijs Molenaar wrote: > Update of /cvsroot/monetdb/clients/src/python/tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv18844/tests > > Log Message: > Directory /cvsroot/monetdb/clients/src/python/tests added to the repository > > > > ------------------------------------------------------------------------------ > Stay on top of everything new and different, both inside and > around Java (TM) technology - register by April 22, and save > $200 on the JavaOne (SM) conference, June 2-5, 2009, San Francisco. > 300 plus technical and hands-on sessions. Register today. > Use priority code J9JMT32. http://p.sf.net/sfu/p > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

5 9

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal remote.mx, , 1.87, 1.88
by Martin Kersten 20 Apr '09

20 Apr '09

Fabian Groffen wrote: > On 19-04-2009 18:56:59 +0000, Martin Kersten wrote: >> Log Message: >> The client context record is shared between threads. This means that you >> have to protect the structure when connection lists are initialized/used. > > "The client context record is shared between threads" > >> U remote.mx >> Index: remote.mx >> =================================================================== >> RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/remote.mx,v >> retrieving revision 1.87 >> retrieving revision 1.88 >> diff -u -d -r1.87 -r1.88 >> --- remote.mx 18 Apr 2009 08:45:34 -0000 1.87 >> +++ remote.mx 19 Apr 2009 18:56:57 -0000 1.88 >> @@ -512,7 +512,6 @@ >> #endif >> >> /* part 1: "user" -- this is trivial */ >> - mal_set_lock(mal_remoteLock, "remote.list"); > ^^^ >> c = userconns; >> /* walk through the list */ >> while (c != NULL) { >> @@ -524,7 +523,6 @@ >> break; >> } >> } >> - mal_unset_lock(mal_remoteLock, "remote.list"); > ^^^ > > Was this intended? A loop through a shared linked list is made here, > which potentially can be modified while you walk through it, hence the > lock that was here. the locks are now placed one level higher in the calling structure. It was a consequence of first protecting RMTconnect structures. >

2 1

[Monetdb-developers] New oid32 system; bulk rotate error
by Stefan de Konink 18 Apr '09

18 Apr '09

sql>ALTER TABLE relation_members_node ADD CONSTRAINT pk_relation_members_node PRIMARY KEY (relation, idx); 0 tuples !MALException:mkey.bulk_rotate_xor_hash:command failed Within a transaction I get the previous error. My dataset on disk is now 29GB after switching to oid32 on a 64bit system, 64GB of main memory is available. And the server was started in performance mode. Stefan

1 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/BugTracker-2009/Tests wrong_error_message.SF-2637051.sql, Feb2009, NONE, 1.1.2.1 wrong_error_message.SF-2637051.stable.err, Feb2009, NONE, 1.1.2.1 wrong_error_message.SF-2637051.stable.out, Feb2009, NONE, 1.1.2.1 All, Feb2009, 1.2.2.40, 1.2.2.41
by Stefan Manegold 18 Apr '09

18 Apr '09

Niels, did you disable my new "parallel_bulk-load.SF-2771052" tests on purpose (if so, why?) or just be accident? Stefan On Fri, Apr 17, 2009 at 09:00:08PM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/test/BugTracker-2009/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12678 > > Modified Files: > Tag: Feb2009 > All > Added Files: > Tag: Feb2009 > wrong_error_message.SF-2637051.sql > wrong_error_message.SF-2637051.stable.err > wrong_error_message.SF-2637051.stable.out > Log Message: > add test for bug 2637051 > [...] > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/BugTracker-2009/Tests/All,v > retrieving revision 1.2.2.40 > retrieving revision 1.2.2.41 > diff -u -d -r1.2.2.40 -r1.2.2.41 > --- All 17 Apr 2009 17:12:54 -0000 1.2.2.40 > +++ All 17 Apr 2009 21:00:06 -0000 1.2.2.41 > @@ -42,5 +42,6 @@ > TribooleanFailureWithSubquery.SF-2679434 > nullstr.SF-2704016 > POWER_vs_prod.SF-2596114 > -parallel_bulk-load.SF-2771052.unpack_csv > -parallel_bulk-load.SF-2771052.test > +#parallel_bulk-load.SF-2771052.unpack_csv ^ > +#parallel_bulk-load.SF-2771052.test ^ > +wrong_error_message.SF-2637051 > [...] -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

[Monetdb-developers] XQ: unaligned access
by Wouter Alink 17 Apr '09

17 Apr '09

Hello, I currently get many of the following messages on the Mserver console, while shredding a collection of XML documents with yesterdays stable nightly build (using 32-bit oids on a 64-bit machine): Mserver(31123): unaligned access to 0x20000000de29726f, ip=0x200000000133c101 Mserver(31123): unaligned access to 0x20000000de1f746e, ip=0x200000000133c101 Mserver(31123): unaligned access to 0x20000000de1f746e, ip=0x200000000133c0f0 Mserver(31123): unaligned access to 0x200000013013696d, ip=0x200000000133c101 Mserver(31123): unaligned access to 0x200000013013696d, ip=0x200000000133c0f0 Mserver(31123): unaligned access to 0x20000000de29726f, ip=0x200000000133c101 A new one appears every few seconds. There seems to be only 4 or 5 different addresses accessed for which this message appears. Is this a bug, a feature, or debug info? Can it be safely ignored? Cheers, Wouter

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_octopus.mx, , 1.29, 1.30
by Lefteris 14 Apr '09

14 Apr '09

Is it only my copy because I messed something up or there is a problem with compiling octapus functions in sql.mx? cc1: warnings being treated as errors /home/lsidir/develop//current/sql/src/backends/monet5/sql.mx: In function ‘SQLnewAquarium’: /home/lsidir/develop//current/sql/src/backends/monet5/sql.mx:4091: error: implicit declaration of function ‘OCTOPUSworker’ /home/lsidir/develop//current/sql/src/backends/monet5/sql.mx:4091: error: return makes pointer from integer without a cast /home/lsidir/develop//current/sql/src/backends/monet5/sql.mx: In function ‘SQLdropAquarium’: /home/lsidir/develop//current/sql/src/backends/monet5/sql.mx:4097: error: implicit declaration of function ‘OCTOPUSdrop’ /home/lsidir/develop//current/sql/src/backends/monet5/sql.mx:4097: error: return makes pointer from integer without a cast make[7]: *** [lib_sql_la-sql.lo] Error 1 make[7]: Leaving directory `/export/scratch0/lsidir/monet/build.current/sql/src/backends/monet5' make[6]: *** [all] Error 2 make[6]: Leaving directory `/export/scratch0/lsidir/monet/build.current/sql/src/backends/monet5' make[5]: *** [all-recursive] Error 1 make[5]: Leaving directory `/export/scratch0/lsidir/monet/build.current/sql/src/backends' make[4]: *** [all] Error 2 make[4]: Leaving directory `/export/scratch0/lsidir/monet/build.current/sql/src/backends' make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory `/export/scratch0/lsidir/monet/build.current/sql/src' make[2]: *** [all] Error 2 make[2]: Leaving directory `/export/scratch0/lsidir/monet/build.current/sql/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/export/scratch0/lsidir/monet/build.current/sql' make: *** [all] Error 2 On Tue, Apr 14, 2009 at 12:59 PM, Martin Kersten <mlkersten(a)users.sourceforge.net> wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7426 > > Modified Files: > opt_octopus.mx > Log Message: > Silence the compilers on unused variables. > > > U opt_octopus.mx > Index: opt_octopus.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_octopus.mx,v > retrieving revision 1.29 > retrieving revision 1.30 > diff -u -d -r1.29 -r1.30 > --- opt_octopus.mx 14 Apr 2009 07:13:43 -0000 1.29 > +++ opt_octopus.mx 14 Apr 2009 10:59:52 -0000 1.30 > @@ -178,7 +178,7 @@ > OPTtentacle(Client cntxt, MalBlkPtr mb, InstrPtr pci, int start, int idx, int v2){ > MalBlkPtr tm= NULL; > InstrPtr p, q,anchor=NULL; > - int varid= pci->argv[idx],i,j,top=0, fnd, version; > + int varid= pci->argv[idx],i,j,top=0, fnd; > char buf[BUFSIZ]; > InstrPtr *list = (InstrPtr*) GDKzalloc(sizeof(InstrPtr) * mb->ssize); > char *needed= (char*) GDKzalloc(mb->vtop); > @@ -219,7 +219,6 @@ > setArgType(mb,q,0,getVarType(mb,varid)); > q= pushStr(mb,q,"tbd"); > q= pushStr(mb,q,name); > - version = newVariable(mb,GDKstrdup("version"),TYPE_int); > q= pushArgument(mb,q,v2); > needed[varid]= 1; > anchor = q; > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > High Quality Requirements in a Collaborative Environment. > Download a free trial of Rational Requirements Composer Now! > http://p.sf.net/sfu/www-ibm-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk.mx, , 1.279, 1.280 gdk_atoms.mx, , 1.161, 1.162 gdk_bat.mx, , 1.214, 1.215 gdk_batop.mx, , 1.170, 1.171 gdk_bbp.mx, , 1.252, 1.253 gdk_heap.mx, , 1.117, 1.118 gdk_qsort.mx, , 1.34, 1.35 gdk_ssort.mx, , 1.15, 1.16 gdk_utils.mx, , 1.246, 1.247
by Sjoerd Mullender 14 Apr '09

14 Apr '09

Is this a backward compatible change? In other words, can databases created before this change be read by the new version? I really want backward compatibility, so if it isn't, some kind of conversion would be needed. Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv5363/src/gdk > > Modified Files: > gdk.mx gdk_atoms.mx gdk_bat.mx gdk_batop.mx gdk_bbp.mx > gdk_heap.mx gdk_qsort.mx gdk_ssort.mx gdk_utils.mx > Log Message: > support for 32GB string heaps in 64bits/oid32 mode > (implies bat format change but ONLY for 64bits/oid32) > > src/gdk/gdk.mx > - introduce GDK_VARSHIFT, var_t (str indices) are to be shifted that > amount of bits to get to the real offset (padding is 8, in case > of 64-bits and oid32 -- otherwise it is 0 => no change) > - clean up usage of var_t in HEAP_* interface > > src/gdk/gdk_atoms.mx > - str heaps with difficult double lim distrubution do not maintain > a linked list (direct open hashing only) > - allow internal string heap hash table pointers to be unsigned shorts > instead of var_t (only switched on for 64bits/oid32) > - double-elim string heaps scaled back to 64KB (from 256-512KB) > - support for GDK_VARSHIFT > > src/gdk/gdk_bat.mx > - bugfix in 64bits/oid32 offset calculation (precision loss averted) > > src/gdk/gdk_batop.mx > src/gdk/gdk_bbp.mx > src/gdk/gdk_qsort.mx > src/gdk/gdk_ssort.mx > - support for GDK_VARSHIFT > > src/gdk/gdk_heap.mx > - HEAPmargin allocates large VM area after a block alloc in 64-bits > (this to stimulate in-place HEAPextend without memcpy) > - clean up use of var_t/size_t in HEAP_* functions, and support for GDK_VARSHIFT > > src/gdk/gdk_utils.mx > - increase VM size for 64-bits systems to 4TB > > > > U gdk.mx > Index: gdk.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk.mx,v > retrieving revision 1.279 > retrieving revision 1.280 > diff -u -d -r1.279 -r1.280 > --- gdk.mx 3 Apr 2009 09:14:51 -0000 1.279 > +++ gdk.mx 13 Apr 2009 23:36:24 -0000 1.280 > @@ -1068,9 +1068,9 @@ > @item void > HEAP_destroy (Heap* h) > @item var_t > -HEAP_malloc (Heap* heap, var_t nbytes) > +HEAP_malloc (Heap* heap, size_t nbytes) > @item void > -HEAP_free (Heap *heap, size_t block) > +HEAP_free (Heap *heap, var_t block) > @item int > HEAP_private (Heap* h) > @item void > @@ -1111,7 +1111,7 @@ > int (*sizefcn) (ptr) /* BATatoms[].atomLen function */ > ); > > -gdk_export var_t HEAP_malloc(Heap *heap, var_t nbytes); > +gdk_export var_t HEAP_malloc(Heap *heap, size_t nbytes); > gdk_export void HEAP_free(Heap *heap, var_t block); > gdk_export var_t HEAP_private(Heap *h); > gdk_export void HEAP_checkformat(Heap *h); > @@ -1350,12 +1350,37 @@ > #define Hloc(b,p) ((b)->H->heap.base+((p)<<(b)->H->shift)) > #define Tloc(b,p) ((b)->T->heap.base+((p)<<(b)->T->shift)) > > +#if SIZEOF_VAR_T < SIZEOF_VOID_P > +/* NEW 11/4/2009: when compiled with 32-bits oids/var_t on 64-bits systems, align heap strings > + * on 8 byte boundaries always (wasting 4 padding bytes on avg). Note that in heaps where > + * duplicate elimination is succesful, such padding occurs anyway (as an aside, a better > + * implementation with two-bytes pointers in the string heap hash table, could reduce that > + * padding to avg 1 byte wasted -- see TODO below). > + * > + * This 8 byte alignment allows the offset in the fixed part of the BAT string column to be > + * interpreted as an index, which should be multiplied by 8 to get the position (VARSHIFT). The > + * overall effect is that 32GB heaps can be addressed even when oids are limited to 4Gtuples. > + * > + * In the future, we might extend this such that the string alignment is set in the BAT header > + * (columns with long strings take more storage space, but could tolerate more padding). > + * It would mostly work, only the sort routine and strPut/strLocate (which do not see the BAT > + * header) extra parameters would be needed in their APIs. > + */ > +typedef unsigned short stridx_t; > +#define GDK_VARSHIFT 3 > +#define GDK_VARALIGN (1<<GDK_VARSHIFT) > +#else > +typedef var_t stridx_t; /* TODO: should also be unsigned short, but kept at var_t not to break BAT images */ > +#define GDK_VARSHIFT 0 > +#define GDK_VARALIGN sizeof(stridx_t) > +#endif > + > #define BUNhloc(bi,p) Hloc((bi).b,p) > #define BUNtloc(bi,p) Tloc((bi).b,p) > #define BUNhpos(bi,p) (Hpos(&(bi),p)) > #define BUNtpos(bi,p) (Tpos(&(bi),p)) > -#define BUNhvar(bi,p) ((bi).b->htype?(Hbase((bi).b)+*((var_t*)BUNhloc(bi,p))):BUNhpos(bi,p)) > -#define BUNtvar(bi,p) ((bi).b->ttype?(Tbase((bi).b)+*((var_t*)BUNtloc(bi,p))):BUNtpos(bi,p)) > +#define BUNhvar(bi,p) ((bi).b->htype?(Hbase((bi).b)+((*(var_t*)BUNhloc(bi,p))<<GDK_VARSHIFT)):BUNhpos(bi,p)) > +#define BUNtvar(bi,p) ((bi).b->ttype?(Tbase((bi).b)+((*(var_t*)BUNtloc(bi,p))<<GDK_VARSHIFT)):BUNtpos(bi,p)) > #define BUNhead(bi,p) ((bi).b->hvarsized?BUNhvar(bi,p):BUNhloc(bi,p)) > #define BUNtail(bi,p) ((bi).b->tvarsized?BUNtvar(bi,p):BUNtloc(bi,p)) > > > U gdk_atoms.mx > Index: gdk_atoms.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_atoms.mx,v > retrieving revision 1.161 > retrieving revision 1.162 > diff -u -d -r1.161 -r1.162 > --- gdk_atoms.mx 7 Apr 2009 11:53:22 -0000 1.161 > +++ gdk_atoms.mx 13 Apr 2009 23:36:24 -0000 1.162 > @@ -175,7 +175,6 @@ > gdk_export int strLen(const char *s); > gdk_export int strCmp(str l, str r); > gdk_export int strNil(str s); > -gdk_export void strHeapConvert(Heap *h, int directon); > gdk_export int strElimDoubles(Heap *h); > gdk_export var_t strLocate(Heap *h, str v); > gdk_export int strCmpNoNil(unsigned char *l, unsigned char *r); > @@ -457,7 +456,7 @@ > 0, 0, > (var_t (*)(Heap *, var_t *, ptr)) strPut, 0, > (int (*)(ptr)) strLen, strHeap, > - (void (*)(Heap *, int)) strHeapConvert, 0}, > + (void (*)(Heap *, int)) 0, 0}, > }; > int GDKatomcnt = TYPE_str + 1; > > @@ -931,24 +930,25 @@ > } \ > } while (0) > > -#define GDK_STRHASHTABLE (1<<10) > +/* string heaps: > + * - strings are 8 byte aligned > + * - start with a 1024 bucket hash table > + * - heaps < 64KB are fully duplicate eliminated with this hash tables > + * - heaps >= 64KB are opportunistically (imperfect) duplicate eliminated > + * as only the last 128KB chunk is considered and there is no linked list > + * - buckets and next pointers are unsigned short "indices" > + * - indices should be multiplied by 8 and takes from ELIMBASE to get an offset > + * > + * Note that a 64KB chunk of the heap contains at most 8K 8-byte aligned > + * strings. The 1K bucket list means that in worst load, the list length is 8 (OK). > + */ > +#define GDK_STRHASHTABLE (1<<10) /* 1024 */ > #define GDK_STRHASHMASK (GDK_STRHASHTABLE-1) > -#define GDK_STRHASHSIZE (GDK_STRHASHTABLE * sizeof(var_t)) > -#define GDK_STRHASHCREDIT(h) (((var_t*) (h)->base)[GDK_STRHASHTABLE]) > +#define GDK_STRHASHSIZE (GDK_STRHASHTABLE * sizeof(stridx_t)) > +#define GDK_ELIMPOWER 16 /* 64KB is the threshold */ > #define GDK_ELIMDOUBLES(h) ((h)->free < GDK_ELIMLIMIT) > -#define GDK_ELIMLIMIT (1<<GDK_ELIMPOWER) > +#define GDK_ELIMLIMIT (1<<GDK_ELIMPOWER) /* equivalently: ELIMBASE == 0 */ > #define GDK_ELIMBASE(x) (((x) >> GDK_ELIMPOWER) << GDK_ELIMPOWER) > -#if SIZEOF_SIZE_T == SIZEOF_INT > -#define GDK_ELIMPOWER 16 /* makes for a max 64KB hash table > - * ie 256 string bytes per hash bucket > - * ~ 4 strings of UP4(8<=len<=11)=12 + 4 bytes > - */ > -#else > -#define GDK_ELIMPOWER 17 /* makes for a max 128KB hash table > - * ie 512 string bytes per hash bucket > - * ~ 5 strings of UP8(8<=len<=15)=16 + 8 bytes > - */ > -#endif > > @- Atomic ADT functions > @c > @@ -1767,46 +1767,34 @@ > Because in many typical situations lots of double string values occur > in tables, the string insertion provides automatic double elimination. > To do this, a GDK_STRHASHTABLE(=1024) bucket hashtable is hidden in the first > -4096 (8192 on 64-bit architectures) bytes of the string heap, consisting of integer offsets of the first > -string hashing to that bucket in the heap. Furthermore, the first 4(8) bytes > -before each string in the heap is an integer offset to the next string hashing > -to the same number. > +4096 bytes of the string heap, consisting an offset to the first string > +hashing to that bucket in the heap. > +These offsets are made small (stridx_t is an unsigned short) by exploiting > +the fact that the double elimination chunks are (now) 64KB, hence a short > +suffices. > > -However, in many other situations the cardinality of string columns is large, > +In many other situations the cardinality of string columns is large, > or the string values might even be unique. In those cases, our fixed-size hash > table will start to overflow quickly. Therefore, after the hash table is full > (this is measured very simplistically by looking whether the string heap exceeds a > -heap size = GDK_ELIMLIMIT -- done this way to keep compatibility with old bat images) > -we flush the hash table. If one views the string heaps as consecutive chunks > -of size GDK_ELIMLIMIT bytes, then all strings within one chunk are double-eliminated. > -There is a macro GDK_ELIMBASE(offset) that computes the base of the chunk in which > -a certain byte-offset falls. > -@- > -This is a departure from our previous policy of not looking at the hash tables at > -all after overflow occurred. The advantage of the new approach is that if we have > -a value distribution that is skewed (ie some values are very frequent), these > -values will always be double eliminated, saving a considerable amount of space. > -Disadvantage of the approach is that we always have to reserve space for the next > -pointer (4(8) byte integer offset) that is stored right in front of the string (and > -consequently have to keep all string chunks and offsets aligned to 4(8)). All this > -translates into some wasted space. However, if there are that many different strings > -that the hash table overflows, the strings must be relatively long and the relative > -storage overhead should be low. > +heap size = GDK_ELIMLIMIT = 64KB) we flush the hash table. Even more, from that moment > +on, we do not use a linked list, but a lossy hash table that just contains > +the last position for each bucket. Basically, after exceeding GDK_ELIMLIMIT, > +we get a probabilistic/opportunistic duplicate elimination mechanism, > +that only looks at the last GDK_ELIMLIMIT chunk in the heap, in a lossy way. > + > +When comparing with the previous string implementation, the biggest difference > +is that on 64-nbits bt with 32-bits oids, strings are always 8-byte aligned > +and var_t numbers are multiplied by 8 to get the true offset. The goal to do > +this is to allow 32-bits var_t on 64-bits systems to address 32GB (using string > +alignment=8). For large database, the cost of padding (4 bytes avg) is offset > +by the savings in var_t (allowing to go from 64- to 32-bits). Nothing lost there, > +and 32-bits var_t also pay in smaller OIDs and smaller hash tables, reducing memory > +pressure. For small duplicate eliminated heaps, the short indices > +used in the hash table have now allowed more buckets (2K instead of 1K) > +and average 2 bytes overhead for the next pointers instead of 6-12. Therefore > +small heaps are now more compact than before. > @- > -Notice that this mechanism enables to keep a certain linear storage property > -in the string heaps. This is important if we want to take a BATslice on a BAT > -by simply loading or @strong{mmap()}ping slices of the BAT files on disk into memory. > -This is relevant in order to process a very large BAT iteratively by taking slices > -in order to reduce memory consumption. Notice that if there are few different string > -values, the hash table has not overflowed, and the string heap size will be small > -(i.e. < GDK_ELIMLIMIT), so in those cases it is not a problem to load the entire string heap. > -If the hash table @strong{has} overflowed, we want to be able to only map a slice of the > -string heap as well. Now, given that the first string in the BAT-slice is called F1 > -and its heap offset is O1 and the last string in the slice is F2 and its > -offset is O2, then the slice we should take from the string heap is: > -@example > -GDK_ELIMBASE(F1) .. MAX(GDK_ELIMBASE(F2)+GDK_ELIMLIMIT), O2+strlen(F2)) > -@end example > The routine strElimDoubles() can be used to check whether all > strings are still being double-eliminated in the original hash-table. > Only then we know that unequal offset-integers in the BUN array means > @@ -1877,16 +1865,12 @@ > strHeap(Heap *d, size_t cap) > { > size_t size; > - var_t *h, *e; > > cap = MAX(cap, BATTINY); > - size = (GDK_STRHASHTABLE + 1) * sizeof(var_t) + MIN(GDK_ELIMLIMIT, cap * 12); > + size = GDK_STRHASHTABLE * sizeof(stridx_t) + MIN(GDK_ELIMLIMIT, cap * GDK_VARALIGN); > if (HEAPalloc(d, size, 1) >= 0) { > - d->free = GDK_STRHASHTABLE * sizeof(var_t); > - h = (var_t *) d->base; > - for (e = h; e < h + GDK_STRHASHTABLE; e++) { > - *e = 0; > - } > + d->free = GDK_STRHASHTABLE * sizeof(stridx_t); > + memset(d->base, 0, d->free); > } > } > > @@ -1923,42 +1907,10 @@ > void > strCleanHash(Heap *h, int rebuild) > { > + (void) rebuild; > if (!GDK_ELIMDOUBLES(h)) { > /* flush hash table for security */ > memset(h->base, 0, GDK_STRHASHSIZE); > - } else if (rebuild) { > - var_t xx, cur = 0, end = 0; > - str hash = (str) h->base; > - > -/* int cnt[GDK_STRHASHTABLE]; */ > - /* collect all values in one big linked list */ > - for (xx = 0; xx < GDK_STRHASHTABLE; xx++) { > - var_t yy = ((var_t *) hash)[xx]; > - > -/* cnt[xx]=0; */ > - ((var_t *) hash)[xx] = 0; /* clear hash table slot */ > - > - if (end) { > - *(var_t *) (hash + end) = yy; > - } else { > - cur = yy; > - } > - for (; yy; yy = *(var_t *) (hash + yy)) > - end = yy; > - } > - > - /* process the linked list, inserting the values again */ > - for (; cur; cur = end) { > - str val = hash + cur; > - GDK_STRHASH(val + sizeof(var_t), xx); > - xx &= GDK_STRHASHMASK; > - end = *(var_t *) val; > - *(var_t *) val = ((var_t *) hash)[xx]; > - ((var_t *) hash)[xx] = cur; > -/* cnt[xx]++; */ > - } > -/* for(xx=0; xx<GDK_STRHASHTABLE; xx++) > - if(cnt[xx]) stream_printf(GDKout, "%5d %6d", xx, cnt[xx]); */ > } > } > > @@ -1970,90 +1922,63 @@ > var_t > strLocate(Heap *h, str v) > { > - var_t *htab = (var_t *) h->base; > - var_t *l, *e; > - BUN idx; > - > - GDK_STRHASH(v, idx); > - e = htab + (idx & GDK_STRHASHMASK); > - if (*e) { > - for (l = e; *l && *l < h->free; l = (var_t *) ((char *) h->base + *l)) { > - str x = (str) ((char *) h->base + *l + sizeof(var_t)); > - > - if (GDK_STRCMP(v, x) == 0) { > - return *l + (var_t) sizeof(var_t); > - } > - } > - } > - return 0; > -} > + stridx_t *ref, *next; > > -#if SIZEOF_SIZE_T == SIZEOF_INT > -#define normal_vart_SWAP(x) ((var_t) normal_int_SWAP((int)x)) > -#else > -#define normal_vart_SWAP(x) ((var_t) long_long_SWAP((lng)x)) > -#endif > + /* search hash-table, if double-elimination is still in place */ > + BUN off; GDK_STRHASH(v, off); > + off &= GDK_STRHASHMASK; > > -/* convert the integers in the implicit hash table structure */ > -void > -strHeapConvert(Heap *h, int dir) > -{ > - var_t *htab = (var_t *) h->base; > - var_t *l, i, j; > + /* should only use strLocate iff fully double eliminated */ > + assert(GDK_ELIMBASE(h->free) == 0); > > - if (dir == CONV_HTON) { > - for (i = 0; i < GDK_STRHASHTABLE; i++) { > - for (l = htab + i; (j = *l) != 0 && j < h->free; l = (var_t *) (h->base + j)) { > - *l = normal_vart_SWAP(j); > - } > - } > - } else { > - for (i = 0; i < GDK_STRHASHTABLE; i++) { > - for (l = htab + i; (j = *l) != 0 && j < h->free; l = (var_t *) (h->base + *l)) { > - *l = normal_vart_SWAP(j); > - } > - } > + /* search the linked list */ > + for (ref = ((stridx_t *) h->base) + off; *ref; ref = next) { > + next = (stridx_t*) (h->base + *ref); > + if (GDK_STRCMP(v, (str) (next+1)) == 0) > + return (sizeof(stridx_t) + *ref) >> GDK_VARSHIFT; /* found */ > } > + return 0; > } > > var_t > strPut(Heap *h, var_t *dst, str v) > { > - var_t *l; > - size_t i = GDK_STRLEN(v); > - BUN off; > - > - /* round up to var_t-byte alignment + var_t (next pointer) */ > - size_t len = ((i + sizeof(var_t) - 1) & ~(sizeof(var_t) - 1)) + sizeof(var_t); > - size_t elimlimit = GDK_ELIMBASE(h->free) + GDK_ELIMLIMIT; > + size_t elimbase = GDK_ELIMBASE(h->free); > + size_t pad = GDK_VARALIGN - (h->free & (GDK_VARALIGN-1)); > + size_t pos, len = GDK_STRLEN(v); > + stridx_t *bucket, *ref, *next; > > /* search hash-table, if double-elimination is still in place */ > - GDK_STRHASH(v, off); > + BUN off; GDK_STRHASH(v, off); > off &= GDK_STRHASHMASK; > - for (l = ((var_t *) h->base) + off; *l && *l < h->free; l = (var_t *) (h->base + *l)) { > - str x = (str) (h->base + *l + sizeof(var_t)); > + bucket = ((stridx_t *) h->base) + off; > > - if (GDK_STRCMP(v, x) == 0) { > - *dst = *l + (var_t) sizeof(var_t); /* already in heap; do not insert! */ > - if (GDK_ELIMDOUBLES(h) == 0 && GDK_STRHASHCREDIT(h)) > - GDK_STRHASHCREDIT(h) += 4; > - return *dst; > + if (elimbase == 0) { /* small string heap (<64KB) -- fully double eliminated */ > + for (ref = bucket; *ref; ref = next) { /* search the linked list */ > + next = (stridx_t*) (h->base + *ref); > + if (GDK_STRCMP(v, (str) (next+1)) == 0) { /* found */ > + pos = sizeof(stridx_t) + *ref; > + return *dst = (pos >> GDK_VARSHIFT); > + } > } > - } > - > - /* flush the hash table if it becomes too big (implies !GDK_ELIMDOUBLES) */ > - if (h->free + len >= elimlimit) { > - /* if we are not hash-inserting anymore, h->free may no longer be var_t aligned */ > - size_t mask = h->free & (sizeof(var_t) - 1); > - > - if (mask) > - h->free += sizeof(var_t) - mask; /* realign */ > - memset(h->base, 0, GDK_STRHASHSIZE); /* start over hash inserting in a pristine hash table */ > - GDK_STRHASHCREDIT(h) = 32; /* only tolerate limited misses in the future */ > + /* is there room for the next pointer in the padding space? */ > + if (pad < sizeof(stridx_t)) > + pad += GDK_VARALIGN; /* if not, pad more */ > + } else { > + /* large string heap (>=64KB) -- opportunistic/probabilistic double elimination */ > + pos = elimbase + *bucket; > + if (GDK_STRCMP(v, (str) (h->base + pos)) == 0) { > + return *dst = (pos >> GDK_VARSHIFT); /* already in heap; do not insert! */ > + } > +#if SIZEOF_VAR_T < SIZEOF_VOID_P > + pad &= (GDK_VARALIGN-1); /* a full VARALIGN pad can be omitted */ > +#else > + pad = 0; /* only 32-bits var_t in 64-bits needs padding */ > +#endif > } > > /* check heap for space (limited to a certain maximum after which nils are inserted) */ > - if (h->free + len >= h->size) { > + if (h->free + pad + len >= h->size) { > /* Something really strange happens here, In a special case > (Pentium II Klamath, gcc version 2.96 20000731, > GNU assembler version 2.10.90 using BFD version 2.10.0.18) > @@ -2064,11 +1989,15 @@ > */ > float batmargin = (float) BATMARGIN; > float hnewsize = h->size * batmargin; > - size_t newsize = len + (size_t) hnewsize; > + size_t newsize = pad + len + (size_t) hnewsize; > > assert(newsize); > > - if (h->free + len < h->maxsize) { > + if (h->free + pad + len >= (((size_t) VAR_MAX) << GDK_VARSHIFT)) { > + GDKerror("strPut: string heaps gets larger than %dGB.\n", (((size_t) VAR_MAX) << GDK_VARSHIFT) >> 30); > + return 0; > + } > + if (h->free + pad + len < h->maxsize) { > /* if there is reserved space, first use the reserved space */ > newsize = MIN(newsize, h->maxsize); > } > @@ -2077,32 +2006,27 @@ > } > /* fill should solve initialisation problems within valgrind */ > memset(h->base + h->free, 0, h->size - h->free); > - } > > - if (!GDK_ELIMDOUBLES(h)) { > - if (GDK_STRHASHCREDIT(h) == 0) { > - /* if credits are gone, we do not hash insert at all */ > - if (h->free > VAR_MAX) { > - GDKerror("strPut: string heaps gets larger than 2GB -- too large for 32-bits oids.\n"); > - return 0; > - } > - *dst = (var_t) h->free; > - memcpy(h->base + h->free, v, i); > - h->free += i; /* in this case, we do not round to var_t either */ > - return *dst; > - } > - GDK_STRHASHCREDIT(h)--; > + /* make bucket point into the enw heap */ > + bucket = ((stridx_t *) h->base) + off; > } > > - /* insert string in hash table and copy into the heap */ > - l = (var_t *) (h->base + h->free); > - *(l++) = ((var_t *) h->base)[off]; > - assert(h->free + sizeof(var_t) <= VAR_MAX); > - ((var_t *) h->base)[off] = (var_t) h->free; > - *dst = (var_t) (h->free + sizeof(var_t)); > - h->free += len; > - memcpy((char *) l, v, i); > + /* insert string */ > + pos = h->free + pad; > + *dst = pos >> GDK_VARSHIFT; > + memcpy(h->base + pos, v, len); > + h->free += pad + len; > + > + /* maintain hash table */ > + if (elimbase == 0) { /* small string heap: link the next pointer */ > + pos -= sizeof(stridx_t); /* the stridx_t next pointer directly precedes the string */ > + *(stridx_t*) (h->base + pos) = *bucket; > + } > + *bucket = (stridx_t) (pos - elimbase); /* set bucket to the new string */ > > + if (h->free >= elimbase + GDK_ELIMLIMIT) { > + memset(h->base, 0, GDK_STRHASHSIZE); /* flush hash table */ > + } > return *dst; > } > > > U gdk_bbp.mx > Index: gdk_bbp.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_bbp.mx,v > retrieving revision 1.252 > retrieving revision 1.253 > diff -u -d -r1.252 -r1.253 > --- gdk_bbp.mx 9 Apr 2009 15:29:18 -0000 1.252 > +++ gdk_bbp.mx 13 Apr 2009 23:36:24 -0000 1.253 > @@ -2965,9 +2965,9 @@ > BATsetcount(&bs->B, 0); > > if (bs->H.vheap) > - memset(bs->H.vheap->base, 0, bs->H.vheap->free = GDK_STRHASHTABLE * sizeof(var_t)); > + memset(bs->H.vheap->base, 0, bs->H.vheap->free = GDK_STRHASHTABLE * sizeof(stridx_t)); > if (bs->T.vheap) > - memset(bs->T.vheap->base, 0, bs->T.vheap->free = GDK_STRHASHTABLE * sizeof(var_t)); > + memset(bs->T.vheap->base, 0, bs->T.vheap->free = GDK_STRHASHTABLE * sizeof(stridx_t)); > return bs; > } > BATDEBUG THRprintf(GDKout, "#BBPrecycle %d %d "SZFMT" (%d, %d %d %d) N2\n", ht, tt, cap, BATCACHE_NOTYPE(ht), BATCACHE_NOTYPE(tt), batcache_maxbuckets, bin); > > U gdk_batop.mx > Index: gdk_batop.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_batop.mx,v > retrieving revision 1.170 > retrieving revision 1.171 > diff -u -d -r1.170 -r1.171 > --- gdk_batop.mx 7 Jan 2009 14:13:48 -0000 1.170 > +++ gdk_batop.mx 13 Apr 2009 23:36:24 -0000 1.171 > @@ -1656,7 +1656,7 @@ > if (b->hkey == 0) { > /* sorted and key? */ > while (cur < end) { > - char *val = base + *(((var_t *)b->H->heap.base)+ cur); > + char *val = base + (*(((var_t *)b->H->heap.base)+ cur) << GDK_VARSHIFT); > > if (cmp(prv, val) @5= 0) { > key = FALSE; > @@ -1668,7 +1668,7 @@ > } > /* sorted? */ > while (cur < end) { > - char *val = base + *(((var_t *)b->H->heap.base)+ cur); > + char *val = base + (*(((var_t *)b->H->heap.base)+ cur) << GDK_VARSHIFT); > > if (cmp(prv, val) @5 0) { > /* record negative position info */ > > U gdk_utils.mx > Index: gdk_utils.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_utils.mx,v > retrieving revision 1.246 > retrieving revision 1.247 > diff -u -d -r1.246 -r1.247 > --- gdk_utils.mx 9 Apr 2009 18:48:25 -0000 1.246 > +++ gdk_utils.mx 13 Apr 2009 23:36:24 -0000 1.247 > @@ -382,7 +382,7 @@ > #define GDK_MEM_NULLALLOWED > > #if SIZEOF_VOID_P==8 > -#define GDK_VM_MAXSIZE LL_CONSTANT(137438953472) /* :-) a 64-bit OS: 128 GB */ > +#define GDK_VM_MAXSIZE LL_CONSTANT(4398046511104) /* :-) a 64-bit OS: 4TB */ > #else > #define GDK_VM_MAXSIZE LL_CONSTANT(1610612736) /* :-| a 32-bit OS: 1.5GB */ > #endif > > U gdk_heap.mx > Index: gdk_heap.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_heap.mx,v > retrieving revision 1.117 > retrieving revision 1.118 > diff -u -d -r1.117 -r1.118 > --- gdk_heap.mx 20 Mar 2009 11:59:57 -0000 1.117 > +++ gdk_heap.mx 13 Apr 2009 23:36:24 -0000 1.118 > @@ -75,8 +75,20 @@ > nice). > @{ > @c > -int > -HEAPalloc(Heap *h, size_t nitems, size_t itemsize) > +size_t HEAPmargin(size_t maxsize) { > + size_t ret; > +#if SIZEOF_VOID_P == 8 > + /* in 64-bits systems, try to enforce in-place realloc, but provoke the memcpy on 256MB, then 4GB */ > + size_t use = GDKvm_cursize(); > + ret = MIN(GDK_mem_maxsize, MAX(((size_t) 1) << 26, 16*maxsize)); > + if ((ret+ret) > (GDK_vm_maxsize-MIN(GDK_vm_maxsize,use))) /* only if room */ > +#endif > + ret = ((double) BATMARGIN)*maxsize - 1; /* do not waste VM on 32-bits */ > + return (1 + (MAX(maxsize,ret) >> 16)) << 16; /* round up to 64K */ > +} > + > +/* in 64-bits space, use very large margins to accomodate reallocations */ > +int HEAPalloc(Heap *h, size_t nitems, size_t itemsize) > { > char nme[PATHLENGTH], *ext = NULL; > > @@ -98,8 +110,7 @@ > /* when using anonymous vm we malloc we need 64K chunks, also we > * 20% extra malloc */ > if (h->size > GDK_mem_bigsize) { > - h->maxsize = (size_t) ((double) h->maxsize * BATMARGIN) - 1; > - h->maxsize = (1 + (h->maxsize >> 16)) << 16; > + h->maxsize = HEAPmargin(h->maxsize); > } > if (h->filename == NULL || (h->size < GDK_mmap_minsize)) { > h->storage = STORE_MEM; > @@ -169,17 +180,14 @@ > /* extend a malloced heap, possibly switching over to file-mapped storage */ > Heap bak = *h; > int can_mmap = h->filename && (size >= GDK_mem_bigsize || h->newstorage != STORE_MEM); > - int must_mmap = can_mmap && (size >= GDK_mmap_minsize || h->newstorage != STORE_MEM); > + int small_cpy = (h->size*4 < size) && (size >= GDK_mmap_minsize); > + int must_mmap = can_mmap && (small_cpy || h->newstorage != STORE_MEM); > > h->size = size; > > if (can_mmap) { > /* in anonymous vm, if have to realloc anyway, we reserve some extra space */ > - if (size > h->maxsize) { > - h->maxsize = (size_t) ((double) size * BATMARGIN); > - } > - /* when using anonymous vm we malloc we need 64K chunks */ > - h->maxsize = (1 + ((h->maxsize - 1) >> 16)) << 16; > + h->maxsize = HEAPmargin(MAX(size,h->maxsize)); > } else { > h->maxsize = size; /* for normal GDKmalloc, maxsize = size */ > } > @@ -514,9 +522,9 @@ > #define HEAPVERSION 20030408 > > typedef struct heapheader { > - var_t head; /* index to first free block */ > + size_t head; /* index to first free block */ > int alignment; /* alignment of objects on heap */ > - var_t firstblock; /* first block in heap */ > + size_t firstblock; /* first block in heap */ > int version; > int (*sizefcn) (ptr); /* ADT function to ask length */ > } HEADER32; > @@ -524,8 +532,8 @@ > typedef struct { > int version; > int alignment; > - var_t head; > - var_t firstblock; > + size_t head; > + size_t firstblock; > int (*sizefcn) (ptr); > } HEADER64; > > @@ -537,8 +545,8 @@ > typedef HEADER64 HEADER_OTHER; > #endif > typedef struct hfblock { > - var_t size; /* Size of this block in freelist */ > - var_t next; /* index of next block */ > + size_t size; /* Size of this block in freelist */ > + size_t next; /* index of next block */ > } CHUNK; > > @c > @@ -546,13 +554,13 @@ > #define roundup_4(x) (((x)+3)&~3) > #define blocksize(h,p) ((p)->size) > > -static INLINE var_t > -roundup_num(var_t number, int alignment) > +static INLINE size_t > +roundup_num(size_t number, int alignment) > { > - var_t rval; > + size_t rval; > > - rval = number + (var_t) alignment - 1; > - rval -= (rval % (var_t) alignment); > + rval = number + (size_t) alignment - 1; > + rval -= (rval % (size_t) alignment); > return rval; > } > > @@ -560,7 +568,7 @@ > HEAP_private(Heap *h) > { > (void) h; > - return (var_t) roundup_8(sizeof(HEADER)); > + return (var_t) (roundup_8(sizeof(HEADER)) >> GDK_VARSHIFT); > } > > #ifdef TRACE > @@ -568,7 +576,7 @@ > HEAP_printstatus(Heap *heap) > { > HEADER *hheader = HEAP_index(heap, 0, HEADER); > - var_t block, cur_free = hheader->head; > + size_t block, cur_free = hheader->head; > CHUNK *blockp; > > THRprintf(GDKout, "#HEAP has head " SZFMT " and alignment %d and size " SZFMT "\n", > @@ -591,7 +599,7 @@ > cur_free = blockp->next; > block += blockp->size; > } else { > - var_t size = blocksize(hheader, blockp); > + size_t size = blocksize(hheader, blockp); > > THRprintf(GDKout, "# block at " SZFMT " with size " SZFMT "\n", block, size); > block += size; > @@ -611,7 +619,7 @@ > /* > // Calculate position of first and only free block. > */ > - var_t head = roundup_num((var_t) (roundup_8(sizeof(HEADER)) + roundup_8(nprivate)), alignment); > + size_t head = roundup_num((size_t) (roundup_8(sizeof(HEADER)) + roundup_8(nprivate)), alignment); > CHUNK *headp = HEAP_index(heap, head, CHUNK); > > assert(roundup_8(sizeof(HEADER)) + roundup_8(nprivate) <= VAR_MAX); > @@ -629,7 +637,7 @@ > // Fill first free block. > */ > assert(heap->size - head <= VAR_MAX); > - headp->size = (var_t) (heap->size - head); > + headp->size = (size_t) (heap->size - head); > headp->next = 0; > #ifdef TRACE > THRprintf(GDKout, "#We created the following heap\n"); > @@ -669,9 +677,9 @@ > > > var_t > -HEAP_malloc(Heap *heap, var_t nbytes) > +HEAP_malloc(Heap *heap, size_t nbytes) > { > - var_t block, trail, ttrail; > + size_t block, trail, ttrail; > CHUNK *blockp; > CHUNK *trailp; > HEADER *hheader = HEAP_index(heap, 0, HEADER); > @@ -682,15 +690,9 @@ > > /* add space for size field */ > nbytes += hheader->alignment; > - if (hheader->alignment == 8) { > - nbytes = roundup_8(nbytes); > - } else if (hheader->alignment == 4) { > - nbytes = roundup_4(nbytes); > - } else { > - GDKfatal("HEAP_malloc: Heap structure corrupt\n"); > - } > + nbytes = roundup_8(nbytes); > if (nbytes < sizeof(CHUNK)) > - nbytes = (var_t) sizeof(CHUNK); > + nbytes = (size_t) sizeof(CHUNK); > > /* > // block -- points to block with acceptable size (if available). > @@ -718,12 +720,12 @@ > // If no block of acceptable size is found we try to enlarge the heap. > */ > if (block == 0) { > - var_t newsize; > + size_t newsize; > > assert(heap->free + MAX(heap->free, nbytes) <= VAR_MAX); > - newsize = (var_t) roundup_8(heap->free + MAX(heap->free, nbytes)); > + newsize = (size_t) roundup_8(heap->free + MAX(heap->free, nbytes)); > assert(heap->free <= VAR_MAX); > - block = (var_t) heap->free; /* current end-of-heap */ > + block = (size_t) heap->free; /* current end-of-heap */ > > #ifdef TRACE > THRprintf(GDKout, "#No block found\n"); > @@ -747,7 +749,7 @@ > > blockp->next = 0; > assert(heap->free - block <= VAR_MAX); > - blockp->size = (var_t) (heap->free - block); /* determine size of allocated block */ > + blockp->size = (size_t) (heap->free - block); /* determine size of allocated block */ > > /* > // Try to join the last block in the freelist and the newly allocated > @@ -778,7 +780,7 @@ > // TUNE: use different amount than 2*sizeof(CHUNK) > */ > if (blockp->size >= nbytes + 2 * sizeof(CHUNK)) { > - var_t newblock = block + nbytes; > + size_t newblock = block + nbytes; > CHUNK *newblockp = HEAP_index(heap, newblock, CHUNK); > > newblockp->size = blockp->size - nbytes; > @@ -800,17 +802,17 @@ > } > > block += hheader->alignment; > - return block; > + return block >> GDK_VARSHIFT; > } > > void > -HEAP_free(Heap *heap, var_t block) > +HEAP_free(Heap *heap, var_t mem) > { > HEADER *hheader = HEAP_index(heap, 0, HEADER); > CHUNK *beforep; > CHUNK *blockp; > CHUNK *afterp; > - var_t after, before; > + size_t after, before, block = mem << GDK_VARSHIFT; > > if (hheader->alignment != 8 && hheader->alignment != 4) { > GDKfatal("HEAP_free: Heap structure corrupt\n"); > @@ -884,10 +886,10 @@ > HEAP_check(Heap *heap, HeapRepair *hr) > { > HEADER *hheader = HEAP_index(heap, 0, HEADER); > - var_t head = hheader->head, alignshift = 2; > - var_t block, nwords = (var_t) ((heap->free - 1) >> 7); > + size_t head = hheader->head, alignshift = 2; > + size_t block, nwords = (size_t) ((heap->free - 1) >> 7); > int *freemask; > - var_t prevblock = 0; > + size_t prevblock = 0; > CHUNK *blockp; > > hr->alignment = hheader->alignment; > @@ -922,8 +924,8 @@ > // Walk the freelist; register them in freemask > */ > for (block = hheader->head; block != 0; block = HEAP_index(heap, block, CHUNK)->next) { > - var_t idx = block >> alignshift; > - var_t pos = idx >> 5; > + size_t idx = block >> alignshift; > + size_t pos = idx >> 5; > int mask = 1 << (idx & 31); > > if ((block <= prevblock) && (block != 0)) { > @@ -942,8 +944,8 @@ > */ > block = hheader->firstblock; > while (block < heap->free) { > - var_t idx = block >> alignshift; > - var_t pos = idx >> 5; > + size_t idx = block >> alignshift; > + size_t pos = idx >> 5; > int mask = 1 << (idx & 31); > > hr->validmask[pos] |= mask; > @@ -965,8 +967,8 @@ > // Check if there are left over free blocks > */ > for (block = hheader->head; block != 0; block = HEAP_index(heap, block, CHUNK)->next) { > - var_t idx = block >> alignshift; > - var_t pos = idx >> 5; > + size_t idx = block >> alignshift; > + size_t pos = idx >> 5; > int mask = 1 << (idx & 31); > > if (freemask[pos] & mask) { > @@ -1046,14 +1048,14 @@ > if (hheader->head > heap->free) { > hheader->head = 0; /* cut off free block */ > } else if (hheader->head) { > - var_t idx = hheader->head; > + size_t idx = hheader->head; > > while (idx) { > CHUNK *blk = HEAP_index(heap, idx, CHUNK); > > if (idx + blk->size > heap->free) { > assert(heap->free - idx <= VAR_MAX); > - blk->size = (var_t) (heap->free - idx); /* cut off illegal tail of block */ > + blk->size = (size_t) (heap->free - idx); /* cut off illegal tail of block */ > } > if (blk->next > heap->free || blk->next < (idx + blk->size) || (blk->next & (hheader->alignment - 1))) { > blk->next = 0; /* cut off next block */ > > U gdk_qsort.mx > Index: gdk_qsort.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_qsort.mx,v > retrieving revision 1.34 > retrieving revision 1.35 > diff -u -d -r1.34 -r1.35 > --- gdk_qsort.mx 7 Jan 2009 14:13:48 -0000 1.34 > +++ gdk_qsort.mx 13 Apr 2009 23:36:24 -0000 1.35 > @@ -86,6 +86,7 @@ > char *offst; /* NULL or start of varsized heap */ > int hshift; /* log2 of hs */ > int tshift; /* log2 of hs */ > + int vshift; /* shift to be applied on var_ offsets */ > unsigned hs; /* width of head record */ > unsigned ts; /* width of tail record */ > void *h; /* start of head buns */ > @@ -189,7 +190,7 @@ > #endif > #endif > > -#define offset(p) (buf->offst + *(var_t*) (p)) > +#define offset(p) (buf->offst + ((*(var_t*) (p)) << buf->vshift)) > #define direct(p) (p) > > #define any_LE(a,b) ((buf->cmp)(a,b) <= 0) > @@ -432,6 +433,7 @@ > buf.ts = (unsigned) ts; > buf.hshift = ATOMelmshift(hs); > buf.tshift = ATOMelmshift(ts); > + buf.vshift = ATOMvarsized(tpe)?GDK_VARSHIFT:0; > buf.h = h; > if (!t) > t = &x; > > U gdk_bat.mx > Index: gdk_bat.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_bat.mx,v > retrieving revision 1.214 > retrieving revision 1.215 > diff -u -d -r1.214 -r1.215 > --- gdk_bat.mx 3 Apr 2009 09:14:52 -0000 1.214 > +++ gdk_bat.mx 13 Apr 2009 23:36:24 -0000 1.215 > @@ -434,7 +434,7 @@ > BAT * > BATextend(BAT *b, BUN newcap) > { > - size_t hheap_size, theap_size; > + size_t hheap_size = newcap, theap_size = newcap; > > assert(newcap <= BUN_MAX); > BATcheck(b, "BATextend"); > @@ -453,10 +453,10 @@ > > b->batCapacity = newcap; > > - hheap_size = Hsize(b) * newcap; > + hheap_size *= Hsize(b); > if (b->H->heap.base && HEAPextend(&b->H->heap, hheap_size) < 0) > return NULL; > - theap_size = Tsize(b) * newcap; > + theap_size *= Tsize(b); > if (b->T->heap.base && HEAPextend(&b->T->heap, theap_size) < 0) > return NULL; > HASHdestroy(b); > > U gdk_ssort.mx > Index: gdk_ssort.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_ssort.mx,v > retrieving revision 1.15 > retrieving revision 1.16 > diff -u -d -r1.15 -r1.16 > --- gdk_ssort.mx 7 Jan 2009 14:13:48 -0000 1.15 > +++ gdk_ssort.mx 13 Apr 2009 23:36:24 -0000 1.16 > @@ -203,8 +203,8 @@ > } \ > } while (0) > > -#define ISLT_any(X, Y, ms) (((ms)->heap ? (*(ms)->compare)((ms)->heap + * (var_t *) (X), (ms)->heap + * (var_t *) (Y)) : (*(ms)->compare)((X), (Y))) < 0) > -#define ISLT_any_rev(X, Y, ms) (((ms)->heap ? (*(ms)->compare)((ms)->heap + * (var_t *) (X), (ms)->heap + * (var_t *) (Y)) : (*(ms)->compare)((X), (Y))) > 0) > +#define ISLT_any(X, Y, ms) (((ms)->heap ? (*(ms)->compare)((ms)->heap + ((*(var_t*) (X)) << GDK_VARSHIFT), (ms)->heap + ((*(var_t*) (Y)) << GDK_VARSHIFT)) : (*(ms)->compare)((X), (Y))) < 0) > +#define ISLT_any_rev(X, Y, ms) (((ms)->heap ? (*(ms)->compare)((ms)->heap + ((*(var_t*) (X)) << GDK_VARSHIFT), (ms)->heap + ((*(var_t*) (Y)) << GDK_VARSHIFT)) : (*(ms)->compare)((X), (Y))) > 0) > @= islt > #define ISLT_@1@2(X, Y, ms) (* (@1 *) (X) @3 * (@1 *) (Y)) > > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > High Quality Requirements in a Collaborative Environment. > Download a free trial of Rational Requirements Composer Now! > http://p.sf.net/sfu/www-ibm-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

5 4

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/scheduler run_octopus.mx, , 1.17, 1.18
by Romulo Goncalves 14 Apr '09

14 Apr '09

It was this check in who broke the compilation in SQL. Martin forgot to remove the calls for OCTOPUSdrop From sql/src/backend/monet5/sql.mx Romulo Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/scheduler > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv21275 > > Modified Files: > run_octopus.mx > Log Message: > A new round for the octopus scheduler. Code still in testing phase. > > > U run_octopus.mx > Index: run_octopus.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/scheduler/run_octopus.mx,v > retrieving revision 1.17 > retrieving revision 1.18 > diff -u -d -r1.17 -r1.18 > --- run_octopus.mx 29 Jan 2009 18:17:10 -0000 1.17 > +++ run_octopus.mx 13 Apr 2009 14:23:01 -0000 1.18 > @@ -30,17 +30,17 @@ > re-directing requests to multiple sites. If there are no sites known, > then the code is executed linearly as is. > > -The scheduler runs all tentacles asynchronously. > +The scheduler runs all tentacles asynchronously if possible. > To make our live easier, we assume that all tentacles are > grouped together in a guarded block as follows: > > @verbatim > -barrier (parallel,a):= scheduler.octopus(timeout); > -a:= octopus.tentacle_1(); > +barrier (parallel,version):= scheduler.octopus(timeout); > +a:= octopus.tentacle_1(sitename,fcnname,version); > ... > -b:= octopus.tentacle_n(); > -a:= mat.pack(a,...,b); > -exit (parallel,a); > +b:= octopus.tentacle_n(sitename,fcnname,version); > +exit (parallel,version); > +z:= mat.pack(a,...,b); > @end verbatim > > This way the MAL flow of control simplifies skipping to the end > @@ -50,27 +50,17 @@ > Allowing MAL instructions inbetween complicates our work, > because it would mean that we have to do a flow analysis. > > -To make this work the scheduler needs a list of database worker. > -For the time being, this is an explicitly administered list here. > -When the octopus scheduling is called, we check the connection with > -the remote site. If it is down, it is re-activated using Merovingian. > - > +To make this work the scheduler needs a list of databases to play with. > +For the time being this consists of all the database known > +and ending with the phrase 'sea'. > +This list is obtained through the remote module using the > +support of Merovingian. The default is to use the local > +database as a target. > @{ > @mal > -pattern scheduler.octopus(timeout:int)(:bit, :bat[:any_1,:any_2]) > +pattern scheduler.octopus(t:int)(:bit,version:int) > address OCTOPUSrun > -comment "Run the program block in parallel, but don't wait longer then t seconds"; > - > -pattern scheduler.worker(dbnme:str, usr:str, pw:str) > -address OCTOPUSworker > -comment "Add a new worker to the known list "; > -pattern scheduler.worker(dbnme:str, usr:str, pw:str, host:str, port:int) > -address OCTOPUSworker > -comment "Add a worker site to the known list "; > - > -pattern scheduler.drop(dbnme:str) > -address OCTOPUSdrop > -comment "Remove a worker from the list"; > +comment "Run the program block in parallel, but don't wait longer then t seconds. Also fix a consistent database version."; > @h > #ifndef _RUN_OCTOPUS > #define _RUN_OCTOPUS > @@ -78,7 +68,7 @@ > #include "mal_instruction.h" > #include "mal_client.h" > > -/*#define DEBUG_RUN_OCTOPUS to trace processing */ > +#define DEBUG_RUN_OCTOPUS /* to trace processing */ > > #ifdef WIN32 > #ifndef LIBRUN_OCTOPUS > @@ -91,8 +81,6 @@ > #endif > > octopus_export str OCTOPUSrun(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p); > -octopus_export str OCTOPUSworker(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p); > -octopus_export str OCTOPUSdrop(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p); > #endif /* MAL_RUN_OCTOPUS */ > > @+ Octopus scheduling implementation > @@ -108,155 +96,156 @@ > #include "remote.h" > #include "alarm.h" > > -#define SITEasleep 0 > -#define SITElocal 1 > -#define SITEremote 2 > +typedef struct REGMAL{ > + str fcn; > + struct REGMAL *nxt; > +} *Registry; > > typedef struct { > - str alias; > - str db; /* connection parameters */ > + str name; > str usr; > - str pw; > - str host; /* used when merovigian is not running */ > - int port; > - int status; /* asleep, local, remote */ > -} Site; > + str pwd; > + Registry nxt; /* list of registered queries */ > +} Sea; > > #define MAXSITES 2048 /* should become dynamic at some point */ > -static Site *sites; > -static int nrsites = 0; > +static Sea sea[MAXSITES]; > +static int nrsea = 0; > > static str > OCTOPUSdiscover(Client cntxt){ > bat b1 = 0, b2 = 0; > - BAT *b; > + BAT *l1, *l2; > + BUN p,q; > str msg = MAL_SUCCEED; > + BATiter bi; > > - (void) cntxt; > - (void) b2; > + sea[nrsea].usr = GDKstrdup("monetdb"); > + sea[nrsea].pwd = GDKstrdup("monetdb"); > + sea[nrsea++].name= GDKstrdup(GDKgetenv("gdk_dbname")); > /* determine if sites are reachable */ > msg = RMTgetList(&b1,&b2); > if ( msg != MAL_SUCCEED) > return msg; > - b = BATdescriptor(b1); > - if ( b == NULL) > + l1 = BATdescriptor(b1); > + if ( l1 == NULL) > throw(MAL,"octopus.discover","No database list available"); > - BBPunfix(b1); > + l2 = BATdescriptor(b2); > + if ( l2 == NULL){ > + BBPreleaseref(b1); > + throw(MAL,"octopus.discover","No database list available"); > + } > + /* add the databases to the working set */ > + bi= bat_iterator(l1); > + BATloop(l1,p,q){ > + str t= (str) BUNtail(bi,p); > + > + if (nrsea ==MAXSITES) break; > + if (strlen(t) >= 3 && strcmp("sea", t+strlen(t)-3) == 0){ > + sea[nrsea].usr = GDKstrdup("monetdb"); > + sea[nrsea].pwd = GDKstrdup("monetdb"); > + sea[nrsea++].name= GDKstrdup(t); > +#ifdef DEBUG_RUN_OCTOPUS > + stream_printf(cntxt->fdout,"Found site %s\n",t); > +#else > + (void) cntxt; > +#endif > + } > + } > +#ifdef DEBUG_RUN_OCTOPUS > + stream_printf(cntxt->fdout,"Seas %d\n",nrsea); > +#endif > + BBPreleaseref(b1); > + BBPreleaseref(b2); > return MAL_SUCCEED; > } > > @- > -The replica is identified by database name. The host and port > -should address a merovingian to ensure the database instance is > -started. The default is to contact the local merovingian at > -default port 50000. > +We first register the tentacle at all sites and keep > +a list of those already sent. > @c > -str > -OCTOPUSworker(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > +static int > +OCTOPUSfind(Sea s, str qry){ > + Registry r; > + for ( r= s.nxt; r; r= r->nxt) > + if ( strcmp(qry, r->fcn)==0) > + return 1; > + return 0; > +} > + > +@- > +The functions called by the octopus.exec_qry are to be > +registered at all sites. > +@c > +static str > +OCTOPUSregister(Client cntxt, MalBlkPtr mb, InstrPtr p) > { > - int idx; > + int i; > + str conn, fname, msg = MAL_SUCCEED; > + > + fname = getVarConstant(mb,getArg(p,2)).val.sval; > + for ( i= 0; i< nrsea; i++){ > + msg= RMTconnect(&conn, &sea[i].name, &sea[i].usr, &sea[i].pwd); > + if (msg ){ > + stream_printf(cntxt->fdout,"!%s\n",msg); > + GDKfree(msg); > + msg = NULL; > + continue; > + } > + if( !OCTOPUSfind(sea[i], fname) ){ > + msg = RMTregisterInternal(cntxt, conn, octopusRef, fname); > > - (void) mb; > - if (nrsites == MAXSITES) > - throw(MAL,"scheduler.worker","Too many worker"); > - mal_set_lock(mal_contextLock,"scheduler.worker"); > - if (nrsites == 0) > - sites = (Site *) GDKzalloc(sizeof(Site) * MAXSITES); > - idx = nrsites++; > - sites[idx].alias = NULL; > - sites[idx].db = GDKstrdup(*(str*) getArgReference(stk,pci,1)); > - sites[idx].usr = GDKstrdup(*(str*) getArgReference(stk,pci,2)); > - sites[idx].pw = GDKstrdup(*(str*) getArgReference(stk,pci,3)); > - if (pci->argc > 4){ > - sites[idx].host = GDKstrdup(*(str*) getArgReference(stk,pci,4)); > - sites[idx].port = *(int*) getArgReference(stk,pci,5); > - } else { > - sites[idx].host = GDKstrdup("localhost"); > - sites[idx].port = 50000; > - } > - mal_unset_lock(mal_contextLock,"scheduler.worker"); > #ifdef DEBUG_RUN_OCTOPUS > - stream_printf(cntxt->fdout,"# added worker %s %s %s %s\n", > - sites[idx].alias, sites[idx].usr, sites[idx].pw); > - sites[idx].db, sites[idx].usr, sites[idx].pw); > + stream_printf(cntxt->fdout,"octopus.%s registered at site %s\n", > + fname,sea[i].name); > + stream_printf(cntxt->fdout,"reply: %s\n",msg?msg:"ok"); > #else > - (void) cntxt; > + (void) cntxt; > #endif > - return MAL_SUCCEED; > -} > -str > -OCTOPUSdrop(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > -{ > - int i,j; > - str alias = *(str*) getArgReference(stk,pci,1); > - > - (void) cntxt; > - (void) mb; > - mal_set_lock(mal_contextLock,"scheduler.drop"); > - for (i=j=0; i<nrsites; i++){ > - if( strcmp(sites[i].alias, alias) ==0) { > - GDKfree(sites[i].alias); > - GDKfree(sites[i].db); > - GDKfree(sites[i].usr); > - GDKfree(sites[i].pw); > - GDKfree(sites[i].host); > - continue; > + if ( msg == MAL_SUCCEED){ > + Registry r= (Registry) GDKzalloc(sizeof(struct REGMAL)); > + r->fcn = GDKstrdup(getFunctionId(p)); > + r->nxt = sea[i].nxt; > + sea[i].nxt = r; > + } > } > - sites[j++] = sites[i]; > } > - nrsites = j; > - mal_unset_lock(mal_contextLock,"scheduler.drop"); > - if ( i == j ) > - throw(MAL,"scheduler.drop","Site not found"); > - return MAL_SUCCEED; > + GDKfree(conn); > + return msg; > } > @- > -The policy to check for sites is a multiphase phase process. > -First, we try to re-use a site where the operation was ran before. > -If not available, we select a non-used worker. > -If all this fails, we pick a random site to execute the plan. > +The work division looks at the system opportunities and > +replaces the target site in all instructions. > +The first policy is to simply perform round robin. > +The more advanced way is to negotiat with the remote sites. > @c > static str > -OCTOPUSexec(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > +OCTOPUSworkdivision(Client cntxt, MalBlkPtr mb, int pc) > { > - int i=0, tries= nrsites * 2; > + static int rr=0; > str msg = MAL_SUCCEED; > + InstrPtr p; > + ValPtr cst; > > -redo: > + for (; pc< mb->stop; pc++){ > + if ( nrsea >1 && rr == 0) rr++; /* ignore default */ > + p= getInstrPtr(mb,pc); > + if ( p->barrier == EXITsymbol) > + break; > + assert( isVarConstant(mb, getArg(p,1)) ); > + cst = &getVarConstant(mb, getArg(p,1)); > + if( cst->val.sval) > + GDKfree(cst->val.sval); > + cst->val.sval= GDKstrdup(sea[rr].name); > + cst->len = strlen(cst->val.sval); > #ifdef DEBUG_RUN_OCTOPUS > - stream_printf(cntxt->fdout,"octopus.exec site selected %d\n",i); > + stream_printf(cntxt->fdout,"octopus site selected %s\n",sea[rr].name); > + printInstruction(cntxt->fdout,mb,0,p,LIST_MAL_STMT); > #else > - (void) cntxt; > -#endif > - > - /* register the plan remotely */ > - msg = RMTregisterInternal(cntxt, sites[i].alias, > - getModuleId(pci), getFunctionId(pci)); > - > - /* ignore a duplicate definition */ > - if (msg != MAL_SUCCEED && !strstr(msg,"Function already defined")){ > -#ifdef DEBUG_RUN_OCTOPUS > - stream_printf(cntxt->fdout,"octopus.exec failed to register plan %s.%s at site %s\n",getModuleId(pci),getFunctionId(pci),sites[i].alias); > - stream_printf(cntxt->fdout,"reply: %s\n",msg); > -#endif > - if (--tries <= 0) > - return msg; > - goto redo; > - } > - > - /* execute the plan as an independent process thread if it is local*/ > - /* otherwise activate it on the remote site passing parameters as well */ > - msg =runMALprocess(cntxt,mb,stk, getPC(mb,pci), getPC(mb,pci)+1); > - if ( msg != MAL_SUCCEED){ > -#ifdef DEBUG_RUN_OCTOPUS > - stream_printf(cntxt->fdout,"octopus.exec failed to run remote plan\n"); > + (void) cntxt; > #endif > - if (--tries <= 0) > - return msg; > - goto redo; > + rr= (rr+1) % nrsea; > } > - > - /* if it fails, we need to find another site */ > return msg; > } > @- > @@ -270,37 +259,52 @@ > We should be careful in accessing a site that runs out > of clients or any failure. It may cause the scheduler to > wait forever. > + > +The database version should indicate to the tentacles > +if it is time to refresh their caches. > +It should be obtained from the recycler where we > +know when updates have been taken place. > @c > str > OCTOPUSrun(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p) > { > int *res = (int*) getArgReference(stk,p,0); > + int *version = (int*) getArgReference(stk,p,1); > int timeout = *(int*) getArgReference(stk,p,2); > - int j,fnd, i = getPC(mb,p); > + int j,fnd, i = getPC(mb,p), threadcnt=0; > str msg = MAL_SUCCEED; > *res = 0; /* skip the block */ > > - if ( OCTOPUSdiscover(cntxt) == 0 ){ > + *version = 0; > + > + if ( (msg= OCTOPUSdiscover(cntxt)) ){ > #ifdef DEBUG_RUN_OCTOPUS > stream_printf(cntxt->fdout,"#Run in local serial mode\n"); > #endif > *res = 1; > - return MAL_SUCCEED; > + return msg; > + } > +@- > +Register the tentacle functions at all sites. > +@c > + if (nrsea > 1) { > + for (j= i+1; j<mb->stop ; j++){ > + p= getInstrPtr(mb,j); > + if ( p->barrier == EXITsymbol ) > + break; > + msg= OCTOPUSregister(cntxt,mb,p); > + if ( msg ) > + return msg; > + } > } > + msg= OCTOPUSworkdivision(cntxt,mb,i+1); > + if ( msg ) > + return msg; > + > /* do the actual parallel work */ > for (i++; i<mb->stop && msg == MAL_SUCCEED; i++){ > p= getInstrPtr(mb,i); > - /* don't do it remote if we need arguments */ > - if ( p->retc != p->argc){ > -#ifdef DEBUG_RUN_OCTOPUS > - stream_printf(cntxt->fdout,"#Run in local serial mode due to arguments\n"); > -#endif > - *res = 1; > - return MAL_SUCCEED; > - } > - if ( p->barrier == EXITsymbol ) > - break; > - if ( getModuleId(p) == matRef && getFunctionId(p) == packRef){ > + if ( p->barrier == EXITsymbol ){ > /* collect the results */ > do{ > fnd = 0; > @@ -311,10 +315,10 @@ > #endif > MT_sleep_ms(1000); > timeout--; > - } while ( fnd < p->argc-3 && timeout > 0 ); > + } while ( fnd < threadcnt && timeout > 0 ); > if (timeout <= 0) > - throw(MAL,"scheduler.pack","Execution time out"); > - return MATpackInternal(stk,p,1); > + throw(MAL,"scheduler.octopus","Execution time out"); > + break; > } > if ( getModuleId(p) != octopusRef) > throw(MAL,"scheduler.octopus","tentacle expected"); > @@ -323,7 +327,8 @@ > #else > (void) cntxt; > #endif > - msg = OCTOPUSexec(cntxt,mb,stk,p); > + msg =runMALprocess(cntxt,mb,stk, getPC(mb,p), getPC(mb,p)+1); > + threadcnt++; > } > return msg; > } > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > High Quality Requirements in a Collaborative Environment. > Download a free trial of Rational Requirements Composer Now! > http://p.sf.net/sfu/www-ibm-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/tools stethoscope.mx, , 1.35, 1.36
by Sjoerd Mullender 14 Apr '09

14 Apr '09

Should this have been done on the stable branch? Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/tools > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30964 > > Modified Files: > stethoscope.mx > Log Message: > The arguments don't have alternatives to worry about. > > > U stethoscope.mx > Index: stethoscope.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/tools/stethoscope.mx,v > retrieving revision 1.35 > retrieving revision 1.36 > diff -u -d -r1.35 -r1.36 > --- stethoscope.mx 20 Mar 2009 13:41:48 -0000 1.35 > +++ stethoscope.mx 12 Apr 2009 20:35:37 -0000 1.36 > @@ -258,36 +258,26 @@ > }; > for(;;){ > int option_index=0; > - int c= getopt_long(argc, argv, "d:u:P:p:?:h", > + int c= getopt_long(argc, argv, "d:u:P:p:?:h:g", > long_options, &option_index); > if( c == -1) > break; > switch(c){ > case 'd': > - if (strcmp(long_options[option_index].name, "dbname") == 0) { > - dbname= optarg; > - break; > - } > + dbname= optarg; > + break; > case 'u': > - if (strcmp(long_options[option_index].name, "user") == 0) { > - user= optarg; > - break; > - } > + user= optarg; > + break; > case 'P': > - if (strcmp(long_options[option_index].name, "password") == 0) { > - password= optarg; > - break; > - } > + password= optarg; > + break; > case 'p': > - if (strcmp(long_options[option_index].name, "port") == 0) { > - portnr= atol(optarg); > - break; > - } > + portnr= atol(optarg); > + break; > case 'g': > - if (strcmp(long_options[option_index].name, "gnuplot") == 0) { > - gnuplot= TRUE; > - break; > - } > + gnuplot= TRUE; > + break; > case 'h': > if (strcmp(long_options[option_index].name, "help") == 0) { > printf("help\n"); > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > High Quality Requirements in a Collaborative Environment. > Download a free trial of Rational Requirements Composer Now! > http://p.sf.net/sfu/www-ibm-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_session.mx, , 1.186, 1.187
by Sjoerd Mullender 14 Apr '09

14 Apr '09

Should this have been done on the stable branch? Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30687 > > Modified Files: > mal_session.mx > Log Message: > On the console it could happen that a MAL syntax error caused a crash > in the next statement due to incomplete cleanup. > > > U mal_session.mx > Index: mal_session.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_session.mx,v > retrieving revision 1.186 > retrieving revision 1.187 > diff -u -d -r1.186 -r1.187 > --- mal_session.mx 2 Apr 2009 17:51:41 -0000 1.186 > +++ mal_session.mx 11 Apr 2009 07:07:48 -0000 1.187 > @@ -495,10 +495,14 @@ > table may have grown in size. > > @= restoreState > - if( c->listing) > - printFunction(c->fdout,c->curprg->def, 0, c->listing); > - MSresetVariables(c,c->curprg->def, c->glb, oldstate.vtop); > - resetMalBlk(c->curprg->def,oldstate.stop); > +{ int i; > + for ( i=1; i<c->curprg->def->vtop; i++) > + freeVariable(c->curprg->def,i); > + GDKfree(c->glb); > + c->glb = NULL; > + c->curprg->def->vtop = 1; > + MSinitClientPrg(c,"user", "main"); > +} > @c > str > MALinitClient(Client c) > @@ -511,15 +515,9 @@ > str > MALexitClient(Client c) > { > - int i; > if (c->glb && c->curprg->def->errors == 0) > garbageCollector(c, c->curprg->def, c->glb,TRUE); > - for ( i=1; i<c->curprg->def->vtop; i++) > - freeVariable(c->curprg->def,i); > - GDKfree(c->glb); > - c->glb = NULL; > - c->curprg->def->vtop = 1; > - MSinitClientPrg(c,"user", "main"); > + @:restoreState@ > return NULL; > } > > @@ -547,18 +545,20 @@ > str > MALparser(Client c) > { > - InstrPtr p; > MalBlkRecord oldstate; > > c->curprg->def->errors = 0; > oldstate = *c->curprg->def; > > prepareMalBlk(c->curprg->def, CURRENT(c)); > - if (parseMAL(c, c->curprg) || c->curprg->def->errors) { > + if (parseMAL(c, c->curprg) || c->curprg->def->errors || > + getInstrPtr(c->curprg->def, 0)->token != FUNCTIONsymbol ){; > /* just complete it for visibility */ > pushEndInstruction(c->curprg->def); > /* caught errors */ > showErrors(c); > + if( c->listing) > + printFunction(c->fdout,c->curprg->def, 0, c->listing); > @:restoreState@ > /* now the parsing is done we should advance the stream */ > c->fdin->pos += c->yycur; > @@ -577,15 +577,12 @@ > if (c->curprg->def->stop == 1) > return MAL_SUCCEED; > > - p = getInstrPtr(c->curprg->def, 0); > - if (p->token != FUNCTIONsymbol) { > - @:restoreState@ > - throw(MAL, "MAL.parser", "Function signature missing"); > - } > pushEndInstruction(c->curprg->def); > chkProgram(c->nspace, c->curprg->def); > if (c->curprg->def->errors) { > showErrors(c); > + if( c->listing) > + printFunction(c->fdout,c->curprg->def, 0, c->listing); > @:restoreState@ > throw(MAL, "MAL.parser", "Semantic errors detected"); > } > @@ -619,6 +616,7 @@ > > if (prg->def->errors > 0) { > showErrors(c); > + /* constructed MAL programs may not have been shown */ > if (c->listing ) > printFunction(c->fdout, c->curprg->def, 0, c->listing); > @:restoreState@ > @@ -651,8 +649,6 @@ > str place = getExceptionPlace(msg); > showException(getExceptionType(msg), place, getExceptionMessage(msg)); > GDKfree(place); > - if (!c->listing) > - printFunction(c->fdout, c->curprg->def, 0, c->listing); > showErrors(c); > } > MSresetVariables(c,prg->def, c->glb, 0); > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > High Quality Requirements in a Collaborative Environment. > Download a free trial of Rational Requirements Composer Now! > http://p.sf.net/sfu/www-ibm-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

[Monetdb-developers] 32GB string heaps for 64-bits/oid32
by Peter Boncz 14 Apr '09

14 Apr '09

MonetDB developers, As my Easter contribution, I just checked in changes that introduce a change in which strings are stored in BATs, that affects only the (not ver often used?) setting of 64-bits compilation with 32-bits oids. This is achieved with the configure options --enable-bits=64 --enable-oid32. By default, the oid width (used to identify tuples) follows the addressing bit with (hence 64-bits pointers and 64-bits oids). The motivation to use 32-bits oids is that many intermediates (often consisting of oid columns) and also the hash tables and the string offsets (which use the type var_t that follows oid in its width) become smaller. For those 64-bit users that are interested in reducing memory consumption, 32-bits oids will likely reduce the MonetDB memory footprint by 20-40%. Especially those who are just running out of space may benefit. Using 32-bits oids has the effect that only 4G tuples may be stored in a single (intermediate) table. The vaste majority of database problems run on a single box (as MonetDB does) have this characteristic. Regrettably, in the past, an additional resitriction (due to var_t) was that each individual string column could hold max 4GB as well. Note that MonetDB does best-effort string de-duplication in a column, so your tring data might be smaller than you think. By the way, there is no good way to get precise stats on the physical size of a column, but you can scan for .theap files in the bat/ directory of your database installation -- those are the string heaps. So, the change checked in interprets the var_t no longer as a byte offset, but an index that is multiplied by 8 (GDK_VARSHIFT=3 for 64bits/oid32, zero otherwise -- so then it is a no-op removed by the compiler even). It also means that strings in the heap are aligned on 8-byte boundaries, then. Note that strings often are aligned to 4-byte boundaries (32-bits) or 8-byte boundaries (64-bits) anyway, unless the duplicate elimination really gave up, which happens if only a very low duplicate locality exists. Also, the string heaps additionally stored pointers in the heap for the de-duplication hash-table which could lead to an avg overhead of 4 (half of 8 byte alignment) + 8 (pointer) = 12 bytes per string. The change also improves the non GDK_VARSHIFT compilation mods in reducing this overhead to 2 bytes only. For 64-bits/oid32, the overhead is 2+4, due to the forced alignment. So, in general, string storage got more compact across the board (the effect will depend on your string distribution), notehowever that for 32/32 and 64/64 the binary BAT format has *NOT* changed. No need to export and re-import. As for my original goal, for 64-bits/oid32 the effect is that a single column can now contain 32GB of (de-duplicated) string data. That aligns much better with the 4G tuple limit than the previous 4GB. I made this change actually mostly because I think oid32 reduces memory consumption, not even so much the var_t (string) offset width. Still as var_t and oid move together, I had to do something. As an alternative, we could make var_t independently configurable (such that we have 32-bits oids and 64-bits var_t). This still remains an option for the future. Another potential option for the future is to set the string alignment on a bat-for-bat (per-column) basis. This is also feasible, but would require more API changes. A final point of attention is the stability/fallout of this change. I have tried to be complete -- my changes span all our CVS repositories. However, I did not that in general the support for 64-bits/oid32 is not as perfect as it should be, as evidenced by the TestWeb. Strinking examples are queries in the src/benchmarks/ATIS (especially the simple join query seems easy to debug), and TPC-H. But in general the 64/32 column shows more red than other compilation settings. I think t=it is an interesting setting, we have used it consistently for our XMark XQuery benchmarking, and I think it also serves well for TPC-H (up to SF300) and e.g. the open streetmap data. Therefore, I think it would be worthwhile if some of these long standing M5/SQL issues that are specific to 64/32 would be fixed. thanks for your attention, Peter

1 0