- developers-list - monetdb.org

[Monetdb-developers] FreeBSD port of MonetDB Feb2009-SP1 release
by George Cox 13 Apr '09

13 Apr '09

Hi, I've just finished my first attempt at creating some ports files for the installation of MonetDB on FreeBSD. I've put them up at: http://www.gjvc.com/software/freebsd/ports/monetdb/ Please have a look and let me know what you think. Things to do include (but not limited to :-)) are: * checking the packing list for each component * adding rc.d scripts * adding monetdb user best; gjvc

2 3

[Monetdb-developers] Another big group by query
by Stefan de Konink 13 Apr '09

13 Apr '09

Hi All, Might be better to go by the mailinglist instead of adding many people to the CC. Currently I am running the latest CVS code disabled mitosis and am running the following code: CREATE TABLE "sys"."way_nds" ( "way" int NOT NULL, "idx" int NOT NULL, "to_node" int, CONSTRAINT "pk_way_nds" PRIMARY KEY ("way", "idx") ); select count(way), way, to_node from way_nds group by way, to_node having count(way) > 1; The table contains about 362420451 rows, and I realised too late there could be many results comming from it. top - 03:12:15 up 1 day, 17:28, 8 users, load average: 1.00, 1.00, 1.00 Tasks: 193 total, 1 running, 192 sleeping, 0 stopped, 0 zombie Cpu(s): 0.0%us, 0.1%sy, 0.0%ni, 94.6%id, 5.2%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 66113464k total, 39353192k used, 26760272k free, 326968k buffers Swap: 134215032k total, 94284k used, 134120748k free, 8489128k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 11856 konink 20 0 51.5g 34g 5.9g S 0.3 54.6 45:34.93 mserver5 But again the load is low, the memory empty and it seems to do so few. Is there something that would be interesting to look at? Stefan

3 7

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_bbp.mx, , 1.251, 1.252 gdk_utils.mx, , 1.244, 1.245
by Sjoerd Mullender 09 Apr '09

09 Apr '09

Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv27450 > > Modified Files: > gdk_bbp.mx gdk_utils.mx > Log Message: > gdk_utils.mx: > - performance fix: do not use malloc() on Linux either > its malloc() implementation appears to give sizable private arenas to > each new thread that performs significant malloc work; this leads > to huge memory fragmentation (especially when used with mitosis) > > gdk_bbp.mx: > - BBPtrim() should not be allowed to trim logical views > this may lead to BBPdecref errors!! Is this a bug fix that should also be applied to the stable branch? > > > U gdk_bbp.mx > Index: gdk_bbp.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_bbp.mx,v > retrieving revision 1.251 > retrieving revision 1.252 > diff -u -d -r1.251 -r1.252 > --- gdk_bbp.mx 31 Mar 2009 13:42:54 -0000 1.251 > +++ gdk_bbp.mx 9 Apr 2009 15:29:18 -0000 1.252 > @@ -1600,7 +1600,7 @@ > @{ > @h > #define BBPswappable(b) ((b) && BBP_refs((b)->batCacheid) == 0) > -#define BBPtrimmable(b) (BBPswappable(b) && !isVIEW(b) && (BBP_status((b)->batCacheid)&BBPWAITING) == 0) > +#define BBPtrimmable(b) (BBPswappable(b) && b->P->lview == 0 && isVIEW(b) == 0 && (BBP_status((b)->batCacheid)&BBPWAITING) == 0) > @- > The @%BBP_ref@ contains the amount of live references to a BAT. > These might be in recursive BATs, C or MIL variables. The count is > > U gdk_utils.mx > Index: gdk_utils.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_utils.mx,v > retrieving revision 1.244 > retrieving revision 1.245 > diff -u -d -r1.244 -r1.245 > --- gdk_utils.mx 7 Apr 2009 14:22:55 -0000 1.244 > +++ gdk_utils.mx 9 Apr 2009 15:29:18 -0000 1.245 > @@ -1053,7 +1053,6 @@ > #endif > } > size = (size + 7) & ~7; /* round up to a multiple of eight */ > -#ifndef HAVE_POSIX_FADVISE > if (size > GDK_mem_bigsize) { > size_t newsize = size + sizeof(size_t) + sizeof(size_t); > size_t newmax = MAX(*maxsize, newsize); > @@ -1068,7 +1067,6 @@ > *maxsize = newmax - (sizeof(size_t) + sizeof(size_t)); > return (void *) s; > } > -#endif > CHKMEM(size, 0); > GDKmalloc_prefixsize(s, size); > if (s == NULL) { > @@ -1205,7 +1203,6 @@ > } > } > #ifndef GDK_MEM_MISALIGN > -#ifndef HAVE_POSIX_FADVISE > else if (size <= GDK_mem_bigsize) { > void *oldblk = blk; > size_t newsize = size + 8; > @@ -1239,7 +1236,6 @@ > return blk; > } > } > -#endif > /* alloc&copy due to failed realloc (may be very big heap that needs vm) */ > #else > /* alloc&copy because we cannot trust realloc due to misalignment */ > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > High Quality Requirements in a Collaborative Environment. > Download a free trial of Rational Requirements Composer Now! > http://p.sf.net/sfu/www-ibm-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

2 2

[Monetdb-developers] monetdb-install.sh & MAKEOPTS=-j
by Stefan Manegold 07 Apr '09

07 Apr '09

Fabian, `make -j[N] install` is know not to work (in particular with MonetDB5) due to race conditions and/or dependency issues, and there is hardly any way to fix this. Hence, setting MAKEOPTS=-j[N] before calling monetdb-install.sh might (will) result in an error during make install. I propose the following (or similar) patch to omit -j[N] when calling make install (of course, the "simpler" but maybe less desireable option is to omit MAKEOPTS completely with make install ...): Index: monetweb/Assets/monetdb-install.sh =================================================================== RCS file: /ufs/monet/repository/monetweb/Assets/monetdb-install.sh,v retrieving revision 1.42 diff -u -r1.42 monetdb-install.sh --- monetweb/Assets/monetdb-install.sh 16 Mar 2009 20:27:42 -0000 1.42 +++ monetweb/Assets/monetdb-install.sh 7 Apr 2009 09:00:33 -0000 @@ -434,7 +434,7 @@ MAKE=make fi fi - ${MAKE} ${MAKEOPTS} "$@" > $QUIET + ${MAKE} "$@" > $QUIET return $? } @@ -502,8 +502,8 @@ echo " * Processing $p" > $QUIET echo $myconf > $QUIET eval "$myconf" > $QUIET || die "configuring $p failed" - emake || die "making $p failed" - emake install || die "installing $p failed" + emake ${MAKEOPTS} || die "making $p failed" + emake $(echo "${MAKEOPTS}" | sed 's|-j *[0-9]*||g') install || die "installing $p failed" popd > /dev/null done } @@ -533,7 +533,7 @@ ${DO_XQUERY+"--with-monetdb4=included"} \ ${DO_SQL+"--with-monetdb5=included"} \ ${DEBUG} - emake || die "making $p failed" + emake ${MAKEOPTS} || die "making $p failed" done } @@ -551,7 +551,7 @@ for p in ${A} ; do cd "${S}"/$p/$(get_cvs_module $p) || die "cannot find directory $p" - emake install || die "installing $p failed" + emake $(echo "${MAKEOPTS}" | sed 's|-j *[0-9]*||g') install || die "installing $p failed" done } Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk.mx, , 1.278, 1.279 gdk_bat.mx, , 1.213, 1.214 gdk_posix.mx, , 1.168, 1.169 gdk_relop.mx, , 1.161, 1.162 gdk_utils.mx, , 1.241, 1.242
by Martin Kersten 07 Apr '09

07 Apr '09

Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv31767/gdk > > Modified Files: > gdk.mx gdk_bat.mx gdk_posix.mx gdk_relop.mx gdk_utils.mx > Log Message: > various tweaks to the memory mangement > > - tune the GDK_mmap_minsize to vary between full RAM size and 128MB > (lowest when memory pressure is extreme) > > - in fetchjoin, when the optimization of string heap copying is applied > (instead of creating a new string heap and inserting into it), try > to share the heaps in virtual memory (rather than copying it) > This is possible with the logical view mechanism. > > now fetchjoin, batcopy and remap use this VM heap sharing. If we do a fetchjoin(L,R) to a table R that does not fit in memory, and the operand L has more oids then the number of pages in R then we should also sort L on the tail oids first This under the constraint that sorting L also cost some IO If you are tweaking in that area anyway, such a patch is appreciated. > > - disable vmalloc on Linux -- well actually on platforms > that do not have posix_fadvise. A bit of a hack. > >

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk.mx, , 1.278, 1.279 gdk_bat.mx, , 1.213, 1.214 gdk_posix.mx, , 1.168, 1.169 gdk_relop.mx, , 1.161, 1.162 gdk_utils.mx, , 1.241, 1.242
by Stefan Manegold 03 Apr '09

03 Apr '09

Peter, these changes lead to $ Mserver # MonetDB Server v4.29.0 # based on GDK v1.29.0 # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-2009, MonetDB B.V.. All rights reserved. # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. !ERROR: CMDfind: value not found. !ERROR: CMDfind: operation failed. !ERROR: interpret_params: int(param 1): evaluation error. MonetDB> In fact, Sjoerd fixed this yesterday in =================================================================== 2009/04/02 - sjoerd: MonetDB/src/gdk/gdk_utils.mx,1.241 Reintroduced monet_pid, gdk_mem_pagebits, and gdk_mem_bigsize into the MonetDB environment, but not through advertizing them as options. This should fix bug 2726337. =================================================================== Your checkin apparently removed this fix, again. Why? Stefan ps: page 14 of http://homepages.cwi.nl/~manegold/Presentations/MonetDBdevTTT.pdf says "Do never copy/overwrite files checked-out from CVS!" On Fri, Apr 03, 2009 at 09:14:55AM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv31767/gdk > > Modified Files: > gdk.mx gdk_bat.mx gdk_posix.mx gdk_relop.mx gdk_utils.mx > Log Message: > various tweaks to the memory mangement > > - tune the GDK_mmap_minsize to vary between full RAM size and 128MB > (lowest when memory pressure is extreme) > > - in fetchjoin, when the optimization of string heap copying is applied > (instead of creating a new string heap and inserting into it), try > to share the heaps in virtual memory (rather than copying it) > This is possible with the logical view mechanism. > > now fetchjoin, batcopy and remap use this VM heap sharing. > > - disable vmalloc on Linux -- well actually on platforms > that do not have posix_fadvise. A bit of a hack. > > > > U gdk.mx > Index: gdk.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk.mx,v > retrieving revision 1.278 > retrieving revision 1.279 > diff -u -d -r1.278 -r1.279 > --- gdk.mx 13 Mar 2009 17:58:12 -0000 1.278 > +++ gdk.mx 3 Apr 2009 09:14:51 -0000 1.279 > @@ -1048,6 +1048,7 @@ > gdk_export int HEAPextend(Heap *h, size_t size); > gdk_export int HEAPload(Heap *h, str nme, str ext, int trunc); > gdk_export int HEAPsave(Heap *h, str nme, str ext); > +gdk_export int HEAPshare(Heap *dst, Heap *src, int copy_on_write); > gdk_export int HEAPcopy(Heap *dst, Heap *src); > gdk_export int HEAPwarm(Heap *h); > gdk_export size_t HEAPsubcopy(Heap *dst, Heap *src, size_t size, size_t offset); > > U gdk_posix.mx > Index: gdk_posix.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_posix.mx,v > retrieving revision 1.168 > retrieving revision 1.169 > diff -u -d -r1.168 -r1.169 > --- gdk_posix.mx 1 Apr 2009 12:37:27 -0000 1.168 > +++ gdk_posix.mx 3 Apr 2009 09:14:52 -0000 1.169 > @@ -824,6 +824,13 @@ > } > } > } > + /* could not save anything -- reset the save_tile to the start to try all heaps again */ > + for (i = MT_mmap_next(MT_mmap_cur); i != MT_mmap_cur; i = MT_mmap_next(i)) { > + if (MT_mmap_tab[i].fd >= 0 && > + MT_mmap_tab[i].writable && > + (MT_mmap_tab[i].pincnt == 0 || MT_mmap_tab[i].len > target)) > + MT_mmap_tab[i].save_tile = 1; > + } > MT_mmap_cur = i; > } > (void) pthread_mutex_unlock(&MT_mmap_lock); > > U gdk_relop.mx > Index: gdk_relop.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_relop.mx,v > retrieving revision 1.161 > retrieving revision 1.162 > diff -u -d -r1.161 -r1.162 > --- gdk_relop.mx 30 Mar 2009 07:30:13 -0000 1.161 > +++ gdk_relop.mx 3 Apr 2009 09:14:52 -0000 1.162 > @@ -972,7 +972,13 @@ > bn->theap->filename = (str) GDKmalloc(strlen(nme) + 12); > GDKfilepath(bn->theap->filename, NULL, nme, "theap"); > } > - if (HEAPcopy(bn->theap, r->theap) < 0) { > + if (r->batRestricted == BAT_READ && HEAPshare(bn->theap, r->theap, 0) == 0) { > + int parent = r->T->parentid; > + if (!parent) parent = -r->batCacheid; > + bn->P->lview = TRUE; > + bn->T->parentid = parent; > + BBPshare(parent); > + } else if (HEAPcopy(bn->theap, r->theap) < 0) { > BBPreclaim(bn); > goto ready; > } > > U gdk_utils.mx > Index: gdk_utils.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_utils.mx,v > retrieving revision 1.241 > retrieving revision 1.242 > diff -u -d -r1.241 -r1.242 > --- gdk_utils.mx 2 Apr 2009 08:44:03 -0000 1.241 > +++ gdk_utils.mx 3 Apr 2009 09:14:53 -0000 1.242 > @@ -1053,6 +1053,7 @@ > #endif > } > size = (size + 7) & ~7; /* round up to a multiple of eight */ > +#ifndef HAVE_POSIX_FADVISE > if (size > GDK_mem_bigsize) { > size_t newsize = size + sizeof(size_t) + sizeof(size_t); > size_t newmax = MAX(*maxsize, newsize); > @@ -1067,6 +1068,7 @@ > *maxsize = newmax - (sizeof(size_t) + sizeof(size_t)); > return (void *) s; > } > +#endif > CHKMEM(size, 0); > GDKmalloc_prefixsize(s, size); > if (s == NULL) { > @@ -1203,6 +1205,7 @@ > } > } > #ifndef GDK_MEM_MISALIGN > +#ifndef HAVE_POSIX_FADVISE > else if (size <= GDK_mem_bigsize) { > void *oldblk = blk; > size_t newsize = size + 8; > @@ -1236,6 +1239,7 @@ > return blk; > } > } > +#endif > /* alloc&copy due to failed realloc (may be very big heap that needs vm) */ > #else > /* alloc&copy because we cannot trust realloc due to misalignment */ > @@ -1446,7 +1450,9 @@ > } > } > > -#ifndef WIN32 > +#ifdef HAVE_POSIX_FADVISE > +static str highload_name[] = { "idle", "low", "medium", "high", "extreme" }; > + > static int membits = 0; > static void > GDKvmtrim(void *limit) > @@ -1458,21 +1464,25 @@ > /* compute rounded down log2 of memsize */ > size_t s = GDK_mem_maxsize_max; > while((s >>= 1) > 0) membits++; > + membits = (MAX(0,membits-27))/4; > } > - > do { > stream *fp = NULL; > - > MT_sleep_ms(highload ? 500 : 5000); > MEMDEBUG { > fp = GDKout; > - THRprintf(fp, "#GDKvmtrim(" LLFMT ")\n", (long long) *(size_t *) limit); > + THRprintf(fp, "#GDKvmtrim(load=%s, rsstarget=" SZFMT ", GDK_mmap_minsize=" SZFMT ")\n", > + highload_name[highload], *(size_t *) limit, GDK_mmap_minsize); > } > highload = MT_mmap_trim(*(size_t *) limit, fp); > if (highload) { /* memcrunch distress varies from 1 to 4 */ > /* rss is above 0.75mem_maxsize!! start using mmap-on-tempfile */ > if (!bak_mmap_minsize) bak_mmap_minsize = GDK_mmap_minsize; > - GDK_mmap_minsize = ((size_t) 1) << (membits-(highload+highload)); /* HEAPalloc/extend > [256-16]MB uses it */ > + /* minsize = memsize iff highload = 0 > + * = ..in between.. iff highload = 1-3 > + * = 128MB iff highload = 4 > + */ > + GDK_mmap_minsize = ((size_t) 1) << (27 + membits*(4-highload)); > } else if (bak_mmap_minsize) { > GDK_mmap_minsize = bak_mmap_minsize; /* revert to default setting */ > bak_mmap_minsize = 0; > @@ -1490,7 +1500,6 @@ > char *p; > opt *n; > int i, j, nlen = 0; > - char buf[16]; > > /* some sanity checks (should also find if symbols are not defined) */ > assert(sizeof(char) == SIZEOF_CHAR); > @@ -1606,20 +1615,8 @@ > } > if (GDKgetenv_isyes("gdk_embedded") || GDKgetenv_isyes("embedded")) > GDKembedded = 1; > - if (GDKgetenv("gdk_mem_pagebits") == NULL) { > - snprintf(buf, sizeof(buf), "%d", GDK_mem_pagebits); > - GDKsetenv("gdk_mem_pagebits", buf); > - } > - if (GDKgetenv("gdk_mem_bigsize") == NULL) { > - snprintf(buf, sizeof(buf), SZFMT, GDK_mem_bigsize); > - GDKsetenv("gdk_mem_bigsize", buf); > - } > - if (GDKgetenv("monet_pid") == NULL) { > - snprintf(buf, sizeof(buf), "%d", (int) getpid()); > - GDKsetenv("monet_pid", buf); > - } > > -#ifndef WIN32 > +#ifdef HAVE_POSIX_FADVISE > if (!GDKembedded && GDK_vm_trim) { > MT_Id t; > > > U gdk_bat.mx > Index: gdk_bat.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_bat.mx,v > retrieving revision 1.213 > retrieving revision 1.214 > diff -u -d -r1.213 -r1.214 > --- gdk_bat.mx 30 Mar 2009 07:30:07 -0000 1.213 > +++ gdk_bat.mx 3 Apr 2009 09:14:52 -0000 1.214 > @@ -670,11 +670,9 @@ > as rcopy(). > @{ > @c > -static int > -heapcopy(Heap *dst, Heap *src, int *remap) > -{ > - if (*remap && src->storage == STORE_MMAP) { > - /* use copy-on-write mmap for isolatable copy */ > +int HEAPshare(Heap *dst, Heap *src, int copy_on_write) { > + /* use copy-on-write mmap for isolatable copy */ > + if (src->storage == STORE_MMAP) { > *dst = *src; > dst->base = (char *) -1; > dst->filename = GDKstrdup(src->filename); > @@ -682,16 +680,25 @@ > char path[PATHLENGTH]; > > GDKfilepath(path, BATDIR, dst->filename, NULL); > - dst->base = GDKmmap(path, MMAP_READ | MMAP_SEQUENTIAL | MMAP_COPY, 0, dst->maxsize); > + dst->base = GDKmmap(path, MMAP_READ | MMAP_SEQUENTIAL | (copy_on_write?MMAP_COPY:0), 0, dst->maxsize); > if (dst->base != (char *) -1) { > dst->copied = 1; > - dst->newstorage = dst->storage = STORE_PRIV; > + dst->newstorage = dst->storage = copy_on_write?STORE_PRIV:STORE_MMAP; > return 0; > } > GDKfree(dst->filename); > dst->filename = NULL; > } > } > + return -1; > +} > + > +static int > +heapcopy(Heap *dst, Heap *src, int *remap) > +{ > + if (*remap && HEAPshare(dst, src, *remap) == 0) { > + return 0; /* use a shared memory heap */ > + } > *remap = 0; > return HEAPcopy(dst, src); > } > @@ -2766,7 +2773,7 @@ > int b0, b1, b2 = 0, b3 = 0; > > /* copy-on-write isolated bats that change mode should be made independent */ > - if (b->P->lview && batunshare(b, "BATsetaccess") < 0) > + if (b->P->lview && newmode != BAT_READ && batunshare(b, "BATsetaccess") < 0) > return NULL; > > if (b->batSharecnt && newmode != BAT_READ) { > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal mat.mx, , 1.25, 1.26
by Stefan Manegold 02 Apr '09

02 Apr '09

On Wed, Apr 01, 2009 at 07:59:56PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25709 > > Modified Files: > mat.mx > Log Message: > Packing of BATs should avoid falling into the BATextend trap. > Preclaim enough space. Don't bother about the properties of the > result. That should be decided later. > This checking removes the only initialization of the pointer variable int *ret; which is then later dereferenced for assginment --- this might/will result in a segfault or other non-deterministic behavior. See details below. Stefan > > U mat.mx > Index: mat.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mat.mx,v > retrieving revision 1.25 > retrieving revision 1.26 > diff -u -d -r1.25 -r1.26 > --- mat.mx 7 Jan 2009 14:15:13 -0000 1.25 > +++ mat.mx 1 Apr 2009 19:59:50 -0000 1.26 > @@ -134,22 +134,31 @@ > The pack operation could be quite expensive, because it > may create a really large BAT. > For the experiments we materialize the BAT in the first > -component. > +component. It should be extended upfront to accomodate > +all elements. > @c > str > MATpackInternal(MalStkPtr stk, InstrPtr p,int first) > { > int i,*ret; ^^^^ > BAT *b, *bn; > + BUN cap=0; > > bn= BATdescriptor(stk->stk[getArg(p,first)].val.ival); > - if( bn == NULL) > - throw(MAL, "mat.pack","Could access BAT"); > - if (BAThrestricted(bn) || BATtrestricted(bn)) { > + if (bn && (BAThrestricted(bn) || BATtrestricted(bn)) ){ > b = BATcopy(bn, bn->htype, bn->ttype, TRUE); > BBPunfix(bn->batCacheid); > bn = b; > } > + if( bn == NULL) > + throw(MAL, "mat.pack","Could not access BAT"); > + > + for(i=first; i<p->argc; i++){ > + b= BATdescriptor(stk->stk[getArg(p,i)].val.ival); > + cap += BATcount(b); > + BBPunfix(b->batCacheid); > + } > + bn = BATextend(bn, cap); > for(i=first+1; i<p->argc; i++){ > b= BATdescriptor(stk->stk[getArg(p,i)].val.ival); > if( b == NULL) > @@ -158,12 +167,6 @@ > BATins(bn,b,FALSE); > BBPunfix(b->batCacheid); > } > - if (bn->htype == TYPE_oid && !BAThordered(bn)) { > - BAT *b = BATsort(bn); > - BBPunfix(bn->batCacheid); > - bn = b; > - } > - ret= (int*) getArgReference(stk,p,0); ^ ^^^^ > BBPkeepref(*ret = bn->batCacheid); ^^^^ > return MAL_SUCCEED; > } > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] MAL Instructions and a New Client Development
by Mohamed Saber 30 Mar '09

30 Mar '09

Hi All, I am new to MonetDB. I want to create new MonetDB commands (like the SQL) in my research project. So, I want a good reference/tutorial on the MAL instructions. After that I will do a compiler to compile my new commands to the equivalent MAL instructions. I think that the MonetDB_Manual is insufficient. If you have any reference or recommendations to achieve what I need, please let me know. I want to master the MAL language. Any help will be appreciated. Thank you so much and have a great day, Kind Regards, Mohamed Saber _________________________________________________________________ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/windows/windowslive/

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah serialize_pftijah.mx, Feb2009, 1.68.2.1, 1.68.2.2
by Stefan Manegold 30 Mar '09

30 Mar '09

On Mon, Mar 30, 2009 at 04:04:10PM +0000, Wouter Alink wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv16148 > > Modified Files: > Tag: Feb2009 > serialize_pftijah.mx > Log Message: > -- step 1 in crossing trhe oid32 boundary with PF/TIJAH: remove some casts to int. > This commit will (partially) fix bug "2722117 PF/TIJAH: dbat_finalize fails". Cetero senseo: never (down-)cast unless it is strictly required and you have strictly ensured/asserted that the actual value of the (larger) source type at all times fits into the range of the (smaller) target type. In fact, I made the experiences that avoiding casts as far as possible (e.g.) by consistently using the "proper" types, keeps the code much cleaner, more maintainable and less error prone, giving the compilers a chance to warn us about potential over/underflows in case we accidently assign/use non-matching types ... ;-) Stefan ps: Just sharing my experiences and lessons I learned, no "blame" at all! ;-) > The fix was suggested by Henning/JanF, and seems to at least partially fix the indexing of a 30GB XML document. A new bug "2722117 PF/TIJAH: dbat_finalize fails" has been filed with the next issue. Bug "2722117" can be closed. No test can be created as the data is simply too large. > > > > U serialize_pftijah.mx > Index: serialize_pftijah.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/serialize_pftijah.mx,v > retrieving revision 1.68.2.1 > retrieving revision 1.68.2.2 > diff -u -d -r1.68.2.1 -r1.68.2.2 > --- serialize_pftijah.mx 25 Mar 2009 13:17:56 -0000 1.68.2.1 > +++ serialize_pftijah.mx 30 Mar 2009 16:04:08 -0000 1.68.2.2 > @@ -982,7 +982,7 @@ > --tjctx->doc_height; > oid start = tj_popTag(tjctx); /* oid of the first node of the element */ > int size = tjctx->tijahPre - start - 1; /* the Tijah document size */ > - dbat_set_int(&tjctx->dbat_collSize,(int)start,size); > + dbat_set_int(&tjctx->dbat_collSize,start,size); > #else > (void) ctx; > #endif > @@ -1136,7 +1136,7 @@ > if ( DOEMIT(tjctx) ) { > oid start = tj_popTag(tjctx); /* oid of the first node of the element */ > int size = tjctx->tijahPre - start - 1; /* the Tijah element size */ > - dbat_set_int(&tjctx->dbat_collSize,(int)start,size); > + dbat_set_int(&tjctx->dbat_collSize,start,size); > }; > #ifdef TJ_TRACE > if ( TJ_TRACE ) stream_printf(GDKout,"C[%s]:empty_endElement: \"%s\"\n", tjctx->name,""); > @@ -1167,7 +1167,7 @@ > if ( DOEMIT(tjctx) ) { > oid start = tj_popTag(tjctx); /* oid of the first node of the element */ > int size = tjctx->tijahPre - start - 1; /* the Tijah element size */ > - dbat_set_int(&tjctx->dbat_collSize,(int)start,size); > + dbat_set_int(&tjctx->dbat_collSize,start,size); > #ifdef TJ_TRACE > if ( TJ_TRACE ) stream_printf(GDKout,"C[%s]:endElement: \"%s\"\n", tjctx->name,name); > #endif > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/common monet_options.mx, , 1.32, 1.33
by Roberto Cornacchia 30 Mar '09

30 Mar '09

Oh thanks!! That is really handy! :) On Mon, 2009-03-30 at 14:51 +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB/src/common > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv4062/src/common > > Modified Files: > monet_options.mx > Log Message: > If the logdir argument to logger_create is a relative path name, the > logdir will be located inside the dbfarm/dbname directory. If it is > an absolute path name, that path is used. > > The default log directory for both SQL and XQuery have been changed > accordingly. > > This change puts the complete database in one location. -- | M.Sc. Roberto Cornacchia | CWI (Centrum voor Wiskunde en Informatica) | Science Park 123, 1098XG Amsterdam, The Netherlands | tel: +31 20 592 4322 , http://www.cwi.nl/~roberto

1 0

[Monetdb-developers] Fix for enable-jdbc enable-xrpcwrapper arguments of MonetDB-java
by Yue Sheng 26 Mar '09

26 Mar '09

Hi, The configure script for MonetDB-java uses the macro AC_ARG_ENABLE for its commandline arguments, but uses $withval instead of $enableval within that macro. The attached patch should fix the issue. It applies to Feb2009-SP1 bug fix release of the MonetDB suite. Thanks.

2 1

[Monetdb-developers] Announcement: New bug fix release of MonetDB suite
by Sjoerd Mullender 26 Mar '09

26 Mar '09

The MonetDB team at CWI is pleased to announce the Feb2009-SP1 bug fix release of the MonetDB suite of programs. This is a bug fix release of last month's Feb2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Feb2009/#Feb200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[Monetdb-developers] do_not_use_posix_fadvise
by Stefan de Konink 23 Mar '09

23 Mar '09

Hi, What is the rationale to enable or disable fadvise explicitly? do_not_use_posix_fadvise = uname(&ubuf) == 0 && strcmp(ubuf.sysname, "Linux") == 0 && strncmp(ubuf.release, "2.4", 3) <= 0; Answers as "it doesn't work" will not satisfy my hunger to this answer; because I do see a completely different performance upon manual changing this variable. Stefan

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/algebra algopt.c, Feb2009, 1.46.2.4, 1.46.2.5
by Stefan Manegold 20 Mar '09

20 Mar '09

On Fri, Mar 20, 2009 at 09:58:04AM +0000, Bastian Brodbeck wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/algebra > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13909/compiler/algebra > > Modified Files: > Tag: Feb2009 ^^^^^^^ > algopt.c > Log Message: > adding new optimization -Y ^^^^^^^^^^^^^^^^^^^^^^^^^^ is this a bug fix or a new feature? If the latter (as I suspect), please undo this checking on the Feb2009 branch and redo it on the development trunk (HEAD), using only CVS commands, as, e.g., discribed on page 15 of http://homepages.cwi.nl/~manegold/Presentations/MonetDBdevTTT.pdf (pages 8 - 16 might be interesting) Thanks! Stefan > this optimization pushes projection up in the tree to minimize them. > the goal is to simplify the tree for other optimizations > > > U algopt.c > Index: algopt.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/algebra/algopt.c,v > retrieving revision 1.46.2.4 > retrieving revision 1.46.2.5 > diff -u -d -r1.46.2.4 -r1.46.2.5 > --- algopt.c 6 Feb 2009 14:48:45 -0000 1.46.2.4 > +++ algopt.c 20 Mar 2009 09:58:02 -0000 1.46.2.5 > @@ -179,6 +179,19 @@ > PFlog (" MonetDB specific optimizations: %s", > PFtimer_str (tm)); > break; > + > + case 'Y': > + /*REMOVE_PROXIES("MonetDB specific optimization")*/ > + > + tm = PFtimer_start (); > + > + root = PFalgopt_projection (root); > + > + tm = PFtimer_stop (tm); > + if (timing) > + PFlog (" project optimizations: %s", > + PFtimer_str (tm)); > + break; > > case 'E': > MAP_UNQ_NAMES("common subexpression elimination") > > > ------------------------------------------------------------------------------ > Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are > powering Web 2.0 with engaging, cross-platform capabilities. Quickly and > easily build your RIAs with Flex Builder, the Eclipse(TM)based development > software that enables intelligent coding and step-through debugging. > Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/algebra/opt Makefile.ag, Feb2009, 1.19.2.2, 1.19.2.3
by Sjoerd Mullender 20 Mar '09

20 Mar '09

This sounds like a new feature which is not allowed in the Stable branch. Bastian Brodbeck wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/algebra/opt > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13909/compiler/algebra/opt > > Modified Files: > Tag: Feb2009 > Makefile.ag > Log Message: > adding new optimization -Y > this optimization pushes projection up in the tree to minimize them. > the goal is to simplify the tree for other optimizations > > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/algebra/opt/Makefile.ag,v > retrieving revision 1.19.2.2 > retrieving revision 1.19.2.3 > diff -u -d -r1.19.2.2 -r1.19.2.3 > --- Makefile.ag 6 Feb 2009 14:47:47 -0000 1.19.2.2 > +++ Makefile.ag 20 Mar 2009 09:58:02 -0000 1.19.2.3 > @@ -47,6 +47,7 @@ > opt_key.c \ > opt_monetxq.c \ > opt_mvd.c \ > + opt_projection.c \ > opt_req_node.c \ > opt_reqval.c \ > opt_rank.c \ > > > ------------------------------------------------------------------------------ > Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are > powering Web 2.0 with engaging, cross-platform capabilities. Quickly and > easily build your RIAs with Flex Builder, the Eclipse(TM)based development > software that enables intelligent coding and step-through debugging. > Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/mil milprint.c, , 1.93, 1.94
by Stefan Manegold 13 Mar '09

13 Mar '09

Jan F (and Jan R), or should my fix (below) rather have looked like this: Index: pathfinder/compiler/mil/milprint.c =================================================================== RCS file: /cvsroot/monetdb/pathfinder/compiler/mil/milprint.c,v retrieving revision 1.93 diff -u -r1.93 milprint.c --- pathfinder/compiler/mil/milprint.c 10 Mar 2009 12:20:44 -0000 1.93 +++ pathfinder/compiler/mil/milprint.c 13 Mar 2009 08:39:16 -0000 @@ -429,7 +429,7 @@ , [m_egsum] = "{sum}" , [m_prod] = "prod" , [m_gprod] = "{prod}" - , [m_gprod] = "{prod}" + , [m_egprod] = "{prod}" , [m_bat] = "bat" , [m_catch] = "CATCH" , [m_error] = "ERROR" ? Thanks! Stefan On Fri, Mar 13, 2009 at 08:37:07AM +0000, Stefan Manegold wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/mil > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12904/pathfinder/compiler/mil > > Modified Files: > milprint.c > Log Message: > > fixing compilation error > > .../pathfinder/compiler/mil/milprint.c:433: error: initialized field overwritten > .../pathfinder/compiler/mil/milprint.c:433: error: (near initialization for ‘ID[111]’) > > there is no need to initialize the same field twice with the same value > > > U milprint.c > Index: milprint.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/mil/milprint.c,v > retrieving revision 1.93 > retrieving revision 1.94 > diff -u -d -r1.93 -r1.94 > --- milprint.c 10 Mar 2009 12:20:44 -0000 1.93 > +++ milprint.c 13 Mar 2009 08:37:05 -0000 1.94 > @@ -429,7 +429,6 @@ > , [m_egsum] = "{sum}" > , [m_prod] = "prod" > , [m_gprod] = "{prod}" > - , [m_gprod] = "{prod}" > , [m_bat] = "bat" > , [m_catch] = "CATCH" > , [m_error] = "ERROR" > > > ------------------------------------------------------------------------------ > Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are > powering Web 2.0 with engaging, cross-platform capabilities. Quickly and > easily build your RIAs with Flex Builder, the Eclipse(TM)based development > software that enables intelligent coding and step-through debugging. > Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 1

[Monetdb-developers] SourceForge unplanned downtime
by Sjoerd Mullender 11 Mar '09

11 Mar '09

We can't use CVS at the moment. According to the SourceForge site status page: "2009-03-10: Service CVS unplanned downtime March 10th, 2009 CVS repositories that begin with the letters (a e h i m o r w z) are experiencing unplanned downtime since 2009-03-10 18:00 UTC. SourceForge.net staff are actively working to resolve the issue and anticipate having the service returned sometime in the next 2 days." -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [MonetDB-users] too deep recursion
by Jan Rittinger 10 Mar '09

10 Mar '09

On Mar 9, 2009, at 23:35, Martin Kersten wrote: > > Please run it also against the HEAD, because most of the problems > may have been resolved there. > > Jan Rittinger wrote: >> Hi Martin and others, >> I just tested what part the Pathfinder code generation plays and >> generated MIL code for the Aug2008 (0.24), the Nov2008, and the >> Feb2009 release branches. I ran all queries using the newest stable >> version (Feb2009) on Mac OS X. >> The observations are: >> * The problem with gdk_heap.mx, mmap, and Mac OS X still resides >> (all queries run in 10 seconds instead of 2 seconds)---Peter knows >> what I'm talking about. >> * Like Nils reported the queries are getting slower. >> * The main performance decrease in my scenario is the document >> loading. >> * The problem does not stem from Pathfinder's MIL code generation. >> For more details see the attached file... >> ------------------------------------------------------------------------ >> BTW: For todays' head version the results are even worse... ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Attached you find a bundle with the queries and the test results. (I'm using a Macbook Pro 2.6GHz Intel Core 2 Duo with 4GB of RAM running Mac OS X 10.5.6.) >> >> Jan >> On Mar 9, 2009, at 18:08, Martin Kersten wrote: >>> For all interested. Indeed there are performance differences >>> between the various releases. Some can be traced back to >>> functional enhancements, others are a result from internal >>> administrative activities. >>> >>> Recent experiments with the TPC-H scale-factor 2 on Feb 2009 >>> branch show a performance degradation compared to Aug 2008, >>> as reported on the website. >>> >>> It appears that some low-level actions related to allocation >>> of BATs and their management in memory-scarce situations are >>> debet to this situation. >>> >>> Solutions are integrated with the HEAD, and may (depending >>> on our resources) be back propagated into a bugfix release >>> of the Feb 2009 version. >>> >>> Nils Grimsmo wrote: >>>> On Wed, Mar 04, 2009 at 11:08:40PM +0100, Jan Rittinger wrote: >>>>> Hi Nils, >>>>> >>>>> I just ran your queries with the latest (not yet announced) >>>>> Feb2009 >>>>> release (http://monetdb.cwi.nl/downloads/sources/Feb2009/) and >>>>> received an answer in 1.5 (Q1) and 2.5 (Q2) seconds. If you >>>>> still have >>>>> problems with the new version, then please let us know. >>>> >>>> Thank you for your answer, Jan. Feb2009 is indeed faster than >>>> Nov2008, >>>> but on my computer it is still slower than Aug2008. I also see >>>> some >>>> strange and unfavorable performance characteristics on subsequent >>>> queries >>>> for Nov2008 and Feb2009 (see below). >>>> >>>> >>>> Aug2008: >>>> # MonetDB Server v4.24.0 >>>> # based on GDK v1.24.0 >>>> # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/ >>>> pftijah >>>> # MonetDB/XQuery module v0.24.0 loaded (default back-end is >>>> 'algebra') >>>> >>>> Nov2008-SP2: >>>> # MonetDB Server v4.26.4 >>>> # based on GDK v1.26.4 >>>> # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/ >>>> pftijah >>>> # MonetDB/XQuery module v0.26.4 loaded (default back-end is >>>> 'algebra') >>>> >>>> Feb2009: >>>> # MonetDB Server v4.28.0 >>>> # Based on GDK v1.28.0 >>>> # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/ >>>> pftijah >>>> # MonetDB/XQuery module v0.28.0 loaded (default back-end is >>>> 'algebra') >>>> >>>> >>>> I run the queries multiple times in different scenarios. >>>> >>>> A - Have just indexed the document, first run. >>>> B - Second run (subsequent have similar timing). >>>> C - Restart the server (Mserver), then first run. >>>> D - Second run (subsequent have similar timing). >>>> >>>> >>>> Query Q0: >>>> Aug2008 Nov2008 Feb2009 >>>> A 1101 3687 1760 >>>> B 1031 4510 3015 >>>> C 1350 5216 3390 >>>> D 1035 12620 9533 >>>> >>>> >>>> Query Q1: >>>> Aug2008 Nov2008 Feb2009 >>>> A 2161 15119 3013 >>>> B 2099 19292 4072 >>>> C 2526 18523 4567 >>>> D 2117 42555 10602 >>>> >>>> >>>> This seems very strange to me. The timings make sense for >>>> Aug2008, where >>>> the query is slightly slower right after restarting the server >>>> (C). For >>>> Nov2008 and Feb2009, the second (and subsequent) runs are slower >>>> than the >>>> first. How can this be? It can make sense for the first run after >>>> restarting the server (C) to be slower (reading stuff from disk >>>> etc.), but >>>> why is the second (D) terribly slower? If I just keep running >>>> the query, >>>> the timings are similar to D. >>>> >>>> Note: If I start mixing Q0 and Q1 after step D, they are both as >>>> slow as >>>> in step D. >>>> >>>> >>>> I hope this feedback is helpful. Is there something strange with >>>> my >>>> setup, or is this a "bug"? (My timings in step (A) seem similar >>>> to Jan's >>>> timings). >>>> >>>> >>>> If I want to compare MonetDB/XQuery to other implementations in a >>>> scientific paper, I typically want to warm up the system, then >>>> run the >>>> query multiple times to get an average timing. It is kind of >>>> inconvenient >>>> not to be able to close down Mserver between experiments... >>>> >>>> >>>>> P.S.: The E-Mail subject seems slightly off topic here :) >>>> >>>> Yes, thought I'd avoid touching the mouse to copy the email >>>> address. Cut >>>> away In-Reply-To:, but forgot to change Subject:... >>>> >>>> >>>> Thank you for your assistance! >>>> >>>> >>>> Klem fra Nils >>>> >>>>> On Mar 4, 2009, at 16:30, Nils Grimsmo wrote: >>>>> >>>>>> Hi, I just upgraded from the Augst to the Noveber super-ball, >>>>>> and the >>>>>> performance has worsened badly. >>>>>> >>>>>> Example queries on dblp.xml (441 MB): >>>>>> >>>>>> Q0: count(/dblp//author[text()="Michael Stonebraker"]) >>>>>> Q1: count(/dblp/*/author[text()="Michael Stonebraker"]) >>>>>> >>>>>> Query time in milliseconds: >>>>>> >>>>>> August November >>>>>> Q0 1100 4867 >>>>>> Q1 3993 17999 >>>>>> >>>>>> I have compiled with --enable-optimise both times. I query with: >>>>>> >>>>>> mclient --language=xquery --algebra --time < $QUERYFILE >>>>>> >>>>>> Is this performance degradation expected? If so, why? >>>>>> >>>>>> >>>>>> BTW: Is there any way of finding how much disk space a >>>>>> collection >>>>>> uses? >>>>>> >>>>>> >>>>>> Thank you for contributing free software! >>>>>> >>>>>> >>>>>> Klem fra Nils -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

1 0

Re: [Monetdb-developers] [MonetDB-users] too deep recursion
by Jan Rittinger 09 Mar '09

09 Mar '09

Hi Martin and others, I just tested what part the Pathfinder code generation plays and generated MIL code for the Aug2008 (0.24), the Nov2008, and the Feb2009 release branches. I ran all queries using the newest stable version (Feb2009) on Mac OS X. The observations are: * The problem with gdk_heap.mx, mmap, and Mac OS X still resides (all queries run in 10 seconds instead of 2 seconds)---Peter knows what I'm talking about. * Like Nils reported the queries are getting slower. * The main performance decrease in my scenario is the document loading. * The problem does not stem from Pathfinder's MIL code generation. For more details see the attached file... BTW: For todays' head version the results are even worse... Jan On Mar 9, 2009, at 18:08, Martin Kersten wrote: > For all interested. Indeed there are performance differences > between the various releases. Some can be traced back to > functional enhancements, others are a result from internal > administrative activities. > > Recent experiments with the TPC-H scale-factor 2 on Feb 2009 > branch show a performance degradation compared to Aug 2008, > as reported on the website. > > It appears that some low-level actions related to allocation > of BATs and their management in memory-scarce situations are > debet to this situation. > > Solutions are integrated with the HEAD, and may (depending > on our resources) be back propagated into a bugfix release > of the Feb 2009 version. > > Nils Grimsmo wrote: >> On Wed, Mar 04, 2009 at 11:08:40PM +0100, Jan Rittinger wrote: >>> Hi Nils, >>> >>> I just ran your queries with the latest (not yet announced) Feb2009 >>> release (http://monetdb.cwi.nl/downloads/sources/Feb2009/) and >>> received an answer in 1.5 (Q1) and 2.5 (Q2) seconds. If you still >>> have >>> problems with the new version, then please let us know. >> >> Thank you for your answer, Jan. Feb2009 is indeed faster than >> Nov2008, >> but on my computer it is still slower than Aug2008. I also see some >> strange and unfavorable performance characteristics on subsequent >> queries >> for Nov2008 and Feb2009 (see below). >> >> >> Aug2008: >> # MonetDB Server v4.24.0 >> # based on GDK v1.24.0 >> # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah >> # MonetDB/XQuery module v0.24.0 loaded (default back-end is >> 'algebra') >> >> Nov2008-SP2: >> # MonetDB Server v4.26.4 >> # based on GDK v1.26.4 >> # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah >> # MonetDB/XQuery module v0.26.4 loaded (default back-end is >> 'algebra') >> >> Feb2009: >> # MonetDB Server v4.28.0 >> # Based on GDK v1.28.0 >> # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah >> # MonetDB/XQuery module v0.28.0 loaded (default back-end is >> 'algebra') >> >> >> I run the queries multiple times in different scenarios. >> >> A - Have just indexed the document, first run. >> B - Second run (subsequent have similar timing). >> C - Restart the server (Mserver), then first run. >> D - Second run (subsequent have similar timing). >> >> >> Query Q0: >> Aug2008 Nov2008 Feb2009 >> A 1101 3687 1760 >> B 1031 4510 3015 >> C 1350 5216 3390 >> D 1035 12620 9533 >> >> >> Query Q1: >> Aug2008 Nov2008 Feb2009 >> A 2161 15119 3013 >> B 2099 19292 4072 >> C 2526 18523 4567 >> D 2117 42555 10602 >> >> >> This seems very strange to me. The timings make sense for Aug2008, >> where >> the query is slightly slower right after restarting the server >> (C). For >> Nov2008 and Feb2009, the second (and subsequent) runs are slower >> than the >> first. How can this be? It can make sense for the first run after >> restarting the server (C) to be slower (reading stuff from disk >> etc.), but >> why is the second (D) terribly slower? If I just keep running the >> query, >> the timings are similar to D. >> >> Note: If I start mixing Q0 and Q1 after step D, they are both as >> slow as >> in step D. >> >> >> I hope this feedback is helpful. Is there something strange with my >> setup, or is this a "bug"? (My timings in step (A) seem similar to >> Jan's >> timings). >> >> >> If I want to compare MonetDB/XQuery to other implementations in a >> scientific paper, I typically want to warm up the system, then run >> the >> query multiple times to get an average timing. It is kind of >> inconvenient >> not to be able to close down Mserver between experiments... >> >> >>> P.S.: The E-Mail subject seems slightly off topic here :) >> >> Yes, thought I'd avoid touching the mouse to copy the email >> address. Cut >> away In-Reply-To:, but forgot to change Subject:... >> >> >> Thank you for your assistance! >> >> >> Klem fra Nils >> >>> On Mar 4, 2009, at 16:30, Nils Grimsmo wrote: >>> >>>> Hi, I just upgraded from the Augst to the Noveber super-ball, and >>>> the >>>> performance has worsened badly. >>>> >>>> Example queries on dblp.xml (441 MB): >>>> >>>> Q0: count(/dblp//author[text()="Michael Stonebraker"]) >>>> Q1: count(/dblp/*/author[text()="Michael Stonebraker"]) >>>> >>>> Query time in milliseconds: >>>> >>>> August November >>>> Q0 1100 4867 >>>> Q1 3993 17999 >>>> >>>> I have compiled with --enable-optimise both times. I query with: >>>> >>>> mclient --language=xquery --algebra --time < $QUERYFILE >>>> >>>> Is this performance degradation expected? If so, why? >>>> >>>> >>>> BTW: Is there any way of finding how much disk space a collection >>>> uses? >>>> >>>> >>>> Thank you for contributing free software! >>>> >>>> >>>> Klem fra Nils -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

1 0

[Monetdb-developers] Possible bug in MonetDB and JDBC driver in sequence management
by Cimballi 09 Mar '09

09 Mar '09

Hi, I'm a recent user of MonetDB. I'm using it to store data from XML files from "http://oasissta.caiso.com/". I parse the XML files and I insert the data into MonetDB using the JDBC driver (1.9). I make a batch insert of each xml data element. The ID column of my table is a sequence I created like this : CREATE TABLE "oasis_report_data" ( "oasis_report_data_id" INT NOT NULL, "oasis_report_header_id" INT NOT NULL, "data_item" VARCHAR(255) NOT NULL, "resource_name" VARCHAR(255) NOT NULL, "opr_date" DATE NOT NULL, "interval_num" INT NOT NULL, "value" DOUBLE NOT NULL, CONSTRAINT "pk_oasis_report_data" PRIMARY KEY ("oasis_report_data_id"), CONSTRAINT "fk_oasis_report_data_oasis_report_header" FOREIGN KEY ("oasis_report_header_id") REFERENCES "oasis_report_header" ("oasis_report_header_id") ); CREATE SEQUENCE seq_oasis_report_data_id AS INT; And I'm using iBatis to insert the data like that : <insert id="insertOasisReportData" parameterClass="oasisReportData"> <selectKey keyProperty="id" resultClass="int" type="pre"> SELECT NEXT VALUE FOR seq_oasis_report_data_id </selectKey> INSERT INTO oasis_report_data (oasis_report_data_id, oasis_report_header_id, data_item, interval_num, opr_date, resource_name, value) VALUES (#id#, #header.id#, #dataItem#, #intervalNum#, #oprDate#, #resourceName#, #value#) </insert> Here is the bug I found : When the file is small (up to 2 Mo, around 15 000 items), no problem. If the file is bigger (20 Mo, around 100 000 items), then at a moment the select next value return null. Here is the java.sql log : 2009-03-02 21:14:30,324 | DEBUG | java.sql.Connection | debug | {conn-170420} Connection 2009-03-02 21:14:30,324 | DEBUG | java.sql.Connection | debug | {conn-170420} Preparing Statement: SELECT NEXT VALUE FOR seq_oasis_report_data_id 2009-03-02 21:14:30,334 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170421} Executing Statement: SELECT NEXT VALUE FOR seq_oasis_report_data_id 2009-03-02 21:14:30,334 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170421} Parameters: [] 2009-03-02 21:14:30,334 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170421} Types: [] 2009-03-02 21:14:30,344 | DEBUG | java.sql.ResultSet | debug | {rset-170422} ResultSet 2009-03-02 21:14:30,344 | DEBUG | java.sql.ResultSet | debug | {rset-170422} Header: [next_value_for_sys] 2009-03-02 21:14:30,344 | DEBUG | java.sql.ResultSet | debug | {rset-170422} Result: [16901] 2009-03-02 21:14:30,344 | DEBUG | java.sql.Connection | debug | {conn-170420} Preparing Statement: INSERT INTO oasis_report_data (oasis_report_data_id, oasis_report_header_id, data_item, interval_num, opr_date, resource_name, value) VALUES (?, ?, ?, ?, ?, ?, ?) 2009-03-02 21:14:30,354 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170423} Executing Statement: INSERT INTO oasis_report_data (oasis_report_data_id, oasis_report_header_id, data_item, interval_num, opr_date, resource_name, value) VALUES (?, ?, ?, ?, ?, ?, ?) 2009-03-02 21:14:30,354 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170423} Parameters: [16901, 705, LMP_PRC, 5, 2009-01-26 00:00:00.0, AVOCADO_6_N002, 31.80941] 2009-03-02 21:14:30,354 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170423} Types: [java.lang.Integer, java.lang.Integer, java.lang.String, java.lang.Integer, java.sql.Timestamp, java.lang.String, java.lang.Double] 2009-03-02 21:14:30,364 | DEBUG | java.sql.Connection | debug | {conn-170424} Connection 2009-03-02 21:14:30,364 | DEBUG | java.sql.Connection | debug | {conn-170424} Preparing Statement: SELECT NEXT VALUE FOR seq_oasis_report_data_id 2009-03-02 21:14:30,364 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170425} Executing Statement: SELECT NEXT VALUE FOR seq_oasis_report_data_id 2009-03-02 21:14:30,364 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170425} Parameters: [] 2009-03-02 21:14:30,364 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170425} Types: [] 2009-03-02 21:14:34,500 | DEBUG | java.sql.Connection | debug | {conn-170424} Preparing Statement: INSERT INTO oasis_report_data (oasis_report_data_id, oasis_report_header_id, data_item, interval_num, opr_date, resource_name, value) VALUES (?, ?, ?, ?, ?, ?, ?) 2009-03-02 21:14:34,510 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170426} Executing Statement: INSERT INTO oasis_report_data (oasis_report_data_id, oasis_report_header_id, data_item, interval_num, opr_date, resource_name, value) VALUES (?, ?, ?, ?, ?, ?, ?) 2009-03-02 21:14:34,510 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170426} Parameters: [null, 705, LMP_PRC, 6, 2009-01-26 00:00:00.0, AVOCADO_6_N002, 35.59336] 2009-03-02 21:14:34,510 | DEBUG | java.sql.PreparedStatement | debug | {pstm-170426} Types: [null, java.lang.Integer, java.lang.String, java.lang.Integer, java.sql.Timestamp, java.lang.String, java.lang.Double] You can see that in the second case there are two lines missing : 2009-03-02 21:14:30,344 | DEBUG | java.sql.ResultSet | debug | {rset-170422} Header: [next_value_for_sys] 2009-03-02 21:14:30,344 | DEBUG | java.sql.ResultSet | debug | {rset-170422} Result: [16901] And what strange is that each time it appears at a different moment (I mean on a different set of data, using the same file). Maybe on nig stress the sequence generator of MonetDB bugs or maybe the JDBC driver. HTH, Cimballi

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql.mx, , 1.321, 1.322 sql_scenario.mx, , 1.337, 1.338
by Fabian Groffen 07 Mar '09

07 Mar '09

On 07-03-2009 21:41:21 +0000, Stefan de Konink wrote: > This code adds the last_id variable to MonetDB5/SQL to implement 'in SQL' > access to the last updated sequence, in a similar fashion as the @@IDENTITY > found in MSSQL. For future compatibility a procedure like get_last_row_id() > found in other databases, this function would have to return the variable > found. The variable is updated when m->last_id is updated. > > The code was added to have last_id support within the ODBC interface; > required for phpBB compatibility. Weird, ODBC already knows it, and more reliable, via the response of Q_UPDATE. I think it was already implemented in ODBC even? It's available in mapilib, using mapi_get_last_id.

2 4

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_derivepath.mx, Feb2009, NONE, 1.1.2.1 Makefile.ag, Feb2009, 1.66, 1.66.2.1 opt_prelude.mx, Feb2009, 1.55.2.3, 1.55.2.4
by Sjoerd Mullender 05 Mar '09

05 Mar '09

How is this not a new feature? Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv2998/optimizer > > Modified Files: > Tag: Feb2009 > Makefile.ag opt_prelude.mx > Added Files: > Tag: Feb2009 > opt_derivepath.mx > Log Message: > Added the framework for the commissioned derivepath optimizer. > > > U opt_prelude.mx > Index: opt_prelude.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_prelude.mx,v > retrieving revision 1.55.2.3 > retrieving revision 1.55.2.4 > diff -u -d -r1.55.2.3 -r1.55.2.4 > --- opt_prelude.mx 1 Mar 2009 19:15:30 -0000 1.55.2.3 > +++ opt_prelude.mx 5 Mar 2009 00:17:12 -0000 1.55.2.4 > @@ -57,6 +57,7 @@ > opt_export str deleteRef; > opt_export str depositRef; > opt_export str deriveRef; > +opt_export str derivePathRef; > opt_export str differenceRef; > opt_export str divRef; > opt_export str disconnectRef; > @@ -216,6 +217,7 @@ > str deleteRef; > str depositRef; > str deriveRef; > +str derivePathRef; > str differenceRef; > str divRef; > str disconnectRef; > @@ -371,6 +373,7 @@ > deleteRef = putName("delete",6); > depositRef = putName("deposit",7); > deriveRef = putName("derive",6); > + derivePathRef = putName("derivePath",10); > differenceRef= putName("difference",10); > divRef = putName("/",1); > disconnectRef= putName("disconnect",10); > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/Makefile.ag,v > retrieving revision 1.66 > retrieving revision 1.66.2.1 > diff -u -d -r1.66 -r1.66.2.1 > --- Makefile.ag 18 Jan 2009 11:44:14 -0000 1.66 > +++ Makefile.ag 5 Mar 2009 00:17:12 -0000 1.66.2.1 > @@ -32,7 +32,7 @@ > opt_singleton.mx opt_costModel.mx opt_reduce.mx opt_macro.mx \ > opt_accumulators.mx opt_qep.mx opt_mergetable.mx \ > opt_remoteQueries.mx opt_joinselect.mx opt_partitions.mx \ > - opt_evaluate.mx opt_inline.mx opt_pushranges.mx \ > + opt_evaluate.mx opt_inline.mx opt_pushranges.mx opt_derivepath.mx \ > opt_accessmode.mx opt_joinpath.mx opt_heuristics.mx opt_remap.mx \ > opt_statistics.mx opt_trace.mx opt_recycler.mx opt_dataflow.mx \ > opt_mitosis.mx opt_octopus.mx opt_replicator.mx opt_history.mx > @@ -53,7 +53,7 @@ > opt_singleton.mx opt_costModel.mx opt_reduce.mx opt_macro.mx \ > opt_accumulators.mx opt_qep.mx opt_mergetable.mx \ > opt_remoteQueries.mx opt_joinselect.mx opt_partitions.mx \ > - opt_evaluate.mx opt_inline.mx opt_pushranges.mx \ > + opt_evaluate.mx opt_inline.mx opt_pushranges.mx opt_derivepath.mx \ > opt_accessmode.mx opt_joinpath.mx opt_heuristics.mx opt_remap.mx \ > opt_statistics.mx opt_trace.mx opt_recycler.mx opt_dataflow.mx \ > opt_mitosis.mx opt_octopus.mx opt_replicator.mx opt_history.mx > @@ -72,7 +72,7 @@ > opt_singleton.mx opt_costModel.mx opt_reduce.mx opt_macro.mx \ > opt_accumulators.mx opt_qep.mx opt_mergetable.mx \ > opt_remoteQueries.mx opt_joinselect.mx opt_partitions.mx \ > - opt_evaluate.mx opt_inline.mx opt_pushranges.mx \ > + opt_evaluate.mx opt_inline.mx opt_pushranges.mx opt_derivepath.mx \ > opt_accessmode.mx opt_joinpath.mx opt_heuristics.mx opt_remap.mx \ > opt_statistics.mx opt_trace.mx opt_recycler.mx opt_dataflow.mx \ > opt_mitosis.mx opt_octopus.mx opt_replicator.mx opt_history.mx > > --- NEW FILE: opt_derivepath.mx --- > @' The contents of this file are subject to the MonetDB Public License > @' Version 1.1 (the "License"); you may not use this file except in > @' compliance with the License. You may obtain a copy of the License at > @' http://monetdb.cwi.nl/Legal/MonetDBLicense-1.1.html > @' > @' Software distributed under the License is distributed on an "AS IS" > @' basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the > @' License for the specific language governing rights and limitations > @' under the License. > @' > @' The Original Code is the MonetDB Database System. > @' > @' The Initial Developer of the Original Code is CWI. > @' Portions created by CWI are Copyright (C) 1997-July 2008 CWI. > @' Copyright August 2008-2009 MonetDB B.V. > @' All Rights Reserved. > > @f opt_derivepath > @- Group derive paths > The routine @sc{optimizer.derivepaths()} > walks through the program looking for grouping operations > and cascades them into a single multiple group paths. > To illustrate, consider > @verbatim > (ext1,grp1) := group.new(b); > (ext2,grp2) := group.derive(ext1,grp1, c); > (ext3,grp3) := group.derive(ext2,grp2, d); > @end verbatim > The result becomes. > @verbatim > (ext3,grp3) := group.derivepath(b,c,d); > @end verbatim > @{ > @mal > pattern optimizer.derivePath():str > address OPTderivePath; > pattern optimizer.derivePath(mod:str, fcn:str):str > address OPTderivePath > comment "Join path constructor"; > pattern group.derivePath(l:bat[:any,:any]...):bat[:any,:any] > address ALGderivePath > comment "internal routine to handle join paths. > The type analysis is rather tricky."; > @h > #ifndef _OPT_DERIVEPATH_ > #define _OPT_DERIVEPATH_ > #include "opt_prelude.h" > #include "opt_support.h" > #include "mal_interpreter.h" > > /* #define DEBUG_OPT_DERIVEPATH */ > @c > #include "mal_config.h" > #include "opt_derivepath.h" > > static int > OPTderivePathImplementation(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p) > { > int i, actions=0; > int *pc; > str derivePathRef = putName("derivePath",10); > InstrPtr q; > InstrPtr *old; > int limit,slimit; > > (void) cntxt; > (void) stk; > if (varGetProp(mb, getArg(mb->stmt[0], 0), inlineProp) != NULL) > return 0; > > old= mb->stmt; > limit= mb->stop; > slimit= mb->ssize; > newMalBlkStmt(mb,mb->ssize); > > /* beware, new variables and instructions are introduced */ > pc= (int*) GDKmalloc(sizeof(int)* mb->vtop * 2); /* to find last assignment */ > memset((char*) pc, 0, sizeof(int)* mb->vtop *2); > > for (i = 0; i<limit; i++){ > p= old[i]; > if( getModuleId(p)== groupRef && getFunctionId(p)== newRef ){ > pc[getArg(p,0)] = i; > pc[getArg(p,1)] = i; > } > if( getModuleId(p)== groupRef && getFunctionId(p)== deriveRef ){ > @- > Try to expand its argument list with what we have found so far. > This creates a series of join paths, many of which will be removed during deadcode elimination. > @c > if (pc[getArg(p,2)]== pc[getArg(p,3)]){ > q= copyInstruction(getInstrPtr(mb,pc[getArg(p,2)])); > q= pushArgument(mb,q, getArg(p,5)); > pc[getArg(p,0)] = i; > pc[getArg(p,1)] = i; > setFunctionId(q,derivePathRef); > p= q; > actions++; > #ifdef DEBUG_OPT_DERIVEPATH > stream_printf(cntxt->fdout,"new derivePath instruction\n"); > printInstruction(cntxt->fdout,mb, 0, q, LIST_MAL_ALL); > #endif > } > } > pushInstruction(mb,p); > } > for(; i<slimit; i++) > if(old[i]) > freeInstruction(old[i]); > GDKfree(old); > GDKfree(pc); > OPTDEBUG > if ( actions) > stream_printf(cntxt->fdout,"#opt_derivepath: %d statements glued\n",actions); > return actions; > } > @include optimizerWrapper.mx > @h > @:exportOptimizer(derivePath)@ > #endif > opt_export str ALGderivePath(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > @c > #include "opt_statistics.h" > @:wrapOptimizer(derivePath,OPT_CHECK_ALL)@ > @- > The derive path optimizer takes a derivation sequence and > attempts to minimize the intermediate result. > The choice depends on a good estimate of intermediate > results using properties. > For the time being, we use a simplistic model, based > on the assumption that most joins are foreign key joins anyway. > @c > str > ALGderivePath(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > { > (void) cntxt; > (void) mb; > (void) stk; > (void) pci; > throw(MAL,"group.derivePath","nyi"); > } > @} > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

3 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_debugger.mx, Feb2009, 1.256.2.2, 1.256.2.3
by Stefan Manegold 04 Mar '09

04 Mar '09

[Pre-nighlty testing compilation check service] Fails to compile with icc & gcc with optimization enabled: .../MonetDB5/src/mal/mal_debugger.mx(1501): error #592: variable "p" is used before its value is set mdbCommand(cntxt, mb, stk, p, pc); ^ Stefam On Wed, Mar 04, 2009 at 03:54:07PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv10776 > > Modified Files: > Tag: Feb2009 > mal_debugger.mx > Log Message: > The debugger command 'bbp trace <pattern>' has been added to > keep a watch over the lref status of bats in the bbp. > > > U mal_debugger.mx > Index: mal_debugger.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_debugger.mx,v > retrieving revision 1.256.2.2 > retrieving revision 1.256.2.3 > diff -u -d -r1.256.2.2 -r1.256.2.3 > --- mal_debugger.mx 12 Feb 2009 06:34:16 -0000 1.256.2.2 > +++ mal_debugger.mx 4 Mar 2009 15:54:04 -0000 1.256.2.3 > @@ -489,6 +489,7 @@ > mal_export void printBatInfo(stream *f, VarPtr n, ValPtr v); > mal_export void printBatProperties(stream *f, VarPtr n, ValPtr v, str props); > mal_export void printTraceCall(stream *out, MalBlkPtr mb, MalStkPtr stk, int pc, int flags); > +mal_export char BBPTraceCall(Client cntxt, MalBlkPtr mb, MalStkPtr stk, int pc); > mal_export str call2str(MalBlkPtr mb, MalStkPtr stk, int pc, int flags); > > mal_export str runMALDebugger(Client cntxt, Symbol s); > @@ -742,6 +743,63 @@ > stream_printf(out, "#%s\n", msg); > GDKfree(msg); > } > +static void > +mdbBacktrace(Client cntxt, MalStkPtr stk, int pci){ > + for (; stk != NULL; stk = stk->up) { > + printCall(cntxt, stk->blk, stk, pci); > + if (stk->up) > + pci = stk->up->pcup; > + } > +} > +@- > +Sometimes we may want to trace the changes applied to the > +BAT buffer pool and report them together with the MAL > +instruction where it happened. > +@c > +static int BBPtraceEnabled = 0; > +static str BBPtracePattern = NULL; > +char > +BBPTraceCall(Client cntxt, MalBlkPtr mb, MalStkPtr stk, int pc) > +{ > + static int *BBPmirror = NULL; > + static int bbpsize; > + char lbuf[1024], pbuf[1024]; > + int i, action; > + (void) mb; > + > + if ( BBPtraceEnabled == 0) > + return 0; > + if (BBPmirror == NULL ){ > + bbpsize= BBPsize; > + BBPmirror = (int*) GDKzalloc(sizeof(int) * BBPsize); > + } > + if( BBPsize > bbpsize) { > + int *old = BBPmirror; > + BBPmirror = (int*) GDKzalloc(sizeof(int) * BBPsize); > + memcpy((char*)BBPmirror, (char*)old, sizeof(int) * bbpsize); > + bbpsize= BBPsize; > + GDKfree(old); > + } > + /* no growing BBP yet */ > + action = 0; > + for ( i=0; i<bbpsize; i++){ > + /* what happened to this BAT */ > + if ( BBPmirror[i] != BBP_lrefs(i)){ > + BBPlogical(i,lbuf); > + if ( BBPtracePattern && > + strncmp(lbuf,BBPtracePattern,strlen(BBPtracePattern)) ) > + continue; > + BBPphysical(i,pbuf); > + stream_printf(cntxt->fdout, "#BBP state change of %s %s entry %d refs %d:\n", > + lbuf,pbuf,i, BBP_lrefs(i)); > + action = 1; > + } > + BBPmirror[i] = BBP_lrefs(i); > + } > + if ( action ) > + mdbBacktrace(cntxt, stk, pc); > + return 's'; > +} > > static void > printBATproperties(stream *f, BAT *b){ > @@ -756,7 +814,7 @@ > if (b->T->parentid) > stream_printf(f, "tail view on %s ", BBPname(b->T->parentid)); > } > -@+ MAL parser > +@+ MAL debugger parser > The debugger structure is inherited from GDB. > The routine mdbCommand is called with p=0 after finishing a mal- function call > and before continuing at the next level of invocation. > @@ -802,14 +860,6 @@ > return getMalBlkHistory(mb,-1); > } > > -static void > -mdbBacktrace(Client cntxt, MalStkPtr stk, int pci){ > - for (; stk != NULL; stk = stk->up) { > - printCall(cntxt, stk->blk, stk, pci); > - if (stk->up) > - pci = stk->up->pcup; > - } > -} > > void > mdbCommand(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p, int pc) > @@ -1089,6 +1139,16 @@ > int i,limit; > > skipWord(cntxt, b); > + /* bbp change tracing enabling */ > + if ( strncmp(b,"trace",5) == 0){ > + skipWord(cntxt, b); > + BBPtraceEnabled = !BBPtraceEnabled; > + if ( BBPtraceEnabled && *b ) > + BBPtracePattern = GDKstrdup(b); > + stream_printf(out,"#bbp trace enabled %d\n", BBPtraceEnabled); > + stk->cmd = 'c'; > + break; > + } > i = BBPindex(b); > if( i) > limit=i+1; > @@ -1437,6 +1497,8 @@ > return; > } > > + if ( BBPTraceCall(cntxt,mb,stk,pc)) > + mdbCommand(cntxt, mb, stk, p, pc); > switch (stk->cmd) { > case 'c': > p = getInstrPtr(mb, pc); > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-bugs] [ monetdb-Bugs-2654300 ] problem with views reusing aliases ?
by Romulo Goncalves 02 Mar '09

02 Mar '09

SourceForge.net wrote: > Bugs item #2654300, was opened at 2009-03-02 12:41 > Message generated for change (Tracker Item Submitted) made by Item Submitter > You can respond by visiting: > https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2654300&group_… > > Please note that this message will contain a full copy of the comment thread, > including the initial issue submission, for this request, > not just the latest update. > Category: SQL/Core > Group: SQL "stable" > Status: Open > Resolution: None > Priority: 5 > Private: No > Submitted By: Roberto Cornacchia (cornuz) > Assigned to: Niels Nes (nielsnes) > Summary: problem with views reusing aliases ? > > Initial Comment: > [ on Feb2009 branch ] > > create table x (n int, s varchar(10)); > insert into x values (1, 'one'); > insert into x values (2, 'two'); > insert into x values (3, 'three'); > > -- swap the two attributes > create view x1 as > select s as a1, n as a2 from x; > > -- swap them again > create view x2 as > select a2 as a1, a1 as a2 from x1; > > -- select on the original 's' attribute fails > select * from x2 where a2='two'; > > This is the output: > > $ mclient -lsql -dtest02 -G < bug2.sql The algebra version is the default one in the current as well as in the stable branch... So how the -G option is still valid? Romulo > [ 1 ] > [ 1 ] > [ 1 ] > MAPI = monetdb@localhost:50000 > QUERY = select * from x2 where a2='two'; > ERROR = !TypeException:user.s0_1[4]:'algebra.uselect' undefined in: _9:any := algebra.uselect(_2:bat[:oid,:str], _8:int) > !TypeException:user.s0_1[6]:'algebra.kdifference' undefined in: _12:any := algebra.kdifference(_9:any, _10:bat[:oid,:str]) > !TypeException:user.s0_1[7]:'algebra.uselect' undefined in: _13:any := algebra.uselect(_10:bat[:oid,:str], _8:int) > !TypeException:user.s0_1[8]:'algebra.kunion' undefined in: _14:any := algebra.kunion(_12:any, _13:any) > !TypeException:user.s0_1[10]:'algebra.uselect' undefined in: _17:any := algebra.uselect(_15:bat[:oid,:str], _8:int) > !TypeException:user.s0_1[11]:'algebra.kunion' undefined in: _18:any := algebra.kunion(_14:any, _17:any) > !TypeException:user.s0_1[14]:'algebra.kdifference' undefined in: _21:any := algebra.kdifference(_18:any, _20:bat[:oid,:oid]) > !TypeException:user.s0_1[16]:'algebra.markT' undefined in: _24:any := algebra.markT(_21:any, _22:oid) > !TypeException:user.s0_1[17]:'bat.reverse' undefined in: _25:any := bat.reverse(_24:any) > !TypeException:user.s0_1[24]:'algebra.join' undefined in: _33:any := algebra.join(_25:any, _32:bat[:oid,:int]) > !TypeException:user.s0_1[28]:'algebra.join' undefined in: _37:any := algebra.join(_25:any, _36:bat[:oid,:str]) > !SQLException:int:conversion of string 'two' failed > > > ---------------------------------------------------------------------- > > You can respond by visiting: > https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2654300&group_… > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-bugs mailing list > Monetdb-bugs(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-bugs

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/common sql_types.mx, Feb2009, 1.121.2.1, 1.121.2.2
by Stefan Manegold 27 Feb '09

27 Feb '09

FYI: This checkin seems to change the DB schema, making existing databases incompatible with the code after this change: !FATAL: SQL schema missing or incompatible, rebuild from archive Stefan On Thu, Feb 26, 2009 at 04:56:32PM +0000, Roberto Cornacchia wrote: > Update of /cvsroot/monetdb/sql/src/common > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv29270/common > > Modified Files: > Tag: Feb2009 > sql_types.mx > Log Message: > added prod() aggregation function in SQL > > Not part of standard SQL, but useful and available in most SQL DBs > > > > U sql_types.mx > Index: sql_types.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/common/sql_types.mx,v > retrieving revision 1.121.2.1 > retrieving revision 1.121.2.2 > diff -u -d -r1.121.2.1 -r1.121.2.2 > --- sql_types.mx 11 Feb 2009 19:35:44 -0000 1.121.2.1 > +++ sql_types.mx 26 Feb 2009 16:56:29 -0000 1.121.2.2 > @@ -1361,6 +1361,35 @@ > t++; /* LNG */ > sql_create_aggr("sum", "aggr", "sum", *(t), *(t)); > > + /* prod for numerical and decimals */ > + sql_create_aggr("prod", "aggr", "product", BTE, SHT); > + sql_create_aggr("prod", "aggr", "product", BTE, INT); > + sql_create_aggr("prod", "aggr", "product", BTE, WRD); > + sql_create_aggr("prod", "aggr", "product", BTE, LNG); > + > + sql_create_aggr("prod", "aggr", "product", SHT, INT); > + sql_create_aggr("prod", "aggr", "product", SHT, WRD); > + sql_create_aggr("prod", "aggr", "product", SHT, LNG); > + > + sql_create_aggr("prod", "aggr", "product", INT, WRD); > + sql_create_aggr("prod", "aggr", "product", INT, LNG); > + > + sql_create_aggr("prod", "aggr", "product", WRD, WRD); > + sql_create_aggr("prod", "aggr", "product", WRD, LNG); > + sql_create_aggr("prod", "aggr", "product", LNG, LNG); > + > + t = decimals; /* BTE */ > + sql_create_aggr("prod", "aggr", "product", *(t), *(t+1)); > + sql_create_aggr("prod", "aggr", "product", *(t), *(t+2)); > + sql_create_aggr("prod", "aggr", "product", *(t), *(t+3)); > + t++; /* SHT */ > + sql_create_aggr("prod", "aggr", "product", *(t), *(t+1)); > + sql_create_aggr("prod", "aggr", "product", *(t), *(t+2)); > + t++; /* INT */ > + sql_create_aggr("prod", "aggr", "product", *(t), *(t+1)); > + t++; /* LNG */ > + sql_create_aggr("prod", "aggr", "product", *(t), *(t)); > + > for (t = numerical; t < floats; t++) { > sql_create_aggr("avg", "aggr", "avg", *(t), DBL); > sql_create_func("mod", "calc", "%", *t, *t, *t, SCALE_FIX); > @@ -1368,6 +1397,7 @@ > > for (t = floats; t < dates; t++) { > sql_create_aggr("sum", "aggr", "sum", *t, *t); > + sql_create_aggr("prod", "aggr", "product", *t, *t); > sql_create_aggr("avg", "aggr", "avg", *t, DBL); > > sql_create_func("mod", "calc", "fmod", *t, *t, *t, SCALE_FIX); > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/common sql_types.mx, Feb2009, 1.121.2.2, 1.121.2.3
by Stefan Manegold 27 Feb '09

27 Feb '09

On Thu, Feb 26, 2009 at 11:47:57PM +0000, Roberto Cornacchia wrote: > Update of /cvsroot/monetdb/sql/src/common > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv3519/common > > Modified Files: > Tag: Feb2009 > sql_types.mx > Log Message: > reverting addition of prob() aggregation, as it would break db compatibility Thanks! (In particular for properly doing it using CVS commands, only!) I prevented propagation of this "undo" to the developlment trunk; the "do" had already been propagated yesterday; hence, the prod() aggregation is now avilable in the development trunk. Stefan > > > U sql_types.mx > Index: sql_types.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/common/sql_types.mx,v > retrieving revision 1.121.2.2 > retrieving revision 1.121.2.3 > diff -u -d -r1.121.2.2 -r1.121.2.3 > --- sql_types.mx 26 Feb 2009 16:56:29 -0000 1.121.2.2 > +++ sql_types.mx 26 Feb 2009 23:47:55 -0000 1.121.2.3 > @@ -1361,35 +1361,6 @@ > t++; /* LNG */ > sql_create_aggr("sum", "aggr", "sum", *(t), *(t)); > > - /* prod for numerical and decimals */ > - sql_create_aggr("prod", "aggr", "product", BTE, SHT); > - sql_create_aggr("prod", "aggr", "product", BTE, INT); > - sql_create_aggr("prod", "aggr", "product", BTE, WRD); > - sql_create_aggr("prod", "aggr", "product", BTE, LNG); > - > - sql_create_aggr("prod", "aggr", "product", SHT, INT); > - sql_create_aggr("prod", "aggr", "product", SHT, WRD); > - sql_create_aggr("prod", "aggr", "product", SHT, LNG); > - > - sql_create_aggr("prod", "aggr", "product", INT, WRD); > - sql_create_aggr("prod", "aggr", "product", INT, LNG); > - > - sql_create_aggr("prod", "aggr", "product", WRD, WRD); > - sql_create_aggr("prod", "aggr", "product", WRD, LNG); > - sql_create_aggr("prod", "aggr", "product", LNG, LNG); > - > - t = decimals; /* BTE */ > - sql_create_aggr("prod", "aggr", "product", *(t), *(t+1)); > - sql_create_aggr("prod", "aggr", "product", *(t), *(t+2)); > - sql_create_aggr("prod", "aggr", "product", *(t), *(t+3)); > - t++; /* SHT */ > - sql_create_aggr("prod", "aggr", "product", *(t), *(t+1)); > - sql_create_aggr("prod", "aggr", "product", *(t), *(t+2)); > - t++; /* INT */ > - sql_create_aggr("prod", "aggr", "product", *(t), *(t+1)); > - t++; /* LNG */ > - sql_create_aggr("prod", "aggr", "product", *(t), *(t)); > - > for (t = numerical; t < floats; t++) { > sql_create_aggr("avg", "aggr", "avg", *(t), DBL); > sql_create_func("mod", "calc", "%", *t, *t, *t, SCALE_FIX); > @@ -1397,7 +1368,6 @@ > > for (t = floats; t < dates; t++) { > sql_create_aggr("sum", "aggr", "sum", *t, *t); > - sql_create_aggr("prod", "aggr", "product", *t, *t); > sql_create_aggr("avg", "aggr", "avg", *t, DBL); > > sql_create_func("mod", "calc", "fmod", *t, *t, *t, SCALE_FIX); > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_accumulators.mx, Feb2009, 1.32, 1.32.2.1 opt_aliases.mx, Feb2009, 1.24, 1.24.2.1 opt_coercion.mx, Feb2009, 1.14, 1.14.2.1 opt_commonTerms.mx, Feb2009, 1.49, 1.49.2.1 opt_costModel.mx, Feb2009, 1.39, 1.39.2.1 opt_dataflow.mx, Feb2009, 1.21, 1.21.2.1 opt_deadcode.mx, Feb2009, 1.40, 1.40.2.1 opt_emptySet.mx, Feb2009, 1.54, 1.54.2.1 opt_evaluate.mx, Feb2009, 1.22, 1.22.2.1 opt_garbageCollector.mx, Feb2009, 1.45.2.2, 1.45.2.3 opt_history.mx,
by Stefan Manegold 25 Feb '09

25 Feb '09

On Wed, Feb 25, 2009 at 02:19:44PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25174 > > Modified Files: > Tag: Feb2009 > opt_accumulators.mx opt_aliases.mx opt_coercion.mx > opt_commonTerms.mx opt_costModel.mx opt_dataflow.mx > opt_deadcode.mx opt_emptySet.mx opt_evaluate.mx > opt_garbageCollector.mx opt_history.mx opt_inline.mx > opt_joinpath.mx opt_mergetable.mx opt_mitosis.mx > opt_multiplex.mx opt_prelude.mx opt_reduce.mx opt_remap.mx > optimizer.mx > Log Message: > Give a summary of the optimizer decisions and effects when --optimizers is > used. > [...] > > U opt_commonTerms.mx > Index: opt_commonTerms.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_commonTerms.mx,v > retrieving revision 1.49 > retrieving revision 1.49.2.1 > diff -u -d -r1.49 -r1.49.2.1 > --- opt_commonTerms.mx 27 Jan 2009 22:29:48 -0000 1.49 > +++ opt_commonTerms.mx 25 Feb 2009 14:19:41 -0000 1.49.2.1 > @@ -244,6 +244,9 @@ > if( old[i]) > freeInstruction(old[i]); > GDKfree(old); > + PROPDEBUG ^^^^ shouldn't this one read "OPTDEBUG" ? Stefan > + if (actions) > + stream_printf(cntxt->fdout,"#opt_commonTerms: %d statemtents catched\n",actions); > return actions; > } > [...] -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_garbageCollector.mx, Feb2009, 1.45, 1.45.2.1
by Stefan Manegold 25 Feb '09

25 Feb '09

I could isolate this checkin as being the cuase that made most SQL tests segfault during testin glast night. Stefan On Tue, Feb 24, 2009 at 11:17:19PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25714 > > Modified Files: > Tag: Feb2009 > opt_garbageCollector.mx > Log Message: > Keep the optimizer statements. > > > U opt_garbageCollector.mx > Index: opt_garbageCollector.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_garbageCollector.mx,v > retrieving revision 1.45 > retrieving revision 1.45.2.1 > diff -u -d -r1.45 -r1.45.2.1 > --- opt_garbageCollector.mx 7 Jan 2009 14:15:13 -0000 1.45 > +++ opt_garbageCollector.mx 24 Feb 2009 23:17:16 -0000 1.45.2.1 > @@ -218,8 +218,11 @@ > } > #endif > for(; i<slimit; i++) > + if( old[i] == pci) > + freeInstruction(pci); > + else > if( old[i]) > - freeInstruction(old[i]); > + pushInstruction(mb,old[i]); > GDKfree(old); > GDKfree(span); > return actions; > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] monetdb-client for python doesn't seem to work for booleans.
by Vikram Bhandoh 23 Feb '09

23 Feb '09

Hi I've been working on a django backend for monetdb. For people who are interested in it have a look at it http://github.com/vikram/monetdb/tree/master I found a couple of issues with the python monetdb-client which are important for python. It doesn't seem to support boolean fields and doesn't give the lastrowid. I have a patch here for both. I'm sure about the lastrowid. As I haven't tested it in anger, could anyone tell me if this is alright or have I got things completely wrong. Thanks Vikram diff MonetSQLdb/converters.py ./converters.py 120,125d119 < def Boolean2Str(x, d): < if x: < return 'TRUE' < else: < return 'FALSE' < 144d137 < types.BooleanType: Boolean2Str, diff MonetSQLdb/cursors.py ./cursors.py 38d37 < self.lastrowid = 0 82d80 < 132,134d129 < if self._result.lastid()>0: < self.lastrowid = self._result.lastid() <

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime shredder.mx, Feb2009, 1.153.2.5, 1.153.2.6
by Stefan Manegold 20 Feb '09

20 Feb '09

On Fri, Feb 20, 2009 at 02:18:38PM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv16245 > > Modified Files: > Tag: Feb2009 > shredder.mx > Log Message: > - fixed shred_characters() bug, sorry :-( Testing suggests that this indeed fixes the previously reported errors / failing tests, again. Thanks! We would *VERY MUCH APPRECIATE*, though, if you could run Mtest yourself --- and check the results to ensure that your changes do not break previously working code & tests --- *before* checking in, at least when bugfixing on the stable branch just before a planned release... Running Mtest costs (each of) you just 12 key strokes (`Mtest.py -r[Enter]`) and (even for pathfinder) takes much less time than it takes us to sort out the problems of many checkins by different people, and Sjoerd to re-build the release candidates more often than necessary ... (Once again) thank you very much in advance for you cooperation! Stefan > > > U shredder.mx > Index: shredder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/shredder.mx,v > retrieving revision 1.153.2.5 > retrieving revision 1.153.2.6 > diff -u -d -r1.153.2.5 -r1.153.2.6 > --- shredder.mx 20 Feb 2009 13:06:50 -0000 1.153.2.5 > +++ shredder.mx 20 Feb 2009 14:18:35 -0000 1.153.2.6 > @@ -1105,9 +1105,20 @@ > const xmlChar *cs, > int n) > { > +#ifdef OLD_SHRED_CHARACTERS > shredCtxStruct *shredCtx = (shredCtxStruct*) xmlCtx; > + int l = MIN(PFSHRED_STRLEN_MAX -(int) shredCtx->content, n); > > - if ( (shredCtx->content + n + 1) < shredCtx->content_max) { > + memcpy(&(shredCtx->content_buf[shredCtx->content]), cs, l); > + shredCtx->content += l; > + > + if (l < n) > + stream_printf(GDKout, "!WARNING: shred_characters truncated text node > %d characters(starts with `%.16s...')\n", > + (int) PFSHRED_STRLEN_MAX, cs); > +#else > + shredCtxStruct *shredCtx = (shredCtxStruct*) xmlCtx; > + > + if ( (shredCtx->content + n + 1) > shredCtx->content_max) { > shredCtx->content_max = shredCtx->content + n + 1; > shredCtx->content_buf = GDKrealloc(shredCtx->content_buf, shredCtx->content_max); > if (shredCtx->content_buf == NULL) { > @@ -1117,6 +1128,7 @@ > } > memcpy(&(shredCtx->content_buf[shredCtx->content]), cs, n); > shredCtx->content += n; > +#endif > } > > /** > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime shredder.mx, Feb2009, 1.153.2.3, 1.153.2.4
by Stefan Manegold 20 Feb '09

20 Feb '09

Jan, unfortunately, this checkin breaks more than 30 pathfinder tests: benchmarks/XBench/TC/MD/shred_docs.milS benchmarks/XBench/TC/MD/load_docs.xq benchmarks/XBench/TC/MD/count_nodes.xq benchmarks/XBench/TC/MD/q01.xq ... benchmarks/XBench/TC/MD/q19.xq benchmarks/XMach-1/load_docs.xq benchmarks/XMach-1/count_nodes.xq benchmarks/XMach-1/q1.xq ... benchmarks/XMach-1/q8.xq tests/BugTracker/immune_for_updates.SF-1766259.xq tests/BugTracker/immune_for_updates.SF-1981852.xq Stefan On Fri, Feb 20, 2009 at 09:06:47AM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv26141 > > Modified Files: > Tag: Feb2009 > shredder.mx > Log Message: > - fix [ monetdb-Bugs-2586088 ] XQ: large text nodes > > > > U shredder.mx > Index: shredder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/shredder.mx,v > retrieving revision 1.153.2.3 > retrieving revision 1.153.2.4 > diff -u -d -r1.153.2.3 -r1.153.2.4 > --- shredder.mx 6 Feb 2009 22:52:30 -0000 1.153.2.3 > +++ shredder.mx 20 Feb 2009 09:06:45 -0000 1.153.2.4 > @@ -362,6 +362,7 @@ > int sp; /* the stackpointer */ > /* buffer administration */ > int content; /* content ptr in char buff */ > + int content_max; /* max size of content buffer */ > char *content_buf; /* character buffer */ > /* */ > size_t fileSize; /* size of the input file */ > @@ -1105,14 +1106,13 @@ > int n) > { > shredCtxStruct *shredCtx = (shredCtxStruct*) xmlCtx; > - int l = MIN(PFSHRED_STRLEN_MAX -(int) shredCtx->content, n); > - > - memcpy(&(shredCtx->content_buf[shredCtx->content]), cs, l); > - shredCtx->content += l; > > - if (l < n) > - stream_printf(GDKout, "!WARNING: shred_characters truncated text node > %d characters(starts with `%.16s...')\n", > - (int) PFSHRED_STRLEN_MAX, cs); > + if ( (shredCtx->content + n + 1) < shredCtx->content_max) { > + shredCtx->content_max = shredCtx->content + n + 1; > + shredCtx->content_buf = GDKrealloc(shredCtx->content_buf, shredCtx->content_max); > + } > + memcpy(&(shredCtx->content_buf[shredCtx->content]), cs, n); > + shredCtx->content += n; > } > > /** > @@ -1831,7 +1831,8 @@ > /* allocate some buffers used during parse */ > shredCtx->val = (char*) GDKmalloc(PFSHRED_BUFLEN+1); > shredCtx->lifo = (node_t *) GDKmalloc((XML_DEPTH_MAX+1) * sizeof(node_t)); > - shredCtx->content_buf = (char*) GDKmalloc(PFSHRED_STRLEN_MAX); > + shredCtx->content_max = PFSHRED_STRLEN_MAX; > + shredCtx->content_buf = (char*) GDKmalloc(shredCtx->content_max); > if (shredCtx->val == NULL || shredCtx->content_buf == NULL || shredCtx->lifo == NULL) { > return shredder_free(shredCtx,-shredCtx->incremental); > } > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_joinpath.mx, Feb2009, 1.36.2.2, 1.36.2.3
by Sjoerd Mullender 20 Feb '09

20 Feb '09

Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv2163 > > Modified Files: > Tag: Feb2009 > opt_joinpath.mx > Log Message: > Undo Martin's checkin per his request: > "The joinpath optimizer handles the documented front-end compression scheme > essential to reduce the number of projection joins in the SQL code." > before creating a new candidate release. The code has not been tested > in any form so will have to wait until later. Ok, I overstated thing just a tad: it apparently was tested on one platform, but not on any others. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_heap.mx, Feb2009, 1.107, 1.107.2.1
by Stefan Manegold 20 Feb '09

20 Feb '09

On Tue, Feb 10, 2009 at 09:13:21AM +0000, Stefan Manegold wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv18180/MonetDB/src/gdk > > Modified Files: > Tag: Feb2009 > gdk_heap.mx > Log Message: > > [on behalf of Peter] re-doing > > 2009/02/05 - boncz: MonetDB/src/gdk/gdk_heap.mx,1.108 > - make large allocs fall back again on mmap Peter, (how) can we make the limit (more) dependend on / adaptive to the actual memory size? Shouldn't this have an effect only with blocks > gdk_vm_minsize == 128 GB ? I have sample scenarios (on Linux) where, e.g., queries produce intermediate results of ~ 5GB --- on my 64-bit 8GB machine those queries run in 40 secs before this change (i.e., with h->storage = STORE_MMAP;), but take 200 secs (i.e., 5 times as long) after this change (i.e., with h->newstorage = STORE_MMAP;) ... Jan R. has seen similar effects with XMark on his Mac ... Thanks, Stefan > now only the actually intended changes > and as bug fix, i.e., in the Feb2009 release branch > > > Index: gdk_heap.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_heap.mx,v > retrieving revision 1.107 > retrieving revision 1.107.2.1 > diff -u -d -r1.107 -r1.107.2.1 > --- gdk_heap.mx 22 Jan 2009 14:47:53 -0000 1.107 > +++ gdk_heap.mx 10 Feb 2009 09:13:19 -0000 1.107.2.1 > @@ -115,7 +115,7 @@ > fp = GDKfilelocate(nme, "wb", ext); > if (fp != NULL) { > fclose(fp); > - h->storage = STORE_MMAP; > + h->newstorage = STORE_MMAP; > HEAPload(h, nme, ext, FALSE); > } > GDKfree(of); > > > ------------------------------------------------------------------------------ > Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) > software. With Adobe AIR, Ajax developers can use existing skills and code to > build responsive, highly engaging applications that combine the power of local > resources and data with the reach of the web. Download the Adobe AIR SDK and > Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 4

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_interpreter.mx, , 1.286, 1.287
by Stefan Manegold 16 Feb '09

16 Feb '09

Milena, do you consider this a bug fix or a new feature? if the former, it will not be in the upcoming release, since it has not (yet) been checked in to the Feb2009 release branch... in case you consider an exceptional back-port of this checkin to the Feb2009 release branch, please make sure you od this using the approriate CVS commands to ensure that the identical changes are applied --- see, e.g., page 14 of http://homepages.cwi.nl/~manegold/Presentations/MonetDBdevTTT.pdf for details --- don't hesitate to ask inc ase you need help ... Stefan On Mon, Feb 16, 2009 at 01:56:58PM +0000, Milena Ivanova wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13891 > > Modified Files: > mal_interpreter.mx > Log Message: > Call recycler only for instructions with positive value of the recycle field. > > > U mal_interpreter.mx > Index: mal_interpreter.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_interpreter.mx,v > retrieving revision 1.286 > retrieving revision 1.287 > diff -u -d -r1.286 -r1.287 > --- mal_interpreter.mx 15 Feb 2009 23:15:30 -0000 1.286 > +++ mal_interpreter.mx 16 Feb 2009 13:56:55 -0000 1.287 > @@ -1993,14 +1993,14 @@ > The recycler works for any variable and relies on policy functions > registered. > @= MALrecycleStart > - if ( pci->recycle >= 0) > + if ( pci->recycle > 0) > @1->clk = GDKusec(); > if( !RECYCLEentry(cntxt, mb,stk,pci) ) > @= MALrecycleExit > - if ( pci->recycle >= 0) > + if( pci->recycle > 0 ){ > tcs = GDKusec() - @1->clk; > - if( pci->recycle > 0 ) > RECYCLEexit(cntxt, mb,stk,pci,tcs); > + } > @} > @- > @node Garbage Collection, Stack Management, Exception Handling, The MAL Interpreter > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/NT/MonetDB5-Server MonetDB5-Server.vdproj, Feb2009, 1.17.2.2, 1.17.2.3 MonetDB5-Server64.vdproj, Feb2009, 1.14.2.2, 1.14.2.3
by Stefan Manegold 15 Feb '09

15 Feb '09

On Sun, Feb 15, 2009 at 12:03:10PM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB5/NT/MonetDB5-Server > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv9992/MonetDB5-Server > > Modified Files: > Tag: Feb2009 > MonetDB5-Server.vdproj MonetDB5-Server64.vdproj > Log Message: > s/batmath/batmmath/ Thanks! --- I was "afraid" that also some of the Windows/installer specific magic code need to be changed and hence did not "dare" to do the simple replacement ... Stefan > U MonetDB5-Server.vdproj > Index: MonetDB5-Server.vdproj > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/NT/MonetDB5-Server/MonetDB5-Server.vdproj,v > retrieving revision 1.17.2.2 > retrieving revision 1.17.2.3 > diff -u -d -r1.17.2.2 -r1.17.2.3 > --- MonetDB5-Server.vdproj 9 Feb 2009 09:39:32 -0000 1.17.2.2 > +++ MonetDB5-Server.vdproj 15 Feb 2009 12:03:07 -0000 1.17.2.3 > @@ -1813,8 +1813,8 @@ > } > "{1FB2D0AE-D3B9-43D4-B9DD-F88EC61E35DE}:_2E6AFBE1C87A4AB0A6A8F2162FD79B8C" > { > - "SourcePath" = "8:Lib\\MonetDB5\\batmath.mal" > - "TargetName" = "8:batmath.mal" > + "SourcePath" = "8:Lib\\MonetDB5\\batmmath.mal" > + "TargetName" = "8:batmmath.mal" > "Tag" = "8:" > "Folder" = "8:_E7F9CF4E0220468FB71F65052227D019" > "Condition" = "8:" > @@ -4453,8 +4453,8 @@ > } > "{1FB2D0AE-D3B9-43D4-B9DD-F88EC61E35DE}:_DFBC77B23C8E43C59447539AC5AD8E85" > { > - "SourcePath" = "8:Lib\\MonetDB5\\lib_batmath.dll" > - "TargetName" = "8:lib_batmath.dll" > + "SourcePath" = "8:Lib\\MonetDB5\\lib_batmmath.dll" > + "TargetName" = "8:lib_batmmath.dll" > "Tag" = "8:" > "Folder" = "8:_E7F9CF4E0220468FB71F65052227D019" > "Condition" = "8:" > > U MonetDB5-Server64.vdproj > Index: MonetDB5-Server64.vdproj > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/NT/MonetDB5-Server/MonetDB5-Server64.vdproj,v > retrieving revision 1.14.2.2 > retrieving revision 1.14.2.3 > diff -u -d -r1.14.2.2 -r1.14.2.3 > --- MonetDB5-Server64.vdproj 9 Feb 2009 09:39:32 -0000 1.14.2.2 > +++ MonetDB5-Server64.vdproj 15 Feb 2009 12:03:07 -0000 1.14.2.3 > @@ -2759,8 +2759,8 @@ > } > "{1FB2D0AE-D3B9-43D4-B9DD-F88EC61E35DE}:_6F7E9C22938E4CB794DBCDBAE1043F7E" > { > - "SourcePath" = "8:Lib\\MonetDB5\\batmath.mal" > - "TargetName" = "8:batmath.mal" > + "SourcePath" = "8:Lib\\MonetDB5\\batmmath.mal" > + "TargetName" = "8:batmmath.mal" > "Tag" = "8:" > "Folder" = "8:_E7F9CF4E0220468FB71F65052227D019" > "Condition" = "8:" > @@ -4379,8 +4379,8 @@ > } > "{1FB2D0AE-D3B9-43D4-B9DD-F88EC61E35DE}:_E0DFFCD93BB4490782297CCD3E6E5DE9" > { > - "SourcePath" = "8:Lib\\MonetDB5\\lib_batmath.dll" > - "TargetName" = "8:lib_batmath.dll" > + "SourcePath" = "8:Lib\\MonetDB5\\lib_batmmath.dll" > + "TargetName" = "8:lib_batmmath.dll" > "Tag" = "8:" > "Folder" = "8:_E7F9CF4E0220468FB71F65052227D019" > "Condition" = "8:" > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel batmmath.mx, Feb2009, NONE, 1.1.2.1 Makefile.ag, Feb2009, 1.74, 1.74.2.1 batmath.mx, Feb2009, 1.21, NONE
by Stefan Manegold 14 Feb '09

14 Feb '09

Sjoerd, could you please also fix the Windows installers accordingly, i.e., rename "batmath" into "batmmath" in MonetDB5/NT/MonetDB5-Server/MonetDB5-Server64.vdproj MonetDB5/NT/MonetDB5-Server/MonetDB5-Server.vdproj sql/NT/MonetDB5-SQL64/MonetDB5-SQL-Installer.vdproj sql/NT/MonetDB5-SQL/MonetDB5-SQL-Installer.vdproj Thanks! Stefan On Sat, Feb 14, 2009 at 05:20:25AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17075/modules/kernel > > Modified Files: > Tag: Feb2009 > Makefile.ag > Added Files: > Tag: Feb2009 > batmmath.mx > Removed Files: > Tag: Feb2009 > batmath.mx > Log Message: > Addressing bug 2596114 > The multiplex mat functions were not found by the remap optimizer, > because they did not obey the naming convention [bat]mmath. > Given the performance impact of using MAL loops, this change > in interface naming has been rectified over a specific hack > in the remap optimizer itself. > > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/Makefile.ag,v > retrieving revision 1.74 > retrieving revision 1.74.2.1 > diff -u -d -r1.74 -r1.74.2.1 > --- Makefile.ag 7 Jan 2009 14:15:12 -0000 1.74 > +++ Makefile.ag 14 Feb 2009 05:20:23 -0000 1.74.2.1 > @@ -28,7 +28,7 @@ > SOURCES = \ > calc.mx bat5.mx algebra.mx status.mx unix.mx \ > mmath.mx lock.mx sema.mx alarm.mx batifthen.mx \ > - batcast.mx batcalc.mx batmath.mx aggr.mx counters.mx \ > + batcast.mx batcalc.mx batmmath.mx aggr.mx counters.mx \ > microbenchmark.mx > > #SCRIPTS = mal mil "" > @@ -103,7 +103,7 @@ > SOURCES = \ > calc.mx bat5.mx algebra.mx status.mx unix.mx \ > mmath.mx lock.mx sema.mx alarm.mx batifthen.mx \ > - batcast.mx batcalc.mx batmath.mx aggr.mx counters.mx \ > + batcast.mx batcalc.mx batmmath.mx aggr.mx counters.mx \ > microbenchmark.mx \ > batstr.mx batmtime.mx batcolor.mx group.mx array.mx logger.mx > HEADERS = h > @@ -114,7 +114,7 @@ > DIR = libdir/MonetDB5 > SOURCES = calc.mx bat5.mx algebra.mx status.mx unix.mx \ > mmath.mx lock.mx sema.mx alarm.mx batstr.mx batmtime.mx \ > - batcolor.mx batifthen.mx batcast.mx batcalc.mx batmath.mx \ > + batcolor.mx batifthen.mx batcast.mx batcalc.mx batmmath.mx \ > group.mx aggr.mx array.mx \ > counters.mx logger.mx microbenchmark.mx > } > > --- batmath.mx DELETED --- > > --- NEW FILE: batmmath.mx --- > @' The contents of this file are subject to the MonetDB Public License > @' Version 1.1 (the "License"); you may not use this file except in > @' compliance with the License. You may obtain a copy of the License at > @' http://monetdb.cwi.nl/Legal/MonetDBLicense-1.1.html > @' > @' Software distributed under the License is distributed on an "AS IS" > @' basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the > @' License for the specific language governing rights and limitations > @' under the License. > @' > @' The Original Code is the MonetDB Database System. > @' > @' The Initial Developer of the Original Code is CWI. > @' Portions created by CWI are Copyright (C) 1997-July 2008 CWI. > @' Copyright August 2008-2009 MonetDB B.V. > @' All Rights Reserved. > > @f batmmath > @a M.L. Kersten > @+ BAT math calculator > This module contains the multiplex versions of the linked > in mathematical functions. > @{ > @= tstBat > if( bn== NULL) {*ret= 0; > throw(MAL, "batcalc.@1", "can not create bat");} > > @+ Scientific routines > The mmath functions are also overloaded to provide for > the fast execution of expanded code blocks. > The common set of math functions is supported. > @= scienceFcn > command @1(x:bat[:oid,:dbl]) :bat[:oid,:dbl] > address CMDscience_bat_dbl_@1; > command @1(x:bat[:oid,:flt]) :bat[:oid,:flt] > address CMDscience_bat_flt_@1; > @= scienceFcnBinary > command @1(x:bat[:oid,:dbl],y:dbl):bat[:oid,:dbl] > address CMDscience_bat_cst_@1_dbl; > command @1(x:bat[:oid,:flt],y:flt):bat[:oid,:flt] > address CMDscience_bat_cst_@1_flt; > @- > @mal > module batmmath; > @:scienceFcn(asin)@ > @:scienceFcn(acos)@ > @:scienceFcn(atan)@ > @:scienceFcn(cos)@ > @:scienceFcn(sin)@ > @:scienceFcn(tan)@ > @:scienceFcn(cosh)@ > @:scienceFcn(sinh)@ > @:scienceFcn(tanh)@ > @:scienceFcn(exp)@ > @:scienceFcn(log)@ > @:scienceFcn(log10)@ > @:scienceFcn(sqrt)@ > @:scienceFcn(ceil)@ > @:scienceFcn(fabs)@ > @:scienceFcn(floor)@ > @- > round is not binary... > @:scienceFcnBinary(round,int)@ > @mal > @:scienceFcnBinary(fmod)@ > @:scienceFcnBinary(atan2)@ > @:scienceFcnBinary(pow)@ > @- Implementation > @include kprelude.mx > > @h > #ifdef _BATMATH_H > #define _BATMATH_H > > #endif /* _BATMATH_H */ > @- Implementations of scientific functions > @c > #include "mal_config.h" > #include "gdk.h" > #include "math.h" > #include "mal_exception.h" > #include "batmmath.h" > > #ifdef WIN32 > #ifndef LIBBATMATH > #define batmmath_export extern __declspec(dllimport) > #else > #define batmmath_export extern __declspec(dllexport) > #endif > #else > #define batmmath_export extern > #endif > > @- > @= scienceFcnImpl > batmmath_export str CMDscience_bat_@2_@1(int *ret, int *bid); > str CMDscience_bat_@2_@1(int *ret, int *bid) > { > BAT *b,*bn; > @2 *o, *p, *q; > > @:getBATdescriptor(bid,b,"batcalc.@1")@ > @:voidresultBAT(TYPE_dbl,"batcalc.@1")@ > > o = (@2*) Tloc(bn, BUNfirst(bn)); > p = (@2*) Tloc(b, BUNfirst(b)); > q = (@2*) Tloc(b, BUNlast(b)); > > if (b->T->nonil){ > for(;p<q; o++, p++) > *o = @1(*p); > } else > for(;p<q; o++, p++){ > *o = *p == dbl_nil? dbl_nil: @1(*p); > } > BATsetcount(bn, BATcount(b)); > bn->tsorted = 0; > BATkey(BATmirror(bn),0); > > if (!(bn->batDirty&2)) bn = BATsetaccess(bn, BAT_READ); > > if (b->htype != bn->htype) { > BAT *r = VIEWcreate(b,bn); > > BBPreleaseref(bn->batCacheid); > bn = r; > } > BBPkeepref(*ret = bn->batCacheid); > BBPreleaseref(b->batCacheid); > return MAL_SUCCEED; > } > @= scienceBinaryImpl > batmmath_export str CMDscience_bat_cst_@1_@2(int *ret, int *bid, @2 *d); > str CMDscience_bat_cst_@1_@2(int *ret, int *bid, @2 *d) > { > BAT *b,*bn; > @2 *o, *p, *q; > > @:getBATdescriptor(bid,b,"batcalc.@1")@ > @:voidresultBAT(TYPE_dbl,"batcalc.@1")@ > > o = (@2*) Tloc(bn, BUNfirst(bn)); > p = (@2*) Tloc(b, BUNfirst(b)); > q = (@2*) Tloc(b, BUNlast(b)); > > if (b->T->nonil){ > for(;p<q; o++, p++) > *o = @1(*p,*d); > } else > for(;p<q; o++, p++){ > *o = *p == dbl_nil? dbl_nil: @1(*p,*d); > } > > BATsetcount(bn, BATcount(b)); > bn->tsorted = 0; > BATkey(BATmirror(bn),0); > > if (!(bn->batDirty&2)) bn = BATsetaccess(bn, BAT_READ); > > if (b->htype != bn->htype) { > BAT *r = VIEWcreate(b,bn); > > BBPreleaseref(bn->batCacheid); > bn = r; > } > BBPkeepref(*ret = bn->batCacheid); > BBPreleaseref(b->batCacheid); > return MAL_SUCCEED; > } > @= scienceImpl > @:scienceFcnImpl(@1,dbl)@ > @:scienceFcnImpl(@1,flt)@ > @c > @:scienceImpl(asin)@ > @:scienceImpl(acos)@ > @:scienceImpl(atan)@ > @:scienceImpl(cos)@ > @:scienceImpl(sin)@ > @:scienceImpl(tan)@ > @:scienceImpl(cosh)@ > @:scienceImpl(sinh)@ > @:scienceImpl(tanh)@ > @:scienceImpl(exp)@ > @:scienceImpl(log)@ > @:scienceImpl(log10)@ > @:scienceImpl(sqrt)@ > @:scienceImpl(ceil)@ > @:scienceImpl(fabs)@ > @:scienceImpl(floor)@ > @- > round is not binary... > @:scienceBinaryImpl(round,int)@ > @c > @:scienceBinaryImpl(fmod,dbl)@ > @:scienceBinaryImpl(fmod,flt)@ > @:scienceBinaryImpl(atan2,dbl)@ > @:scienceBinaryImpl(atan2,flt)@ > @:scienceBinaryImpl(pow,dbl)@ > @:scienceBinaryImpl(pow,flt)@ > > @} > > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] stable xq testweb
by Peter Boncz 10 Feb '09

10 Feb '09

Hi, (the below analyis of the Stable XQ testweb is not an implicit request for anybody to do something, I just share it here so you will not do double work) Recently I checked in some fixes. - Because I have the suspicion that certain scripts at NFI may still use hard commits, I redefined the commit() in module pathfinder to giving an error. - I also added pflock_trycommit(), as part of the change (hack?) to ensure that checkpoint flushes occur only on an idle system. This led me to expect the Stable testweb in detail today. My new commit() error policy causes the following tests to display different output: benchmarks/XPath*/import_doc benchmarks/XMark*/import_doc benchmarks/Music*/import_doc tests/BugsViaSourgeforce/ ID.1078462_import tests/Standoff/video/import_doc tests/W3C_use_cases/XQUF/AddressBook/check_docs tests/i18n/import_doc tests/WebSite/voc I think what we could do is to substitute the commit() by a pf_logflush(0LL) , although simply omitting the "commit();"should also work. The pflock_trycommit() new command obviously alsoshows up in some tests. However, I also saw time-, standoff- and pf-tjah related output that probably can be approved: modules/pftijah/procs runtime/sigs runtime/procs No to the oher differences (ignoring xrpc and W3c/qn/ns which AFAIK has always failed).. The below use recursive functions for which we maybe could add 'declare option pf:recursion-depth "<number>";?? tests/BugTracker/Alignment_error.SF-1886994 tests/BugTracker/recursive_function.SF-1835745 tests/BugTracker/pf-O0_produces_wrong_MIL.SF-1771532 tests/BugTracker/posjoin_null_BAT_2nd_run.SF-1678948 tests/BugTracker/error-KO2.SF-1562868 recursion_type_error.SF-1579524 tests/BugsViaSourgeforce/ID.1652527 tests/W3C_use_cases/XQ/PARTS/Q1[x] tests/W3C_use_cases/XQ/TREE/Q[1,6] tests/W3C_use_cases/XQUF/Parts/q3b[12] tests/WebSite/books2,3 tests/XQuery/fun1,4 which leaves us with 6 the following suspect regressions: tests/BugTracker/replace-corrupts.SF-1758902 tests/BugTracker/1637867.xq tests/BugTracker/1pagedoc.SF-2141012 tests/BugTracker/Zombie_document.SF-2009556 tests/W3C_use_cases/XQUF/AddressBook/check_docs tests/Update/insert_test_order_seq

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_heap.mx, , 1.107, 1.108
by Stefan Manegold 09 Feb '09

09 Feb '09

Peter, IMHO, this check in does more than the log message suggests; among others, it appears to me as if this check in undoes some fixes coancerning *.new files that Sjoerd recently checked in. Could you please check and comment whether this was/is intended? Or was there any CVS related "accident"? Given that also the copyright statement is reverted to a state of last year, I suspect that an old version of this file has been re-activated, possibly instead of using CVS commands to revert or replay a former check in? Thanks in advance! Stefan On Thu, Feb 05, 2009 at 03:39:43PM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv5674 > > Modified Files: > gdk_heap.mx > Log Message: > - make large allocs fall back again on mmap > > > > U gdk_heap.mx > Index: gdk_heap.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_heap.mx,v > retrieving revision 1.107 > retrieving revision 1.108 > diff -u -d -r1.107 -r1.108 > --- gdk_heap.mx 22 Jan 2009 14:47:53 -0000 1.107 > +++ gdk_heap.mx 5 Feb 2009 15:39:41 -0000 1.108 > @@ -12,7 +12,7 @@ > @' > @' The Initial Developer of the Original Code is CWI. > @' Portions created by CWI are Copyright (C) 1997-July 2008 CWI. > -@' Copyright August 2008-2009 MonetDB B.V. > +@' Copyright August 2008- MonetDB B.V. > @' All Rights Reserved. > > @f gdk_heap > @@ -115,7 +115,7 @@ > fp = GDKfilelocate(nme, "wb", ext); > if (fp != NULL) { > fclose(fp); > - h->storage = STORE_MMAP; > + h->newstorage = STORE_MMAP; > HEAPload(h, nme, ext, FALSE); > } > GDKfree(of); > @@ -262,7 +262,7 @@ > @} > @- HEAPload > > -If we find file X.new, we move it over X (if present) and open it. > +If we don find file X.new, we move it over X (if present) and open it. > > This routine initializes the h->filename without deallocating > its previous contents. > @@ -284,7 +284,7 @@ > if (h->filename == NULL) > h->filename = (char *) GDKmalloc(strlen(nme) + strlen(ext) + 2); > if (h->filename == NULL) > - return -1; > + return -1; > sprintf(h->filename, "%s.%s", nme, ext); > > /* round up mmap heap sizes to REMAP_PAGE_MAXSIZE (usually 512KB) segments */ > @@ -323,19 +323,21 @@ > strcpy(p, ".new"); > ret = stat(dstpath, &st); > if (stat(srcpath, &st) == 0) { > - int t0; > - if (ret == 0) { > - t0 = GDKms(); > + if (ret) { > + int t0 = GDKms(); > ret = unlink(dstpath); > IODEBUG THRprintf(GDKout, "#unlink %s = %d (%dms)\n", dstpath, ret, GDKms() - t0); > } > - t0 = GDKms(); > - ret = rename(srcpath, dstpath); > - if (ret < 0) { > - GDKsyserror("HEAPload: rename of %s failed\n", srcpath); > - return -1; > + if (ret == 0) { /* move X.new to X */ > + int t0 = GDKms(); > + ret = rename(srcpath, dstpath); > + IODEBUG THRprintf(GDKout, "#rename %s %s = %d (%dms)\n", srcpath, dstpath, ret, GDKms() - t0); > } > - IODEBUG THRprintf(GDKout, "#rename %s %s = %d (%dms)\n", srcpath, dstpath, ret, GDKms() - t0); > + } else if (ret) { /* legacy: accept .priv files as well */ > + int t0 = GDKms(); > + strcpy(p, ".priv"); > + ret = rename(srcpath, dstpath); /* move X.priv to X */ > + IODEBUG THRprintf(GDKout, "#rename %s %s = %d (%dms)\n", srcpath, dstpath, ret, GDKms() - t0); > } > > h->base = (char *) GDKload(nme, ext, h->free, h->size, h->newstorage); > @@ -885,13 +887,15 @@ > /* > // Create bitmasks that will hold all valid block positions > */ > - hr->validmask = (int *) GDKzalloc(sizeof(int) * ++nwords); > - freemask = (int *) GDKzalloc(sizeof(int) * nwords); > + hr->validmask = (int *) GDKmalloc(sizeof(int) * ++nwords); > + freemask = (int *) GDKmalloc(sizeof(int) * nwords); > if (hr->validmask == NULL || freemask == NULL) { > GDKfree(hr->validmask); > GDKfree(freemask); > return FALSE; > } > + for (block = 0; block < nwords; block++) > + freemask[block] = hr->validmask[block] = 0; > > /* > // Walk the freelist; register them in freemask > > > ------------------------------------------------------------------------------ > Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) > software. With Adobe AIR, Ajax developers can use existing skills and code to > build responsive, highly engaging applications that combine the power of local > resources and data with the reach of the web. Download the Adobe AIR SDK and > Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal Makefile.ag, Feb2009, 1.127, 1.127.2.1 mal_init.mx, Feb2009, 1.155, 1.155.2.1 factory.mx, Feb2009, 1.28, NONE
by Stefan Manegold 08 Feb '09

08 Feb '09

On Sun, Feb 08, 2009 at 10:16:30AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv6498 > > Modified Files: > Tag: Feb2009 > Makefile.ag mal_init.mx > Removed Files: > Tag: Feb2009 > factory.mx > Log Message: > Solving a name conflict. Factory cannot be used as a module name, because > it is a keyword. It should have been captured a long time ago. Haven't trued to checkout and compile, yet, but I suspect you forgot to check in the new factories.mx, right? Stefan > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/Makefile.ag,v > retrieving revision 1.127 > retrieving revision 1.127.2.1 > diff -u -d -r1.127 -r1.127.2.1 > --- Makefile.ag 7 Jan 2009 14:15:13 -0000 1.127 > +++ Makefile.ag 8 Feb 2009 10:16:28 -0000 1.127.2.1 > @@ -31,7 +31,7 @@ > chopper.mx constraints.mx language.mx box.mx \ > profiler.mx const.mx algebraExtensions.mx \ > inspect.mx manual.mx pqueue.mx mkey.mx \ > - factory.mx mdb.mx \ > + factories.mx mdb.mx \ > urlbox.mx mat.mx \ > sabaoth.mx remote.mx replicator.mx txtsim.mx recycle.mx \ > cluster.mx > @@ -182,7 +182,7 @@ > chopper.mx constraints.mx language.mx box.mx \ > profiler.mx const.mx algebraExtensions.mx \ > inspect.mx manual.mx pqueue.mx mkey.mx \ > - factory.mx mdb.mx \ > + factories.mx mdb.mx \ > urlbox.mx mat.mx \ > sabaoth.mx remote.mx replicator.mx batxml.mx recycle.mx \ > cluster.mx > @@ -198,7 +198,7 @@ > profiler.mx const.mx batExtensions.mx algebraExtensions.mx \ > inspect.mx manual.mx mal_io.mx pqueue.mx mkey.mx \ > chopper.mx clients.mx \ > - factory.mx mdb.mx pcre.mx tablet.mx mat.mx \ > + factories.mx mdb.mx pcre.mx tablet.mx mat.mx \ > urlbox.mx statistics.mx transaction.mx \ > mal_mapi.mx sabaoth.mx remote.mx replicator.mx \ > bpm.mx batxml.mx txtsim.mx recycle.mx \ > > U mal_init.mx > Index: mal_init.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/mal_init.mx,v > retrieving revision 1.155 > retrieving revision 1.155.2.1 > diff -u -d -r1.155 -r1.155.2.1 > --- mal_init.mx 26 Jan 2009 09:26:02 -0000 1.155 > +++ mal_init.mx 8 Feb 2009 10:16:28 -0000 1.155.2.1 > @@ -70,7 +70,7 @@ > library clients; > library mal_io; > library tablet; > -library factory; > +library factories; > library const; > library bbp; > library box; > @@ -160,7 +160,7 @@ > include box; > include mal_io; > include tablet; > -include factory; > +include factories; > include recycle; > include remote; > include replicator; > > --- factory.mx DELETED --- > > > ------------------------------------------------------------------------------ > Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) > software. With Adobe AIR, Ajax developers can use existing skills and code to > build responsive, highly engaging applications that combine the power of local > resources and data with the reach of the web. Download the Adobe AIR SDK and > Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/semantics xquery_fo.c, Feb2009, 1.177.2.1, 1.177.2.2
by Lefteris 08 Feb '09

08 Feb '09

Ignore this commit, it is the wrong file, I will undo this and re commit the correct file On Sun, Feb 8, 2009 at 12:15 PM, Lefteris Sidirourgos <lsidir(a)users.sourceforge.net> wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/semantics > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12467/compiler/semantics > > Modified Files: > Tag: Feb2009 > xquery_fo.c > Log Message: > do not assume that if a function has multiple signatures then it is always the correct. It might be the case that later on the list a more specific function definition is found. Thus, keep around the multiple signature function and return it only if nothing more specific is found. > > > U xquery_fo.c > Index: xquery_fo.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/semantics/xquery_fo.c,v > retrieving revision 1.177.2.1 > retrieving revision 1.177.2.2 > diff -u -d -r1.177.2.1 -r1.177.2.2 > --- xquery_fo.c 1 Feb 2009 10:57:08 -0000 1.177.2.1 > +++ xquery_fo.c 8 Feb 2009 11:15:36 -0000 1.177.2.2 > @@ -1597,20 +1597,88 @@ > .ret_ty = PFty_opt (PFty_xs_daytimeduration ()) } }, > .alg = NULL } > > -#if 0 > /* 10.6 Arithmetic Operators on Durations */ > - > - , /* op:add-yearMonthDurations */ > - , /* op:subtract-yearMonthDurations */ > - , /* op:multiply-yearMonthDuration */ > - , /* op:divide-yearMonthDuration */ > - , /* op:divide-yearMonthDuration-by-yearMonthDuration */ > - , /* op:add-dayTimeDurations */ > - , /* op:subtract-dayTimeDurations */ > - , /* op:multiply-dayTimeDuration */ > - , /* op:divide-dayTimeDuration */ > - , /* op:divide-dayTimeDuration-by-dayTimeDuration */ > - > + , /* op:add-yearMonthDurations (yearMonthDuration, yearMonthDuration) > + as yearMonthDuration */ > + { .ns = PFns_op, .loc = "plus", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_yearmonthduration (), > + PFty_xs_yearmonthduration () }, > + .ret_ty = PFty_xs_yearmonthduration () } }, > + .alg = PFbui_op_yearmonthduration_plus } > + , /* op:subtract-yearMonthDurations (yearMonthDuration, yearMonthDuration) > + as yearMonthDuration */ > + { .ns = PFns_op, .loc = "minus", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_yearmonthduration (), > + PFty_xs_yearmonthduration () }, > + .ret_ty = PFty_xs_yearmonthduration () } }, > + .alg = PFbui_op_yearmonthduration_minus } > + , /* op:multiply-yearMonthDuration (yearMonthDuration, double) > + as yearMonthDuration */ > + { .ns = PFns_op, .loc = "times", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_yearmonthduration (), > + PFty_xs_double () }, > + .ret_ty = PFty_xs_yearmonthduration () } }, > + .alg = PFbui_op_yearmonthduration_times } > + , /* op:divide-yearMonthDuration (yearMonthDuration, double) > + as yearMonthDuration */ > + { .ns = PFns_op, .loc = "div", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_yearmonthduration (), > + PFty_xs_double () }, > + .ret_ty = PFty_xs_yearmonthduration () } }, > + .alg = PFbui_op_yearmonthduration_div_dbl } > + , /* op:divide-yearMonthDuration-by-yearMonthDuration (yearMonthDuration, > + yearMonthDuration) as decimal */ > + { .ns = PFns_op, .loc = "div", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_yearmonthduration (), > + PFty_xs_yearmonthduration () }, > + .ret_ty = PFty_xs_decimal () } }, > + .alg = PFbui_op_yearmonthduration_div } > + , /* op:add-dayTimeDurations (dayTimeDuration, dayTimeDuration) > + as dayTimeDuration */ > + { .ns = PFns_op, .loc = "plus", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_daytimeduration (), > + PFty_xs_daytimeduration () }, > + .ret_ty = PFty_xs_daytimeduration () } }, > + .alg = PFbui_op_daytimeduration_plus } > + , /* op:subtract-dayTimeDurations (dayTimeDuration, dayTimeDuration) > + as dayTimeDuration */ > + { .ns = PFns_op, .loc = "minus", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_daytimeduration (), > + PFty_xs_daytimeduration () }, > + .ret_ty = PFty_xs_daytimeduration () } }, > + .alg = PFbui_op_daytimeduration_minus } > + , /* op:multiply-dayTimeDuration (dayTimeDuration, double) > + as dayTimeDuration */ > + { .ns = PFns_op, .loc = "times", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_daytimeduration (), > + PFty_xs_double () }, > + .ret_ty = PFty_xs_daytimeduration () } }, > + .alg = PFbui_op_daytimeduration_times } > + , /* op:divide-dayTimeDuration (dayTimeDuration, double) > + as dayTimeDuration */ > + { .ns = PFns_op, .loc = "div", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_daytimeduration (), > + PFty_xs_double () }, > + .ret_ty = PFty_xs_daytimeduration () } }, > + .alg = PFbui_op_daytimeduration_div_dbl } > + , /* op:divide-dayTimeDuration-by-dayTimeDuration (dayTimeDuration, > + dayTimeDuration) as decimal */ > + { .ns = PFns_op, .loc = "div", > + .arity = 2, .sig_count = 1, .sigs = { { > + .par_ty = (PFty_t[]) { PFty_xs_daytimeduration (), > + PFty_xs_daytimeduration () }, > + .ret_ty = PFty_xs_decimal () } }, > + .alg = PFbui_op_daytimeduration_div } > +#if 0 > /* 10.7 Timezone Adjustment Functions on Dates and Time Values */ > > , /* fn:adjust-dateTime-to-timezone */ > > > ------------------------------------------------------------------------------ > Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) > software. With Adobe AIR, Ajax developers can use existing skills and code to > build responsive, highly engaging applications that combine the power of local > resources and data with the reach of the web. Download the Adobe AIR SDK and > Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins >

1 0

[Monetdb-developers] Aggr function comment clarification
by Stefan de Konink 07 Feb '09

07 Feb '09

Could anyone elaborate what: comment "Sum over grouped tail sum on @1"; vs comment "Grouped tail sum on @1"; ...means? It is the distinct difference between AX3aggrX3_sum and AX3aggrX3_sum3. I'm looking for this `answer' just from an informational perspective. Stefan

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/Tests test_lms_or.stable.out, Feb2009, 1.3, 1.3.16.1
by Stefan Manegold 06 Feb '09

06 Feb '09

On Thu, Feb 05, 2009 at 02:48:37PM +0000, Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv2165/Tests > > Modified Files: > Tag: Feb2009 > test_lms_or.stable.out > Log Message: > after running the testset of INEX efficiency track, i found and fixed > several small bugs that caused queries to fail. Would it be an option to consider adding these tests to the standard testset to be run (and checked) automatically every night? Stefan > > > U test_lms_or.stable.out > Index: test_lms_or.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/test_lms_or.stable.out,v > retrieving revision 1.3 > retrieving revision 1.3.16.1 > diff -u -d -r1.3 -r1.3.16.1 > --- test_lms_or.stable.out 11 Sep 2007 15:52:53 -0000 1.3 > +++ test_lms_or.stable.out 5 Feb 2009 14:48:35 -0000 1.3.16.1 > @@ -22,7 +22,7 @@ > # 12:52:37 > > > <?xml version="1.0" encoding="utf-8"?> > -<XQueryResult><node rank="1"><title>Pathfinder and TIJAH</title></node><node rank="2"><title>TIJAH</title></node><node rank="3"><title>Pathfinder</title></node><node rank="4"><title>PF/Tijah</title></node></XQueryResult> > +<XQueryResult><node rank="1"><title>Pathfinder and TIJAH</title></node><node rank="2"><title>Pathfinder</title></node><node rank="3"><title>TIJAH</title></node><node rank="4"><title>PF/Tijah</title></node></XQueryResult> > > # 12:52:37 > > # 12:52:37 > Done. > > > ------------------------------------------------------------------------------ > Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) > software. With Adobe AIR, Ajax developers can use existing skills and code to > build responsive, highly engaging applications that combine the power of local > resources and data with the reach of the web. Download the Adobe AIR SDK and > Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/Tests usageH.stable.out, , 1.52, 1.53
by Sjoerd Mullender 05 Feb '09

05 Feb '09

Jan Rittinger wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12228/Tests > > Modified Files: > usageH.stable.out > Log Message: > -- Restructured Peters yesterday type cast checkin. > > - There is no necessity to make the types known outside the > typing. We can add the function signatures also locally. > > - Only the atomic types can be casted -- so only add atomic > predefined types. > > - Switched phases 9 and 10 to make sure that the type constructor > functions are loaded before the function checking. > > @Sjoerd and Stefan: I think these changes should be propagated to > the stable branch as well. Can you do that > with a script or should I better do it by hand? For us it's also a manual thing, so we wouldn't mind if you did it. But please use cvs commands to backport so that subsequent propagation sees that there are in fact no changes (otherwise we get conflicts). -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/BugTracker-2009/Tests select_from_history.SF-2556566.sql, Feb2009, NONE, 1.1.2.1 All, Feb2009, 1.2.2.2, 1.2.2.3
by Sjoerd Mullender 02 Feb '09

02 Feb '09

Where is the stable output? Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/test/BugTracker-2009/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv31118 > > Modified Files: > Tag: Feb2009 > All > Added Files: > Tag: Feb2009 > select_from_history.SF-2556566.sql > Log Message: > Add test to cover bug > select_from_history.SF-2556566 > > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/BugTracker-2009/Tests/All,v > retrieving revision 1.2.2.2 > retrieving revision 1.2.2.3 > diff -u -d -r1.2.2.2 -r1.2.2.3 > --- All 1 Feb 2009 23:37:18 -0000 1.2.2.2 > +++ All 2 Feb 2009 11:11:57 -0000 1.2.2.3 > @@ -3,3 +3,4 @@ > subquery_returns_table_crash.SF-2513620 > distinct.SF-2546483 > union_leak.SF-2540169 > +select_from_history.SF-2556566 > > --- NEW FILE: select_from_history.SF-2556566.sql --- > select * from history; > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_main.c, , 1.11, 1.12 tjc_milprint.c, , 1.10, 1.11
by Sjoerd Mullender 02 Feb '09

02 Feb '09

On 2009-02-01 18:12, Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv21759/tjc > > Modified Files: > tjc_main.c tjc_milprint.c > Log Message: > propagated other retrieval models from old tijah implementation to the new one. > (Sjoerd, should I check this in to the Feb2009 branch as well?) If it works and you want it in the release, then yes. -- Sjoerd Mullender

3 3

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah pftijah.mx, , 1.200, 1.201
by Stefan Manegold 02 Feb '09

02 Feb '09

On Mon, Feb 02, 2009 at 08:05:07AM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17111 > > Modified Files: > pftijah.mx > Log Message: > - Modify Hennings memory fix of yesterday eveening. This causes all old > pftijah testsets to fail. Henning will propagate this on to Stable. In case you are not able to have a release branch next to the development trunk (I currently handle 4 branches in parallel, each with 6 different configurations), you might want to consider the following to still follow our rule that bug fixes (that (also) apply to the release branch) are supposed to be checked in to the release branch, only, e.g., by [in your checkout of the development trunk] [edit your source file] [check whether everithing compiles and works correctly] cvs diff <file> [to check your changes wrt. the dev. trunk] cvs up -r<latest release branch name> <file> cvs diff <file> [to check your changes wrt. the release branch] [! check whether your fix indeed also fits for the release branch; in particular, check that there are no conflicts! !] cvs ci -m'<msg>' <file> cvs up -A <file> (While this is IMHO not too difficult, having a separate release branch checkout is prefered, ans it allows for testing fixes prior to checking them in ...) Stefan > U pftijah.mx > Index: pftijah.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/pftijah.mx,v > retrieving revision 1.200 > retrieving revision 1.201 > diff -u -d -r1.200 -r1.201 > --- pftijah.mx 1 Feb 2009 17:12:17 -0000 1.200 > +++ pftijah.mx 2 Feb 2009 08:05:05 -0000 1.201 > @@ -4156,7 +4156,8 @@ > GDKerror("CMDtijah_query: execute MIL failed.\n"); > return GDK_FAIL; > } > - GDKfree(mil); > + if ( newversion ) > + GDKfree(mil); > if (TDEBUG(2)) stream_printf(GDKout,"# CMDtijah_query: finish MIL script.\n"); > lng time_end = GDKusec(); > > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] M4 Automatic multiplex version of .tostr: weird behavior
by Lefteris 01 Feb '09

01 Feb '09

The following behavior is strange to me, but I am not sure if it is a bug or I have done something wrong. dayTimeDuration (dtduration) is defined in mil as: .ATOM dtduration = lng; .FROMSTR = dtduration_fromstr; .TOSTR = dtduration_tostr; .END; and in c as : typedef long long dtduration; also .tostr has the following sign. int dtduration_tostr(str *buf, int *len, dtduration *val) you can find all this in MonetDB4/src/modules/plain/monettime.mx Now, if I do either: dtduration("P12DT1H").print() [dtduration]("P12DT1H").print() I get the correct value printed. But if I create a BAT (void,str): var a0006 := new (void,str).seqbase (0@0); a0006.append("P12DT1H"); and do: [dtduration](a0006).print(); It gives back "PT0S", which means 0 duration, and thus the value of *val in dtduration_tostr is 0 (I checked that). So, could that be some bug with correct dealing of long values in the multiplex creation (btw. where is that happening?) Or am I missing some special case that I should take into consideration with long values? Thank you, lefteris P.S. yearMonthDuration which is defined as int works like a charm.

3 5

[Monetdb-developers] M5-SQL current branch on Fedora 10
by Romulo Goncalves 01 Feb '09

01 Feb '09

Hello, I just start my mserver5 on Fedora 10 (my desktop) and I get several messages like this one: #WARNING: LoaderException:loadLibrary:mdb: loader error libssl.so.6: cannot open shared object file: No such file or directory libssl.so.6 missing... All my sources are updated. Some suggestions on how to resolve this problem are very welcome ;) Romulo

4 4

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/mil milgen.brg, , 1.201, 1.202
by Sjoerd Mullender 30 Jan '09

30 Jan '09

Is this a fix that also applies to the Feb2009 branch? If so, please apply it there as well. In your copy of the Feb2009 stable branch do: cvs update -j1.201 -j1.202 milgen.brg Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/mil > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv10667/mil > > Modified Files: > milgen.brg > Log Message: > * reduce memory footprint by throwing away global score db explicitly. > > > > U milgen.brg > Index: milgen.brg > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/mil/milgen.brg,v > retrieving revision 1.201 > retrieving revision 1.202 > diff -u -d -r1.201 -r1.202 > --- milgen.brg 26 Jan 2009 14:50:15 -0000 1.201 > +++ milgen.brg 30 Jan 2009 08:43:40 -0000 1.202 > @@ -3825,8 +3825,12 @@ > error (var (err->name)), > nop ())); > } > - > unpin (err, 1); > +#ifdef HAVE_PFTIJAH > + execute( > + assgn (var (PF_MIL_TIJAH_SCORE_DB), unused() ) > + ); > +#endif > } break; /* fold) */ > > /* Query: serialize (Side, empty_tbl) */ > @@ -3932,6 +3936,11 @@ > nop ())); > > unpin (err, 1); > +#ifdef HAVE_PFTIJAH > + execute( > + assgn (var (PF_MIL_TIJAH_SCORE_DB), unused() ) > + ); > +#endif > } break; /* fold) */ > > /* Rel: lit_tbl */ > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_abssyn.c, , 1.4, 1.5 tjc_abssyn.h, , 1.6, 1.7 tjc_main.c, , 1.10, 1.11 tjc_parse.y, , 1.5, 1.6 tjc_phys_optimize.c, , 1.3, 1.4 tjc_phys_optimize.h, , 1.1, 1.2
by Sjoerd Mullender 30 Jan '09

30 Jan '09

Is this a fix that also applies to the Feb2009 branch? Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7540 > > Modified Files: > tjc_abssyn.c tjc_abssyn.h tjc_main.c tjc_parse.y > tjc_phys_optimize.c tjc_phys_optimize.h > Log Message: > forgot to free some allocated memory > > > > U tjc_main.c > Index: tjc_main.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_main.c,v > retrieving revision 1.10 > retrieving revision 1.11 > diff -u -d -r1.10 -r1.11 > --- tjc_main.c 28 Jan 2009 22:31:01 -0000 1.10 > +++ tjc_main.c 29 Jan 2009 22:33:16 -0000 1.11 > @@ -121,20 +121,6 @@ > } > } > > -void free_tree(TJptree_t *ptree) > -{ > - int c; > - TJpnode_t *n; > - for (c = 0; c < ptree->length; c++) { > - n = &ptree->node[c]; > - if (n->kind == p_query) > - TJCfree (n->sem.qnode); > - if (n->kind == p_tag && strcmp (n->sem.str, "*")) > - TJCfree (n->sem.str); > - } > - TJCfree (ptree); > -} > - > /* THE NEW STUFF */ > > tjc_config* tjc_c_GLOBAL; > @@ -334,7 +320,8 @@ > if (DEBUG) stream_printf(GDKout,"#!tjc start of mil:\n%s",milres); > if (DEBUG) stream_printf(GDKout,"#!tjc end of mil\n"); > > - free_tree(ptree); > + free_atree (atree); > + tjcp_freetree (ptree); > } > else { > *errBUFF = GDKstrdup(tjc_c->errBUFF); > > U tjc_phys_optimize.h > Index: tjc_phys_optimize.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_phys_optimize.h,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- tjc_phys_optimize.h 28 Jan 2009 22:31:01 -0000 1.1 > +++ tjc_phys_optimize.h 29 Jan 2009 22:33:16 -0000 1.2 > @@ -86,6 +86,9 @@ > phys_optimize(TJptree_t *ptree, TJpnode_t *proot, BAT* rtagbat); > > extern void > +free_atree(TJatree_t *atree); > + > +extern void > printTJatree(tjc_config *tjc_c, TJatree_t *atree); > > #endif /* PYHS_OPTIMIZE_H */ > > U tjc_phys_optimize.c > Index: tjc_phys_optimize.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_phys_optimize.c,v > retrieving revision 1.3 > retrieving revision 1.4 > diff -u -d -r1.3 -r1.4 > --- tjc_phys_optimize.c 29 Jan 2009 20:30:05 -0000 1.3 > +++ tjc_phys_optimize.c 29 Jan 2009 22:33:16 -0000 1.4 > @@ -123,6 +123,11 @@ > return atree; > } > > +void free_atree (TJatree_t *atree) { > + TJCfree (atree->nodes); > + TJCfree (atree); > +} > + > TJanode_t* pnode2anode (TJatree_t *atree, TJpnode_t *s, TJpnode_t *pnode, short *nt) > { > TJanode_t *anode; > > U tjc_parse.y > Index: tjc_parse.y > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_parse.y,v > retrieving revision 1.5 > retrieving revision 1.6 > diff -u -d -r1.5 -r1.6 > --- tjc_parse.y 28 Jan 2009 22:31:01 -0000 1.5 > +++ tjc_parse.y 29 Jan 2009 22:33:16 -0000 1.6 > @@ -145,7 +145,7 @@ > { $$ = $1; $$->root = tjcp_wire2 (tjc_tree, p_pred, $1->root, $2); } > | Path PathNoPred PredicateList > { $$ = $1; *($2->fixme) = $1->root; > - $$->root = tjcp_wire2 (tjc_tree, p_pred, $2->root, $3); } > + $$->root = tjcp_wire2 (tjc_tree, p_pred, $2->root, $3); TJCfree($2); } > ; > OptPathNoPred : /* empty */ > { $$ = NULL; } > > U tjc_abssyn.c > Index: tjc_abssyn.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_abssyn.c,v > retrieving revision 1.4 > retrieving revision 1.5 > diff -u -d -r1.4 -r1.5 > --- tjc_abssyn.c 28 Jan 2009 22:31:01 -0000 1.4 > +++ tjc_abssyn.c 29 Jan 2009 22:33:16 -0000 1.5 > @@ -48,7 +48,6 @@ > TJpnode_t *n = NULL; > int c; > > - //n = (TJpnode_t *) TJCmalloc (sizeof (TJpnode_t)); > if (t->length < t->capacity) > n = &(t->node[t->length++]); > else > @@ -170,6 +169,20 @@ > return ptree; > } > > +void tjcp_freetree(TJptree_t *ptree) > +{ > + int c; > + TJpnode_t *n; > + for (c = 0; c < ptree->length; c++) { > + n = &ptree->node[c]; > + if (n->kind == p_query) > + TJCfree (n->sem.qnode); > + if (n->kind == p_tag && strcmp (n->sem.str, "*")) > + TJCfree (n->sem.str); > + } > + TJCfree (ptree); > +} > + > /** > * Allocates enough memory to hold a copy of @a str > * and return a pointer to this copy > > U tjc_abssyn.h > Index: tjc_abssyn.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_abssyn.h,v > retrieving revision 1.6 > retrieving revision 1.7 > diff -u -d -r1.6 -r1.7 > --- tjc_abssyn.h 28 Jan 2009 22:31:01 -0000 1.6 > +++ tjc_abssyn.h 29 Jan 2009 22:33:16 -0000 1.7 > @@ -160,6 +160,9 @@ > extern struct TJptree_t * > tjcp_inittree (void); > > +extern void > +tjcp_freetree (TJptree_t *ptree); > + > extern char * > TJstrndup (const char *str); > > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

[Monetdb-developers] New stable branch created
by Sjoerd Mullender 29 Jan '09

29 Jan '09

I have created new stable branches for the upcoming release. From now on *all* bug fixes and *only* bug fixes *must* go to this new stable branch. I reserve the right to undo any changes that do not comply with this rule. All packages use the same name for the branch: Feb2009. So in each of your stable checkout directories you can do cvs update -rFeb2009 to update to the new branch. I have created branches for the following packages: MonetDB MonetDB4 MonetDB5 TestTools buildtools clients geom java pathfinder sql template testing. Note that datacell is missing from this list. It is not yet released and will not be released in this round. Also note that two packages now have stable branches that didn't use to have them: java and testing. Testing is a new package (split off from MonetDB) and java is now also incorporated in the release cycle. -- Sjoerd Mullender

1 0

[Monetdb-developers] char *mapi_get_type(MapiHdl hdl, int fnr)
by Stefan de Konink 25 Jan '09

25 Jan '09

What is the reason that $subj is not a const char *? Stefan

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server rel_semantic.mx, , 1.35, 1.36 sql_parser.mx, , 1.299, 1.300 sql_psm.mx, , 1.65, 1.66 sql_semantic.mx, , 1.194, 1.195 sql_updates.mx, , 1.161, 1.162
by Sjoerd Mullender 23 Jan '09

23 Jan '09

Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13513/src/server > > Modified Files: > rel_semantic.mx sql_parser.mx sql_psm.mx sql_semantic.mx > sql_updates.mx > Log Message: > added binary import support (using new BATattach) > > > Index: sql_parser.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_parser.mx,v > retrieving revision 1.299 > retrieving revision 1.300 > diff -u -d -r1.299 -r1.300 > --- sql_parser.mx 17 Jan 2009 18:17:01 -0000 1.299 > +++ sql_parser.mx 22 Jan 2009 21:58:06 -0000 1.300 > @@ -2400,6 +2401,12 @@ > append_list(l, $2); > append_string(l, $8); > $$ = _symbol_create_list( SQL_COPYFROM, l ); } > +/* binary copy from */ > + | COPY INTO qname FROM '(' string_commalist ')' > + { dlist *l = L(); > + append_list(l, $3); > + append_list(l, $6); > + $$ = _symbol_create_list( SQL_BINCOPYFROM, l ); } > | COPY select_no_parens_orderby INTO string opt_seps opt_null_string > { dlist *l = L(); > append_symbol(l, $2); This appears to break the syntax copy into a from '/tmp/i' using delimiters '\t'; (!syntax error, unexpected STRING, expecting '(' in: "explain copy into a from '/tmp/i'"). It can be salvaged by adding opt_nr like the two COPY statements before this, but then you'd have to check "by hand" that opt_nr returns NULL. -- Sjoerd Mullender

1 0

[Monetdb-developers] Announcement: New bug fix release of MonetDB suite
by Sjoerd Mullender 23 Jan '09

23 Jan '09

The MonetDB team at CWI is pleased to announce the Nov2008-SP2 bug fix release of the MonetDB suite of programs. This is a bug fix release of the Nov2008 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Nov2008/#Nov200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime serialize.mx, , 1.119, 1.120 xrpc_server.mx, , 1.85, 1.86
by Stefan Manegold 22 Jan '09

22 Jan '09

On Thu, Jan 22, 2009 at 03:06:44PM +0100, Ying Zhang wrote: > On Thu, Jan 22, 2009 at 12:30:21PM +0000, Ying Zhang wrote: > > Update of /cvsroot/monetdb/pathfinder/runtime > > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv16608 > > > > Modified Files: > > serialize.mx xrpc_server.mx > > Log Message: > > Added a new env. var. to make the root directory, from which the XRPC HTTP > > server serves files, configurable. > > > > This was (mainly) needed to get the xrpc admin tests run with RunMtest, since RunMtest doesn't have monet installed yet (i.e., there is no $prefix/share/ MonetDB/xrpc/ yet), so we need a way to tell the xrpc server to serve file from > > a different directory, in this case, from $srcdir/runtime/xrpc. > > Sorry, I forgot to mention that this checkin requires an update and a > rebuild of MonetDB4, because changes in MonetDB4/conf/MonetDB.conf.in > are needed. question is why are they needed? or differently, why is the default (only) set in MonetDB.conf, rather then where it is (first) used in Pathfinder/XRPC? I would have expected that the newly added code in Pathfinder/XRPC, just checks, whether the new environment variable is set; if so, it uses that value; otherwise, it uses a default (defined there). In case your code does already exactly this, the changes in MonetDB.conf, should not be required for the new PF/XRPC code to work, rather, they mainly document the new variable and its default value. Stefan > Jennie > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime serialize.mx, , 1.119, 1.120 xrpc_server.mx, , 1.85, 1.86
by Stefan Manegold 22 Jan '09

22 Jan '09

On Thu, Jan 22, 2009 at 12:30:21PM +0000, Ying Zhang wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv16608 > > Modified Files: > serialize.mx xrpc_server.mx > Log Message: > Added a new env. var. to make the root directory, from which the XRPC HTTP > server serves files, configurable. > > This was (mainly) needed to get the xrpc admin tests run with RunMtest, since RunMtest doesn't have monet installed yet (i.e., there is no $prefix/share/ MonetDB/xrpc/ yet), so we need a way to tell the xrpc server to serve file from > a different directory, in this case, from $srcdir/runtime/xrpc. > [...] > > U xrpc_server.mx > Index: xrpc_server.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc_server.mx,v > retrieving revision 1.85 > retrieving revision 1.86 > diff -u -d -r1.85 -r1.86 > --- xrpc_server.mx 8 Jan 2009 16:54:18 -0000 1.85 > +++ xrpc_server.mx 22 Jan 2009 12:30:19 -0000 1.86 > @@ -89,6 +89,10 @@ > xrpc_trusted.append(prefix); > } > > +proc set_xrpc_docroot(str new_docroot) : void { > + > +} > + Jennie, what is the purpose of the above *empty* MIL proc? Stefan > proc get_xrpc_open() : bit { > if (monet_environment.exist("xrpc_open")){ > return bit(monet_environment.find("xrpc_open")); [...] -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] Results of FastBit Experiment
by Ross Bates 21 Jan '09

21 Jan '09

A question for any of the core team who were involved.... what resulted when FastBit was plugged into the backend of MonetDB? -Ross

1 0

[Monetdb-developers] mclient running out of memory, crashing mserver5
by sylver_b 21 Jan '09

21 Jan '09

Hi, I've finally found a better way to bulk load records via perl & odbc - a lot more stable. However, I've noticed many times mclient crashing mserver5 when loading records via the interactive interface. For instance, I tried to load about 130 inserts from a sql file using this command : mclient -lsql -d mydb < public_sysuser.sql After few seconds I started to see : #BBPTRIM: memtarget=17978753 vmtarget=0 #BBPTRIM_EXIT: memsize=24100864,vmsize=273741960 [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] #BBPTRIM_ENTER: memsize=275281456,vmsize=275166768 #BBPTRIM: memtarget=19273201 vmtarget=0 #BBPTRIM_EXIT: memsize=24100864,vmsize=275158816 [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] #BBPTRIM_ENTER: memsize=276161752,vmsize=276047064 #BBPTRIM: memtarget=20153497 vmtarget=0 #BBPTRIM_EXIT: memsize=24100864,vmsize=276056368 [ 1 ] #BBPTRIM_ENTER: memsize=276322608,vmsize=276207920 #BBPTRIM: memtarget=20314353 vmtarget=0 #BBPTRIM_EXIT: memsize=24100864,vmsize=276198064 Top is showing : top - 23:26:14 up 249 days, 9:57, 5 users, load average: 0.00, 0.20, 0.45 Tasks: 96 total, 1 running, 95 sleeping, 0 stopped, 0 zombie Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 4025600k total, 2433324k used, 1592276k free, 191788k buffers Swap: 9502408k total, 92k used, 9502316k free, 1993392k cached I don't think i'm running out of memory. I had to stop and restart mserver5, flush the table, then re-run the command - all the records were inserted. Also I noticed this type of messages on the mserver5 console when piping records through the mclient (over 1million records) . It seems that the mclient is quiet instable (cf my post about "COPY, terminating connection" few months ago). So, is there a way to increase the memory limit or make sure mserver5 won't crash when running bash inserts via a cron job ? Please advise, Thank you SB

3 9

[Monetdb-developers] MonetDb comparison Data Load
by Prometheus WillSurvive 19 Jan '09

19 Jan '09

Dear Developers-Users, First of all I would like to thanks all of your afforts to birng us these DB technologies and a platform for openly discussion. We are consulting big sized customers and deploying their data search technologies. Total size is around 1 petabytes daily . (total of our customers number ) . Their data size starts 1 TB (9.000.000.000 lines cvs) to 100 TB. so we have different size of customer base. We are looking opensource db solutions for a while due to lack of support and technological cumbersome of the current commercial solutions. We have 3 test customer now : 1-1 TB data dailiy read only purposes. 9.000.000.000 cvs file should be load to database . Data should be load to the database max 2 hours. after that comlex crm analitic queries. max 10 concurrent user/queries. database will be daily and wil not grow dailiy. so limit is 1 TB data load. 2-10 TB data daily. same as above .. 3-50 TB data stabil. will not grow. So we are looking for a solutions: *Fast data loading. How fast we load data to the MonetDB ? Is it could be multithreaded data loading possible ? *Is it possible to MPP ? can we add more server to share cpu resources and decrease the load time ? what is the best HW solution for above first customer ? Do we need still fat enterrprise servers or what ? We are also looking for InfoBright, Vertica and also Luciddb. VErtica is not opensource so out of the list. Infobright seems not giving its full power in the opensource.. Also we heard about the MonetDB X100 and interested. After 3 months succefully test we will support monetDB developer if its solved our problems. We can pay . Best Regards W.S

1 0

[Monetdb-developers] MonetDB Comparison and Power
by willsurvive 19 Jan '09

19 Jan '09

Dear Developers-Users, First of all I would like to thanks all of your afforts to birng us these DB technologies and a platform for openly discussion. We are consulting big sized customers and deploying their data search technologies. Total size is around 1 petabytes daily . (total of our customers number ) . Their data size starts 1 TB (9.000.000.000 lines cvs) to 100 TB. so we have different size of customer base. We are looking opensource db solutions for a while due to lack of support and technological cumbersome of the current commercial solutions. We have 3 test customer now : 1-1 TB data dailiy read only purposes. 9.000.000.000 cvs file should be load to database . Data should be load to the database max 2 hours. after that comlex crm analitic queries. max 10 concurrent user/queries. database will be daily and wil not grow dailiy. so limit is 1 TB data load. 2-10 TB data daily. same as above .. 3-50 TB data stabil. will not grow. So we are looking for a solutions: *Fast data loading. How fast we load data to the MonetDB ? Is it could be multithreaded data loading possible ? *Is it possible to MPP ? can we add more server to share cpu resources and decrease the load time ? what is the best HW solution for above first customer ? Do we need still fat enterrprise servers or what ? We are also looking for InfoBright, Vertica and also Luciddb. VErtica is not opensource so out of the list. Infobright seems not giving its full power in the opensource.. Also we heard about the MonetDB X100 and interested. After 3 months succefully test we will support monetDB developer if its solved our problems. We can pay . Best Regards W.S -- View this message in context: http://www.nabble.com/MonetDB-Comparison-and-Power-tp21541998p21541998.html Sent from the monetdb-developers mailing list archive at Nabble.com.

1 0

[Monetdb-developers] prepare for release
by Sjoerd Mullender 14 Jan '09

14 Jan '09

This is a heads-up. Next week I will create a new bug fix release, so please fix the last remaining bugs in the stable branch now. When the bug fix release has been done, I will create a new stable branch based on the development branch in preparation for the February feature release. This means that if there is anything that you want in that release, implement it now. Once the branch has been made, we will have a few weeks to stabilize the new stable branch before it is released. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime/xrpc/admin/Tests add_del_doc.xq.in, Nov2008, 1.1.4.3, 1.1.4.4 add_del_doc_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2 add_trusted.mil, Nov2008, 1.1.4.2, 1.1.4.3 backup_restore.xq.in, Nov2008, 1.1.4.5, 1.1.4.6 backup_restore_noxrpc.xq.in, Nov2008, 1.1.2.2, 1.1.2.3 db_env.xq.in, Nov2008, 1.1.4.2, 1.1.4.3 db_env_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2 db_stats.xq.in, Nov2008, 1.1.4.2, 1.1.4.3 db_stats_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2
by Sjoerd Mullender 12 Jan '09

12 Jan '09

On 2009-01-12 17:16, Ying Zhang wrote: > Sorry, forgot to mention: please don't propagate these changes to HEAD! I took care of that. > Thanks. > > Jennie > > > On Mon, Jan 12, 2009 at 04:01:02PM +0000, Ying Zhang wrote: >> Update of /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv10518 >> >> Modified Files: >> Tag: Nov2008 >> add_del_doc.xq.in add_del_doc_noxrpc.xq.in add_trusted.mil >> backup_restore.xq.in backup_restore_noxrpc.xq.in db_env.xq.in >> db_env_noxrpc.xq.in db_stats.xq.in db_stats_noxrpc.xq.in >> Log Message: >> - *.xq.in >> >> the xrpc http server is not available (yet) in RunMtest, hence, use the module >> file 'admin.xq'-s local path, instead of using its URL served by the xrpc http server. >> >> -add_trusted.mil >> >> allow 'admin.xq' to be executed >> >> >> >> U add_del_doc.xq.in >> Index: add_del_doc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_del_doc.xq.in,v >> retrieving revision 1.1.4.3 >> retrieving revision 1.1.4.4 >> diff -u -d -r1.1.4.3 -r1.1.4.4 >> --- add_del_doc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.4.3 >> +++ add_del_doc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.4 >> @@ -11,17 +11,17 @@ >> - adm:del-doc() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> (execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", >> "xmark1.xml", "xmark", 10)}, >> execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", >> "xmark2.xml", "xmark", 10)} >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-add>{ >> @@ -61,11 +61,11 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-del>{ >> >> U backup_restore_noxrpc.xq.in >> Index: backup_restore_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/backup_restore_noxrpc.xq.in,v >> retrieving revision 1.1.2.2 >> retrieving revision 1.1.2.3 >> diff -u -d -r1.1.2.2 -r1.1.2.3 >> --- backup_restore_noxrpc.xq.in 9 Jan 2009 14:40:24 -0000 1.1.2.2 >> +++ backup_restore_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.3 >> @@ -15,13 +15,13 @@ >> - adm:restore-col() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> -(adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> - adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> +(adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> + adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-before-backup>{ >> @@ -38,23 +38,23 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:backup("test") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-del>{ adm:collections() }</db-after-del> >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:restore("test", 10) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-after-restore>{ >> @@ -73,11 +73,11 @@ >> <> >> (: clean DB at the end of the test :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-cleanup> >> { adm:documents() } >> </db-after-cleanup> >> >> U db_env_noxrpc.xq.in >> Index: db_env_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_env_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- db_env_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ db_env_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $env in adm:db-env() >> return >> (text { "
 " }, >> >> U db_stats.xq.in >> Index: db_stats.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_stats.xq.in,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- db_stats.xq.in 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ db_stats.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $stat in execute at {"$HOST:$XRPCPORT"} {adm:db-stats()} >> return >> (text { "
 " }, >> >> U add_del_doc_noxrpc.xq.in >> Index: add_del_doc_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_del_doc_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- add_del_doc_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ add_del_doc_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -11,13 +11,13 @@ >> - adm:del-doc() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> -(adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> - adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> +(adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> + adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-add>{ >> @@ -57,11 +57,11 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-del>{ >> >> U db_stats_noxrpc.xq.in >> Index: db_stats_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_stats_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- db_stats_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ db_stats_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $stat in adm:db-stats() >> return >> (text { "
 " }, >> >> U db_env.xq.in >> Index: db_env.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_env.xq.in,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- db_env.xq.in 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ db_env.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $env in execute at {"$HOST:$XRPCPORT"} {adm:db-env()} >> return >> (text { "
 " }, >> >> U add_trusted.mil >> Index: add_trusted.mil >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_trusted.mil,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- add_trusted.mil 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ add_trusted.mil 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -2,12 +2,17 @@ >> module("unix"); >> >> var TSTSRCDIR := getenv("TSTSRCDIR"); >> +var TSTSRCBASE := getenv("TSTSRCBASE"); >> var TSTTRGDIR := getenv("TSTTRGDIR"); >> +var TSTTRGBASE := getenv("TSTTRGBASE"); >> var HOST := getenv("HOST"); >> var XRPCPORT := getenv("XRPCPORT"); >> >> add_xrpc_trusted(TSTSRCDIR); >> +add_xrpc_trusted(TSTSRCBASE); >> + >> add_xrpc_trusted(TSTTRGDIR); >> +add_xrpc_trusted(TSTTRGBASE); >> add_xrpc_trusted("http://"+HOST+":"+XRPCPORT); >> >> commit(); >> >> U backup_restore.xq.in >> Index: backup_restore.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/backup_restore.xq.in,v >> retrieving revision 1.1.4.5 >> retrieving revision 1.1.4.6 >> diff -u -d -r1.1.4.5 -r1.1.4.6 >> --- backup_restore.xq.in 9 Jan 2009 14:40:24 -0000 1.1.4.5 >> +++ backup_restore.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.6 >> @@ -15,17 +15,17 @@ >> - adm:restore-col() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> (execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", >> "xmark1.xml", "xmark", 10)}, >> execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", >> "xmark2.xml", "xmark", 10)} >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-before-backup>{ >> @@ -42,25 +42,25 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:backup("test")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-del>{ >> execute at {"$HOST:$XRPCPORT"} {adm:collections()} >> }</db-after-del> >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:restore("test", 10)} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-after-restore>{ >> @@ -79,11 +79,11 @@ >> <> >> (: clean DB at the end of the test :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-cleanup> >> { execute at {"$HOST:$XRPCPORT"} {adm:documents()} } >> </db-after-cleanup> >> >> >> ------------------------------------------------------------------------------ >> Check out the new SourceForge.net Marketplace. >> It is the best place to buy or sell services for >> just about anything Open Source. >> http://p.sf.net/sfu/Xq1LFB >> _______________________________________________ >> Monetdb-pf-checkins mailing list >> Monetdb-pf-checkins(a)lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/Tests usage.stable.out, , 1.19, 1.20 usageH.stable.out, , 1.49, 1.50
by Stefan Manegold 09 Jan '09

09 Jan '09

On Fri, Jan 09, 2009 at 09:50:35AM +0000, Jan Rittinger wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17274/Tests > > Modified Files: > usage.stable.out usageH.stable.out > Log Message: > -- Adjust help messages to the new copyright information. Just for info for you and for who ever will take care of updating the stable output accordingly in the Nov2008 release branch and then (not) propagating it to the development trunk (most probably Sjoerd or me ...): The copyright information has obviously also been updated in the Nov2008 release branch, and the stable output for the respective tests should be updated there as well --- propagating these updates *might* then cause (probably easily resolvable) conflicts as the stable output in the development trunk has just experienced two changes: new copyright and new usage info. Note, this is neither a critique nor a major problem, but just to share information that might help to reduce / prevent inconveniences, in particular with (semi-automa[tgn]ic) propagation of chnages from the latest release branch to the development trunk. (For the future, the "ideal" procedure would (have) be(en) to first update the copyright info in the stable output of the release branch, then propagate these changes, and then update / extend the usage info in the development trunk and update the stable output there accordingly. ;-)) Stefan > -- Extend help message 'pf -H' to list all available optimization phases. > > > U usageH.stable.out > Index: usageH.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/Tests/usageH.stable.out,v > retrieving revision 1.49 > retrieving revision 1.50 > diff -u -d -r1.49 -r1.50 > --- usageH.stable.out 2 Dec 2008 17:30:41 -0000 1.49 > +++ usageH.stable.out 9 Jan 2009 09:50:33 -0000 1.50 > @@ -11,7 +11,7 @@ > # 15:43:45 > > > Pathfinder XQuery Compiler ($Revision$, $Date$) > -(c) Database Group, Technische Universitaet Muenchen > +(c) Database Systems Group, Eberhard Karls Universitaet Tuebingen > > Usage: pf [OPTION] [FILE] > > @@ -38,6 +38,9 @@ > = -p, --physical-algebra-plan: enable generation of physical algebra plan > = -f<format>, --format=<format>: enable generation of algebra properties > + print all available properties (logical/physical algebra) > + <optoptions> selectively choose optimization options that are based > + on a single property (e.g., 'O') to print the respective > + property > c print cost value (physical algebra) > o print orderings (physical algebra) > > @@ -65,23 +68,30 @@ > 21 after compiling the physical algebra into MIL code > 22 after the MIL program has been serialized > > -= -o<options>, --optimize-algebra=<options>: optimize algebra according to options: > += -o<optoptions>, --optimize-algebra=<optoptions>: optimize algebra according to optimization options: > + E merge common subexpressions (CSE) > + G apply general optimization (without properties) > O apply optimization based on constant property > I apply optimization based on icols property > K apply optimization based on key property > - C apply optimization using multiple properties (complex) > - (and icols based optimization will be applied afterwards) > - G apply general optimization (without properties) > + N apply optimization based on required node values property > V apply optimization based on required values property > - [ map column names to unique column names > - J push down equi-joins (requires unique column names) > - ] map column names back (from unique names to original names) > - M apply optimization based on multi-value dependencies > S apply optimization based on set property > + U apply optimization based on XML Guide information > + (only works for the SQL code generation) > + C apply optimization using multiple properties (complex) > + (and icols based optimization will be applied afterwards) > + J push down equi-joins > + M push up cross products (based on multi-value dependencies > + T push up theta-joins (based on multi-value dependencies > + R push up rank operators > } introduce proxy operators that representoperator groups > { remove proxy operators > + Q apply optimizations tailored for the SQL code generation > + [ assign a new set of unique column names > + ] assign bit-encoded column names (deprecated optimization option) > P infer all properties > - _ does nothing (used for structuring the options) > + _ does nothing (used for structuring the optimization options) > (default for option -A is: '-o OIKCG_VG_JISI_GECSVR_OK_N}MT{JISI_GECSVR_}MT{JISI_OK_GECSVR_GP') > (default for option -S is: '-o OIKCG_VG_JISI_GECSVR_OK_N}MT{JISI_GECSVR_Q_}MT{JISI_OK_GECSVR_QGP') > > > U usage.stable.out > Index: usage.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/Tests/usage.stable.out,v > retrieving revision 1.19 > retrieving revision 1.20 > diff -u -d -r1.19 -r1.20 > --- usage.stable.out 19 Jun 2008 14:13:10 -0000 1.19 > +++ usage.stable.out 9 Jan 2009 09:50:33 -0000 1.20 > @@ -11,7 +11,7 @@ > # 13:16:47 > > > Pathfinder XQuery Compiler ($Revision$, $Date$) > -(c) Database Group, Technische Universitaet Muenchen > +(c) Database Systems Group, Eberhard Karls Universitaet Tuebingen > > Usage: pf [OPTION] [FILE] > > > > ------------------------------------------------------------------------------ > Check out the new SourceForge.net Marketplace. > It is the best place to buy or sell services for > just about anything Open Source. > http://p.sf.net/sfu/Xq1LFB > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [MonetDB-users] COPY INTO on aggregate queries crashes MonetDB
by Martin Kersten 04 Jan '09

04 Jan '09

Dear Peter, The problem mentioned could be reproduced. It is clearly a bug and registered as such in test copy-count.SF-2485215.sql. It seems a bug in the code generator of SQL. The progress can be followed in the sourceforge bugtracker. Thanks for using the MonetDB package and helping to improve its quality. regards, Martin Peter Farkash wrote: > Hi, > > When I use COPY INTO with a count query, monetDB crashes. > For example: > > copy select count (*) into 'C:\\copyinto.txt' using delimiters ','; > > Gives me the following result and kills the server: > > MAPI = monetdb@localhost:50000 > ACTION= read_line > QUERY = copy select count (*) into 'C:\\copyinto.txt' using delimiters ','; > ERROR = Connection terminated > > The same happens if I use sum, average, etc. On normal queries the copy into > works just fine. > I am using v5.8.2, and am getting the crash both when using mclient and the > MAPI programming interface. > > Any ideas? >

1 0

[Monetdb-developers] MonetDB at Ohloh
by Marcin Zukowski 03 Jan '09

03 Jan '09

Dear MonetDB Devs, As a pre-xmas present, I wanted to update MonetDB site on Ohloh.net - a site that has an ambition (and maybe a chance) to become a central information repository about FOSS projects and developers: https://www.ohloh.net/p/10306 Unfortunately, the code-analysis part of the site does not seem to like the 'sql' module, as it hangs during checking out its history: https://www.ohloh.net/p/10306/enlistments I contacted the Ohloh team, and it seems the error occurs at the following command: ~$ cvsnt -d :pserver:anonymous:@monetdb.cvs.sourceforge.net:/cvsroot/monetdb checkout -D'2001/06/07 13:41:21Z' -A -d'monetdb' 'sql' cvs checkout: Updating monetdb ... cvs [checkout aborted]: invalid change text in /cvsroot/monetdb/sql/src/odbc/driver/Attic/statement_dump.c,v If you think being properly visible on Ohloh is worth it, perhaps this is something some local CVS expert could investigate ;) Otherwise, we can remove the 'sql' module and hope the other ones work properly. cheers, Marcin

3 3

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/Skyserver Skyserver_import.sql, , 1.3, 1.4 Skyserver_tables.sql, , 1.4, 1.5
by Stefan Manegold 29 Dec '08

29 Dec '08

On Mon, Dec 29, 2008 at 04:50:00PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/test/Skyserver > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv383 > > Modified Files: > Skyserver_import.sql Skyserver_tables.sql > Log Message: > Correct some copy from statements to make the test green > At the same time remove some NULL constraints from the columns because "" is now seen as NULL IMHO, "" (i.e., an empty string of length 0) is *not* NULL --- but I don't know, whether the SQL standard has a different "opinion" ... Stefan > > > > U Skyserver_tables.sql > Index: Skyserver_tables.sql > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/Skyserver/Skyserver_tables.sql,v > retrieving revision 1.4 > retrieving revision 1.5 > diff -u -d -r1.4 -r1.5 > --- Skyserver_tables.sql 1 Apr 2008 11:45:51 -0000 1.4 > +++ Skyserver_tables.sql 29 Dec 2008 16:49:58 -0000 1.5 > @@ -451,7 +451,7 @@ > eta float NOT NULL, > lambdaMin float NOT NULL, > lambdaMax float NOT NULL, > - htmArea varchar(1024) NOT NULL, > + htmArea varchar(1024), --NOT NULL, > CONSTRAINT pk_StripeDefs_stripe PRIMARY KEY > ( > stripe > @@ -1155,11 +1155,11 @@ > ); > CREATE TABLE DBColumns( > tablename varchar(128) NOT NULL, > - name varchar(64) NOT NULL, > - unit varchar(64) NOT NULL, > - ucd varchar(128) NOT NULL, > - enum varchar(64) NOT NULL, > - description varchar(2000) NOT NULL, > + name varchar(64), -- NOT NULL, > + unit varchar(64), -- NOT NULL, > + ucd varchar(128), --NOT NULL, > + enum varchar(64), -- NOT NULL, > + description varchar(2000),-- NOT NULL, > rank int NOT NULL DEFAULT (0), > CONSTRAINT pk_DBColumns_tableName_name PRIMARY KEY > ( > > U Skyserver_import.sql > Index: Skyserver_import.sql > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/Skyserver/Skyserver_import.sql,v > retrieving revision 1.3 > retrieving revision 1.4 > diff -u -d -r1.3 -r1.4 > --- Skyserver_import.sql 6 Jun 2008 11:54:58 -0000 1.3 > +++ Skyserver_import.sql 29 Dec 2008 16:49:58 -0000 1.4 > @@ -60,7 +60,7 @@ > > COPY 1000 RECORDS INTO SDSSConstants FROM 'DATA/SDSSConstants1.dat.bz2' USING DELIMITERS '|', '\015\n'; > > -COPY 1000 RECORDS INTO StripeDefs FROM 'DATA/StripeDefs1.dat.bz2' USING DELIMITERS '\t', '\015\n'; > +COPY 1000 RECORDS INTO StripeDefs FROM 'DATA/StripeDefs1.dat.bz2' USING DELIMITERS '\t', '\015\n', '"' NULL as ''; > > COPY 1000 RECORDS INTO RunShift FROM 'DATA/RunShift.dat.bz2' USING DELIMITERS '\t', '\015\n'; > > @@ -116,7 +116,7 @@ > > COPY 1000 RECORDS INTO Inventory FROM 'DATA/Inventory.dat.bz2' USING DELIMITERS '\t', '\015\n'; > > -COPY 3000 RECORDS INTO DBColumns FROM 'DATA/DBColumns1.dat.bz2' USING DELIMITERS '\t', '\015\n'; > +COPY 3000 RECORDS INTO DBColumns FROM 'DATA/DBColumns1.dat.bz2' USING DELIMITERS '\t', '\015\n', '"' NULL as ''; > > COPY 1000 RECORDS INTO DBViewCols FROM 'DATA/DBViewCols.dat.bz2' USING DELIMITERS '\t', '\015\n'; > > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_schema.mx, Nov2008, 1.152.2.1, 1.152.2.2
by Stefan Manegold 27 Dec '08

27 Dec '08

On Sat, Dec 27, 2008 at 05:08:39PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv19272 > > Modified Files: > Tag: Nov2008 > sql_schema.mx > Log Message: > It seems it is also broken in the stable... > If you drop a constraint like a primary key make sure there are no dependencies on it... > > Note: Do not propagate this check in... it was already done in the current branch... if the changes are identical (i.e., made using cvs commands), propagation will notice this and silently accept the identical changes (i.e., not try to do them again). see also `man cvs` and pages 8-16 (in particular pages 13-15) of http://homepages.cwi.nl/~manegold/Presentations/MonetDBdevTTT.pdf Stefan > > U sql_schema.mx > Index: sql_schema.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_schema.mx,v > retrieving revision 1.152.2.1 > retrieving revision 1.152.2.2 > diff -u -d -r1.152.2.1 -r1.152.2.2 > --- sql_schema.mx 14 Nov 2008 13:48:40 -0000 1.152.2.1 > +++ sql_schema.mx 27 Dec 2008 17:08:37 -0000 1.152.2.2 > @@ -1695,6 +1695,8 @@ > assert(l->h->next->type == type_int); > if ((key = mvc_bind_key(sql, ss, kname )) == NULL) > return sql_error(sql, 02, "cannot drop unknown constraint %s\n", kname); > + if (!drop_action && mvc_check_dependency(sql, key->base.id, KEY_DEPENDENCY, NULL)) > + return sql_error(sql, 02, "unable to drop constraint %s (there are database objects which depend on it)\n", key->base.name); > mvc_drop_key(sql, ss, key, drop_action); > res = stmt_none(); > } break; > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/tests/StandOff StandOff.py, , 1.10, 1.11
by Stefan Manegold 23 Dec '08

23 Dec '08

Wouter, On Tue, Dec 23, 2008 at 10:40:57AM +0000, Wouter Alink wrote: > Update of /cvsroot/monetdb/pathfinder/tests/StandOff > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv29912 > > Modified Files: > StandOff.py > Log Message: > - this commit switches StandOff testing towards Algebra-backend was/is it you intension to force all StandOff testing though the Algebra back-end (added "-A" option for pf; see below), i.e., ignoring/overruling the compile time default / choice (whch is indeed the Algebra back-end) as well as the choice on the Mtest.py command line? If so, why? Does MPS not longer support StandOff (or v.v.)? If not, you should remove the "-A" swicth for pf, again. > - observation: order of attributes seems to have changed in some > tests, the testoutput has been changed accordingly Serialization in MonetDB/XQuery has not feature (yet?) to enforce a particular attribute order. The order of attributes is only determined by the very implementation and (physical) order of input data, and can hence change. If it happens to differe between the MPS & ALG back-end for (some) StandOff tests, we could consider approving back-end specific (ALG or MPS) stable output for these tests. (See `Mtest.py --help` and/or http://monetdb.cwi.nl/Development/TestWeb/Mtest/ for details and/or feel free to ask for advice/help.) Stefan > - the "video/artists" test still fails, due to incorrect order > of the elements in the result. this test needs more investigation > > > U StandOff.py > Index: StandOff.py > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/tests/StandOff/StandOff.py,v > retrieving revision 1.10 > retrieving revision 1.11 > diff -u -d -r1.10 -r1.11 > --- StandOff.py 15 Feb 2008 18:34:11 -0000 1.10 > +++ StandOff.py 23 Dec 2008 10:40:55 -0000 1.11 > @@ -27,7 +27,7 @@ > TSTSRCDIR = os.environ['TSTSRCDIR'] > PF = os.environ['PF'] > > -CALL = '%s -b "%s.xq" | %s --set standoff=enabled --dbname=%s "--dbinit=module(pathfinder);"' % (PF,os.path.join(TSTSRCDIR,TST),MSERVER,TSTDB) > +CALL = '%s -bA "%s.xq" | %s --set standoff=enabled --dbname=%s "--dbinit=module(pathfinder);"' % (PF,os.path.join(TSTSRCDIR,TST),MSERVER,TSTDB) > > import sys, time > Mlog = "\n%s %s\n\n" % (time.strftime('# %H:%M:%S >',time.localtime(time.time())), CALL) > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 4

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/semantics typecheck.brg, , 1.73, 1.74
by Stefan Manegold 22 Dec '08

22 Dec '08

Hi Wouter, thank you very much for porting your StandOff extensions to the Algebra back-end! I took this as a trigger to disable to automatic fall-back to the (deprecated) "milprint_summer" back-end in case the StandOff extensions are enabled (cf., http://monetdb.cwi.nl/Development/Releases/Version4.24/index.html#XQuery) The result: ======== .../pathfinder $ Mtest.py -rq --no-algebra tests/StandOff ................ ======== .../pathfinder $ Mtest.py -rq --algebra tests/StandOff .... * (test2.test.out.FILTERED) significantly .. * (lltest.test.out.FILTERED) significantly ........ * (scenes.test.out.FILTERED) significantly .. * (artists.test.out.FILTERED) significantly !ERROR: Testing FAILED SIGNIFICANTLY ! 4 out of 16 tests produced SIGNIFICANTLY different output ======== .../pathfinder $ Mtest.py -rq tests/StandOff .... * (test2.test.out.FILTERED) significantly .. * (lltest.test.out.FILTERED) significantly ........ * (scenes.test.out.FILTERED) significantly .. * (artists.test.out.FILTERED) significantly !ERROR: Testing FAILED SIGNIFICANTLY ! 4 out of 16 tests produced SIGNIFICANTLY different output ======== ;-) Stefan On Sun, Dec 21, 2008 at 07:33:36PM +0000, Wouter Alink wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/semantics > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv21308/semantics > > Modified Files: > typecheck.brg > Log Message: > Step 3 of: > - enabling the standoff axes with the algebra backend. > - removing the "reject-narrow" and "reject-wide" axes steps > > In this commit: > - changes to the compiler. > > > > U typecheck.brg > Index: typecheck.brg > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/semantics/typecheck.brg,v > retrieving revision 1.73 > retrieving revision 1.74 > diff -u -d -r1.73 -r1.74 > --- typecheck.brg 14 Nov 2008 14:39:48 -0000 1.73 > +++ typecheck.brg 21 Dec 2008 19:33:33 -0000 1.74 > @@ -138,10 +138,8 @@ > %term preceding_sibling = 51 /**< all preceding nodes with same parent */ > %term self = 52 /**< the context node itself */ > /* [STANDOFF] */ > -%term select_narrow = 100 /**< regions contained in a context-node */ > -%term select_wide = 101 /**< regions overlapping a context-node */ > -%term reject_narrow = 102 /**< all regions except the contained regions */ > -%term reject_wide = 103 /**< all regions except the overlapping regions */ > +%term select_narrow = 53 /**< regions contained in a context-node */ > +%term select_wide = 54 /**< regions overlapping a context-node */ > /* [/STANDOFF] */ > > /* Constructor Nodes */ > @@ -228,10 +226,8 @@ > LocationStep: preceding_sibling (SequenceType) = 36 (10); > LocationStep: self (SequenceType) = 37 (10); > /* [STANDOFF] */ > -LocationStep: select_narrow (SequenceType) = 100 (10); > -LocationStep: select_wide (SequenceType) = 101 (10); > -LocationStep: reject_narrow (SequenceType) = 102 (10); > -LocationStep: reject_wide (SequenceType) = 103 (10); > +LocationStep: select_narrow (SequenceType) = 38 (10); > +LocationStep: select_wide (SequenceType) = 39 (10); > /* [/STANDOFF] */ > > LocationSteps: locsteps (LocationStep, LocationSteps) = 40 (10); > @@ -884,23 +880,13 @@ > TY(p) = TY(L(p)); > break; > /* [STANDOFF] */ > - case 100: > + case 38: > /* LocationStep: select_narrow (SequenceType) */ > TY(p) = PFty_star (TY(L(p))); > break; > > /* LocationStep: select_wide (SequenceType) */ > - case 101: > - TY(p) = PFty_star (TY(L(p))); > - break; > - > - /* LocationStep: reject_narrow (SequenceType) */ > - case 102: > - TY(p) = PFty_star (TY(L(p))); > - break; > - > - /* LocationStep: reject_wide (SequenceType) */ > - case 103: > + case 39: > TY(p) = PFty_star (TY(L(p))); > break; > /* [/STANDOFF] */ > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Announcement: New bug fix release of MonetDB suite
by Sjoerd Mullender 22 Dec '08

22 Dec '08

The MonetDB team at CWI is pleased to announce the Nov2008-SP1 bug fix release of the MonetDB suite of programs. This is a bug fix release of last month's Nov2008 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Nov2008/#Nov200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[Monetdb-developers] stable branch open
by Sjoerd Mullender 18 Dec '08

18 Dec '08

The release has been built. The stable branch is open again for business. Bug fixes only! -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_interpreter.mx, , 1.274, 1.275 mal_recycle.mx, , 1.169, 1.170
by Stefan Manegold 16 Dec '08

16 Dec '08

On Tue, Dec 16, 2008 at 05:28:57PM +0000, Milena Ivanova wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv4716 > > Modified Files: > mal_interpreter.mx mal_recycle.mx > Log Message: > Subsumed instructions are not recycled. This is checked in the proper place > before the attempt to obtain the lock. > Mtest gave No differences encountered during testing. "Comfirmed" ;-) Thanks! Stefan > > > U mal_recycle.mx > Index: mal_recycle.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_recycle.mx,v > retrieving revision 1.169 > retrieving revision 1.170 > diff -u -d -r1.169 -r1.170 > --- mal_recycle.mx 15 Dec 2008 16:13:13 -0000 1.169 > +++ mal_recycle.mx 16 Dec 2008 17:28:55 -0000 1.170 > @@ -114,7 +114,6 @@ > mal_export int recycleCacheLimit; > mal_export lng recycleMemory; /* Units of memory permitted */ > mal_export lng recyclerUsedMemory; > -mal_export MT_Lock recycleLock; > mal_export MalBlkPtr recycleBlk; > mal_export double recycleAlpha; > mal_export double recycleFresh; > @@ -173,7 +172,7 @@ > #include "mal_function.h" > #include "mal_client.h" > > -MT_Lock recycleLock ; > +static MT_Lock recycleLock ; > MalBlkPtr recycleBlk = NULL; > > static void RECYCLEexitImpl(Client cntxt,MalBlkPtr mb, MalStkPtr stk, InstrPtr p); > @@ -1055,7 +1054,7 @@ > > if( recycleBlk == 0 || reusePolicy == 0) > return -1; > - mal_set_lock(recycleLock,"recycle"); > + mal_set_lock(recycleLock,"recycle"); > > for (i = 0; i < recycleBlk->stop; i++){ > q = getInstrPtr(recycleBlk,i); > @@ -1143,7 +1142,7 @@ > updateQryStat(q->recycle,gluse); > } > recycleRecent = i; > - mal_unset_lock(recycleLock,"recycle"); > + mal_unset_lock(recycleLock,"recycle"); > return i; > notfound: > continue; > @@ -1192,7 +1191,7 @@ > #else > (void) evicted; > #endif > - mal_unset_lock(recycleLock,"recycle"); > + mal_unset_lock(recycleLock,"recycle"); > return pc; > } > > @@ -1241,8 +1240,6 @@ > > if ( wr > memLimit) > return; > - if ( p->recycle == NO_RECYCLING ) > - return; > if (recycleBlk){ > if ( recyclerUsedMemory + wr > memLimit || > recycleSize >= cacheLimit ) > > U mal_interpreter.mx > Index: mal_interpreter.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_interpreter.mx,v > retrieving revision 1.274 > retrieving revision 1.275 > diff -u -d -r1.274 -r1.275 > --- mal_interpreter.mx 17 Nov 2008 08:57:52 -0000 1.274 > +++ mal_interpreter.mx 16 Dec 2008 17:28:55 -0000 1.275 > @@ -1923,7 +1923,7 @@ > @= MALrecycleStart > if( !RECYCLEentry(cntxt, mb,stk,pci) ) > @= MALrecycleExit > - if( pci->recycle ) > + if( pci->recycle > 0 ) > RECYCLEexit(cntxt, mb,stk,pci); > @} > @- > > > ------------------------------------------------------------------------------ > SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada. > The future of the web can't happen without you. Join us at MIX09 to help > pave the way to the Next Web now. Learn more and register at > http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] testing/src Mtest.py.in, , 1.4, 1.5
by Milena Ivanova 16 Dec '08

16 Dec '08

Hi, I have the following message when configure testing( updated at 12.45h) checking for perl... /usr/bin/perl checking perl.h usability... no checking perl.h presence... yes configure: WARNING: perl.h: present but cannot be compiled configure: WARNING: perl.h: check for missing prerequisite headers? configure: WARNING: perl.h: see the Autoconf documentation configure: WARNING: perl.h: section "Present But Cannot Be Compiled" configure: WARNING: perl.h: proceeding with the preprocessor's result configure: WARNING: perl.h: in the future, the compiler will take precedence configure: WARNING: ## --------------------------- ## configure: WARNING: ## Report this to monet(a)cwi.nl ## configure: WARNING: ## --------------------------- ## checking for perl.h... yes I also got (in src, build) find: perl.h: No such file or directory The hanging recycle test shows the following: 13:04:59> src/mal/recycle01.mal (<=60,60,60) ... 0.075s recycle01.stable.out.FILTERED and recycle01.test.out.FILTERED are equal. recycle01.stable.err.FILTERED and recycle01.test.err.FILTERED are equal. No differences encountered during testing. If necessary, you can checkin your modifications, now. Exception in thread Thread-3 (most likely raised during interpreter shutdown): Traceback (most recent call last): File "/usr/lib64/python2.5/threading.py", line 460, in __bootstrap File "/usr/lib64/python2.5/threading.py", line 623, in run File "/usr/lib64/python2.5/threading.py", line 364, in wait File "/usr/lib64/python2.5/threading.py", line 238, in wait <type 'exceptions.ValueError'>: list.remove(x): x not in list Unhandled exception in thread started by Error in sys.excepthook: Original exception was: Milena

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/BugTracker-2008/Tests is_distinct_broken.SF-2430201.stable.err, , NONE, 1.1 is_distinct_broken.SF-2430201.stable.out, , NONE, 1.1
by Romulo Goncalves 16 Dec '08

16 Dec '08

Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/test/BugTracker-2008/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv8183/src/test/BugTracker-2008/Tests > > Added Files: > is_distinct_broken.SF-2430201.stable.err > is_distinct_broken.SF-2430201.stable.out > Log Message: > approved output You need to do the same for the stable ;) If not I can't close the bug... Romulo > > > --- NEW FILE: is_distinct_broken.SF-2430201.stable.out --- > stdout of test 'is_distinct_broken.SF-2430201` in directory 'src/test/BugTracker-2008` itself: > > > # 12:32:45 > > # 12:32:45 > mserver5 "--config=/ufs/niels/scratch/monetdb/Linux-x86_64/etc/monetdb5.conf" --debug=10 --set gdk_nr_threads=4 --set "monet_mod_path=/ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5:/ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5/lib:/ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5/bin" --set "gdk_dbfarm=/ufs/niels/scratch/monetdb/Linux-x86_64/var/MonetDB5/dbfarm" --set "sql_logdir=/ufs/niels/scratch/monetdb/Linux-x86_64/var/MonetDB5/sql_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=35778 --set xrpc_port=45446 --set monet_prompt= --trace "--dbname=mTests_src_test_BugTracker-2008" --set mal_listing=0 "--dbinit= include sql;" ; echo ; echo Over.. > # 12:32:45 > > > # MonetDB server v5.9.0, based on kernel v1.27.0 > # Serving database 'mTests_src_test_BugTracker-2008', using 4 threads > # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked > # Copyright (c) 1993-July 2008 CWI. > # Copyright (c) August 2008- MonetDB B.V., all rights reserved > # Visit http://monetdb.cwi.nl/ for further information > # Listening for connection requests on mapi:monetdb://alf.ins.cwi.nl:35778/ > # MonetDB/SQL module v2.27.0 loaded > > Ready. > # falling back to direct mode > # falling back to direct mode > # falling back to direct mode > #function user.main():void; > # clients.quit(); > #end main; > > Over.. > > # 12:32:45 > > # 12:32:45 > mclient -lsql -umonetdb -Pmonetdb --host=alf --port=35778 > # 12:32:45 > > > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > [ 1 ] > % sys.way_tags # table_name > % way # name > % int # type > % 8 # length > [ 23950375 ] > [ 24644162 ] > % . # table_name > % single_value # name > % tinyint # type > % 2 # length > [ 10 ] > % .b # table_name > % a # name > % tinyint # type > % 2 # length > [ 10 ] > > # 12:32:45 > > # 12:32:45 > Done. > # 12:32:45 > > > > --- NEW FILE: is_distinct_broken.SF-2430201.stable.err --- > stderr of test 'is_distinct_broken.SF-2430201` in directory 'src/test/BugTracker-2008` itself: > > > # 12:32:45 > > # 12:32:45 > mserver5 "--config=/ufs/niels/scratch/monetdb/Linux-x86_64/etc/monetdb5.conf" --debug=10 --set gdk_nr_threads=4 --set "monet_mod_path=/ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5:/ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5/lib:/ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5/bin" --set "gdk_dbfarm=/ufs/niels/scratch/monetdb/Linux-x86_64/var/MonetDB5/dbfarm" --set "sql_logdir=/ufs/niels/scratch/monetdb/Linux-x86_64/var/MonetDB5/sql_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=35778 --set xrpc_port=45446 --set monet_prompt= --trace "--dbname=mTests_src_test_BugTracker-2008" --set mal_listing=0 "--dbinit= include sql;" ; echo ; echo Over.. > # 12:32:45 > > > # builtin opt gdk_arch = 64bitx86_64-unknown-linux-gnu > # builtin opt gdk_version = 1.27.0 > # builtin opt monet_pid = 8562 > # builtin opt prefix = /ufs/niels/scratch/monetdb/Linux-x86_64 > # builtin opt exec_prefix = ${prefix} > # builtin opt gdk_dbname = tst > # builtin opt gdk_dbfarm = ${prefix}/var/MonetDB > # builtin opt gdk_debug = 8 > # builtin opt gdk_mem_bigsize = 262144 > # builtin opt gdk_alloc_map = yes > # builtin opt gdk_mem_pagebits = 14 > # builtin opt gdk_vmtrim = yes > # builtin opt monet_admin = adm > # builtin opt monet_prompt = > > # builtin opt monet_welcome = yes > # builtin opt monet_mod_path = ${exec_prefix}/lib/MonetDB:${exec_prefix}/lib/bin > # builtin opt monet_daemon = yes > # builtin opt host = localhost > # builtin opt mapi_port = 50000 > # builtin opt mapi_noheaders = no > # builtin opt mapi_debug = 0 > # builtin opt mapi_clients = 2 > # builtin opt sql_debug = 0 > # builtin opt sql_logdir = ${prefix}/var/MonetDB > # builtin opt xquery_logdir = ${prefix}/var/MonetDB > # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > # builtin opt standoff_start = start > # builtin opt standoff_end = end > # config opt prefix = /ufs/niels/scratch/monetdb/Linux-x86_64 > # config opt config = ${prefix}/etc/monetdb5.conf > # config opt prefix = /ufs/niels/scratch/monetdb/Linux-x86_64 > # config opt exec_prefix = ${prefix} > # config opt gdk_dbfarm = ${prefix}/var/MonetDB5/dbfarm > # config opt gdk_dbname = demo > # config opt gdk_alloc_map = no > # config opt gdk_embedded = no > # config opt gdk_debug = 0 > # config opt monet_mod_path = ${exec_prefix}/lib/MonetDB5:${exec_prefix}/lib/MonetDB5/lib:${exec_prefix}/lib/MonetDB5/bin > # config opt monet_daemon = no > # config opt monet_welcome = yes > # config opt mero_msglog = ${prefix}/var/log/merovingian.log > # config opt mero_errlog = ${prefix}/var/log/merovingian.log > # config opt mero_timeinterval = 600 > # config opt mero_pidfile = ${prefix}/var/run/merovingian.pid > # config opt mero_exittimeout = 7 > # config opt mero_doproxy = yes > # config opt mero_discoveryttl = 600 > # config opt mal_init = ${exec_prefix}/lib/MonetDB5/mal_init.mal > # config opt mal_listing = 2 > # config opt checkpoint_dir = ${prefix}/var/MonetDB5/chkpnt > # config opt mapi_port = 50000 > # config opt mapi_open = false > # config opt sql_logdir = ${prefix}/var/MonetDB5/sql_logs > # config opt sql_init = ${exec_prefix}/lib/MonetDB5/sql_init.sql > # cmdline opt config = /ufs/niels/scratch/monetdb/Linux-x86_64/etc/monetdb5.conf > # cmdline opt gdk_nr_threads = 4 > # cmdline opt monet_mod_path = /ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5:/ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5/lib:/ufs/niels/scratch/monetdb/Linux-x86_64/lib/MonetDB5/bin > # cmdline opt gdk_dbfarm = /ufs/niels/scratch/monetdb/Linux-x86_64/var/MonetDB5/dbfarm > # cmdline opt sql_logdir = /ufs/niels/scratch/monetdb/Linux-x86_64/var/MonetDB5/sql_logs > # cmdline opt mapi_open = true > # cmdline opt xrpc_open = true > # cmdline opt mapi_port = 35778 > # cmdline opt xrpc_port = 45446 > # cmdline opt monet_prompt = > # cmdline opt gdk_dbname = mTests_src_test_BugTracker-2008 > # cmdline opt mal_listing = 0 > # cmdline opt gdk_debug = 10 > #warning: please don't forget to set your vault key! > #(see /ufs/niels/scratch/monetdb/Linux-x86_64/etc/monetdb5.conf) > > # 12:32:45 > > # 12:32:45 > mclient -lsql -umonetdb -Pmonetdb --host=alf --port=35778 > # 12:32:45 > > > > # 12:32:45 > > # 12:32:45 > Done. > # 12:32:45 > > > > > ------------------------------------------------------------------------------ > SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada. > The future of the web can't happen without you. Join us at MIX09 to help > pave the way to the Next Web now. Learn more and register at > http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/BugTracker-2008/Tests is_distinct_broken.SF-2430201.sql, Nov2008, NONE, 1.1.2.2 All, Nov2008, 1.6.2.8, 1.6.2.9
by Sjoerd Mullender 15 Dec '08

15 Dec '08

Where is the stable output? There is no sense running a test if there is no stable output. Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/test/BugTracker-2008/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv15432 > > Modified Files: > Tag: Nov2008 > All > Added Files: > Tag: Nov2008 > is_distinct_broken.SF-2430201.sql > Log Message: > Add test to cover bug: > is_distinct_broken.SF-2430201 > > Note: Please do not propagate this check in. It was already checked in current cvs branch ;) > > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/test/BugTracker-2008/Tests/All,v > retrieving revision 1.6.2.8 > retrieving revision 1.6.2.9 > diff -u -d -r1.6.2.8 -r1.6.2.9 > --- All 19 Nov 2008 10:39:51 -0000 1.6.2.8 > +++ All 15 Dec 2008 10:04:26 -0000 1.6.2.9 > @@ -30,3 +30,4 @@ > count_with_order_by_and_limit_crashes.SF-2229936 > sql_command_kills_db.SF-2233677 > between_no_columns.SF2102101 > +is_distinct_broken.SF-2430201 > > --- NEW FILE: is_distinct_broken.SF-2430201.sql --- > create table way_tags (way int, k int); > insert into way_tags values(23950375,1); > insert into way_tags values(23950375,1); > insert into way_tags values(23950375,1); > insert into way_tags values(23950375,1); > insert into way_tags values(23950375,1); > insert into way_tags values(24644162,1); > insert into way_tags values(24644162,1); > insert into way_tags values(24644162,1); > > select distinct way from way_tags group by way, k having count(*) > 1; > > drop table way_tags; > > select distinct (select 10 union all select 10); > > select distinct a from (select 10 as a union all select 10 as a) as b; > > > ------------------------------------------------------------------------------ > SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada. > The future of the web can't happen without you. Join us at MIX09 to help > pave the way to the Next Web now. Learn more and register at > http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime shredder.mx, , 1.149, 1.150
by Sjoerd Mullender 15 Dec '08

15 Dec '08

Shouldn't this also be done on the stable branch? Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv15280 > > Modified Files: > shredder.mx > Log Message: > - Try to fix [ monetdb-Bugs-2141012 ] XQ: unclear error > > > > U shredder.mx > Index: shredder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/shredder.mx,v > retrieving revision 1.149 > retrieving revision 1.150 > diff -u -d -r1.149 -r1.150 > --- shredder.mx 11 Dec 2008 13:46:47 -0000 1.149 > +++ shredder.mx 15 Dec 2008 13:27:08 -0000 1.150 > @@ -601,6 +601,8 @@ > return GDK_SUCCEED; > } > > +#define INHOLE(P) (P->pageFree && (P->nnode_pre&REMAP_PAGE_MASK) == ((oid)P->pageFree)) > + > #define _NEXT_PRE_IMP(P) if ((P->nnode_pre++ == GDK_oid_max || P->nnode_nid++ == GDK_oid_max) ||\ > (P->pageFree && (P->nnode_pre&REMAP_PAGE_MASK) == ((oid)P->pageFree) && !createHole(P)))\ > { GDKerror("shredder: failed inserting RID tuple " OIDFMT " \n", (P->nnode_pre-1)); > @@ -1795,6 +1797,17 @@ > break; > } > } > + /* Now check if by coincedence the shredder starts in a not yet > + * created hole. If soo a proper hole has to be created after > + * which the document can start. > + */ > + if ( INHOLE(shredCtx) ) { > + if ( !createHole(shredCtx) ) { > + GDKerror("shredder_create: recover from starting in a hole fails!\n"); > + return shredder_free(shredCtx,-shredCtx->updatable); > + > + } > + } > } > if (shredCtx->nnode_pre <= pre_min) { > shredCtx->nnode_pre = pre_min; > @@ -1822,6 +1835,7 @@ > if (shredCtx->val == NULL || shredCtx->content_buf == NULL || shredCtx->lifo == NULL) { > return shredder_free(shredCtx,-shredCtx->incremental); > } > + > return shredCtx; > } > > > > ------------------------------------------------------------------------------ > SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada. > The future of the web can't happen without you. Join us at MIX09 to help > pave the way to the Next Web now. Learn more and register at > http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

[Monetdb-developers] bug fix release preparation
by Sjoerd Mullender 15 Dec '08

15 Dec '08

Tomorrow I want to build the December bug fix release. So please no more checkins on the Stable branch, unless you have my express permission. -- Sjoerd Mullender

1 0

[Monetdb-developers] !MALException:mkey.bulk_rotate_xor_hash:command failed
by Stefan de Konink 15 Dec '08

15 Dec '08

sql>ALTER table way_tags add primary key(way, k); !MALException:mkey.bulk_rotate_xor_hash:command failed What should I read from that one? Stefan

1 0

[Monetdb-developers] # falling back to direct mode
by Stefan de Konink 15 Dec '08

15 Dec '08

As $subj; What does it mean? I'm about to run my final result test on the new algebra version; but I just wondered what it means. Stefan

1 0

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/mapiclient MapiClient.mx, , 1.130, 1.131
by Stefan Manegold 14 Dec '08

14 Dec '08

On Sat, Dec 13, 2008 at 03:50:22PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/clients/src/mapiclient > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv11819/mapiclient > > Modified Files: > MapiClient.mx > Log Message: > Start removing the default choice. It should not be an option > any longer. > Preferrably, we should remove the -g altogether. > > > U MapiClient.mx > Index: MapiClient.mx > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/mapiclient/MapiClient.mx,v > retrieving revision 1.130 > retrieving revision 1.131 > diff -u -d -r1.130 -r1.131 > --- MapiClient.mx 5 Dec 2008 14:57:32 -0000 1.130 > +++ MapiClient.mx 13 Dec 2008 15:50:20 -0000 1.131 > @@ -1287,7 +1287,6 @@ > stream_printf(toConsole, "\\a - disable auto commit\n"); > } > if (mode == SQL || mode == XQUERY) { > - stream_printf(toConsole, "\\G - switch to algebra frontend\n"); > stream_printf(toConsole, "\\g - switch to old frontend\n"); hm, this means that you tell users only how to switch to the old frontend, but once they have done so, they (now) won't get told (anymore) how to switch back, again ... ... maybe not that handy --- and for XQuery, the "old" backend is both still available and still required for some functionality ... Hence, IMHO (1) "-G" / "-g" and "\G" / "\g" make only sense as pairs, i.e., to switch back and forth, i.e., removing one does not make (much) sense; and (2) XQuery still requires both for the time being. Thus, if we don't need either for SQL any more, we should remove the documentation (and functionality) of both switches only for SQL, but not for XQuery --- and if we do so, we should do this everywhere, i.e., not only with mclient, but also with Mserver/mserver5, MonetDB.conf/monetdb5.conf, Mtest.py and the wbe site --- well, lacking branches, the latter can only be done once we have a new feature release in about 3 month from now ... Stefan > } > if (mode == XQUERY) { > @@ -1709,7 +1708,6 @@ > fprintf(stderr, " -r nr | --rows=nr for pagination\n"); > fprintf(stderr, " -w nr | --width=nr for pagination\n"); > fprintf(stderr, " -D | --dump create an SQL dump\n"); > - fprintf(stderr, " -G | --algebra use algebra frontend\n"); > fprintf(stderr, " -g | --no-algebra use old frontend\n"); > > fprintf(stderr, "\nXQuery specific options\n"); > > > ------------------------------------------------------------------------------ > SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada. > The future of the web can't happen without you. Join us at MIX09 to help > pave the way to the Next Web now. Learn more and register at > http://ad.doubleclick.net/clk;208669438;13503038;i?http://2009.visitmix.com/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 4

[Monetdb-developers] New "testing" CVS module
by Stefan Manegold 12 Dec '08

12 Dec '08

Dear fellow MonetDB developers, I just separated the MonetDB testing tools (Mtest.py & friends) from MonetDB/src/testing/ into their own "testing" CVS module / MonetDB component. IMPORTANT NOTE: =============== In case you plan to upgrade your exiting CVS-based "MonetDB" installation, please run `make uninstall` in your "MonetDB" build directory, first, i.e., before running `cvs update` in your "MonetDB" source directory. Once you update your "MonetDB" to the latest CVS development trunk version, and plan to continue (or start) using Mtest.py, you also need to check out the new "testing" CVS module (from SF) and compile and install it any time after you compiled and installed "MonetDB", and before you plan to use Mtest.py. The new "testing" CVS module depends only on "MonetDB" (and hence requires that to be installed), but on no other MonetDB component (except from the "buildtools", in case your are compiling from CVS sources). No other MonetDB component depends on the new "testing" CVS module other than that you obviously need to have "testing" installed once you want/need to run tests using Mtest.py. Details: -------- The MonetDB testing tools (Mtest.py & friends) are not part of the actual MonetDB functionality, but mainly for MonetDB development purpose (and hence only distributed only in the source tarballs, but not in any (official) binary packages). To make them less dependent on release cycles (and vice versa), and well as to prepare making them usable without MonetDB --- for now, they actually still depend on MonetDB; see below) --- we decided to separate the MonetDB testing tools from the "MonetDB" CVS module into their own "testing" CVS module. For the time being (i.e., until further notice), "testing" depends on "MonetDB" --- more precisely only on some utils from MonetDB/src/common/, but not on the GDK kernel from MonetDB/src/gdk/, as (1) Mtest.py (mainly for "convenience") still uses monet_options.py; and (2) (on Windows only), Mdiff.c uses "our" getopt code. Python modules "subprocess26.py" & "trace.py" have been moved from <PYTHON_LIBDIR>/MonetDB to <PYTHON_LIBDIR>/MonetDBtesting . Changes are wrapped in CVS tags "before_testing_separation" & "after_testing_separation". Regards, Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] gridsql
by Martin.Kersten＠cwi.nl 10 Dec '08

10 Dec '08

Can you have a 1-2 hour look at gridsql if it is feasible at all. If so, let's push Venks.... ;) otherwise avoid the frustration for him.

3 2

[Monetdb-developers] Announcement: New feature release of MonetDB suite
by Sjoerd Mullender 08 Dec '08

08 Dec '08

The MonetDB team at CWI is pleased to announce the new "Nov2008" release of the MonetDB suite of programs. This is a feature release, involving, among other things, a change in the database format, so be sure to dump your databases before attempting an upgrade. More information on the new release is available at <https://sourceforge.net/forum/forum.php?forum_id=892621>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[Monetdb-developers] Size limits for DECIMAL(P,S)
by Schwarz, Omri 05 Dec '08

05 Dec '08

Hi, all. I managed to build MonetDB and am looking through it right now, but I am hitting against rgw 18 digit size limit for the decimal type. How hard would it be to reimplement it on the back end to make room for more digits? Denham Quantitative Management LP 200 Clarendon Street, 25th Floor Boston, MA 02216 T: 617-587-5812 M: 617-909-7786 omri.schwarz(a)denhamcapital.com NOTICE: This e-mail message is intended for the named recipient(s) above and may contain confidential information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. NO REPRESENTATION OR WARRANTY IS MADE TO ANY PERSON AS TO THE ACCURACY OR COMPLETENESS OF THE INFORMATION CONTAINED HEREIN. Denham Capital Management(sm) is a trademark of Denham Capital Management LP.

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_instruction.mx, , 1.370, 1.371
by Sjoerd Mullender 05 Dec '08

05 Dec '08

Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv8366 > > Modified Files: > mal_instruction.mx > Log Message: > Clear the details completely. > > > U mal_instruction.mx > Index: mal_instruction.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_instruction.mx,v > retrieving revision 1.370 > retrieving revision 1.371 > diff -u -d -r1.370 -r1.371 > --- mal_instruction.mx 17 Nov 2008 08:57:48 -0000 1.370 > +++ mal_instruction.mx 21 Nov 2008 21:39:29 -0000 1.371 > @@ -1009,6 +1009,7 @@ > clrFunction(InstrPtr p) > { > p->fcn = 0; > + p->blk = 0; > setModuleId(p, NULL); > setFunctionId(p, NULL); > } > Should this be backported? -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal cluster.mx, , 1.13, 1.14
by Stefan Manegold 02 Dec '08

02 Dec '08

On Tue, Dec 02, 2008 at 08:57:48AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv23226 > > Modified Files: > cluster.mx > Log Message: > added the string clustering. Martin, what exactly is the purpose and/or intention of the MONET_OID32-dependent choices below? MONET_OID32 is ONLY defined when using 32-bit OIDs on 64-bit systems, but in no other case. In that case, type oid is 32-bit wide, just like type int. The same hold for 32-bit systems, where OIDs are (obviously) always 32-bit. When using 64-bit OIDs on 64-bit systems, type oid is 64-bit wide, just like lng. In either case, oid is unsigned, while int & lng are both signed. Hence, either any code does support type oid, then this can and should be used as such, i.e., no OID-width related alternatives are required. Or there is no oid specific code, and the implementation hence needs to fall back to alternative type of same width assuming that the signedness does not matter (i.e., only copying and equality comparisons are used, but no inequality comparisons), e.g., 32-bit int or 64-bit lng. (Only!) in the latter case, I'd hence expect choices that look like #if SIZEOF_OID == SIZEOF_INT /* use int code */ #else /* SIZEOF_OID == SIZEOF_LNG */ /* use lng code */ #endif Likewise for type var_t: #if SIZEOF_VAR_T == SIZEOF_INT /* use int code */ #else /* SIZEOF_VAR_T == SIZEOF_LNG */ /* use lng code */ #endif Stefan > U cluster.mx > Index: cluster.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/cluster.mx,v > retrieving revision 1.13 > retrieving revision 1.14 > diff -u -d -r1.13 -r1.14 > --- cluster.mx 23 Nov 2008 23:12:31 -0000 1.13 > +++ cluster.mx 2 Dec 2008 08:57:46 -0000 1.14 [...] > +#ifdef MONET_OID32 > +@:map_fixed(str,int)@ > +#else > +@:map_fixed(str,oid)@ > +#endif [...] > +#ifdef MONET_OID32 > + if( sizeof(var_t)== sizeof(int)) { > + CLUSTER_column_int(nb, b, cmap); > + break; > + } > +#else > + if( sizeof(var_t)== sizeof(oid)) { > + CLUSTER_column_oid(nb, b, cmap); > + break; > + } else > +#endif [...] -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_abssyn.h, , 1.4, 1.5
by Stefan Manegold 27 Nov '08

27 Nov '08

On Thu, Nov 27, 2008 at 12:38:18PM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv7993 > > Modified Files: > tjc_abssyn.h > Log Message: > - fix old_style extern fun() to extern fun(void) Thanks. ... in case you're curious, icc now (correctly ;-)) complains about ======== .../pathfinder/modules/pftijah/tjc/tjc_parse.y(54): error #593: variable "tjc_errbuff" was set but never used static char* tjc_errbuff; ^ compilation aborted for tjc_parse.tab.c (code 2) ======== Stefan > Thanks Stefan. > > > > U tjc_abssyn.h > Index: tjc_abssyn.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_abssyn.h,v > retrieving revision 1.4 > retrieving revision 1.5 > diff -u -d -r1.4 -r1.5 > --- tjc_abssyn.h 27 Nov 2008 10:53:17 -0000 1.4 > +++ tjc_abssyn.h 27 Nov 2008 12:38:15 -0000 1.5 > @@ -123,7 +123,7 @@ > tjcp_fixme (TJpnode_t *n1, TJpnode_t **n2); > > extern struct TJqnode_t * > -tjcq_initnode (); > +tjcq_initnode (void); > > extern struct TJqnode_t * > tjcq_firstterm (char *term, char *entity, double weight); > @@ -132,7 +132,7 @@ > tjcq_addterm (TJqnode_t *n, char *term, char *entity, double weight); > > extern struct TJptree_t * > -tjcp_inittree (); > +tjcp_inittree (void); > > extern char * > TJstrndup (const char *str); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_abssyn.c, , 1.2, 1.3 tjc_abssyn.h, , 1.3, 1.4 tjc_scan.l, , 1.1, 1.2
by Stefan Manegold 27 Nov '08

27 Nov '08

Jan F. (and others), On Thu, Nov 27, 2008 at 10:53:19AM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv1147 > > Modified Files: > tjc_abssyn.c tjc_abssyn.h tjc_scan.l > Log Message: > fix Windows&icc compiler problems > - old-style parameter list (anachronism) this problem is not fixed, yet; Intel's icc did (and still does) complain about the old-style *parameter list*, not about the return-type declaration: ======== /ufs/manegold/_/scratch0/Monet/Testing/Current/source/pathfinder/modules/pftijah/tjc/tjc_abssyn.h(126): error #310: old-style parameter list (anachronism) tjcq_initnode (); ^ /ufs/manegold/_/scratch0/Monet/Testing/Current/source/pathfinder/modules/pftijah/tjc/tjc_abssyn.h(135): error #310: old-style parameter list (anachronism) tjcp_inittree (); ^ compilation aborted for /ufs/manegold/_/scratch0/Monet/Testing/Current/source/pathfinder/modules/pftijah/tjc/tjc_milprint.c (code 2) ======== For your info, fcn_name(); ^^ is "old-style"; "new-style" is fnc_name(void); ^^^^^^ Stefan > U tjc_abssyn.h > Index: tjc_abssyn.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_abssyn.h,v > retrieving revision 1.3 > retrieving revision 1.4 > diff -u -d -r1.3 -r1.4 > --- tjc_abssyn.h 26 Nov 2008 10:00:24 -0000 1.3 > +++ tjc_abssyn.h 27 Nov 2008 10:53:17 -0000 1.4 > @@ -110,28 +110,28 @@ > > /* interfaces to parse construction routines > */ > -extern TJpnode_t * > +extern struct TJpnode_t * > tjcp_leaf (TJptree_t *t, TJptype_t type); > > -extern TJpnode_t * > +extern struct TJpnode_t * > tjcp_wire1 (TJptree_t *t, TJptype_t type, TJpnode_t *n1); > > -extern TJpnode_t * > +extern struct TJpnode_t * > tjcp_wire2 (TJptree_t *t, TJptype_t type, TJpnode_t *n1, TJpnode_t *n2); > > -extern TJpfixme_t * > +extern struct TJpfixme_t * > tjcp_fixme (TJpnode_t *n1, TJpnode_t **n2); > > -extern TJqnode_t * > +extern struct TJqnode_t * > tjcq_initnode (); > > -extern TJqnode_t * > +extern struct TJqnode_t * > tjcq_firstterm (char *term, char *entity, double weight); > > -extern TJqnode_t * > +extern struct TJqnode_t * > tjcq_addterm (TJqnode_t *n, char *term, char *entity, double weight); > > -extern TJptree_t * > +extern struct TJptree_t * > tjcp_inittree (); > > extern char * > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/tjc tjc_scan.l, , 1.2, 1.3
by Stefan Manegold 27 Nov '08

27 Nov '08

On Thu, Nov 27, 2008 at 11:03:29AM +0000, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/tjc > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv3513 > > Modified Files: > tjc_scan.l > Log Message: > - defining an empty ECHO should solve the fwrite() problem I think. I copied > this solution which first did not make any sense from nexi.l. Works. Thanks. Alternative (in case ECHO was used) would have been to disable the strict checks for (flex-/bison-) generated code, e.g., via ======== Index: buildtools/conf/MonetDB.m4 =================================================================== RCS file: /cvsroot/monetdb/buildtools/conf/MonetDB.m4,v retrieving revision 1.99 diff -u -r1.99 MonetDB.m4 --- buildtools/conf/MonetDB.m4 27 Nov 2008 08:04:34 -0000 1.99 +++ buildtools/conf/MonetDB.m4 27 Nov 2008 11:46:09 -0000 @@ -758,7 +758,7 @@ dnl locally as possible via "-Wno-undef" dnl (see also MonetDB4/src/monet/Makefile.ag, sql/src/server/Makefile.ag, dnl pathfinder/modules/pftijah/Makefile.ag). - GCC_BISON_CFLAGS="$GCC_BISON_CFLAGS -Wno-undef" + GCC_BISON_CFLAGS="$GCC_BISON_CFLAGS -Wno-undef -Wp,-U_FORTIFY_SOURCE" dnl Likewise, at least with gcc 4.3.0 and flex 2.5.33 and bison 2.3 on Gentoo 1.12.11.1, dnl gcc complains about some bison/flex-generated code that defines an unused static function: dnl "warning: 'input' defined but not used". ======== Stefan > > > U tjc_scan.l > Index: tjc_scan.l > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/tjc/tjc_scan.l,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- tjc_scan.l 27 Nov 2008 10:53:17 -0000 1.2 > +++ tjc_scan.l 27 Nov 2008 11:03:26 -0000 1.3 > @@ -49,6 +49,8 @@ > YY_FATAL_ERROR( "input in tijah flex scanner failed" ); > #endif > > +#define ECHO /* empty -- don't echo anything (we shouldn't get there anyway */ > + > static void > gotoState (int s) > { > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_instruction.mx, , 1.374, 1.375
by Stefan Manegold 27 Nov '08

27 Nov '08

On Thu, Nov 27, 2008 at 10:43:37AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv739 > > Modified Files: > mal_instruction.mx > Log Message: > If you enter a multiplatform experiment then remove the exception handling too. > > > U mal_instruction.mx > Index: mal_instruction.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_instruction.mx,v > retrieving revision 1.374 > retrieving revision 1.375 > diff -u -d -r1.374 -r1.375 > --- mal_instruction.mx 26 Nov 2008 20:57:50 -0000 1.374 > +++ mal_instruction.mx 27 Nov 2008 10:43:34 -0000 1.375 > @@ -1736,7 +1736,7 @@ > #ifdef STRUCT_ALIGNED > /* experiment against alternative 32 bit platforms */ > #else > - showException(SYNTAX, "convertConstant", "missing implementation"); > + /* showException(SYNTAX, "convertConstant", "missing implementation");*/ > #endif ... hm, maybe the whole "effectless" #ifdef STRUCT_ALIGNED /* ... */ #else /* ... */ #endif [cs]hould be removed, now to keep the sources clean of dead code? Stefan > if ( vr->vtype != type) > showException(SYNTAX, "convertConstant", "coercion failed in '%s'", vr->val.sval); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/Tests colltest2.stable.err, , 1.2, 1.3 colltest2.stable.out, , 1.2, 1.3 procs.stable.out, , 1.46, 1.47 sigs.stable.out, , 1.27, 1.28
by Jan Rittinger 27 Nov '08

27 Nov '08

Hi Jan, was approving test colltest2 really what you wanted? -- I don't think so... On Nov 27, 2008, at 09:15, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25914/Tests > > Modified Files: > colltest2.stable.err colltest2.stable.out procs.stable.out > sigs.stable.out > Log Message: > - cleanup and approve sigs and procs tests > > > > U sigs.stable.out > Index: sigs.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/ > sigs.stable.out,v > retrieving revision 1.27 > retrieving revision 1.28 > diff -u -d -r1.27 -r1.28 > --- sigs.stable.out 24 Apr 2008 06:22:25 -0000 1.27 > +++ sigs.stable.out 27 Nov 2008 08:15:44 -0000 1.28 > @@ -51,7 +51,6 @@ > [ "tj_init_global(BAT[str,str]) : void" ] > [ "tj_log(str, int) : void" ] > [ "tj_normalizeTerm(str, str) : str" ] > -[ "tj_ping() : void" ] > [ "tj_setlog(str) : void" ] > [ "treemergejoin_sort(BAT[oid,oid], BAT[void,int], BAT[oid,oid]) : > BAT[oid,oid]" ] > [ "treemergejoin_sort_unnested(BAT[oid,oid], BAT[void,int], > BAT[oid,oid]) : BAT[oid,oid]" ] > > U colltest2.stable.err > Index: colltest2.stable.err > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/ > colltest2.stable.err,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- colltest2.stable.err 11 Sep 2007 15:52:53 -0000 1.2 > +++ colltest2.stable.err 27 Nov 2008 08:15:44 -0000 1.3 > @@ -5,11 +5,20 @@ > # 16:06:32 > Mtimeout -timeout 180 Mserver "--config=/usr/local/ > flokstra/etc/MonetDB.conf" --debug=0 --set "monet_mod_path=/usr/ > local/flokstra/lib/MonetDB4:/usr/local/flokstra/lib/MonetDB4/lib:/ > usr/local/flokstra/lib/MonetDB4/bin" --set "gdk_dbfarm=/usr/local/ > flokstra/var/MonetDB4/dbfarm" --set "sql_logdir=/usr/local/flokstra/ > var/MonetDB4/sql_logs" --set "xquery_logdir=/usr/local/flokstra/var/ > MonetDB4/xquery_logs" --set mapi_port=31150 --set xrpc_port=43225 -- > set monet_prompt= --trace "--dbname=mTests_modules_pftijah" -- > dbinit=" module(pathfinder);" ; echo ; echo Over.. > # 16:06:32 > > > +looking for col: pos68, ty: 0x1 in function pft_create_pfop (line > 1927) > +environment looks like: > + col: iter65, type: 0x1, mvar->name: a0011 > + col: pos68, type: 0x100000, mvar->name: a0017 > + col: pos68, type: 0x200000, mvar->name: a0016 > > # 16:06:32 > > # 16:06:32 > Mtimeout -timeout 60 MapiClient -lxquery -fxml - > umonetdb -Pmonetdb --host=localhost --port=31150 colltest2.xq > # 16:06:32 > > > +MAPI = monetdb@ewi581:37090 > +QUERY = let $opt := <TijahOptions debug="0" ft-index="FT_PFCOLL" ir- > model="NLLR"/> > + > + !# halted in milgen.brg (env_mvar_), line 676 > > # 16:06:32 > > # 16:06:32 > Done. > > U procs.stable.out > Index: procs.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/ > procs.stable.out,v > retrieving revision 1.46 > retrieving revision 1.47 > diff -u -d -r1.46 -r1.47 > --- procs.stable.out 29 Sep 2008 14:11:44 -0000 1.46 > +++ procs.stable.out 27 Nov 2008 08:15:44 -0000 1.47 > @@ -86,11 +86,10 @@ > [ "_shredlock_set(str, lng) : void" ] > [ "_shredlock_unset(str, lng) : void" ] > [ "_terms2void_tid(BAT[void,str], str) : > BAT[void,oid]" ] > -[ "_timestr(lng) : str" ] > [ "_tj_RTagBat(str) : str" ] > [ "_tj_TagBat(str) : str" ] > [ "_tj_TermBat(str) : str" ] > -[ "_tj_add2collection(str, BAT[str,BAT], str, str, bit) : > void" ] > +[ "_tj_add2collection(str, BAT[oid,BAT], BAT[str,BAT], str, str, > bit) : void" ] > [ "_tj_chk_modified_fragments(str, BAT[str,BAT]) : > BAT[void,str]" ] > [ "_tj_collection(str) : BAT[str,BAT]" ] > [ "_tj_collection_str(str) : BAT[void,BAT]" ] > @@ -509,6 +508,7 @@ > [ "p_containing_q_LMs(BAT[oid,dbl], BAT[void,str], BAT[oid,str]) : > BAT[oid,dbl]" ] > [ "p_containing_q_NLLR(BAT[oid,dbl], BAT[void,str], BAT[oid,str]) : > BAT[oid,dbl]" ] > [ "p_containing_q_OKAPI(BAT[oid,dbl], BAT[void,str], BAT[oid,str]) : > BAT[oid,dbl]" ] > +[ "p_containing_q_PRF(BAT[oid,dbl], BAT[void,str], BAT[oid,str]) : > BAT[oid,dbl]" ] > [ "p_containing_sum(BAT[oid,dbl], BAT[oid,dbl], BAT[oid,str]) : > BAT[oid,dbl]" ] > [ "pagesample(BAT[oid,any]) : BAT[oid,void]" ] > [ "parent(BAT[void,oid], BAT[void,oid], oid, BAT[void,BAT], int) : > BAT[void,BAT]" ] > @@ -646,7 +646,6 @@ > [ "tj_is_indexed(str) : bit" ] > [ "tj_nid2pre(BAT[oid,any], BAT[oid,str]) : > BAT[oid,any]" ] > [ "tj_pfop(BAT[void,oid], BAT[void,any], BAT[void,int], > BAT[void,oid]) : BAT[void,BAT]" ] > -[ "tj_ping() : void" ] > [ "tj_play_doc_tape(BAT[void,BAT], BAT[void,oid], BAT[void,int], > BAT[void,lng], BAT[void,str]) : void" ] > [ "tj_query_handler(bit, BAT[void,BAT], BAT[void,BAT], > BAT[void,BAT], BAT[oid,any], BAT[oid,BAT], BAT[void,lng], > BAT[void,dbl], BAT[void,str], BAT[void,BAT]) : BAT[void,BAT]" ] > [ "tj_rebuild_collection(str) : void" ] > > U colltest2.stable.out > Index: colltest2.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/ > colltest2.stable.out,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- colltest2.stable.out 11 Sep 2007 15:52:53 -0000 1.2 > +++ colltest2.stable.out 27 Nov 2008 08:15:44 -0000 1.3 > @@ -18,14 +18,12 @@ > > Over.. > > -# 16:06:32 > > -# 16:06:32 > Mtimeout -timeout 60 MapiClient -lxquery -fxml - > umonetdb -Pmonetdb --host=localhost --port=31150 colltest2.xq > -# 16:06:32 > > +# 09:11:32 > > +# 09:11:32 > mclient -lxquery -fxml -umonetdb -Pmonetdb -- > host=ewi581 --port=37090 colltest2.xq > +# 09:11:32 > > > -<?xml version="1.0" encoding="utf-8"?> > -<XQueryResult><bubble>Speed is the key to success.</ > bubble><bubble>Snelheid is de sleutel tot succes.</bubble></ > XQueryResult> > > -# 16:06:32 > > -# 16:06:32 > Done. > -# 16:06:32 > > +# 09:11:32 > > +# 09:11:32 > Done. > +# 09:11:32 > > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_instruction.mx, , 1.372, 1.373
by Stefan Manegold 26 Nov '08

26 Nov '08

On Wed, Nov 26, 2008 at 08:21:17PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13401 > > Modified Files: > mal_instruction.mx > Log Message: > An experiment for the nightly tests to address e.g. Darwin color test. > Should be handled correctly by GDK. > > > U mal_instruction.mx > Index: mal_instruction.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_instruction.mx,v > retrieving revision 1.372 > retrieving revision 1.373 > diff -u -d -r1.372 -r1.373 > --- mal_instruction.mx 23 Nov 2008 15:48:14 -0000 1.372 > +++ mal_instruction.mx 26 Nov 2008 20:21:14 -0000 1.373 > @@ -1,4 +1,4 @@ > -@' The contents of this file are subject to the MonetDB Public License > +' The contents of this file are subject to the MonetDB Public License > @' Version 1.1 (the "License"); you may not use this file except in > @' compliance with the License. You may obtain a copy of the License at > @' http://monetdb.cwi.nl/Legal/MonetDBLicense-1.1.html > @@ -1715,7 +1715,6 @@ > if( vr->vtype == type) > return 0; > if( vr->vtype == TYPE_str){ > -#ifdef STRUCT_ALIGNED > int ll = 0; > ptr d = NULL; > > @@ -1734,6 +1733,8 @@ > VALset(vr, type, d); > if (ATOMextern(type) == 0) > GDKfree(d); > +#ifdef STRUCT_ALIGNED > + /* experiment against alternative 32 bit platforms */ The problems does not seem to be 32-bit specific, but possibly big-endian related; it occurs on both 32- & 64-bit big-endian platforms such as PowerPC http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… and SPARC http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… similar problems occur with other tests on the same set of platforms: http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… Stefan > #else > showException(SYNTAX, "convertConstant", "missing implementation"); > #endif > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_instruction.mx, , 1.372, 1.373
by Stefan Manegold 26 Nov '08

26 Nov '08

On Wed, Nov 26, 2008 at 08:21:17PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13401 > > Modified Files: > mal_instruction.mx > Log Message: > An experiment for the nightly tests to address e.g. Darwin color test. > Should be handled correctly by GDK. > > > U mal_instruction.mx > Index: mal_instruction.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_instruction.mx,v > retrieving revision 1.372 > retrieving revision 1.373 > diff -u -d -r1.372 -r1.373 > --- mal_instruction.mx 23 Nov 2008 15:48:14 -0000 1.372 > +++ mal_instruction.mx 26 Nov 2008 20:21:14 -0000 1.373 > @@ -1,4 +1,4 @@ > -@' The contents of this file are subject to the MonetDB Public License > +' The contents of this file are subject to the MonetDB Public License ^^ Was this (also) intended? Stefan > @' Version 1.1 (the "License"); you may not use this file except in > @' compliance with the License. You may obtain a copy of the License at > @' http://monetdb.cwi.nl/Legal/MonetDBLicense-1.1.html > @@ -1715,7 +1715,6 @@ > if( vr->vtype == type) > return 0; > if( vr->vtype == TYPE_str){ > -#ifdef STRUCT_ALIGNED > int ll = 0; > ptr d = NULL; > > @@ -1734,6 +1733,8 @@ > VALset(vr, type, d); > if (ATOMextern(type) == 0) > GDKfree(d); > +#ifdef STRUCT_ALIGNED > + /* experiment against alternative 32 bit platforms */ > #else > showException(SYNTAX, "convertConstant", "missing implementation"); > #endif > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/tools/Tests mclient-lmal--help.stable.out.SunOS5.11.STATIC, Nov2008, NONE, 1.1.2.1
by Stefan Manegold 25 Nov '08

25 Nov '08

On Tue, Nov 25, 2008 at 01:45:28PM +0000, Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/tools/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12238 > > Added Files: > Tag: Nov2008 > mclient-lmal--help.stable.out.SunOS5.11.STATIC ^^^^^^^ IMHO, this will not work since Mtest.py considers ".STATIC" specific stable output only in case MonetDB is "statically linked", i.e., configures with "--disable-shared --enable-static", i.e., extension modules are statically linked into Mserver --- a "feature" which is (soon: was) only supported by MonetDB version 4, but is not (has never been) supported by MonetDB version 5). ... I guess, we should rather try to find out, why the compilation seems to find a usable readline on the very same machine (build-x86-sol10) when using GNU gcc (http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.mTests103/G…) while is apparently does not when using the Sun Studio 12 compiler (http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.mTests103/S…) ... (Mtest.py does not (yet) provide functionality to have *compiler*-specific stable output, mainly because is (still) uses the stabdard welcome message of both Mserver & mserver5 to get configuration information --- but only mserver5's --version option reveals the compiler name ...) http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.GNU.32.32.d… says ======== checking readline/readline.h usability... yes checking readline/readline.h presence... yes checking for readline/readline.h... yes checking for readline in -lreadline... yes checking for rl_completion_matches in -lreadline... yes ======== and ======== configure:31480: checking readline/readline.h usability configure:31497: gcc -c -O2 -D__EXTENSIONS__ -Wall -Wextra -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt conftest.c >&5 configure:31503: $? = 0 configure:31517: result: yes configure:31521: checking readline/readline.h presence configure:31536: gcc -E conftest.c configure:31542: $? = 0 configure:31556: result: yes configure:31589: checking for readline/readline.h configure:31596: result: yes configure:31601: checking for readline in -lreadline configure:31636: gcc -o conftest -O2 -D__EXTENSIONS__ -Wall -Wextra -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt conftest.c -lreadline >&5 configure:31642: $? = 0 configure:31660: result: yes configure:31815: checking for rl_completion_matches in -lreadline configure:31850: gcc -o conftest -O2 -D__EXTENSIONS__ -Wall -Wextra -std=c99 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt conftest.c -lreadline -lreadline >&5 configure:31856: $? = 0 configure:31874: result: yes ======== while http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.Sun.32.32.d… says ======== checking readline/readline.h usability... no checking readline/readline.h presence... no checking for readline/readline.h... no ======== and ======== configure:31480: checking readline/readline.h usability configure:31497: cc -c -D__EXTENSIONS__ -xc99 -xO5 conftest.c >&5 "conftest.c", line 104: cannot find include file: <readline/readline.h> cc: acomp failed for conftest.c configure:31503: $? = 2 configure: failed program was: | /* confdefs.h. */ | #define PACKAGE_NAME "MonetDB Server" | #define PACKAGE_TARNAME "MonetDB5-server" | #define PACKAGE_VERSION "5.8.1" | #define PACKAGE_STRING "MonetDB Server 5.8.1" | #define PACKAGE_BUGREPORT "monet(a)cwi.nl" | #define PACKAGE "MonetDB5-server" | #define VERSION "5.8.1" | #define HOST "i386-pc-solaris2.11" | #define HAVE_SYS_TYPES_H 1 | #define HAVE_SYS_STAT_H 1 | #define HAVE_STDLIB_H 1 | #define HAVE_STRING_H 1 | #define HAVE_MEMORY_H 1 | #define HAVE_STRINGS_H 1 | #define HAVE_INTTYPES_H 1 | #define HAVE_STDINT_H 1 | #define HAVE_UNISTD_H 1 | #define SIZEOF_LONG 4 | #define _XPG6 1 | #define __EXTENSIONS__ 1 | #define HAVE_C99 1 | #define HAVE_DLFCN_H 1 | #define YYTEXT_POINTER 1 | #define TIME_WITH_SYS_TIME 1 | #define HAVE_DIRENT_H 1 | #define HAVE_ALLOCA_H 1 | #define HAVE_GETOPT_H 1 | #define HAVE_NETDB_H 1 | #define HAVE_SYS_TYPES_H 1 | #define HAVE_SYS_TIMES_H 1 | #define _FILE_OFFSET_BITS 64 | #define RETSIGTYPE void | #define HAVE_PTRDIFF_T 1 | #define HAVE_SSIZE_T 1 | #define HAVE_LONG_LONG 1 | #define LLFMT "%lld" | #define ULLFMT "%llu" | #define SIZEOF_CHAR 1 | #define SIZEOF_SHORT 2 | #define SIZEOF_INT 4 | #define SIZEOF_LONG 4 | #define SIZEOF_VOID_P 4 | #define SIZEOF_SIZE_T 4 | #define SIZEOF_SSIZE_T 4 | #define SIZEOF_PTRDIFF_T 4 | #define SIZEOF_LONG_LONG 8 | #define SIZEOF___INT64 0 | #define HAVE_FTRUNCATE 1 | #define HAVE_GETTIMEOFDAY 1 | #define HAVE_OPENDIR 1 | #define HAVE_SYSCONF 1 | #define HAVE_TIMES 1 | #define HAVE_FTELLO 1 | #define HAVE_FSEEKO 1 | #define DIR_SEP '/' | #define DIR_SEP_STR "/" | #define PATH_SEP ':' | #define PATH_SEP_STR ":" | #define SO_PREFIX "lib" | #define SO_EXT ".so" | #define NDEBUG 1 | #define HAVE_PTHREAD_H 1 | #define HAVE_SEMAPHORE_H 1 | #define HAVE_SCHED_H 1 | #define HAVE_PTHREAD_KILL 1 | #define HAVE_PTHREAD_SIGMASK 1 | #define HAVE_PTHREAD_SETSCHEDPRIO 1 | #define HAVE_LIBPTHREAD 1 | /* end confdefs.h. */ | #include <stdio.h> | #ifdef HAVE_SYS_TYPES_H | # include <sys/types.h> | #endif | #ifdef HAVE_SYS_STAT_H | # include <sys/stat.h> | #endif | #ifdef STDC_HEADERS | # include <stdlib.h> | # include <stddef.h> | #else | # ifdef HAVE_STDLIB_H | # include <stdlib.h> | # endif | #endif | #ifdef HAVE_STRING_H | # if !defined STDC_HEADERS && defined HAVE_MEMORY_H | # include <memory.h> | # endif | # include <string.h> | #endif | #ifdef HAVE_STRINGS_H | # include <strings.h> | #endif | #ifdef HAVE_INTTYPES_H | # include <inttypes.h> | #endif | #ifdef HAVE_STDINT_H | # include <stdint.h> | #endif | #ifdef HAVE_UNISTD_H | # include <unistd.h> | #endif | #include <readline/readline.h> configure:31517: result: no configure:31521: checking readline/readline.h presence configure:31536: cc -E conftest.c "conftest.c", line 71: cannot find include file: <readline/readline.h> cc: acomp failed for conftest.c configure:31542: $? = 2 configure: failed program was: | /* confdefs.h. */ | #define PACKAGE_NAME "MonetDB Server" | #define PACKAGE_TARNAME "MonetDB5-server" | #define PACKAGE_VERSION "5.8.1" | #define PACKAGE_STRING "MonetDB Server 5.8.1" | #define PACKAGE_BUGREPORT "monet(a)cwi.nl" | #define PACKAGE "MonetDB5-server" | #define VERSION "5.8.1" | #define HOST "i386-pc-solaris2.11" | #define HAVE_SYS_TYPES_H 1 | #define HAVE_SYS_STAT_H 1 | #define HAVE_STDLIB_H 1 | #define HAVE_STRING_H 1 | #define HAVE_MEMORY_H 1 | #define HAVE_STRINGS_H 1 | #define HAVE_INTTYPES_H 1 | #define HAVE_STDINT_H 1 | #define HAVE_UNISTD_H 1 | #define SIZEOF_LONG 4 | #define _XPG6 1 | #define __EXTENSIONS__ 1 | #define HAVE_C99 1 | #define HAVE_DLFCN_H 1 | #define YYTEXT_POINTER 1 | #define TIME_WITH_SYS_TIME 1 | #define HAVE_DIRENT_H 1 | #define HAVE_ALLOCA_H 1 | #define HAVE_GETOPT_H 1 | #define HAVE_NETDB_H 1 | #define HAVE_SYS_TYPES_H 1 | #define HAVE_SYS_TIMES_H 1 | #define _FILE_OFFSET_BITS 64 | #define RETSIGTYPE void | #define HAVE_PTRDIFF_T 1 | #define HAVE_SSIZE_T 1 | #define HAVE_LONG_LONG 1 | #define LLFMT "%lld" | #define ULLFMT "%llu" | #define SIZEOF_CHAR 1 | #define SIZEOF_SHORT 2 | #define SIZEOF_INT 4 | #define SIZEOF_LONG 4 | #define SIZEOF_VOID_P 4 | #define SIZEOF_SIZE_T 4 | #define SIZEOF_SSIZE_T 4 | #define SIZEOF_PTRDIFF_T 4 | #define SIZEOF_LONG_LONG 8 | #define SIZEOF___INT64 0 | #define HAVE_FTRUNCATE 1 | #define HAVE_GETTIMEOFDAY 1 | #define HAVE_OPENDIR 1 | #define HAVE_SYSCONF 1 | #define HAVE_TIMES 1 | #define HAVE_FTELLO 1 | #define HAVE_FSEEKO 1 | #define DIR_SEP '/' | #define DIR_SEP_STR "/" | #define PATH_SEP ':' | #define PATH_SEP_STR ":" | #define SO_PREFIX "lib" | #define SO_EXT ".so" | #define NDEBUG 1 | #define HAVE_PTHREAD_H 1 | #define HAVE_SEMAPHORE_H 1 | #define HAVE_SCHED_H 1 | #define HAVE_PTHREAD_KILL 1 | #define HAVE_PTHREAD_SIGMASK 1 | #define HAVE_PTHREAD_SETSCHEDPRIO 1 | #define HAVE_LIBPTHREAD 1 | /* end confdefs.h. */ | #include <readline/readline.h> configure:31556: result: no configure:31589: checking for readline/readline.h configure:31596: result: no ======== apparently, readline/readline.h is in GNU gcc's default include path but not in Sun Studio cc's default include path on that machine ... Stefan > Log Message: > Attempt to approve no static readline library on SunOS 5.11 (when not Prefix-enabled) > > --- NEW FILE: mclient-lmal--help.stable.out.SunOS5.11.STATIC --- > stdout of test 'mclient-lmal--help` in directory 'src/tools` itself: > > > # 11:03:02 > > # 11:03:02 > Mtimeout -timeout 240 mserver5 "--config=/ufs/mk/monet5/Linux/etc/monetdb5.conf" --debug=10 --set "monet_mod_path=/ufs/mk/monet5//Linux/lib/MonetDB5:/ufs/mk/monet5//Linux/lib/MonetDB5/lib:/ufs/mk/monet5//Linux/lib/MonetDB5/bin" --set "gdk_dbfarm=/ufs/mk/monet5//Linux/var/MonetDB5/dbfarm" --set "sql_logdir=/ufs/mk/monet5//Linux/var/MonetDB5/sql_logs" --set "xquery_logdir=/ufs/mk/monet5//Linux/var/MonetDB5/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=36261 --set xrpc_port=45929 --set monet_prompt= --trace "--dbname=mTests_src_tools" --dbinit="" ; echo ; echo Over.. > # 11:03:02 > > > !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. > !WARNING: BBPdir: initializing BBP. > # MonetDB server v5.1.0, based on kernel v1.19.0 > # Serving database 'mTests_src_tools' > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked > # Copyright (c) 1993-2007 CWI, all rights reserved > # Visit http://monetdb.cwi.nl/ for further information > # Listening for connection requests on mapi:monetdb://gio.ins.cwi.nl:36261/ > > Ready. > #function user.main():void; > # clients.quit(); > #end main; > > Over.. > > # 11:03:02 > > # 11:03:02 > Mtimeout -timeout 120 ./mclient-lmal--help.MAL.sh mclient-lmal--help > # 11:03:02 > > > > # 11:03:02 > > # 11:03:02 > Mtimeout -timeout 60 mclient -lmal -umonetdb -Pmonetdb --config=/ufs/mk/monet5/Linux/etc/monetdb5.conf --host=gio --port=36261 --help > # 11:03:02 > > > \? - show this message > ?pat - MAL function help. pat=[modnme[.fcnnme][(][)]] wildcard * > \<file - read input from file > \>file - save response in file, or stdout if no file is given > \|cmd - pipe result to process, or stop when no command is given > \t - toggle timer > \e - echo the query in sql formatting mode > \f - format using a built-in renderer {csv,tab,raw,sql,xml} > \w# - set maximal page width (-1=raw,0=no limit, >0 max char) > \r# - set maximum rows per page (-1=raw) > \L file - save client/server interaction > \X - trace mclient code > \q - terminate session > mal> > # 11:03:02 > > # 11:03:02 > Done. > # 11:03:02 > > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

[Monetdb-developers] Could not create hash table for key test
by Stefan de Konink 23 Nov '08

23 Nov '08

#GDKmalloc(14777222432) fail => BBPtrim(enter) usage[mem=14840896,vm=27527806976] #BBPTRIM_ENTER: memsize=14840896,vmsize=27527806976 #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 #GDKmalloc(14777222432) fail => BBPtrim(ready) usage[mem=11538120,vm=27527806976] #BATpropcheck: BAT tmp_1260(-688): could not allocate hash table for key test #GDKmalloc(14777222432) fail => BBPtrim(enter) usage[mem=11537664,vm=27527806976] #BBPTRIM_ENTER: memsize=11537664,vmsize=27527806976 #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 #GDKmalloc(14777222432) fail => BBPtrim(ready) usage[mem=10416208,vm=27527806976] #BATpropcheck: BAT tmp_1135(-605): could not allocate hash table for key test MAPI = monetdb@localhost:50000 QUERY = COPY 773410980 RECORDS INTO node_tags from '/mnt/data2/csv/node_tags.csv' USING DELIMITERS ',', '\n', ''''; ERROR = !MALException: GDKmallocmax: failed for 1892320544 bytes !ERROR: GDKload: failed name=12/1252, ext=thash !ERROR: GDKmallocmax: failed for 1892320544 bytes !ERROR: GDKload: failed name=12/1253, ext=thash What kind of voodoo is this? I'm trying to import a 42GB csv file using copy into, on a native system, 2GB of memory, 4GB of swap. Latest CVS version, this time compiled for CoreDuo, without debuging, with optimise. Stefan

3 10

Re: [Monetdb-developers] Monetdb-developers Digest, Vol 30, Issue 10
by Peter Boncz 23 Nov '08

23 Nov '08

Hi Stefan (the non-german .de one) > Maybe a very strange idea, could be your better solution. If by default > these operations are mmap'ed, they should be taken care of by a disk based > memory extension. Hence being independent of RAM/SWAP but having all pro's > of both. You are right. In fact, this is what MonetDB is supposed to do. Memory is organized in contiguous Heap objects. This does not only hold for BATs but also for Hash Tables. At some moment, I did add the possibility to use a real memory mapped files for their allocation, as a last resort. The problem was there that the Heap() API did not have a filename parameter, and a HEAPextend() thus would not know what file to use. In order not to break the API, I decided to initialize the filename fields at BAT creation time (this is why you may sometimes see .hhash and .thash files in a just stopped MonetDB repository -- even though hash tables are not persistent). With hindsight, this API decision was bad judgement; because the question whether real file mapping is used now depends on the question whether the filename was initialized at BAT or Hash table creation. Now, this should be the case, but it would be my first question to address in a debugging session. I also recall that in case of the Skyserver TB dataset, key checking was disabled to to similar problems. Of course, if we would find and fix this bug, life will not be rosy for you, doing random access (key uniqueness checking) into a 14GB heap that will never fit your 2GB RAM. That goes back to your question whether it is in fact reasonable to materialize 14GB. Questions like these led to a redesign that is much more careful with memory consumption (X100) whose spin-off development regrettably means that my time for such debugging sessions currently is limited. Peter PS The likely cause for the problem is a shortage of swap space. Increasing your swap file size (with a few 10s of GB) should be a workaround for the problem.

3 2

[Monetdb-developers] Constraint violations with all details
by Stefan de Konink 23 Nov '08

23 Nov '08

Hi, I cannot find it back in the trackers but I think it have asked this question before. Would it be possible to output the actual failing constraint details instead of 'just an error'. sql>alter table relation_members_way add constraint relation_to_way_fkey foreign key(to_way) references ways; !SQLException:assert:INSERT INTO: FOREIGN KEY constraint 'relation_members_way.relation_to_way_fkey' violated Inserting with INSERTS will give a nice error, because the query it self contains the problem. This is not true for a copy into, or in this respect just an alter table. Stefan ps. indeed I have to think too long about a query that will show me the non existing primary keys.

2 2

Re: [Monetdb-developers] Could not create hash table for key test
by Peter Boncz 23 Nov '08

23 Nov '08

Hi Stefan, Like Martin indicated, MonetDB runs out of memory here, when trying to obtain a contiguous area of 14GB. The error messages show that MonetDB is pulling all the stops to try to get this memory from the system. That is, a so-called "trim" buffer manager thread tries to unload all unpinned other tables. To no avail here. You see the actvity of the trim thread only when a GDKmalloc has failed already, and the system tries again after unloading what it can. The fact that though it tries to GDKmalloc you see the GDKload error message indicates that it actually tries to get the 14GB by creating a file and memory mapping on it. The cause for failure can thus be: (1) your file system is full (test just after the error message appears, because a MonetDB restarts first clears out all temp files it created on the last run) (2) you try to process such large loads on a 32-bts machine (naughty naughty) For these large sizes, and the way MonetDB manages mamory, you need a 64-bits OS. Peter > Message: 4 > Date: Sun, 23 Nov 2008 02:04:09 +0100 > From: Stefan de Konink <stefan(a)konink.de> > Subject: [Monetdb-developers] Could not create hash table for key test > To: monetdb-dev <monetdb-developers(a)lists.sourceforge.net> > Message-ID: <4928AC09.7010205(a)konink.de> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > #GDKmalloc(14777222432) fail => BBPtrim(enter) > usage[mem=14840896,vm=27527806976] > #BBPTRIM_ENTER: memsize=14840896,vmsize=27527806976 > #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 > #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 > #GDKmalloc(14777222432) fail => BBPtrim(ready) > usage[mem=11538120,vm=27527806976] > #BATpropcheck: BAT tmp_1260(-688): could not allocate hash table for key > test > #GDKmalloc(14777222432) fail => BBPtrim(enter) > usage[mem=11537664,vm=27527806976] > #BBPTRIM_ENTER: memsize=11537664,vmsize=27527806976 > #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 > #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 > #GDKmalloc(14777222432) fail => BBPtrim(ready) > usage[mem=10416208,vm=27527806976] > #BATpropcheck: BAT tmp_1135(-605): could not allocate hash table for key > test > MAPI = monetdb@localhost:50000 > QUERY = COPY 773410980 RECORDS INTO node_tags from > '/mnt/data2/csv/node_tags.csv' USING DELIMITERS ',', '\n', ''''; > ERROR = !MALException: GDKmallocmax: failed for 1892320544 bytes > !ERROR: GDKload: failed name=12/1252, ext=thash > !ERROR: GDKmallocmax: failed for 1892320544 bytes > !ERROR: GDKload: failed name=12/1253, ext=thash > > What kind of voodoo is this? > > I'm trying to import a 42GB csv file using copy into, on a native > system, 2GB of memory, 4GB of swap. Latest CVS version, this time > compiled for CoreDuo, without debuging, with optimise. > > > Stefan > > > > ------------------------------ > > Message: 5 > Date: Sun, 23 Nov 2008 03:02:18 +0100 > From: Stefan de Konink <stefan(a)konink.de> > Subject: Re: [Monetdb-developers] Could not create hash table for key > test > To: monetdb-dev <monetdb-developers(a)lists.sourceforge.net> > Message-ID: <4928B9AA.5060401(a)konink.de> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > #BBPTRIM_ENTER: memsize=180224,vmsize=14397997056 > #BBPTRIM: memtarget=0 vmtarget=0 > #BBPTRIM_EXIT: memsize=20365312,vmsize=14397997056 > #BBPTRIM_ENTER: memsize=2496368440,vmsize=16874000184 > #BBPTRIM: memtarget=778092856 vmtarget=0 > #BBPTRIM_EXIT: memsize=20365312,vmsize=10150287928 > Killed > > This one also doen't make me happy. The initial table that are inserted > without a problem are of 19GB and 1GB. > > The table that fails after it is 7GB. > > > Now obviously we are talking about a system that could use some more > memory. But I don't really see why it is inserting 20GB without a > problem, and then borks on the inserting of 7GB. A non string, table. > > > > Stefan > > > > ------------------------------ > > Message: 6 > Date: Sun, 23 Nov 2008 08:32:00 +0100 > From: Martin Kersten <Martin.Kersten(a)cwi.nl> > Subject: Re: [Monetdb-developers] Could not create hash table for key > test > To: Stefan de Konink <stefan(a)konink.de>, monetdb-dev > <monetdb-developers(a)lists.sourceforge.net> > Message-ID: <492906F0.5060209(a)cwi.nl> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > Dear Stefan, > Let's explain as far as possible. > > Stefan de Konink wrote: >> #GDKmalloc(14777222432) fail => BBPtrim(enter) >> usage[mem=14840896,vm=27527806976] >> #BBPTRIM_ENTER: memsize=14840896,vmsize=27527806976 >> #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 >> #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 >> > The system is trying to malloc space for (in this case) a hash table, > but that instruction fails. Then it attempts to free up memory by > swapping out tables. > Given the fact that after this sweep it still fails, indicates that > your swap memory has become fragmented, such that there is no > consecutive area of 14 GB left. > > For large table loads (relative to the swap size) it is advisable to > load in multiple steps. > First load the data into the tables without (foreign) key checks. > After this step ALTER the tables to respect the (foreign) keys. > > Better solutions are being worked on. >> #GDKmalloc(14777222432) fail => BBPtrim(ready) >> usage[mem=11538120,vm=27527806976] >> #BATpropcheck: BAT tmp_1260(-688): could not allocate hash table for key >> test >> #GDKmalloc(14777222432) fail => BBPtrim(enter) >> usage[mem=11537664,vm=27527806976] >> #BBPTRIM_ENTER: memsize=11537664,vmsize=27527806976 >> #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 >> #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 >> #GDKmalloc(14777222432) fail => BBPtrim(ready) >> usage[mem=10416208,vm=27527806976] >> #BATpropcheck: BAT tmp_1135(-605): could not allocate hash table for key >> test >> MAPI = monetdb@localhost:50000 >> QUERY = COPY 773410980 RECORDS INTO node_tags from >> '/mnt/data2/csv/node_tags.csv' USING DELIMITERS ',', '\n', ''''; >> ERROR = !MALException: GDKmallocmax: failed for 1892320544 bytes >> !ERROR: GDKload: failed name=12/1252, ext=thash >> !ERROR: GDKmallocmax: failed for 1892320544 bytes >> !ERROR: GDKload: failed name=12/1253, ext=thash >> >> What kind of voodoo is this? >> >> I'm trying to import a 42GB csv file using copy into, on a native >> system, 2GB of memory, 4GB of swap. Latest CVS version, this time >> compiled for CoreDuo, without debuging, with optimise. >> >> >> Stefan >> >> ------------------------------------------------------------------------- >> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge >> Build the coolest Linux based applications with Moblin SDK & win great >> prizes >> Grand prize is a trip for two to an Open Source event anywhere in the world >> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> _______________________________________________ >> Monetdb-developers mailing list >> Monetdb-developers(a)lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/monetdb-developers >> > > > > > ------------------------------ > > Message: 7 > Date: Sun, 23 Nov 2008 09:32:30 +0100 > From: Martin Kersten <Martin.Kersten(a)cwi.nl> > Subject: Re: [Monetdb-developers] Could not create hash table for key > test > To: Stefan de Konink <stefan(a)konink.de>, monetdb-dev > <monetdb-developers(a)lists.sourceforge.net> > Message-ID: <4929151E.2040909(a)cwi.nl> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > Stefan de Konink wrote: >> #BBPTRIM_ENTER: memsize=180224,vmsize=14397997056 >> #BBPTRIM: memtarget=0 vmtarget=0 >> #BBPTRIM_EXIT: memsize=20365312,vmsize=14397997056 >> #BBPTRIM_ENTER: memsize=2496368440,vmsize=16874000184 >> #BBPTRIM: memtarget=778092856 vmtarget=0 >> #BBPTRIM_EXIT: memsize=20365312,vmsize=10150287928 >> Killed >> > ^^^^^^^^ > This means the process is victimized by the Linux kernel. >> This one also doen't make me happy. The initial table that are inserted >> without a problem are of 19GB and 1GB. >> >> The table that fails after it is 7GB. >> >> >> Now obviously we are talking about a system that could use some more >> memory. But I don't really see why it is inserting 20GB without a >> problem, and then borks on the inserting of 7GB. A non string, table. >> >> >> >> Stefan >> >> ------------------------------------------------------------------------- >> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge >> Build the coolest Linux based applications with Moblin SDK & win great >> prizes >> Grand prize is a trip for two to an Open Source event anywhere in the world >> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> _______________________________________________ >> Monetdb-developers mailing list >> Monetdb-developers(a)lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/monetdb-developers >> > > > > > ------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > ------------------------------ > > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > End of Monetdb-developers Digest, Vol 30, Issue 9 > ************************************************* >

2 1

[Monetdb-developers] MAPI protocol suggestion
by Stefan de Konink 22 Nov '08

22 Nov '08

Hi, With light on my recent philosophical question on doubles/uints for the lossy storage on coordinates. I wonder the following; Would it be possible to implement a binary MAPI protocol that can use the native types of the data that is stored within MonetDB? So for example; I create a table: CREATE TABLE helloword (hello varchar(13), world integer); INSERT INTO helloword (hello, world) VALUES ('hoi', 1); And fetch this table: SELECT hello, world FROM helloworld; And receive the MAPI data in the following (too simplistic) way: (len) (string) --> 5 hello 5 world --> 3 hoi 4 0x0 0x0 0x0 0x1 For several reasons the above will not work; the length field is too short (only up to 255) it is also not optimal. I wonder if it can trigger any idea to allow the end user to use native types instead of char[]'s. Stefan

2 4

Re: [Monetdb-developers] [Monetdb-checkins] java Makefile.ag, , 1.11, 1.12 build.properties, , 1.5, 1.6 release.txt, , 1.5, 1.6
by Stefan Manegold 18 Nov '08

18 Nov '08

Fabian, Sjoerd, shouldn't we then also increase the "version" of the java tarball, e.g., ======== $ sed -i -e 's|20080625|20081118|' java/configure.ag java/NT/rules.msc ======== $ cvs diff java/configure.ag java/NT/rules.msc -------- Index: java/configure.ag =================================================================== RCS file: /cvsroot/monetdb/java/configure.ag,v retrieving revision 1.16 diff -u -r1.16 configure.ag --- java/configure.ag 10 Oct 2008 08:41:25 -0000 1.16 +++ java/configure.ag 18 Nov 2008 10:36:12 -0000 @@ -20,7 +20,7 @@ # Process this file with autoconf to produce a configure script. AC_PREREQ(2.59) -AC_INIT([MonetDB Java], [20080625], [monet(a)cwi.nl] [MonetDB-java]) +AC_INIT([MonetDB Java], [20081118], [monet(a)cwi.nl] [MonetDB-java]) AC_CONFIG_AUX_DIR(conf) AM_INIT_AUTOMAKE AM_CONFIG_HEADER([monetdb_java_config.h]) Index: java/NT/rules.msc =================================================================== RCS file: /cvsroot/monetdb/java/NT/rules.msc,v retrieving revision 1.9 diff -u -r1.9 rules.msc --- java/NT/rules.msc 10 Oct 2008 08:41:25 -0000 1.9 +++ java/NT/rules.msc 18 Nov 2008 10:36:12 -0000 @@ -29,6 +29,6 @@ MONETDB_LIBS=/libpath:"$(MONETDB_PREFIX)\lib" pkg = MonetDB -VERSION=20080625 +VERSION=20081118 ODBC_LIBS = odbccp32.lib user32.lib ======== The java tarball has a date as "version number", since it contains JDBC & XRPC and hence can/should not have the JDBC version number. (The xrpc wrapper .jar files do not even have a versioning schema, yet ...) Stefan On Tue, Nov 18, 2008 at 10:27:33AM +0000, Fabian wrote: > Update of /cvsroot/monetdb/java > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13749 > > Modified Files: > Makefile.ag build.properties release.txt > Log Message: > Bump version due to changed licence. Nothing has changed between 1.8 and 1.9, tagged suffix (Excelsa) with the current release (Nov2008). We should probably make a note of this in the general release notes. > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/java/Makefile.ag,v > retrieving revision 1.11 > retrieving revision 1.12 > diff -u -d -r1.11 -r1.12 > --- Makefile.ag 10 Oct 2008 08:41:25 -0000 1.11 > +++ Makefile.ag 18 Nov 2008 10:27:31 -0000 1.12 > @@ -30,7 +30,7 @@ > ant_distjdbc = { > COND = HAVE_JAVAJDBC > DIR = datadir/MonetDB/lib > - FILES = monetdb-1.3-mcl.jar monetdb-1.8-jdbc.jar jdbcclient.jar > + FILES = monetdb-1.3-mcl.jar monetdb-1.9-jdbc.jar jdbcclient.jar > } > > ant_distxrpc = { > > U release.txt > Index: release.txt > =================================================================== > RCS file: /cvsroot/monetdb/java/release.txt,v > retrieving revision 1.5 > retrieving revision 1.6 > diff -u -d -r1.5 -r1.6 > --- release.txt 16 Jun 2008 12:46:39 -0000 1.5 > +++ release.txt 18 Nov 2008 10:27:31 -0000 1.6 > @@ -1,8 +1,8 @@ > RELEASE NOTES > -MonetDB JDBC driver version 1.8 (Excelsa/MCL-1.3) > +MonetDB JDBC driver version 1.9 (Excelsa-Nov2008/MCL-1.3) > Fabian Groffen <Fabian.Groffen(a)cwi.nl> > > -Release date: 2008-06-16 > +Release date: 2008-11-18 > > > This JDBC driver is designed for use with MonetDB, a main-memory > @@ -12,6 +12,8 @@ > interface are available. It is believed, however, that this > implementation is rich enough to be suitable for a majority of > application settings. > +Most notably, JDBC4 is not implemented at the moment. This disallows > +Java 1.6 and up to compile the driver from source. > > Below a list of supported features can be found. Please read this list > if you intend to use this driver. If you feel some features are > > U build.properties > Index: build.properties > =================================================================== > RCS file: /cvsroot/monetdb/java/build.properties,v > retrieving revision 1.5 > retrieving revision 1.6 > diff -u -d -r1.5 -r1.6 > --- build.properties 16 Jun 2008 12:46:39 -0000 1.5 > +++ build.properties 18 Nov 2008 10:27:31 -0000 1.6 > @@ -19,9 +19,9 @@ > # major release number > JDBC_MAJOR=1 > # minor release number > -JDBC_MINOR=8 > +JDBC_MINOR=9 > # an additional identifying string > -JDBC_VER_SUFFIX=Excelsa > +JDBC_VER_SUFFIX=Excelsa-Nov2008 > # the default port to connect on, if no port given when using SQL > JDBC_DEF_PORT=50000 > # the default port to connect on, if no port given when using XML:DB > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime/xrpc/admin/Tests db_env.stable.out, XQuery_0-24, 1.1.2.1, 1.1.2.2
by Stefan Manegold 18 Nov '08

18 Nov '08

On Mon, Nov 17, 2008 at 05:53:14PM +0000, Ying Zhang wrote: > Update of /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17083/admin/Tests > > Modified Files: > Tag: XQuery_0-24 Also this one: checked in in wrong branch! Stefan > db_env.stable.out > Log Message: > new output (with one additional bun) > > > > U db_env.stable.out > Index: db_env.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/Attic/db_env.stable.out,v > retrieving revision 1.1.2.1 > retrieving revision 1.1.2.2 > diff -u -d -r1.1.2.1 -r1.1.2.2 > --- db_env.stable.out 17 Nov 2008 12:03:42 -0000 1.1.2.1 > +++ db_env.stable.out 17 Nov 2008 17:53:12 -0000 1.1.2.2 > @@ -125,6 +125,9 @@ > <bun head="xrpc_trusted"> > # http://monetdb.cwi.nl;http://127.0.0.1;http://localhost;/net/jarl/export/sc… > </bun> > + <bun head="xrpc_user"> > +# http://127.0.0.1;127.0.0.1;http://localhost;localhost > + </bun> > </XQueryResult> > > # 12:02:35 > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

18 Nov '08

Ying Zhang wrote: > Update of /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv22023 > > Added Files: > Tag: XQuery_0-24 Checked in in wrong branch. > All add_del_doc.prologue.src add_del_doc.stable.err > add_del_doc.stable.out add_del_doc.xq.in add_trusted.mil > backup_restore.prologue.src backup_restore.stable.err > backup_restore.stable.out backup_restore.xq.in > db_env.prologue.src db_env.stable.err db_env.stable.out > db_env.xq.in db_stats.prologue.src db_stats.stable.err > db_stats.stable.out db_stats.xq.in > Log Message: > Tests for the admin XQuery functions > > > > > --- NEW FILE: db_stats.stable.err --- > stderr of test 'db_stats` in directory 'runtime/xrpc/admin` itself: > > > # 11:06:16 > > # 11:06:16 > Mserver "--config=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf" --debug=10 --set "monet_mod_path=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/lib:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/bin" --set "gdk_dbfarm=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm" --set "sql_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/sql_logs" --set "xquery_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=36716 --set xrpc_port=46327 --set monet_prompt= --trace "--dbname=mTests_runtime_xrpc_admin" "--dbinit= module(pathfinder);" db_stats.prologue ; echo ; echo Over.. > # 11:06:16 > > > > # 11:06:16 > > # 11:06:16 > mclient -lxquery -fxml -umonetdb -Pmonetdb --host=jarl --port=36716 db_stats.xq > # 11:06:16 > > > > # 11:06:17 > > # 11:06:17 > Done. > # 11:06:17 > > > > --- NEW FILE: All --- > add_del_doc > backup_restore > db_stats > db_env > > --- NEW FILE: backup_restore.stable.out --- > stdout of test 'backup_restore` in directory 'runtime/xrpc/admin` itself: > > > # 11:19:35 > > # 11:19:35 > Mserver "--config=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf" --debug=10 --set "monet_mod_path=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/lib:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/bin" --set "gdk_dbfarm=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm" --set "sql_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/sql_logs" --set "xquery_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=37835 --set xrpc_port=44669 --set monet_prompt= --trace "--dbname=mTests_runtime_xrpc_admin" "--dbinit= module(pathfinder);" backup_restore.prologue ; echo ; echo Over.. > # 11:19:35 > > > > > # MonetDB Server v4.24.0 > # based on GDK v1.24.1 > # Copyright (c) 1993-2008, CWI. All rights reserved. > # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs; dynamically linked. > # Visit http://monetdb.cwi.nl/ for further information. > # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah > # MonetDB/XQuery module v0.24.1 loaded (default back-end is 'milprint_summer') > # XRPC administrative console at http://127.0.0.1:44669/admin > > printf("\nReady.\n"); > > Ready. > quit(); > > Over.. > > # 11:19:36 > > # 11:19:36 > mclient -lxquery -fxml -umonetdb -Pmonetdb --host=jarl --port=37835 backup_restore.xq > # 11:19:36 > > > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult><db-before-backup><document updatable="true" collection="xmark">xmark1.xml</document><document updatable="true" collection="xmark">xmark2.xml</document></db-before-backup></XQueryResult> > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult></XQueryResult> > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult><db-after-del/></XQueryResult> > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult><db-after-restore><document updatable="false" collection="xmark" uri="">xmark1.xml</document><document updatable="false" collection="xmark" uri="">xmark2.xml</document></db-after-restore></XQueryResult> > > # 11:19:37 > > # 11:19:37 > Done. > # 11:19:37 > > > > --- NEW FILE: db_env.stable.out --- > stdout of test 'db_env` in directory 'runtime/xrpc/admin` itself: > > > # 12:02:34 > > # 12:02:34 > Mserver "--config=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf" --debug=10 --set "monet_mod_path=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/lib:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/bin" --set "gdk_dbfarm=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm" --set "sql_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/sql_logs" --set "xquery_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=32688 --set xrpc_port=47901 --set monet_prompt= --trace "--dbname=mTests_runtime_xrpc_admin" "--dbinit= module(pathfinder);" db_env.prologue ; echo ; echo Over.. > # 12:02:34 > > > > > # MonetDB Server v4.24.0 > # based on GDK v1.24.1 > # Copyright (c) 1993-2008, CWI. All rights reserved. > # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs; dynamically linked. > # Visit http://monetdb.cwi.nl/ for further information. > # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah > # MonetDB/XQuery module v0.24.1 loaded (default back-end is 'milprint_summer') > # XRPC administrative console at http://127.0.0.1:47901/admin > > printf("\nReady.\n"); > > Ready. > quit(); > > Over.. > > # 12:02:34 > > # 12:02:34 > mclient -lxquery -fxml -umonetdb -Pmonetdb --host=jarl --port=32688 db_env.xq > # 12:02:34 > > > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult> > <bun head="config"> > # /net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf > </bun> > <bun head="datadir"> > # /net/jarl/export/scratch0/zhang/monet-install/stable/debug/share > </bun> > <bun head="gdk_alloc_map"> > # no > </bun> > <bun head="gdk_arch"> > # 64bitx86_64-unknown-linux-gnu > </bun> > <bun head="gdk_dbfarm"> > # /net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm > </bun> > <bun head="gdk_dbname"> > # mTests_runtime_xrpc_admin > </bun> > <bun head="gdk_mem_bigsize"> > # 262144 > </bun> > <bun head="gdk_mem_maxsize"> > # 6786091110 > </bun> > <bun head="gdk_mem_pagebits"> > # 14 > </bun> > <bun head="gdk_version"> > # 1.24.0 > </bun> > <bun head="gdk_vmtrim"> > # yes > </bun> > <bun head="host"> > # localhost > </bun> > <bun head="mapi_clients"> > # 2 > </bun> > <bun head="mapi_open"> > # true > </bun> > <bun head="mapi_port"> > # 32688 > </bun> > <bun head="monet_admin"> > # adm > </bun> > <bun head="monet_cwd"> > # /ufs/zhang/homepage/ROOT/mTests/runtime/xrpc/admin > </bun> > <bun head="monet_version"> > # 4.24.0 > </bun> > <bun head="standoff_end"> > # end > </bun> > <bun head="standoff_ns"> > # > </bun> > <bun head="standoff_start"> > # start > </bun> > <bun head="xquery_backend"> > # milprint_summer > </bun> > <bun head="xquery_cacheMB"> > # 100 > </bun> > <bun head="xquery_cacherules"> > # > </bun> > <bun head="xquery_logdir"> > # /net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs > </bun> > <bun head="xquery_output"> > # dm > </bun> > <bun head="xquery_procMB"> > # 128 > </bun> > <bun head="xrpc_admin"> > # 127.0.0.1;http://127.0.0.1;localhost;http://localhost > </bun> > <bun head="xrpc_open"> > # true > </bun> > <bun head="xrpc_options"> > # > </bun> > <bun head="xrpc_port"> > # 47901 > </bun> > <bun head="xrpc_trusted"> > # http://monetdb.cwi.nl;http://127.0.0.1;http://localhost;/net/jarl/export/sc… > </bun> > </XQueryResult> > > # 12:02:35 > > # 12:02:35 > Done. > # 12:02:35 > > > > --- NEW FILE: add_del_doc.prologue.src --- > $TSTSRCDIR/add_trusted.mil > > --- NEW FILE: add_del_doc.xq.in --- > (: > 1. add two xmark documents and show the results; > 2. delete the two added documents and show the results. > > Test the following admin functions: > - adm:collections() > - adm:documents() > - adm:documents($collections) > - adm:add-doc() > - adm:del-col() > - adm:del-doc() > :) > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > (execute at {"$HOST:$XRPCPORT"} > {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", > "xmark1.xml", "xmark", 10)}, > execute at {"$HOST:$XRPCPORT"} > {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", > "xmark2.xml", "xmark", 10)} > ) > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > (<collections-after-add>{ > execute at {"$HOST:$XRPCPORT"} {adm:collections()} > }</collections-after-add>, > <documents-after-add>{ > let $docs := execute at {"$HOST:$XRPCPORT"} {adm:documents()} > return > for $d in $docs > return element document { > attribute updatable {$d/@updatable}, > attribute collection {$d/@collection}, > $d/text() } > }</documents-after-add>, > <documents-of-collection-after-add>{ > let $docs := execute at {"$HOST:$XRPCPORT"} {adm:documents("xmark")} > return > for $d in $docs > return element document { > attribute updatable {$d/@updatable}, > attribute collection {$d/@collection}, > $d/text() } > }</documents-of-collection-after-add> > ) > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > (<collections-after-del>{ > execute at {"$HOST:$XRPCPORT"} {adm:collections()} > }</collections-after-del>, > <documents-after-del>{ > let $docs := execute at {"$HOST:$XRPCPORT"} {adm:documents()} > return > for $d in $docs > return element document { > attribute updatable {$d/@updatable}, > attribute collection {$d/@collection}, > $d/text() } > }</documents-after-del>, > <documents-of-collection-after-del>{ > let $docs := execute at {"$HOST:$XRPCPORT"} {adm:documents("xmark")} > return > for $d in $docs > return element document { > attribute updatable {$d/@updatable}, > attribute collection {$d/@collection}, > $d/text() } > }</documents-of-collection-after-del> > ) > > > --- NEW FILE: add_del_doc.stable.err --- > stderr of test 'add_del_doc` in directory 'runtime/xrpc/admin` itself: > > > # 16:44:49 > > # 16:44:49 > Mserver "--config=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf" --debug=10 --set "monet_mod_path=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/lib:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/bin" --set "gdk_dbfarm=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm" --set "sql_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/sql_logs" --set "xquery_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=36099 --set xrpc_port=49971 --set monet_prompt= --trace "--dbname=mTests_runtime_xrpc_admin" "--dbinit= module(pathfinder);" add_del_doc.prologue ; echo ; echo Over.. > # 16:44:49 > > > > # 16:44:49 > > # 16:44:49 > mclient -lxquery -fxml -umonetdb -Pmonetdb --host=jarl --port=36099 add_del_doc.xq > # 16:44:49 > > > > # 16:44:50 > > # 16:44:50 > Done. > # 16:44:50 > > > > --- NEW FILE: db_stats.prologue.src --- > $TSTSRCDIR/add_trusted.mil > > --- NEW FILE: db_env.stable.err --- > stderr of test 'db_env` in directory 'runtime/xrpc/admin` itself: > > > # 11:50:19 > > # 11:50:19 > Mserver "--config=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf" --debug=10 --set "monet_mod_path=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/lib:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/bin" --set "gdk_dbfarm=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm" --set "sql_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/sql_logs" --set "xquery_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=36039 --set xrpc_port=47247 --set monet_prompt= --trace "--dbname=mTests_runtime_xrpc_admin" "--dbinit= module(pathfinder);" db_env.prologue ; echo ; echo Over.. > # 11:50:19 > > > > # 11:50:19 > > # 11:50:19 > mclient -lxquery -fxml -umonetdb -Pmonetdb --host=jarl --port=36039 db_env.xq > # 11:50:19 > > > > # 11:50:20 > > # 11:50:20 > Done. > # 11:50:20 > > > > --- NEW FILE: db_stats.stable.out --- > stdout of test 'db_stats` in directory 'runtime/xrpc/admin` itself: > > > # 11:06:16 > > # 11:06:16 > Mserver "--config=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf" --debug=10 --set "monet_mod_path=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/lib:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/bin" --set "gdk_dbfarm=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm" --set "sql_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/sql_logs" --set "xquery_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=36716 --set xrpc_port=46327 --set monet_prompt= --trace "--dbname=mTests_runtime_xrpc_admin" "--dbinit= module(pathfinder);" db_stats.prologue ; echo ; echo Over.. > # 11:06:16 > > > > > # MonetDB Server v4.24.1 > # based on GDK v1.24.1 > # Copyright (c) 1993-2008, CWI. All rights reserved. > # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs; dynamically linked. > # Visit http://monetdb.cwi.nl/ for further information. > # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah > # MonetDB/XQuery module v0.24.1 loaded (default back-end is 'milprint_summer') > # XRPC administrative console at http://127.0.0.1:46327/admin > > printf("\nReady.\n"); > > Ready. > quit(); > > Over.. > > # 11:06:16 > > # 11:06:16 > mclient -lxquery -fxml -umonetdb -Pmonetdb --host=jarl --port=36716 db_stats.xq > # 11:06:16 > > > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult> > <bun head="xquery_index_curMB"> > # 0 > </bun> > <bun head="xquery_cache_curdocs"> > # 0 > </bun> > <bun head="xquery_cache_curMB"> > # 0 > </bun> > <bun head="xquery_log_curMB"> > # 0 > </bun> > <bun head="gdk_vm_cursize"> > # 182517760 > </bun> > <bun head="gdk_mem_cursize"> > # 67584024 > </bun> > </XQueryResult> > > # 11:06:17 > > # 11:06:17 > Done. > # 11:06:17 > > > > --- NEW FILE: db_stats.xq.in --- > (: > Test the following admin functions: > - adm:db-stats() > Filter out uninteresting differences in the results > :) > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > for $stat in execute at {"$HOST:$XRPCPORT"} {adm:db-stats()} > return > (text { "
 " }, > element bun { > $stat/@head, > text { "
# " }, > string($stat/@tail), > text { "
 " } > }), > text { "
" } > > --- NEW FILE: backup_restore.stable.err --- > stderr of test 'backup_restore` in directory 'runtime/xrpc/admin` itself: > > > # 11:19:35 > > # 11:19:35 > Mserver "--config=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf" --debug=10 --set "monet_mod_path=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/lib:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/bin" --set "gdk_dbfarm=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm" --set "sql_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/sql_logs" --set "xquery_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=37835 --set xrpc_port=44669 --set monet_prompt= --trace "--dbname=mTests_runtime_xrpc_admin" "--dbinit= module(pathfinder);" backup_restore.prologue ; echo ; echo Over.. > # 11:19:35 > > > > # 11:19:36 > > # 11:19:36 > mclient -lxquery -fxml -umonetdb -Pmonetdb --host=jarl --port=37835 backup_restore.xq > # 11:19:36 > > > > # 11:19:37 > > # 11:19:37 > Done. > # 11:19:37 > > > > --- NEW FILE: db_env.prologue.src --- > $TSTSRCDIR/add_trusted.mil > > --- NEW FILE: add_trusted.mil --- > module("pathfinder"); > module("unix"); > > var TSTSRCDIR := getenv("TSTSRCDIR"); > var TSTTRGDIR := getenv("TSTTRGDIR"); > var HOST := getenv("HOST"); > var XRPCPORT := getenv("XRPCPORT"); > > add_xrpc_trusted(TSTSRCDIR); > add_xrpc_trusted(TSTTRGDIR); > add_xrpc_trusted("http://"+HOST+":"+XRPCPORT); > > commit(); > > > --- NEW FILE: add_del_doc.stable.out --- > stdout of test 'add_del_doc` in directory 'runtime/xrpc/admin` itself: > > > # 16:44:49 > > # 16:44:49 > Mserver "--config=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/etc/MonetDB.conf" --debug=10 --set "monet_mod_path=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/lib:/net/jarl/export/scratch0/zhang/monet-install/stable/debug/lib/MonetDB4/bin" --set "gdk_dbfarm=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/dbfarm" --set "sql_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/sql_logs" --set "xquery_logdir=/net/jarl/export/scratch0/zhang/monet-install/stable/debug/var/MonetDB4/xquery_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=36099 --set xrpc_port=49971 --set monet_prompt= --trace "--dbname=mTests_runtime_xrpc_admin" "--dbinit= module(pathfinder);" add_del_doc.prologue ; echo ; echo Over.. > # 16:44:49 > > > > > # MonetDB Server v4.24.0 > # based on GDK v1.24.1 > # Copyright (c) 1993-2008, CWI. All rights reserved. > # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs; dynamically linked. > # Visit http://monetdb.cwi.nl/ for further information. > # PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah > # MonetDB/XQuery module v0.24.1 loaded (default back-end is 'milprint_summer') > # XRPC administrative console at http://127.0.0.1:49971/admin > > printf("\nReady.\n"); > > Ready. > quit(); > > Over.. > > # 16:44:49 > > # 16:44:49 > mclient -lxquery -fxml -umonetdb -Pmonetdb --host=jarl --port=36099 add_del_doc.xq > # 16:44:49 > > > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult><collections-before-add/><documents-before-add/></XQueryResult> > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult><collections-after-add><collection updatable="true" size="511 KiB" numDocs="2">xmark</collection></collections-after-add><documents-after-add><document updatable="true" collection="xmark">xmark1.xml</document><document updatable="true" collection="xmark">xmark2.xml</document></documents-after-add><documents-of-collection-after-add><document updatable="true" collection="xmark">xmark1.xml</document><document updatable="true" collection="xmark">xmark2.xml</document></documents-of-collection-after-add></XQueryResult> > <?xml version="1.0" encoding="utf-8"?> > <XQueryResult><collections-after-del/><documents-after-del/><documents-of-collection-after-del/></XQueryResult> > > # 16:44:50 > > # 16:44:50 > Done. > # 16:44:50 > > > > --- NEW FILE: db_env.xq.in --- > (: > Test the following admin functions: > - adm:db-env() > Filter out uninteresting differences in the results > :) > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > for $env in execute at {"$HOST:$XRPCPORT"} {adm:db-env()} > return > (text { "
 " }, > element bun { > $env/@head, > text { "
# " }, > string($env/@tail), > text { "
 " } > }), > text { "
" } > > > --- NEW FILE: backup_restore.prologue.src --- > $TSTSRCDIR/add_trusted.mil > > --- NEW FILE: backup_restore.xq.in --- > (: > 1. show current documents in DB > 2. backup current DB > 3. delete all documents in DB > 4. restore backup > > Test the following admin functions: > - adm:add-doc() > - adm:documents() > - adm:backup() > - adm:backup-col() > - adm:del-col() > - adm:del-doc() > - adm:restore() > - adm:restore-col() > :) > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > (execute at {"$HOST:$XRPCPORT"} > {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", > "xmark1.xml", "xmark", 10)}, > execute at {"$HOST:$XRPCPORT"} > {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", > "xmark2.xml", "xmark", 10)} > ) > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > <db-before-backup>{ > let $docs := execute at {"$HOST:$XRPCPORT"} {adm:documents()} > return > for $d in $docs > return element document { > attribute updatable {$d/@updatable}, > attribute collection {$d/@collection}, > $d/text() } > }</db-before-backup> > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > execute at {"$HOST:$XRPCPORT"} {adm:backup("test")} > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > <db-after-del>{ > execute at {"$HOST:$XRPCPORT"} {adm:collections()} > }</db-after-del> > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > execute at {"$HOST:$XRPCPORT"} {adm:restore("test", 0)} > <> > import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" > at "http://$HOST:$XRPCPORT/admin/admin.xq"; > <db-after-restore>{ > let $docs := execute at {"$HOST:$XRPCPORT"} {adm:documents()} > return > for $d in $docs > return element document { > attribute updatable {$d/@updatable}, > attribute collection {$d/@collection}, > attribute uri {$d/@uri}, > $d/text() } > }</db-after-restore> > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_parser.mx, Nov2008, 1.296.2.1, 1.296.2.2
by Sjoerd Mullender 18 Nov '08

18 Nov '08

Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv6758/src/server > > Modified Files: > Tag: Nov2008 > sql_parser.mx > Log Message: > we don't have lng sizes in types > > > U sql_parser.mx > Index: sql_parser.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_parser.mx,v > retrieving revision 1.296.2.1 > retrieving revision 1.296.2.2 > diff -u -d -r1.296.2.1 -r1.296.2.2 > --- sql_parser.mx 17 Nov 2008 22:29:45 -0000 1.296.2.1 > +++ sql_parser.mx 18 Nov 2008 08:09:21 -0000 1.296.2.2 > @@ -4166,7 +4166,7 @@ > { > lng d = $3; ^^^ > if (d > 18) { > - char *msg = sql_message("decimal of " LLFMT " digits are not supported", d); > + char *msg = sql_message("decimal of %d digits are not supported", d); ^^ One change too many or one too few? > yyerror(msg); > _DELETE(msg); > $$.type = NULL; > @@ -4177,14 +4177,14 @@ > } > | sqlDECIMAL '(' nonzero ',' posint ')' > { > - lng d = $3; > - lng s = $5; > + int d = $3; > + int s = $5; > if (s >= d || s + d > 18) { > char *msg = NULL; > if (s >= d) > - msg = sql_message("scale (" LLFMT ") should be less than precision (" LLFMT ")", s, d); > + msg = sql_message("scale (%d) should be less than precision (%d)", s, d); > else > - msg = sql_message("decimal(" LLFMT ","LLFMT") isn't supported because P="LLFMT" + S="LLFMT" > 18", d, s, d, s); > + msg = sql_message("decimal(%d,%d) isn't supported because P=%d + S=%d > 18", d, s, d, s); > yyerror(msg); > _DELETE(msg); > $$.type = NULL; > @@ -4210,7 +4210,7 @@ > } > | sqlFLOAT '(' intval ',' intval ')' > { if ($5 >= $3) { > - char *msg = sql_message("precision(" LLFMT ") should be less than number of digits(" LLFMT ")", $5, $3); > + char *msg = sql_message("precision(%d) should be less than number of digits(%d)", $5, $3); > > yyerror(msg); > _DELETE(msg); > @@ -4241,7 +4241,7 @@ > { sql_find_subtype(&$$, $1, $3, 0); } > | type_alias '(' intval ',' intval ')' > { if ($5 >= $3) { > - char *msg = sql_message("precision(" LLFMT ") should be less than number of digits(" LLFMT ")", $5, $3); > + char *msg = sql_message("precision(%d) should be less than number of digits(%d)", $5, $3); > > yyerror(msg); > _DELETE(msg); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- Sjoerd Mullender

1 0

[Monetdb-developers] trace in SQL....
by Romulo Goncalves 17 Nov '08

17 Nov '08

If I use the latest stable version of M5-SQL and I trace a query I can't see the execution time for each MAL instruction. What I get now is the same output as the one output by the explain plus the mal code ends with #end s0_1; # mdb.setTrace(false); Was it a decision or a mistake done during the implementation of the new logging tool called History? Romulo

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/storage store.mx, Nov2008, 1.22.2.1, 1.22.2.2
by Sjoerd Mullender 14 Nov '08

14 Nov '08

Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/storage > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25673 > > Modified Files: > Tag: Nov2008 > store.mx > Log Message: > I got the single thing.... > Sorry the mistake... This is exactly what I mean with being *very* conservative and being *absolutely* sure. This error makes me very unhappy. > > U store.mx > Index: store.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/storage/store.mx,v > retrieving revision 1.22.2.1 > retrieving revision 1.22.2.2 > diff -u -d -r1.22.2.1 -r1.22.2.2 > --- store.mx 14 Nov 2008 13:46:52 -0000 1.22.2.1 > +++ store.mx 14 Nov 2008 14:04:09 -0000 1.22.2.2 > @@ -110,7 +110,7 @@ > } > list_destroy(k->columns); > base_destroy(&k->base); > - if ((k->type == pkey) && (k->t->pkey = (sql_ukey *) k)) > + if ((k->type == pkey) && (k->t->pkey == (sql_ukey *) k)) > k->t->pkey = NULL; > _DELETE(k); > } > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/storage store.mx, Nov2008, 1.22, 1.22.2.1
by Sjoerd Mullender 14 Nov '08

14 Nov '08

Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/storage > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv24421 > > Modified Files: > Tag: Nov2008 > store.mx > Log Message: > Set the pkey from the table structure to NULL to avoid garbage when we are checking if the table > already contain a specific pkey... > > > U store.mx > Index: store.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/storage/store.mx,v > retrieving revision 1.22 > retrieving revision 1.22.2.1 > diff -u -d -r1.22 -r1.22.2.1 > --- store.mx 30 Oct 2008 08:48:54 -0000 1.22 > +++ store.mx 14 Nov 2008 13:46:52 -0000 1.22.2.1 > @@ -110,6 +110,8 @@ > } > list_destroy(k->columns); > base_destroy(&k->base); > + if ((k->type == pkey) && (k->t->pkey = (sql_ukey *) k)) Do you really mean a single = here? ^ > + k->t->pkey = NULL; > _DELETE(k); > } > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins -- Sjoerd Mullender

2 2

[Monetdb-developers] closing the stable branch
by Sjoerd Mullender 14 Nov '08

14 Nov '08

I am closing the stable branch for further checkins. We need to converge to a release. Today I will only still accept fixes that make that things compile on all platforms. I do not want anything that could possibly break tonight's compilation or testing. Note, this is only for the Nov2008 stable branch. -- Sjoerd Mullender

2 4

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/tests/BugTracker/Tests All, , 1.119, 1.120
by Lefteris 14 Nov '08

14 Nov '08

I jsut runned the fn_collection_after_delete.SF-2141000 test and did not produced any errors. I was not aware that it was disabled. lefteris On Fri, Nov 14, 2008 at 12:53 PM, Stefan Manegold <stmane(a)users.sourceforge.net> wrote: > Update of /cvsroot/monetdb/pathfinder/tests/BugTracker/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv18290/pathfinder/tests/BugTracker/Tests > > Modified Files: > All > Log Message: > > Since Lefteris implemented fn:collection() (also) for the Algebra back-end, > we can re-enable the fn_collection_after_delete.SF-2141000 test (also) for the Algebra back-end. > > Wrapped changes in Lefteris's "fn_collection_before" & "fn_collection_after" tags. > > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/tests/BugTracker/Tests/All,v > retrieving revision 1.119 > retrieving revision 1.120 > diff -u -d -r1.119 -r1.120 > --- All 15 Oct 2008 10:32:18 -0000 1.119 > +++ All 14 Nov 2008 11:53:03 -0000 1.120 > @@ -164,7 +164,7 @@ > duplicates_error.SF-2142522 > order_by.SF-2140992 > combination_of_constructed_and_doc_elements.SF-2059394 > -NOT_ALGEBRA?fn_collection_after_delete.SF-2141000 > +fn_collection_after_delete.SF-2141000 > XML_attribute_generation.SF-2038906-unpack_doc > XML_attribute_generation.SF-2038906 > empty_file.SF-2017862 > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins >

1 0

[Monetdb-developers] Transactions
by Eric M. Hielscher 13 Nov '08

13 Nov '08

Hi all, My name is Eric Hielscher, and I'm a PhD student working on a database project. The goal will be to replace the transaction processing subsystem of a dbms, and I've decided to use MonetDB. I've yet to really look much at the source. If anyone has the time, I'd appreciate some tips about where to look for: - The transaction processing code - The scheduling of transaction execution This is of course something I could do on my own, but would be more efficient if someone with expert knowledge could just quickly walk me through things. Thanks in advance, -- Eric Hielscher

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime/xrpc/admin admin.xq, , 1.10, 1.11 xrpcwebclient.js, , 1.12, 1.13
by Ying Zhang 12 Nov '08

12 Nov '08

On Fri, Oct 31, 2008 at 03:26:46PM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/pathfinder/runtime/xrpc/admin > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv25251/runtime/xrpc/admin > > Modified Files: > admin.xq xrpcwebclient.js > Log Message: > Fixed administration console: > > - Reverted back the merge from the xrpcdemo branch since it did not > work at all: the function XRPC was called with too few parameters, > and the callback function was never called. Hi Sjoerd, Thanks for trying fix the admin gui. However, simply revert the changes does not seem to help to improve the situation, i.e., executing an admin function just returns error. Since the JS script before the merge is out-dated, I would prefer to fix things based on the latest version. Hence, is it ok if I undo your reverting of xrpcwebclient.js, while keeping your bonus (see below)? Jennie > - Reintroduced the logger_base variable in pf_logmanager since it is > used by the statistics call. > - Added a CATCH in the statistics implementation so that the lock is > freed even if an error occurs. > - If there are no documents, the sum() in the statistics > implementation returns nil which causes serialization of the answer > to fail. > > As a bonus, replaced the non-ASCII characters in xrpcwebclient.js with > octal escapes so that the file can also be viewed in a UTF-8 > environment. > > > U admin.xq > Index: admin.xq > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/admin.xq,v > retrieving revision 1.10 > retrieving revision 1.11 > diff -u -d -r1.10 -r1.11 > --- admin.xq 6 Jul 2008 11:20:06 -0000 1.10 > +++ admin.xq 31 Oct 2008 15:26:44 -0000 1.11 > @@ -86,7 +86,7 @@ > (: =================== server management =================== :) > > declare function admin:db-stats() > -{ pf:mil('lock_set(pf_short); var ret := bat(str,str); var tot := 0LL; colname_runtime@batloop() tot :+= sum([batsize]($t)); ret.insert("xquery_index_curMB", str(tot/1048576LL)); tot := doc_timestamp.select(timestamp_nil,timestamp_nil).reverse(); ret.insert("xquery_cache_curdocs", str(count(tot))); tot := tot.join(doc_collection).tunique().reverse().join(collection_size).sum(); ret.insert("xquery_cache_curMB", str(tot/1048576LL)); ret.insert("xquery_log_curMB", str((logger_changes(pf_logger) - logger_base)/131072)); ret.insert("gdk_vm_cursize", str(vm_cursize())); ret.insert("gdk_mem_cursize", str(mem_cursize())); lock_unset(pf_short); return ret;') }; > +{ pf:mil('var ret; var err := CATCH({ lock_set(pf_short); ret := bat(str,str); var tot := 0LL; colname_runtime@batloop() tot :+= sum([batsize]($t)); ret.insert("xquery_index_curMB", str(tot/1048576LL)); tot := doc_timestamp.select(timestamp_nil,timestamp_nil).reverse(); ret.insert("xquery_cache_curdocs", str(count(tot))); tot := tot.join(doc_collection).tunique().reverse().join(collection_size).sum(); if (isnil(tot)) tot := 0LL; ret.insert("xquery_cache_curMB", str(tot/1048576LL)); ret.insert("xquery_log_curMB", str((logger_changes(pf_logger) - logger_base)/131072)); ret.insert("gdk_vm_cursize", str(vm_cursize())); ret.insert("gdk_mem_cursize", str(mem_cursize())); }); lock_unset(pf_short); if (not(isnil(err))) ERROR(err); return ret;') }; > > declare function admin:db-env() > { pf:mil('var dels := new(void, str, 20).append("exec_prefix").append("prefix").append("gdk_debug").append("gdk_embedded").append("gdk_vm_minsize").append("mapi_debug").append("mapi_noheaders").append("monet_daemon").append("monet_mod_path").append("monet_pid").append("monet_prompt").append("monet_welcome").append("sql_debug").append("sql_logdir").reverse(); return monet_environment.kdiff(dels).access(BAT_WRITE).insert("gdk_mem_maxsize", str(mem_maxsize())).sort();') }; > > U xrpcwebclient.js > Index: xrpcwebclient.js > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/xrpcwebclient.js,v > retrieving revision 1.12 > retrieving revision 1.13 > diff -u -d -r1.12 -r1.13 > --- xrpcwebclient.js 3 Jul 2008 15:10:37 -0000 1.12 > +++ xrpcwebclient.js 31 Oct 2008 15:26:44 -0000 1.13 > @@ -4,28 +4,18 @@ > moduleurl, /* module (physical) at-hint URL. Module file must be here! */ > method, /* method name (matches function name in module) */ > arity, /* arity of the method */ > - updating, /* whether the function is an updating function */ > call, /* one or more XRPC_CALL() parameter specs (concatenated strings) */ > - callback, /* callback function to call with the XML response */ > - timeout, /* timeout value, when > 0 repeatable isolation level is presumed */ > - mode) /* (none | repeatable) [-iterative][-trace] */ > -{ > - clnt.sendReceive(posturl, method, XRPC_REQUEST(module,moduleurl,method,arity,updating,call,timeout,mode), callback); > -} > - > -function XRPC_PART(geturl, /* Your XRPC server. Usually: "http://yourhost:yourport/xrpc" */ > callback) /* callback function to call with the XML response */ > { > - clntPart.sendReceivePart(geturl, callback); > + clnt.sendReceive(posturl, method, XRPC_REQUEST(module,moduleurl,method,arity,call), callback); > } > > /********************************************************************** > functions to construct valid XRPC soap requests > ***********************************************************************/ > > -function XRPC_REQUEST(module, moduleurl, method, arity, updating, body, timeout, mode) > -{ > - return '<?xml version="1.0" encoding="utf-8"?>\n' + > +function XRPC_REQUEST(module, moduleurl, method, arity, body) { > + var r = '<?xml version="1.0" encoding="utf-8"?>\n' + > '<env:Envelope ' + > 'xmlns:env="http://www.w3.org/2003/05/soap-envelope" ' + > 'xmlns:xrpc="http://monetdb.cwi.nl/XQuery" ' + > @@ -36,11 +26,10 @@ > '<xrpc:request xrpc:module="' + module + '" ' + > 'xrpc:location="' + moduleurl + '" ' + > 'xrpc:method="' + method + '" ' + > - 'xrpc:mode="' + mode + '" ' + > - 'xrpc:updCall="' + (updating?"true":"false") + '" ' + > 'xrpc:arity="' + arity + '">' + > body > + '</xrpc:request></env:Body></env:Envelope>'; > + return r; > } > > /* a body consists of one or more calls */ > @@ -83,25 +72,6 @@ > } > } > > -function string2XML(text) { > - try //Internet Explorer > - { > - xmlDoc=new ActiveXObject("Microsoft.XMLDOM"); > - xmlDoc.async="false"; > - xmlDoc.loadXML(text); > - } > - catch(e) > - { > - try //Firefox, Mozilla, Opera, etc. > - { > - parser=new DOMParser(); > - xmlDoc=parser.parseFromString(text,"text/xml"); > - } > - catch(e) {alert(e.message)} > - } > - return xmlDoc; > -} > - > function getnodesXRPC(node,tagname) { > try { > return node.getElementsByTagNameNS("http://monetdb.cwi.nl/XQuery",tagname); > @@ -122,75 +92,21 @@ > } > } > > -XRPCWebClientPart = function () { > - if (window.XMLHttpRequest) { > - this.xmlhttp = new XMLHttpRequest(); > - } else if (window.ActiveXObject) { > - try { > - this.xmlhttp = new ActiveXObject("Msxml2.XMLHTTP"); > - } catch(e) { > - this.xmlhttp = new ActiveXObject("Microsoft.XMLHTTP"); > - } > - } > -} > - > XRPCWebClient.prototype.sendReceive = function(posturl, method, request, callback) { > try { > - this.xmlhttp.open("POST", posturl, true); > - //alert(request); > - if (XRPCDEBUG && method != 'getdoc') { > - //document.getElementById("messreq").value = request; > - messreqChanged(string2XML(request)); > - } > - this.xmlhttp.send(request); > - var app = this; > - > - this.xmlhttp.onreadystatechange = function() { > - if (app.xmlhttp.readyState == 4 ) { > - if (app.xmlhttp.status == 200 && > - app.xmlhttp.responseText.indexOf("!ERROR") < 0 && > - app.xmlhttp.responseText.indexOf("<env:Fault>") < 0) > - { > - if (XRPCDEBUG) { > - if (app.xmlhttp.responseText) { > - > - > - if(method != 'getdoc') messresChanged(app.xmlhttp.responseXML? app.xmlhttp.responseXML: string2XML(app.xmlhttp.responseText)); > - callback(app.xmlhttp.responseXML? app.xmlhttp.responseXML: string2XML(app.xmlhttp.responseText)); > - } > - } > - } else { > - var errmsg = > - '!ERROR: "' + method + ' execution failed at the remote side"\n\n' + > - '!ERROR: HTTP/1.1 ' + app.xmlhttp.status + '\n' + > - '!ERROR: HTTP Response:\n\n\t' + app.xmlhttp.responseText; > - alert(errmsg); > - return null; > - } > - } > - }; > - } catch (e) { > - alert('sendRequest('+posturl,','+method+'): '+e); > - } > -} > + this.xmlhttp.open("POST", posturl, true); > + if (XRPCDEBUG) alert(request); > + this.xmlhttp.send(request); > > -XRPCWebClientPart.prototype.sendReceivePart = function(geturl, callback) { > - try { > - //alert("get " + geturl); > - this.xmlhttp.open("GET", geturl, true); > - this.xmlhttp.send(""); > var app = this; > - > - this.xmlhttp.onreadystatechange = function() { > + this.xmlhttp.onreadystatechange = function() { > if (app.xmlhttp.readyState == 4 ) { > if (app.xmlhttp.status == 200 && > app.xmlhttp.responseText.indexOf("!ERROR") < 0 && > app.xmlhttp.responseText.indexOf("<env:Fault>") < 0) > { > - if (XRPCDEBUG) { > - if (app.xmlhttp.responseText) > - callback(app.xmlhttp.responseXML? app.xmlhttp.responseXML: string2XML(app.xmlhttp.responseText)); > - } > + if (XRPCDEBUG) alert(serializeXML(app.xmlhttp.responseXML)); > + callback(app.xmlhttp.responseXML); > } else { > var errmsg = > '!ERROR: "' + method + ' execution failed at the remote side"\n\n' + > @@ -202,7 +118,7 @@ > } > }; > } catch (e) { > - alert('sendRequest('+geturl+'): '+e); > + alert('sendRequest('+method+'): '+e); > } > } > > @@ -222,15 +138,15 @@ > '\\030', '\\031', '\\032', '\\033', '\\034', '\\035', '\\036', '\\037'); > > > - var chars = new Array ('&','�','�','�','�','�','�','�','�','�','�', > - '�','�','�','�','�','�','�','�','�','�','�', > - '�','�','�','�','�','�','�','�','�','�','�', > - '�','�','�','�','�','�','�','�','�','�','�', > - '�','�','�','�','�','�','�','�','�','�','�', > - '�','�','�','�','�','�','�','�','\"','�','<', > - '>','�','�','�','�','�','�','�','�','�','�', > - '�','�','�','�','�','�','�','�','�','�','�', > - '�','�','�','�','�','�','�','�'); > + var chars = new Array ('&','\340','\341','\342','\343','\344','\345','\346','\347','\350','\351', > + '\352','\353','\354','\355','\356','\357','\360','\361','\362','\363','\364', > + '\365','\366','\370','\371','\372','\373','\374','\375','\376','\377','\300', > + '\301','\302','\303','\304','\305','\306','\307','\310','\311','\312','\313', > + '\314','\315','\316','\317','\320','\321','\322','\323','\324','\325','\326', > + '\330','\331','\332','\333','\334','\335','\336','\200','\"','\337','<', > + '>','\242','\243','\244','\245','\246','\247','\250','\251','\252','\253', > + '\254','\255','\256','\257','\260','\261','\262','\263','\264','\265','\266', > + '\267','\270','\271','\272','\273','\274','\275','\276'); > > var entities = new Array ('amp','agrave','aacute','acirc','atilde','auml','aring', > 'aelig','ccedil','egrave','eacute','ecirc','euml','igrave', > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins

2 1

[Monetdb-developers] Mtest: remove M5 warning about modules
by Fabian Groffen 11 Nov '08

11 Nov '08

Currently Mtest.py spits out the following warning when using M5: Mtest.py Warning: MonetDB/5: Check, whether required modules do exist, is not possible, yet! It's in there for years. I think the functionality of Mtest to be able to check whether required modules are available before running a test come at the price of administering which modules are necessary to run the test. Implementing the module check in M5 hence would also mean adding the required module information to each test. Hence, I would suggest to remove the warning from Mtest.py and just deal with the error messages that appear when modules don't exist. Opinions?

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_env.mx, Nov2008, 1.74, 1.74.2.1
by Martin Kersten 05 Nov '08

05 Nov '08

It will change again ;) see in my local dir Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17857/src/server > > Modified Files: > Tag: Nov2008 > sql_env.mx > Log Message: > keepCall now has 12 arguments > > > U sql_env.mx > Index: sql_env.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_env.mx,v > retrieving revision 1.74 > retrieving revision 1.74.2.1 > diff -u -d -r1.74 -r1.74.2.1 > --- sql_env.mx 4 Nov 2008 11:38:16 -0000 1.74 > +++ sql_env.mx 5 Nov 2008 21:16:00 -0000 1.74.2.1 > @@ -114,7 +114,7 @@ > sgn = stack_get_number(m, "history"); > assert((lng) GDK_int_min <= sgn && sgn <= (lng) GDK_int_max); > if (!sql_find_func(sys, "keepquery", 4) || > - !sql_find_func(sys, "keepcall", 6)) > + !sql_find_func(sys, "keepcall", 12)) > return sql_message( "Cannot activate history because the keepQuery and keepCall procedures are not available\n" ); > m->history = (int) (sgn)?1:0; > } > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins >

1 0

[Monetdb-developers] Release schedule
by Sjoerd Mullender 04 Nov '08

04 Nov '08

Today we decided that we want to try to do releases more often and more regularly. I have been appointed release manager for all upcoming releases. I propose that we keep to the following schedule: - Do a major (feature) release once every 4 months. - Do a minor (bug fix) release once every month inbetween the major releases. This should solve the problem that we get bug reports for problems in the release for bugs that were already fixed months ago but not yet released. In the worst case the submitter has to wait a month for the fix, but usually of course much less than that. It also solves the problem that developers always want to add just one more feature to the next release and thereby forcing the release to be postponed. If a feature doesn't make it in a release, it will be released in four months time. If users (and developers) had to wait years for this feature, they can wait a little longer. I also propose to create a new stable branch right after releasing the last of the bug fix releases in a cycle. This gives us one month to stabilize and test a new release. This plan is effective as of now. -- Sjoerd Mullender

4 7

[Monetdb-developers] New stable branch created
by Sjoerd Mullender 04 Nov '08

04 Nov '08

I have created new stable branches for the upcoming release. From now on *all* bug fixes and *only* bug fixes *must* go to this new stable branch. I reserve the right to undo any changes that do not comply with this rule. Unlike previous stable branches, this time all packages use the same name for the branch: Nov2008. So in each of your stable checkout directories you can do cvs update -rNov2008 to update to the new branch. I have created branches for the following packages: MonetDB MonetDB4 MonetDB5 TestTools buildtools clients geom pathfinder sql template. Note that java and datacell are missing from this list. Java has its own release schedule, and datacell is not yet released and will not be released in this round. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql_gencode.mx, , 1.291, 1.292
by Stefan Manegold 04 Nov '08

04 Nov '08

What about solving the actual problem and fixing the code properly instead of just curing/patching symptoms? In MonetDB type long is not supposed to be used at all as it is not portable. What is wrong with using the standard MonetDB type system? E.g., ======== $ cvs diff MonetDB5/src/mal/mal_builder.mx sql/src/backends/monet5/sql_gencode.mx Index: MonetDB5/src/mal/mal_builder.mx =================================================================== RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_builder.mx,v retrieving revision 1.36 diff -u -r1.36 mal_builder.mx --- MonetDB5/src/mal/mal_builder.mx 30 Oct 2008 07:28:42 -0000 1.36 +++ MonetDB5/src/mal/mal_builder.mx 4 Nov 2008 07:33:47 -0000 @@ -47,7 +47,7 @@ mal_export InstrPtr pushChr(MalBlkPtr mb, InstrPtr q, char val); mal_export InstrPtr pushOid(MalBlkPtr mb, InstrPtr q, oid val); mal_export InstrPtr pushVoid(MalBlkPtr mb, InstrPtr q); -mal_export InstrPtr pushLng(MalBlkPtr mb, InstrPtr q, long val); +mal_export InstrPtr pushLng(MalBlkPtr mb, InstrPtr q, lng val); mal_export InstrPtr pushDbl(MalBlkPtr mb, InstrPtr q, double val); mal_export InstrPtr pushFlt(MalBlkPtr mb, InstrPtr q, float val); mal_export InstrPtr pushStr(MalBlkPtr mb, InstrPtr q, const char *val); @@ -232,7 +232,7 @@ } InstrPtr -pushLng(MalBlkPtr mb, InstrPtr q, long val) +pushLng(MalBlkPtr mb, InstrPtr q, lng val) { int _t; ValRecord cst; Index: sql/src/backends/monet5/sql_gencode.mx =================================================================== RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql_gencode.mx,v retrieving revision 1.292 diff -u -r1.292 sql_gencode.mx --- sql/src/backends/monet5/sql_gencode.mx 4 Nov 2008 06:55:24 -0000 1.292 +++ sql/src/backends/monet5/sql_gencode.mx 4 Nov 2008 07:33:47 -0000 @@ -1929,8 +1929,8 @@ q = newStmt(mb,sqlRef,"keepquery"); q= pushInt(mb,q,c->history); q= pushStr(mb,q,t); - q= pushLng(mb,q, (long) (GDKusec() - be->mvc->Tparse) ); - q= pushLng(mb,q, (long) GDKusec()); + q= pushLng(mb,q, GDKusec() - be->mvc->Tparse); + q= pushLng(mb,q, GDKusec()); c->Tparse = 0; } ======== or even better ======== $ cvs diff MonetDB5/src/mal/mal_builder.mx sql/src/backends/monet5/sql_gencode.mx Index: MonetDB5/src/mal/mal_builder.mx =================================================================== RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_builder.mx,v retrieving revision 1.36 diff -u -r1.36 mal_builder.mx --- MonetDB5/src/mal/mal_builder.mx 30 Oct 2008 07:28:42 -0000 1.36 +++ MonetDB5/src/mal/mal_builder.mx 4 Nov 2008 07:35:53 -0000 @@ -44,14 +44,14 @@ mal_export InstrPtr pushInt(MalBlkPtr mb, InstrPtr q, int val); mal_export InstrPtr pushWrd(MalBlkPtr mb, InstrPtr q, wrd val); mal_export InstrPtr pushBte(MalBlkPtr mb, InstrPtr q, bte val); -mal_export InstrPtr pushChr(MalBlkPtr mb, InstrPtr q, char val); +mal_export InstrPtr pushChr(MalBlkPtr mb, InstrPtr q, chr val); mal_export InstrPtr pushOid(MalBlkPtr mb, InstrPtr q, oid val); mal_export InstrPtr pushVoid(MalBlkPtr mb, InstrPtr q); -mal_export InstrPtr pushLng(MalBlkPtr mb, InstrPtr q, long val); -mal_export InstrPtr pushDbl(MalBlkPtr mb, InstrPtr q, double val); -mal_export InstrPtr pushFlt(MalBlkPtr mb, InstrPtr q, float val); +mal_export InstrPtr pushLng(MalBlkPtr mb, InstrPtr q, lng val); +mal_export InstrPtr pushDbl(MalBlkPtr mb, InstrPtr q, dbl val); +mal_export InstrPtr pushFlt(MalBlkPtr mb, InstrPtr q, flt val); mal_export InstrPtr pushStr(MalBlkPtr mb, InstrPtr q, const char *val); -mal_export InstrPtr pushBit(MalBlkPtr mb, InstrPtr q, int val); +mal_export InstrPtr pushBit(MalBlkPtr mb, InstrPtr q, bit val); mal_export InstrPtr pushNil(MalBlkPtr mb, InstrPtr q, int tpe); mal_export InstrPtr pushNilType(MalBlkPtr mb, InstrPtr q, char *tpe); mal_export InstrPtr pushZero(MalBlkPtr mb, InstrPtr q, int tpe); @@ -193,7 +193,7 @@ } InstrPtr -pushChr(MalBlkPtr mb, InstrPtr q, char val) +pushChr(MalBlkPtr mb, InstrPtr q, chr val) { int _t; ValRecord cst; @@ -232,7 +232,7 @@ } InstrPtr -pushLng(MalBlkPtr mb, InstrPtr q, long val) +pushLng(MalBlkPtr mb, InstrPtr q, lng val) { int _t; ValRecord cst; @@ -244,7 +244,7 @@ } InstrPtr -pushDbl(MalBlkPtr mb, InstrPtr q, double val) +pushDbl(MalBlkPtr mb, InstrPtr q, dbl val) { int _t; ValRecord cst; @@ -256,7 +256,7 @@ } InstrPtr -pushFlt(MalBlkPtr mb, InstrPtr q, float val) +pushFlt(MalBlkPtr mb, InstrPtr q, flt val) { ValRecord cst; @@ -281,7 +281,7 @@ } InstrPtr -pushBit(MalBlkPtr mb, InstrPtr q, int val) +pushBit(MalBlkPtr mb, InstrPtr q, bit val) { int _t; ValRecord cst; Index: sql/src/backends/monet5/sql_gencode.mx =================================================================== RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql_gencode.mx,v retrieving revision 1.292 diff -u -r1.292 sql_gencode.mx --- sql/src/backends/monet5/sql_gencode.mx 4 Nov 2008 06:55:24 -0000 1.292 +++ sql/src/backends/monet5/sql_gencode.mx 4 Nov 2008 07:35:53 -0000 @@ -1929,8 +1929,8 @@ q = newStmt(mb,sqlRef,"keepquery"); q= pushInt(mb,q,c->history); q= pushStr(mb,q,t); - q= pushLng(mb,q, (long) (GDKusec() - be->mvc->Tparse) ); - q= pushLng(mb,q, (long) GDKusec()); + q= pushLng(mb,q, GDKusec() - be->mvc->Tparse); + q= pushLng(mb,q, GDKusec()); c->Tparse = 0; } ======== Stefan On Tue, Nov 04, 2008 at 06:55:26AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5 > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13501 > > Modified Files: > sql_gencode.mx > Log Message: > Silence compiler > > > U sql_gencode.mx > Index: sql_gencode.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql_gencode.mx,v > retrieving revision 1.291 > retrieving revision 1.292 > diff -u -d -r1.291 -r1.292 > --- sql_gencode.mx 3 Nov 2008 15:32:04 -0000 1.291 > +++ sql_gencode.mx 4 Nov 2008 06:55:24 -0000 1.292 > @@ -1929,8 +1929,8 @@ > q = newStmt(mb,sqlRef,"keepquery"); > q= pushInt(mb,q,c->history); > q= pushStr(mb,q,t); > - q= pushLng(mb,q,GDKusec() - be->mvc->Tparse); > - q= pushLng(mb,q, GDKusec()); > + q= pushLng(mb,q, (long) (GDKusec() - be->mvc->Tparse) ); > + q= pushLng(mb,q, (long) GDKusec()); > c->Tparse = 0; > } > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB4/src/modules/contrib malalgebra.mx, MonetDB_4-24, 1.8.2.2, 1.8.2.3
by Sjoerd Mullender 03 Nov '08

03 Nov '08

Did you see what I had done on the head branch for this problem? On 2008-11-03 22:51, Stefan Manegold wrote: > Update of /cvsroot/monetdb/MonetDB4/src/modules/contrib > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv6583/MonetDB4/src/modules/contrib > > Modified Files: > Tag: MonetDB_4-24 > malalgebra.mx > Log Message: > > attempt to fix bug in Peter's new {band,left}mergejoin_limit() functions > that was reported by Riham: > > While {band,left}mergejoin_limit() internally use a limit of type size_t, > the MIL level uses type lng; hence, we need to properly convert the types > back and forth (and check for potential under-/overflows). > > (For now, I did not dare to change the MIL interface to use the more suitable > type wrd that (unlike lng) grows with system word size just like size_t.) > > Riham, > > could you please check, whether this fixes your problem? > Thanks! > > > > U malalgebra.mx > Index: malalgebra.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB4/src/modules/contrib/malalgebra.mx,v > retrieving revision 1.8.2.2 > retrieving revision 1.8.2.3 > diff -u -d -r1.8.2.2 -r1.8.2.3 > --- malalgebra.mx 28 Oct 2008 17:49:34 -0000 1.8.2.2 > +++ malalgebra.mx 3 Nov 2008 21:51:09 -0000 1.8.2.3 > @@ -263,28 +263,50 @@ > } > > int > -CMDbandmergejoin_limit(BAT **result, BAT *left, BAT *right, ptr minus, ptr plus, bit *li, bit *hi, lng* limit) > +CMDbandmergejoin_limit(BAT **result, BAT *left, BAT *right, ptr minus, ptr plus, bit *li, bit *hi, lng* _limit) > { > - size_t cutoff = *limit; > + lng limit = *_limit; > + size_t cutoff = (size_t) limit; > + assert(limit >= 0); > +#if SIZEOF_SIZE_T == SIZEOF_INT > + assert(limit <= GDK_int_max); > +#endif > *result = BATbandmergejoin_limit(left, right, minus, plus, *li, *hi, &cutoff); > if (*result) { > bat bid = (*result)->batCacheid; > *result = BATnew(TYPE_lng, TYPE_bat, 1); > - if (*result) BUNins(*result, &cutoff, &bid, FALSE); > + if (*result) { > +#if SIZEOF_SIZE_T == SIZEOF_LNG > + assert(cutoff <= (size_t) GDK_lng_max); > +#endif > + limit = (lng) cutoff; > + BUNins(*result, &limit, &bid, FALSE); > + } > BBPunfix(bid); > } > return (*result)?GDK_SUCCEED:GDK_FAIL; > } > > int > -CMDleftmergejoin_limit(BAT **result, BAT *left, BAT *right, lng* limit) > +CMDleftmergejoin_limit(BAT **result, BAT *left, BAT *right, lng* _limit) > { > - size_t cutoff = *limit; > + lng limit = *_limit; > + size_t cutoff = (size_t) limit; > + assert(limit >= 0); > +#if SIZEOF_SIZE_T == SIZEOF_INT > + assert(limit <= GDK_int_max); > +#endif > *result = BATleftmergejoin_limit(left, right, cutoff, &cutoff); > if (*result) { > bat bid = (*result)->batCacheid; > *result = BATnew(TYPE_lng, TYPE_bat, 1); > - if (*result) BUNins(*result, &cutoff, &bid, FALSE); > + if (*result) { > +#if SIZEOF_SIZE_T == SIZEOF_LNG > + assert(cutoff <= (size_t) GDK_lng_max); > +#endif > + limit = (lng) cutoff; > + BUNins(*result, &limit, &bid, FALSE); > + } > BBPunfix(bid); > } > return (*result)?GDK_SUCCEED:GDK_FAIL; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_history.mx, , 1.1, 1.2
by Romulo Goncalves 03 Nov '08

03 Nov '08

Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv32362 > > Modified Files: > opt_history.mx > Log Message: > Added the missing information. > > > U opt_history.mx > Index: opt_history.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_history.mx,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- opt_history.mx 3 Nov 2008 06:35:34 -0000 1.1 > +++ opt_history.mx 3 Nov 2008 12:36:44 -0000 1.2 > @@ -32,7 +32,7 @@ > time you use the history without initialization. > The keepcall can be used to check for initialization of the cache. > @mal > -module user; > +module sql; > function keepquery{unsafe}(qid:int,qry:str,parse:lng,optimize:lng):void; > raise SQLexception:= "SQL history script should be run first"; > end keepquery; > @@ -44,6 +44,10 @@ > function queryId{unsafe}(qid:int):void; > end queryId; > > +pattern forgetPrevious():void > +address OPTforgetPrevious > +comment "invalidate the previous instruction from future execution"; > + > pattern optimizer.history():str > address OPThistory; > pattern optimizer.history(mod:str, fcn:str):str > @@ -61,6 +65,7 @@ > #include "mal_instruction.h" > #include "mal_function.h" > > +opt_export str OPTforgetPrevious(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > /* #define _DEBUG_OPT_QUERYHISTORY_ trace its behavior */ > > @- > @@ -79,12 +84,23 @@ > @c > #include "opt_history.h" > > +str > +OPTforgetPrevious(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci){ > + int pc; > + (void) cntxt; > + (void) stk; > + pc= getPC(mb,pci); > + assert ( pc > 0 && pc < mb->stop); > + mb->stmt[pc-1]->token = REMsymbol; > + return MAL_SUCCEED; > +} > + > static int > OPThistoryImplementation(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > { > int i, limit,slimit; > InstrPtr p=0, *old= mb->stmt, q,r; > - int qid, argc, elaps, inblock, oublock, arg, ctime; > + int qid=0, argc, elaps, inblock, oublock, arg, ctime; > int returnseen=0; > > > @@ -97,6 +113,17 @@ > #else > (void) cntxt; > #endif > + if ( findSymbol(userRef,"keepQuery") == 0){ > + /* initialization script has not been ran */ > + return 0; > + } > + /* gather information and recast the call handel*/ > + for (i = 1; i < limit; i++) { Using limit here and... > + p= getInstrPtr(mb,i); > + if ( getModuleId(p)== sqlRef && idcmp(getFunctionId(p),"queryId")==0){ > + qid= getArg(p,1); > + } > + } > > limit= mb->stop; You initialize it here :S Romulo > slimit= mb->ssize; > @@ -109,6 +136,11 @@ > for (i = 1; i < limit; i++) { > p= old[i]; > > + if ( getModuleId(p)== sqlRef && idcmp(getFunctionId(p),"keepQuery")==0){ > + getModuleId(p) = userRef; > + pushInstruction(mb,p); > + q= newStmt(mb,sqlRef,"forgetPrevious"); > + } > if ( p->token== ENDsymbol || p->barrier == RETURNsymbol || p->barrier == YIELDsymbol){ > if (returnseen && p->token == ENDsymbol) { > pushInstruction(mb,p); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

[Monetdb-developers] mserver5 does not terminated
by Romulo Goncalves 03 Nov '08

03 Nov '08

If I start a mserver5 with a corrupted (old) dbfarm I get: # MonetDB server v5.7.0, based on kernel v1.25.0 # Serving database 'rdf_current', using 4 threads # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008- MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /scratch/romulo/build/MonetDB/current/optimized/MonetDB5//etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.25.0 loaded >!ERROR: Incompatible database version 040000, this server supports version 050000 !ERROR: Please move away /scratch/romulo/var/dblogs/rdf_current/sql/ and its corresponding dbfarm. !mvc_init: unable to create system tables > >\q Which is correct. However, I am only able to close (I should more say kill it) with kill -9 <mserver5_pid> I could open a bug, but it is not easy to create a test for this problem... Romulo

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_history.mx, , NONE, 1.1 Makefile.ag, , 1.62, 1.63 opt_prelude.mx, , 1.49, 1.50
by Romulo Goncalves 03 Nov '08

03 Nov '08

Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv21452 > > Modified Files: > Makefile.ag opt_prelude.mx > Added Files: > opt_history.mx > Log Message: > include the SQL history code optimizer > > > U opt_prelude.mx > --- NEW FILE: opt_history.mx --- ............... > > static int > OPThistoryImplementation(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > { > int i, limit,slimit; > InstrPtr p=0, *old= mb->stmt, q,r; > int qid, argc, elaps, inblock, oublock, arg, ctime; You need to initialize it before you use it.... qid = 0 ? Regards, Romulo > int returnseen=0; > > > (void) pci; > (void) stk; /* to fool compilers */ > > #ifdef _DEBUG_OPT_QUERYHISTORY_ > stream_printf(cntxt->fdout,"ENTERING TRACE CODE \n"); > printFunction(cntxt->fdout,mb,0,LIST_MAL_ALL); > #else > (void) cntxt; > #endif > > limit= mb->stop; > slimit= mb->ssize; > newMalBlkStmt(mb, mb->ssize+20); /* a new statement stack */ > > pushInstruction(mb, old[0]); > /* collect the statistics */ > @:initCounters@ > > for (i = 1; i < limit; i++) { > p= old[i]; > > if ( p->token== ENDsymbol || p->barrier == RETURNsymbol || p->barrier == YIELDsymbol){ > if (returnseen && p->token == ENDsymbol) { > pushInstruction(mb,p); > continue; > } > returnseen++; > q = newStmt(mb,"alarm","usec"); > setVarType(mb,getArg(q,0), TYPE_lng); > r = newStmt(mb,"calc","-"); > r = pushArgument(mb,r, getArg(q,0)); > r = pushArgument(mb,r, elaps); > elaps= getArg(r,0); > > q = newStmt(mb,"bbp","getDiskReads"); > setVarType(mb,getArg(q,0), TYPE_lng); > r = newStmt(mb,"calc","-"); > r = pushArgument(mb,r, getArg(q,0)); > r = pushArgument(mb,r, inblock); > inblock= getArg(r,0); > > q = newStmt(mb,"bbp","getDiskWrites"); > setVarType(mb,getArg(q,0), TYPE_lng); > r = newStmt(mb,"calc","-"); > r = pushArgument(mb,r, getArg(q,0)); > r = pushArgument(mb,r, oublock); > oublock= getArg(r,0); > > /* prepare the call to the history manager */ > q = newStmt(mb,"sql","argRecord"); > setVarType(mb,getArg(q,0), TYPE_str); > for ( argc=0; argc < old[0]->argc; argc++) > q = pushArgument(mb, q, getArg(old[0],argc)); > > arg= getArg(q,0); > > q = newStmt(mb,"user","keepcall"); > q = pushInt(mb, q, qid); /* query identifier */ > q = pushArgument(mb, q, ctime); /* arguments */ > q = pushArgument(mb, q, arg); /* arguments */ > q = pushArgument(mb, q, elaps); /* elaps */ > q = pushArgument(mb, q, inblock);/* inblock */ > q = pushArgument(mb, q, oublock);/* oublock */ > } > > pushInstruction(mb,p); > if (p->barrier == YIELDsymbol){ > /* the factory yield may return */ > @:initCounters@ > } > } > > #ifdef _DEBUG_OPT_QUERYHISTORY_ > stream_printf(cntxt->fdout,"LEAVING QUERYHISTORY CODE INJECTION\n"); > printFunction(cntxt->fdout,mb,LIST_MAL_ALL); > #endif > for( ; i<slimit; i++) > if(old[i]) > freeInstruction(old[i]); > GDKfree(old); > return 1; > } > @include optimizerWrapper.mx > @h > @:exportOptimizer(history)@ > #endif > @c > #include "opt_statistics.h" > @:wrapOptimizer(history,OPT_CHECK_ALL)@ > @} > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

[Monetdb-developers] communication problem between Mserver and mclient on OS X
by Jan Rittinger 31 Oct '08

31 Oct '08

Hi all, can you tell me what I need to change to make Mserver communicate with mclient on OS X. All I get is silence... $ Mserver --dbinit='module(pathfinder); mil_start();' # MonetDB Server v4.25.0 # based on GDK v1.25.0 # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-, MonetDB B.V.. All rights reserved. # Compiled for i686-apple-darwin9.5.0/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah # MonetDB/XQuery module v0.25.0 loaded (default back-end is 'algebra') # XRPC administrative console at http://127.0.0.1:50001/admin MonetDB> $ mclient -lx q01.xq ^C (after 2 minutes) $ mclient -lmil q01.mil ^C (after 2 minutes) Running the same query through Mserver directly completes in under a second. $ pf q01.xq > q01.mil $ Mserver q01.mil # MonetDB Server v4.25.0 # based on GDK v1.25.0 # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-, MonetDB B.V.. All rights reserved. # Compiled for i686-apple-darwin9.5.0/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah # MonetDB/XQuery module v0.25.0 loaded (default back-end is 'algebra') # XRPC administrative console at http://127.0.0.1:50001/admin <?xml version="1.0" encoding="utf-8"?> <XQueryResult>Ayonca Vijaykrishnan</XQueryResult> MonetDB> Thanks, Jan -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

2 4

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB4/src/modules/contrib malalgebra.mx, MonetDB_4-24, 1.8.2.1, 1.8.2.2
by Sjoerd Mullender 29 Oct '08

29 Oct '08

This type of change is not allowed on a stable branch. Changes of API are *not* allowed. Since we're going to abandon this stable branch soon, I'll let it pass. On 2008-10-28 18:49, Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB4/src/modules/contrib > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv901/src/modules/contrib > > Modified Files: > Tag: MonetDB_4-24 > malalgebra.mx > Log Message: > changes to minimize sampling overhead (mostly in XML text index) > > - introduce bandmergejoin(), and leftmergejoin()/bandmergejoin() with a cutoff > > > > U malalgebra.mx > Index: malalgebra.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB4/src/modules/contrib/malalgebra.mx,v > retrieving revision 1.8.2.1 > retrieving revision 1.8.2.2 > diff -u -d -r1.8.2.1 -r1.8.2.2 > --- malalgebra.mx 10 Oct 2008 08:42:22 -0000 1.8.2.1 > +++ malalgebra.mx 28 Oct 2008 17:49:34 -0000 1.8.2.2 > @@ -43,7 +43,6 @@ > @:leftjoin(fetch,\nCAUTION: positional matches are assumed not to be out-of-bounds!!)@ > @:leftjoin(merge)@ > @:leftjoin(hash)@ > - > .COMMAND leftthetajoin ( BAT[any::1,any::2] left, BAT[any::2,any::3] right, int mode) : > BAT[any::1,any::3] = CMDleftthetajoin; > "Hook directly into the 'leftthetajoin' implementation of the join. > @@ -58,6 +57,22 @@ > Also, for each left tuple, all matching right tuples will appear in their order > of appearrance in the right BAT. This property is handy for XQuery processing." > > + .COMMAND bandmergejoin ( BAT[any::1,any::2] outer, BAT[any::2,any::3] inner, > + any::2 minus, any::2 plus, bit l_in, bit h_in) : > + BAT[any::1,any::3] = CMDbandmergejoin; > + "The bandjoin algorithm, but forced to use (left) mergejoin rather than nested loop" > + > + .COMMAND bandmergejoin ( BAT[any::1,any::2] outer, BAT[any::2,any::3] inner, > + any::2 minus, any::2 plus, bit l_in, bit h_in, lng limit) : > + BAT[lng,BAT] = CMDbandmergejoin_limit; > + "A bandjoin that uses the merge algorithm and limits the result size. > + Result generation is cut off after this point and the > + result [lng,BAT] holds [estimated_full_resultsize,limited_result]" > + > + .COMMAND leftmergejoin ( BAT[any::1,any::2] left, BAT[any::2,any::3] right, lng limit) : > + BAT[lng,BAT] = CMDleftmergejoin_limit; > + "leftmergejoin, but limit the result (by cutting off result generation) > + return a BAT[lng,BAT] containing [full_result_estimate,limited_result]" > > @= select > .COMMAND ord_@1select ( BAT[any::1,any::2] b, any::2 low, any::2 high) : > @@ -119,6 +134,7 @@ > #ifndef __MALALGEBRA_H__ > #define __MALALGEBRA_H__ > #include "gdk.h" > +#include "gdk_rangejoin.h" > > /* nothing much */ > > @@ -240,6 +256,40 @@ > return (*result = BATnlthetajoin(l, r, *mode, (size_t) * estimate)) ? GDK_SUCCEED : GDK_FAIL; > } > > +int > +CMDbandmergejoin(BAT **result, BAT *left, BAT *right, ptr minus, ptr plus, bit *li, bit *hi) > +{ > + return (*result = BATbandmergejoin(left, right, minus, plus, *li, *hi)) ? GDK_SUCCEED : GDK_FAIL; > +} > + > +int > +CMDbandmergejoin_limit(BAT **result, BAT *left, BAT *right, ptr minus, ptr plus, bit *li, bit *hi, lng* limit) > +{ > + size_t cutoff = *limit; > + *result = BATbandmergejoin_limit(left, right, minus, plus, *li, *hi, &cutoff); > + if (*result) { > + bat bid = (*result)->batCacheid; > + *result = BATnew(TYPE_lng, TYPE_bat, 1); > + if (*result) BUNins(*result, &cutoff, &bid, FALSE); > + BBPunfix(bid); > + } > + return (*result)?GDK_SUCCEED:GDK_FAIL; > +} > + > +int > +CMDleftmergejoin_limit(BAT **result, BAT *left, BAT *right, lng* limit) > +{ > + size_t cutoff = *limit; > + *result = BATleftmergejoin_limit(left, right, cutoff, &cutoff); > + if (*result) { > + bat bid = (*result)->batCacheid; > + *result = BATnew(TYPE_lng, TYPE_bat, 1); > + if (*result) BUNins(*result, &cutoff, &bid, FALSE); > + BBPunfix(bid); > + } > + return (*result)?GDK_SUCCEED:GDK_FAIL; > +} > + > @= selectcmd > int CMDord_@1select1(BAT **result, BAT* b, ptr value) { > return (*result = BAT_select_(b, value, 0, TRUE, TRUE, @2, FALSE, TRUE))?GDK_SUCCEED:GDK_FAIL; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

4 11

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal bbp.mx, , 1.127, 1.128
by Stefan Manegold 27 Oct '08

27 Oct '08

On Mon, Oct 27, 2008 at 06:35:34AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv4663 > > Modified Files: > bbp.mx > Log Message: > Silence compilers > > > U bbp.mx > Index: bbp.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/bbp.mx,v > retrieving revision 1.127 > retrieving revision 1.128 > diff -u -d -r1.127 -r1.128 > --- bbp.mx 25 Oct 2008 22:08:09 -0000 1.127 > +++ bbp.mx 27 Oct 2008 06:35:32 -0000 1.128 > @@ -867,7 +867,7 @@ > int i; > char buf[MAXPATHLEN]; > char cwd[MAXPATHLEN]; > - getcwd(cwd, MAXPATHLEN); > + (void) getcwd(cwd, MAXPATHLEN); This is not "sufficient". With optimization enabled, gcc still (correctly) complains as follows: ======== gcc -DHAVE_CONFIG_H -I. -I../../.. -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal -I../atoms -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/../atoms -I../kernel -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/../kernel -I../../mal -I/ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/../../mal -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-optimize_--disable-debug_--disable-assert/include/MonetDB -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-optimize_--disable-debug_--disable-assert/include/MonetDB/mapilib -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-optimize_--disable-debug_--disable-assert/include/MonetDB -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-optimize_--disable-debug_--disable-assert/include/MonetDB/common -I/ufs/manegold/_/scratch0/Monet/Testing/Current/prefix.--enable-strict_--disable-optimize_--disable-debug_--disable-assert/include/MonetDB/gdk -I/usr/include/libxml2 -DLIBBBP -O2 -Wall -Wextra -std=c99 -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -D_REENTRANT -c bbp.c -fPIC -DPIC -o .libs/lib_bbp_la-bbp.o cc1: warnings being treated as errors /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/bbp.mx: In function 'CMDbbpLocation': /ufs/manegold/_/scratch0/Monet/Testing/Current/source/MonetDB5/src/modules/mal/bbp.mx:874: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result make[8]: *** [lib_bbp_la-bbp.lo] Error 1 ======== getcwd() can fail (e.g., incase the current directpry is not readable for the user; see `man getcwd` for details), and hence, the return value needs to be checked, and proper measures need to be taken in case getcwd() does fail (e.g., have default fall-back or trigger warning or error). Stefan > b = BATnew(TYPE_int, TYPE_str, BBPsize); > if (b == 0) > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_posix.mx, , 1.157, 1.158
by Stefan Manegold 25 Oct '08

25 Oct '08

On Sat, Oct 25, 2008 at 07:30:50AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30373 > > Modified Files: > gdk_posix.mx > Log Message: > The memory map table maintained for the vmtrim > should be aligned to the number of mapped files. > In more recent applications, such as the SkyServer > this may be around 2000 BATs easily. > For the time being the limit of 100 is increased to 4096 > > The remainder are additions of '#' in error messages > to prepare for problems in the API. just an idea (without background knowledge): shouldn't we introduce a new symbol/chracter in the protocol to indicate warnings and informative message? '!' indicates errors (obviously never to be ignored) '#' indicates (usually to be ignored) comments '?' to be added to indicate warnings (and "informative messages)? '?' to be added for ... ?? Stefan > > > > U gdk_posix.mx > Index: gdk_posix.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_posix.mx,v > retrieving revision 1.157 > retrieving revision 1.158 > diff -u -d -r1.157 -r1.158 > --- gdk_posix.mx 10 Oct 2008 08:50:35 -0000 1.157 > +++ gdk_posix.mx 25 Oct 2008 07:30:48 -0000 1.158 > @@ -389,7 +389,7 @@ > * hope the VM paging algorithm behaves better than Linux which just runs off > * the cliff and if MonetDB does not prevent RSS from being too high, enters coma. > * > - * We will only eb able to sensibly test this on Windows64. On Windows32, mmap sizes > + * We will only be able to sensibly test this on Windows64. On Windows32, mmap sizes > * do not significantly exceed RAM sizes so MonetDB swapping actually will not happen > * (of course, you've got this nasty problem of VM fragemntation and failing mmaps instead). > * > @@ -488,6 +488,10 @@ > * to the cursors (i.e. pointers to b->batBuns->free or the cursors > * in radix-cluster), which an enhanced version of this thread might > * take into account. > + * > + * [Kersten] The memory map table should be aligned to the number of > + * mapped files. In more recent applications, such as the SkyServer > + * this may be around 2000 BATs easily. > */ > > #ifdef HAVE_PTHREAD_H > @@ -519,7 +523,7 @@ > #endif > > #define MT_MMAP_TILE (1<<27) > -#define MT_MMAP_BUFSIZE 100 > +#define MT_MMAP_BUFSIZE 4096 > MT_mmap_t MT_mmap_tab[MT_MMAP_BUFSIZE]; > int MT_mmap_cur = -1, MT_mmap_first = -1, MT_mmap_free = 0; > > @@ -598,7 +602,7 @@ > if (MT_mmap_cur == -1) > MT_mmap_cur = i; > #ifdef MMAP_DEBUG > - stream_printf(GDKerr, "MT_mmap_new: %s fd=%d\n", path, fd); > + stream_printf(GDKerr, "#MT_mmap_new: %s fd=%d\n", path, fd); > #endif > strncpy(MT_mmap_tab[i].path, path, 128); > MT_mmap_tab[i].base = base; > @@ -642,13 +646,13 @@ > /* tell the OS quite clearly that you want to drop this */ > ret = posix_fadvise(MT_mmap_tab[victim].fd, 0LL, MT_mmap_tab[victim].len, POSIX_FADV_DONTNEED); > #ifdef MMAP_DEBUG > - stream_printf(GDKerr, "MT_mmap_del: posix_fadvise(%s,fd=%d,%uMB,POSIX_FADV_DONTNEED) = %d\n", MT_mmap_tab[victim].path, MT_mmap_tab[victim].fd, (unsigned int) (MT_mmap_tab[victim].len >> 20), ret); > + stream_printf(GDKerr, "#MT_mmap_del: posix_fadvise(%s,fd=%d,%uMB,POSIX_FADV_DONTNEED) = %d\n", MT_mmap_tab[victim].path, MT_mmap_tab[victim].fd, (unsigned int) (MT_mmap_tab[victim].len >> 20), ret); > #endif > } > #endif > ret = close(MT_mmap_tab[victim].fd); > #ifdef MMAP_DEBUG > - stream_printf(GDKerr, "MT_mmap_del: close(%s fd=%d) = %d\n", MT_mmap_tab[victim].path, MT_mmap_tab[victim].fd, ret); > + stream_printf(GDKerr, "#MT_mmap_del: close(%s fd=%d) = %d\n", MT_mmap_tab[victim].path, MT_mmap_tab[victim].fd, ret); > #endif > MT_mmap_tab[victim].next = MT_mmap_free; > MT_mmap_empty(victim); > @@ -674,7 +678,7 @@ > if (MT_mmap_tab[i].fd >= 0) { > ret = posix_fadvise(MT_mmap_tab[i].fd, 0, len, advice); > #ifdef MMAP_DEBUG > - stream_printf(GDKerr, "MT_fadvise: posix_fadvise(%s,fd=%d,%uMB,%d) = %d\n", MT_mmap_tab[i].path, MT_mmap_tab[i].fd, (unsigned int) (len >> 20), advice, ret); > + stream_printf(GDKerr, "#MT_fadvise: posix_fadvise(%s,fd=%d,%uMB,%d) = %d\n", MT_mmap_tab[i].path, MT_mmap_tab[i].fd, (unsigned int) (len >> 20), advice, ret); > #endif > } > } > @@ -697,7 +701,7 @@ > int ret = posix_madvise(MT_mmap_tab[i].base + off, MT_MMAP_TILE, POSIX_MADV_DONTNEED); > > if (err) { > - stream_printf(err, "MT_mmap_unload_tile: posix_madvise(%s,off=%uMB,%uMB,fd=%d,POSIX_MADV_DONTNEED) = %d\n", > + stream_printf(err, "#MT_mmap_unload_tile: posix_madvise(%s,off=%uMB,%uMB,fd=%d,POSIX_MADV_DONTNEED) = %d\n", > MT_mmap_tab[i].path, (unsigned int) (off >> 20), > (unsigned int) (MT_MMAP_TILE >> 20), MT_mmap_tab[i].fd, ret); > } > @@ -706,7 +710,7 @@ > /* tell the OS quite clearly that you want to drop this */ > ret = posix_fadvise(MT_mmap_tab[i].fd, off, MT_MMAP_TILE, POSIX_FADV_DONTNEED); > if (err) { > - stream_printf(err, "MT_mmap_unload_tile: posix_fadvise(%s,off=%uMB,%uMB,fd=%d,POSIX_MADV_DONTNEED) = %d\n", > + stream_printf(err, "#MT_mmap_unload_tile: posix_fadvise(%s,off=%uMB,%uMB,fd=%d,POSIX_MADV_DONTNEED) = %d\n", > MT_mmap_tab[i].path, (unsigned int) (off >> 20), > (unsigned int) (MT_MMAP_TILE >> 20), MT_mmap_tab[i].fd, ret); > } > @@ -721,7 +725,7 @@ > > /* save to disk an 128MB tile, and observe how long this takes */ > if (err) { > - stream_printf(err, "MT_mmap_save_tile: msync(%s,off=%uM,%u,SYNC)...\n", > + stream_printf(err, "#MT_mmap_save_tile: msync(%s,off=%uM,%u,SYNC)...\n", > MT_mmap_tab[i].path, (unsigned int) (tile >> 20), > (unsigned int) (MT_MMAP_TILE >> 20)); > } > @@ -729,7 +733,7 @@ > ret = MT_msync(MT_mmap_tab[i].base, tile, MT_MMAP_TILE, MMAP_SYNC); > t = GDKms() - t; > if (err) { > - stream_printf(err, "MT_mmap_save_tile: msync(%s,tile=%uM,%uM,SYNC) = %d (%dms)\n", > + stream_printf(err, "#MT_mmap_save_tile: msync(%s,tile=%uM,%uM,SYNC) = %d (%dms)\n", > MT_mmap_tab[i].path, (unsigned int) (tile >> 20), > (unsigned int) (MT_MMAP_TILE >> 20), ret, t); > } > @@ -768,7 +772,7 @@ > > (void) pthread_mutex_lock(&MT_mmap_lock); > if (err) { > - stream_printf(err, "MT_mmap_trim(%u MB): rss = %u MB\n", (unsigned int) ((target) >> 20), (unsigned int) (rss >> 20)); > + stream_printf(err, "#MT_mmap_trim(%u MB): rss = %u MB\n", (unsigned int) ((target) >> 20), (unsigned int) (rss >> 20)); > } > if (rss > target) { > /* try to selectively unload pages from the writable regions */ > @@ -1085,7 +1089,7 @@ > int ret = munmap(p, len); > > #ifdef MMAP_DEBUG > - stream_printf(GDKerr, "munmap(" LLFMT "," LLFMT ",%d) = %d\n", (long long) p, (long long) len, ret); > + stream_printf(GDKerr, "#munmap(" LLFMT "," LLFMT ",%d) = %d\n", (long long) p, (long long) len, ret); > #endif > MT_mmap_del(p, len); > return ret; > @@ -1097,7 +1101,7 @@ > int ret = msync(((char*) p)+off, len, (mode & MMAP_SYNC) ? MS_SYNC : ((mode & MMAP_ASYNC) ? MS_ASYNC : MS_INVALIDATE)); > > #ifdef MMAP_DEBUG > - stream_printf(GDKerr, "msync(" LLFMT "," LLFMT ",%s) = %d\n", (long long) p, (long long) len, (mode & MMAP_SYNC) ? "MS_SYNC" : ((mode & MMAP_ASYNC) ? "MS_ASYNC" : "MS_INVALIDATE"), ret); > + stream_printf(GDKerr, "#msync(" LLFMT "," LLFMT ",%s) = %d\n", (long long) p, (long long) len, (mode & MMAP_SYNC) ? "MS_SYNC" : ((mode & MMAP_ASYNC) ? "MS_ASYNC" : "MS_INVALIDATE"), ret); > #endif > if (ret < 0) > return errno; > @@ -1110,7 +1114,7 @@ > int ret = posix_madvise(p, len, advise); > > #ifdef MMAP_DEBUG > - stream_printf(GDKerr, "posix_madvise(" PTRFMT "," SZFMT ",%d) = %d\n", PTRFMTCAST p, len, advise, ret); > + stream_printf(GDKerr, "#posix_madvise(" PTRFMT "," SZFMT ",%d) = %d\n", PTRFMTCAST p, len, advise, ret); > #endif > if (MT_fadvise(p, len, advise)) > ret = -1; > @@ -1468,7 +1472,7 @@ > } > if (heapstatus == _HEAPBADPTR || heapstatus == _HEAPBADBEGIN || heapstatus == _HEAPBADNODE) { > > - stream_printf(GDKerr, "mallinfo(): heap is corrupt."); > + stream_printf(GDKerr, "#mallinfo(): heap is corrupt."); > } > _heapmin(); > return _ret; > @@ -1604,7 +1608,7 @@ > return; > > if (!FindClose(dir->find_file_handle)) > - stream_printf(GDKerr, "rewinddir(): FindClose() failed\n"); > + stream_printf(GDKerr, "#rewinddir(): FindClose() failed\n"); > > mask = malloc(strlen(dir->dir_name) + 3); > sprintf(mask, "%s\\*", dir->dir_name); > @@ -2116,7 +2120,7 @@ > p = (void *) VirtualAlloc(a, size, MEM_COMMIT | mode, PAGE_READWRITE); > (void) pthread_mutex_unlock(&MT_mmap_lock); > if (p == NULL) { > - stream_printf(GDKerr, "VirtualAlloc(" PTRFMT "," SZFMT ",MEM_COMMIT,PAGE_READWRITE): failed\n", PTRFMTCAST a, size); > + stream_printf(GDKerr, "#VirtualAlloc(" PTRFMT "," SZFMT ",MEM_COMMIT,PAGE_READWRITE): failed\n", PTRFMTCAST a, size); > } > return p; > } > @@ -2126,9 +2130,9 @@ > MT_vmfree(void *p, size_t size) > { > if (VirtualFree(p, size, MEM_DECOMMIT) == 0) > - stream_printf(GDKerr, "VirtualFree(" PTRFMT "," SZFMT ",MEM_DECOMMIT): failed\n", PTRFMTCAST p, size); > + stream_printf(GDKerr, "#VirtualFree(" PTRFMT "," SZFMT ",MEM_DECOMMIT): failed\n", PTRFMTCAST p, size); > if (VirtualFree(p, 0, MEM_RELEASE) == 0) > - stream_printf(GDKerr, "VirtualFree(" PTRFMT ",0,MEM_RELEASE): failed\n", PTRFMTCAST p); > + stream_printf(GDKerr, "#VirtualFree(" PTRFMT ",0,MEM_RELEASE): failed\n", PTRFMTCAST p); > } > > void * > @@ -2149,7 +2153,7 @@ > size_t ret = VirtualFree(p + newsize, oldsize - newsize, MEM_DECOMMIT); > > if (ret == 0) > - stream_printf(GDKerr, "VirtualFree(" PTRFMT "," SSZFMT ",MEM_DECOMMIT): failed\n", PTRFMTCAST(p + newsize), (ssize_t) (oldsize - newsize)); > + stream_printf(GDKerr, "#VirtualFree(" PTRFMT "," SSZFMT ",MEM_DECOMMIT): failed\n", PTRFMTCAST(p + newsize), (ssize_t) (oldsize - newsize)); > } else if (oldsize < newsize) { > (void) pthread_mutex_lock(&MT_mmap_lock); > a = (char *) VirtualAlloc(p, newsize, MEM_COMMIT, PAGE_READWRITE); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 2

[Monetdb-developers] slow query log
by Stefan de Konink 21 Oct '08

21 Oct '08

Is there currently a syntax to log every incoming SQL query to a file? I found options like: 1) ODBCDEBUG [1] 2) mapi_log(...) [2] But is there something easy to capture all incoming query with their timings; so a real slow queries log can be created? In the Skyserver presentation [3] I see 'Query log' analysis; I'm really interested in how this is realised. I would like to do an analysis on all queries Mapserver generates by its GDAL/OGR layer, since I have implemented this interface using ODBC (yes, I was too lazy to implement a native connector) some logging would be possible, but not concurrently, hence the file would be overwritten. If nothing is in place, I'm happy to give it a try and implement it. Stefan [1] <http://article.gmane.org/gmane.comp.db.monetdb.devel/1381> [2] <http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Mapi-Function-Refe…> [3] <www.win.tue.nl/~tcalders/presentations/ivanova.ppt>

3 2

[Monetdb-developers] x100 development
by Ross Bates 17 Oct '08

17 Oct '08

Hi All - is there any chance we could get a comment or two from the core monetdb developers about the future of x100? I'm just curious if it's going to be an extension, a separate product, commercial, open source, etc..... To be honest I'm fine with whatever the answer is... you could tell me it's never going to see the light of day and that would be ok. Just wondering. Best Regards, Ross

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime shredder.mx, , 1.142, 1.143
by Sjoerd Mullender 16 Oct '08

16 Oct '08

On 2008-10-16 08:21, Jan Flokstra wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv11903 > > Modified Files: > shredder.mx > Log Message: > - fix strncat() size overflow compilation problem on some architectures. > > > > U shredder.mx > Index: shredder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/shredder.mx,v > retrieving revision 1.142 > retrieving revision 1.143 > diff -u -d -r1.142 -r1.143 > --- shredder.mx 15 Oct 2008 12:45:12 -0000 1.142 > +++ shredder.mx 16 Oct 2008 06:21:44 -0000 1.143 > @@ -1324,7 +1324,7 @@ > > const xmlChar *abs_SystemID; > > - char locbuff[FILENAME_MAX]; > + char locbuff[FILENAME_MAX+1]; > > if (SystemID && shredCtx->base_dir && !isURL((char*)SystemID) && !((*SystemID=='/') || (*SystemID=='\\'))) { > /* is is a relative name which should be prefixed with the > @@ -1333,7 +1333,7 @@ > /* base_dir */ > locbuff[0] = '\0'; > strncat(&locbuff[0],shredCtx->base_dir,FILENAME_MAX); > - strncat(&locbuff[0],(char*)SystemID,FILENAME_MAX); > + strncat(&locbuff[0],(char*)SystemID,FILENAME_MAX-strlen(shredCtx->base_dir)); > abs_SystemID = (const xmlChar *)&locbuff[0]; > } else > abs_SystemID = SystemID; > This is not very good from a defensive programming point of view, nor from an efficiency point of view. Plus, the compiler complains about the second strncat. Better, instead of the three lines starting with locbuff[0] = '\0'; do snprintf(locbuff, sizeof(locbuff), "%s%s", shredCtx->base_dir, (char *) SystemID); The problem is, strlen(shredCtx->base_dir) could be greater than FILENAME_MAX, in which case the third argument to the second strncat could overflow and become extremely large (it's an unsigned, so it won't be negative). -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/conf monetdb5.conf.in, , 1.34, 1.35
by Fabian Groffen 13 Oct '08

13 Oct '08

On 12-10-2008 09:38:04 +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/conf > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv19179 > > Modified Files: > monetdb5.conf.in > Log Message: > Move the MonetDB related files to a clearly marked achorpoint default > -mero_msglog=@localstatedir@@DIRSEP@log@DIRSEP@merovingian.log > -mero_errlog=@localstatedir@@DIRSEP@log@DIRSEP@merovingian.log > +mero_msglog=@localstatedir@@DIRSEP@MonetDB5@DIRSEP@merovingian.log > +mero_errlog=@localstatedir@@DIRSEP@MonetDB5@DIRSEP@merovingian.log May I suggest to leave in "log" in here. Traditionally, logfiles are stored in /var/log. No real need to deviate from that, I think? /var/log/MonetDB5 would be ok, I guess. > -mero_pidfile=@localstatedir@@DIRSEP@run@DIRSEP@merovingian.pid > +mero_pidfile=@localstatedir@@DIRSEP@MonetDB5@DIRSEP@merovingian.pid Pidfiles are traditionally stored in /var/run. I think this is not a good idea. Note that both changes don't make "slotting" of monetdb any more possible than it is now.

4 5

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_logger.mx, , 1.26, 1.27
by Stefan Manegold 13 Oct '08

13 Oct '08

On Sun, Oct 12, 2008 at 10:24:45AM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv23370/src/gdk > > Modified Files: > gdk_logger.mx > Log Message: > default log directories moved to ${gdk_dbfarm} > Logger now extends the logdir with ${dbname}/$log_name > where $log_name == sql or xquery (passed by the call to logger_create) > (so now everything is again under the dbfarm base directory by default > but can still be set to anything else using the logdir variables) Niels, (mainly to be able to anticipate how your changes will affect testing, and whether I need to do any changes in Mtest.py, TestTools, and/or */RunMtest*) in case we do use/set sql_logdir and/or xquery_logdir, what wil be the resulting path for the log? ${*_logdir} or ${*_logdir}/${dbname}/${log_name} ? in other words, is the default for sql_logdir & xquery_logdir now ${gdk_dbfarm} or ${gdk_dbfarm}/${dbname}/${log_name} ? Thanks! Stefan > Needed to patch mo_substitute (now rewrites all ${varname} and for windows > also all %varname%), same for monet_options.py > > > > U gdk_logger.mx > Index: gdk_logger.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_logger.mx,v > retrieving revision 1.26 > retrieving revision 1.27 > diff -u -d -r1.26 -r1.27 > --- gdk_logger.mx 10 Oct 2008 08:50:31 -0000 1.26 > +++ gdk_logger.mx 12 Oct 2008 10:24:43 -0000 1.27 > @@ -1037,7 +1037,7 @@ > > lg->tid = 0; > > - snprintf(filename, BUFSIZ, "%s%c%s%c", logdir, DIR_SEP, dbname, DIR_SEP); > + snprintf(filename, BUFSIZ, "%s%c%s%c%s%c", logdir, DIR_SEP, dbname, DIR_SEP, fn, DIR_SEP); > lg->fn = GDKstrdup(fn); > lg->dir = GDKstrdup(filename); > lg->phandler = phandler; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 merovingian.mx, , 1.58, 1.59 monetdb.mx, , 1.27, 1.28
by Fabian Groffen 12 Oct '08

12 Oct '08

On 12-10-2008 10:31:31 +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5 > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv23781 > > Modified Files: > merovingian.mx monetdb.mx > Log Message: > Use a known location for the lock file. known? > - snprintf(lockfile, 512, "%s/.merovingian_lock", dbfarm); > + /* the lock file is placed in the same directory as the pid */ > + strcpy(lockfile, pidfilename); > + c= strrchr(lockfile,'/'); > + if (c) > + strcpy(c+1,".merovingian_lock"); > + } else > + strcat(lockfile, ".merovingian_lock"); Why would you move out the lockfile from the dbfarm, and put it in /var/run instead? merovingian manages a dbfarm, hence the most obvious place to lock is the dbfarm itself. You now allow a user to use a different pidfile, but the same dbfarm and get two merovingians managing the same dbfarm, which seems like NOT a good idea to me. Below changes seem unrelated to the commit message to me. It indeed fixes one bug. However, if you change the input prompt to ignore an empty response, you probably want to change the documentation accordingly, as it states that the default is No, while you now require the user to at least type something. (Yes I'm picky, because everything was very well thought over.) > U monetdb.mx > Index: monetdb.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/monetdb.mx,v > retrieving revision 1.27 > retrieving revision 1.28 > diff -u -d -r1.27 -r1.28 > --- monetdb.mx 10 Oct 2008 08:54:15 -0000 1.27 > +++ monetdb.mx 12 Oct 2008 10:31:29 -0000 1.28 > @@ -24,7 +24,7 @@ > The monetdb utility is designed to be the interface for the DBA to the > dbfarm. Creating or deleting databases next to retrieving status > information about them are the primary goals of this tool. > - > +@{ > @h > #define TOOLKIT_VERSION "0.4" > > @@ -282,11 +282,13 @@ > } > /* demo | state | uptime | health */ > secondsToString(avg, uplog.avguptime, 0); > - printf("%-14s %s %12s %3d%%, %3s %s\n", > - dbname, > - state, uptime, > - 100 - (uplog.crashcntr * 100 / uplog.startcntr), > - avg, crash); > + printf("%-14s %s %12s", > + dbname, state, uptime); > + if (uplog.startcntr) > + printf(" %3d%%, %3s %s", > + 100 - (uplog.crashcntr * 100 / uplog.startcntr), > + avg, crash); > + printf("\n"); > } else if (mode == 2) { > /* long mode */ > char *state; > @@ -1076,9 +1078,10 @@ > printf("you are about to remove database '%s'\n", dbname); > printf("ALL data in this database will get lost, " > "are you sure? [y/N] "); > - if (scanf("%c", &answ) >= 1 && (answ == 'y' || answ == 'Y')) { > - /* do it! */ > - } else { > + answ = getchar(); > + while (answ!= '\n' && getchar()!= '\n') > + ; > + if (answ != 'y' && answ != 'Y') { > printf("battle control terminated\n"); > exit(0); > } > @@ -1361,4 +1364,5 @@ > return(0); > } > > +@} > /* vim:set ts=4 sw=4 noexpandtab: */ > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins

2 2

[Monetdb-developers] mapi_fetch_reset
by Stefan de Konink 10 Oct '08

10 Oct '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, Is it theoretically possible that the result set is too big for mapi_fetch_reset to work, so it is actually not brought back to the first result? (Opposed to the first result in the cache) I'm having the following optimalisation issue; I can request a set of points in one go, but I need to reprocess them in two outputs. - - I can place two queries, second one with a subselect - - I can place one query with a subselect (process it twice, see question one) - - I can store the outcome of query one, and then use an IN (...) pattern build from the first query output. - - I can store desired outcome in a temporary buffer, and place it on the end, using the one query subselect approach. Option one uses two queries, sounds slow, option two is related to quetion one, I have seen option 3 fail for huge sets, Option 4 can take up twice as much memory. Suggestions? :) Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkjvlPcACgkQYH1+F2Rqwn3BPQCfTCjR/aHwJw/tUU09oCl+W5xq 1cEAniPMIFArgNJjOdKAgmH2TUZHWEpG =l9k7 -----END PGP SIGNATURE-----

1 0

Re: [Monetdb-developers] [carl.nobile@gmail.com: Re: Data integrity bug]
by Stefan Manegold 07 Oct '08

07 Oct '08

On Tue, Oct 07, 2008 at 07:52:49PM +0200, Niels Nes wrote: > > Sjoerd, Stefan, > > Ik heb al een tijdje geen buildtools in een lege omgeving (ie geen > monetdb enviroment settings) geprobeert. Kan het zijn dat er dan > iets misgaat. Make distclean moeten we misschien ook nog aan de testing > toevoegen ? > > Niels > ----- Forwarded message from Carl Nobile <carl.nobile(a)gmail.com> ----- > > From: Carl Nobile <carl.nobile(a)gmail.com> > Subject: Re: [Monetdb-developers] Data integrity bug > To: Niels Nes <Niels.Nes(a)cwi.nl> > > Neils, > I got buildtools to compile. It seems that 'make distclean' > does not clean out any of the yacc crud. So, I just blew away > the tree and checked it out again. > Now when I run ./bootstrap in the clients code it complains the > following: > $ ./bootstrap > automake 1.9.6 is 1.7 or newer. Good. > autoconf 2.61 is 2.57 or newer. Good. > libtool 1.5.24Debian1.5.24-1ubuntu1 is 1.4 or newer. Good. > Python 2.5.1 is 2.0.0 or newer. Good. > Traceback (most recent call last): > File "/usr/local/MonetDB/bin/autogen.py", line 29, in > <module> > from autogen import am > ImportError: No module named autogen > I've looked for a python-autogen package, but have found > nothing in Ubuntu's repositories. from buildtools/README ======== [...] In particular, see autogen/README for how to set your PYTHONPATH in case ./bootstrap of MonetDB, sql, pathfinder, etc. fails to find the autogen module with the default settings. ======== from buildtools/autogen/README ======== To build, run python setup.py build then to install, run python setup.py install [--prefix=<install-dir-prefix>] Use python setup.py --help to get more information about the possible options. If you use the --prefix option or otherwise install autogen in a different place, you may have to set your PYTHONPATH environment variable accordingly. The directory which needs to be added is <install-dir-prefix>/lib(64)/python<python-version>/site-packages, where <python-version> is the version of Python used (e.g. 2.4). You can automatically get the respective directory via "<install-dir-prefix>/`python -c 'import distutils.sysconfig; print distutils.sysconfig.get_python_lib(0,0,"")'`". ( In case you are using Apple-built Python 2.5.1 on Mac OS X 10.5.* (Darwin 9.*), it can be that the above command yields "<install-dir-prefix>/Library/Python/2.5/site-packages", while Python's distutils.core.setup() actually installs the python modules into "<install-dir-prefix>/lib/python2.5/site-packages". In that case, replacing the above command by "<install-dir-prefix>/`python -c 'import distutils.sysconfig; print distutils.sysconfig.get_python_lib(0,1,"")'`/site-packages" might help to overcome this inconsistency. ) [...] ======== Stefan > -Carl > On Tue, Oct 7, 2008 at 12:35 PM, Niels Nes > <[1]Niels.Nes(a)cwi.nl> wrote: > > On Tue, Oct 07, 2008 at 12:24:38PM -0400, Carl Nobile wrote: > > Neils, > > I'm getting errors when I try to build buildtools. > > mel.cc:(.text+0x7f9): undefined reference to `yyin' > > My installed packages are: > > autoconf (GNU Autoconf) 2.61 > > automake (GNU automake) 1.9.6 > > autogen (GNU AutoGen) - The Automated Program Generator - > Ver. > > 5.9.1 > > ltmain.sh (GNU libtool) 1.5.24 Debian 1.5.24-1ubuntu1 > > (1.1220.2.456 2007/06/24 02:25:32) > > bison (GNU Bison) 2.3 > > flex 2.5.33 > > g++ (GCC) 4.1.3 20070929 (prerelease) (Ubuntu > 4.1.2-16ubuntu2) > > Carl > > yyin should be defined in mel/[2]mel.yy.cc, ie a flex > generated source > file. Maybe something went wrong with this file. We have for > almost > all tools the same version on our fedore 8 systems. > Niels (ie not Neils) > > On Tue, Oct 7, 2008 at 6:27 AM, Niels Nes > <[1][3]Niels.Nes(a)cwi.nl> > > > wrote: > > > > On Mon, Oct 06, 2008 at 03:07:02PM -0400, Carl Nobile > wrote: > > > Ross, > > > I forgot to answer one of your questions. Although my > web > > > service can delete data, running a delete doesn't > seen to > > be > > > involved with this issue. To make a long story short > it > > seems > > > everything is okay until I add a column during an > update. > > > > I just fixed the problem for Ross. Allthough the problem > was > > related to > > deletes which you do not have, it still may solve your > > problem as the > > fix was at a lower level than the sql delete statement. > > So could you test with a checkout from cvs head? > > Niels > > > > > -Carl > > > On Mon, Oct 6, 2008 at 2:50 PM, Carl Nobile > > > > > > <[1][2][4]carl.nobile(a)gmail.com> wrote: > > > > > > Yes, the same is true with my situation. It can work > fine > > 3 or > > > 4 times in a row then select from where equals just > stops > > > returning any data. > > > -Carl > > > On Mon, Oct 6, 2008 at 2:45 PM, Ross Bates > > > > > > <[2][3][5]rbates(a)gmail.com> wrote: > > > > > > Something definitely going on with the table stats, I > am > > seeing > > > the same strange behavior in that it doesn't occur on > a > > > consistent basis. > > > I have finally been able to recreate it using the > > following > > > steps. (also see my notes that follow) > > > -------------------------------------- > > > CREATE TABLE "sobi"."table1" > > > ( > > > cid integer, > > > p varchar(100), > > > c varchar(100), > > > lf integer, > > > rt integer, > > > lvl integer > > > ) > > > insert into sobi.table1 values (1,'foo','bar',9,12,1) > > > insert into sobi.table1 values > (1,'boo','blah',13,22,1) > > > CREATE TABLE "sobi"."table2" > > > ( > > > p varchar(100), > > > c varchar(100), > > > lf integer, > > > rt integer, > > > lvl integer > > > ) > > > insert into sobi.table2(p,c) (select p,c from > sobi.table1) > > > select * from sobi.table2 > > > select * from sobi.table2 where p = 'foo' > > > delete from sobi.table2 > > > -------------------------------------- > > > It might happen right away - or it might take 5-10 > times, > > but > > > if you iterate over the insert > select > delete > > statements > > > eventually the [p = 'foo'] select will stop returning > > rows. > > > On Mon, Oct 6, 2008 at 1:24 PM, Carl Nobile > > > > > > <[3][4][6]carl.nobile(a)gmail.com> wrote: > > > > > > Ross, > > > I have written a web service in Python that sets on > top of > > > MonetDB it is somewhat complicated, but I'll try to > > explain it > > > below. There are only three tables in the schema and > one > > view > > > over sys.tables and sys.columns. > > > BUSINESS_UNIT > > > BUSINESS_USER_COLUMN_STATS > > > BUSINESS_USER_PROFILE > > > BUSINESS_USER_PROFILE_COLUMNS > > > 1) START TRANSACTION > > > 2) Check if record exists to determine if an UPDATE > or an > > > INSERT needs to be done. > > > (SELECT count(*) FROM "BUSINESS_USER_PROFILE" WHERE > > > "USER_ID"=%(USER_ID)s AND > "BUSINESS_ID"=%(BUSINESS_ID)s) > > > 3) If an INSERT then check if the BUSINESS_UNIT is > > present. > > > SELECT count(*) FROM "BUSINESS_UNIT" WHERE > > > "BUSINESS_ID"=%(BUSINESS_ID)s > > > 4) If UPDATE see item 13 > > > 5) If INSERT then: INSERT INTO "BUSINESS_UNIT" > > ("BUSINESS_ID", > > > "CREATE_DT", "CREATE_CID") VALUES (%(BUSINESS_ID)s, > > > %(CREATE_DT)s, %(CREATE_CID)s > > > 6) Look to see if any new columns need to be added to > > > BUSINESS_USER_PROFILE by checking the view, if yes > then: > > ALTER > > > TABLE "BUSINESS_USER_PROFILE" ADD COLUMN "%s" > VARCHAR(240) > > NULL > > > 7) Commit then START TRANSACTION > > > 8) INSERT the record into the BUSINESS_USER_PROFILE > table > > (the > > > two %s constructs could be any number of columns and > > values): > > > INSERT INTO "BUSINESS_USER_PROFILE" (%s) VALUES (%s) > > > 9) Check to see if the column needs to be inserted or > > updated > > > to the stats table: SELECT "COLUMN_NAME" FROM > > > "BUSINESS_USER_COLUMN_STATS" > > > 10) Check the view again to see if the column already > > exists. > > > 11) If INSERT: INSERT INTO > "BUSINESS_USER_COLUMN_STATS" > > > ("COLUMN_NAME", "BUSINESS_ID", "LAST_UPDT_DT", > > "LAST_UPDT_CID") > > > VALUES (%(COLUMN_NAME)s, %(BUSINESS_ID)s, > > %(LAST_UPDT_DT)s, > > > %(LAST_UPDT_CID)s) > > > 12) If UPDATE: UPDATE "BUSINESS_USER_COLUMN_STATS" > SET > > > "BUSINESS_ID"=%(BUSINESS_ID)s, > > "LAST_UPDT_DT"=%(LAST_UPDT_DT)s, > > > "LAST_UPDT_CID"=%(LAST_UPDT_CID)s WHERE > > > "COLUMN_NAME"=%(COLUMN_NAME)s > > > 13) Do 6 and 7 above. > > > 14) UPDATE the record in the BUSINESS_USER_PROFILE > table > > (the > > > two %s constructs could be any number of columns or > > > conditions): 'UPDATE "BUSINESS_USER_PROFILE" SET %s > WHERE > > %s > > > 15) Do 9, 10, 11, and 12 > > > OK this may be over kill, but I had to think through > the > > > process myself before I could answer your question. > Any > > select > > > after doing a sequence of six inserts and six updates > > would > > > usually cause the issue. The operative word is > 'usually', > > > because sometimes it would work flawlessly. > > > -Carl > > > On Mon, Oct 6, 2008 at 1:23 PM, Ross Bates > > > > > > <[4][5][7]rbates(a)gmail.com> wrote: > > > > > > Carl - this bug continues to bother me as well as I > can't > > > reproduce the exact steps. > > > Does your application populate the table in question > using > > sql > > > like this? > > > insert into foo(col1,col2) (select col1,col2 from > bar) > > > Also, do you run any delete statements before > populating > > the > > > data? > > > I was thinking that the bug was related to the > > > addition/deletion of columns, but it appears to show > up > > more > > > often after a series of insert/delete statements > which > > follow > > > my alter/create table statements. > > > On Sun, Oct 5, 2008 at 4:19 PM, Stefan de Konink > > > > > > <[5][6][8]stefan(a)konink.de> wrote: > > > > > > -----BEGIN PGP SIGNED MESSAGE----- > > > Hash: SHA512 > > > > > > Ross Bates schreef: > > > > > > > Stefan - what is occurring in the alignment bug you > are > > > referring to? > > > > > > I had an issue before that occured after I had > added an > > > index (that in > > > MonetDB terms shouldn't do anything), where I was > able > > to > > > make mserver5 > > > crash on a string comparison. > > > But I know that this was fixed even before I had > > reported > > > it. > > > > > > Stefan > > > -----BEGIN PGP SIGNATURE----- > > > Version: GnuPG v2.0.9 (GNU/Linux) > > > Comment: Using GnuPG with Mozilla - > > > > > > [6][7][9]http://enigmail.mozdev.org > > > > > > > > > > > > iEYEAREKAAYFAkjpL2AACgkQYH1+F2Rqwn3k9gCeKg+p+n+nQE+dPTLDLnZe > > > 9OZ9 > > > SIAAnimb0zS4XvWtiKncWEwh3RU7DMJe > > > =zHeG > > > -----END PGP SIGNATURE----- > > > > > > > > > > References > > > > > > 1. mailto:[11][10]carl.nobile@gmail.com > > > 2. mailto:[12][11]rbates@gmail.com > > > > > 3. mailto:[13][12]carl.nobile@gmail.com > > > 4. mailto:[14][13]rbates@gmail.com > > > 5. mailto:[15][14]stefan@konink.de > > > 6. [16][15]http://enigmail.mozdev.org/ > > > > > 7. mailto:[17][16]carl.nobile@gmail.com > > > 8. mailto:[18][17]carl.nobile@gmail.com > > > 9. mailto:[19][18]carl.nobile@gmail.com > > > > > > > > > --------------------------------------------------------------- > > ---------- > > > This SF.Net email is sponsored by the Moblin Your Move > > Developer's challenge > > > Build the coolest Linux based applications with Moblin > SDK & > > win great prizes > > > Grand prize is a trip for two to an Open Source event > > anywhere in the world > > > > > > > [20][19]http://moblin-contest.org/redirect.php?banner_id=100 > &url=/ > > > _______________________________________________ > > > Monetdb-developers mailing list > > > [21][20]Monetdb-developers(a)lists.sourceforge.net > > > > > > [22][21]https://lists.sourceforge.net/lists/listinfo/monetdb > -develo > > > pers > > > > -- > > Niels Nes, Centre for Mathematics and Computer Science > (CWI) > > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > > > url: [23][22]http://www.cwi.nl/~niels e-mail: > > [24][23]Niels.Nes(a)cwi.nl > > > > > > > > References > > > > 1. mailto:[24]Niels.Nes@cwi.nl > > > 2. mailto:[25]carl.nobile@gmail.com > > > 3. mailto:[26]rbates@gmail.com > > > 4. mailto:[27]carl.nobile@gmail.com > > > 5. mailto:[28]rbates@gmail.com > > 6. mailto:[29]stefan@konink.de > > 7. [30]http://enigmail.mozdev.org/ > > > 8. mailto:[31]carl.nobile@gmail.com > > 9. mailto:[32]carl.nobile@gmail.com > > > 10. mailto:[33]carl.nobile@gmail.com > > 11. mailto:[34]carl.nobile@gmail.com > > 12. mailto:[35]rbates@gmail.com > > 13. mailto:[36]carl.nobile@gmail.com > > 14. mailto:[37]rbates@gmail.com > > 15. mailto:[38]stefan@konink.de > > 16. [39]http://enigmail.mozdev.org/ > > 17. mailto:[40]carl.nobile@gmail.com > > 18. mailto:[41]carl.nobile@gmail.com > > 19. mailto:[42]carl.nobile@gmail.com > > 20. > [43]http://moblin-contest.org/redirect.php?banner_id=100&url > =/ > > 21. mailto:[44]Monetdb-developers@lists.sourceforge.net > > 22. > [45]https://lists.sourceforge.net/lists/listinfo/monetdb-dev > elopers > > 23. [46]http://www.cwi.nl/%7Eniels > > 24. mailto:[47]Niels.Nes@cwi.nl > > 25. mailto:[48]carl.nobile@gmail.com > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: [49]http://www.cwi.nl/~niels e-mail: > [50]Niels.Nes(a)cwi.nl > > References > > 1. mailto:Niels.Nes@cwi.nl > 2. http://mel.yy.cc/ > 3. mailto:Niels.Nes@cwi.nl > 4. mailto:carl.nobile@gmail.com > 5. mailto:rbates@gmail.com > 6. mailto:carl.nobile@gmail.com > 7. mailto:rbates@gmail.com > 8. mailto:stefan@konink.de > 9. http://enigmail.mozdev.org/ > 10. mailto:carl.nobile@gmail.com > 11. mailto:rbates@gmail.com > 12. mailto:carl.nobile@gmail.com > 13. mailto:rbates@gmail.com > 14. mailto:stefan@konink.de > 15. http://enigmail.mozdev.org/ > 16. mailto:carl.nobile@gmail.com > 17. mailto:carl.nobile@gmail.com > 18. mailto:carl.nobile@gmail.com > 19. http://moblin-contest.org/redirect.php?banner_id=100&url=/ > 20. mailto:Monetdb-developers@lists.sourceforge.net > 21. https://lists.sourceforge.net/lists/listinfo/monetdb-develo > 22. http://www.cwi.nl/%7Eniels > 23. mailto:Niels.Nes@cwi.nl > 24. mailto:Niels.Nes@cwi.nl > 25. mailto:carl.nobile@gmail.com > 26. mailto:rbates@gmail.com > 27. mailto:carl.nobile@gmail.com > 28. mailto:rbates@gmail.com > 29. mailto:stefan@konink.de > 30. http://enigmail.mozdev.org/ > 31. mailto:carl.nobile@gmail.com > 32. mailto:carl.nobile@gmail.com > 33. mailto:carl.nobile@gmail.com > 34. mailto:carl.nobile@gmail.com > 35. mailto:rbates@gmail.com > 36. mailto:carl.nobile@gmail.com > 37. mailto:rbates@gmail.com > 38. mailto:stefan@konink.de > 39. http://enigmail.mozdev.org/ > 40. mailto:carl.nobile@gmail.com > 41. mailto:carl.nobile@gmail.com > 42. mailto:carl.nobile@gmail.com > 43. http://moblin-contest.org/redirect.php?banner_id=100&url=/ > 44. mailto:Monetdb-developers@lists.sourceforge.net > 45. https://lists.sourceforge.net/lists/listinfo/monetdb-developers > 46. http://www.cwi.nl/%7Eniels > 47. mailto:Niels.Nes@cwi.nl > 48. mailto:carl.nobile@gmail.com > 49. http://www.cwi.nl/%7Eniels > 50. mailto:Niels.Nes@cwi.nl > > ----- End forwarded message ----- > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Data integrity bug
by Carl Nobile 07 Oct '08

07 Oct '08

I think I have found a data integrity bug. After working with the DB for a while I notice that the equals (=) operator no longer works, however, the LIKE operator will still retrieve data. The only way I have found to solve this issue is to rebuild the DB and import all the data. This is obviously not a very good solution. There is an application sitting on top of the DB that has been the cause of this, but as you can see below mclient also gives the wrong results. Bouncing the server does not fix it. You should know the only odd thing the application does is dynamically add and drop columns to one of the tables--the reason we are using MonetDB. This allows us to have an essential flat 2nd normal form table with 4th normal form capabilities. sql>SELECT "USERNAME","LAST_UPDT_CID","CREATE_DT" from "BUSINESS_USER_PROFILE" WHERE "USERNAME"='Carl'; sql>SELECT "USERNAME","LAST_UPDT_CID","CREATE_DT" from "BUSINESS_USER_PROFILE" WHERE "USERNAME" like 'Carl'; +-----------------+-------------------------+---------------------------------------+ | USERNAME |LAST_UPDT_CID |CREATE_DT | +==========+==============+======================+ | Carl |GVE |2008-10-04 20:47:54.275000 | +----------------- +------------------------+---------------------------------------+ We are still in development of this project, but need to release our code in a month or so. Any ideas what is going on here? ------------------------------------------------------------------------------- Carl J. Nobile (Software Engineer) carl.nobile(a)gmail.com -------------------------------------------------------------------------------

4 10

[Monetdb-developers] [Fwd: SourceForge.net CVS Migration and Downtime Announcement]
by Sjoerd Mullender 29 Sep '08

29 Sep '08

Be aware that the CVS repository will be off line tomorrow (Tuesday) evening. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Fwd: Question: MonetDB static compile]
by Stefan Manegold 29 Sep '08

29 Sep '08

Lefteris, Hans, ======== $ monetdb-install.sh --help -------- usage: /export/scratch0/manegold/Monet/Testing/Current/source/monetweb/Assets/monetdb-install.sh < OPTS ... > where OPTS are: --prefix=path install into location path, defaults to /ufs/manegold/MonetDB --build=path use path as (temporary) build directory, defaults to /var/tmp/MonetDB-XXXXXXXXX --enable-sql build the MonetDB/SQL server --enable-xquery build the MonetDB/XQuery server --enable-geom build geom extension for MonetDB/SQL, this option implies --enable-sql --enable-template build template module for MonetDB extensions, this option requires nightly or cvs sources. --nightly=target download and install a nightly snapshot of the stable or current branch, target must be 'stable' or 'current' --cvs checkout a CVS snapshot of the current branch --enable-debug compile with debugging support via e.g. gdb --enable-optimise compile with high optimisation flags, enabling this option increases compilation time considerably but often yields in a faster MonetDB server --enable-optimize alias for --enable-optimise --quiet suppress output going to stdout --help this message --devhelp special help for developers ^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^ --version show revision number and quit ======== $ monetdb-install.sh --devhelp -------- There are a few hooks in this script that may be interesting to developers or experienced users. If you know what you're doing, by setting EXTRA_ECONF in the environment ^^^^^^^^^^^ you can pass extra arguments to configure invocations. Use with care. The variable MAKEOPTS is passed onto each make invocation, and can be used to e.g. set "-j2" to speed up compilation times. By setting MAKE, a make with a special name or location can be used. Two targets exist which control what the script is doing: unpack and install. They can be given as argument to the script. unpack only runs the fetch and unpacking phase, while install skips the fetching/unpacking of the sources, and starts configure/make/make install. By using --build=/path/to with the install target it is possible to resume/retry a (failed) compilation. ======== $ configure --help -------- [...] --enable-static[=PKGS] build static libraries [default=no] --enable-shared[=PKGS] build shared libraries [default=yes] [...] (Note that the "[=PKGS]" is some bug in the docu and should be ignored.) ======== Hence, export EXTRA_ECONF='--disable-shared --enable-static' monetdb-install.sh --enable-xquery --prefix=/opt/MonetDB will (should) give you a statically linked MonetDB/XQUery Mserver in that sense, that all required MonetDB modules are statically linked into the Mserver (as opposed to loading them as shared libraries at runtime). What this does not do, though, is statically linking system libraries and other external libraries (like libxml2 or libpcre) into the Mserver --- we do not have any support for that. Stefan ps: I felt free to Cc: our (prefered) public communication channel to also let others benefit from your question and my answer to it. On Mon, Sep 29, 2008 at 04:46:56PM +0200, Lefteris Sidirourgos wrote: > Is there a compile time option for what NFI asks? > > ---------------------------- Original Message ---------------------------- > Subject: Question: MonetDB static compile > From: "Hans van Rijswijk (DT)" <hans(a)holmes.nl> > Date: Mon, September 29, 2008 4:02 pm > To: "Lefteris Sidirourgos" <E.Sidirourgos(a)cwi.nl> > -------------------------------------------------------------------------- > > > Hi Lefteris, > > I would like to create a static compilation/link of MonetDB (XQuery). The > purpose is to make the installation easier (No compilation while > installing, No shared library dependencies). > Given the MonetDB-Aug2008-SuperBall, what am I supposed to do, to create a > version for an Ubuntu Linux x86-64 platform. > I know the command: > monetdb-install.sh --enable-xquery --prefix=/opt/MonetDB > does the compilation for dynamic libraries. > > Hope to hear from you. Thanks in advance. > > Regards, > Hans van Rijswijk > NFI. > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] latest pathfinder CVS sources require latest buildtools
by Stefan Manegold 25 Sep '08

25 Sep '08

Dear all, since SF currently experiences (severe) problems with checkin mails, I distribute the following info via this channel: =================================================================== 2008/09/25 - stmane: buildtools/conf/rules.mk,1.7 to avoid the necessity of using a single fixed name for [f]lex output files (`flex -olex.yy.c`) --- and hence the name clash in case of parallel makes, we now also handle the default output "lex.X.c" of `flex X.l` correctly. =================================================================== 2008/09/25 - stmane: pathfinder/compiler/parser/Makefile.ag,1.18 pathfinder/modules/pftijah/Makefile.ag,1.27 Avoid using option "-olex.yy.c" with [f]lex, which created a name clash in case of parallel makes. Note: Updating you pathfinder CVS sources to this version also requires an update of the buildtools to the latest CVS version! =================================================================== Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] Just a test; please ignore
by Lefteris 23 Sep '08

23 Sep '08

It didnt work in my last night checkins for pathfinder either. On Tue, Sep 23, 2008 at 2:52 PM, Stefan Manegold <Stefan.Manegold(a)cwi.nl> wrote: > > does mailing to monetdb-checkins(a)lists.sourceforge.net work? > > Stefan > > -- > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > | The Netherlands | Fax : +31 (20) 592-4312 | > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

1 0

[Monetdb-developers] MonetDB/XQuery & MonetDB/SQL : how can i find the two jar-archives MonetDB JDBC driver (i couldn't find them after intallation)
by Clarisse Kagoyire 22 Sep '08

22 Sep '08

Hello, I installed MonetDB/SQL and I would like to use the JDBC Driver but i could not find none of the two jar-archives (monetdb-X.Y-jdbc.jar and jdbcclient.jar) in the directory share/MonetDB/lib. Please can you tell me where i can get them? (actually I was only using MonetDB/Xquery, but as i wanted to run some porgramme written in java, i also installed monetdb/SQL to get the MonetDB JDBC Driver. ) Thank you. Clarisse

3 2

[Monetdb-developers] profile in SQL...
by Romulo Goncalves 17 Sep '08

17 Sep '08

There is this information online: http://monetdb.cwi.nl/SQL/Documentation/PROFILE-Statement.html and when I do: sql>set profile = true; !Variable profile unknown 0 tuples sql>select * from profile; !SELECT: no such table 'profile' 0 tuples sql> Hummmm... Is the information wrong or SQL is broken? Romulo

2 1

[Monetdb-developers] Re : [Monetdb-checkins] clients/src/perl Mapi.pm, , 1.5, 1.6
by sylver_b 16 Sep '08

16 Sep '08

Hi Is it Ok to use the perl module ? Is it available on the SVN ? Let me know Thanks ----- Message d'origine ---- De : Fabian Groffen <Fabian.Groffen(a)cwi.nl> À : monetdb-developers(a)lists.sourceforge.net Envoyé le : Vendredi, 12 Septembre 2008, 18h41mn 14s Objet : Re: [Monetdb-developers] [Monetdb-checkins] clients/src/perl Mapi.pm, , 1.5, 1.6 On 12-09-2008 13:18:32 +0200, Sjoerd Mullender wrote: > sed -i '/Xexport/s/putblock/$self->putblock/' src/perl/Mapi.pm (pegasus:clients/src/perl) fabian% sed -i '/Xexport/s/putblock/$self->putblock/' Mapi.pm (pegasus:clients/src/perl) fabian% ./mclient.pl !please specify a database (pegasus:clients/src/perl) fabian% ./mclient.pl sdss > select * from tables; [ 978, "schemas", 977, NULL, 0, true, 0, 0 ] ... [ 7525, "spt_datatype_info", 977, NULL, 0, false, 0, 0 ] > > > > \q No more error/warning. I'll commit it. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_parser.mx, , 1.291, 1.292 sql_updates.mx, , 1.145, 1.146
by Stefan Manegold 16 Sep '08

16 Sep '08

On Tue, Sep 16, 2008 at 02:55:45PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv12591 > > Modified Files: > sql_parser.mx sql_updates.mx > Log Message: > The number of records should be type lng > to allow the load of billions of records in a single copy command. [...] > U sql_updates.mx > Index: sql_updates.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_updates.mx,v > retrieving revision 1.145 > retrieving revision 1.146 > diff -u -d -r1.145 -r1.146 > --- sql_updates.mx 7 Sep 2008 14:28:00 -0000 1.145 > +++ sql_updates.mx 16 Sep 2008 14:55:42 -0000 1.146 > @@ -1411,11 +1411,11 @@ > char *ssep = (seps->h->next->next)?seps->h->next->next->data.sval:"\""; > char *ns = (null_string)?null_string:"null"; > list *slist; > - int nr = (nr_offset)?nr_offset->h->data.i_val:-1; > - int offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > + lng nr = (nr_offset)?nr_offset->h->data.i_val:-1; ^^^ ^ > + lng offset = (nr_offset)?nr_offset->h->next->data.i_val:0; ^^^ ^ shouldn't these be "l_val", now? ^ > > - assert(!nr_offset || nr_offset->h->type == type_int); > - assert(!nr_offset || nr_offset->h->next->type == type_int); > + assert(!nr_offset || nr_offset->h->type == type_lng); ^^^ > + assert(!nr_offset || nr_offset->h->next->type == type_lng); ^^^ > if (sname && !(s=mvc_bind_schema(sql, sname))) { > (void) sql_error(sql, 02, "COPY INTO: no such schema '%s'", sname); > return NULL; -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_parser.mx, , 1.291, 1.292 sql_updates.mx, , 1.145, 1.146
by Stefan Manegold 16 Sep '08

16 Sep '08

On Tue, Sep 16, 2008 at 02:55:45PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv12591 > > Modified Files: > sql_parser.mx sql_updates.mx > Log Message: > The number of records should be type lng ^^^ shouldn't that be aligned with the BATcount, i.e., type BUN (if possible) or at least type wrd? Stefan > to allow the load of billions of records in a single copy command. > > > > U sql_parser.mx > Index: sql_parser.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_parser.mx,v > retrieving revision 1.291 > retrieving revision 1.292 > diff -u -d -r1.291 -r1.292 > --- sql_parser.mx 9 Sep 2008 13:28:49 -0000 1.291 > +++ sql_parser.mx 16 Sep 2008 14:55:41 -0000 1.292 > @@ -583,6 +583,8 @@ > > %type <l_val> > opt_start > + lngval > + poslng > opt_increment > opt_min > opt_max > @@ -2462,8 +2464,8 @@ > > opt_nr: > /* empty */ { $$ = NULL; } > - | posint RECORDS { $$ = append_int(append_int(L(), $1), 0); } > - | posint OFFSET posint RECORDS { $$ = append_int(append_int(L(), $1), $3); } > + | poslng RECORDS { $$ = append_lng(append_lng(L(), $1), 0); } > + | poslng OFFSET poslng RECORDS { $$ = append_lng(append_lng(L(), $1), $3); } > ; > > opt_null_string: > @@ -4118,6 +4120,17 @@ > } > ; > > + > +poslng: > + lngval { $$ = $1; > + if ($$ < 0) { > + $$ = -1; > + yyerror("Positive value expected"); > + YYABORT; > + } > + } > + ; > + > posint: > intval { $$ = $1; > if ($$ < 0) { > @@ -4394,6 +4407,10 @@ > { $$ = append_string($1, $3); } > ; > > +lngval: > + sqlINT { $$ = strtoll($1,NULL,10); } > +; > + > intval: > sqlINT { $$ = strtol($1,NULL,10); } > | IDENT { mvc *m = (mvc*)parm; > > U sql_updates.mx > Index: sql_updates.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_updates.mx,v > retrieving revision 1.145 > retrieving revision 1.146 > diff -u -d -r1.145 -r1.146 > --- sql_updates.mx 7 Sep 2008 14:28:00 -0000 1.145 > +++ sql_updates.mx 16 Sep 2008 14:55:42 -0000 1.146 > @@ -1411,11 +1411,11 @@ > char *ssep = (seps->h->next->next)?seps->h->next->next->data.sval:"\""; > char *ns = (null_string)?null_string:"null"; > list *slist; > - int nr = (nr_offset)?nr_offset->h->data.i_val:-1; > - int offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > + lng nr = (nr_offset)?nr_offset->h->data.i_val:-1; > + lng offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > > - assert(!nr_offset || nr_offset->h->type == type_int); > - assert(!nr_offset || nr_offset->h->next->type == type_int); > + assert(!nr_offset || nr_offset->h->type == type_lng); > + assert(!nr_offset || nr_offset->h->next->type == type_lng); > if (sname && !(s=mvc_bind_schema(sql, sname))) { > (void) sql_error(sql, 02, "COPY INTO: no such schema '%s'", sname); > return NULL; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime ll_upwards.mx, , 1.29, 1.30 vx_index.mx, , 1.1, 1.2
by Stefan Manegold 16 Sep '08

16 Sep '08

On Tue, Sep 16, 2008 at 09:19:52AM +0000, Lefteris Sidirourgos wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv29372 > > Modified Files: > ll_upwards.mx vx_index.mx > Log Message: > Trying to fix some compilation errors arised in SunOS and Federa 9 (?). In my > Fedora 9 everything compiled correct. as opposed to (e.g.) gcc 4.1.2 on Fedora 8, gcc 4.3.0 on Fedora 9 (recall, out desktops still run Fedora 8 with gcc 4.1.2), gcc 4.3.1 on Gentoo 1.12.11.1, and Sun Studio 12 compiler on (Open)Solaris 11 seem to adhere to and implement the C99 standard of INLINE declarations. Please see (e.g.) http://www.greenend.org.uk/rjk/2003/03/inline.html and compare "GNU C inline rules" to "C99 inline rules". The latter says (a.o.) " A function where all the declarations (including the definition) mention "inline" and never "extern". There must be a definition in the same translation unit. No stand-alone object code is emitted. You can (must?) have a separate (not inline) definition in another translation unit, and the compiler might choose either that or the inline definition. " Maybe this helps ... Stefan > > > U vx_index.mx > Index: vx_index.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/vx_index.mx,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- vx_index.mx 15 Sep 2008 10:30:29 -0000 1.1 > +++ vx_index.mx 16 Sep 2008 09:19:50 -0000 1.2 > @@ -32,6 +32,8 @@ > @c > #include "pf_config.h" > #include <gdk.h> > +#include "shredder.h" /* for XML_DEPTH_MAX */ > +#include "ll_upwards.h" /* skipholes, speculate_skip, PF_SIBLING_PROBES */ > > #define XQH_UNSGN(v) ((unsigned int) v) > #define XQH_MASK5(c) ((c) & 31) > @@ -190,11 +192,7 @@ > > > @c > -#include "shredder.h" /* for XML_DEPTH_MAX */ > -#include "ll_upwards.h" /* skipholes, speculate_skip, PF_SIBLING_PROBES */ > - > -static > -int > +static int > vx_index_create( /* OUTPUT: */ > unsigned int* pre_hsh, /* - pre_hsh column */ > /* DOCUMENT: */ > > U ll_upwards.mx > Index: ll_upwards.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/ll_upwards.mx,v > retrieving revision 1.29 > retrieving revision 1.30 > diff -u -d -r1.29 -r1.30 > --- ll_upwards.mx 15 Sep 2008 10:26:44 -0000 1.29 > +++ ll_upwards.mx 16 Sep 2008 09:19:50 -0000 1.30 > @@ -90,11 +90,13 @@ > pathfinder runtime. > > @h > +#ifndef LL_UPWARDS_H > +#define LL_UPWARDS_H > #define PF_SIBLING_PROBES 64 > > INLINE oid skipholes(oid, unsigned int *); > oid speculate_skip(oid, oid, oid, int, unsigned int*, unsigned char*); > - > +#endif /* LL_UPWARDS_H */ > > @c > #include "pf_config.h" > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime pathfinder.mx, XQuery_0-24, 1.416.2.12, 1.416.2.13
by Ying Zhang 16 Sep '08

16 Sep '08

On Sep 15, 2008, at 13:33 , Ying Zhang wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv13268 > > Modified Files: > Tag: XQuery_0-24 > pathfinder.mx > Log Message: > backported (JanR's) bugfix from HEAD: Jan, as I could understand that this bug is not an important item in your agenda, I felt free to backport your fix, so that this bug could be closed. I hope this is OK. Regards, Jennie > > > <original log message> > -- Try to fix bug 2015219 by changing the mark offset. > > identical checkin, expecting no conflicts during propagation > > > > U pathfinder.mx > Index: pathfinder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/pathfinder.mx,v > retrieving revision 1.416.2.12 > retrieving revision 1.416.2.13 > diff -u -d -r1.416.2.12 -r1.416.2.13 > --- pathfinder.mx 28 Jun 2008 10:19:09 -0000 1.416.2.12 > +++ pathfinder.mx 15 Sep 2008 11:33:45 -0000 1.416.2.13 > @@ -3226,7 +3226,7 @@ > var attrid := new(void,oid, > 2 > *count > (attr1 > )).seqbase > (0(a)0).append(attr1.project(oid_nil)).append(attr1.project(oid_nil)) > attrid.replace(reverse([oid]([lng] > (reverse(attr_constr(attr1.project(at1qn),attr1,ws).fetch(1))).[*] > (2LL)))); > attrid.replace(reverse([oid]([lng] > (reverse(attr_constr(attr1.project(at2qn),attr2,ws).fetch(1))).[*] > (2LL).[+](1LL)))); > - return elem_constr(attr1.mark(1(a)0),attr1.project(eltqn), > attrid.mirror().[lng]().[/](2LL).[oid](), > + return elem_constr(attr1.mark(0(a)0),attr1.project(eltqn), > attrid.mirror().[lng]().[/](2LL).[oid](), > > attrid.project(oid_nil), attrid.project(oid_nil), > attrid, > attrid.project(WS), ws).fetch(1); > } > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins

2 1

[Monetdb-developers] MoneDB/XQuery problem (importing a module, http access)
by Clarisse Kagoyire 15 Sep '08

15 Sep '08

Hello, I am a student in GeoInformatics at ITC(International Institute for Geo-Information Science and Earth Observation) and I have just started using MonetDB/XQuery for my MSc Research project. But I am facing some problems and your help will be really appreciated: 1. Whenever I try to use any of the options available in the Administrative GUI(like adding, deleting documents, list collections,...), I get an error message. Here is an example of the error returned if I try to list collections: !ERROR: "collections execution failed at the remote side" !ERROR: HTTP/1.1 404 !ERROR: HTTP Response: <?xml version="1.0" encoding="utf-8"?> <env:Envelope xmlns:env="http://www.w3.org/2003/05/soap-envelope"><env:Body><env:Fault ><env:Code><env:Value>env:Sender</env:Value></env:Code><env:Reason><env: Text <http://www.w3.org/2003/05/soap-envelope"><env:Body><env:Fault><env:Code ><env:Value>env:Sender</env:Value></env:Code><env:Reason><env:Text> xml:lang="en">xquery_module_load: could not load module. Due to earlier error: parse error: syntax error, unexpected $end on line 1, column 0 parse error: XQuery parsing failed </env:Text></env:Reason></env:Fault></env:Body></env:Envelope> Note that I can do this (add documents, delete,list...) without any problem using the mclient XQuery.(I think that it's a problem of HTTP access, but I couldn't fix it) 2. Another problem is that I cannot make use of XQuery module, because whenever I import a module i get an error. Here is an example of a simple xquery module from the tutorial that I was tried to import: -the XQuery module saved in E:\Program Files\CWI\MonetDB4\share\MonetDB\xrpc\export\xrpc-mod.xq module namespace foo = "xrpc-test-function"; declare function foo:add($v1 as xs:integer, $v2 as xs:integer) as xs:integer { $v1 + $v2 }; -on mclient, I typed the following to import the module: > import module namespace test = "xrpc-test-function" at "http://127.0.0.1:50001/export/xrpc-mod.xq <http://127.0.0.1:50001/export/xrpc-mod.xq> "; >test:add(100, 200) Which returned also an error: !parse eroor: error parsing module.... I'm looking forward to hearing from you. Thank you , Clarisse K.

2 1

[Monetdb-developers] COPY, terminating connection
by sylver_b 14 Sep '08

14 Sep '08

Hi, When i run the COPY command from a batch script and after few minutes of processing (2,3minutes), and few thousand lines inserted in the DB, im getting : Connection terminated merovingian log is showing: MSG demo[5084]: # MonetDB server v5.6.0, based on kernel v1.24.0 MSG demo[5084]: # Serving database 'demo' MSG demo[5084]: # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked MSG demo[5084]: # Copyright (c) 1993-2008 CWI, all rights reserved MSG demo[5084]: # Visit http://monetdb.cwi.nl/ for further information MSG demo[5084]: # Listening for connection requests on mapi:monetdb://ulys:50001/ MSG merovingian[3981]: proxying client 127.0.0.1:41420 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41420 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41422 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41422 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41424 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41424 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41426 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41426 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41428 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41428 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41430 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41430 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41432 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41434 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41432 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41436 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41434 disconnected from proxy MSG merovingian[3981]: client has 127.0.0.1:41436 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41438 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[3981]: client has 127.0.0.1:41438 disconnected from proxy MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) MSG merovingian[3981]: proxying client 127.0.0.1:41440 for database 'demo' to mapi:monetdb://ulys:50001/ TME 2008-09-12 11:56:46 MSG merovingian[3981]: client has 127.0.0.1:41440 disconnected from proxy This is what my script does : #!/bin/sh FILE=$1 awk -F "\"*;\"*" '{print ";",$1,";",$2,";",$3,";",$4,";",$5,";",$6,";",$8,";",$9,";",$10,";",$13,";",$15,";",$18,";",$22,";",$24,";",$25,";",$26,";",$27,";",$28,";",$29,";",$30,";",$31,";",$32,";",$33,";",$35,";",$36,";",$38,";",$39,";",$42,";",$47,";",$48,";",$49,";",$53,";",$54,";",$55,";","FILE"}' $1 | sed -e "s/ ; /;/g; s/; /;/g" | mclient -lsql -d demo -i -s "COPY INTO cdrwholesaler FROM STDIN USING DELIMITERS ';' NULL AS ''" and this is how i call it : find /usr/ftp -name '*.CDR' -exec /var/www/consolecdr/batch/test_monetdb/awk_csv_generator.sh {} \; Is there anything im doing wrong ? I have the feeling there must be too many connections crashing the system .. coz after that i can't use mclient anymore, i have to restart the DB. Please advise, Thanks SB

4 3

[Monetdb-developers] Re : Re : COPY, terminating connection
by sylver_b 13 Sep '08

13 Sep '08

Hi, Yes it's a 32bit system. 4G of Ram, Quad Xeon. OS: Ubuntu Server 6.10 - Raid10(4x HDs) Total data size > 4G (but could be a lot more, sometimes i need to restream 1month worth of CDRs). I was using a postgres/bizgres DB, and loading data with psql -c, + the COPY command - but didnt like the fact that, if a line was rejected the whole process was stopped, so that's why i've created my own perl ETL script able to ignore rejected entries - which might be the best option finally ? MonetDB's COPY command is doing the same. Also can the mclient re-use an active connection ? Let me know what do you think. Thanks ----- Message d'origine ---- De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> À : sylver_b <sylver_b(a)yahoo.com> Cc : monetdb-developers(a)lists.sourceforge.net Envoyé le : Samedi, 13 Septembre 2008, 9h12mn 53s Objet : Re: [Monetdb-developers] Re : COPY, terminating connection On Sat, Sep 13, 2008 at 12:43:32AM -0700, sylver_b wrote: > Hi Stephan > > >How many (sequential, not concurrent, right?) connections are we talking > >about, i.e., how many *.CDR files do you have? > I wanted to stream about 60 to 100 CDR files > > >How many rows do these *.CDR files hold in total? > some files can contain over half a million records - average is 100~200K lines > > >Are all attributes of the cdrwholesaler table string attributes? > some of them are date/time, timestamp, int, double, but majority is varchar How large is your total data volumne? Does it fit into a 32-bit address space? What kind of machine are you running on? CPU, memory, OS? Given that you're using a 32-bit MonetDB installation, I suppose you hardware and OS is 32-bit, too, isn't it? > It looks like for each call of mclient (probably for each cdr line) a connection is opened. Obviously, you call mclient once for each of you CBR files, and yes, each of these mclient calls make a new connection to the server. For each CBR file (not line!) there should be only one mclient call, and hence, only one connection. Stefan ps: please also note that the vrey fast bulk loading I mentioned only holds for loading from files with the number of rows to be loaded specified in the COPY INTO statement. > SB > > > ----- Message d'origine ---- > De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> > À : sylver_b <sylver_b(a)yahoo.com> > Cc : monetdb-developers(a)lists.sourceforge.net > Envoyé le : Samedi, 13 Septembre 2008, 6h36mn 19s > Objet : Re: [Monetdb-developers] COPY, terminating connection > > On Fri, Sep 12, 2008 at 04:48:43AM -0700, sylver_b wrote: > > Hi, > > > > When i run the COPY command from a batch script and after few minutes of processing (2,3minutes), and few thousand lines inserted in the DB, im getting : > > > > Connection terminated > > > > > > merovingian log is showing: > > > > MSG demo[5084]: # MonetDB server v5.6.0, based on kernel v1.24.0 > > MSG demo[5084]: # Serving database 'demo' > > MSG demo[5084]: # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked > > MSG demo[5084]: # Copyright (c) 1993-2008 CWI, all rights reserved > > MSG demo[5084]: # Visit http://monetdb.cwi.nl/ for further information > > MSG demo[5084]: # Listening for connection requests on mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: proxying client 127.0.0.1:41420 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41420 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41422 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41422 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41424 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41424 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41426 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41426 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41428 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41428 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41430 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41430 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41432 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41434 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41432 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41436 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41434 disconnected from proxy > > MSG merovingian[3981]: client has 127.0.0.1:41436 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41438 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[3981]: client has 127.0.0.1:41438 disconnected from proxy > > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > > MSG merovingian[3981]: proxying client 127.0.0.1:41440 for database 'demo' to mapi:monetdb://ulys:50001/ > > TME 2008-09-12 11:56:46 > > MSG merovingian[3981]: client has 127.0.0.1:41440 disconnected from proxy > > > > > > This is what my script does : > > > > #!/bin/sh > > > > FILE=$1 > > awk -F "\"*;\"*" '{print ";",$1,";",$2,";",$3,";",$4,";",$5,";",$6,";",$8,";",$9,";",$10,";",$13,";",$15,";",$18,";",$22,";",$24,";",$25,";",$26,";",$27,";",$28,";",$29,";",$30,";",$31,";",$32,";",$33,";",$35,";",$36,";",$38,";",$39,";",$42,";",$47,";",$48,";",$49,";",$53,";",$54,";",$55,";","FILE"}' $1 | sed -e "s/ ; /;/g; s/; /;/g" | mclient -lsql -d demo -i -s "COPY INTO cdrwholesaler FROM STDIN USING DELIMITERS ';' NULL AS ''" > > > > and this is how i call it : > > > > find /usr/ftp -name '*.CDR' -exec /var/www/consolecdr/batch/test_monetdb/awk_csv_generator.sh {} \; > > > > > > Is there anything im doing wrong ? I have the feeling there must be too many connections crashing the system .. coz after that i can't use mclient anymore, i have to restart the DB. > > How many (sequential, not concurrent, right?) connections are we talking > about, i.e., how many *.CDR files do you have? > > How many rows do these *.CDR files hold in total? > > Are all attributes of the cdrwholesaler table string attributes? > > ... "too many connections" *might* be the problem (though it should of > course not) --- strange, though, that the merovingian log do not give any > indication of whether, and if so why the server might have crashed ... > > Stefan > > > Please advise, > > Thanks > > SB > > > > > > > > ------------------------------------------------------------------------- > > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > > Build the coolest Linux based applications with Moblin SDK & win great prizes > > Grand prize is a trip for two to an Open Source event anywhere in the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > _______________________________________________ > > Monetdb-developers mailing list > > Monetdb-developers(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > -- > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > | The Netherlands | Fax : +31 (20) 592-4312 | > > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Re : COPY, terminating connection
by sylver_b 13 Sep '08

13 Sep '08

Hi Stephan >How many (sequential, not concurrent, right?) connections are we talking >about, i.e., how many *.CDR files do you have? I wanted to stream about 60 to 100 CDR files >How many rows do these *.CDR files hold in total? some files can contain over half a million records - average is 100~200K lines >Are all attributes of the cdrwholesaler table string attributes? some of them are date/time, timestamp, int, double, but majority is varchar It looks like for each call of mclient (probably for each cdr line) a connection is opened. SB ----- Message d'origine ---- De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> À : sylver_b <sylver_b(a)yahoo.com> Cc : monetdb-developers(a)lists.sourceforge.net Envoyé le : Samedi, 13 Septembre 2008, 6h36mn 19s Objet : Re: [Monetdb-developers] COPY, terminating connection On Fri, Sep 12, 2008 at 04:48:43AM -0700, sylver_b wrote: > Hi, > > When i run the COPY command from a batch script and after few minutes of processing (2,3minutes), and few thousand lines inserted in the DB, im getting : > > Connection terminated > > > merovingian log is showing: > > MSG demo[5084]: # MonetDB server v5.6.0, based on kernel v1.24.0 > MSG demo[5084]: # Serving database 'demo' > MSG demo[5084]: # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked > MSG demo[5084]: # Copyright (c) 1993-2008 CWI, all rights reserved > MSG demo[5084]: # Visit http://monetdb.cwi.nl/ for further information > MSG demo[5084]: # Listening for connection requests on mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: proxying client 127.0.0.1:41420 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41420 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41422 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41422 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41424 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41424 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41426 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41426 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41428 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41428 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41430 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41430 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41432 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41434 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41432 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41436 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41434 disconnected from proxy > MSG merovingian[3981]: client has 127.0.0.1:41436 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41438 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[3981]: client has 127.0.0.1:41438 disconnected from proxy > MSG merovingian[3981]: database 'demo' already running since 2008-09-12 11:44:44, up min/avg/max: 30/37441/213742, crash average: 0.00 0.10 0.03 (8-6=1) > MSG merovingian[3981]: proxying client 127.0.0.1:41440 for database 'demo' to mapi:monetdb://ulys:50001/ > TME 2008-09-12 11:56:46 > MSG merovingian[3981]: client has 127.0.0.1:41440 disconnected from proxy > > > This is what my script does : > > #!/bin/sh > > FILE=$1 > awk -F "\"*;\"*" '{print ";",$1,";",$2,";",$3,";",$4,";",$5,";",$6,";",$8,";",$9,";",$10,";",$13,";",$15,";",$18,";",$22,";",$24,";",$25,";",$26,";",$27,";",$28,";",$29,";",$30,";",$31,";",$32,";",$33,";",$35,";",$36,";",$38,";",$39,";",$42,";",$47,";",$48,";",$49,";",$53,";",$54,";",$55,";","FILE"}' $1 | sed -e "s/ ; /;/g; s/; /;/g" | mclient -lsql -d demo -i -s "COPY INTO cdrwholesaler FROM STDIN USING DELIMITERS ';' NULL AS ''" > > and this is how i call it : > > find /usr/ftp -name '*.CDR' -exec /var/www/consolecdr/batch/test_monetdb/awk_csv_generator.sh {} \; > > > Is there anything im doing wrong ? I have the feeling there must be too many connections crashing the system .. coz after that i can't use mclient anymore, i have to restart the DB. How many (sequential, not concurrent, right?) connections are we talking about, i.e., how many *.CDR files do you have? How many rows do these *.CDR files hold in total? Are all attributes of the cdrwholesaler table string attributes? ... "too many connections" *might* be the problem (though it should of course not) --- strange, though, that the merovingian log do not give any indication of whether, and if so why the server might have crashed ... Stefan > Please advise, > Thanks > SB > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] Re : COPY, terminating connection
by sylver_b 13 Sep '08

13 Sep '08

Hi I can send you a CDR file sample if needed.. please let me know. Thanks ----- Message d'origine ---- De : Fabian Groffen <Fabian.Groffen(a)cwi.nl> À : monetdb-developers(a)lists.sourceforge.net Envoyé le : Samedi, 13 Septembre 2008, 8h33mn 00s Objet : Re: [Monetdb-developers] COPY, terminating connection On 13-09-2008 07:36:19 +0200, Stefan Manegold wrote: > > Is there anything im doing wrong ? I have the feeling there must be too many connections crashing the system .. coz after that i can't use mclient anymore, i have to restart the DB. > > How many (sequential, not concurrent, right?) connections are we talking > about, i.e., how many *.CDR files do you have? > > How many rows do these *.CDR files hold in total? > > Are all attributes of the cdrwholesaler table string attributes? > > ... "too many connections" *might* be the problem (though it should of > course not) --- strange, though, that the merovingian log do not give any > indication of whether, and if so why the server might have crashed ... It can't, because the server didn't crash. It indicates it is still alive. Most probably the server is confused by the amount of inserts, I've seen this a few times before. Somewhere something gets stuck, making the mserver refuse to operate. A restart of the server solves it, as the original reporter also indicates. Note from the logs that the server "demo" had one crash in the past, though. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers

1 0

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/perl Mapi.pm, , 1.5, 1.6
by Sjoerd Mullender 12 Sep '08

12 Sep '08

Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/clients/src/perl > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv29671/src/perl > > Modified Files: > Mapi.pm > Log Message: > propagated changes of Wednesday Sep 10 2008 - Friday Sep 12 2008 > from the Clients_1-24 branch to the development trunk > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > 2008/09/10 - mr-meltdown: src/perl/Mapi.pm,1.5.4.1 > Implemented redirect support in Mapi.pm. While testing I hit the > following error which I don't know what it means (let alone how to fix > it): > > Can't use string ("Xexport 1 100 100") as a HASH ref while "strict refs" > in use at Mapi.pm line 352, <> line 2. > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ I just noticed this log message. Could the cause be that in Mapi.pm there is one place where the function putblock is called *without* $self-> in front of it, and that is exactly the only occurrence of the string "Xexport" in the complete source? My guess is that unpacking the arguments in the putblock function causes the error message. Can you test this? -- Sjoerd Mullender

2 3

[Monetdb-developers] Re : Re : Re : ODBC, no database selected
by sylver_b 11 Sep '08

11 Sep '08

Ok great!! i'm looking forward to some updates when Sjoerd has a chance. Thanks SB ----- Message d'origine ---- De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> À : sylver_b <sylver_b(a)yahoo.com> Cc : monetdb-developers(a)lists.sourceforge.net Envoyé le : Mercredi, 10 Septembre 2008, 9h24mn 06s Objet : Re: [Monetdb-developers] Re : Re : ODBC, no database selected On Wed, Sep 10, 2008 at 01:17:49AM -0700, sylver_b wrote: > That will do fine and i can scrap the perl tool all together if this can do the job - I will try that . Good. --- In fact bulk-loading via COPY INTO is by far the fasted way to load data into MonetDB. > any idea for the ODBC issue ? is it maintained by you guys (cwi ) ? ODBC is maintained at CWI by Sjoerd. I guess, Sjoerd will have a look at it as soon as his time allows. Stefan > Thanks > > > > > ----- Message d'origine ---- > De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> > À : sylver_b <sylver_b(a)yahoo.com> > Cc : monetdb-developers(a)lists.sourceforge.net > Envoyé le : Mercredi, 10 Septembre 2008, 9h06mn 57s > Objet : Re : [Monetdb-developers] ODBC, no database selected > > On Wed, Sep 10, 2008 at 12:21:46AM -0700, sylver_b wrote: > > Hi Stefan, > > > > I've started the DB with the following commands : > > 1. merovingian > > 2. monetdb create demo > > 3. monetdb start demo > > 3. mclient -lsql --time -d demo > > > > I get the prompt straight away, but i have to specify the db - mclient > > -lsql , says: !please specify a database - i don't have any other DB at > > the moment, just evaluating monetdb to migrate a call detail records > > application ; for that purpose i've developed a simple ETL tool in perl > > that extract specific fields from a CSV file and insert them in the DB. > > Maybe there is a better way to do that ? > > In case you need the perl part only for extracting and loading, a simple > work around to get a quick start, in case you/we do not manage to get the > perl interface working for you quickly, would be to either load all fields > from your CSV file using sql "COPY ... INTO .. FROM ..." command (cf., > http://monetdb.cwi.nl/SQL/Documentation/Data-Manipulation.html) or extract > the desired fileds into a separate CSV file, first, and then load using > "COPY ... INTO .. FROM ..." (e.g., via mclient) ... > > Stefan > > > by the way , ps faux gives me : > > root 11224 0.0 0.0 63160 1816 pts/2 Sl 00:17 0:00 merovingian > > root 11229 0.0 1.7 107680 69816 ? Ssl 00:17 0:00 \_ /root/MonetDB/bin/mserver5 --config=/root/MonetD > > B/etc/monetdb5.conf --dbname=demo --dbinit=include sql; --set monet_daemon yes --set mapi_open true --set mapi_port 0 > > --set monet_vault_key /root/MonetDB/var/MonetDB5/dbfarm/demo/.vaultkey > > > > Please advise, > > Thanks > > SB > > > > > > > > > > ----- Message d'origine ---- > > De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> > > À : sylver_b <sylver_b(a)yahoo.com> > > Cc : monetdb-developers(a)lists.sf.net > > Envoyé le : Mercredi, 10 Septembre 2008, 6h19mn 03s > > Objet : Re: [Monetdb-developers] ODBC, no database selected > > > > Hi "sylver_b", > > > > just a simple & quick saniy check: > > > > How did you start your MonetDB server? > > > > Can you connect with `mclient -lsql`? > > > > Stefan > > > > On Tue, Sep 09, 2008 at 04:56:47PM -0700, sylver_b wrote: > > > Hi Eveyone, > > > > > > I'm trying to connect to monetdb with this time, ODBC - but still no luck. > > > > > > Here is the output of my script : > > > > > > ./monetdb2.pl > > > DBI connect('DSN_MonetDB','monetdb',...) failed: [unixODBC][MonetDB][ODBC Driver 1.0]Client unable to establish connection (SQL-08001)(DBD: db_login/SQLConnect err=-1) at ./monetdb2.pl line 6 > > > [unixODBC][MonetDB][ODBC Driver 1.0]Client unable to establish connection (SQL-08001)(DBD: db_login/SQLConnect err=-1) > > > > > > cat monetdb2.pl > > > #!/usr/bin/perl > > > > > > use DBI(); > > > > > > > > > my $dbh = DBI-> connect('dbi:ODBC:DSN_MonetDB', 'monetdb', 'monetdb', {database => demo}) or die ($DBI::errstr . "\n"); > > > > > > if (!$dbh) > > > { > > > print "$DBI::err\n$DBI::errstr\n$DBI::state"; > > > } > > > else > > > { > > > $dbh->disconnect if ($dbh); > > > } > > > > > > my $sth = $dbh->prepare('SELECT * FROM env() env'); > > > $sth->execute; > > > $sth->dump_results; > > > > > > This the merovingian output : > > > tail -f /root/MonetDB/var/log/merovingian.log > > > MSG demo[11229]: # MonetDB server v5.6.0, based on kernel v1.24.0 > > > MSG demo[11229]: # Serving database 'demo' > > > MSG demo[11229]: # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked > > > MSG demo[11229]: # Copyright (c) 1993-2008 CWI, all rights reserved > > > MSG demo[11229]: # Visit http://monetdb.cwi.nl/ for further information > > > MSG demo[11229]: # Listening for connection requests on mapi:monetdb://ulys:50001/ > > > ERR merovingian[11224]: client error: no database specified > > > MSG merovingian[11224]: database 'demo' already running since 2008-09-10 00:17:32, up min/avg/max: 30/2181/7036, crash average: 0.00 0.00 0.00 (6-5=0) > > > MSG merovingian[11224]: proxying client 127.0.0.1:59244 for database 'demo' to mapi:monetdb://ulys:50001/ > > > MSG merovingian[11224]: client has 127.0.0.1:59244 disconnected from proxy > > > > > > ERR merovingian[11224]: client error: no database specified > > > > > > This is the content of my odbc.ini & odbcinst.ini : > > > > > > [DSN_MonetDB] > > > Description = ODBC Driver for MonetDB SQL Server > > > Driver = /root/MonetDB/lib/libMonetODBC.so > > > Port = 50000 > > > Host = localhost > > > Database = demo > > > User = monetdb > > > Password = monetdb > > > Debug = 1 > > > Trace = 1 > > > DebugFile = /var/log/odbc-debugfile.log > > > TraceFile = /var/log/odbc-tracefile.log > > > > > > odbcinst.ini > > > [DSN_MonetDB] > > > Description = ODBC Driver for MonetDB SQL Server > > > Driver = /root/MonetDB/lib/libMonetODBC.so > > > Setup = /root/MonetDB/lib/libMonetODBCs.so > > > FileUsage = 1 > > > CommLog = 1 > > > Debug = 1 > > > > > > I also tried with PHP odbc, same result - how to specify the DB right from the script ? > > > > > > > > > > > > ------------------------------------------------------------------------- > > > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > > > Build the coolest Linux based applications with Moblin SDK & win great prizes > > > Grand prize is a trip for two to an Open Source event anywhere in the world > > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > > _______________________________________________ > > > Monetdb-developers mailing list > > > Monetdb-developers(a)lists.sourceforge.net > > > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > > > > -- > > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > > | The Netherlands | Fax : +31 (20) 592-4312 | > > > > > > > > > -- > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > | The Netherlands | Fax : +31 (20) 592-4312 | > > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal bpm.mx, , 1.137, 1.138 mal_mapi.mx, , 1.16, 1.17
by Stefan Manegold 11 Sep '08

11 Sep '08

On Wed, Sep 10, 2008 at 07:06:16PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv20655 > > Modified Files: > bpm.mx mal_mapi.mx > Log Message: > bpm- defense against failed BATextend As mentioned before, proper error handling would be the better solution than an assert in such cases --- recall and be aware the assertions are disabled in released versions; hence, case of a failing BATextend the released version will react with a segfault! Stefan > > > U bpm.mx > Index: bpm.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/bpm.mx,v > retrieving revision 1.137 > retrieving revision 1.138 > diff -u -d -r1.137 -r1.138 > --- bpm.mx 25 Aug 2008 16:12:42 -0000 1.137 > +++ bpm.mx 10 Sep 2008 19:06:14 -0000 1.138 > @@ -1535,7 +1535,8 @@ > bn= BATdescriptor(px->bid); > if( bn== NULL) > throw(MAL,"bpm.addPartition","Partition BAT not found"); > - BATappend(bn,b,TRUE); > + bn= BATappend(bn,b,TRUE); > + assert(bn!=NULL); ^^^^^^^^^^^^^^^^^ > px ->cnt += BATcount(b); > BBPunfix(bn->batCacheid); > #ifdef _DEBUG_BPM_ > @@ -2266,7 +2267,8 @@ > b= BATdescriptor(i); > if( b== NULL) > throw(MAL,"bpm.fold","Partitioned BAT not found"); > - BATappend(bn,b,FALSE); > + bn= BATappend(bn,b,FALSE); > + assert(bn!=NULL); ^^^^^^^^^^^^^^^^^ > /* remove its persistency counter */ > BBPdecref(b->batCacheid,TRUE); > BBPunfix(b->batCacheid); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal tablet.mx, , 1.170, 1.171
by Stefan Manegold 10 Sep '08

10 Sep '08

On Wed, Sep 10, 2008 at 10:36:27AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv17819 > > Modified Files: > tablet.mx > Log Message: > More defenses. > > > U tablet.mx > Index: tablet.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/tablet.mx,v > retrieving revision 1.170 > retrieving revision 1.171 > diff -u -d -r1.170 -r1.171 > --- tablet.mx 10 Sep 2008 09:30:16 -0000 1.170 > +++ tablet.mx 10 Sep 2008 10:36:19 -0000 1.171 > @@ -1964,10 +1964,12 @@ > for( i=0; i< (int)as->nr_attrs; i++) { > if (as->format[i].c) { > /* prepare enough space */ > - BATextend( as->format[i].c, cnt ); > + as->format[i].c = BATextend( as->format[i].c, cnt ); > + assert(as->format[i].c != NULL); Assertions are (usually) ment for ensuring consistency of the code and its usage and (hence) to detect situations that may/must ("can") not occur under "normal" circumstances; A BATextend (i.e., a malloc) can very well fail in normal circumstance (e.g., when running out of memory); hence, such a situation should (must?) better be detected and handled by some error handling code, not by an assertion; Recall and be aware that assertions are disabled in the release production version, i.e., in this case a failing BATextend (e.g., due to shortage of memory or address space) will lead to undefined behavor of the code, potentially a segmentation fault. This is IMHO not desired ... Stefan > for (j=0; j<nway; j++) { > assert (partition[j]->format[i].c); > - BATappend(as->format[i].c, partition[j]->format[i].c,TRUE); > + as->format[i].c= BATappend(as->format[i].c, partition[j]->format[i].c,TRUE); > + assert(as->format[i].c!= NULL); > BATsave(as->format[i].c); > /* Throw away the temporary bats a.s.a.p. without saveing */ > BBPunfix(partition[j]->format[i].c->batCacheid); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Re : Re : ODBC, no database selected
by sylver_b 10 Sep '08

10 Sep '08

That will do fine and i can scrap the perl tool all together if this can do the job - I will try that . any idea for the ODBC issue ? is it maintained by you guys (cwi ) ? Thanks ----- Message d'origine ---- De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> À : sylver_b <sylver_b(a)yahoo.com> Cc : monetdb-developers(a)lists.sourceforge.net Envoyé le : Mercredi, 10 Septembre 2008, 9h06mn 57s Objet : Re : [Monetdb-developers] ODBC, no database selected On Wed, Sep 10, 2008 at 12:21:46AM -0700, sylver_b wrote: > Hi Stefan, > > I've started the DB with the following commands : > 1. merovingian > 2. monetdb create demo > 3. monetdb start demo > 3. mclient -lsql --time -d demo > > I get the prompt straight away, but i have to specify the db - mclient > -lsql , says: !please specify a database - i don't have any other DB at > the moment, just evaluating monetdb to migrate a call detail records > application ; for that purpose i've developed a simple ETL tool in perl > that extract specific fields from a CSV file and insert them in the DB. > Maybe there is a better way to do that ? In case you need the perl part only for extracting and loading, a simple work around to get a quick start, in case you/we do not manage to get the perl interface working for you quickly, would be to either load all fields from your CSV file using sql "COPY ... INTO .. FROM ..." command (cf., http://monetdb.cwi.nl/SQL/Documentation/Data-Manipulation.html) or extract the desired fileds into a separate CSV file, first, and then load using "COPY ... INTO .. FROM ..." (e.g., via mclient) ... Stefan > by the way , ps faux gives me : > root 11224 0.0 0.0 63160 1816 pts/2 Sl 00:17 0:00 merovingian > root 11229 0.0 1.7 107680 69816 ? Ssl 00:17 0:00 \_ /root/MonetDB/bin/mserver5 --config=/root/MonetD > B/etc/monetdb5.conf --dbname=demo --dbinit=include sql; --set monet_daemon yes --set mapi_open true --set mapi_port 0 > --set monet_vault_key /root/MonetDB/var/MonetDB5/dbfarm/demo/.vaultkey > > Please advise, > Thanks > SB > > > > > ----- Message d'origine ---- > De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> > À : sylver_b <sylver_b(a)yahoo.com> > Cc : monetdb-developers(a)lists.sf.net > Envoyé le : Mercredi, 10 Septembre 2008, 6h19mn 03s > Objet : Re: [Monetdb-developers] ODBC, no database selected > > Hi "sylver_b", > > just a simple & quick saniy check: > > How did you start your MonetDB server? > > Can you connect with `mclient -lsql`? > > Stefan > > On Tue, Sep 09, 2008 at 04:56:47PM -0700, sylver_b wrote: > > Hi Eveyone, > > > > I'm trying to connect to monetdb with this time, ODBC - but still no luck. > > > > Here is the output of my script : > > > > ./monetdb2.pl > > DBI connect('DSN_MonetDB','monetdb',...) failed: [unixODBC][MonetDB][ODBC Driver 1.0]Client unable to establish connection (SQL-08001)(DBD: db_login/SQLConnect err=-1) at ./monetdb2.pl line 6 > > [unixODBC][MonetDB][ODBC Driver 1.0]Client unable to establish connection (SQL-08001)(DBD: db_login/SQLConnect err=-1) > > > > cat monetdb2.pl > > #!/usr/bin/perl > > > > use DBI(); > > > > > > my $dbh = DBI-> connect('dbi:ODBC:DSN_MonetDB', 'monetdb', 'monetdb', {database => demo}) or die ($DBI::errstr . "\n"); > > > > if (!$dbh) > > { > > print "$DBI::err\n$DBI::errstr\n$DBI::state"; > > } > > else > > { > > $dbh->disconnect if ($dbh); > > } > > > > my $sth = $dbh->prepare('SELECT * FROM env() env'); > > $sth->execute; > > $sth->dump_results; > > > > This the merovingian output : > > tail -f /root/MonetDB/var/log/merovingian.log > > MSG demo[11229]: # MonetDB server v5.6.0, based on kernel v1.24.0 > > MSG demo[11229]: # Serving database 'demo' > > MSG demo[11229]: # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked > > MSG demo[11229]: # Copyright (c) 1993-2008 CWI, all rights reserved > > MSG demo[11229]: # Visit http://monetdb.cwi.nl/ for further information > > MSG demo[11229]: # Listening for connection requests on mapi:monetdb://ulys:50001/ > > ERR merovingian[11224]: client error: no database specified > > MSG merovingian[11224]: database 'demo' already running since 2008-09-10 00:17:32, up min/avg/max: 30/2181/7036, crash average: 0.00 0.00 0.00 (6-5=0) > > MSG merovingian[11224]: proxying client 127.0.0.1:59244 for database 'demo' to mapi:monetdb://ulys:50001/ > > MSG merovingian[11224]: client has 127.0.0.1:59244 disconnected from proxy > > > > ERR merovingian[11224]: client error: no database specified > > > > This is the content of my odbc.ini & odbcinst.ini : > > > > [DSN_MonetDB] > > Description = ODBC Driver for MonetDB SQL Server > > Driver = /root/MonetDB/lib/libMonetODBC.so > > Port = 50000 > > Host = localhost > > Database = demo > > User = monetdb > > Password = monetdb > > Debug = 1 > > Trace = 1 > > DebugFile = /var/log/odbc-debugfile.log > > TraceFile = /var/log/odbc-tracefile.log > > > > odbcinst.ini > > [DSN_MonetDB] > > Description = ODBC Driver for MonetDB SQL Server > > Driver = /root/MonetDB/lib/libMonetODBC.so > > Setup = /root/MonetDB/lib/libMonetODBCs.so > > FileUsage = 1 > > CommLog = 1 > > Debug = 1 > > > > I also tried with PHP odbc, same result - how to specify the DB right from the script ? > > > > > > > > ------------------------------------------------------------------------- > > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > > Build the coolest Linux based applications with Moblin SDK & win great prizes > > Grand prize is a trip for two to an Open Source event anywhere in the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > _______________________________________________ > > Monetdb-developers mailing list > > Monetdb-developers(a)lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > -- > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > | The Netherlands | Fax : +31 (20) 592-4312 | > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] Re : Re : Cannot get perl talking to monetdb5 nightly stable
by sylver_b 10 Sep '08

10 Sep '08

Hi Yes i've contacted Steffen- this was his complete answer : On Tue, Sep 9, 2008 at 9:21 AM, Steffen Goeldner wrote: Hi Steffen, I'm experiencing some difficulties with the Perl lib - i've spent the past 3 days trying to get this to work but i can't find any log, any error message etc ... I'm really unhappy that I found no time to maintain the perl modules lately. MonetDB::CLI::MapiPP still speaks protocol version 4, not 5. Maybe the libMapi based MonetDB::CLI::MapiLib works with the current version - I didn't test it. Steffen ----- Message d'origine ---- De : Fabian Groffen <Fabian.Groffen(a)cwi.nl> À : monetdb-developers(a)lists.sourceforge.net Envoyé le : Mercredi, 10 Septembre 2008, 8h11mn 45s Objet : Re: [Monetdb-developers] Re : Cannot get perl talking to monetdb5 nightly stable On 09-09-2008 01:36:21 -0700, sylver_b wrote: > Hi > > For the one wondering why the Perl lib doesn't work with monetdb , this > is the answer from the developer : You had contact with Steffen Goeldner? > >MonetDB::CLI::MapiPP still speaks protocol version 4, not 5. > >Maybe the libMapi based MonetDB::CLI::MapiLib works with the > >current version - I didn't test it. I am trying to come up with a patch for MapiPP, since it's clearly useless in its current state. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers

3 3

[Monetdb-developers] Re : ODBC, no database selected
by sylver_b 10 Sep '08

10 Sep '08

Hi Stefan, I've started the DB with the following commands : 1. merovingian 2. monetdb create demo 3. monetdb start demo 3. mclient -lsql --time -d demo I get the prompt straight away, but i have to specify the db - mclient -lsql , says: !please specify a database - i don't have any other DB at the moment, just evaluating monetdb to migrate a call detail records application ; for that purpose i've developed a simple ETL tool in perl that extract specific fields from a CSV file and insert them in the DB. Maybe there is a better way to do that ? by the way , ps faux gives me : root 11224 0.0 0.0 63160 1816 pts/2 Sl 00:17 0:00 merovingian root 11229 0.0 1.7 107680 69816 ? Ssl 00:17 0:00 \_ /root/MonetDB/bin/mserver5 --config=/root/MonetD B/etc/monetdb5.conf --dbname=demo --dbinit=include sql; --set monet_daemon yes --set mapi_open true --set mapi_port 0 --set monet_vault_key /root/MonetDB/var/MonetDB5/dbfarm/demo/.vaultkey Please advise, Thanks SB ----- Message d'origine ---- De : Stefan Manegold <Stefan.Manegold(a)cwi.nl> À : sylver_b <sylver_b(a)yahoo.com> Cc : monetdb-developers(a)lists.sf.net Envoyé le : Mercredi, 10 Septembre 2008, 6h19mn 03s Objet : Re: [Monetdb-developers] ODBC, no database selected Hi "sylver_b", just a simple & quick saniy check: How did you start your MonetDB server? Can you connect with `mclient -lsql`? Stefan On Tue, Sep 09, 2008 at 04:56:47PM -0700, sylver_b wrote: > Hi Eveyone, > > I'm trying to connect to monetdb with this time, ODBC - but still no luck. > > Here is the output of my script : > > ./monetdb2.pl > DBI connect('DSN_MonetDB','monetdb',...) failed: [unixODBC][MonetDB][ODBC Driver 1.0]Client unable to establish connection (SQL-08001)(DBD: db_login/SQLConnect err=-1) at ./monetdb2.pl line 6 > [unixODBC][MonetDB][ODBC Driver 1.0]Client unable to establish connection (SQL-08001)(DBD: db_login/SQLConnect err=-1) > > cat monetdb2.pl > #!/usr/bin/perl > > use DBI(); > > > my $dbh = DBI-> connect('dbi:ODBC:DSN_MonetDB', 'monetdb', 'monetdb', {database => demo}) or die ($DBI::errstr . "\n"); > > if (!$dbh) > { > print "$DBI::err\n$DBI::errstr\n$DBI::state"; > } > else > { > $dbh->disconnect if ($dbh); > } > > my $sth = $dbh->prepare('SELECT * FROM env() env'); > $sth->execute; > $sth->dump_results; > > This the merovingian output : > tail -f /root/MonetDB/var/log/merovingian.log > MSG demo[11229]: # MonetDB server v5.6.0, based on kernel v1.24.0 > MSG demo[11229]: # Serving database 'demo' > MSG demo[11229]: # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked > MSG demo[11229]: # Copyright (c) 1993-2008 CWI, all rights reserved > MSG demo[11229]: # Visit http://monetdb.cwi.nl/ for further information > MSG demo[11229]: # Listening for connection requests on mapi:monetdb://ulys:50001/ > ERR merovingian[11224]: client error: no database specified > MSG merovingian[11224]: database 'demo' already running since 2008-09-10 00:17:32, up min/avg/max: 30/2181/7036, crash average: 0.00 0.00 0.00 (6-5=0) > MSG merovingian[11224]: proxying client 127.0.0.1:59244 for database 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[11224]: client has 127.0.0.1:59244 disconnected from proxy > > ERR merovingian[11224]: client error: no database specified > > This is the content of my odbc.ini & odbcinst.ini : > > [DSN_MonetDB] > Description = ODBC Driver for MonetDB SQL Server > Driver = /root/MonetDB/lib/libMonetODBC.so > Port = 50000 > Host = localhost > Database = demo > User = monetdb > Password = monetdb > Debug = 1 > Trace = 1 > DebugFile = /var/log/odbc-debugfile.log > TraceFile = /var/log/odbc-tracefile.log > > odbcinst.ini > [DSN_MonetDB] > Description = ODBC Driver for MonetDB SQL Server > Driver = /root/MonetDB/lib/libMonetODBC.so > Setup = /root/MonetDB/lib/libMonetODBCs.so > FileUsage = 1 > CommLog = 1 > Debug = 1 > > I also tried with PHP odbc, same result - how to specify the DB right from the script ? > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] Re : Re : Cannot get perl talking to monetdb5 nightly stable
by sylver_b 10 Sep '08

10 Sep '08

Hi To make this successful, I think ODBC is the best bet here, as i also would like to migrate a PHP application that use Propel (symfony framework) - they don't have monetdb implemented but they do have ODBC. SB ----- Message d'origine ---- De : Fabian Groffen <Fabian.Groffen(a)cwi.nl> À : monetdb-developers(a)lists.sourceforge.net Envoyé le : Mercredi, 10 Septembre 2008, 8h23mn 34s Objet : Re: [Monetdb-developers] Re : Cannot get perl talking to monetdb5 nightly stable On 09-09-2008 01:36:21 -0700, sylver_b wrote: > Hi > > For the one wondering why the Perl lib doesn't work with monetdb , this > is the answer from the developer : > > >MonetDB::CLI::MapiPP still speaks protocol version 4, not 5. > >Maybe the libMapi based MonetDB::CLI::MapiLib works with the > >current version - I didn't test it. I think we should remove MapiPP, it can't and won't work any more. It seems like a relatively large investment to /make/ it work. In contrast, Mapi.pm seems to be up-to-date to the latest protocol, while also being a pure perl implementation. Can you use Mapi.pm for your application? ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers

1 0

[Monetdb-developers] Re : ODBC, no database selected
by sylver_b 10 Sep '08

10 Sep '08

Hi Fabian, Effectively , successful connections are from the mclient. SB ----- Message d'origine ---- De : Fabian Groffen <Fabian.Groffen(a)cwi.nl> À : monetdb-developers(a)lists.sourceforge.net Envoyé le : Mercredi, 10 Septembre 2008, 7h55mn 38s Objet : Re: [Monetdb-developers] ODBC, no database selected Hi Sylver, On 09-09-2008 16:56:47 -0700, sylver_b wrote: [snip] > my $dbh = DBI-> connect('dbi:ODBC:DSN_MonetDB', 'monetdb', 'monetdb', > {database => demo}) or die ($DBI::errstr . "\n"); My perl is pretty much non-existant. However, it looks as if you *do* specify that you want to use a database, "demo" in this case. > This the merovingian output : > tail -f /root/MonetDB/var/log/merovingian.log > MSG demo[11229]: # MonetDB server v5.6.0, based on kernel v1.24.0 > MSG demo[11229]: # Serving database 'demo' > MSG demo[11229]: # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs > dynamically linked > MSG demo[11229]: # Copyright (c) 1993-2008 CWI, all rights reserved > MSG demo[11229]: # Visit http://monetdb.cwi.nl/ for further information > MSG demo[11229]: # Listening for connection requests on mapi:monetdb:// > ulys:50001/ > ERR merovingian[11224]: client error: no database specified > MSG merovingian[11224]: database 'demo' already running since > 2008-09-10 00:17:32, up min/avg/max: 30/2181/7036, crash average: 0.00 > 0.00 0.00 (6-5=0) > MSG merovingian[11224]: proxying client 127.0.0.1:59244 for database > 'demo' to mapi:monetdb://ulys:50001/ > MSG merovingian[11224]: client has 127.0.0.1:59244 disconnected from > proxy > > ERR merovingian[11224]: client error: no database specified Merovingian here sees no database requested. The other successful calls in this log snippet are from mclient or something? > I also tried with PHP odbc, same result - how to specify the DB right > from the script ? Weird. Maybe the odbc driver doesn't catch up the database argument (yet). Sjoerd, any idea on this one? ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers

1 0

[Monetdb-developers] Re : Cannot get perl talking to monetdb5 nightly stable
by sylver_b 10 Sep '08

10 Sep '08

Hi For the one wondering why the Perl lib doesn't work with monetdb , this is the answer from the developer : >MonetDB::CLI::MapiPP still speaks protocol version 4, not 5. >Maybe the libMapi based MonetDB::CLI::MapiLib works with the >current version - I didn't test it. SB ----- Message d'origine ---- De : sylver_b <sylver_b(a)yahoo.com> À : monetdb-developers(a)lists.sourceforge.net Envoyé le : Mardi, 9 Septembre 2008, 8h24mn 06s Objet : RE: [Monetdb-developers] Cannot get perl talking to monetdb5 nightly stable Hi Everyone, I'm also experiencing some difficulties with Perl - i've spent the past 3 days trying to get this to work but i can't find any log, any error message etc ... I've installed all the perl libs , but when i run the test script, it's just stay there indefinitely with no output,no error - this is the script : cat monetdb2.pl #!/usr/bin/perl use DBI(); my $dbh = DBI->connect('dbi:monetdb:'); my $sth = $dbh->prepare('SELECT * FROM env'); $sth->execute; $sth->dump_results; I'm running monetdb with the following command: root@ulys:~# mserver5 --dbinit="include sql;" --dbname=demo --daemon=yes # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /root/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.24.0 loaded when i kill the monetdb daemon, my perl script is throwing this error : # ./monetdb2.pl Caught a SIGPIPE at /usr/local/share/perl/5.8.8/MonetDB/CLI/MapiPP.pm line 93 $ = eval {...} called from file `/usr/local/share/perl/5.8.8/MonetDB/CLI/MapiPP.pm' line 93 $ = MonetDB::CLI::MapiPP::Req::query('MonetDB::CLI::MapiPP::Req=HASH(0x83a66e0)', 'SELECT * FROM env') called from file `/usr/local/share/perl/5.8.8/DBD/monetdb.pm' line 567 $ = eval {...} called from file `/usr/local/share/perl/5.8.8/DBD/monetdb.pm' line 567 $ = DBD::monetdb::st::execute('DBI::st=HASH(0x83a683c)') called from file `./monetdb2.pl' line 8 Aborted Also i can connect with no problem with mclient (no password required). Please advise on how to get perl talking to monetdb5. Thanks in advance, SB ------ original message ------- [Monetdb-developers] Cannot get perl talking to monetdb5 nightly stableFrom: Rt Ibmer <rtibmx@ya...> - 2008-06-17 02:06 I am using the nightly stable build of monetdb5. All outside of perl->monetdb seems to be working just fine. I just can't get perl to talk to the db. Here's what I did: - installed from nightly stable source on Fedora 8 - copied the source from http://homepages.cwi.nl/~mk/MonetDB/The-Perl-Library.html into mytest.pl - tried running: perl /tmp/mytest.pl but it came back complaining about missing libs in @INC. So then I added these steps: - /var/tmp/MonetDB-1213632062/MonetDB-client/clients/src/perl - make install and also ran make instlal in the various subdirs like MonetDB-CLI and others (not sure if this step was necessar) Then I tried running the script and this time it executed without the @INC errors. So this was progress. However all I get is this: ------- Start a simple Monet MIL interaction data sources: dbi:monetdb: -------- and then nothing. It just sits there indefinitely. In playing with the source of the .pl I see that it is the "my $dbh = DBI->connect( $dsn, ..." that execution stops at. I have merovingian running and the db is started. I also tried with merovigan stopped and just using mserver5 --dbinit="include sql;" but I had the same result. Am I doing something wrong? Thanks.

3 3

[Monetdb-developers] ODBC, no database selected
by sylver_b 10 Sep '08

10 Sep '08

Hi Eveyone, I'm trying to connect to monetdb with this time, ODBC - but still no luck. Here is the output of my script : ./monetdb2.pl DBI connect('DSN_MonetDB','monetdb',...) failed: [unixODBC][MonetDB][ODBC Driver 1.0]Client unable to establish connection (SQL-08001)(DBD: db_login/SQLConnect err=-1) at ./monetdb2.pl line 6 [unixODBC][MonetDB][ODBC Driver 1.0]Client unable to establish connection (SQL-08001)(DBD: db_login/SQLConnect err=-1) cat monetdb2.pl #!/usr/bin/perl use DBI(); my $dbh = DBI-> connect('dbi:ODBC:DSN_MonetDB', 'monetdb', 'monetdb', {database => demo}) or die ($DBI::errstr . "\n"); if (!$dbh) { print "$DBI::err\n$DBI::errstr\n$DBI::state"; } else { $dbh->disconnect if ($dbh); } my $sth = $dbh->prepare('SELECT * FROM env() env'); $sth->execute; $sth->dump_results; This the merovingian output : tail -f /root/MonetDB/var/log/merovingian.log MSG demo[11229]: # MonetDB server v5.6.0, based on kernel v1.24.0 MSG demo[11229]: # Serving database 'demo' MSG demo[11229]: # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked MSG demo[11229]: # Copyright (c) 1993-2008 CWI, all rights reserved MSG demo[11229]: # Visit http://monetdb.cwi.nl/ for further information MSG demo[11229]: # Listening for connection requests on mapi:monetdb://ulys:50001/ ERR merovingian[11224]: client error: no database specified MSG merovingian[11224]: database 'demo' already running since 2008-09-10 00:17:32, up min/avg/max: 30/2181/7036, crash average: 0.00 0.00 0.00 (6-5=0) MSG merovingian[11224]: proxying client 127.0.0.1:59244 for database 'demo' to mapi:monetdb://ulys:50001/ MSG merovingian[11224]: client has 127.0.0.1:59244 disconnected from proxy ERR merovingian[11224]: client error: no database specified This is the content of my odbc.ini & odbcinst.ini : [DSN_MonetDB] Description = ODBC Driver for MonetDB SQL Server Driver = /root/MonetDB/lib/libMonetODBC.so Port = 50000 Host = localhost Database = demo User = monetdb Password = monetdb Debug = 1 Trace = 1 DebugFile = /var/log/odbc-debugfile.log TraceFile = /var/log/odbc-tracefile.log odbcinst.ini [DSN_MonetDB] Description = ODBC Driver for MonetDB SQL Server Driver = /root/MonetDB/lib/libMonetODBC.so Setup = /root/MonetDB/lib/libMonetODBCs.so FileUsage = 1 CommLog = 1 Debug = 1 I also tried with PHP odbc, same result - how to specify the DB right from the script ?

3 2

Re: [Monetdb-developers] Cannot get perl talking to monetdb5 nightly stable
by sylver_b 09 Sep '08

09 Sep '08

Hi Everyone, I'm also experiencing some difficulties with Perl - i've spent the past 3 days trying to get this to work but i can't find any log, any error message etc ... I've installed all the perl libs , but when i run the test script, it's just stay there indefinitely with no output,no error - this is the script : cat monetdb2.pl #!/usr/bin/perl use DBI(); my $dbh = DBI->connect('dbi:monetdb:'); my $sth = $dbh->prepare('SELECT * FROM env'); $sth->execute; $sth->dump_results; I'm running monetdb with the following command: root@ulys:~# mserver5 --dbinit="include sql;" --dbname=demo --daemon=yes # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /root/MonetDB/etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.24.0 loaded when i kill the monetdb daemon, my perl script is throwing this error : # ./monetdb2.pl Caught a SIGPIPE at /usr/local/share/perl/5.8.8/MonetDB/CLI/MapiPP.pm line 93 $ = eval {...} called from file `/usr/local/share/perl/5.8.8/MonetDB/CLI/MapiPP.pm' line 93 $ = MonetDB::CLI::MapiPP::Req::query('MonetDB::CLI::MapiPP::Req=HASH(0x83a66e0)', 'SELECT * FROM env') called from file `/usr/local/share/perl/5.8.8/DBD/monetdb.pm' line 567 $ = eval {...} called from file `/usr/local/share/perl/5.8.8/DBD/monetdb.pm' line 567 $ = DBD::monetdb::st::execute('DBI::st=HASH(0x83a683c)') called from file `./monetdb2.pl' line 8 Aborted Also i can connect with no problem with mclient (no password required). Please advise on how to get perl talking to monetdb5. Thanks in advance, SB ------ original message ------- [Monetdb-developers] Cannot get perl talking to monetdb5 nightly stableFrom: Rt Ibmer <rtibmx@ya...> - 2008-06-17 02:06 I am using the nightly stable build of monetdb5. All outside of perl->monetdb seems to be working just fine. I just can't get perl to talk to the db. Here's what I did: - installed from nightly stable source on Fedora 8 - copied the source from http://homepages.cwi.nl/~mk/MonetDB/The-Perl-Library.html into mytest.pl - tried running: perl /tmp/mytest.pl but it came back complaining about missing libs in @INC. So then I added these steps: - /var/tmp/MonetDB-1213632062/MonetDB-client/clients/src/perl - make install and also ran make instlal in the various subdirs like MonetDB-CLI and others (not sure if this step was necessar) Then I tried running the script and this time it executed without the @INC errors. So this was progress. However all I get is this: ------- Start a simple Monet MIL interaction data sources: dbi:monetdb: -------- and then nothing. It just sits there indefinitely. In playing with the source of the .pl I see that it is the "my $dbh = DBI->connect( $dsn, ..." that execution stops at. I have merovingian running and the db is started. I also tried with merovigan stopped and just using mserver5 --dbinit="include sql;" but I had the same result. Am I doing something wrong? Thanks.

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal/Tests tst026.stable.out, , 1.5, 1.6 tst1505.stable.out, , 1.25, 1.26 tst220.stable.out, , 1.39, 1.40 tst280.stable.out, , 1.28, 1.29 tst903.stable.out, , 1.52, 1.53
by Stefan Manegold 06 Sep '08

06 Sep '08

On Sat, Sep 06, 2008 at 11:22:09AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv8410/mal/Tests > > Modified Files: > tst026.stable.out tst1505.stable.out tst220.stable.out > tst280.stable.out tst903.stable.out > Log Message: > The function aggr.count() now returns a lng, because we have to support > tables with more then 3G tuples. > The grouping operations still assume 32 bits to be sufficient. Since we (as far as I can tell) can only support ~2G tuples on 32-bit systems, what about using "wrd" instead of "lng", i.e., 32-bit on 32-bit systems & 64-bit on 64-bit systems? In fact, with with Sjoerd recent changes, BAT cardinalities are of type "BUN" which is currently defined as "oid"; hence, BATs are limited ~2G tuples in case of 32-bit OIDs (even/also on 64-bit systems with 32-bit OIDs) --- a VoID column can obvoiusly not handle more in case of 32-bit OIDs ... Stefan > > > U tst026.stable.out > Index: tst026.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/Tests/tst026.stable.out,v > retrieving revision 1.5 > retrieving revision 1.6 > diff -u -d -r1.5 -r1.6 > --- tst026.stable.out 28 Aug 2008 05:59:11 -0000 1.5 > +++ tst026.stable.out 6 Sep 2008 11:21:53 -0000 1.6 > @@ -18,24 +18,27 @@ > cnt := 0:lng; # 2 cnt:lng := _5:lng > barrier d := true; # 3 d:bit := _7:bit {J11} > f := 1; # 4 f:int := _9:int > - cnt := aggr.count(b); # 5 cnt:lng := aggr.count(b:bat[:oid,:int]) {U} > + cnt := aggr.count(b); # 5 cnt:lng := ALGcount_bat(b:bat[:oid,:int]) > redo d := false; # 6 d:bit := _10:bit {J4} > barrier e := true; # 7 e:bit := _7:bit {J9} > g := 1; # 8 g:int := _9:int > exit e; # 9 e:bit > io.print(g); # 10 _13:void := IOprint_val(g:int) > exit d; # 11 d:bit > - cnt := aggr.count(b); # 12 cnt:lng := aggr.count(b:bat[:oid,:int]) {U} > + cnt := aggr.count(b); # 12 cnt:lng := ALGcount_bat(b:bat[:oid,:int]) > id := calc.oid(cnt); # 13 id:oid := CALClng2oid(cnt:lng) > io.print(f); # 14 _15:void := IOprint_val(f:int) > io.print(g); # 15 _16:void := IOprint_val(g:int) > end foo; # 16 > > function user.main():void; # 0 main:void := user.main() > - user.foo(); # 1 _1:void := user.foo() {U} > + user.foo(); # 1 _1:void := user.foo() > end main; # 2 > +[ 1 ] > +[ 1 ] > +[ 1 ] > > -# 12:49:32 > > -# 12:49:32 > Done. > -# 12:49:32 > > +# 08:57:31 > > +# 08:57:31 > Done. > +# 08:57:31 > > > > U tst1505.stable.out > Index: tst1505.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/Tests/tst1505.stable.out,v > retrieving revision 1.25 > retrieving revision 1.26 > diff -u -d -r1.25 -r1.26 > --- tst1505.stable.out 9 Aug 2008 16:52:00 -0000 1.25 > +++ tst1505.stable.out 6 Sep 2008 11:21:56 -0000 1.26 > @@ -82,9 +82,9 @@ > io.print(y); # 18 _23:void := IOprint_val(y:bat[:oid,:dbl]) > z := batcalc.<(y,2:dbl); # 19 z:bat[:oid,:bit] := CMD_LT_dbl_cst(y:bat[:oid,:dbl], _25:dbl) {G} > io.print(z); # 20 _26:void := IOprint_val(z:bat[:oid,:bit]) > - c := aggr.count(z); # 21 c:int := ALGcount_bat(z:bat[:oid,:bit]) > + c := aggr.count(z); # 21 c:lng := ALGcount_bat(z:bat[:oid,:bit]) > io.print("count"); # 22 _28:void := IOprint_val(_29:str) > - io.print(c); # 23 _30:void := IOprint_val(c:int) > + io.print(c); # 23 _30:void := IOprint_val(c:lng) > x := bat.new(:oid,:bit); # 24 x:bat[:oid,:bit] := CMDBATnew(_2:oid, _32:bit) {G} > bat.append(x,true); # 25 _33:bat[:bit,:any] := BKCappend_val_wrap(x:bat[:oid,:bit], _34:bit) {G} > bat.append(x,false); # 26 _35:bat[:bit,:any] := BKCappend_val_wrap(x:bat[:oid,:bit], _36:bit) {G} > > U tst903.stable.out > Index: tst903.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/Tests/tst903.stable.out,v > retrieving revision 1.52 > retrieving revision 1.53 > diff -u -d -r1.52 -r1.53 > --- tst903.stable.out 12 Aug 2008 14:08:50 -0000 1.52 > +++ tst903.stable.out 6 Sep 2008 11:22:05 -0000 1.53 > @@ -151,22 +151,22 @@ > t1 := alarm.usec(); # 20 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 21 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#copy %d",d0); # 22 _25:void := IOprint_formatted_lng(_26:str, d0:lng) > - cnt := aggr.count(c); # 23 cnt:int := ALGcount_bat(c:bat[:oid,:lng]) > - io.printf("#count %d\n",cnt); # 24 _28:void := IOprint_formatted_int(_29:str, cnt:int) > + cnt := aggr.count(c); # 23 cnt:lng := ALGcount_bat(c:bat[:oid,:lng]) > + io.printf("#count %d\n",cnt); # 24 _28:void := IOprint_formatted_lng(_29:str, cnt:lng) > t0 := alarm.usec(); # 25 t0:lng := ALARMusec() > z := algebra.select(b,25:lng,25:lng);# 26 z:bat[:oid,:lng] := ALGselect(b:bat[:oid,:lng], _31:lng, _31:lng) {G} > t1 := alarm.usec(); # 27 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 28 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select none %d",d0); # 29 _32:void := IOprint_formatted_lng(_33:str, d0:lng) > - cnt := aggr.count(z); # 30 cnt:int := ALGcount_bat(z:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 31 _34:void := IOprint_formatted_int(_35:str, cnt:int) > + cnt := aggr.count(z); # 30 cnt:lng := ALGcount_bat(z:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 31 _34:void := IOprint_formatted_lng(_35:str, cnt:lng) > t0 := alarm.usec(); # 32 t0:lng := ALARMusec() > z2 := algebra.select(b,mi,mx); # 33 z2:bat[:oid,:lng] := ALGselect(b:bat[:oid,:lng], mi:lng, mx:lng) {G} > t1 := alarm.usec(); # 34 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 35 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select all %d",d0); # 36 _37:void := IOprint_formatted_lng(_38:str, d0:lng) > - cnt := aggr.count(z2); # 37 cnt:int := ALGcount_bat(z2:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 38 _39:void := IOprint_formatted_int(_35:str, cnt:int) > + cnt := aggr.count(z2); # 37 cnt:lng := ALGcount_bat(z2:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 38 _39:void := IOprint_formatted_lng(_35:str, cnt:lng) > rng := calc.-(mx,mi); # 39 rng:lng := CALCbinarySUBlnglng(mx:lng, mi:lng) > r2 := calc./(rng,20); # 40 r2:lng := CALCbinarycheckDIVlngint(rng:lng, _42:int) > r3 := calc.+(mi,r2); # 41 r3:lng := CALCbinaryADDlnglng(mi:lng, r2:lng) > @@ -175,8 +175,8 @@ > t1 := alarm.usec(); # 44 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 45 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select 0.05 %d",d0); # 46 _45:void := IOprint_formatted_lng(_46:str, d0:lng) > - cnt := aggr.count(z3); # 47 cnt:int := ALGcount_bat(z3:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 48 _47:void := IOprint_formatted_int(_35:str, cnt:int) > + cnt := aggr.count(z3); # 47 cnt:lng := ALGcount_bat(z3:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 48 _47:void := IOprint_formatted_lng(_35:str, cnt:lng) > r2 := calc./(rng,10); # 49 r2:lng := CALCbinarycheckDIVlngint(rng:lng, _48:int) > r3 := calc.+(mi,r2); # 50 r3:lng := CALCbinaryADDlnglng(mi:lng, r2:lng) > t0 := alarm.usec(); # 51 t0:lng := ALARMusec() > @@ -184,8 +184,8 @@ > t1 := alarm.usec(); # 53 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 54 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select 0.1 %d",d0); # 55 _50:void := IOprint_formatted_lng(_51:str, d0:lng) > - cnt := aggr.count(z4); # 56 cnt:int := ALGcount_bat(z4:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 57 _52:void := IOprint_formatted_int(_35:str, cnt:int) > + cnt := aggr.count(z4); # 56 cnt:lng := ALGcount_bat(z4:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 57 _52:void := IOprint_formatted_lng(_35:str, cnt:lng) > r2 := calc./(rng,5); # 58 r2:lng := CALCbinarycheckDIVlngint(rng:lng, _53:int) > r3 := calc.+(mi,r2); # 59 r3:lng := CALCbinaryADDlnglng(mi:lng, r2:lng) > t0 := alarm.usec(); # 60 t0:lng := ALARMusec() > @@ -193,49 +193,49 @@ > t1 := alarm.usec(); # 62 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 63 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select 0.2 %d",d0); # 64 _55:void := IOprint_formatted_lng(_56:str, d0:lng) > - cnt := aggr.count(z5); # 65 cnt:int := ALGcount_bat(z5:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 66 _57:void := IOprint_formatted_int(_35:str, cnt:int) > + cnt := aggr.count(z5); # 65 cnt:lng := ALGcount_bat(z5:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 66 _57:void := IOprint_formatted_lng(_35:str, cnt:lng) > r3 := calc.+(r3,r2); # 67 r3:lng := CALCbinaryADDlnglng(r3:lng, r2:lng) > t0 := alarm.usec(); # 68 t0:lng := ALARMusec() > z6 := algebra.select(b,mi,r3); # 69 z6:bat[:oid,:lng] := ALGselect(b:bat[:oid,:lng], mi:lng, r3:lng) {G} > t1 := alarm.usec(); # 70 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 71 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select 0.4 %d",d0); # 72 _59:void := IOprint_formatted_lng(_60:str, d0:lng) > - cnt := aggr.count(z6); # 73 cnt:int := ALGcount_bat(z6:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 74 _61:void := IOprint_formatted_int(_35:str, cnt:int) > + cnt := aggr.count(z6); # 73 cnt:lng := ALGcount_bat(z6:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 74 _61:void := IOprint_formatted_lng(_35:str, cnt:lng) > r3 := calc.+(r3,r2); # 75 r3:lng := CALCbinaryADDlnglng(r3:lng, r2:lng) > t0 := alarm.usec(); # 76 t0:lng := ALARMusec() > z7 := algebra.select(b,mi,r3); # 77 z7:bat[:oid,:lng] := ALGselect(b:bat[:oid,:lng], mi:lng, r3:lng) {G} > t1 := alarm.usec(); # 78 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 79 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select 0.6 %d",d0); # 80 _63:void := IOprint_formatted_lng(_64:str, d0:lng) > - cnt := aggr.count(z7); # 81 cnt:int := ALGcount_bat(z7:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 82 _65:void := IOprint_formatted_int(_35:str, cnt:int) > + cnt := aggr.count(z7); # 81 cnt:lng := ALGcount_bat(z7:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 82 _65:void := IOprint_formatted_lng(_35:str, cnt:lng) > r3 := calc.+(r3,r2); # 83 r3:lng := CALCbinaryADDlnglng(r3:lng, r2:lng) > t0 := alarm.usec(); # 84 t0:lng := ALARMusec() > z8 := algebra.select(b,mi,r3); # 85 z8:bat[:oid,:lng] := ALGselect(b:bat[:oid,:lng], mi:lng, r3:lng) {G} > t1 := alarm.usec(); # 86 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 87 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select 0.8 %d",d0); # 88 _67:void := IOprint_formatted_lng(_68:str, d0:lng) > - cnt := aggr.count(z8); # 89 cnt:int := ALGcount_bat(z8:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 90 _69:void := IOprint_formatted_int(_70:str, cnt:int) > + cnt := aggr.count(z8); # 89 cnt:lng := ALGcount_bat(z8:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 90 _69:void := IOprint_formatted_lng(_70:str, cnt:lng) > r3 := calc.+(r3,r2); # 91 r3:lng := CALCbinaryADDlnglng(r3:lng, r2:lng) > t0 := alarm.usec(); # 92 t0:lng := ALARMusec() > z9 := algebra.select(b,mi,r3); # 93 z9:bat[:oid,:lng] := ALGselect(b:bat[:oid,:lng], mi:lng, r3:lng) {G} > t1 := alarm.usec(); # 94 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); # 95 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#select 1.0 %d",d0); # 96 _72:void := IOprint_formatted_lng(_73:str, d0:lng) > - cnt := aggr.count(z9); # 97 cnt:int := ALGcount_bat(z9:bat[:oid,:lng]) > - io.printf(" count %d\n",cnt); # 98 _74:void := IOprint_formatted_int(_70:str, cnt:int) > + cnt := aggr.count(z9); # 97 cnt:lng := ALGcount_bat(z9:bat[:oid,:lng]) > + io.printf(" count %d\n",cnt); # 98 _74:void := IOprint_formatted_lng(_70:str, cnt:lng) > t0 := alarm.usec(); # 99 t0:lng := ALARMusec() > sr := bat.reverse(b); #100 sr:bat[:lng,:oid] := BKCreverse(b:bat[:oid,:lng]) {G} > s := algebra.sort(sr); #101 s:bat[:lng,:oid] := ALGhsort(sr:bat[:lng,:oid]) {G} > t1 := alarm.usec(); #102 t1:lng := ALARMusec() > d0 := calc.-(t1,t0); #103 d0:lng := CALCbinarySUBlnglng(t1:lng, t0:lng) > io.printf("#head sort %d",d0); #104 _77:void := IOprint_formatted_lng(_78:str, d0:lng) > - cnt := aggr.count(s); #105 cnt:int := ALGcount_bat(s:bat[:lng,:oid]) > - io.printf(" count %d\n",cnt); #106 _79:void := IOprint_formatted_int(_70:str, cnt:int) > - cnt := aggr.count(z9); #107 cnt:int := ALGcount_bat(z9:bat[:oid,:lng]) > + cnt := aggr.count(s); #105 cnt:lng := ALGcount_bat(s:bat[:lng,:oid]) > + io.printf(" count %d\n",cnt); #106 _79:void := IOprint_formatted_lng(_70:str, cnt:lng) > + cnt := aggr.count(z9); #107 cnt:lng := ALGcount_bat(z9:bat[:oid,:lng]) > t0 := alarm.usec(); #108 t0:lng := ALARMusec() > _87 := bat.new(nil:oid,nil:lng); #109 _87:bat[:oid,:lng] := CMDBATnew(_88:oid, _89:lng) {G} > barrier (_91,_92,_93) := bat.newIterator(b);#110 (_91:lng, _92:oid, _93:lng) := CHPbunIterator(b:bat[:oid,:lng]) {J115} > > U tst220.stable.out > Index: tst220.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/Tests/tst220.stable.out,v > retrieving revision 1.39 > retrieving revision 1.40 > diff -u -d -r1.39 -r1.40 > --- tst220.stable.out 18 Aug 2008 17:54:50 -0000 1.39 > +++ tst220.stable.out 6 Sep 2008 11:22:03 -0000 1.40 > @@ -93,7 +93,7 @@ > io.printf("after assignment refcount =%d[2]\n",i);# 12 _15:void := IOprint_formatted_int(_16:str, i:int) > #re-use a bat variable > b3 := b; # 14 b3:bat[:int,:str] := b:bat[:int,:str] {G} > - cnt := aggr.count(b3); # 15 cnt:int := ALGcount_bat(b3:bat[:int,:str]) > + cnt := aggr.count(b3); # 15 cnt:lng := ALGcount_bat(b3:bat[:int,:str]) > # forced use > i := bbp.getLRefCount(b); # 17 i:int := CMDgetBATlrefcnt(b:bat[:int,:str]) > io.printf("after 2nd assignment refcount =%d[3]\n",i);# 18 _21:void := IOprint_formatted_int(_22:str, i:int) > > U tst280.stable.out > Index: tst280.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/Tests/tst280.stable.out,v > retrieving revision 1.28 > retrieving revision 1.29 > diff -u -d -r1.28 -r1.29 > --- tst280.stable.out 12 Aug 2008 14:08:47 -0000 1.28 > +++ tst280.stable.out 6 Sep 2008 11:22:04 -0000 1.29 > @@ -47,9 +47,9 @@ > function user.tst(A2:bat[:oid,:int],A3:bat[:oid,:int]):bat[:oid,:int];# 0 tst:bat[:oid,:int] := user.tst(A2:bat[:oid,:int], A3:bat[:oid,:int]) {G} > io.print(A2); # 1 _3:void := IOprint_val(A2:bat[:oid,:int]) > resB := bat.new(:oid,:int); # 2 resB:bat[:oid,:int] := CMDBATnew(_5:oid, _6:int) {G} > - lim := aggr.count(A2); # 3 lim:int := ALGcount_bat(A2:bat[:oid,:int]) > - io.printf("count %d\n",lim); # 4 _8:void := IOprint_formatted_int(_9:str, lim:int) > - l := calc.lng(lim); # 5 l:lng := CALCint2lng(lim:int) > + lim := aggr.count(A2); # 3 lim:lng := ALGcount_bat(A2:bat[:oid,:int]) > + io.printf("count %d\n",lim); # 4 _8:void := IOprint_formatted_lng(_9:str, lim:lng) > + l := calc.lng(lim); # 5 l:lng := CALClng2lng(lim:lng) > barrier (mloop,m) := language.newRange(0:lng);# 6 (mloop:bit, m:lng) := RNGnewRange_lng(_13:lng) {J17} > io.printf("loopindex %d\n",m); # 7 _14:void := IOprint_formatted_lng(_15:str, m:lng) > B2 := algebra.fetch(A2,m); # 8 B2:int := ALGfetch(A2:bat[:oid,:int], m:lng) > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel algebra.mx, MonetDB_5-6, 1.196, 1.196.2.1
by Sjoerd Mullender 02 Sep '08

02 Sep '08

When propagating I noticed this. This change, and the accompanying change in SQL, is not allowed on the stable branch. With this change, a new SQL cannot work with an old MonetDB5 and that makes this change unacceptable. If you want to fix a bug than you will just have to work around it on the SQL side without adding new features in MonetDB5. Your release manager. Sorry Niels. Niels Nes wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv28287/src/modules/kernel > > Modified Files: > Tag: MonetDB_5-6 > algebra.mx > Log Message: > added thetauselect/thetaselect these correctly handle nil cases (the sql semantics way) > > > U algebra.mx > Index: algebra.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/algebra.mx,v > retrieving revision 1.196 > retrieving revision 1.196.2.1 > diff -u -d -r1.196 -r1.196.2.1 > --- algebra.mx 24 Apr 2008 20:28:13 -0000 1.196 > +++ algebra.mx 30 Aug 2008 06:50:36 -0000 1.196.2.1 > @@ -111,6 +111,10 @@ > ordered domain of values, tuples with 'nil' values > are NEVER returned by the range select."; > > +command thetaselect(b:bat[:any_1,:any_2], val:any_2, op:str) :bat[:any_1,:any_2] > +address ALGthetaselect > +comment "The theta (<=,<,=,>,>=) select()"; > + > command select(b:bat[:any_1,:any_2], low:any_2, > high:any_2, li:bit, hi:bit) :bat[:any_1,:any_2] > address ALGselectInclusive > @@ -149,6 +153,7 @@ > command select(b:bat[:any_2,:void], low:any_2) > :bat[:any_2,:void] > address ALGselect1Head; > + > command select(b:bat[:any_2,:void], low:any_2, high:any_2) > :bat[:any_2,:void] > address ALGselectHead; > @@ -186,6 +191,10 @@ > address ALGuselectInclusive > comment "See select() but limited to head values"; > > +command thetauselect(b:bat[:any_1,:any_2], val:any_2, op:str) :bat[:any_1,:oid] > +address ALGthetauselect > +comment "The theta (<=,<,=,>,>=) select() limited to head values"; > + > command uselect(b:bat[:any_1,:any_2], low:any_2, high:any_2):bat[:any_1,:oid] > address ALGuselect; > command uselect(b:bat[:any_1,:any_2], value:any_2) :bat[:any_1,:oid] > @@ -942,8 +951,10 @@ > algebra_export str ALGselect1(int *result, int *bid, ptr value); > algebra_export str ALGselect1Head(int *result, int *bid, ptr value); > algebra_export str ALGuselect1(int *result, int *bid, ptr value); > +algebra_export str ALGthetauselect(int *result, int *bid, ptr value, str *op); > algebra_export str ALGantiuselect1(int *result, int *bid, ptr value); > algebra_export str ALGselect(int *result, int *bid, ptr low, ptr high); > +algebra_export str ALGthetaselect(int *result, int *bid, ptr low, str *op); > algebra_export str ALGselectHead(int *result, int *bid, ptr low, ptr high); > algebra_export str ALGuselect(int *result, int *bid, ptr low, ptr high); > algebra_export str ALGselectInclusive(int *result, int *bid, ptr low, ptr high, bit *lin, bit *rin); > @@ -2495,6 +2506,49 @@ > } > > str > +ALGthetaselect(int *result, int *bid, ptr val, str *OP) > +{ > + ptr nilptr; > + BAT *b, *bn = NULL; > + > + if ((b = BATdescriptor(*bid)) == NULL) { > + throw(MAL, "algebra.thetaselect", "Cannot access descriptor"); > + } > + nilptr = ATOMnilptr(b->ttype); > + @:derefStr(b,t,val);@ > + if (ATOMcmp(b->ttype, val, nilptr) == 0) { > + bn = BATnew(b->htype,b->ttype, 0); > + } else { > + char *op = *OP; > + bit lin = TRUE, rin = TRUE; > + ptr low = nilptr, high = nilptr; > + > + if (op[0] == '=') { > + low = val; > + high = NULL; > + } else if (op[0] == '<') { > + high = val; > + rin = (op[1] == '='); > + } else if (op[0] == '>') { > + low = val; > + lin = (op[1] == '='); > + } else { > + BBPreleaseref(b->batCacheid); > + throw(MAL, "algebra.thetaselect", "unknown operator"); > + } > + CMDselect_(&bn, b, low, high, &lin, &rin); > + } > + BBPreleaseref(b->batCacheid); > + if (bn) { > + if (!(bn->batDirty&2)) bn = BATsetaccess(bn, BAT_READ); > + *result = bn->batCacheid; > + BBPkeepref(*result); > + return MAL_SUCCEED; > + } > + throw(MAL, "algebra.thetaselect", "GDKerror"); > +} > + > +str > ALGselectNotNil(int *result, int *bid) > { > BAT *b, *bn = NULL; > @@ -2567,6 +2621,49 @@ > } > > str > +ALGthetauselect(int *result, int *bid, ptr val, str *OP) > +{ > + ptr nilptr; > + BAT *b, *bn = NULL; > + > + if ((b = BATdescriptor(*bid)) == NULL) { > + throw(MAL, "algebra.thetauselect", "Cannot access descriptor"); > + } > + nilptr = ATOMnilptr(b->ttype); > + @:derefStr(b,t,val);@ > + if (ATOMcmp(b->ttype, val, nilptr) == 0) { > + bn = BATnew(b->htype,TYPE_void, 0); > + } else { > + char *op = *OP; > + bit lin = TRUE, rin = TRUE; > + ptr low = nilptr, high = nilptr; > + > + if (op[0] == '=') { > + low = val; > + high = NULL; > + } else if (op[0] == '<') { > + high = val; > + rin = (op[1] == '='); > + } else if (op[0] == '>') { > + low = val; > + lin = (op[1] == '='); > + } else { > + BBPreleaseref(b->batCacheid); > + throw(MAL, "algebra.thetauselect", "unknown operator"); > + } > + CMDuselect_(&bn, b, low, high, &lin, &rin); > + } > + BBPreleaseref(b->batCacheid); > + if (bn) { > + if (!(bn->batDirty&2)) bn = BATsetaccess(bn, BAT_READ); > + *result = bn->batCacheid; > + BBPkeepref(*result); > + return MAL_SUCCEED; > + } > + throw(MAL, "algebra.thetauselect", "GDKerror"); > +} > + > +str > ALGselectInclusive(int *result, int *bid, ptr low, ptr high, bit *lin, bit *rin) > { > BAT *b, *bn = NULL; > @@ -3776,12 +3873,9 @@ > if( ATOMvarsized(b->ttype) || b->htype != TYPE_void){ > bn= BATwcopy(b); > } else { > - bn= BATnew(b->htype,b->ttype,BATcount(b)); > - bn->H->heap.free = headsize(bn,BATcount(b)); > - bn->T->heap.free = tailsize(bn,BATcount(b)); > + bn = BATnew(b->htype,b->ttype,BATcount(b)); > BATsetcount(bn,BATcount(b)); > - > - bn->tsorted= FALSE; > + bn->tsorted = FALSE; > BATkey(bn,FALSE); > /* head is void */ > BATseqbase(bn, b->hseqbase); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

[Monetdb-developers] Using the MAPI library
by Erin's Ghost 01 Sep '08

01 Sep '08

hello, do you have some sort of tutorial on how to build the MAPI library on Windows (for use in an external program that connects to monet) ? thanks, erin.

2 1

[Monetdb-developers] Bug report: Poor query performance
by Elad . 31 Aug '08

31 Aug '08

Hi, I have a database with 52 columns and 7 million rows. The columns are Date (timestamp data type), Customer (real data type) and a bunch of other columns that indicate values for each customer on each date (all of these columns are of real data type). The 'Date' column contains 5 unique values. The 'Customer' column contains 1.7 million unique values. 1. The following query returns instantly: SELECT "CUSTOMER" FROM "TABLE". 2. The following query takes a long time (stopped after a few minutes): SELECT "CUSTOMER" FROM "TABLE" GROUP BY "CUSTOMER". 3. The following query returns instantly: SELECT "DATE", "CUSTOMER" FROM "TABLE" GROUP BY "DATE", "CUSTOMER". 4. The following query takes a long time (stopped after a few minutes): SELECT "CUSTOMER", "DATE" from "TABLE" GROUP BY "CUSTOMER", "DATE". * Note that the only difference between query 1 and query 2 are the addition of a group by clause to query 2. * Note that the only difference between query 3 and query 4 are the order of columns in the select and group by clauses. Is there a way to work around this? I'm really stuck. Thanks in advance, Elad _________________________________________________________________ Talk to your Yahoo! Friends via Windows Live Messenger. Find out how. http://www.windowslive.com/explore/messenger?ocid=TXT_TAGLM_WL_messenger_ya…

2 1

[Monetdb-developers] Days of week
by Aviad Harell 31 Aug '08

31 Aug '08

Hi there, Is there a ways to extract days of week (1-7) from a timestamp columns? 10-08-2008 will result: Sunday or 1; 11-08-2008 will result: Monday or 2 thanks, Aviad

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 merovingian.mx, , 1.53, 1.54
by Martin Kersten 30 Aug '08

30 Aug '08

Interesting step. Pushes me forward.... after i have solved some issues, like reading thesi.... Fabian wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5 > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv11537 > > Modified Files: > merovingian.mx > Log Message: > Merovingian now sends a list of discovered databases (tested with nc) > > % nc -U $INSTALL_DIR/var/MonetDB5/dbfarm/.merovingian_control > anelosimus eximius > sdss mapi:monetdb://tweek.ins.cwi.nl:50000/ > > > > U merovingian.mx > Index: merovingian.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/merovingian.mx,v > retrieving revision 1.53 > retrieving revision 1.54 > diff -u -d -r1.53 -r1.54 > --- merovingian.mx 30 Aug 2008 10:52:12 -0000 1.53 > +++ merovingian.mx 30 Aug 2008 11:17:12 -0000 1.54 > @@ -805,19 +805,6 @@ > return(NO_ERR); > } > > -static void > -listDiscoveries(stream *fout) > -{ > - remotedb rdb; > - > - rdb = _merovingian_remotedbs; > - while (rdb != NULL) { > - stream_printf(fout, "%s\t%s\t%d\n", > - rdb->dbname, rdb->conn, rdb->ttl); > - rdb = rdb->next; > - } > -} > - > static err > handleClient(int sock) > { > @@ -945,15 +932,6 @@ > *s = 0; > } > > - if (strcmp(lang, "eximius") == 0) { > - /* return a list of remote databases from our Aranita */ > - listDiscoveries(fout); > - stream_flush(fout); > - close_stream(fout); > - close_stream(fdin); > - return(NO_ERR); > - } > - > if (*database == '\0') { > /* we need to have a database, if we haven't gotten one, > * complain */ > @@ -1363,6 +1341,22 @@ > "%s is not controlled by merovingian\n", q); > send(msgsock, buf2, len, 0); > } > + } else if (strcmp(q, "anelosimus") == 0 && > + strcmp(p, "eximius") == 0) > + { > + /* return a list of remote databases from our Aranita */ > + remotedb rdb; > + > + rdb = _merovingian_remotedbs; > + while (rdb != NULL) { > + len = snprintf(buf2, sizeof(buf2), "%s\t%s\n", > + rdb->dbname, rdb->conn); > + send(msgsock, buf2, len, 0); > + rdb = rdb->next; > + } > + /* because this command is multi line, you can't > + * combine it, disconnect the client */ > + break; > } else { > fprintf(stderr, "unknown control command: %s", p); > len = snprintf(buf2, sizeof(buf2), > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins >

2 1

[Monetdb-developers] Multipale stamtents in odbc command
by Aviad Harell 26 Aug '08

26 Aug '08

Hi, First i have to say that MonetDb is amazing database. Now, I'm using MonetDb Odbc. i m trying to execute command that contains create function statement and i get general error. My function is : create function create_date(y int, m int, d int) returns date external name mtime.date . any ideas? Tnx and keep the amazing job. Aviad.

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal remote.mx, , 1.48, 1.49
by Romulo Goncalves 24 Aug '08

24 Aug '08

Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv27157 > > Modified Files: > remote.mx > Log Message: > Redo remote.mx to no longer have externally visible functions that are only for internal use. Also minimise the number of messages a bit. remote now assumes a strict typed scenario, meaning remote.get will require the variable to assign to to be typed. But how bpm will compile with these changes? I am calling these functions there... Romulo > > U remote.mx > Index: remote.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/mal/remote.mx,v > retrieving revision 1.48 > retrieving revision 1.49 > diff -u -d -r1.48 -r1.49 > --- remote.mx 13 Aug 2008 13:05:36 -0000 1.48 > +++ remote.mx 20 Aug 2008 11:10:59 -0000 1.49 > @@ -93,18 +93,10 @@ > address RMTdestroy > comment "Destroys a previously created connection."; > > -pattern describe(ident:str):void > -address RMTdescribe > -comment "Prints a description of the given identifier"; > - > pattern get(conn:str, ident:rmtobj):any > address RMTget > comment "Retrieves a copy of a remote object."; > > -pattern getnextid():void > -address RMTgetnextid > -comment "Prints the next unique local identifier"; > - > pattern put(conn:str, object:any):rmtobj > address RMTput > comment "Copy an object to a remote site and returns its identifier."; > @@ -118,10 +110,6 @@ > comment "Remotely executes function mod.func using the argument list > of remote objects and returns the handle to its result"; > > -@- > -@{ > -TODO: this is not thread safe yet and we should check stability > -wrt broken communication lines. > @h > > #ifndef _REMOTE_DEF > @@ -146,21 +134,22 @@ > #include "remote.h" /* for the implementation of the functions */ > > @- > - > +TODO: thread safe or not? Technically, these methods need to be > +serialised per connection, hence a scheduler that interleaves e.g. > +multiple get calls, simply violates this constraint. If parallelism to > +the same site is desired, a user could create a second connection. > @- Implementation > @h > typedef struct _connection { > char name[16]; /* name of the connection, > - 15 chars should be enough for everyone */ > + 15 chars should be enough for everyone */ > Mapi mconn; /* the Mapi handle for the connection */ > + size_t nextid; /* id counter */ > struct _connection *next; /* the next connection in the list */ > } *connection; > > remote_export str RMTprelude(int *ret); > remote_export str RMTepilogue(int *ret); > -remote_export str RMTinternalput(str *ret, Mapi mconn, int type, ptr value); > -remote_export str RMTinternalget(Mapi mconn, str ident, ValPtr v); > -remote_export str RMTfindconn(connection *ret, str conn); > > @- > > @@ -171,15 +160,14 @@ > * Helper function to return a connection matching a given string, or an > * error if it does not exist. Before the connection is returned, it is > * made sure that it is usable. If the connection cannot be made > - * useable, an error is returned. > + * useable, an error is returned. Since this function is internal, it > + * doesn't check the argument conn, as it should have been checked > + * already. > */ > -str > +static INLINE str > RMTfindconn(connection *ret, str conn) { > connection c = connections; > > - /* conn should be passed as valid variable here */ > - > - > /* just make sure the return isn't garbage */ > *ret = NULL; > > @@ -202,11 +190,28 @@ > } > > /** > + * Little helper function that returns a GDKmalloced string containing a > + * valid identifier that is supposed to be unique in the connection's > + * remote context. Since this function is internal, it doesn't check > + * the argument conn, as it should have been checked already. > + */ > +static INLINE str /*synchronized*/ > +RMTgetNextId(str *ret, connection conn) { > + char buf[128]; > + snprintf(buf, 128, "remote_%s_id_" SZFMT, conn->name, conn->nextid++); > + *ret = GDKstrdup(buf); > + return(MAL_SUCCEED); > +} > + > +/** > * Helper function to execute a query over the given connection, > * returning the result handle. If communication fails in one way or > - * another, an error is returned. > + * another, an error is returned. Since this function is internal, it > + * doesn't check the input arguments func, conn and query, as they > + * should have been checked already. > */ > -static INLINE str RMTquery(MapiHdl *ret, str func, Mapi conn, str query) { > +static INLINE str > +RMTquery(MapiHdl *ret, str func, Mapi conn, str query) { > MapiHdl mhdl; > > *ret = NULL; > @@ -225,7 +230,7 @@ > throw(IO, func, "an error occurred on connection: %s", > mapi_error_str(conn)); > } else { > - throw(IO, func, "remote function invocation didn't return a result"); > + throw(MAL, func, "remote function invocation didn't return a result"); > } > } > > @@ -233,143 +238,83 @@ > return(MAL_SUCCEED); > } > > -/** > - * Helper function to place the given object on the remote host via the > - * given connection. An id will be fetched from the remote host, and > - * set in ret if no problems occur, on which an error is returned. The > - * id can be used to reference the object put on the remote host. > - */ > -str > -RMTinternalput(str *ret, Mapi mconn, int type, ptr value) { > - str tmp; > - str ident; > - MapiHdl mhdl = NULL; > - > - /* get a free identifier on the remote host */ > - rethrow("remote.put", tmp, RMTquery(&mhdl, "remote.put", mconn, "remote.getnextid();")); > - mapi_fetch_row(mhdl); /* should succeed */ > - tmp = mapi_fetch_field(mhdl, 0); /* should be there */ > - if (tmp == NULL) { > - mapi_close_handle(mhdl); > - throw(MAL, "remote.put", "missing first column in tuple"); > - } > - /* allocate on the stack as not to leak when we error lateron */ > - ident = alloca(sizeof(char) * (strlen(tmp) + 1)); > - memcpy(ident, tmp, strlen(tmp) + 1); > - mapi_close_handle(mhdl); > - > - /* depending on the input object generate actions to store the > - * object remotely*/ > - if (type == TYPE_any || isAnyExpression(type)) { > - throw(MAL, "remote.put", "cannot deal with '%s' type", > - getTypeName(type)); > - } else if (isaBatType(type)) { > - BATiter bi; > - /* naive approach using bat.new() and bat.insert() calls */ > - char head[10], tail[10]; > - char qbuf[512]; /* FIXME: this should be dynamic */ > - int bid; > - BAT *b; > - BUN p, q; > - str headv, tailv; > - > - if (getHeadIndex(type) > 0) { > - sprintf(head, "any%c%d", TMPMARKER, getHeadIndex(type)); > - } else if (getHeadType(type) == TYPE_any) { > - sprintf(head, "any"); > - } else { > - sprintf(head, "%s", ATOMname(getHeadType(type))); > - } > - if (getTailIndex(type) > 0) { > - sprintf(tail, "any%c%d", TMPMARKER, getTailIndex(type)); > - } else if (getTailType(type) == TYPE_any) { > - sprintf(tail, "any"); > - } else { > - sprintf(tail, "%s", ATOMname(getTailType(type))); > - } > +str RMTprelude(int *ret) { > + (void)ret; > > - bid = *(int *)value; > - if ((b = BATdescriptor(bid)) == NULL) > - throw(MAL, "remote.put", "cannot access BAT descriptor"); > + return(MAL_SUCCEED); > +} > > - qbuf[511] = '\0'; > - snprintf(qbuf, 511, "%s := bat.new(:%s, :%s, " SZFMT ");", > - ident, head, tail, BATcount(b)); > +str RMTepilogue(int *ret) { > + connection c = connections, t; > > - rethrow("remote.put", tmp, RMTquery(&mhdl, "remote.put", mconn, qbuf)); > - mapi_close_handle(mhdl); > + (void)ret; > > - headv = tailv = NULL; > - bi = bat_iterator(b); > - BATloop(b, p, q) { > - ATOMformat(getHeadType(type), BUNhead(bi, p), &headv); > - ATOMformat(getTailType(type), BUNtail(bi, p), &tailv); > - snprintf(qbuf, 511, "bat.insert(%s, %s:%s, %s:%s);", > - ident, headv, head, tailv, tail); > - rethrow("remote.put", tmp, RMTquery(&mhdl, "remote.put", mconn, qbuf)); > - /* we leak headv and tailv here if an exception is thrown */ > - mapi_close_handle(mhdl); > - } > - GDKfree(headv); > - GDKfree(tailv); > - BBPunfix(b->batCacheid); > - } else { > - str val = NULL; > - char qbuf[512]; /* FIXME: this should be dynamic */ > - if (ATOMvarsized(type)) { > - ATOMformat(type, *(str *)value, &val); > - } else { > - ATOMformat(type, value, &val); > - } > - snprintf(qbuf, 511, "%s := %s:%s;\n", ident, val, ATOMname(type)); > - qbuf[511] = '\0'; > - GDKfree(val); > - rethrow("remote.put", tmp, RMTquery(&mhdl, "remote.put", mconn, qbuf)); > - mapi_close_handle(mhdl); > + /* free connections list */ > + while (c != NULL) { > + t = c; > + c = c->next; > + mapi_destroy(t->mconn); > + GDKfree(t); > } > + /* not sure, but better be safe than sorry */ > + connections = NULL; > > - *ret = GDKstrdup(ident); > return(MAL_SUCCEED); > } > > +@h > +remote_export str RMTget(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > +@c > /** > - * Helper function to return a remote object via the given connection as > - * a local object. > + * get fetches the object referenced by ident over connection conn. > */ > -str > -RMTinternalget(Mapi mconn, str ident, ValPtr v) { > - str type, tmp; > - int vtype; > +str RMTget(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) { > + str conn, ident, tmp; > + connection c; > char qbuf[512]; > MapiHdl mhdl; > + int rtype; > + ValPtr v; > > - snprintf(qbuf, 511, "remote.describe(\"%s\");", ident); > - rethrow("remote.get", tmp, RMTquery(&mhdl, "remote.get", mconn, qbuf)); > + (void)cntxt; > + (void)mb; > > - mapi_fetch_row(mhdl); /* should succeed */ > - type = mapi_fetch_field(mhdl, 0); /* should be there */ > - if (type == NULL) { > - mapi_close_handle(mhdl); > - throw(MAL, "remote.get", "missing first column in tuple"); > + conn = (str)getArgValue(stk, pci, 1); > + if (conn == NULL || strcmp(conn, (str)str_nil) == 0) > + throw(ILLARG, "remote.get", "connection name is NULL or nil"); > + ident = (str)getArgValue(stk, pci, 2); > + if (isIdentifier(ident) < 0) > + throw(ILLARG, "remote.get", "identifier expected, got '%s'", ident); > + > + /* lookup conn, set mconn if valid */ > + rethrow("remote.get", tmp, RMTfindconn(&c, conn)); > + > + rtype = getArgType(mb, pci, 0); > + v = &stk->stk[getArg(pci, 0)]; > + > + if (rtype == TYPE_any || isAnyExpression(rtype)) { > + throw(MAL, "remote.get", "cannot deal with any (%s) type", > + getTypeName(rtype)); > } > > - vtype = getTypeIndex(type, (int) strlen(type), -1); > - if (vtype == TYPE_bat) { > + if (isaBatType(rtype)) { > int h, t, s; > ptr l, r; > lng len; > str val, var; > BAT *b; > > - /* no checks on the existence of the values */ > - val = mapi_fetch_field(mhdl, 1); > - h = getTypeIndex(val, (int) strlen(val), -1); > - val = mapi_fetch_field(mhdl, 2); > - t = getTypeIndex(val, (int) strlen(val), -1); > - vtype = newBatType(h, t); > - val = mapi_fetch_field(mhdl, 3); > + snprintf(qbuf, 511, "user.remote_internal_servegetbat(\"%s\", %s);", > + getTypeName(rtype), ident); > + rethrow("remote.get", tmp, > + RMTquery(&mhdl, "remote.get", c->mconn, qbuf)); > + mapi_fetch_row(mhdl); /* should succeed */ > + val = mapi_fetch_field(mhdl, 0); > + if (val == NULL) { > + mapi_close_handle(mhdl); > + throw(MAL, "remote.get", "missing first column in tuple"); > + } > len = atol(val); > - mapi_close_handle(mhdl); > > #if SIZEOF_SIZE_T == 4 > if ((lng)(len & 0x80000000FFFFFFFF) != len) > @@ -378,15 +323,18 @@ > #endif > /* FIXME: len < 0 ???? */ > > - snprintf(qbuf, 511, "io.print(%s);", ident); > - rethrow("remote.get", tmp, RMTquery(&mhdl, "remote.get", mconn, qbuf)); > - > assert(0 <= len && len <= (lng)GDK_oid_max); > + h = getHeadType(rtype); > + t = getTailType(rtype); > b = BATnew(h, t, (size_t)len); > > while (len-- > 0) { > - mapi_fetch_row(mhdl); > - val = mapi_fetch_field(mhdl, 0); /* should be there */ > + if (mapi_fetch_row(mhdl) == 0) { > + mapi_close_handle(mhdl); > + throw(MAL, "remote.get", > + "expected %d more rows in result", len + 1); > + } > + val = mapi_fetch_field(mhdl, 0); /* should both be there */ > var = mapi_fetch_field(mhdl, 1); > if (ATOMvarsized(h)) { > l = (ptr)(val == NULL ? str_nil : val); > @@ -413,28 +361,26 @@ > if (!ATOMvarsized(t)) GDKfree(r); > } > > - /* adjust the return type */ > - v->vtype = vtype; > v->val.ival = b->batCacheid; > - } else if (vtype == TYPE_any) { > - mapi_close_handle(mhdl); > - throw(MAL, "remote.get", "can't handle variables of type 'any'"); > } else { > - /* we risk getting something we don't understand here */ > ptr p = NULL; > str val; > int len = 0; > > - /* no checks on the existence of the value */ > - val = mapi_fetch_field(mhdl, 1); > + snprintf(qbuf, 511, "user.remote_internal_serveget(\"%s\", %s);", > + getTypeName(rtype), ident); > + rethrow("remote.get", tmp, > + RMTquery(&mhdl, "remote.get", c->mconn, qbuf)); > + mapi_fetch_row(mhdl); /* should succeed */ > + val = mapi_fetch_field(mhdl, 0); > > - if (ATOMvarsized(vtype)) { > - VALset(v, vtype, GDKstrdup(val)); > + if (ATOMvarsized(rtype)) { > + VALset(v, rtype, GDKstrdup(val == NULL ? str_nil : val)); > } else { > - ATOMfromstr(vtype, &p, &len, val); > + ATOMfromstr(rtype, &p, &len, val == NULL ? "nil" : val); > if (p != NULL) { > - VALset(v, vtype, p); > - if (ATOMextern(vtype) == 0) > + VALset(v, rtype, p); > + if (ATOMextern(rtype) == 0) > GDKfree(p); > } else { > char tval[512]; > @@ -451,194 +397,116 @@ > return(MAL_SUCCEED); > } > > -str RMTprelude(int *ret) { > - (void)ret; > - > - return(MAL_SUCCEED); > -} > - > -str RMTepilogue(int *ret) { > - connection c = connections, t; > - > - (void)ret; > - > - /* free connections list */ > - while (c != NULL) { > - t = c; > - c = c->next; > - mapi_destroy(t->mconn); > - GDKfree(t); > - } > - /* not sure, but better be safe than sorry */ > - connections = NULL; > - > - return(MAL_SUCCEED); > -} > - > @h > -remote_export str RMTdescribe(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > +remote_export str RMTput(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > @c > /** > - * Describe() prints a descriptive string for the given identifier ident. > - * This method is used by get() to retrieve an object. Describe() prints > - * a single tuple with information on the object. The first column in > - * the tuple is the MAL type of the object. Depending on this, the > - * other columns are filled in. For scalar data types, the second > - * column represents the value of the scalar as a string, e.g. > - * [ "int", 1 ] > - * More complex types that need to be fetched afterwards just get extra > - * information where available, e.g. to describe a BAT with oid head and > - * str tail and one BUN: > - * [ "bat", "oid", "str", 1 ] > + * stores the given object on the remote host. The identifier of the > + * object on the remote host is returned for later use. > */ > -str RMTdescribe(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) { > - int i; > - str name; > - VarPtr n; > +str RMTput(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) { > + str conn, tmp; > + str ident; > + connection c; > ValPtr v; > - char ret[256]; > + int type; > + ptr value; > + MapiHdl mhdl = NULL; > > - (void) cntxt; > - name = (str)getArgValue(stk, pci, 1); > - i = findVariable(mb, name); > - if (i < 0) > - throw(MAL, "remote.describe", "no such object '%s'", name); > + (void)cntxt; > > - n = getVar(mb, i); > - v = stk->stk + i; > - if (n->type == TYPE_any || isAnyExpression(n->type)) { > - throw(MAL, "remote.describe", "cannot deal with '%s' type", > - getTypeName(n->type)); > - } else if (isaBatType(n->type)) { > + conn = (str)getArgValue(stk, pci, 1); > + if (conn == NULL || strcmp(conn, (str)str_nil) == 0) > + throw(ILLARG, "remote.put", "connection name is NULL or nil"); > + > + /* lookup conn */ > + rethrow("remote.put", tmp, RMTfindconn(&c, conn)); > + > + /* put the thing */ > + type = getArgType(mb, pci, 2); > + value = getArgReference(stk, pci, 2); > + > + /* get a free identifier for the remote host */ > + RMTgetNextId(&tmp, c); > + /* allocate on the stack as not to leak when we error lateron */ > + ident = alloca(sizeof(char) * (strlen(tmp) + 1)); > + memcpy(ident, tmp, strlen(tmp) + 1); > + GDKfree(tmp); /* FIXME, this is inefficient... */ > + > + /* depending on the input object generate actions to store the > + * object remotely*/ > + if (type == TYPE_any || isAnyExpression(type)) { > + throw(MAL, "remote.put", "cannot deal with '%s' type", > + getTypeName(type)); > + } else if (isaBatType(type)) { > + BATiter bi; > + /* naive approach using bat.new() and bat.insert() calls */ > char head[10], tail[10]; > + char qbuf[512]; /* FIXME: this should be dynamic */ > + int bid; > BAT *b; > + BUN p, q; > + str headv, tailv; > > - if (getHeadIndex(n->type) > 0) { > - sprintf(head, "any%c%d", TMPMARKER, getHeadIndex(n->type)); > - } else if (getHeadType(n->type) == TYPE_any) { > + if (getHeadIndex(type) > 0) { > + sprintf(head, "any%c%d", TMPMARKER, getHeadIndex(type)); > + } else if (getHeadType(type) == TYPE_any) { > sprintf(head, "any"); > } else { > - sprintf(head, "%s", ATOMname(getHeadType(n->type))); > + sprintf(head, "%s", ATOMname(getHeadType(type))); > } > - if (getTailIndex(n->type) > 0) { > - sprintf(tail, "any%c%d", TMPMARKER, getTailIndex(n->type)); > - } else if (getTailType(n->type) == TYPE_any) { > + if (getTailIndex(type) > 0) { > + sprintf(tail, "any%c%d", TMPMARKER, getTailIndex(type)); > + } else if (getTailType(type) == TYPE_any) { > sprintf(tail, "any"); > } else { > - sprintf(tail, "%s", ATOMname(getTailType(n->type))); > + sprintf(tail, "%s", ATOMname(getTailType(type))); > } > > - if ((b = BATdescriptor(v->val.ival)) == NULL) > - throw(MAL, "remote.describe", > - "invalid BAT descriptor for '%s'", name); > - snprintf(ret, 255, "[ \"bat\",\t\"%s\",\t\"%s\",\t" SZFMT "\t]", > - head, tail, BATcount(b)); > + bid = *(int *)value; > + if ((b = BATdescriptor(bid)) == NULL) > + throw(MAL, "remote.put", "cannot access BAT descriptor"); > + > + qbuf[511] = '\0'; > + snprintf(qbuf, 511, "%s := bat.new(:%s, :%s, " SZFMT ");", > + ident, head, tail, BATcount(b)); > + > + rethrow("remote.put", tmp, RMTquery(&mhdl, "remote.put", c->mconn, qbuf)); > + mapi_close_handle(mhdl); > + > + headv = tailv = NULL; > + bi = bat_iterator(b); > + BATloop(b, p, q) { > + ATOMformat(getHeadType(type), BUNhead(bi, p), &headv); > + ATOMformat(getTailType(type), BUNtail(bi, p), &tailv); > + snprintf(qbuf, 511, "bat.insert(%s, %s:%s, %s:%s);", > + ident, headv, head, tailv, tail); > + rethrow("remote.put", tmp, RMTquery(&mhdl, "remote.put", c->mconn, qbuf)); > + /* we leak headv and tailv here if an exception is thrown */ > + mapi_close_handle(mhdl); > + } > + GDKfree(headv); > + GDKfree(tailv); > BBPunfix(b->batCacheid); > } else { > str val = NULL; > - if (ATOMvarsized(n->type)) { > - ATOMformat(n->type, *(str *)v, &val); > + char qbuf[512]; /* FIXME: this should be dynamic */ > + if (ATOMvarsized(type)) { > + ATOMformat(type, *(str *)value, &val); > } else { > - ATOMformat(n->type, v, &val); > + ATOMformat(type, value, &val); > } > - snprintf(ret, 255, "[ \"%s\",\t%s\t]", ATOMname(n->type), val); > + snprintf(qbuf, 511, "%s := %s:%s;\n", ident, val, ATOMname(type)); > + qbuf[511] = '\0'; > GDKfree(val); > + rethrow("remote.put", tmp, RMTquery(&mhdl, "remote.put", c->mconn, qbuf)); > + mapi_close_handle(mhdl); > } > - ret[255] = '\0'; > - > - stream_printf(cntxt->fdout, "%s\n", ret); > - > - return(MAL_SUCCEED); > -} > -@} > - > -@h > -remote_export str RMTget(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > -@c > -/** > - * get fetches the object referenced by ident over connection conn. > - */ > -str RMTget(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) { > - str conn, ident, tmp; > - connection c; > - > - (void)cntxt; > - (void)mb; > - > - conn = (str)getArgValue(stk, pci, 1); > - if (conn == NULL || strcmp(conn, (str)str_nil) == 0) > - throw(ILLARG, "remote.get", "connection name is NULL or nil"); > - ident = (str)getArgValue(stk, pci, 2); > - if (isIdentifier(ident) < 0) > - throw(ILLARG, "remote.get", "identifier expected, got '%s'", ident); > - > - /* lookup conn, set mconn if valid */ > - rethrow("remote.get", tmp, RMTfindconn(&c, conn)); > - > - /* perform the get */ > - rethrow("remote.get", tmp, RMTinternalget(c->mconn, > - ident, &stk->stk[getArg(pci, 0)])); > - > - return(MAL_SUCCEED); > -} > - > -@h > -remote_export str RMTgetnextid(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > -@c > -static unsigned int _remote_object_counter = 0; > -/** > - * getnextid prints the next unique local identifier as a tuple with one > - * column, e.g.: > - * [ "remote_put_object_1" ] > - * This method is used by put() to store an object. The identifiers > - * generated by getnextid are based on a simple and naive strategy of > - * having a prefix and a counter that result in a hopefully unique > - * identifier. The current prefix is "remote_put_object_" which should > - * reduce possible conflicts to a minimum. > - */ > -str RMTgetnextid(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > -{ > - int *ret = (int *)getArgReference(stk,pci,0); > - (void)mb; > - > - stream_printf(cntxt->fdout, "[ \"remote_put_object_%d\"\t]\n", > - _remote_object_counter++); > - > - *ret = 0; > - return(MAL_SUCCEED); > -} > - > -@h > -remote_export str RMTput(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > -@c > -/** > - * stores the given object on the remote host. The identifier of the > - * object on the remote host is returned for later use. > - */ > -str RMTput(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) { > - str conn, tmp; > - str ident; > - connection c; > - ValPtr v; > - > - (void) cntxt; > - conn = (str)getArgValue(stk, pci, 1); > - if (conn == NULL || strcmp(conn, (str)str_nil) == 0) > - throw(ILLARG, "remote.put", "connection name is NULL or nil"); > - > - /* lookup conn */ > - rethrow("remote.put", tmp, RMTfindconn(&c, conn)); > - > - /* put the thing */ > - rethrow("remote.put", tmp, RMTinternalput(&ident, > - c->mconn, > - getArgType(mb, pci, 2), > - getArgReference(stk, pci, 2))); > > /* return the identifier */ > v = &stk->stk[getArg(pci, 0)]; > v->vtype = TYPE_str; > - v->val.sval = ident; > + v->val.sval = GDKstrdup(ident); > return(MAL_SUCCEED); > } > > @@ -678,22 +546,15 @@ > rethrow("remote.exec", tmp, RMTfindconn(&c, conn)); > > /* get a free identifier on the remote host */ > - mhdl = NULL; > - rethrow("remote.exec", tmp, RMTquery(&mhdl, "remote.exec", c->mconn, "remote.getnextid();")); > - mapi_fetch_row(mhdl); /* should succeed */ > - tmp = mapi_fetch_field(mhdl, 0); /* should be there */ > - if (tmp == NULL) { > - mapi_close_handle(mhdl); > - throw(MAL, "remote.exec", "missing first column in tuple"); > - } > - i = (int) strlen(tmp) + 1; > + RMTgetNextId(&tmp, c); > + i = (int)strlen(tmp) + 1; > ident = alloca(sizeof(char) * i); > memcpy(ident, tmp, i); > + GDKfree(tmp); > > /* build the function invocation string in qbuf */ > len = 0; > len += snprintf(&qbuf[len], 511 - len, "%s := %s.%s(", ident, mod, func); > - mapi_close_handle(mhdl); > > /* handle the arguments to the function */ > assert(pci->argc >= 3); /* ret, conn, func, ... */ > @@ -730,6 +591,36 @@ > str *user, > str *passwd); > @c > +#define serveget "\ > + function user.remote_internal_servegetbat(type:str, o:bat[:any_1,:any_2]):void;\n\ > + t := inspect.getType(o);\n\ > + barrier ifpart := type == t;\n\ > + len := aggr.count(o);\n\ > + io.print(len);\n\ > + io.print(o);\n\ > + exit ifpart;\n\ > + barrier ifpart := calc.isnil(type);\n\ > + io.printf(\"!MALException:user.serveget:nil type doesn't match anything\n\");\n\ > + exit ifpart;\n\ > + barrier ifpart := type != t;\n\ > + io.printf(\"!MALException:user.serveget:object type (%s) \", t);\n\ > + io.printf(\"does not match required type (%s)\n\", type);\n\ > + exit ifpart;\n\ > + end user.remote_internal_servegetbat;\n\ > + function user.remote_internal_serveget(type:str, o:any):void;\n\ > + t := inspect.getType(o);\n\ > + barrier ifpart := type == t;\n\ > + io.print(o);\n\ > + exit ifpart;\n\ > + barrier ifpart := calc.isnil(type);\n\ > + io.printf(\"!MALException:user.serveget:nil type doesn't match anything\n\");\n\ > + exit ifpart;\n\ > + barrier ifpart := type != t;\n\ > + io.printf(\"!MALException:user.serveget:object type (%s) \", t);\n\ > + io.printf(\"does not match required type (%s)\n\", type);\n\ > + exit ifpart;\n\ > + end user.remote_internal_serveget;\n\ > +" > str RMTcreate( > int *ret, > str *conn, > @@ -741,6 +632,8 @@ > { > connection c; > int s; > + MapiHdl mhdl; > + str tmp; > > if (conn == NULL || *conn == NULL || strcmp(*conn, (str)str_nil) == 0) > throw(ILLARG, "remote.create", "connection name is NULL or nil"); > @@ -780,8 +673,20 @@ > memcpy(c->name, *conn, s + 1 /* \0 */); > c->mconn = mapi_mapi(*host, *port, *user, *passwd, "mal", > (strcmp(*dbname, (str)str_nil) == 0 ? NULL : *dbname)); > + c->nextid = 0; > c->next = NULL; > > + if (mapi_reconnect(c->mconn) != MOK) > + throw(IO, "remote.create", "an error occurred during " > + "connect of connection '%s': %s", > + conn, mapi_error_str(c->mconn)); > + /* TODO: throw away connection? */ > + > + /* initialise remote helper function */ > + rethrow("remote.create", tmp, > + RMTquery(&mhdl, "remote.create", c->mconn, serveget)); > + mapi_close_handle(mhdl); > + > /* just make sure the return isn't garbage */ > *ret = 0; > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

2 2

[Monetdb-developers] Will optimisations occur in storage when indexing is applied?
by Stefan de Konink 22 Aug '08

22 Aug '08

Hi, If a user places an index on a varchar column will the actual character storage move to an intermediate (or final) column with only unique instances of each string. Or will the storage in the original table definition still contain all materialized string, instead of pointers to the index? Stefan

2 1

[Monetdb-developers] BETWEEN; SQL92 etc.
by Stefan de Konink 21 Aug '08

21 Aug '08

Hi, SQL92: 6) "X BETWEEN Y AND Z" is equivalent to "X>=Y AND X<=Z". If between is equivalent to the above, why would call it between? I wonder why the order should be Y < Z for it to work. Wouldn't it be much more functional if it took two arbitrary numbers where order doesn't count? Stefan

2 1

[Monetdb-developers] next val, to be higher than the highest value
by Stefan de Konink 21 Aug '08

21 Aug '08

Hello, I have run in some unexpected troubles related to the serial datatype. Is it possible to force the next value to be higher than the highest value already present in the sequence? The behavior I now see is counter intuitive and starts to fill the empty values before this value first. Stefan

3 3

[Monetdb-developers] Error in CVS / sql
by Stefan de Konink 21 Aug '08

21 Aug '08

Due to a bug in Monet5, I am forced to run a more recent version, compiling the sql cvs module has the following result: libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../../src/backends/monet5 -I../../.. -I../../../../src/backends/monet5 -I../../include -I../../../../src/backends/monet5/../../include -I../../common -I../../../../src/backends/monet5/../../common -I../../storage -I../../../../src/backends/monet5/../../storage -I../../server -I../../../../src/backends/monet5/../../server -I/opt/cherokee/include/MonetDB5/atoms -I/opt/cherokee/include/MonetDB5/compiler -I/opt/cherokee/include/MonetDB5/kernel -I/opt/cherokee/include/MonetDB5/mal -I/opt/cherokee/include/MonetDB5/optimizer -I/opt/cherokee/include/MonetDB5/scheduler -I/opt/cherokee/include/MonetDB5 -I/opt/cherokee/include/MonetDB -I/opt/cherokee/include/MonetDB/mapilib -I/opt/cherokee/include/MonetDB -I/opt/cherokee/include/MonetDB/common -I/opt/cherokee/include/MonetDB/gdk -DLIBSQL -Wall -Wextra -std=c99 -g -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -c sql_bpm.c -fPIC -DPIC -o .libs/lib_sql_la-sql_bpm.o cc1: warnings being treated as errors ../../../../src/backends/monet5/sql_bpm.mx: In functie ‘send_part’: ../../../../src/backends/monet5/sql_bpm.mx:272: fout: impliciete declaratie van functie ‘RMTfindconn’ ../../../../src/backends/monet5/sql_bpm.mx:272: fout: assignment makes pointer from integer without a cast ../../../../src/backends/monet5/sql_bpm.mx:276: fout: impliciete declaratie van functie ‘RMTinternalput’ ../../../../src/backends/monet5/sql_bpm.mx:276: fout: assignment makes pointer from integer without a cast ../../../../src/backends/monet5/sql_bpm.mx: In functie ‘get_part’: ../../../../src/backends/monet5/sql_bpm.mx:339: fout: assignment makes pointer from integer without a cast ../../../../src/backends/monet5/sql_bpm.mx:343: fout: impliciete declaratie van functie ‘RMTinternalget’ ../../../../src/backends/monet5/sql_bpm.mx:343: fout: assignment makes pointer from integer without a cast make[7]: *** [lib_sql_la-sql_bpm.lo] Fout 1 make[7]: Map '/mnt/dv/skinkie/monetdb/sql/Linux/src/backends/monet5' wordt verlaten make[6]: *** [all] Fout 2

2 3

Re: [Monetdb-developers] MonetDB5/src/modules/atoms url.mx, , 1.36, 1.37
by Fabian Groffen 15 Aug '08

15 Aug '08

On 14-08-2008 15:44:44 +0000, Lefteris Sidirourgos wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/atoms > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv29402 > > Modified Files: > url.mx > Log Message: > Also deleted trailing spaces, alligned text (removing tabs...). > Fixed documentation/comments. Hi Lefteris, Please remember that the MonetDB code style uses tabs, not evil spaces. Unfortunately the Pathfinder sources do not comply to the MonetDB code style (in more than just spaces and tabs).

2 2

[Monetdb-developers] Announcement: new minor release of MonetDB Clients package
by Sjoerd Mullender 12 Aug '08

12 Aug '08

The MonetDB team at CWI is pleased to announve a bug fix release for the MonetDB Clients package. A number of bugs in the ODBC driver have been fixed: - fixes for the handling of UTF-8 encoded queries and query parameters; - fixes for dealing with wide characters. There is also a fix for mclient: - the timer (-t/--time option) could overflow. There are new Windows installers for the ODBC driver, and there are new RPMs for Fedora 8 and 9. All of this for both 32 and 64 bit architectures. There is also a new Super Source Ball. -- Sjoerd Mullender

1 0

[Monetdb-developers] Some questions
by Elad . 11 Aug '08

11 Aug '08

Hi there! A few questions: 1. Is it possible to run the server module without a visible console on Windows? 2. When inserting large bulks using the ODBC driver, the server process terminates without warning when the bulk is too large to fit in memory (on a 32 bit machine) and the ODBC driver throws a strange exception. I assume this will also happen with large SELECT queries as well. Is there a way to uniquely identify this scenario and/or avoid it? 3. What is the best way of determining whether the server process is up and running? 4. What is the best way to set up my own version of Monet? I want to take a look at the code and perhaps package the server a little differently (create a different MSI, change the EXE file name, etc). Which IDE would be best to do this? Thanks! _________________________________________________________________ Got Game? Win Prizes in the Windows Live Hotmail Mobile Summer Games Trivia Contest http://www.gowindowslive.com/summergames?ocid=TXT_TAGHM

1 0

[Monetdb-developers] Announcing MonetDB support for Ruby on Rails
by Michalis Polakis 10 Aug '08

10 Aug '08

Hello folks, I developed the MonetDB adapter for Rail's ActiveRecord. It will enable you to work with MonetDB databases in Ruby on Rails. You are more than welcome to try the code, give me some feedback, and maybe help me maintain it. To get the code visit : http://rubyforge.org/projects/monetdb-ror Thanks, Michalis Polakis

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/Tests remote02.stable.out, , 1.12, 1.13
by Stefan Manegold 10 Aug '08

10 Aug '08

FYI: the last 4 checkins on this file (mainly) consisted of alternatingly removing and adding (the same) part of the output: http://monetdb.cvs.sourceforge.net/monetdb/MonetDB5/src/modules/mal/Tests/r… http://monetdb.cvs.sourceforge.net/monetdb/MonetDB5/src/modules/mal/Tests/r… http://monetdb.cvs.sourceforge.net/monetdb/MonetDB5/src/modules/mal/Tests/r… http://monetdb.cvs.sourceforge.net/monetdb/MonetDB5/src/modules/mal/Tests/r… http://monetdb.cvs.sourceforge.net/monetdb/MonetDB5/src/modules/mal/Tests/r… Most of the log messages unfortunately give hardly any hint as to whether (and if so, why) this was intended or whether this was by "accident" / "sloppyness" ... Stefan On Sun, Aug 10, 2008 at 11:19:31AM +0000, Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv30947/Tests > > Modified Files: > remote02.stable.out > Log Message: > restore (accidently?) wiped out test output > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_debugger.mx, , 1.232, 1.233 mal_recycle.mx, , 1.134, 1.135
by Sjoerd Mullender 08 Aug '08

08 Aug '08

On 2008-08-08 18:30, Stefan Manegold wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv22332/src/mal > > Modified Files: > mal_debugger.mx mal_recycle.mx > Log Message: > > acknowledge the type that functions return (for good reasons); > for BATcount(), it is size_t . @@ -789,8 +789,8 @@ > > static void > printBATproperties(stream *f, BAT *b){ > - stream_printf(f, " count=%d lrefs=%d ", > - (int) BATcount(b), BBP_lrefs(ABS(b->batCacheid))); > + stream_printf(f, " count=%d lrefs=" SZFMT " ", > + BATcount(b), BBP_lrefs(ABS(b->batCacheid))); > if( BBP_refs(ABS(b->batCacheid)) - 1) > stream_printf(f, " refs=%d ", BBP_refs(ABS(b->batCacheid)) - 1); > if( b->batSharecnt) > I think you got this backwards: it should be count=SZFMT , lrefs=%d. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal/Tests tst052.mal, , 1.1, 1.2 tst052.stable.out, , 1.1, 1.2
by Stefan Manegold 05 Aug '08

05 Aug '08

On Tue, Aug 05, 2008 at 06:22:32AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv9480 > > Modified Files: > tst052.mal tst052.stable.out > Log Message: > simplify test. > Martin, wouldn't it have been better to keep the check whether type wrd is handled correctly on both 32-bit and 64-bit systems and approve the (correct!) 32-bit specific output instead of simply removing this check? Stefan > > U tst052.mal > Index: tst052.mal > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/Tests/tst052.mal,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- tst052.mal 4 Aug 2008 06:57:09 -0000 1.1 > +++ tst052.mal 5 Aug 2008 06:22:30 -0000 1.2 > @@ -7,6 +7,5 @@ > bat.insert(b,7,127:wrd); > bat.insert(b,15,32768:wrd); > bat.insert(b,31,2147483647:wrd); > -bat.insert(b,63,9223372036854775807:wrd); > > io.print(b); > > U tst052.stable.out > Index: tst052.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/Tests/tst052.stable.out,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- tst052.stable.out 4 Aug 2008 06:57:09 -0000 1.1 > +++ tst052.stable.out 5 Aug 2008 06:22:30 -0000 1.2 > @@ -32,10 +32,9 @@ > bat.insert(b,7,127:wrd); # 5 _9:void := BKCinsert_bun(b:bat[:int,:wrd], _10:int, _11:wrd) > bat.insert(b,15,32768:wrd); # 6 _12:void := BKCinsert_bun(b:bat[:int,:wrd], _13:int, _14:wrd) > bat.insert(b,31,2147483647:wrd); # 7 _15:void := BKCinsert_bun(b:bat[:int,:wrd], _16:int, _17:wrd) > - bat.insert(b,63,9223372036854775807:wrd);# 8 _18:void := BKCinsert_bun(b:bat[:int,:wrd], _19:int, _20:wrd) > - io.print(b); # 9 _21:void := IOprint_val(b:bat[:int,:wrd]) > -end main; # 10 > -#---------------------------------# > + io.print(b); # 8 _18:void := IOprint_val(b:bat[:int,:wrd]) > +end main; # 9 > +#-------------------------# > # h t # name > # int wrd # type > #---------------------------------# > @@ -43,7 +42,6 @@ > [ 7, 127 ] > [ 15, 32768 ] > [ 31, 2147483647 ] > -[ 63, 9223372036854775807 ] > > # 08:54:36 > > # 08:54:36 > Done. > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_profiler.mx, , 1.108, 1.109
by Stefan Manegold 05 Aug '08

05 Aug '08

On Mon, Aug 04, 2008 at 11:46:50PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv18736 > > Modified Files: > mal_profiler.mx > Log Message: > Use a larger type for the diskspace Martin, thank for taking care of this one, and my apologies for not having suggested a mu simple solution in my bug report. In detail: I'm in fact afraid that your fix / new solution will not even compile on Windows. The reason is, that the C function getDiskSpace() internally (still) collects / calculates the occupied disk space in a variable of type "lng" --- this is (and was) good & correct, as even on 32-bit systems, MonetDB's (total) database size can grow beyond 2 GB --- however, C function getDiskSpace() now returns a "size_t" (while it used to correctly return the internal "lng"). Not only is "size_t" only 32 bit on 32-bit systems, while "lng" is 64-bit also on 32-bit systems, but it is also unsigned while lng is signed. Hence, the Windows compilers will (at least) complain about the possible loos of data when implicitly truncating the 64-bit (signed) "lng" to a 32-bit (unsigned) "size_t" in the return statement of C function getDiskSpace() on 32-bit systems. Moreover, it is a bit "odd" to use unsigned type "size_t" in the undelying C function, but signed type "wrd" in the MAL command --- why not also use type "wrd" in C -- we have it defined (for exacly this reason) as any other "three-letter-type" we use in GDK ... In fact, the IMHO correct (and simpler/simplest) solution would have been to leave the C function getDiskSpace() return a "lng" as it (correctly) used to do, and simply change to MAL command signature and wrapper to directly pass this "lng" through as "lng" instead of truncating it (on both 32- & 64-bit systems) to an "int". Again, my apologies for not explicitly pointing out this simple solution in my bug report. Stefan ps: If you wish, I could take care of fixing this ... > U mal_profiler.mx > Index: mal_profiler.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_profiler.mx,v > retrieving revision 1.108 > retrieving revision 1.109 > diff -u -d -r1.108 -r1.109 > --- mal_profiler.mx 4 Aug 2008 06:56:27 -0000 1.108 > +++ mal_profiler.mx 4 Aug 2008 23:46:48 -0000 1.109 > @@ -213,7 +213,7 @@ > mal_export void clearTrace(void); > mal_export BAT *getTrace(str ev); > > -mal_export lng getDiskSpace(void); > +mal_export size_t getDiskSpace(void); > #define DEBUG_MAL_PROFILER > > #endif > @@ -550,7 +550,7 @@ > log("%d,\t", mb->profiler[pc].obytes); > } > if (profileCounter[PROFdisk].status) { > - log("%d,\t", getDiskSpace()); > + log(SZFMT",\t", getDiskSpace()); > } > if (profileCounter[PROFaggr].status) > log2("%d,\t%d,\t", mb->profiler[pc].counter, mb->profiler[pc].clk); > @@ -950,7 +950,7 @@ > TRACE_id_stmt = TRACEcreate("id", "statement", TYPE_int, TYPE_str); > TRACE_id_ibytes = TRACEcreate("id", "ibytes", TYPE_int, TYPE_wrd); > TRACE_id_obytes = TRACEcreate("id", "obytes", TYPE_int, TYPE_wrd); > - TRACE_id_diskspace = TRACEcreate("id", "diskspace", TYPE_int, TYPE_lng); > + TRACE_id_diskspace = TRACEcreate("id", "diskspace", TYPE_int, TYPE_wrd); > TRACE_init = 1; > mal_unset_lock(mal_contextLock, "trace"); > } > @@ -1132,7 +1132,7 @@ > BUNins(TRACE_id_obytes, &evnt, &mb->profiler[pc].obytes, FALSE); > } > if (profileCounter[PROFdisk].status) { > - lng disk= getDiskSpace(); > + size_t disk= getDiskSpace(); > BUNins(TRACE_id_diskspace, &evnt, &disk, FALSE); > } > eventcounter++; > @@ -1147,7 +1147,7 @@ > if( mb->profiler) return; > mb->profiler = (ProfPtr) GDKzalloc(mb->ssize*sizeof(ProfRecord)); > } > -lng > +size_t > getDiskSpace() > { > BAT *b; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/atoms rmtobj.mx, , 1.4, 1.5
by Sjoerd Mullender 04 Aug '08

04 Aug '08

Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/atoms > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv22761 > > Modified Files: > rmtobj.mx > Log Message: > For what its worth, apply my diffs after merging Martin's changes. I > basically had the same fixes. > > > @@ -86,11 +86,11 @@ > int > RMTOtoString(str *retval, int *len, str handle) > { > - int hl = (int) strlen(handle)+1; > + int hl = (int)strlen(handle) + 1; > if (*len < hl) { > if (*retval != NULL) > GDKfree(*retval); > - *retval = GDKmalloc(hl); > + *retval = GDKmalloc(sizeof(char) * hl); > } > *len = hl; > memcpy(*retval, handle, hl); I've seen this kind of thing quite often, but I have to ask, why? The standard says about the sizeof operator: "When applied to an operand that has type char, unsigned char, or signed char, (or a qualified version thereof) the result is 1." So why bother multiplying with sizeof(char)? -- Sjoerd Mullender

2 1

[Monetdb-developers] DateAdd()
by Elad . 04 Aug '08

04 Aug '08

Hi, Is there an existing SQL implementation of the DateAdd function in Monetdb? Something along the lines of SELECT DATEADD(month, 1, '08/30/2006') that would add a single month to the specified time stamp. Thanks! _________________________________________________________________ Got Game? Win Prizes in the Windows Live Hotmail Mobile Summer Games Trivia Contest http://www.gowindowslive.com/summergames?ocid=TXT_TAGHM

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/atoms xml.mx, , 1.21, 1.22
by Martin Kersten 03 Aug '08

03 Aug '08

Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/atoms > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv1588 > > Modified Files: > xml.mx > Log Message: > By using the correct types, you loose a lot of casts... > Point is that strings in GDK ValRecord are limited to int length. The consequence, for me, is that we should limit all string manipulation in the system to this size. I consider xml a subtype of str. All places where we use or construct strings, we should check the size overflow or we have to live with the truncation semantics. Since such large large strings are (not yet) at the horizon and would cause problems way in before, we can live with a truncation policy. A real solution requires many weeks of development investment for a case not eminent. Now the patch was aimed at removing the compiler complaints. All practical cases are well within the size limit. > > U xml.mx > Index: xml.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/atoms/xml.mx,v > retrieving revision 1.21 > retrieving revision 1.22 > diff -u -d -r1.21 -r1.22 > --- xml.mx 3 Aug 2008 06:55:59 -0000 1.21 > +++ xml.mx 3 Aug 2008 09:07:03 -0000 1.22 > @@ -214,7 +214,7 @@ > > str > XMLcomment(xml *x, str *s){ > - int len = (int) strlen(*s) + 10; > + size_t len = strlen(*s) + 10; > str buf = (str) GDKmalloc(len); > > snprintf(buf, len, "", *s); > @@ -241,9 +241,9 @@ > str > XMLroot(str *ret, str *val, str *version, str *standalone) > { > - int len; > - str buf = (str) GDKmalloc(len= (int) strlen(*val) + > - (int) strlen("<? version=\"\" standalone=\"\"?>")); > + size_t len; > + str buf = (str) GDKmalloc(len= strlen(*val) + > + strlen("<? version=\"\" standalone=\"\"?>")); > snprintf(buf,len,"<? version=\"%s\" stanalone=\"%s\"?>%s", > *version,*standalone,*val); > *ret= buf; > @@ -253,8 +253,8 @@ > str > XMLattribute(xml *ret, str *name, str *val) > { > - int len; > - str buf= (str) GDKmalloc(len= (int)(2*strlen(*name)+strlen(*val)+5)); > + size_t len; > + str buf= (str) GDKmalloc(len= (2*strlen(*name)+strlen(*val)+5)); > snprintf(buf,len," %s=\"%s\"",*name,*val); > *ret = buf; > return MAL_SUCCEED; > @@ -264,8 +264,8 @@ > XMLelement(xml *ret, str *name, str *nspace, xml *attr, xml *Val) > { > char *val = *Val; > - int len; > - str buf= (str) GDKmalloc(len=2* (int)(strlen(*name) + > + size_t len; > + str buf= (str) GDKmalloc(len=2* (strlen(*name) + > strlen(*nspace) + strlen(*attr)+ > strlen("<></> ")+strlen(val)+1)); > if (strNil(val)) /* todo short hand <elementname /> */ > @@ -290,8 +290,8 @@ > str > XMLelementSmall(xml *ret, str *name, xml *val) > { > - int len; > - str buf= (str) GDKmalloc(len=2*(int) (strlen(*name) + > + size_t len; > + str buf= (str) GDKmalloc(len=2*(strlen(*name) + > strlen("<></> ")+strlen(*val))); > snprintf(buf,len,"<%s>%s</%s>",*name, *val, *name); > *ret= buf; > @@ -320,7 +320,7 @@ > (void) cntxt; > for( i=p->retc; i<p->argc; i++) > len += strlen(*(str*)getArgReference(stk,p,i)); > - buf= (str) GDKmalloc( (int) (len+1)); > + buf= (str) GDKmalloc( len+1); > buf[0]=0; > > assert(len <INT_MAX); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

2 1

[Monetdb-developers] monet db copy command
by ashokguruswamy 01 Aug '08

01 Aug '08

my seasonal compliments.. this is ashok. i am using monetdb for my application with java. just i need to copy the monetdb table to a csv file.. in an sql manual i read the syntax for copying from table to csvfile is Syntax: COPY <subquery> INTO <file_name> [ [USING] DELIMITERS tuple_separator [’,’ record_separator [ ’,’ string_quote ]]] [ NULL AS null_string ]; Operating System: Windows XP My query: copy select * from table_name into 'D:/file_name.csv' using delimiters '|'; but if i execute this, am facing the following problem.. any suggestion? asap... Error: Syntax error, unexpected SELECT, expecting INTO in: “copy select”.. Also the query specified below which having --with null as 'null_String"-- is not working.. copy select * from table_name into 'D:/file_name.csv' using delimiters '|' with null as ' '; I want a way to copy monetdb tables to csv files.. -- View this message in context: http://www.nabble.com/monet-db-copy-command-tp18768958p18768958.html Sent from the monetdb-developers mailing list archive at Nabble.com.

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_recycle.mx, , 1.129, 1.130
by Sjoerd Mullender 31 Jul '08

31 Jul '08

Romulo Goncalves wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv13210 > > Modified Files: > mal_recycle.mx > Log Message: > Use the correct types. > > Sjoerd said: > "The Right Thing To Do would be to use the correct types for everything. > In this case, size_t for anything that counts bytes (such as > recyclerUsedMemory and memLimit)." I'll also say: use SZFMT and LLFMT in format strings to print values of type size_t and lng respectively. See how these tokens are used. > > > U mal_recycle.mx > Index: mal_recycle.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_recycle.mx,v > retrieving revision 1.129 > retrieving revision 1.130 > diff -u -d -r1.129 -r1.130 > --- mal_recycle.mx 31 Jul 2008 08:56:54 -0000 1.129 > +++ mal_recycle.mx 31 Jul 2008 11:19:08 -0000 1.130 > @@ -106,8 +106,8 @@ > > mal_export int recycleClaim; > mal_export int recycleCacheLimit; > -mal_export lng recycleMemory; /* Units of memory permitted */ > -mal_export lng recyclerUsedMemory; > +mal_export size_t recycleMemory; /* Units of memory permitted */ > +mal_export size_t recyclerUsedMemory; > mal_export MT_Lock recycleLock; > mal_export MalBlkPtr recycleBlk; > mal_export double recycleAlpha; > @@ -196,7 +196,7 @@ > RCACHE_MEMCRD: reduce the storage overhead */ > int recycleCacheLimit=0; /* No limit by default */ > int recycleClaim=0; /* avoid stale tables by letting users mark it */ > -lng recycleMemory=0; /* Units of memory permitted */ > +size_t recycleMemory=0; /* Units of memory permitted */ > @- > The profiler record is re-used to store recycler information. > The clk is used by the LRU scheme, counter is the number of > @@ -214,7 +214,7 @@ > > @- Monitoring the Recycler > @c > -lng recyclerUsedMemory = 0; > +size_t recyclerUsedMemory = 0; > int statements = 0; /* total number of statements executed */ > int recycled = 0; /* total number of statements recycled */ > int retained = 0; /* total number of statements retained */ > @@ -487,7 +487,7 @@ > int cont, reserve; > lng oldclk, newclk; > dbl mincrd, crd; > - lng memLimit = recycleMemory?recycleMemory:HARDLIMIT_MEM; > + size_t memLimit = recycleMemory?recycleMemory:HARDLIMIT_MEM; > #ifdef _DEBUG_CACHE_ > Client cntxt= MCgetClient(); > #endif > @@ -682,7 +682,8 @@ > ValRecord *v; > ValRecord cst; > InstrPtr q; > - lng memLimit,cacheLimit; > + size_t memLimit; > + lng cacheLimit; > > RECYCLEspace(); > cacheLimit = recycleCacheLimit?recycleCacheLimit:HARDLIMIT_STMT; > @@ -744,7 +745,7 @@ > recyclerUsedMemory += wr; > if (monitorRecycler == 1 ) > fprintf(stderr, > - "#memory=%lld, stop=%d, recycled=%d, retained=%d executed=%d saved=" LLFMT "\n", > + "#memory=%lu, stop=%d, recycled=%d, retained=%d executed=%d saved=" LLFMT "\n", > recyclerUsedMemory, recycleBlk->stop, > recycled, retained, statements, savedTime); > retained++; > @@ -1026,7 +1027,8 @@ > void > RECYCLEexitImpl(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p){ > lng clk = 0; > - lng memLimit, cacheLimit; > + size_t memLimit; > + lng cacheLimit; > size_t rd = getVolume(stk,p, 1)/ RU +1; > size_t wr = getVolume(stk,p, 0)/ RU +1; > ValRecord *v; > @@ -1041,10 +1043,10 @@ > if ((v->vtype == TYPE_bat) && (BBP_status( *(int*)VALget(v)) & BBPPERSISTENT)) > wr = 0; > > - if (wr > memLimit) > + if ( wr > memLimit) > return; > if (recycleBlk) > - if ( recyclerUsedMemory + wr > memLimit || > + if ( recyclerUsedMemory + wr > memLimit || > recycleBlk->stop >= cacheLimit ){ > RECYCLEcleanCache(wr); > RECYCLEversion(cntxt,mb); > @@ -1069,7 +1071,7 @@ > { > /* RETAIN_SIZE: size cost model */ > if (recycleVolume && RECYCLEfind(cntxt,mb,stk,p)<0){ > - if (rd+wr > recycleVolume){ > + if ((lng) (rd+wr) > recycleVolume){ > (void) RECYCLEnew(cntxt,mb, stk, p, rd, wr); > #ifdef _DEBUG_RECYCLE_ > stream_printf(cntxt->fdout,"RECYCLEexit size " SZFMT " " SZFMT "\n",rd,wr); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_recycle.mx, , 1.127, 1.128
by Romulo Goncalves 31 Jul '08

31 Jul '08

Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv19189 > > Modified Files: > mal_recycle.mx > Log Message: > Fix types: getVolume returns a size_t, so there is absolutely no need > to convert back and forth to lng. > Also use correct format specifiers and the correct number of format > specifiers. With this change I will get compilation complains: cc1: warnings being treated as errors /ufs/goncalve/MonetDB/current/MonetDB5/src/mal/mal_recycle.mx: In function 'RECYCLEnew': /ufs/goncalve/MonetDB/current/MonetDB5/src/mal/mal_recycle.mx:692: warning: comparison between signed and unsigned due this if clause: memLimit = recycleMemory?recycleMemory:HARDLIMIT_MEM; if ( recyclerUsedMemory + (lng) wr > memLimit) return ; /* no more caching */ If I do a cast to lng if ( recyclerUsedMemory + (lng) wr > memLimit) The compilation starts to work. Should I do the cast or is something else that I forgot to do? Romulo > > > U mal_recycle.mx > Index: mal_recycle.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_recycle.mx,v > retrieving revision 1.127 > retrieving revision 1.128 > diff -u -d -r1.127 -r1.128 > --- mal_recycle.mx 30 Jul 2008 13:53:03 -0000 1.127 > +++ mal_recycle.mx 31 Jul 2008 08:27:31 -0000 1.128 > @@ -676,7 +676,7 @@ > } > > static void > -RECYCLEnew(Client cntxt, MalBlkPtr mb, MalStkPtr s, InstrPtr p, lng rd, lng wr) > +RECYCLEnew(Client cntxt, MalBlkPtr mb, MalStkPtr s, InstrPtr p, size_t rd, size_t wr) > { > int i, j, c; > ValRecord *v; > @@ -1027,8 +1027,8 @@ > RECYCLEexitImpl(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr p){ > lng clk = 0; > lng memLimit, cacheLimit; > - lng rd = getVolume(stk,p, 1)/ RU +1; > - lng wr = getVolume(stk,p, 0)/ RU +1; > + size_t rd = getVolume(stk,p, 1)/ RU +1; > + size_t wr = getVolume(stk,p, 0)/ RU +1; > ValRecord *v; > > RECYCLEversion(cntxt,mb); > @@ -1072,7 +1072,7 @@ > if (rd+wr > recycleVolume){ > (void) RECYCLEnew(cntxt,mb, stk, p, rd, wr); > #ifdef _DEBUG_RECYCLE_ > - stream_printf(cntxt->fdout,"RECYCLEexit size %d %d\n",rd,wr); > + stream_printf(cntxt->fdout,"RECYCLEexit size " SZFMT " " SZFMT "\n",rd,wr); > #endif > } > } > @@ -1085,8 +1085,8 @@ > if (recycleAlpha *(rd+wr) + (1-recycleAlpha)* clk > (recycleVolume+1) * (recycleTime+1)){ > (void) RECYCLEnew(cntxt,mb, stk, p, rd, wr); > #ifdef _DEBUG_RECYCLE_ > - stream_printf(cntxt->fdout,"RECYCLEexit volume %d %d %d \n",clk,rd,wr,(rd+wr)*clk); > - stream_printf(cntxt->fdout,"RECYCLEexit volume %d %d\n", recycleVolume, recycleTime); > + stream_printf(cntxt->fdout,"RECYCLEexit volume " LLFMT " " SZFMT " " SZFMT " " LLFMT " \n",clk,rd,wr,(rd+wr)*clk); > + stream_printf(cntxt->fdout,"RECYCLEexit volume " LLFMT " " LLFMT "\n", recycleVolume, recycleTime); > #endif > } > } > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/atoms blob.mx, , 1.43, 1.44 str.mx, , 1.76, 1.77 xml.mx, , 1.19, 1.20
by Stefan Manegold 30 Jul '08

30 Jul '08

On Wed, Jul 30, 2008 at 08:02:16AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/atoms > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv22933/atoms > > Modified Files: > blob.mx str.mx xml.mx > Log Message: > Silenceing the compiler on windows. > Strings and BATcount are always less then 4GB Even if so, int (signed) allows only 2^31 - 1, i.e., "2GB". Moreover, in the 64-bit case (in particular with 64-bit OIDs), neither the length of strings nor the tuple (BUN) count of BATs is formally restricted to 2^31 - 1 (or 2^32 - 1) --- in fact, breaking through this limit is one of the reasons for / features of the 64-bit port of MonetDB --- how efficiently such larger strings and BATs are handled is a different question ... That's why I used to guard all down-cast that I added with an assertion to detect overflows ... Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel batcalc.mx, , 1.152, 1.153
by Stefan Manegold 28 Jul '08

28 Jul '08

On Mon, Jul 28, 2008 at 06:10:05AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv6684/kernel > > Modified Files: > batcalc.mx > Log Message: > Oid unary accums are limited to '+' Since there is IMHO no unary '+' operator defined in MAL, this is unused ("dead") code. (In fact, I could not tell what the purpose/semantic of a unary '+' operator should be...) Moreover, the current code (for good?) also disables unary "--" & "++" for type OID; hence, the current code is equivalent to a simple " case TYPE_oid: throw(MAL, "batcalc.@1", "unexpected operator"); break;" and could/should be simplified like this. In fact, the part of the code that has been modified, i.e., the "CMDunaryAccum@1" functions, are not used at all, yet, only the "CMDunary@1" are used, but is actually the one that triggers ".\..\..\..\..\src\modules\kernel\batcalc.mx(923) : warning C4146: unary minus operator applied to unsigned type, result still unsigned" I'd suggest to disable (remove?) the unused ("dead") code fo not (yet?) used "CMDunaryAccum@1" and cleanup / simplify the code for "CMDunary@1" as suggested above. Stefan > U batcalc.mx > Index: batcalc.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/modules/kernel/batcalc.mx,v > retrieving revision 1.152 > retrieving revision 1.153 > diff -u -d -r1.152 -r1.153 > --- batcalc.mx 21 Jul 2008 09:28:55 -0000 1.152 > +++ batcalc.mx 28 Jul 2008 06:10:02 -0000 1.153 > @@ -937,10 +937,22 @@ > > switch(BATttype(bn)){ > case TYPE_oid: if ( strcmp("@2","+")== 0){ > - @:accumUnary(oid,@2)@ > - } else > - throw(MAL, "batcalc.@1", "unexpected operator"); > - break; > + oid* p = (oid*)Tloc(b,BUNfirst(b)); > + oid *q = (oid*)Tloc(b,BUNlast(b)); > + oid *o = (oid*)Tloc(bn,BUNfirst(bn)); > + > + for(; p<q; p++, o++){ > + /* this code is better as x?nil:y */ > +#ifdef NULLTST > + if(*p == oid_nil ) > + *o = oid_nil; > + else > +#endif > + *o = *p; > + } > + } else > + throw(MAL, "batcalc.@1", "unexpected operator"); > + break; > case TYPE_bte: @:accumUnary(bte,@2)@ break; > case TYPE_sht: @:accumUnary(sht,@2)@ break; > case TYPE_int: @:accumUnary(int,@2)@ break; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/Tests rdf.stable.out, , NONE, 1.1 rdf.mal, , NONE, 1.1 rdf.stable.err, , NONE, 1.1 rdf.testdata.ttl, , NONE, 1.1
by Stefan Manegold 24 Jul '08

24 Jul '08

On Thu, Jul 24, 2008 at 12:10:53PM +0000, Marco Antonelli wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv16238/src/modules/mal/Tests > > Added Files: > rdf.stable.out rdf.mal rdf.stable.err rdf.testdata.ttl > Log Message: > Test case for rdf.mx: it imports rdf data from rdf.testdata.ttl and then prints the dictionary and the 6 data tables. > It is still not in the 'All' file since rdf is not compiled by default. Wouldn't it be the time to make rdf compile by default? Otherwise, how can the compialtion of rdf be enabled (easily)? Is there any configue switch, or alike? Stefan > --- NEW FILE: rdf.testdata.ttl --- > @prefix rdf:<http://www.w3.org/1999/02/22-rdf-syntax-ns#> . > @prefix rdfs:<http://www.w3.org/2000/01/rdf-schema#> . > @prefix ex:<http://www.example.org/example#> . > @prefix xsd:<http://www.w3.org/2001/XMLSchema#> . > > _:float0 <ex:value> "0"^^xsd:float . > _:float1 <ex:value> "-5"^^xsd:float . > _:float2 <ex:value> "-5.0001"^^xsd:float . > _:float3 <ex:value> "-4.9999"^^xsd:float . > _:float4 <ex:value> "5"^^xsd:float . > _:float5 <ex:value> "5.0001"^^xsd:float . > _:float6 <ex:value> "4.9999"^^xsd:float . > _:float7 <ex:value> "NaN"^^xsd:float . > _:float8 <ex:value> "INF"^^xsd:float . > > _:double0 <ex:value> "0"^^xsd:double . > _:double-5 <ex:value> "-5"^^xsd:double . > _:double-5.0001 <ex:value> "-5.0001"^^xsd:double . > _:double-4.9999 <ex:value> "-4.9999"^^xsd:double . > _:double5 <ex:value> "5"^^xsd:double . > _:double5.0001 <ex:value> "5.0001"^^xsd:double . > _:double4.9999 <ex:value> "4.9999"^^xsd:double . > _:doubleNaN <ex:value> "NaN"^^xsd:double . > _:doubleINF <ex:value> "INF"^^xsd:double . > > <ex:decimal0> <ex:value> "0"^^xsd:decimal . > <ex:decimal-5> <ex:value> "-5"^^xsd:decimal . > <ex:decimal-5.0001> <ex:value> "-5.0001"^^xsd:decimal . > <ex:decimal-4.9999> <ex:value> "-4.9999"^^xsd:decimal . > <ex:decimal5> <ex:value> "5"^^xsd:decimal . > <ex:decimal5.0001> <ex:value> "5.0001"^^xsd:decimal . > <ex:decimal4.9999> <ex:value> "4.9999"^^xsd:decimal . > > <ex:integer0> <ex:value> "0"^^xsd:integer . > <ex:integer-5> <ex:value> "-5"^^xsd:integer . > <ex:integer5> <ex:value> "5"^^xsd:integer . > > <ex:nonPosInt0> <ex:value> "0"^^xsd:nonPositiveInteger . > <ex:nonPosInt-5> <ex:value> "-5"^^xsd:nonPositiveInteger . > > <ex:negInt-5> <ex:value> "-5"^^xsd:negativeInteger . > > <ex:nonNegInt0> <ex:value> "0"^^xsd:nonNegativeInteger . > <ex:nonNegInt5> <ex:value> "5"^^xsd:nonNegativeInteger . > > <ex:posInt5> <ex:value> "5"^^xsd:positiveInteger . > > <ex:long0> <ex:value> "0"^^xsd:long . > <ex:long1> <ex:value> "1235467890"^^xsd:long . > > <ex:ulong0> <ex:value> "0"^^xsd:unsignedLong . > <ex:ulong1> <ex:value> "1235467890"^^xsd:unsignedLong . > > <ex:int0> <ex:value> "0"^^xsd:int . > <ex:int1> <ex:value> "1235467890"^^xsd:int . > > <ex:uint0> <ex:value> "0"^^xsd:unsignedInt . > <ex:uint1> <ex:value> "1235467890"^^xsd:unsignedInt . > > <ex:short0> <ex:value> "0"^^xsd:short . > <ex:short1> <ex:value> "5"^^xsd:short . > > <ex:ushort0> <ex:value> "0"^^xsd:unsignedShort . > <ex:ushort1> <ex:value> "5"^^xsd:unsignedShort . > > <ex:byte0> <ex:value> "0"^^xsd:short . > <ex:byte1> <ex:value> "5"^^xsd:short . > > <ex:ubyte0> <ex:value> "0"^^xsd:unsignedByte . > <ex:ubyte1> <ex:value> "5"^^xsd:unsignedByte . > > <ex:boolT> <ex:value1> "1"^^xsd:boolean . > <ex:boolT> <ex:value2> "true"^^xsd:boolean . > <ex:boolF> <ex:value1> "0"^^xsd:boolean . > <ex:boolF> <ex:value2> "false"^^xsd:boolean . > > <ex:stringTyped0> <ex:value> "this is a typed string"^^xsd:string . > <ex:stringTyped1> <ex:value> "ciao"^^xsd:string . > > <ex:stringLang0> <ex:value> "this is a string with lang tag"@en . > <ex:stringLang1> <ex:value> "ciao"@it . > > <ex:stringPlain0> <ex:value> "this is a plain string" . > <ex:stringPlain1> <ex:value> "ciao" . > > <ex:datetime01> <ex:value> "1236-12-15T00:00:00"^^xsd:dateTime . > <ex:datetime02> <ex:value> "1236-12-15T00:00:00"^^xsd:dateTime . > <ex:datetime03> <ex:value> "1236-12-15T00:00:00Z"^^xsd:dateTime . > <ex:datetime04> <ex:value> "1236-12-15T00:00:00.0"^^xsd:dateTime . > <ex:datetime05> <ex:value> "1236-12-15T00:00:00.00"^^xsd:dateTime . > <ex:datetime06> <ex:value> "1236-12-15T00:00:00.1"^^xsd:dateTime . > <ex:datetime07> <ex:value> "1236-12-15T00:00:00.12"^^xsd:dateTime . > <ex:datetime08> <ex:value> "1236-12-15T00:00:00.123"^^xsd:dateTime . > <ex:datetime09> <ex:value> "1236-12-15T00:00:00+00:00"^^xsd:dateTime . > <ex:datetime10> <ex:value> "1236-12-15T01:00:00.0+01:00"^^xsd:dateTime . > <ex:datetime11> <ex:value> "1236-12-15T02:00:00.00+02:00"^^xsd:dateTime . > <ex:datetime12> <ex:value> "1236-12-15T03:00:00.1+03:00"^^xsd:dateTime . > <ex:datetime13> <ex:value> "1236-12-15T04:00:00.12+04:00"^^xsd:dateTime . > <ex:datetime14> <ex:value> "1236-12-15T05:00:00.123+05:00"^^xsd:dateTime . > <ex:datetime15> <ex:value> "1236-12-14T24:00:00-00:00"^^xsd:dateTime . > <ex:datetime16> <ex:value> "1236-12-14T23:00:00.0-01:00"^^xsd:dateTime . > <ex:datetime17> <ex:value> "1236-12-14T22:00:00.00-02:00"^^xsd:dateTime . > <ex:datetime18> <ex:value> "1236-12-14T21:00:00.1-03:00"^^xsd:dateTime . > <ex:datetime19> <ex:value> "1236-12-14T20:00:00.12-04:00"^^xsd:dateTime . > <ex:datetime20> <ex:value> "1236-12-14T19:00:00.123-05:00"^^xsd:dateTime . > > <ex:orderTest> <ex:v1> "A" . > <ex:orderTest> <ex:v1> "B" . > <ex:orderTest> <ex:v1> "C" . > <ex:orderTest> <ex:v2> "A" . > <ex:orderTest> <ex:v2> "B" . > <ex:orderTest> <ex:v2> "C" . > > <ex:xmlLiteral> <ex:value> "<a:Box xmlns:a=\"http://example.org/a#\" required=\"true\"/>\n\t<a:widget size=\"10\"/>\n\t<a:grommit id=\"23\"/>\n</a:Box>"^^<http://www.w3.org/1999/02/22-rdf-syntax-ns#XMLLiteral> . > > <ex:customTypedLiteral0> <ex:value> "customTypedLiteral"^^<http://customdatatype.org/types#custom0> . > <ex:customTypedLiteral1> <ex:value> "customTypedLiteral"^^<http://customdatatype.org/types#custom1> . > > > --- NEW FILE: rdf.mal --- > include rdf; > > targetdir := unix.getenv("TSTTRGDIR"); > barrier correct:= targetdir == ""; > targetdir := unix.getenv("PWD"); > exit correct; > barrier correct:= targetdir != ""; > targetdir := targetdir + "/"; > exit correct; > > datafile := targetdir + "rdf.testdata.ttl"; > io.printf("#source:%s\n",datafile); > > rdf.importGraph(datafile, "turtle", "db", "g", 1024:lng); > > map:bat[:oid,:str] := bbp.bind("db_g_map"); > io.print(map); > > Spot:bat[:oid,:oid] := bbp.bind("db_g_Spot"); > sPot:bat[:oid,:oid] := bbp.bind("db_g_sPot"); > spOt:bat[:oid,:oid] := bbp.bind("db_g_spOt"); > spoT:bat[:oid,:bte] := bbp.bind("db_g_spoT"); > > s := algebra.fetchjoin(Spot,map); > p := algebra.fetchjoin(sPot,map); > o := algebra.fetchjoin(spOt,map); > > io.print("order: SPO"); > tablet.page(s,p,o,spoT); > > Sopt:bat[:oid,:oid] := bbp.bind("db_g_Sopt"); > sOpt:bat[:oid,:oid] := bbp.bind("db_g_sOpt"); > soPt:bat[:oid,:oid] := bbp.bind("db_g_soPt"); > sopT:bat[:oid,:bte] := bbp.bind("db_g_sopT"); > > s := algebra.fetchjoin(Sopt,map); > o := algebra.fetchjoin(sOpt,map); > p := algebra.fetchjoin(soPt,map); > > io.print("order: SOP"); > tablet.page(s,o,p,sopT); > > Psot:bat[:oid,:oid] := bbp.bind("db_g_Psot"); > pSot:bat[:oid,:oid] := bbp.bind("db_g_pSot"); > psOt:bat[:oid,:oid] := bbp.bind("db_g_psOt"); > psoT:bat[:oid,:bte] := bbp.bind("db_g_psoT"); > > p := algebra.fetchjoin(Psot,map); > s := algebra.fetchjoin(pSot,map); > o := algebra.fetchjoin(psOt,map); > > io.print("order: PSO"); > tablet.page(p,s,o,psoT); > > Post:bat[:oid,:oid] := bbp.bind("db_g_Post"); > pOst:bat[:oid,:oid] := bbp.bind("db_g_pOst"); > poSt:bat[:oid,:oid] := bbp.bind("db_g_poSt"); > posT:bat[:oid,:bte] := bbp.bind("db_g_posT"); > > p := algebra.fetchjoin(Post,map); > o := algebra.fetchjoin(pOst,map); > s := algebra.fetchjoin(poSt,map); > > io.print("order: POS"); > tablet.page(p,o,s,posT); > > Opst:bat[:oid,:oid] := bbp.bind("db_g_Opst"); > oPst:bat[:oid,:oid] := bbp.bind("db_g_oPst"); > opSt:bat[:oid,:oid] := bbp.bind("db_g_opSt"); > opsT:bat[:oid,:bte] := bbp.bind("db_g_opsT"); > > o := algebra.fetchjoin(Opst,map); > p := algebra.fetchjoin(oPst,map); > s := algebra.fetchjoin(opSt,map); > > io.print("order: OPS"); > tablet.page(o,p,s,opsT); > > Ospt:bat[:oid,:oid] := bbp.bind("db_g_Ospt"); > oSpt:bat[:oid,:oid] := bbp.bind("db_g_oSpt"); > osPt:bat[:oid,:oid] := bbp.bind("db_g_osPt"); > ospT:bat[:oid,:bte] := bbp.bind("db_g_ospT"); > > o := algebra.fetchjoin(Ospt,map); > s := algebra.fetchjoin(oSpt,map); > p := algebra.fetchjoin(osPt,map); > > io.print("order: OSP"); > tablet.page(o,s,p,ospT); > > > --- NEW FILE: rdf.stable.err --- > stderr of test 'rdf` in directory 'src/modules/mal` itself: > > > # 13:29:12 > > # 13:29:12 > mserver5 "--config=/export/scratch1/mark/MonetDB/etc/monetdb5.conf" --debug=10 --set "monet_mod_path=/export/scratch1/mark/MonetDB/lib/MonetDB5:/export/scratch1/mark/MonetDB/lib/MonetDB5/lib:/export/scratch1/mark/MonetDB/lib/MonetDB5/bin" --set "gdk_dbfarm=/export/scratch1/mark/MonetDB/var/MonetDB5/dbfarm" --set "sql_logdir=/export/scratch1/mark/MonetDB/var/MonetDB5/sql_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=31339 --set xrpc_port=49823 --set monet_prompt= --trace --dbname=mTests_src_modules_mal rdf.mal > # 13:29:12 > > > # builtin opt gdk_arch = 64bitx86_64-unknown-linux-gnu > # builtin opt gdk_version = 1.25.0 > # builtin opt monet_pid = 1973 > # builtin opt prefix = /export/scratch1/mark/MonetDB > # builtin opt exec_prefix = ${prefix} > # builtin opt gdk_dbname = tst > # builtin opt gdk_dbfarm = ${prefix}/var/MonetDB > # builtin opt gdk_debug = 8 > # builtin opt gdk_mem_bigsize = 262144 > # builtin opt gdk_alloc_map = yes > # builtin opt gdk_mem_pagebits = 14 > # builtin opt gdk_vmtrim = yes > # builtin opt monet_admin = adm > # builtin opt monet_prompt = > > # builtin opt monet_welcome = yes > # builtin opt monet_mod_path = ${exec_prefix}/lib/MonetDB:${exec_prefix}/lib/bin > # builtin opt monet_daemon = yes > # builtin opt host = localhost > # builtin opt mapi_port = 50000 > # builtin opt mapi_noheaders = no > # builtin opt mapi_debug = 0 > # builtin opt mapi_clients = 2 > # builtin opt sql_debug = 0 > # builtin opt sql_logdir = ${prefix}/var/MonetDB/sql_logs > # builtin opt xquery_logdir = ${prefix}/var/MonetDB/xquery_logs > # builtin opt standoff_ns = http://monetdb.cwi.nl/standoff > # builtin opt standoff_start = start > # builtin opt standoff_end = end > # config opt prefix = /export/scratch1/mark/MonetDB > # config opt config = ${prefix}/etc/monetdb5.conf > # config opt prefix = /export/scratch1/mark/MonetDB > # config opt exec_prefix = ${prefix} > # config opt gdk_dbfarm = ${prefix}/var/MonetDB5/dbfarm > # config opt gdk_dbname = demo > # config opt gdk_alloc_map = no > # config opt gdk_embedded = no > # config opt gdk_debug = 0 > # config opt monet_mod_path = ${exec_prefix}/lib/MonetDB5:${exec_prefix}/lib/MonetDB5/lib:${exec_prefix}/lib/MonetDB5/bin > # config opt monet_daemon = no > # config opt monet_welcome = yes > # config opt mero_msglog = ${prefix}/var/log/merovingian.log > # config opt mero_errlog = ${prefix}/var/log/merovingian.log > # config opt mero_timeinterval = 600 > # config opt mero_pidfile = ${prefix}/var/run/merovingian.pid > # config opt mero_exittimeout = 7 > # config opt mero_doproxy = yes > # config opt mero_discoveryttl = 600 > # config opt mal_init = ${exec_prefix}/lib/MonetDB5/mal_init.mal > # config opt mal_listing = 15 > # config opt checkpoint_dir = ${prefix}/var/MonetDB5/chkpnt > # config opt mapi_port = 50000 > # config opt mapi_open = false > # config opt sql_debug = 0 > # config opt sql_logdir = ${prefix}/var/MonetDB5/sql_logs > # config opt sql_init = ${exec_prefix}/lib/MonetDB5/sql_init.sql > # cmdline opt config = /export/scratch1/mark/MonetDB/etc/monetdb5.conf > # cmdline opt monet_mod_path = /export/scratch1/mark/MonetDB/lib/MonetDB5:/export/scratch1/mark/MonetDB/lib/MonetDB5/lib:/export/scratch1/mark/MonetDB/lib/MonetDB5/bin > # cmdline opt gdk_dbfarm = /export/scratch1/mark/MonetDB/var/MonetDB5/dbfarm > # cmdline opt sql_logdir = /export/scratch1/mark/MonetDB/var/MonetDB5/sql_logs > # cmdline opt mapi_open = true > # cmdline opt xrpc_open = true > # cmdline opt mapi_port = 31339 > # cmdline opt xrpc_port = 49823 > # cmdline opt monet_prompt = > # cmdline opt gdk_dbname = mTests_src_modules_mal > # cmdline opt gdk_debug = 10 > #warning: please don't forget to set your vault key! > #(see /export/scratch1/mark/MonetDB/etc/monetdb5.conf) > > # 13:29:13 > > # 13:29:13 > Done. > # 13:29:13 > > > > --- NEW FILE: rdf.stable.out --- > stdout of test 'rdf` in directory 'src/modules/mal` itself: > > > # 13:29:12 > > # 13:29:12 > mserver5 "--config=/export/scratch1/mark/MonetDB/etc/monetdb5.conf" --debug=10 --set "monet_mod_path=/export/scratch1/mark/MonetDB/lib/MonetDB5:/export/scratch1/mark/MonetDB/lib/MonetDB5/lib:/export/scratch1/mark/MonetDB/lib/MonetDB5/bin" --set "gdk_dbfarm=/export/scratch1/mark/MonetDB/var/MonetDB5/dbfarm" --set "sql_logdir=/export/scratch1/mark/MonetDB/var/MonetDB5/sql_logs" --set mapi_open=true --set xrpc_open=true --set mapi_port=31339 --set xrpc_port=49823 --set monet_prompt= --trace --dbname=mTests_src_modules_mal rdf.mal > # 13:29:12 > > > > > > > > > > > > > # MonetDB server v5.7.0, based on kernel v1.25.0 > # Serving database 'mTests_src_modules_mal' > # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked running on 2 cores > # Copyright (c) 1993-2008 CWI, all rights reserved > # Visit http://monetdb.cwi.nl/ for further information > # Listening for connection requests on mapi:monetdb://ivysaur.ins.cwi.nl:31339/ > #include rdf; > # > #targetdir := unix.getenv("PWD"); > #exit correct; > #barrier correct:= targetdir != ""; > # targetdir := targetdir + "/"; > #exit correct; > # > #datafile := targetdir + "rdfdatafile.ttl"; > #io.printf("#source:%s\n",datafile); > # > #rdf.importGraph(datafile, "turtle", "db", "g", 1024:lng); > # > #map:bat[:oid,:str] := bbp.bind("db_g_map"); > #io.print(map); > # > #Spot:bat[:oid,:oid] := bbp.bind("db_g_Spot"); > #sPot:bat[:oid,:oid] := bbp.bind("db_g_sPot"); > #spOt:bat[:oid,:oid] := bbp.bind("db_g_spOt"); > #spoT:bat[:oid,:bte] := bbp.bind("db_g_spoT"); > # > #s := algebra.fetchjoin(Spot,map); > #p := algebra.fetchjoin(sPot,map); > #o := algebra.fetchjoin(spOt,map); > # > #io.print("order: SPO"); > #tablet.page(s,p,o,spoT); > # > #Sopt:bat[:oid,:oid] := bbp.bind("db_g_Sopt"); > #sOpt:bat[:oid,:oid] := bbp.bind("db_g_sOpt"); > #soPt:bat[:oid,:oid] := bbp.bind("db_g_soPt"); > #sopT:bat[:oid,:bte] := bbp.bind("db_g_sopT"); > # > #s := algebra.fetchjoin(Sopt,map); > #o := algebra.fetchjoin(sOpt,map); > #p := algebra.fetchjoin(soPt,map); > # > #io.print("order: SOP"); > #tablet.page(s,o,p,sopT); > # > #Psot:bat[:oid,:oid] := bbp.bind("db_g_Psot"); > #pSot:bat[:oid,:oid] := bbp.bind("db_g_pSot"); > #psOt:bat[:oid,:oid] := bbp.bind("db_g_psOt"); > #psoT:bat[:oid,:bte] := bbp.bind("db_g_psoT"); > # > #p := algebra.fetchjoin(Psot,map); > #s := algebra.fetchjoin(pSot,map); > #o := algebra.fetchjoin(psOt,map); > # > #io.print("order: PSO"); > #tablet.page(p,s,o,psoT); > # > #Post:bat[:oid,:oid] := bbp.bind("db_g_Post"); > #pOst:bat[:oid,:oid] := bbp.bind("db_g_pOst"); > #poSt:bat[:oid,:oid] := bbp.bind("db_g_poSt"); > #posT:bat[:oid,:bte] := bbp.bind("db_g_posT"); > # > #p := algebra.fetchjoin(Post,map); > #o := algebra.fetchjoin(pOst,map); > #s := algebra.fetchjoin(poSt,map); > # > #io.print("order: POS"); > #tablet.page(p,o,s,posT); > # > #Opst:bat[:oid,:oid] := bbp.bind("db_g_Opst"); > #oPst:bat[:oid,:oid] := bbp.bind("db_g_oPst"); > #opSt:bat[:oid,:oid] := bbp.bind("db_g_opSt"); > #opsT:bat[:oid,:bte] := bbp.bind("db_g_opsT"); > # > #o := algebra.fetchjoin(Opst,map); > #p := algebra.fetchjoin(oPst,map); > #s := algebra.fetchjoin(opSt,map); > # > #io.print("order: OPS"); > #tablet.page(o,p,s,opsT); > # > #Ospt:bat[:oid,:oid] := bbp.bind("db_g_Ospt"); > #oSpt:bat[:oid,:oid] := bbp.bind("db_g_oSpt"); > #osPt:bat[:oid,:oid] := bbp.bind("db_g_osPt"); > #ospT:bat[:oid,:bte] := bbp.bind("db_g_ospT"); > # > #o := algebra.fetchjoin(Ospt,map); > #s := algebra.fetchjoin(oSpt,map); > #p := algebra.fetchjoin(osPt,map); > # > #io.print("order: OSP"); > #tablet.page(o,s,p,ospT); > # > # > > function user.main():void; # 0 main:void := user.main() {G} > targetdir := unix.getenv("TSTTRGDIR");# 1 targetdir:str := UNIXgetenv(_2:str) {G} > barrier correct := calc.==(targetdir,"");# 2 correct:bit := CALCcompEQstrstr(targetdir:str, _4:str) {J4} > targetdir := unix.getenv("PWD"); # 3 targetdir:str := UNIXgetenv(_5:str) {G} > exit correct; # 4 correct:bit > barrier correct := calc.!=(targetdir,"");# 5 correct:bit := CALCcompNEQstrstr(targetdir:str, _4:str) {J7} > targetdir := calc.+(targetdir,"/"); # 6 targetdir:str := CALCstrConcat(targetdir:str, _6:str) {G} > exit correct; # 7 correct:bit > datafile := calc.+(targetdir,"rdf.testdata.ttl");# 8 datafile:str := CALCstrConcat(targetdir:str, _8:str) {G} > io.printf("#source:%s\n",datafile); # 9 _9:void := IOprint_formatted_str(_10:str, datafile:str) > rdf.importGraph(datafile,"turtle","db","g",1024:lng);# 10 _11:void := RDFimportGraph(datafile:str, _12:str, _13:str, _14:str, _15:lng) > map:bat[:oid,:str] := bbp.bind("db_g_map");# 11 map:bat[:oid,:str] := CMDbbpbind(_17:str) {G} > io.print(map); # 12 _18:void := IOprint_val(map:bat[:oid,:str]) > Spot:bat[:oid,:oid] := bbp.bind("db_g_Spot");# 13 Spot:bat[:oid,:oid] := CMDbbpbind(_20:str) {G} > sPot:bat[:oid,:oid] := bbp.bind("db_g_sPot");# 14 sPot:bat[:oid,:oid] := CMDbbpbind(_22:str) {G} > spOt:bat[:oid,:oid] := bbp.bind("db_g_spOt");# 15 spOt:bat[:oid,:oid] := CMDbbpbind(_24:str) {G} > spoT:bat[:oid,:bte] := bbp.bind("db_g_spoT");# 16 spoT:bat[:oid,:bte] := CMDbbpbind(_26:str) {G} > s := algebra.fetchjoin(Spot,map); # 17 s:bat[:oid,:str] := ALGfetchjoin(Spot:bat[:oid,:oid], map:bat[:oid,:str]) {G} > p := algebra.fetchjoin(sPot,map); # 18 p:bat[:oid,:str] := ALGfetchjoin(sPot:bat[:oid,:oid], map:bat[:oid,:str]) {G} > o := algebra.fetchjoin(spOt,map); # 19 o:bat[:oid,:str] := ALGfetchjoin(spOt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > io.print("order: SPO"); # 20 _30:void := IOprint_val(_31:str) > tablet.page(s,p,o,spoT); # 21 _32:int := TABpage(s:bat[:oid,:str], p:bat[:oid,:str], o:bat[:oid,:str], spoT:bat[:oid,:bte]) > Sopt:bat[:oid,:oid] := bbp.bind("db_g_Sopt");# 22 Sopt:bat[:oid,:oid] := CMDbbpbind(_34:str) {G} > sOpt:bat[:oid,:oid] := bbp.bind("db_g_sOpt");# 23 sOpt:bat[:oid,:oid] := CMDbbpbind(_36:str) {G} > soPt:bat[:oid,:oid] := bbp.bind("db_g_soPt");# 24 soPt:bat[:oid,:oid] := CMDbbpbind(_38:str) {G} > sopT:bat[:oid,:bte] := bbp.bind("db_g_sopT");# 25 sopT:bat[:oid,:bte] := CMDbbpbind(_40:str) {G} > s := algebra.fetchjoin(Sopt,map); # 26 s:bat[:oid,:str] := ALGfetchjoin(Sopt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > o := algebra.fetchjoin(sOpt,map); # 27 o:bat[:oid,:str] := ALGfetchjoin(sOpt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > p := algebra.fetchjoin(soPt,map); # 28 p:bat[:oid,:str] := ALGfetchjoin(soPt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > io.print("order: SOP"); # 29 _41:void := IOprint_val(_42:str) > tablet.page(s,o,p,sopT); # 30 _43:int := TABpage(s:bat[:oid,:str], o:bat[:oid,:str], p:bat[:oid,:str], sopT:bat[:oid,:bte]) > Psot:bat[:oid,:oid] := bbp.bind("db_g_Psot");# 31 Psot:bat[:oid,:oid] := CMDbbpbind(_45:str) {G} > pSot:bat[:oid,:oid] := bbp.bind("db_g_pSot");# 32 pSot:bat[:oid,:oid] := CMDbbpbind(_47:str) {G} > psOt:bat[:oid,:oid] := bbp.bind("db_g_psOt");# 33 psOt:bat[:oid,:oid] := CMDbbpbind(_49:str) {G} > psoT:bat[:oid,:bte] := bbp.bind("db_g_psoT");# 34 psoT:bat[:oid,:bte] := CMDbbpbind(_51:str) {G} > p := algebra.fetchjoin(Psot,map); # 35 p:bat[:oid,:str] := ALGfetchjoin(Psot:bat[:oid,:oid], map:bat[:oid,:str]) {G} > s := algebra.fetchjoin(pSot,map); # 36 s:bat[:oid,:str] := ALGfetchjoin(pSot:bat[:oid,:oid], map:bat[:oid,:str]) {G} > o := algebra.fetchjoin(psOt,map); # 37 o:bat[:oid,:str] := ALGfetchjoin(psOt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > io.print("order: PSO"); # 38 _52:void := IOprint_val(_53:str) > tablet.page(p,s,o,psoT); # 39 _54:int := TABpage(p:bat[:oid,:str], s:bat[:oid,:str], o:bat[:oid,:str], psoT:bat[:oid,:bte]) > Post:bat[:oid,:oid] := bbp.bind("db_g_Post");# 40 Post:bat[:oid,:oid] := CMDbbpbind(_56:str) {G} > pOst:bat[:oid,:oid] := bbp.bind("db_g_pOst");# 41 pOst:bat[:oid,:oid] := CMDbbpbind(_58:str) {G} > poSt:bat[:oid,:oid] := bbp.bind("db_g_poSt");# 42 poSt:bat[:oid,:oid] := CMDbbpbind(_60:str) {G} > posT:bat[:oid,:bte] := bbp.bind("db_g_posT");# 43 posT:bat[:oid,:bte] := CMDbbpbind(_62:str) {G} > p := algebra.fetchjoin(Post,map); # 44 p:bat[:oid,:str] := ALGfetchjoin(Post:bat[:oid,:oid], map:bat[:oid,:str]) {G} > o := algebra.fetchjoin(pOst,map); # 45 o:bat[:oid,:str] := ALGfetchjoin(pOst:bat[:oid,:oid], map:bat[:oid,:str]) {G} > s := algebra.fetchjoin(poSt,map); # 46 s:bat[:oid,:str] := ALGfetchjoin(poSt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > io.print("order: POS"); # 47 _63:void := IOprint_val(_64:str) > tablet.page(p,o,s,posT); # 48 _65:int := TABpage(p:bat[:oid,:str], o:bat[:oid,:str], s:bat[:oid,:str], posT:bat[:oid,:bte]) > Opst:bat[:oid,:oid] := bbp.bind("db_g_Opst");# 49 Opst:bat[:oid,:oid] := CMDbbpbind(_67:str) {G} > oPst:bat[:oid,:oid] := bbp.bind("db_g_oPst");# 50 oPst:bat[:oid,:oid] := CMDbbpbind(_69:str) {G} > opSt:bat[:oid,:oid] := bbp.bind("db_g_opSt");# 51 opSt:bat[:oid,:oid] := CMDbbpbind(_71:str) {G} > opsT:bat[:oid,:bte] := bbp.bind("db_g_opsT");# 52 opsT:bat[:oid,:bte] := CMDbbpbind(_73:str) {G} > o := algebra.fetchjoin(Opst,map); # 53 o:bat[:oid,:str] := ALGfetchjoin(Opst:bat[:oid,:oid], map:bat[:oid,:str]) {G} > p := algebra.fetchjoin(oPst,map); # 54 p:bat[:oid,:str] := ALGfetchjoin(oPst:bat[:oid,:oid], map:bat[:oid,:str]) {G} > s := algebra.fetchjoin(opSt,map); # 55 s:bat[:oid,:str] := ALGfetchjoin(opSt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > io.print("order: OPS"); # 56 _74:void := IOprint_val(_75:str) > tablet.page(o,p,s,opsT); # 57 _76:int := TABpage(o:bat[:oid,:str], p:bat[:oid,:str], s:bat[:oid,:str], opsT:bat[:oid,:bte]) > Ospt:bat[:oid,:oid] := bbp.bind("db_g_Ospt");# 58 Ospt:bat[:oid,:oid] := CMDbbpbind(_78:str) {G} > oSpt:bat[:oid,:oid] := bbp.bind("db_g_oSpt");# 59 oSpt:bat[:oid,:oid] := CMDbbpbind(_80:str) {G} > osPt:bat[:oid,:oid] := bbp.bind("db_g_osPt");# 60 osPt:bat[:oid,:oid] := CMDbbpbind(_82:str) {G} > ospT:bat[:oid,:bte] := bbp.bind("db_g_ospT");# 61 ospT:bat[:oid,:bte] := CMDbbpbind(_84:str) {G} > o := algebra.fetchjoin(Ospt,map); # 62 o:bat[:oid,:str] := ALGfetchjoin(Ospt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > s := algebra.fetchjoin(oSpt,map); # 63 s:bat[:oid,:str] := ALGfetchjoin(oSpt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > p := algebra.fetchjoin(osPt,map); # 64 p:bat[:oid,:str] := ALGfetchjoin(osPt:bat[:oid,:oid], map:bat[:oid,:str]) {G} > io.print("order: OSP"); # 65 _85:void := IOprint_val(_86:str) > tablet.page(o,s,p,ospT); # 66 _87:int := TABpage(o:bat[:oid,:str], s:bat[:oid,:str], p:bat[:oid,:str], ospT:bat[:oid,:bte]) > end main; # 67 > #source:/export/scratch1/mark/MonetDB/mTests/src/modules/mal/rdf.testdata.ttl > #-----------------------------------------------------------------------------------------------------------------------------------------# > # t h # name > # void str # type > #-----------------------------------------------------------------------------------------------------------------------------------------# > [ 0@0, "0double-4.9999" ] > [ 1@0, "0double-5" ] > [ 2@0, "0double-5.0001" ] > [ 3@0, "0double0" ] > [ 4@0, "0double4.9999" ] > [ 5@0, "0double5" ] > [ 6@0, "0double5.0001" ] > [ 7@0, "0doubleINF" ] > [ 8@0, "0doubleNaN" ] > [ 9@0, "0float0" ] > [ 10@0, "0float1" ] > [ 11@0, "0float2" ] > [ 12@0, "0float3" ] > [ 13@0, "0float4" ] > [ 14@0, "0float5" ] > [ 15@0, "0float6" ] > [ 16@0, "0float7" ] > [ 17@0, "0float8" ] > [ 18@0, "1ex:boolF" ] > [ 19@0, "1ex:boolT" ] > [ 20@0, "1ex:byte0" ] > [ 21@0, "1ex:byte1" ] > [ 22@0, "1ex:customTypedLiteral0" ] > [ 23@0, "1ex:customTypedLiteral1" ] > [ 24@0, "1ex:datetime01" ] > [ 25@0, "1ex:datetime02" ] > [ 26@0, "1ex:datetime03" ] > [ 27@0, "1ex:datetime04" ] > [ 28@0, "1ex:datetime05" ] > [ 29@0, "1ex:datetime06" ] > [ 30@0, "1ex:datetime07" ] > [ 31@0, "1ex:datetime08" ] > [ 32@0, "1ex:datetime09" ] > [ 33@0, "1ex:datetime10" ] > [ 34@0, "1ex:datetime11" ] > [ 35@0, "1ex:datetime12" ] > [ 36@0, "1ex:datetime13" ] > [ 37@0, "1ex:datetime14" ] > [ 38@0, "1ex:datetime15" ] > [ 39@0, "1ex:datetime16" ] > [ 40@0, "1ex:datetime17" ] > [ 41@0, "1ex:datetime18" ] > [ 42@0, "1ex:datetime19" ] > [ 43@0, "1ex:datetime20" ] > [ 44@0, "1ex:decimal-4.9999" ] > [ 45@0, "1ex:decimal-5" ] > [ 46@0, "1ex:decimal-5.0001" ] > [ 47@0, "1ex:decimal0" ] > [ 48@0, "1ex:decimal4.9999" ] > [ 49@0, "1ex:decimal5" ] > [ 50@0, "1ex:decimal5.0001" ] > [ 51@0, "1ex:int0" ] > [ 52@0, "1ex:int1" ] > [ 53@0, "1ex:integer-5" ] > [ 54@0, "1ex:integer0" ] > [ 55@0, "1ex:integer5" ] > [ 56@0, "1ex:long0" ] > [ 57@0, "1ex:long1" ] > [ 58@0, "1ex:negInt-5" ] > [ 59@0, "1ex:nonNegInt0" ] > [ 60@0, "1ex:nonNegInt5" ] > [ 61@0, "1ex:nonPosInt-5" ] > [ 62@0, "1ex:nonPosInt0" ] > [ 63@0, "1ex:orderTest" ] > [ 64@0, "1ex:posInt5" ] > [ 65@0, "1ex:short0" ] > [ 66@0, "1ex:short1" ] > [ 67@0, "1ex:stringLang0" ] > [ 68@0, "1ex:stringLang1" ] > [ 69@0, "1ex:stringPlain0" ] > [ 70@0, "1ex:stringPlain1" ] > [ 71@0, "1ex:stringTyped0" ] > [ 72@0, "1ex:stringTyped1" ] > [ 73@0, "1ex:ubyte0" ] > [ 74@0, "1ex:ubyte1" ] > [ 75@0, "1ex:uint0" ] > [ 76@0, "1ex:uint1" ] > [ 77@0, "1ex:ulong0" ] > [ 78@0, "1ex:ulong1" ] > [ 79@0, "1ex:ushort0" ] > [ 80@0, "1ex:ushort1" ] > [ 81@0, "1ex:v1" ] > [ 82@0, "1ex:v2" ] > [ 83@0, "1ex:value" ] > [ 84@0, "1ex:value1" ] > [ 85@0, "1ex:value2" ] > [ 86@0, "1ex:xmlLiteral" ] > [ 87@0, "33febffe5c91d14e3" ] > [ 88@0, "33febffffffffffff" ] > [ 89@0, "33fec001a36e2eb1b" ] > [ 90@0, "4" ] > [ 91@0, "5" ] > [ 92@0, "8A" ] > [ 93@0, "8B" ] > [ 94@0, "8C" ] > [ 95@0, "8ciao" ] > [ 96@0, "8this is a plain string" ] > [ 97@0, "8this is a typed string" ] > [ 98@0, "9en@this is a string with lang tag" ] > [ 99@0, "9it@ciao" ] > [ 100@0, "A" ] > [ 101@0, "Bc013ffe5c91d14e4" ] > [ 102@0, "Bc014000000000000" ] > [ 103@0, "Bc014001a36e2eb1c" ] > [ 104@0, "Bc1d268ef9c800000" ] > [ 105@0, "C" ] > [ 106@0, "D8006e4cd00000000" ] > [ 107@0, "D8006e4cd00000000+00:00" ] > [ 108@0, "D8006e4cd00000000-00:00" ] > [ 109@0, "D8006e4cd000000000" ] > [ 110@0, "D8006e4cd000000000+01:00" ] > [ 111@0, "D8006e4cd000000000-01:00" ] > [ 112@0, "D8006e4cd0000000000" ] > [ 113@0, "D8006e4cd0000000000+02:00" ] > [ 114@0, "D8006e4cd0000000000-02:00" ] > [ 115@0, "D8006e4cd000000001" ] > [ 116@0, "D8006e4cd000000001+03:00" ] > [ 117@0, "D8006e4cd000000001-03:00" ] > [ 118@0, "D8006e4cd0000000012" ] > [ 119@0, "D8006e4cd0000000012+04:00" ] > [ 120@0, "D8006e4cd0000000012-04:00" ] > [ 121@0, "D8006e4cd00000000123" ] > [ 122@0, "D8006e4cd00000000123+05:00" ] > [ 123@0, "D8006e4cd00000000123-05:00" ] > [ 124@0, "E<a:Box xmlns:a=\"http://example.org/a#\" required=\"true\"/>\n\t<a:widget size=\"10\"/>\n\t<a:grommit id=\"23\"/>\n</a:Box>" ] > [ 125@0, "Fhttp://customdatatype.org/types#custom0^customTypedLiteral" ] > [ 126@0, "Fhttp://customdatatype.org/types#custom1^customTypedLiteral" ] > [ 127@0, "Z" ] > [ "order: SPO" ] > #-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "0double-4.9999", "1ex:value", "33fec001a36e2eb1b", 73 ] > [ "0double-5", "1ex:value", "33febffffffffffff", 73 ] > [ "0double-5.0001", "1ex:value", "33febffe5c91d14e3", 73 ] > [ "0double0", "1ex:value", "5", 73 ] > [ "0double4.9999", "1ex:value", "Bc013ffe5c91d14e4", 73 ] > [ "0double5", "1ex:value", "Bc014000000000000", 73 ] > [ "0double5.0001", "1ex:value", "Bc014001a36e2eb1c", 73 ] > [ "0doubleINF", "1ex:value", "C", 73 ] > [ "0doubleNaN", "1ex:value", "Z", 73 ] > [ "0float0", "1ex:value", "5", 72 ] > [ "0float1", "1ex:value", "33febffffffffffff", 72 ] > [ "0float2", "1ex:value", "33febffe5c91d14e3", 72 ] > [ "0float3", "1ex:value", "33fec001a36e2eb1b", 72 ] > [ "0float4", "1ex:value", "Bc014000000000000", 72 ] > [ "0float5", "1ex:value", "Bc014001a36e2eb1c", 72 ] > [ "0float6", "1ex:value", "Bc013ffe5c91d14e4", 72 ] > [ "0float7", "1ex:value", "Z", 72 ] > [ "0float8", "1ex:value", "C", 72 ] > [ "1ex:boolF", "1ex:value1", "4", 74 ] > [ "1ex:boolF", "1ex:value2", "4", 74 ] > [ "1ex:boolT", "1ex:value1", "A", 74 ] > [ "1ex:boolT", "1ex:value2", "A", 74 ] > [ "1ex:byte0", "1ex:value", "5", 68 ] > [ "1ex:byte1", "1ex:value", "Bc014000000000000", 68 ] > [ "1ex:customTypedLiteral0", "1ex:value", "Fhttp://customdatatype.org/types#custom0^customTypedLiteral", 78 ] > [ "1ex:customTypedLiteral1", "1ex:value", "Fhttp://customdatatype.org/types#custom1^customTypedLiteral", 78 ] > [ "1ex:datetime01", "1ex:value", "D8006e4cd00000000", 76 ] > [ "1ex:datetime02", "1ex:value", "D8006e4cd00000000", 76 ] > [ "1ex:datetime03", "1ex:value", "D8006e4cd00000000+00:00", 76 ] > [ "1ex:datetime04", "1ex:value", "D8006e4cd000000000", 76 ] > [ "1ex:datetime05", "1ex:value", "D8006e4cd0000000000", 76 ] > [ "1ex:datetime06", "1ex:value", "D8006e4cd000000001", 76 ] > [ "1ex:datetime07", "1ex:value", "D8006e4cd0000000012", 76 ] > [ "1ex:datetime08", "1ex:value", "D8006e4cd00000000123", 76 ] > [ "1ex:datetime09", "1ex:value", "D8006e4cd00000000+00:00", 76 ] > [ "1ex:datetime10", "1ex:value", "D8006e4cd000000000+01:00", 76 ] > [ "1ex:datetime11", "1ex:value", "D8006e4cd0000000000+02:00", 76 ] > [ "1ex:datetime12", "1ex:value", "D8006e4cd000000001+03:00", 76 ] > [ "1ex:datetime13", "1ex:value", "D8006e4cd0000000012+04:00", 76 ] > [ "1ex:datetime14", "1ex:value", "D8006e4cd00000000123+05:00", 76 ] > [ "1ex:datetime15", "1ex:value", "D8006e4cd00000000-00:00", 76 ] > [ "1ex:datetime16", "1ex:value", "D8006e4cd000000000-01:00", 76 ] > [ "1ex:datetime17", "1ex:value", "D8006e4cd0000000000-02:00", 76 ] > [ "1ex:datetime18", "1ex:value", "D8006e4cd000000001-03:00", 76 ] > [ "1ex:datetime19", "1ex:value", "D8006e4cd0000000012-04:00", 76 ] > [ "1ex:datetime20", "1ex:value", "D8006e4cd00000000123-05:00", 76 ] > [ "1ex:decimal-4.9999", "1ex:value", "33fec001a36e2eb1b", 51 ] > [ "1ex:decimal-5", "1ex:value", "33febffffffffffff", 51 ] > [ "1ex:decimal-5.0001", "1ex:value", "33febffe5c91d14e3", 51 ] > [ "1ex:decimal0", "1ex:value", "5", 51 ] > [ "1ex:decimal4.9999", "1ex:value", "Bc013ffe5c91d14e4", 51 ] > [ "1ex:decimal5", "1ex:value", "Bc014000000000000", 51 ] > [ "1ex:decimal5.0001", "1ex:value", "Bc014001a36e2eb1c", 51 ] > [ "1ex:int0", "1ex:value", "5", 66 ] > [ "1ex:int1", "1ex:value", "Bc1d268ef9c800000", 66 ] > [ "1ex:integer-5", "1ex:value", "33febffffffffffff", 52 ] > [ "1ex:integer0", "1ex:value", "5", 52 ] > [ "1ex:integer5", "1ex:value", "Bc014000000000000", 52 ] > [ "1ex:long0", "1ex:value", "5", 57 ] > [ "1ex:long1", "1ex:value", "Bc1d268ef9c800000", 57 ] > [ "1ex:negInt-5", "1ex:value", "33febffffffffffff", 54 ] > [ "1ex:nonNegInt0", "1ex:value", "5", 55 ] > [ "1ex:nonNegInt5", "1ex:value", "Bc014000000000000", 55 ] > [ "1ex:nonPosInt-5", "1ex:value", "33febffffffffffff", 53 ] > [ "1ex:nonPosInt0", "1ex:value", "5", 53 ] > [ "1ex:orderTest", "1ex:v1", "8A", 50 ] > [ "1ex:orderTest", "1ex:v1", "8B", 50 ] > [ "1ex:orderTest", "1ex:v1", "8C", 50 ] > [ "1ex:orderTest", "1ex:v2", "8A", 50 ] > [ "1ex:orderTest", "1ex:v2", "8B", 50 ] > [ "1ex:orderTest", "1ex:v2", "8C", 50 ] > [ "1ex:posInt5", "1ex:value", "Bc014000000000000", 56 ] > [ "1ex:short0", "1ex:value", "5", 68 ] > [ "1ex:short1", "1ex:value", "Bc014000000000000", 68 ] > [ "1ex:stringLang0", "1ex:value", "9en@this is a string with lang tag", 50 ] > [ "1ex:stringLang1", "1ex:value", "9it@ciao", 50 ] > [ "1ex:stringPlain0", "1ex:value", "8this is a plain string", 50 ] > [ "1ex:stringPlain1", "1ex:value", "8ciao", 50 ] > [ "1ex:stringTyped0", "1ex:value", "8this is a typed string", 75 ] > [ "1ex:stringTyped1", "1ex:value", "8ciao", 75 ] > [ "1ex:ubyte0", "1ex:value", "5", 71 ] > [ "1ex:ubyte1", "1ex:value", "Bc014000000000000", 71 ] > [ "1ex:uint0", "1ex:value", "5", 67 ] > [ "1ex:uint1", "1ex:value", "Bc1d268ef9c800000", 67 ] > [ "1ex:ulong0", "1ex:value", "5", 65 ] > [ "1ex:ulong1", "1ex:value", "Bc1d268ef9c800000", 65 ] > [ "1ex:ushort0", "1ex:value", "5", 69 ] > [ "1ex:ushort1", "1ex:value", "Bc014000000000000", 69 ] > [ "1ex:xmlLiteral", "1ex:value", "E<a:Box xmlns:a=\"http://example.org/a#\" required=\"true\"/>\n\t<a:widget size=\"10\"/>\n\t<a:grommit id=\"23\"/>\n</a:Box>", 77 ] > #-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "order: SOP" ] > #-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "0double-4.9999", "33fec001a36e2eb1b", "1ex:value", 73 ] > [ "0double-5", "33febffffffffffff", "1ex:value", 73 ] > [ "0double-5.0001", "33febffe5c91d14e3", "1ex:value", 73 ] > [ "0double0", "5", "1ex:value", 73 ] > [ "0double4.9999", "Bc013ffe5c91d14e4", "1ex:value", 73 ] > [ "0double5", "Bc014000000000000", "1ex:value", 73 ] > [ "0double5.0001", "Bc014001a36e2eb1c", "1ex:value", 73 ] > [ "0doubleINF", "C", "1ex:value", 73 ] > [ "0doubleNaN", "Z", "1ex:value", 73 ] > [ "0float0", "5", "1ex:value", 72 ] > [ "0float1", "33febffffffffffff", "1ex:value", 72 ] > [ "0float2", "33febffe5c91d14e3", "1ex:value", 72 ] > [ "0float3", "33fec001a36e2eb1b", "1ex:value", 72 ] > [ "0float4", "Bc014000000000000", "1ex:value", 72 ] > [ "0float5", "Bc014001a36e2eb1c", "1ex:value", 72 ] > [ "0float6", "Bc013ffe5c91d14e4", "1ex:value", 72 ] > [ "0float7", "Z", "1ex:value", 72 ] > [ "0float8", "C", "1ex:value", 72 ] > [ "1ex:boolF", "4", "1ex:value1", 74 ] > [ "1ex:boolF", "4", "1ex:value2", 74 ] > [ "1ex:boolT", "A", "1ex:value1", 74 ] > [ "1ex:boolT", "A", "1ex:value2", 74 ] > [ "1ex:byte0", "5", "1ex:value", 68 ] > [ "1ex:byte1", "Bc014000000000000", "1ex:value", 68 ] > [ "1ex:customTypedLiteral0", "Fhttp://customdatatype.org/types#custom0^customTypedLiteral", "1ex:value", 78 ] > [ "1ex:customTypedLiteral1", "Fhttp://customdatatype.org/types#custom1^customTypedLiteral", "1ex:value", 78 ] > [ "1ex:datetime01", "D8006e4cd00000000", "1ex:value", 76 ] > [ "1ex:datetime02", "D8006e4cd00000000", "1ex:value", 76 ] > [ "1ex:datetime03", "D8006e4cd00000000+00:00", "1ex:value", 76 ] > [ "1ex:datetime04", "D8006e4cd000000000", "1ex:value", 76 ] > [ "1ex:datetime05", "D8006e4cd0000000000", "1ex:value", 76 ] > [ "1ex:datetime06", "D8006e4cd000000001", "1ex:value", 76 ] > [ "1ex:datetime07", "D8006e4cd0000000012", "1ex:value", 76 ] > [ "1ex:datetime08", "D8006e4cd00000000123", "1ex:value", 76 ] > [ "1ex:datetime09", "D8006e4cd00000000+00:00", "1ex:value", 76 ] > [ "1ex:datetime10", "D8006e4cd000000000+01:00", "1ex:value", 76 ] > [ "1ex:datetime11", "D8006e4cd0000000000+02:00", "1ex:value", 76 ] > [ "1ex:datetime12", "D8006e4cd000000001+03:00", "1ex:value", 76 ] > [ "1ex:datetime13", "D8006e4cd0000000012+04:00", "1ex:value", 76 ] > [ "1ex:datetime14", "D8006e4cd00000000123+05:00", "1ex:value", 76 ] > [ "1ex:datetime15", "D8006e4cd00000000-00:00", "1ex:value", 76 ] > [ "1ex:datetime16", "D8006e4cd000000000-01:00", "1ex:value", 76 ] > [ "1ex:datetime17", "D8006e4cd0000000000-02:00", "1ex:value", 76 ] > [ "1ex:datetime18", "D8006e4cd000000001-03:00", "1ex:value", 76 ] > [ "1ex:datetime19", "D8006e4cd0000000012-04:00", "1ex:value", 76 ] > [ "1ex:datetime20", "D8006e4cd00000000123-05:00", "1ex:value", 76 ] > [ "1ex:decimal-4.9999", "33fec001a36e2eb1b", "1ex:value", 51 ] > [ "1ex:decimal-5", "33febffffffffffff", "1ex:value", 51 ] > [ "1ex:decimal-5.0001", "33febffe5c91d14e3", "1ex:value", 51 ] > [ "1ex:decimal0", "5", "1ex:value", 51 ] > [ "1ex:decimal4.9999", "Bc013ffe5c91d14e4", "1ex:value", 51 ] > [ "1ex:decimal5", "Bc014000000000000", "1ex:value", 51 ] > [ "1ex:decimal5.0001", "Bc014001a36e2eb1c", "1ex:value", 51 ] > [ "1ex:int0", "5", "1ex:value", 66 ] > [ "1ex:int1", "Bc1d268ef9c800000", "1ex:value", 66 ] > [ "1ex:integer-5", "33febffffffffffff", "1ex:value", 52 ] > [ "1ex:integer0", "5", "1ex:value", 52 ] > [ "1ex:integer5", "Bc014000000000000", "1ex:value", 52 ] > [ "1ex:long0", "5", "1ex:value", 57 ] > [ "1ex:long1", "Bc1d268ef9c800000", "1ex:value", 57 ] > [ "1ex:negInt-5", "33febffffffffffff", "1ex:value", 54 ] > [ "1ex:nonNegInt0", "5", "1ex:value", 55 ] > [ "1ex:nonNegInt5", "Bc014000000000000", "1ex:value", 55 ] > [ "1ex:nonPosInt-5", "33febffffffffffff", "1ex:value", 53 ] > [ "1ex:nonPosInt0", "5", "1ex:value", 53 ] > [ "1ex:orderTest", "8A", "1ex:v1", 50 ] > [ "1ex:orderTest", "8A", "1ex:v2", 50 ] > [ "1ex:orderTest", "8B", "1ex:v1", 50 ] > [ "1ex:orderTest", "8B", "1ex:v2", 50 ] > [ "1ex:orderTest", "8C", "1ex:v1", 50 ] > [ "1ex:orderTest", "8C", "1ex:v2", 50 ] > [ "1ex:posInt5", "Bc014000000000000", "1ex:value", 56 ] > [ "1ex:short0", "5", "1ex:value", 68 ] > [ "1ex:short1", "Bc014000000000000", "1ex:value", 68 ] > [ "1ex:stringLang0", "9en@this is a string with lang tag", "1ex:value", 50 ] > [ "1ex:stringLang1", "9it@ciao", "1ex:value", 50 ] > [ "1ex:stringPlain0", "8this is a plain string", "1ex:value", 50 ] > [ "1ex:stringPlain1", "8ciao", "1ex:value", 50 ] > [ "1ex:stringTyped0", "8this is a typed string", "1ex:value", 75 ] > [ "1ex:stringTyped1", "8ciao", "1ex:value", 75 ] > [ "1ex:ubyte0", "5", "1ex:value", 71 ] > [ "1ex:ubyte1", "Bc014000000000000", "1ex:value", 71 ] > [ "1ex:uint0", "5", "1ex:value", 67 ] > [ "1ex:uint1", "Bc1d268ef9c800000", "1ex:value", 67 ] > [ "1ex:ulong0", "5", "1ex:value", 65 ] > [ "1ex:ulong1", "Bc1d268ef9c800000", "1ex:value", 65 ] > [ "1ex:ushort0", "5", "1ex:value", 69 ] > [ "1ex:ushort1", "Bc014000000000000", "1ex:value", 69 ] > [ "1ex:xmlLiteral", "E<a:Box xmlns:a=\"http://example.org/a#\" required=\"true\"/>\n\t<a:widget size=\"10\"/>\n\t<a:grommit id=\"23\"/>\n</a:Box>", "1ex:value", 77 ] > #-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "order: PSO" ] > #-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "1ex:v1", "1ex:orderTest", "8A", 50 ] > [ "1ex:v1", "1ex:orderTest", "8B", 50 ] > [ "1ex:v1", "1ex:orderTest", "8C", 50 ] > [ "1ex:v2", "1ex:orderTest", "8A", 50 ] > [ "1ex:v2", "1ex:orderTest", "8B", 50 ] > [ "1ex:v2", "1ex:orderTest", "8C", 50 ] > [ "1ex:value", "0double-4.9999", "33fec001a36e2eb1b", 73 ] > [ "1ex:value", "0double-5", "33febffffffffffff", 73 ] > [ "1ex:value", "0double-5.0001", "33febffe5c91d14e3", 73 ] > [ "1ex:value", "0double0", "5", 73 ] > [ "1ex:value", "0double4.9999", "Bc013ffe5c91d14e4", 73 ] > [ "1ex:value", "0double5", "Bc014000000000000", 73 ] > [ "1ex:value", "0double5.0001", "Bc014001a36e2eb1c", 73 ] > [ "1ex:value", "0doubleINF", "C", 73 ] > [ "1ex:value", "0doubleNaN", "Z", 73 ] > [ "1ex:value", "0float0", "5", 72 ] > [ "1ex:value", "0float1", "33febffffffffffff", 72 ] > [ "1ex:value", "0float2", "33febffe5c91d14e3", 72 ] > [ "1ex:value", "0float3", "33fec001a36e2eb1b", 72 ] > [ "1ex:value", "0float4", "Bc014000000000000", 72 ] > [ "1ex:value", "0float5", "Bc014001a36e2eb1c", 72 ] > [ "1ex:value", "0float6", "Bc013ffe5c91d14e4", 72 ] > [ "1ex:value", "0float7", "Z", 72 ] > [ "1ex:value", "0float8", "C", 72 ] > [ "1ex:value", "1ex:byte0", "5", 68 ] > [ "1ex:value", "1ex:byte1", "Bc014000000000000", 68 ] > [ "1ex:value", "1ex:customTypedLiteral0", "Fhttp://customdatatype.org/types#custom0^customTypedLiteral", 78 ] > [ "1ex:value", "1ex:customTypedLiteral1", "Fhttp://customdatatype.org/types#custom1^customTypedLiteral", 78 ] > [ "1ex:value", "1ex:datetime01", "D8006e4cd00000000", 76 ] > [ "1ex:value", "1ex:datetime02", "D8006e4cd00000000", 76 ] > [ "1ex:value", "1ex:datetime03", "D8006e4cd00000000+00:00", 76 ] > [ "1ex:value", "1ex:datetime04", "D8006e4cd000000000", 76 ] > [ "1ex:value", "1ex:datetime05", "D8006e4cd0000000000", 76 ] > [ "1ex:value", "1ex:datetime06", "D8006e4cd000000001", 76 ] > [ "1ex:value", "1ex:datetime07", "D8006e4cd0000000012", 76 ] > [ "1ex:value", "1ex:datetime08", "D8006e4cd00000000123", 76 ] > [ "1ex:value", "1ex:datetime09", "D8006e4cd00000000+00:00", 76 ] > [ "1ex:value", "1ex:datetime10", "D8006e4cd000000000+01:00", 76 ] > [ "1ex:value", "1ex:datetime11", "D8006e4cd0000000000+02:00", 76 ] > [ "1ex:value", "1ex:datetime12", "D8006e4cd000000001+03:00", 76 ] > [ "1ex:value", "1ex:datetime13", "D8006e4cd0000000012+04:00", 76 ] > [ "1ex:value", "1ex:datetime14", "D8006e4cd00000000123+05:00", 76 ] > [ "1ex:value", "1ex:datetime15", "D8006e4cd00000000-00:00", 76 ] > [ "1ex:value", "1ex:datetime16", "D8006e4cd000000000-01:00", 76 ] > [ "1ex:value", "1ex:datetime17", "D8006e4cd0000000000-02:00", 76 ] > [ "1ex:value", "1ex:datetime18", "D8006e4cd000000001-03:00", 76 ] > [ "1ex:value", "1ex:datetime19", "D8006e4cd0000000012-04:00", 76 ] > [ "1ex:value", "1ex:datetime20", "D8006e4cd00000000123-05:00", 76 ] > [ "1ex:value", "1ex:decimal-4.9999", "33fec001a36e2eb1b", 51 ] > [ "1ex:value", "1ex:decimal-5", "33febffffffffffff", 51 ] > [ "1ex:value", "1ex:decimal-5.0001", "33febffe5c91d14e3", 51 ] > [ "1ex:value", "1ex:decimal0", "5", 51 ] > [ "1ex:value", "1ex:decimal4.9999", "Bc013ffe5c91d14e4", 51 ] > [ "1ex:value", "1ex:decimal5", "Bc014000000000000", 51 ] > [ "1ex:value", "1ex:decimal5.0001", "Bc014001a36e2eb1c", 51 ] > [ "1ex:value", "1ex:int0", "5", 66 ] > [ "1ex:value", "1ex:int1", "Bc1d268ef9c800000", 66 ] > [ "1ex:value", "1ex:integer-5", "33febffffffffffff", 52 ] > [ "1ex:value", "1ex:integer0", "5", 52 ] > [ "1ex:value", "1ex:integer5", "Bc014000000000000", 52 ] > [ "1ex:value", "1ex:long0", "5", 57 ] > [ "1ex:value", "1ex:long1", "Bc1d268ef9c800000", 57 ] > [ "1ex:value", "1ex:negInt-5", "33febffffffffffff", 54 ] > [ "1ex:value", "1ex:nonNegInt0", "5", 55 ] > [ "1ex:value", "1ex:nonNegInt5", "Bc014000000000000", 55 ] > [ "1ex:value", "1ex:nonPosInt-5", "33febffffffffffff", 53 ] > [ "1ex:value", "1ex:nonPosInt0", "5", 53 ] > [ "1ex:value", "1ex:posInt5", "Bc014000000000000", 56 ] > [ "1ex:value", "1ex:short0", "5", 68 ] > [ "1ex:value", "1ex:short1", "Bc014000000000000", 68 ] > [ "1ex:value", "1ex:stringLang0", "9en@this is a string with lang tag", 50 ] > [ "1ex:value", "1ex:stringLang1", "9it@ciao", 50 ] > [ "1ex:value", "1ex:stringPlain0", "8this is a plain string", 50 ] > [ "1ex:value", "1ex:stringPlain1", "8ciao", 50 ] > [ "1ex:value", "1ex:stringTyped0", "8this is a typed string", 75 ] > [ "1ex:value", "1ex:stringTyped1", "8ciao", 75 ] > [ "1ex:value", "1ex:ubyte0", "5", 71 ] > [ "1ex:value", "1ex:ubyte1", "Bc014000000000000", 71 ] > [ "1ex:value", "1ex:uint0", "5", 67 ] > [ "1ex:value", "1ex:uint1", "Bc1d268ef9c800000", 67 ] > [ "1ex:value", "1ex:ulong0", "5", 65 ] > [ "1ex:value", "1ex:ulong1", "Bc1d268ef9c800000", 65 ] > [ "1ex:value", "1ex:ushort0", "5", 69 ] > [ "1ex:value", "1ex:ushort1", "Bc014000000000000", 69 ] > [ "1ex:value", "1ex:xmlLiteral", "E<a:Box xmlns:a=\"http://example.org/a#\" required=\"true\"/>\n\t<a:widget size=\"10\"/>\n\t<a:grommit id=\"23\"/>\n</a:Box>", 77 ] > [ "1ex:value1", "1ex:boolF", "4", 74 ] > [ "1ex:value1", "1ex:boolT", "A", 74 ] > [ "1ex:value2", "1ex:boolF", "4", 74 ] > [ "1ex:value2", "1ex:boolT", "A", 74 ] > #-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "order: POS" ] > #-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "1ex:v1", "8A", "1ex:orderTest", 50 ] > [ "1ex:v1", "8B", "1ex:orderTest", 50 ] > [ "1ex:v1", "8C", "1ex:orderTest", 50 ] > [ "1ex:v2", "8A", "1ex:orderTest", 50 ] > [ "1ex:v2", "8B", "1ex:orderTest", 50 ] > [ "1ex:v2", "8C", "1ex:orderTest", 50 ] > [ "1ex:value", "33febffe5c91d14e3", "0double-5.0001", 73 ] > [ "1ex:value", "33febffe5c91d14e3", "0float2", 72 ] > [ "1ex:value", "33febffe5c91d14e3", "1ex:decimal-5.0001", 51 ] > [ "1ex:value", "33febffffffffffff", "0double-5", 73 ] > [ "1ex:value", "33febffffffffffff", "0float1", 72 ] > [ "1ex:value", "33febffffffffffff", "1ex:decimal-5", 51 ] > [ "1ex:value", "33febffffffffffff", "1ex:integer-5", 52 ] > [ "1ex:value", "33febffffffffffff", "1ex:negInt-5", 54 ] > [ "1ex:value", "33febffffffffffff", "1ex:nonPosInt-5", 53 ] > [ "1ex:value", "33fec001a36e2eb1b", "0double-4.9999", 73 ] > [ "1ex:value", "33fec001a36e2eb1b", "0float3", 72 ] > [ "1ex:value", "33fec001a36e2eb1b", "1ex:decimal-4.9999", 51 ] > [ "1ex:value", "5", "0double0", 73 ] > [ "1ex:value", "5", "0float0", 72 ] > [ "1ex:value", "5", "1ex:byte0", 68 ] > [ "1ex:value", "5", "1ex:decimal0", 51 ] > [ "1ex:value", "5", "1ex:int0", 66 ] > [ "1ex:value", "5", "1ex:integer0", 52 ] > [ "1ex:value", "5", "1ex:long0", 57 ] > [ "1ex:value", "5", "1ex:nonNegInt0", 55 ] > [ "1ex:value", "5", "1ex:nonPosInt0", 53 ] > [ "1ex:value", "5", "1ex:short0", 68 ] > [ "1ex:value", "5", "1ex:ubyte0", 71 ] > [ "1ex:value", "5", "1ex:uint0", 67 ] > [ "1ex:value", "5", "1ex:ulong0", 65 ] > [ "1ex:value", "5", "1ex:ushort0", 69 ] > [ "1ex:value", "8ciao", "1ex:stringPlain1", 50 ] > [ "1ex:value", "8ciao", "1ex:stringTyped1", 75 ] > [ "1ex:value", "8this is a plain string", "1ex:stringPlain0", 50 ] > [ "1ex:value", "8this is a typed string", "1ex:stringTyped0", 75 ] > [ "1ex:value", "9en@this is a string with lang tag", "1ex:stringLang0", 50 ] > [ "1ex:value", "9it@ciao", "1ex:stringLang1", 50 ] > [ "1ex:value", "Bc013ffe5c91d14e4", "0double4.9999", 73 ] > [ "1ex:value", "Bc013ffe5c91d14e4", "0float6", 72 ] > [ "1ex:value", "Bc013ffe5c91d14e4", "1ex:decimal4.9999", 51 ] > [ "1ex:value", "Bc014000000000000", "0double5", 73 ] > [ "1ex:value", "Bc014000000000000", "0float4", 72 ] > [ "1ex:value", "Bc014000000000000", "1ex:byte1", 68 ] > [ "1ex:value", "Bc014000000000000", "1ex:decimal5", 51 ] > [ "1ex:value", "Bc014000000000000", "1ex:integer5", 52 ] > [ "1ex:value", "Bc014000000000000", "1ex:nonNegInt5", 55 ] > [ "1ex:value", "Bc014000000000000", "1ex:posInt5", 56 ] > [ "1ex:value", "Bc014000000000000", "1ex:short1", 68 ] > [ "1ex:value", "Bc014000000000000", "1ex:ubyte1", 71 ] > [ "1ex:value", "Bc014000000000000", "1ex:ushort1", 69 ] > [ "1ex:value", "Bc014001a36e2eb1c", "0double5.0001", 73 ] > [ "1ex:value", "Bc014001a36e2eb1c", "0float5", 72 ] > [ "1ex:value", "Bc014001a36e2eb1c", "1ex:decimal5.0001", 51 ] > [ "1ex:value", "Bc1d268ef9c800000", "1ex:int1", 66 ] > [ "1ex:value", "Bc1d268ef9c800000", "1ex:long1", 57 ] > [ "1ex:value", "Bc1d268ef9c800000", "1ex:uint1", 67 ] > [ "1ex:value", "Bc1d268ef9c800000", "1ex:ulong1", 65 ] > [ "1ex:value", "C", "0doubleINF", 73 ] > [ "1ex:value", "C", "0float8", 72 ] > [ "1ex:value", "D8006e4cd00000000", "1ex:datetime01", 76 ] > [ "1ex:value", "D8006e4cd00000000", "1ex:datetime02", 76 ] > [ "1ex:value", "D8006e4cd00000000+00:00", "1ex:datetime03", 76 ] > [ "1ex:value", "D8006e4cd00000000+00:00", "1ex:datetime09", 76 ] > [ "1ex:value", "D8006e4cd00000000-00:00", "1ex:datetime15", 76 ] > [ "1ex:value", "D8006e4cd000000000", "1ex:datetime04", 76 ] > [ "1ex:value", "D8006e4cd000000000+01:00", "1ex:datetime10", 76 ] > [ "1ex:value", "D8006e4cd000000000-01:00", "1ex:datetime16", 76 ] > [ "1ex:value", "D8006e4cd0000000000", "1ex:datetime05", 76 ] > [ "1ex:value", "D8006e4cd0000000000+02:00", "1ex:datetime11", 76 ] > [ "1ex:value", "D8006e4cd0000000000-02:00", "1ex:datetime17", 76 ] > [ "1ex:value", "D8006e4cd000000001", "1ex:datetime06", 76 ] > [ "1ex:value", "D8006e4cd000000001+03:00", "1ex:datetime12", 76 ] > [ "1ex:value", "D8006e4cd000000001-03:00", "1ex:datetime18", 76 ] > [ "1ex:value", "D8006e4cd0000000012", "1ex:datetime07", 76 ] > [ "1ex:value", "D8006e4cd0000000012+04:00", "1ex:datetime13", 76 ] > [ "1ex:value", "D8006e4cd0000000012-04:00", "1ex:datetime19", 76 ] > [ "1ex:value", "D8006e4cd00000000123", "1ex:datetime08", 76 ] > [ "1ex:value", "D8006e4cd00000000123+05:00", "1ex:datetime14", 76 ] > [ "1ex:value", "D8006e4cd00000000123-05:00", "1ex:datetime20", 76 ] > [ "1ex:value", "E<a:Box xmlns:a=\"http://example.org/a#\" required=\"true\"/>\n\t<a:widget size=\"10\"/>\n\t<a:grommit id=\"23\"/>\n</a:Box>", "1ex:xmlLiteral", 77 ] > [ "1ex:value", "Fhttp://customdatatype.org/types#custom0^customTypedLiteral", "1ex:customTypedLiteral0", 78 ] > [ "1ex:value", "Fhttp://customdatatype.org/types#custom1^customTypedLiteral", "1ex:customTypedLiteral1", 78 ] > [ "1ex:value", "Z", "0doubleNaN", 73 ] > [ "1ex:value", "Z", "0float7", 72 ] > [ "1ex:value1", "4", "1ex:boolF", 74 ] > [ "1ex:value1", "A", "1ex:boolT", 74 ] > [ "1ex:value2", "4", "1ex:boolF", 74 ] > [ "1ex:value2", "A", "1ex:boolT", 74 ] > #-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "order: OPS" ] > #-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "33febffe5c91d14e3", "1ex:value", "0double-5.0001", 73 ] > [ "33febffe5c91d14e3", "1ex:value", "0float2", 72 ] > [ "33febffe5c91d14e3", "1ex:value", "1ex:decimal-5.0001", 51 ] > [ "33febffffffffffff", "1ex:value", "0double-5", 73 ] > [ "33febffffffffffff", "1ex:value", "0float1", 72 ] > [ "33febffffffffffff", "1ex:value", "1ex:decimal-5", 51 ] > [ "33febffffffffffff", "1ex:value", "1ex:integer-5", 52 ] > [ "33febffffffffffff", "1ex:value", "1ex:negInt-5", 54 ] > [ "33febffffffffffff", "1ex:value", "1ex:nonPosInt-5", 53 ] > [ "33fec001a36e2eb1b", "1ex:value", "0double-4.9999", 73 ] > [ "33fec001a36e2eb1b", "1ex:value", "0float3", 72 ] > [ "33fec001a36e2eb1b", "1ex:value", "1ex:decimal-4.9999", 51 ] > [ "4", "1ex:value1", "1ex:boolF", 74 ] > [ "4", "1ex:value2", "1ex:boolF", 74 ] > [ "5", "1ex:value", "0double0", 73 ] > [ "5", "1ex:value", "0float0", 72 ] > [ "5", "1ex:value", "1ex:byte0", 68 ] > [ "5", "1ex:value", "1ex:decimal0", 51 ] > [ "5", "1ex:value", "1ex:int0", 66 ] > [ "5", "1ex:value", "1ex:integer0", 52 ] > [ "5", "1ex:value", "1ex:long0", 57 ] > [ "5", "1ex:value", "1ex:nonNegInt0", 55 ] > [ "5", "1ex:value", "1ex:nonPosInt0", 53 ] > [ "5", "1ex:value", "1ex:short0", 68 ] > [ "5", "1ex:value", "1ex:ubyte0", 71 ] > [ "5", "1ex:value", "1ex:uint0", 67 ] > [ "5", "1ex:value", "1ex:ulong0", 65 ] > [ "5", "1ex:value", "1ex:ushort0", 69 ] > [ "8A", "1ex:v1", "1ex:orderTest", 50 ] > [ "8A", "1ex:v2", "1ex:orderTest", 50 ] > [ "8B", "1ex:v1", "1ex:orderTest", 50 ] > [ "8B", "1ex:v2", "1ex:orderTest", 50 ] > [ "8C", "1ex:v1", "1ex:orderTest", 50 ] > [ "8C", "1ex:v2", "1ex:orderTest", 50 ] > [ "8ciao", "1ex:value", "1ex:stringPlain1", 50 ] > [ "8ciao", "1ex:value", "1ex:stringTyped1", 75 ] > [ "8this is a plain string", "1ex:value", "1ex:stringPlain0", 50 ] > [ "8this is a typed string", "1ex:value", "1ex:stringTyped0", 75 ] > [ "9en@this is a string with lang tag", "1ex:value", "1ex:stringLang0", 50 ] > [ "9it@ciao", "1ex:value", "1ex:stringLang1", 50 ] > [ "A", "1ex:value1", "1ex:boolT", 74 ] > [ "A", "1ex:value2", "1ex:boolT", 74 ] > [ "Bc013ffe5c91d14e4", "1ex:value", "0double4.9999", 73 ] > [ "Bc013ffe5c91d14e4", "1ex:value", "0float6", 72 ] > [ "Bc013ffe5c91d14e4", "1ex:value", "1ex:decimal4.9999", 51 ] > [ "Bc014000000000000", "1ex:value", "0double5", 73 ] > [ "Bc014000000000000", "1ex:value", "0float4", 72 ] > [ "Bc014000000000000", "1ex:value", "1ex:byte1", 68 ] > [ "Bc014000000000000", "1ex:value", "1ex:decimal5", 51 ] > [ "Bc014000000000000", "1ex:value", "1ex:integer5", 52 ] > [ "Bc014000000000000", "1ex:value", "1ex:nonNegInt5", 55 ] > [ "Bc014000000000000", "1ex:value", "1ex:posInt5", 56 ] > [ "Bc014000000000000", "1ex:value", "1ex:short1", 68 ] > [ "Bc014000000000000", "1ex:value", "1ex:ubyte1", 71 ] > [ "Bc014000000000000", "1ex:value", "1ex:ushort1", 69 ] > [ "Bc014001a36e2eb1c", "1ex:value", "0double5.0001", 73 ] > [ "Bc014001a36e2eb1c", "1ex:value", "0float5", 72 ] > [ "Bc014001a36e2eb1c", "1ex:value", "1ex:decimal5.0001", 51 ] > [ "Bc1d268ef9c800000", "1ex:value", "1ex:int1", 66 ] > [ "Bc1d268ef9c800000", "1ex:value", "1ex:long1", 57 ] > [ "Bc1d268ef9c800000", "1ex:value", "1ex:uint1", 67 ] > [ "Bc1d268ef9c800000", "1ex:value", "1ex:ulong1", 65 ] > [ "C", "1ex:value", "0doubleINF", 73 ] > [ "C", "1ex:value", "0float8", 72 ] > [ "D8006e4cd00000000", "1ex:value", "1ex:datetime01", 76 ] > [ "D8006e4cd00000000", "1ex:value", "1ex:datetime02", 76 ] > [ "D8006e4cd00000000+00:00", "1ex:value", "1ex:datetime03", 76 ] > [ "D8006e4cd00000000+00:00", "1ex:value", "1ex:datetime09", 76 ] > [ "D8006e4cd00000000-00:00", "1ex:value", "1ex:datetime15", 76 ] > [ "D8006e4cd000000000", "1ex:value", "1ex:datetime04", 76 ] > [ "D8006e4cd000000000+01:00", "1ex:value", "1ex:datetime10", 76 ] > [ "D8006e4cd000000000-01:00", "1ex:value", "1ex:datetime16", 76 ] > [ "D8006e4cd0000000000", "1ex:value", "1ex:datetime05", 76 ] > [ "D8006e4cd0000000000+02:00", "1ex:value", "1ex:datetime11", 76 ] > [ "D8006e4cd0000000000-02:00", "1ex:value", "1ex:datetime17", 76 ] > [ "D8006e4cd000000001", "1ex:value", "1ex:datetime06", 76 ] > [ "D8006e4cd000000001+03:00", "1ex:value", "1ex:datetime12", 76 ] > [ "D8006e4cd000000001-03:00", "1ex:value", "1ex:datetime18", 76 ] > [ "D8006e4cd0000000012", "1ex:value", "1ex:datetime07", 76 ] > [ "D8006e4cd0000000012+04:00", "1ex:value", "1ex:datetime13", 76 ] > [ "D8006e4cd0000000012-04:00", "1ex:value", "1ex:datetime19", 76 ] > [ "D8006e4cd00000000123", "1ex:value", "1ex:datetime08", 76 ] > [ "D8006e4cd00000000123+05:00", "1ex:value", "1ex:datetime14", 76 ] > [ "D8006e4cd00000000123-05:00", "1ex:value", "1ex:datetime20", 76 ] > [ "E<a:Box xmlns:a=\"http://example.org/a#\" required=\"true\"/>\n\t<a:widget size=\"10\"/>\n\t<a:grommit id=\"23\"/>\n</a:Box>", "1ex:value", "1ex:xmlLiteral", 77 ] > [ "Fhttp://customdatatype.org/types#custom0^customTypedLiteral", "1ex:value", "1ex:customTypedLiteral0", 78 ] > [ "Fhttp://customdatatype.org/types#custom1^customTypedLiteral", "1ex:value", "1ex:customTypedLiteral1", 78 ] > [ "Z", "1ex:value", "0doubleNaN", 73 ] > [ "Z", "1ex:value", "0float7", 72 ] > #-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "order: OSP" ] > #-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > [ "33febffe5c91d14e3", "0double-5.0001", "1ex:value", 73 ] > [ "33febffe5c91d14e3", "0float2", "1ex:value", 72 ] > [ "33febffe5c91d14e3", "1ex:decimal-5.0001", "1ex:value", 51 ] > [ "33febffffffffffff", "0double-5", "1ex:value", 73 ] > [ "33febffffffffffff", "0float1", "1ex:value", 72 ] > [ "33febffffffffffff", "1ex:decimal-5", "1ex:value", 51 ] > [ "33febffffffffffff", "1ex:integer-5", "1ex:value", 52 ] > [ "33febffffffffffff", "1ex:negInt-5", "1ex:value", 54 ] > [ "33febffffffffffff", "1ex:nonPosInt-5", "1ex:value", 53 ] > [ "33fec001a36e2eb1b", "0double-4.9999", "1ex:value", 73 ] > [ "33fec001a36e2eb1b", "0float3", "1ex:value", 72 ] > [ "33fec001a36e2eb1b", "1ex:decimal-4.9999", "1ex:value", 51 ] > [ "4", "1ex:boolF", "1ex:value1", 74 ] > [ "4", "1ex:boolF", "1ex:value2", 74 ] > [ "5", "0double0", "1ex:value", 73 ] > [ "5", "0float0", "1ex:value", 72 ] > [ "5", "1ex:byte0", "1ex:value", 68 ] > [ "5", "1ex:decimal0", "1ex:value", 51 ] > [ "5", "1ex:int0", "1ex:value", 66 ] > [ "5", "1ex:integer0", "1ex:value", 52 ] > [ "5", "1ex:long0", "1ex:value", 57 ] > [ "5", "1ex:nonNegInt0", "1ex:value", 55 ] > [ "5", "1ex:nonPosInt0", "1ex:value", 53 ] > [ "5", "1ex:short0", "1ex:value", 68 ] > [ "5", "1ex:ubyte0", "1ex:value", 71 ] > [ "5", "1ex:uint0", "1ex:value", 67 ] > [ "5", "1ex:ulong0", "1ex:value", 65 ] > [ "5", "1ex:ushort0", "1ex:value", 69 ] > [ "8A", "1ex:orderTest", "1ex:v1", 50 ] > [ "8A", "1ex:orderTest", "1ex:v2", 50 ] > [ "8B", "1ex:orderTest", "1ex:v1", 50 ] > [ "8B", "1ex:orderTest", "1ex:v2", 50 ] > [ "8C", "1ex:orderTest", "1ex:v1", 50 ] > [ "8C", "1ex:orderTest", "1ex:v2", 50 ] > [ "8ciao", "1ex:stringPlain1", "1ex:value", 50 ] > [ "8ciao", "1ex:stringTyped1", "1ex:value", 75 ] > [ "8this is a plain string", "1ex:stringPlain0", "1ex:value", 50 ] > [ "8this is a typed string", "1ex:stringTyped0", "1ex:value", 75 ] > [ "9en@this is a string with lang tag", "1ex:stringLang0", "1ex:value", 50 ] > [ "9it@ciao", "1ex:stringLang1", "1ex:value", 50 ] > [ "A", "1ex:boolT", "1ex:value1", 74 ] > [ "A", "1ex:boolT", "1ex:value2", 74 ] > [ "Bc013ffe5c91d14e4", "0double4.9999", "1ex:value", 73 ] > [ "Bc013ffe5c91d14e4", "0float6", "1ex:value", 72 ] > [ "Bc013ffe5c91d14e4", "1ex:decimal4.9999", "1ex:value", 51 ] > [ "Bc014000000000000", "0double5", "1ex:value", 73 ] > [ "Bc014000000000000", "0float4", "1ex:value", 72 ] > [ "Bc014000000000000", "1ex:byte1", "1ex:value", 68 ] > [ "Bc014000000000000", "1ex:decimal5", "1ex:value", 51 ] > [ "Bc014000000000000", "1ex:integer5", "1ex:value", 52 ] > [ "Bc014000000000000", "1ex:nonNegInt5", "1ex:value", 55 ] > [ "Bc014000000000000", "1ex:posInt5", "1ex:value", 56 ] > [ "Bc014000000000000", "1ex:short1", "1ex:value", 68 ] > [ "Bc014000000000000", "1ex:ubyte1", "1ex:value", 71 ] > [ "Bc014000000000000", "1ex:ushort1", "1ex:value", 69 ] > [ "Bc014001a36e2eb1c", "0double5.0001", "1ex:value", 73 ] > [ "Bc014001a36e2eb1c", "0float5", "1ex:value", 72 ] > [ "Bc014001a36e2eb1c", "1ex:decimal5.0001", "1ex:value", 51 ] > [ "Bc1d268ef9c800000", "1ex:int1", "1ex:value", 66 ] > [ "Bc1d268ef9c800000", "1ex:long1", "1ex:value", 57 ] > [ "Bc1d268ef9c800000", "1ex:uint1", "1ex:value", 67 ] > [ "Bc1d268ef9c800000", "1ex:ulong1", "1ex:value", 65 ] > [ "C", "0doubleINF", "1ex:value", 73 ] > [ "C", "0float8", "1ex:value", 72 ] > [ "D8006e4cd00000000", "1ex:datetime01", "1ex:value", 76 ] > [ "D8006e4cd00000000", "1ex:datetime02", "1ex:value", 76 ] > [ "D8006e4cd00000000+00:00", "1ex:datetime03", "1ex:value", 76 ] > [ "D8006e4cd00000000+00:00", "1ex:datetime09", "1ex:value", 76 ] > [ "D8006e4cd00000000-00:00", "1ex:datetime15", "1ex:value", 76 ] > [ "D8006e4cd000000000", "1ex:datetime04", "1ex:value", 76 ] > [ "D8006e4cd000000000+01:00", "1ex:datetime10", "1ex:value", 76 ] > [ "D8006e4cd000000000-01:00", "1ex:datetime16", "1ex:value", 76 ] > [ "D8006e4cd0000000000", "1ex:datetime05", "1ex:value", 76 ] > [ "D8006e4cd0000000000+02:00", "1ex:datetime11", "1ex:value", 76 ] > [ "D8006e4cd0000000000-02:00", "1ex:datetime17", "1ex:value", 76 ] > [ "D8006e4cd000000001", "1ex:datetime06", "1ex:value", 76 ] > [ "D8006e4cd000000001+03:00", "1ex:datetime12", "1ex:value", 76 ] > [ "D8006e4cd000000001-03:00", "1ex:datetime18", "1ex:value", 76 ] > [ "D8006e4cd0000000012", "1ex:datetime07", "1ex:value", 76 ] > [ "D8006e4cd0000000012+04:00", "1ex:datetime13", "1ex:value", 76 ] > [ "D8006e4cd0000000012-04:00", "1ex:datetime19", "1ex:value", 76 ] > [ "D8006e4cd00000000123", "1ex:datetime08", "1ex:value", 76 ] > [ "D8006e4cd00000000123+05:00", "1ex:datetime14", "1ex:value", 76 ] > [ "D8006e4cd00000000123-05:00", "1ex:datetime20", "1ex:value", 76 ] > [ "E<a:Box xmlns:a=\"http://example.org/a#\" required=\"true\"/>\n\t<a:widget size=\"10\"/>\n\t<a:grommit id=\"23\"/>\n</a:Box>", "1ex:xmlLiteral", "1ex:value", 77 ] > [ "Fhttp://customdatatype.org/types#custom0^customTypedLiteral", "1ex:customTypedLiteral0", "1ex:value", 78 ] > [ "Fhttp://customdatatype.org/types#custom1^customTypedLiteral", "1ex:customTypedLiteral1", "1ex:value", 78 ] > [ "Z", "0doubleNaN", "1ex:value", 73 ] > [ "Z", "0float7", "1ex:value", 72 ] > #-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------# > > # 13:37:22 > > # 13:37:22 > Done. > # 13:37:22 > > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 11

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime xrpc_server.mx, , 1.82, 1.83
by Ying Zhang 23 Jul '08

23 Jul '08

Hi Stefan, Thanks for cleaning up the code. However, it is referred in MIL, so I think this change will break loading the module. This BAT should be used by xrpc_handle_file_request() for security check. I should add code to do this, so I'd suggest to undo this change. What do you think? Regards, Jennie On Jul 23, 2008, at 12:37 , Stefan Manegold wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv9875/ > pathfinder/runtime > > Modified Files: > xrpc_server.mx > Log Message: > > clean-up: removing unused global variable > > > U xrpc_server.mx > Index: xrpc_server.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc_server.mx,v > retrieving revision 1.82 > retrieving revision 1.83 > diff -u -d -r1.82 -r1.83 > --- xrpc_server.mx 17 Jul 2008 21:28:28 -0000 1.82 > +++ xrpc_server.mx 23 Jul 2008 10:37:49 -0000 1.83 > @@ -194,7 +194,7 @@ > static MT_Sema xrpc_commit_sema; > static xrpc_commit_t *xrpc_commit_active = NULL; > > -BAT *xrpc_trusted = NULL, *xrpc_admin = NULL, *xrpc_user = NULL; > +BAT *xrpc_trusted = NULL, *xrpc_admin = NULL; > char *xrpc_hostname = NULL; > int xrpc_port = 0; > > @@ -889,7 +889,6 @@ > @:xrpc_bat(admin,str)@ > xrpc_admin = xrpc_bat; > @:xrpc_bat(user,str)@ > - xrpc_user = xrpc_bat; > > CMDmy_hostname(&xrpc_hostname); > MT_init_sema(xrpc_commit_sema,0, "XRPC_COMMIT_SEMA"); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins

2 3

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_system.mx, , 1.111, 1.112 gdk_utils.mx, , 1.211, 1.212
by Stefan Manegold 23 Jul '08

23 Jul '08

On Tue, Jul 22, 2008 at 03:07:06PM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv22418 > > Modified Files: > gdk_system.mx gdk_utils.mx > Log Message: > Switching from GDKcores to GDKnr_threads. > As MTcheck_nr_cores() is to expensive on startup, so only use it > when GDKnr_threads == 0. > GDKnr_threads is set via the environment variable 'gdk_nr_threads'. > > > U gdk_utils.mx > Index: gdk_utils.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_utils.mx,v > retrieving revision 1.211 > retrieving revision 1.212 > diff -u -d -r1.211 -r1.212 > --- gdk_utils.mx 19 Jul 2008 08:16:33 -0000 1.211 > +++ gdk_utils.mx 22 Jul 2008 15:07:01 -0000 1.212 > @@ -177,6 +177,21 @@ > } > > @h > +gdk_export int GDKgetenv_int(const char *name, int def); > + > +@c > +int > +GDKgetenv_int(const char *name, int def) > +{ > + char *val = GDKgetenv(name); > + > + if (val) { > + int d = strtod(val, NULL); ^^^ ^ Niels, should this be "atoi()" instead of "strtod()"? The Microsoft compiler on Windows (IMHO correctly) warns about: ".\..\..\..\src\gdk\gdk_utils.mx(189) : warning C4244: 'initializing' : conversion from 'double' to 'int', possible loss of data" Stefan > + return d; > + } > + return def; > +} > +@h > gdk_export void GDKsetenv(str name, str value); > > @c > @@ -1553,7 +1568,9 @@ > MT_create_thread(&t, GDKvmtrim, &GDK_mem_maxsize); > } > #endif > - GDKcores = MT_check_nr_cores(); > + GDKnr_threads = GDKgetenv_int("gdk_nr_threads", 0); > + if (GDKnr_threads == 0) > + GDKnr_threads = MT_check_nr_cores(); > return 1; > } > > @@ -1563,11 +1580,11 @@ > The buffer pool manager takes care of this. > @h > gdk_export int GDKstopped; > -gdk_export int GDKcores; > +gdk_export int GDKnr_threads; > > @c > int GDKstopped = 1; > -int GDKcores = 1; > +int GDKnr_threads = 0; > > @h > gdk_export void GDKexit(int status); > > U gdk_system.mx > Index: gdk_system.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_system.mx,v > retrieving revision 1.111 > retrieving revision 1.112 > diff -u -d -r1.111 -r1.112 > --- gdk_system.mx 19 Jul 2008 08:16:33 -0000 1.111 > +++ gdk_system.mx 22 Jul 2008 15:07:01 -0000 1.112 > @@ -521,7 +521,7 @@ > } > > #define SMP_TOLERANCE 0.40 > -#define SMP_ROUNDS 1024*1024*16 > +#define SMP_ROUNDS 1024*1024*128 > > static void > smp_thread(void *data) > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_recycle.mx, , 1.120, 1.121
by Stefan Manegold 23 Jul '08

23 Jul '08

On Tue, Jul 22, 2008 at 03:48:02PM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv5497 > > Modified Files: > mal_recycle.mx > Log Message: > Fix so that initialization happens *exactly* once. > The initialization of a per-process (a.k.a. global) varirable should > be governed by a per-process variable, not a per-thread or > per-something-else variable. Especially not if that variable isn't > actually used to indicate whether initialization took place (see > OPTrecycleImplementation in src/optimizer/opt_recycler.mx where > version was set to -1 which broke the use here. > This fixes most of the numerous SQL tests that were failing on Windows (with M5 server, only) --- thank you very much for caring and taking care! Stefan > > U mal_recycle.mx > Index: mal_recycle.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_recycle.mx,v > retrieving revision 1.120 > retrieving revision 1.121 > diff -u -d -r1.120 -r1.121 > --- mal_recycle.mx 22 Jul 2008 06:27:53 -0000 1.120 > +++ mal_recycle.mx 22 Jul 2008 15:47:58 -0000 1.121 > @@ -244,10 +244,13 @@ > > void RECYCLEversion(Client cntxt, MalBlkPtr mb) > { > + static int recycleLockInitialized = 0; > int i; > > - if (mb->version == 0) > + if (!recycleLockInitialized) { > MT_init_lock(recycleLock,"recycleLock"); > + recycleLockInitialized = 1; > + } > if ( mb->version && mb->version != recycleVersion) { > mal_set_lock(recycleLock,"recycle"); > /* all re-used instructions are dropped */ > @@ -257,8 +260,8 @@ > (void) cntxt; > #endif > for(i=1; i<mb->stop; i++) > - if (getInstrPtr(mb,i)->recycle) > - getInstrPtr(mb,i)->recycle = -1; > + if (getInstrPtr(mb,i)->recycle) > + getInstrPtr(mb,i)->recycle = -1; > mal_unset_lock(recycleLock,"recycle"); > } > mb->version = recycleVersion; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/storage/bpm bpm_distribution.mx, , 1.1, 1.2
by Stefan Manegold 22 Jul '08

22 Jul '08

On Mon, Jul 21, 2008 at 04:08:53PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/storage/bpm > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv12270 > > Modified Files: > bpm_distribution.mx > Log Message: > Use strdup to avoid problems with garbage on the string. > I suppose you do take care of the "garbage" that strdup() creates, i.e., free() the malloc()'ed memory once it is not used any more ... Stefan > > U bpm_distribution.mx > Index: bpm_distribution.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/storage/bpm/bpm_distribution.mx,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- bpm_distribution.mx 19 Jan 2008 17:10:34 -0000 1.1 > +++ bpm_distribution.mx 21 Jul 2008 16:08:50 -0000 1.2 > @@ -90,11 +90,11 @@ > bpmHost bpmH = NULL; > bpmH = ZNEW(bpmHostRec); > bpmH->id = id; > - bpmH->host = host; > + bpmH->host = strdup(host); > bpmH->port = port; > - bpmH->dbname = dbname; > - bpmH->user = user; > - bpmH->passwd = password; > + bpmH->dbname = strdup(dbname); > + bpmH->user = strdup(user); > + bpmH->passwd = strdup(password); > bpmH->next = hostAnchor; > hostAnchor = bpmH; > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > > > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 5

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/tests/gdkTests/Tests append_dense_tail.stable.out, MonetDB_5-6, 1.5.2.1, 1.5.2.2
by Stefan Manegold 22 Jul '08

22 Jul '08

Martin, prior to this checkin, this test used to work fine (i.e., create no differences) both with Stable & Current. After this checkin to the Stable branch (and its propagation to the Current trunk), the test does fail as follows: http://monetdb.cwi.nl/testing/projects/monetdb/Stable/MonetDB5/.mTests103/G… http://monetdb.cwi.nl/testing/projects/monetdb/Current/MonetDB5/.mTests103/… Has the output been incorrectly approved? Or is the output as expected, but some related code buggy? I would be very thankful, if you could check & fix this problem. Stefan On Sat, Jul 19, 2008 at 05:25:27PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/tests/gdkTests/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv8526/tests/gdkTests/Tests > > Modified Files: > Tag: MonetDB_5-6 > append_dense_tail.stable.out > Log Message: > Approved. > > > U append_dense_tail.stable.out > Index: append_dense_tail.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/tests/gdkTests/Tests/append_dense_tail.stable.out,v > retrieving revision 1.5.2.1 > retrieving revision 1.5.2.2 > diff -u -d -r1.5.2.1 -r1.5.2.2 > --- append_dense_tail.stable.out 10 Jul 2008 18:34:35 -0000 1.5.2.1 > +++ append_dense_tail.stable.out 19 Jul 2008 17:25:25 -0000 1.5.2.2 > @@ -80,10 +80,10 @@ > # h t # name > # str str # type > #-------------------------# > -[ "hdense", "1" ] > [ "hseqbase", "0@0" ] > -[ "tdense", "0" ] > +[ "hdense", "1" ] > [ "tseqbase", "0@0" ] > +[ "tdense", "0" ] > > # 09:01:01 > > # 09:01:01 > Done. > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Monet-in-a-File
by Stefan de Konink 20 Jul '08

20 Jul '08

Hi, By a thought that I have expressed to Niels as alternative for [the-idea-that-i'm-not-going-mention-here]. I was wondering how much work it would take to make MonetDB to work directly on fixed size files. I'm not going into details but anyone with a bit computer experience would know what fixed size files are in an operation system perspective. Would it be feasible to memory map directly to a disk instead, or would this potentially harm the performance with respect to transactions? With the storage method that I have in mind the backend would make absolutely sure the file is stored bit correct. Stefan ps. After writing this mail I have realized this could be applied on the two different projectes we discussed.

1 0

Re: [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures
by SOL ZADEH 19 Jul '08

19 Jul '08

Thanks Martin; let me explain better: if table update are too costly (slow etc) then could try insertion instead (having/including the timestamps as an index) providing the server can cope with very frequent table insertions. Is there any benchmark tests in relation to table insertions? Regarding : >> Concurrent transactions can freely read a consistent copy of the database. does this mean "dirty reads" ? Regards ----- Original Message ---- From: Martin Kersten <Martin.Kersten(a)cwi.nl> To: SOL ZADEH <solzadeh(a)yahoo.com> Cc: Niels Nes <Niels.Nes(a)cwi.nl>; monetdb-developers(a)lists.sourceforge.net Sent: Saturday, July 19, 2008 2:22:16 PM Subject: Re: [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures SOL ZADEH wrote: > > Thanks Neils for your prompt reply. > > Is there a quantified limitation on "insertions" on scenarios I > mentioned below (multiple tables/database)? > I.e. Does very frequent insertions on 2 or more tables (on same > database or other database on the same server) > in any way effect the performance of the other queries > (select,insert,update) on the "same" > or "other" tables (i.e. is parallel processing possible & locking > performance etc). > Regards Trying to interpret you question what it means. MonetDB does not lock tables or databases during update. Concurrent transactions can freely read a consistent copy of the database. All interference comes from sharing the same CPU, memory and IO channels. > > ----- Original Message ---- > From: Niels Nes <Niels.Nes(a)cwi.nl> > To: SOL ZADEH <solzadeh(a)yahoo.com> > Cc: monetdb-developers(a)lists.sourceforge.net > Sent: Saturday, July 19, 2008 8:49:55 AM > Subject: Re: [Monetdb-developers] tables/databases simultaneous > updates & extended-stored-procedures > > On Fri, Jul 18, 2008 at 05:13:54PM -0700, SOL ZADEH wrote: > > Hi > > > > > > I have a couple of questions and really appreciate if any one > > could answer them or instruct me to the relevant forum topics: > > > > > > 1- what is the limitations (speed, threshold etc) on > > simultaneous tables /databases update i.e. via multiple odbc > > connection lets say (also any other faster API to interface > > with the MonetDB ?) > MonetDB research concentrated mostly in low update/high query loads. The > update implementation is still quite capable, but no reall performance > experiments on updates have been conducted. Next to odbc we have > mapi and jdbc APIs available. > > > > > > 2- Is there a way to have the triggers to generate > > real-world (non-db) events i.e. similar to the Extended Stored > > Procedure in SqlServer or the way Oracle allows you to run Java > > code inside the stored procedures. > MonetDB can be extended using C-code and that code could be run within > the triggers. > > Niels > > > > Thanks > > > > ------------------------------------------------------------------------- > > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > > Build the coolest Linux based applications with Moblin SDK & win > great prizes > > Grand prize is a trip for two to an Open Source event anywhere in > the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > _______________________________________________ > > Monetdb-developers mailing list > > Monetdb-developers(a)lists.sourceforge.net > <mailto:Monetdb-developers@lists.sourceforge.net> > > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > -- > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > url: http://www.cwi.nl/~niels <http://www.cwi.nl/%7Eniels> e-mail: > Niels.Nes(a)cwi.nl <mailto:Niels.Nes@cwi.nl> > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > ------------------------------------------------------------------------ > > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers >

1 0

Re: [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures
by SOL ZADEH 19 Jul '08

19 Jul '08

Thanks Neils for your prompt reply. Is there a quantified limitation on "insertions" on scenarios I mentioned below (multiple tables/database)? I.e. Does very frequent insertions on 2 or more tables (on same database or other database on the same server) in any way effect the performance of the other queries (select,insert,update) on the "same" or "other" tables (i.e. is parallel processing possible & locking performance etc). Regards ----- Original Message ---- From: Niels Nes <Niels.Nes(a)cwi.nl> To: SOL ZADEH <solzadeh(a)yahoo.com> Cc: monetdb-developers(a)lists.sourceforge.net Sent: Saturday, July 19, 2008 8:49:55 AM Subject: Re: [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures On Fri, Jul 18, 2008 at 05:13:54PM -0700, SOL ZADEH wrote: > Hi > > > I have a couple of questions and really appreciate if any one > could answer them or instruct me to the relevant forum topics: > > > 1- what is the limitations (speed, threshold etc) on > simultaneous tables /databases update i.e. via multiple odbc > connection lets say (also any other faster API to interface > with the MonetDB ?) MonetDB research concentrated mostly in low update/high query loads. The update implementation is still quite capable, but no reall performance experiments on updates have been conducted. Next to odbc we have mapi and jdbc APIs available. > > > 2- Is there a way to have the triggers to generate > real-world (non-db) events i.e. similar to the Extended Stored > Procedure in SqlServer or the way Oracle allows you to run Java > code inside the stored procedures. MonetDB can be extended using C-code and that code could be run within the triggers. Niels > > Thanks > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers -- Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl

2 1

[Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures
by SOL ZADEH 19 Jul '08

19 Jul '08

Hi I have a couple of questions and really appreciate if any one could answer them or instruct me to the relevant forum topics: 1- what is the limitations (speed, threshold etc) on simultaneous tables /databases update i.e. via multiple odbc connection lets say (also any other faster API to interface with the MonetDB ?) 2- Is there a way to have the triggers to generate real-world (non-db) events i.e. similar to the Extended Stored Procedure in SqlServer or the way Oracle allows you to run Java code inside the stored procedures. Thanks

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime Makefile.ag, , 1.91, 1.92
by Ying Zhang 18 Jul '08

18 Jul '08

On Fri, Jul 18, 2008 at 01:25:23PM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv28620 > > Modified Files: > Makefile.ag > Log Message: > XRPC server needs TYPE_logger. > Now it compiles on Windows (64 bit). Thanks Sjoerd! > > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/Makefile.ag,v > retrieving revision 1.91 > retrieving revision 1.92 > diff -u -d -r1.91 -r1.92 > --- Makefile.ag 17 Jul 2008 21:28:28 -0000 1.91 > +++ Makefile.ag 18 Jul 2008 13:25:21 -0000 1.92 > @@ -124,7 +124,7 @@ > ./lib_pf_support ./lib_pathfinder \ > $(PF_LIBS) $(SOCKET_LIBS) \ > $(MONETDB_LIBS) -lbat -lstream $(MONETDB4_LIBS) -lmonet $(PTHREAD_LIBS) \ > - $(MONETDB4_MODS) -l_mapi -l_streams -l_builtin -l_ascii_io > + $(MONETDB4_MODS) -l_logger -l_mapi -l_streams -l_builtin -l_ascii_io > } > > headers_mil = { > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB4/src/mapi/Tests All, , 1.2, 1.3
by Stefan Manegold 18 Jul '08

18 Jul '08

On Fri, Jul 18, 2008 at 11:46:19AM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB4/src/mapi/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv19788 > > Modified Files: > All > Log Message: > Test can only be run if compiled with HAVE_PYTHON (else Mapi.py does > not get installed). > This reminds me of a "minor"(?) flaw in Mtest.py: Mapi.py gets installed in case clients was configured with python avialable, but Mtest.py set "HAVE_PYTHON" if MonetDB was configured with python avialable. Hence, in case clients and MonetDB are not configured equally, the conditional does not reflect the actual status. The same hold for all static/compile-time conditionals currently supported by Mtest.py. To solve this problem, we could consider deriving all conditionals only at runtime as Mtest.py already does, e.g., for all MonetDB/Java related conditional. ... once we will have some spare time ... Stefan > > U All > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB4/src/mapi/Tests/All,v > retrieving revision 1.2 > retrieving revision 1.3 > diff -u -d -r1.2 -r1.3 > --- All 12 Jan 2007 17:19:23 -0000 1.2 > +++ All 18 Jul 2008 11:46:14 -0000 1.3 > @@ -1,3 +1,3 @@ > monet_BATs > -manyMapiClients > +HAVE_PYTHON?manyMapiClients > utf_8_C > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0