- developers-list - monetdb.org

Re: [Monetdb-developers] MonetDB: default - Add HEADLESS warning flag
by Stefan Manegold 15 Jul '12

15 Jul '12

FYI: "headless" means *dense* BAT heads (unless they are void-nil). S. ----- Original Message ----- > Changeset: 3be4152afaa3 for MonetDB > URL: > http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=3be4152afaa3 > Modified Files: > gdk/gdk.h > gdk/gdk_bat.c > gdk/gdk_bat.h > monetdb5/mal/mal_dataflow.c > monetdb5/mal/mal_interpreter.c > Branch: default > Log Message: > > Add HEADLESS warning flag > During conversion towards :oid and col it would be nice to > trap all cases where an 'alien' bat is created. > A free bit in the debug flag is used for that purpose. > > > diffs (71 lines): > > diff --git a/gdk/gdk.h b/gdk/gdk.h > --- a/gdk/gdk.h > +++ b/gdk/gdk.h > @@ -2334,6 +2334,8 @@ VALptr(const ValRecord *v) > */ > #define PARMASK (1<<7) > #define PARDEBUG if (GDKdebug & PARMASK) > +#define HEADLESSMASK (1<<8) > +#define HEADLESSDEBUG if ( GDKdebug & HEADLESSMASK) > /* TRGMASK not used anymore > #define TRGMASK (1<<8) > #define TRGDEBUG if (GDKdebug & TRGMASK) > diff --git a/gdk/gdk_bat.c b/gdk/gdk_bat.c > --- a/gdk/gdk_bat.c > +++ b/gdk/gdk_bat.c > @@ -89,6 +89,11 @@ BATcreatedesc(int ht, int tt, int heapna > > if (bs == NULL) > return NULL; > + HEADLESSDEBUG { > + if ( ht != TYPE_void && ht != TYPE_oid) > + fprintf(stderr, "#headless violation in BATcreatedesc %d\n", ht); > + > + } > /* > * assert needed in the kernel to get symbol eprintf resolved. > * Else modules using assert fail to load. > @@ -2799,7 +2804,7 @@ BATmode(BAT *b, int mode) > * is not actually used anywhere, but it is checked. */ > > #ifndef NDEBUG > -void > +static void > BATassertHeadProps(BAT *b) > { > BATiter bi = bat_iterator(b); > diff --git a/gdk/gdk_bat.h b/gdk/gdk_bat.h > --- a/gdk/gdk_bat.h > +++ b/gdk/gdk_bat.h > @@ -23,7 +23,6 @@ > gdk_export BUN void_replace_bat(BAT *b, BAT *u, bit force); > gdk_export int void_inplace(BAT *b, oid id, const void *val, bit > force); > gdk_export BAT *BATattach(int tt, const char *heapfile); > -gdk_export void BATassertHeadProps(BAT *b); > > extern int default_ident(char *s); > extern oid MAXoid(BAT *i); > diff --git a/monetdb5/mal/mal_dataflow.c > b/monetdb5/mal/mal_dataflow.c > --- a/monetdb5/mal/mal_dataflow.c > +++ b/monetdb5/mal/mal_dataflow.c > @@ -618,7 +618,7 @@ DFLOWstep(FlowTask *t, FlowStatus fs) > #if 0 /* when needed, enable */ > if (i < pci->retc && bid){ > BAT *b = BATdescriptor(bid); > - BATassertHeadProps(b); > + BATassertProps(b); > BBPunfix(b->batCacheid); > } > #endif > diff --git a/monetdb5/mal/mal_interpreter.c > b/monetdb5/mal/mal_interpreter.c > --- a/monetdb5/mal/mal_interpreter.c > +++ b/monetdb5/mal/mal_interpreter.c > @@ -860,7 +860,7 @@ str runMALsequence(Client cntxt, MalBlkP > #if 0 /* when needed, enable */ > if (i < pci->retc && bid){ > BAT *b = BATdescriptor(bid); > - BATassertHeadProps(b); > + BATassertProps(b); > BBPunfix(b->batCacheid); > } > #endif > _______________________________________________ > Checkin-list mailing list > Checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list >

1 0

Re: [Monetdb-developers] MonetDB: default - Debugging routine should be globally known
by Stefan Manegold 15 Jul '12

15 Jul '12

Shouldn't BATassertProps() (have) be(en) used instead of BATassertHeadProps()? The former is already globally known and calls the latter on both, head & tail of a BAT ... Stefan ----- Original Message ----- > Changeset: 6a5b3889c41e for MonetDB > URL: > http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=6a5b3889c41e > Modified Files: > gdk/gdk_bat.c > gdk/gdk_bat.h > Branch: default > Log Message: > > Debugging routine should be globally known > > > diffs (23 lines): > > diff --git a/gdk/gdk_bat.c b/gdk/gdk_bat.c > --- a/gdk/gdk_bat.c > +++ b/gdk/gdk_bat.c > @@ -2799,7 +2799,7 @@ BATmode(BAT *b, int mode) > * is not actually used anywhere, but it is checked. */ > > #ifndef NDEBUG > -static void > +void > BATassertHeadProps(BAT *b) > { > BATiter bi = bat_iterator(b); > diff --git a/gdk/gdk_bat.h b/gdk/gdk_bat.h > --- a/gdk/gdk_bat.h > +++ b/gdk/gdk_bat.h > @@ -23,6 +23,7 @@ > gdk_export BUN void_replace_bat(BAT *b, BAT *u, bit force); > gdk_export int void_inplace(BAT *b, oid id, const void *val, bit > force); > gdk_export BAT *BATattach(int tt, const char *heapfile); > +gdk_export void BATassertHeadProps(BAT *b); > > extern int default_ident(char *s); > extern oid MAXoid(BAT *i); > _______________________________________________ > Checkin-list mailing list > Checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list >

1 0

Re: [Monetdb-developers] MonetDB: default - Include debugging
by Stefan Manegold 15 Jul '12

15 Jul '12

In the light of :oid- or even dense-headed BATs (and eventually COLs), what is the reason to only check/assert head properties (trivial once dense), but not tail properties? Stefan ----- Original Message ----- > Changeset: f96a7db93e54 for MonetDB > URL: > http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=f96a7db93e54 > Modified Files: > monetdb5/mal/mal_dataflow.c > monetdb5/mal/mal_interpreter.c > Branch: default > Log Message: > > Include debugging > We have to trace for illegal property settings. It is an expensive > test, that may isolate a few deeply hidden errors. > > Moreover, initialize the cpu affinity > > > diffs (61 lines): > > diff --git a/monetdb5/mal/mal_dataflow.c > b/monetdb5/mal/mal_dataflow.c > --- a/monetdb5/mal/mal_dataflow.c > +++ b/monetdb5/mal/mal_dataflow.c > @@ -614,6 +614,16 @@ DFLOWstep(FlowTask *t, FlowStatus fs) > if (isaBatType(getArgType(mb, pci, i))) { > bat bid = stk->stk[a].val.bval; > > +#ifndef NDEBUG > +#if 0 /* when needed, enable */ > + if (i < pci->retc && bid){ > + BAT *b = BATdescriptor(bid); > + BATassertHeadProps(b); > + BBPunfix(b->batCacheid); > + } > +#endif > +#endif > + /* Check output properties */ > /* update the bigfoot information only if we need to gc */ > if (cntxt->flags & bigfootFlag) > updateBigFoot(cntxt, bid, TRUE); > @@ -811,8 +821,12 @@ runDFLOWworker(void *t) > Thread thr; > int i, local = 0, last = 0; > long usec=0; > + //int cpu; > > thr = THRnew(MT_getpid(), "DFLOWworker"); > + > + //cpu = MT_set_affinity(task->id); > + > GDKsetbuf(GDKmalloc(GDKMAXERRLEN)); /* where to leave errors */ > GDKerrbuf[0] = 0; > while (task) { > @@ -915,6 +929,7 @@ runDFLOWworker(void *t) > } > GDKfree(GDKerrbuf); > GDKsetbuf(0); > + //MT_unset_affinity(cpu); > THRdel(thr); > } > > diff --git a/monetdb5/mal/mal_interpreter.c > b/monetdb5/mal/mal_interpreter.c > --- a/monetdb5/mal/mal_interpreter.c > +++ b/monetdb5/mal/mal_interpreter.c > @@ -856,6 +856,16 @@ str runMALsequence(Client cntxt, MalBlkP > if (isaBatType(getArgType(mb, pci, i))) { > bat bid = stk->stk[a].val.bval; > > +#ifndef NDEBUG > +#if 0 /* when needed, enable */ > + if (i < pci->retc && bid){ > + BAT *b = BATdescriptor(bid); > + BATassertHeadProps(b); > + BBPunfix(b->batCacheid); > + } > +#endif > +#endif > + > /* update the bigfoot information only if we need to gc */ > if (cntxt->flags & bigfootFlag) > updateBigFoot(cntxt, bid, TRUE); > _______________________________________________ > Checkin-list mailing list > Checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list >

1 0

[Monetdb-developers] a problem
by wuxiaobing 09 Jul '12

09 Jul '12

hi I hava a problem with my MonetDB. I want to visit MonetDB from other machines, that the document told us to set mapi_open=yes,but I do not know how to set it on windows. thank you for answer me. 2012-07-06 wuxiaobing

2 1

Re: [Monetdb-developers] MonetDB: holindex - Change L1 cache size into the number of inte...
by Stefan Manegold 25 Jun '12

25 Jun '12

On Mon, Jun 25, 2012 at 02:53:54PM +0200, Eleni Petraki wrote: > Changeset: f52327015707 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=f52327015707 > Modified Files: > monetdb5/extras/crackers/crackers_selecthol_ops.mx > Branch: holindex > Log Message: > > Change L1 cache size into the number of integers that fit into L1. > > > diffs (12 lines): > > diff --git a/monetdb5/extras/crackers/crackers_selecthol_ops.mx b/monetdb5/extras/crackers/crackers_selecthol_ops.mx > --- a/monetdb5/extras/crackers/crackers_selecthol_ops.mx > +++ b/monetdb5/extras/crackers/crackers_selecthol_ops.mx > @@ -306,7 +306,7 @@ createView: > bit copy=TRUE; > > int countBatElements; > - int L1=8192; /*KiloBytes*/ > + int L1=2048000; /*Number of integers that can fit into L1 cache (size: 8192KB)*/ Wow --- which CPU has 8 MB L1(!) cache? > /*k and randomoid are used for DD1R*/ > @1 k,temp_h; > _______________________________________________ > Checkin-list mailing list > Checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list > > -- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

1 0

[Monetdb-developers] ODBC driver
by Max Kad 25 Jun '12

25 Jun '12

Hi Guys, I've installed MonetDB yesterday on Ubuntu 11.10 and it seems working fine. I've 2 questions though: 1) I'm trying to install MonetDB ODBC driver for UnixODBC following the instructions at (http://www.monetdb.org/Documentation/Manuals/SQLreference/Programming/ODBC ) but for some reason I can't find the Monet ODBC libMonetODBC.so or libMonetODBCs.so driver. ( I found the following files: libmonetdb5.so.11, libmonetdb5.so.11.0.2 but I'm not sure what they are for. ) 2) Are there similar Date functions available on MonetDB as the following MySQL functions: UNIX_TIMESTAMP(), DATE() ) or an epoch function. I couldn't find it on the following link. ( http://www.monetdb.org/Documentation/SQLreference/Temporal ) Thanks in advance, Max

2 1

[Monetdb-developers] ODBC driver
by Max Kad 23 Jun '12

23 Jun '12

Hi Guys, I've installed MonetDB yesterday on Ubuntu 11.10 and it seems working fine. I've 2 questions though: 1) I'm trying to install MonetDB ODBC driver for UnixODBC following the instructions at ( http://www.monetdb.org/Documentation/Manuals/SQLreference/Programming/ODBC ) but for some reason I can't find the Monet ODBC libMonetODBC.so or libMonetODBCs.so driver. ( I found the following files: libmonetdb5.so.11, libmonetdb5.so.11.0.2 but I'm not sure what they are for. ) 2) Are there similar Date functions available on MonetDB as the following MySQL functions: UNIX_TIMESTAMP(), DATE() ) or an epoch function. I couldn't find it on the following link. ( http://www.monetdb.org/Documentation/SQLreference/Temporal ) Thanks in advance, Max

1 0

[Monetdb-developers] Announcement: New Apr2012-SP2 Bugfix release of MonetDB suite
by Sjoerd Mullender 19 Jun '12

19 Jun '12

The MonetDB team at CWI/MonetDB BV is pleased to announce the Apr2012-SP2 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Apr 2012-SP2 bugfix release Client Package * Resolved a cosmetical error where tab-characters would cause misalignments in tabular result views. For the time being, tabs are now represented as a single space in tabular view. MonetDB Common * Limit number of detected CPU cores to 16 on 32-bits systems to avoid running quickly out of addressable resources followed by a kill from the OS. Bug Fixes * 2594: NULL cannot automatically be casted to every other type * 3085: assertion fails upon execution of a valid SQL query * 3086: Modulo function does not work in select from table * 3087: query causes "Not yet implemented" message * 3089: mserver5 crashed if join condition has two column and incorrect order * 3090: crashed if using single identifier for where condition * 3096: Type of median error

1 0

Re: [Monetdb-developers] MonetDB: default - attempt to more thoroughly remove opt_accessmode
by Sjoerd Mullender 14 Jun '12

14 Jun '12

On 2012-06-14 10:16, Fabian Groffen wrote: > Changeset: af264c7d6966 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=af264c7d6966 > Modified Files: > NT/installer32/MonetDB5-SQL-Installer.vdproj > NT/installer64/MonetDB5-SQL-Installer.vdproj > clients/Tests/exports.stable.out > monetdb5/modules/mal/mal_init.mal > monetdb5/optimizer/opt_support.c > sql/backends/monet5/Tests/optimizers.sql > sql/backends/monet5/Tests/optimizers.stable.err > Branch: default > Log Message: > > attempt to more thoroughly remove opt_accessmode > > > diffs (163 lines): > > diff --git a/NT/installer32/MonetDB5-SQL-Installer.vdproj b/NT/installer32/MonetDB5-SQL-Installer.vdproj > --- a/NT/installer32/MonetDB5-SQL-Installer.vdproj > +++ b/NT/installer32/MonetDB5-SQL-Installer.vdproj > @@ -2477,26 +2477,6 @@ > "IsDependency" = "11:FALSE" > "IsolateTo" = "8:" > } > - "{1FB2D0AE-D3B9-43D4-B9DD-F88EC61E35DE}:_4704D4539B804719AEB979F67EE20CDE" > - { > - "SourcePath" = "8:lib\\monetdb5\\opt_accessmode.mal" > - "TargetName" = "8:opt_accessmode.mal" > - "Tag" = "8:" > - "Folder" = "8:_B593DAA0787744D6A44D17884E0C3951" > - "Condition" = "8:" > - "Transitive" = "11:FALSE" > - "Vital" = "11:TRUE" > - "ReadOnly" = "11:FALSE" > - "Hidden" = "11:FALSE" > - "System" = "11:FALSE" > - "Permanent" = "11:FALSE" > - "SharedLegacy" = "11:FALSE" > - "PackageAs" = "3:1" > - "Register" = "3:1" > - "Exclude" = "11:FALSE" > - "IsDependency" = "11:FALSE" > - "IsolateTo" = "8:" > - } > "{1FB2D0AE-D3B9-43D4-B9DD-F88EC61E35DE}:_47A76DE07EE648EF9F19C2D1AC42B9EE" > { > "SourcePath" = "8:lib\\monetdb5\\autoload\\80_udf.mal" > diff --git a/NT/installer64/MonetDB5-SQL-Installer.vdproj b/NT/installer64/MonetDB5-SQL-Installer.vdproj > --- a/NT/installer64/MonetDB5-SQL-Installer.vdproj > +++ b/NT/installer64/MonetDB5-SQL-Installer.vdproj > @@ -2937,26 +2937,6 @@ > "IsDependency" = "11:FALSE" > "IsolateTo" = "8:" > } > - "{1FB2D0AE-D3B9-43D4-B9DD-F88EC61E35DE}:_7209273FAD0B4F4ABFF16B6C23681DA5" > - { > - "SourcePath" = "8:lib\\monetdb5\\opt_accessmode.mal" > - "TargetName" = "8:opt_accessmode.mal" > - "Tag" = "8:" > - "Folder" = "8:_B593DAA0787744D6A44D17884E0C3951" > - "Condition" = "8:" > - "Transitive" = "11:FALSE" > - "Vital" = "11:TRUE" > - "ReadOnly" = "11:FALSE" > - "Hidden" = "11:FALSE" > - "System" = "11:FALSE" > - "Permanent" = "11:FALSE" > - "SharedLegacy" = "11:FALSE" > - "PackageAs" = "3:1" > - "Register" = "3:1" > - "Exclude" = "11:FALSE" > - "IsDependency" = "11:FALSE" > - "IsolateTo" = "8:" > - } > "{1FB2D0AE-D3B9-43D4-B9DD-F88EC61E35DE}:_727ED1BD7FF74A91A491B34CC26E6848" > { > "SourcePath" = "8:lib\\monetdb5\\udf.mal" If you do this, also remove the "Entry" with MsmKey equal to the value behind the UUID (so 4704D4539B804719AEB979F67EE20CDE and 7209273FAD0B4F4ABFF16B6C23681DA5 in this case respectively). -- Sjoerd Mullender

1 0

[Monetdb-developers] Announcement: New Apr2012-SP1 Bugfix release of MonetDB suite
by Fabian Groffen 25 May '12

25 May '12

The MonetDB team at CWI/MonetDB BV is pleased to announce the Apr2012-SP1 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at http://www.monetdb.org/. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Apr 2012-SP1 bugfix release Build Environment * Windows: we now use OpenSSL 1.0.1b. SQL * Databases that were upgraded from the Aug2011 release have an error in the catalog for SQL procedures. This is now fixed. Merovingian * Fixed a bug where connecting to a stopped multiplex-funnel would result in a 'there are no available connections' error. MonetDB Common * Implemented MT_getrss for Mac OS X systems, this allows the server to know about how much memory is currently in use. Bug Fixes * 2454: SQL: add various statistical functions * 2916: non admin user cannot create temporary tables * 2949: SQL exception during execution of a correct user defined function that just returns a relation table constructed by a simple SQL select query * 2958: Grant does't work with schema syntax * 2960: mclient terminates connection during insertion of a large number of records from a file * 2972: SQL URL functionality contains errors * 2987: Broken type inference when using sql round * 2992: SQL module truncates DECIMALS when passing integers to MAL module * 3000: Inconsistency between read-only and read-write modes after dropping a schema * 3028: Segmentation fault in seqscan_eq_bte_bte_tloc_void_void * 3046: mserver5 terminates with segmentation fault * 3063: datacell functions no longer work after restart of database * 3072: Database upgrade from Dec2011 to Apr2012 broken for storage() * 3073: VERY slow foreign key check (due to missing batcalc.isnil() ?) * 3074: Name resolution in procedures * 3077: No errors on UDF returning table with too many columns * 3079: Converting an Oracle schema DDL for MonetDB fails to create a column named "no".

1 0