- developers-list - monetdb.org

Announcement: New Feb2013-SP6 Bugfix release of MonetDB suite
by Sjoerd Mullender 03 Dec '13

03 Dec '13

The MonetDB team at CWI/MonetDB BV is pleased to announce the Feb2013-SP6 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Feb 2013-SP6 bugfix release MonetDB5 Server * Fixed a possible buffer overflow in the COPY INTO code. * Fixed a problem that when the server is using all available threads for a query, it was not possible to attach another client and have it execute even the smallest query. This is fixed by creating extra threads for each client entering the fray at the cost of having more threads that execute queries. But at least there is guaranteed progress for all clients (modulo the operating system scheduler). See bug #3258. Merovingian * monetdbd(1) now refuses to startup if it cannot read the properties from the dbfarm, bug #3398 Client Package * mclient: Fixed a bug where the -H option only worked if the readline history file already existed. Now we properly create and use the history file. * ODBC: Fixed interpretation SQL_C_SLONG/SQL_C_ULONG/SQL_C_LONG to refer to a 32 bit integer always (i.e. "int" on 64 bit architectures despite the name and the Microsoft documentation). This seems to be the consensus. * ODBC: Fixed transaction level: MonetDB only supports the highest level (SQL_TXN_SERIALIZABLE), so setting the transaction level can be accepted and ignored. MonetDB Common * Stopped using the deprecated sbrk() system call. * Fixed a problem when reverse sorting a sorted column. * Fixed bugs that deal with problems that could possibly occur when transactions are aborted and the server is restarted. See bug #3243. * A bug was fixed in the handling of grouped aggregates when all values in a group are null. See bug #3388. SQL * Fixed a bug where the server at some point stopped saving compiled queries in the SQL query cache. Bug Fixes * 3243: Segmentation fault (possible data corruption) after clean shutdown * 3258: Scheduling issues * 3368: BAT sortedness info ignored on ORDER BY and TOPN * 3374: UNIQUE constraint does not set tkey property on the corresponding BAT * 3382: Response to PREPARE emtpy if query contains a LIMIT * 3385: Simple query fails with 'identifier not found' * 3387: mclient does not properly double quote schema names when using autofill tab * 3388: case statement in "order by" clause doesn't work when used together with "group by" * 3389: median function with "group by" - SIGSEGV * 3392: ODBC datatype conversion for INTEGER not working properly * 3394: "Cannot find column type" error in temporary tables in functions * 3395: error occurred during a query: "'CASE WHEN" sentence * 3396: Improper UDF expansion * 3397: Error in ODBC-Driver when using Prepared Statements * 3398: Cannot stop monetdbd after erroneously starting an uninitialized dbfarm

1 0

New Jan2014 stable branch created
by Sjoerd Mullender 27 Nov '13

27 Nov '13

I have created a new stable branch for the next feature release. This branch was created in order to stabilize the code before the feature release. From now on *only* bug fixes may go to this new stable branch. I reserve the right to undo any changes that do not comply with this rule. I also reserve the right to admit changes that are not strictly bug fixes. The name for the branch is Jan2014. So in each of your stable checkout directories you can do hg pull hg update -rJan2014 to update to this new branch. -- Sjoerd Mullender

1 0

MonetDB with OpenCL extension (Ocelot) query fails trying to cache empty BAT
by Edward Ching 25 Nov '13

25 Nov '13

I'm running into a problme with Ocelot, the MonetDB with OpenCL extension.Not sure if this should go to the developers' or users' list. I apologize if this is not the right list to post to. I'm seeing a query failure which was caused by MoneDB-OpenCL trying to cache an empty BAT and ended up calling clCreateBuffer with a 0 size buffer and failed. Any select with a where clause would trigger it. Has anyone seen this too? It fails whether I use 32 bit or 64 bit oid, Nvidia or AMD. I'm trying to figure if it's a real issue or if I'm missing anything. Any input greatly appreciated. The database was generated by TPC-H dbgen (details below). The query I used was "select c_custkey, c_name from customer where c_custkey < 2", and here's a trace of the sequence of calls leading to the failure starting from the MAL statement: 1) X_52 := ocelot.thetasubselect(r1_10,A0,"<",0);(see log below) 2) ocl_select.c::ocl_subselect() line 142: ocl_cacheBAT 3) ocl_memmanager.c::ocl_cacheBAT() line 771: allocateBuffer 4) ocl_memmanager.c::allocateBuffer() line 432: clCreateBuffer ===== Source version and environment ===== 1) Ocelot src installed from zip downloaded from monetdb-opencl: msaecker-monetdb-opencl-b513b35eb84a.zip 2) Ocelot configure options: ./configure --prefix=/usr/local --enable-oid32 --enable-optimize --disable-test ing --disable-developer --disable-debug --disable-assert --enable-sql --enable-m onetdb5 --with-opencl=/usr 3) Operating System: Fedora 17 kernel 3.9.10-100 4) Hardware: NVIDIA GTX570 on Intel i7-3820 w/ 16GB mem 5) OpenCL: Nvidia OpenCL that came with CUDA 5.5 SDK 6) Database: generated w/ TPC-H dbgen using size factor s=0.01 ===== operation log follows ===== [root@gen3-2 ocelot]# mclient -ddb001 -lmal mal>ocelot.init(); mal>ocelot.listDevices(); # Device 0: NVIDIA Corporation - GeForce GTX 570 (default device) mal>\q [root@gen3-2 ocelot]# mclient -ddb001 -lsql sql>\d TABLE sys.customer TABLE sys.lineitem TABLE sys.nation TABLE sys.orders TABLE sys.part TABLE sys.partsupp TABLE sys.region TABLE sys.supplier sql>\d customer CREATE TABLE "sys"."customer" ( "c_custkey" INTEGER NOT NULL, "c_name" VARCHAR(25) NOT NULL, "c_address" VARCHAR(40) NOT NULL, "c_nationkey" INTEGER NOT NULL, "c_phone" VARCHAR(15) NOT NULL, "c_acctbal" DECIMAL(15,2) NOT NULL, "c_mktsegment" VARCHAR(10) NOT NULL, "c_comment" VARCHAR(117) NOT NULL, CONSTRAINT "customer_c_custkey_pkey" PRIMARY KEY ("c_custkey"), CONSTRAINT "customer_c_nationkey_fkey" FOREIGN KEY ("c_nationkey") REFERENCES "sys"."nation" ("n_nationkey") ); sql>select count(*) from customer; +------+ | L1 | +======+ | 1500 | +------+ 1 tuple (1.311ms) sql>select c_custkey, c_name from customer where c_custkey < 2; +-----------+--------------------+ | c_custkey | c_name | +===========+====================+ | 1 | Customer#000000001 | +-----------+--------------------+ 1 tuple (1.776ms) sql>set optimizer='cl_pipe'; operation successful (0.981ms) sql>select c_custkey, c_name from customer where c_custkey < 2; invalid/unknown response from server, ignoring output ? #Could not allocate OpenCL buffer of size: 0. Error caching input BAT. sql> sql>explain select c_custkey, c_name from customer where c_custkey < 2; +------------------------------------------------------------------------------+ | mal +==============================================================================+ | function user.s9_1{autoCommit=true}(A0:int):void; | | ocelot.beginQuery(); | | X_3 := sql.mvc(); | | X_7 := sql.bind(X_3,"sys","customer","c_custkey",0); | | X_4:bat[:oid,:oid] := sql.tid(X_3,"sys","customer"); | | X_51 := ocelot.thetasubselect(X_7,X_4,A0,"<",0); | | (X_10,r1_10) := sql.bind(X_3,"sys","customer","c_custkey",2); | | X_52 := ocelot.thetasubselect(r1_10,A0,"<",0); | | X_13 := sql.bind(X_3,"sys","customer","c_custkey",1); | | X_53 := ocelot.thetasubselect(X_13,X_4,A0,"<",0); | | ocelot.sync(X_51); | | ocelot.sync(X_52); | | ocelot.sync(X_53); | | X_15 := sql.subdelta(X_51,X_4,X_10,X_52,X_53); | | X_17 := sql.projectdelta(X_15,X_7,X_10,r1_10,X_13); | | X_18 := sql.bind(X_3,"sys","customer","c_name",0); | | (X_20,r1_23) := sql.bind(X_3,"sys","customer","c_name",2); | | X_22 := sql.bind(X_3,"sys","customer","c_name",1); | | X_23 := sql.projectdelta(X_15,X_18,X_20,r1_23,X_22); | | X_24 := sql.resultSet(2,1,X_17); | | sql.rsColumn(X_24,"sys.customer","c_custkey","int",32,0,X_17); | | sql.rsColumn(X_24,"sys.customer","c_name","varchar",25,0,X_23); | | X_32 := io.stdout(); | | sql.exportResult(X_32,X_24); | | ocelot.endQuery(); | | end s9_1; | | # querylog.define("explain select c_custkey, c_name from customer where c_cu | : stkey < 2;","cl_pipe") : +------------------------------------------------------------------------------+ 27 tuples (1.408ms) sql> =======================================

1 0

Re: MonetDB: default - Get rid of Mx.
by Fabian Groffen 21 Nov '13

21 Nov '13

On 21-11-2013 12:54:34 +0100, Sjoerd Mullender wrote: > Changeset: f6606676fe5e for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=f6606676fe5e > Branch: default > Log Message: > > Get rid of Mx. Hooray! Congratulations :) Fabian

1 0

Re: MonetDB: default - Prepare split of sql.mx
by Stefan Manegold 20 Nov '13

20 Nov '13

Martin, what's the (intended) difference between the newly added command mmath.rand{unsafe} (v:int) :int (see below) and the existing function mmath.rand{inline}( v:int ) :int; (see sql/backends/monet5/sql.mx line 1123) ? In particular, which of the two seemingly identical signatures will the MAL interpreter choose / use to evaluate, say, a:int:=mmath.rand(0:int); ? If they are identical / indistinguishable, one should be removed (again). Thanks, Stefan ps: Found by test clients/Tests/MAL-signatures ;-) ----- Original Message ----- > Changeset: 026d2c8bc8ee for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=026d2c8bc8ee > Added Files: > sql/backends/monet5/sql.mal > sql/backends/monet5/sql_aggr_bte.mal > sql/backends/monet5/sql_aggr_flt.mal > sql/backends/monet5/sql_aggr_int.mal > sql/backends/monet5/sql_aggr_lng.mal > sql/backends/monet5/sql_aggr_sht.mal > sql/backends/monet5/sql_aggr_wrd.mal > sql/backends/monet5/sql_cast.mal > sql/backends/monet5/sql_inspect.mal > sql/backends/monet5/sql_octopus.mal > sql/backends/monet5/sql_rank.mal > sql/backends/monet5/sql_rdf.mal > sql/backends/monet5/sql_sort.mal > Modified Files: > monetdb5/modules/kernel/mmath.mal > sql/backends/monet5/Makefile.ag > Branch: default > Log Message: > > Prepare split of sql.mx > The first step in a dissection of the monster. > Splitting sql.mx into *mal and the rest > > times() has been removed. Also script 11_times > should be removed. > > sql_cast.mal calls for a shell script > whereafter we can finish the first step in > the dissection. > > > diffs (truncated from 1794 to 300 lines): > > diff --git a/monetdb5/modules/kernel/mmath.mal > b/monetdb5/modules/kernel/mmath.mal > --- a/monetdb5/modules/kernel/mmath.mal > +++ b/monetdb5/modules/kernel/mmath.mal > @@ -182,6 +182,10 @@ command rand{unsafe} () :int > address MATHrandint > comment "return a random number"; > > +command rand{unsafe} (v:int) :int > +address MATHrandint > +comment "return a random number"; > + > command srand(seed:int) :void > address MATHsrandint > comment "initialize the rand() function with a seed"; > diff --git a/sql/backends/monet5/Makefile.ag > b/sql/backends/monet5/Makefile.ag > --- a/sql/backends/monet5/Makefile.ag > +++ b/sql/backends/monet5/Makefile.ag > @@ -96,7 +96,7 @@ lib__sql = { > headers_mal = { > HEADERS = mal > DIR = libdir/monetdb5 > - SOURCES = sql.mx > + SOURCES = sql.mx sql_aggr_bte.mal sql_aggr_flt.mal sql_aggr_int.mal > sql_aggr_lng.mal sql_aggr_sht.mal sql_aggr_wrd.mal sql_cast.mal > sql_inspect.mal sql.mal sql_octopus.mal sql_rank.mal sql_rdf.mal > sql_sort.mal > } > > headers_autoload = { > diff --git a/sql/backends/monet5/sql.mal b/sql/backends/monet5/sql.mal > new file mode 100644 > --- /dev/null > +++ b/sql/backends/monet5/sql.mal > @@ -0,0 +1,1055 @@ > +# The contents of this file are subject to the MonetDB Public License > +# Version 1.1 (the "License"); you may not use this file except in > +# compliance with the License. You may obtain a copy of the License at > +# http://www.monetdb.org/Legal/MonetDBLicense > +# > +# Software distributed under the License is distributed on an "AS IS" > +# basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the > +# License for the specific language governing rights and limitations > +# under the License. > +# > +# The Original Code is the MonetDB Database System. > +# > +# The Initial Developer of the Original Code is CWI. > +# Portions created by CWI are Copyright (C) 1997-July 2008 CWI. > +# Copyright August 2008-2013 MonetDB B.V. > +# All Rights Reserved. > + > + > +module batsql; > +module sql; > + > +pattern start():void > +address SQLsession > +comment "Switch to processing SQL statements"; > + > +pattern start2():void > +address SQLsession2 > +comment "Switch to processing precompiled sql statements"; > + > +pattern init():void > +address SQLinitEnvironment > +comment "Initialize the environment for MAL"; > + > +pattern shutdown(delay:bte, force:bit):str > +address SQLshutdown_wrap; > +pattern shutdown(delay:sht, force:bit):str > +address SQLshutdown_wrap; > +pattern shutdown(delay:int, force:bit):str > +address SQLshutdown_wrap; > + > +pattern shutdown(delay:bte):str > +address SQLshutdown_wrap; > +pattern shutdown(delay:sht):str > +address SQLshutdown_wrap; > +pattern shutdown(delay:int):str > +address SQLshutdown_wrap; > + > +pattern mvc():int > +address SQLmvc > +comment "Get the multiversion catalog context. > +Needed for correct statement dependencies > +(ie sql.update, should be after sql.bind in concurrent execution)"; > + > +pattern trans(type:int,chain:int,name:str):void > +address SQLtransaction > +comment "A transaction statement (type can be commit,release,rollback or > start)"; > + > +pattern transaction{unsafe}() > +address SQLtransaction2 > +comment "Start an autocommit transaction"; > + > +pattern commit() > +address SQLcommit > +comment "Trigger the commit operation for a MAL block"; > + > +pattern abort() > +address SQLabort > +comment "Trigger the abort operation for a MAL block"; > + > +pattern catalog(type:int,sname:str,name:str,action:int):void > +address SQLcatalog; > +pattern > catalog(type:int,sname:str,name:str,funcid:int,ft:int,action:int):void > +address SQLcatalog; > +pattern > catalog(type:int,sname:str,name:str,tname:str,time:int,o:int,event:int,oname:str,nname:str,condition:str,query:str):void > +address SQLcatalog; > +pattern catalog(type:int,sname:str,t:ptr):void > +address SQLcatalog; > +pattern catalog(type:int,sname:str,t:ptr,temp:int):void > +address SQLcatalog; > +pattern catalog(type:int,sname:str,t:ptr,restart:lng):void > +address SQLcatalog > +comment "a catalog statement"; > + > +pattern catalog(type:int,grantee:str,role:str):void > +address SQLcatalog > +comment "a grant/revoke role statement"; > + > +pattern > catalog(type:int,user:str,passwd:str,enc:int,schema:str,fullname:str):void > +address SQLcatalog > +comment "a user catalog statement"; > + > +pattern > catalog(type:int,sname:str,tname:str,grantee:str,privs:int,cname:str,grant:int,grantor:int):void > +address SQLcatalog > +comment "a grant/revoke privileges statement"; > + > +pattern catalog(type:int,iname:str,itype:int,sname:str,tname:str...):void > +address SQLcatalog > +comment "a create index catalog statement"; > + > +pattern eval(cmd:str):void > +address SQLstatement; > +pattern eval(cmd:str, output:bit):void > +address SQLstatement > +comment "Compile and execute a single sql statement (and optionaly send > output on the output stream)"; > + > +pattern include(fname:str):void > +address SQLinclude > +comment "Compile and execute a sql statements on the file"; > + > +pattern evalAlgebra(cmd:str, optimize:bit):void > +address RAstatement > +comment "Compile and execute a single 'relational algebra' statement"; > + > +pattern assert(b:bit,msg:str):void > +address SQLassert; > +pattern assert(b:int,msg:str):void > +address SQLassertInt; > +pattern assert(b:wrd,msg:str):void > +address SQLassertWrd; > +pattern assert(b:lng,msg:str):void > +address SQLassertLng > +comment "Generate an exception when b!=0"; > + > +pattern setVariable(mvc:int, varname:str, value:any_1 ):int > +address setVariable > +comment "Set the value of a session variable"; > + > +pattern getVariable(mvc:int, varname:str ):any_1 > +address getVariable > +comment "Get the value of a session variable"; > + > +pattern logfile{unsafe}(filename:str):void > +address mvc_logfile > +comment "Enable/disable saving the sql statement traces"; > + > +pattern next_value( sname:str, sequence:str ):lng > +address mvc_next_value > +comment "return the next value of the sequence"; > + > +pattern batsql.next_value( sname:bat[:oid,:str], sequence:str ) > :bat[:oid,:lng] > +address mvc_bat_next_value > +comment "return the next value of the sequence"; > + > +pattern get_value( sname:str, sequence:str ):lng > +address mvc_get_value > +comment "return the current value of the sequence"; > + > +pattern restart{unsafe}( sname:str, sequence:str, start:lng ):lng > +address mvc_restart_seq > +comment "restart the sequence with value start"; > + > +pattern bind_idxbat(mvc:int, schema:str, table:str, index:str, > access:int):bat[:oid,:any_1] > +address mvc_bind_idxbat_wrap > +comment "Bind the 'schema.table.index' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind_idxbat(mvc:int, schema:str, table:str, index:str, > access:int)(uid:bat[:oid,:oid],uval:bat[:oid,:any_1]) > +address mvc_bind_idxbat_wrap > +comment "Bind the 'schema.table.index' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind_idxbat(mvc:int, schema:str, table:str, index:str, access:int, > part_nr:int, nr_parts:int):bat[:oid,:any_1] > +address mvc_bind_idxbat_wrap > +comment "Bind the 'schema.table.index' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind_idxbat(mvc:int, schema:str, table:str, index:str, access:int, > part_nr:int, nr_parts:int)(uid:bat[:oid,:oid],uval:bat[:oid,:any_1]) > +address mvc_bind_idxbat_wrap > +comment "Bind the 'schema.table.index' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind(mvc:int, schema:str, table:str, column:str, access:int > ):bat[:oid,:any_1] > +address mvc_bind_wrap > +comment "Bind the 'schema.table.column' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind(mvc:int, schema:str, table:str, column:str, access:int > )(uid:bat[:oid,:oid],uval:bat[:oid,:any_1]) > +address mvc_bind_wrap > +comment "Bind the 'schema.table.column' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind(mvc:int, schema:str, table:str, column:str, access:int, > part_nr:int, nr_parts:int ):bat[:oid,:any_1] > +address mvc_bind_wrap > +comment "Bind the 'schema.table.column' BAT partition with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +pattern bind(mvc:int, schema:str, table:str, column:str, access:int, > part_nr:int, nr_parts:int )(uid:bat[:oid,:oid],uval:bat[:oid,:any_1]) > +address mvc_bind_wrap > +comment "Bind the 'schema.table.column' BAT with access kind: > + 0 - base table > + 1 - inserts > + 2 - updates"; > + > +command delta ( col:bat[:oid,:any_3], uid:bat[:oid,:oid], > uval:bat[:oid,:any_3], ins:bat[:oid,:any_3] ) > + :bat[:oid,:any_3] > +address DELTAbat > +comment "Return column bat with delta's applied."; > + > +command projectdelta( subselect:bat[:oid,:oid], col:bat[:oid,:any_3], > uid:bat[:oid,:oid], uval:bat[:oid,:any_3], ins:bat[:oid,:any_3] ) > :bat[:oid,:any_3] > +address DELTAproject > +comment "Return column bat with delta's applied."; > + > +command subdelta ( col:bat[:oid,:oid], cand:bat[:oid,:oid], > uid:bat[:oid,:oid], uval:bat[:oid,:oid], ins:bat[:oid,:oid] ) > :bat[:oid,:oid] > +address DELTAsub > +comment "Return a single bat of subselected delta."; > + > +command delta ( col:bat[:oid,:any_3], uid:bat[:oid,:oid], > uval:bat[:oid,:any_3]) :bat[:oid,:any_3] > +address DELTAbat2 > +comment "Return column bat with delta's applied."; > + > +command projectdelta( subselect:bat[:oid,:oid], col:bat[:oid,:any_3], > uid:bat[:oid,:oid], uval:bat[:oid,:any_3]) :bat[:oid,:any_3] > +address DELTAproject2 > +comment "Return column bat with delta's applied."; > + > +command subdelta ( col:bat[:oid,:oid], cand:bat[:oid,:oid], > uid:bat[:oid,:oid], uval:bat[:oid,:oid]) :bat[:oid,:oid] > +address DELTAsub2 > +comment "Return a single bat of subselected delta."; > + > +command getVersion(clientid:int):lng > +address mvc_getVersion > +comment "Return the database version identifier for a client"; > + > +pattern append(mvc:int, sname:str, tname:str, cname:str, ins:any):int > +address mvc_append_wrap > +comment "Append b to the column tname.cname (possibly optimized to replace > the insert bat of tname.cname (returns sequence number for order > dependence)"; > + > +pattern update(mvc:int, sname:str, tname:str, cname:str, rids:any, > upd:any):int > +address mvc_update_wrap > +comment "Update the values of the column tname.cname"; > + > +pattern clear_table{unsafe}(sname:str, tname:str) :wrd > +address mvc_clear_table_wrap > +comment "Clear table"; > + > +pattern tid( mvc:int, sname:str, tname:str):bat[:oid,:any_3] > +address SQLtid; > +pattern tid( mvc:int, sname:str, tname:str, part_nr:int, nr_parts:int > ):bat[:oid,:any_3] > +address SQLtid > +comment "Return the tables tid column."; > + > +pattern delete{unsafe}(mvc:int, sname:str, tname:str, b:any):int > +address mvc_delete_wrap > +comment "delete from table"; > + > +pattern resultSet{unsafe}( nr_cols:int, sep:str, rsep:str, ssep:str, ns:str, > order:any_1 ) :int > +address mvc_result_file_wrap; > +pattern resultSet{unsafe}( nr_cols:int, sep:str, rsep:str, ssep:str, ns:str, > order:bat[:oid,:any_1] ) :int > +address mvc_result_file_wrap; > +pattern resultSet{unsafe}( nr_cols:int, qtype:int, order:any_1 ) :int > +address mvc_result_row_wrap; > +pattern resultSet{unsafe}( nr_cols:int, qtype:int, order:bat[:oid,:any_1] ) > :int > +address mvc_result_table_wrap; > +pattern rsColumn{unsafe}(rs:int, tname:str, name:str, typename:str, > digits:int, scale:int, val:any_1 ) :void > +address mvc_result_value_wrap > +comment "Add the value to the row query result"; > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/checkin-list > -- | Stefan.Manegold(a)CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

1 0

Default branch does not compile for builds with --enable_oid32
by Max Heimel 17 Nov '13

17 Nov '13

Hi, I stumbled upon a build error in the latest source from the default branch when I configure with --enable_oid32. The fix is a missing curly brace in the HASHputall macro at gdk/gdk_search.h:110.

2 1

Re: MonetDB: holindex - Comment lines that use papi in order to meas...
by Stefan Manegold 13 Nov '13

13 Nov '13

Eleni, this calls for a proper configure check and conditionals to reduce/eliminate (extra) code maintenance overhead ;-) Feel free to ask in case you need more detailed pointers ... Stefan ----- Original Message ----- > Changeset: da0067120542 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=da0067120542 > Modified Files: > monetdb5/extras/crackers/crackers_selectholpl_ops.mx > Branch: holindex > Log Message: > > Comment lines that use papi in order to measure hardware events. > > > diffs (59 lines): > > diff --git a/monetdb5/extras/crackers/crackers_selectholpl_ops.mx > b/monetdb5/extras/crackers/crackers_selectholpl_ops.mx > --- a/monetdb5/extras/crackers/crackers_selectholpl_ops.mx > +++ b/monetdb5/extras/crackers/crackers_selectholpl_ops.mx > @@ -77,6 +77,7 @@ crackers_export str CRKrandomholpl_@1(in > */ > #include "monetdb_config.h" > #include "crackers.h" > +//#include <papi.h> > > /* Local support functions and macros */ > @:TypeSwitch(crackOperations)@ > @@ -384,7 +385,7 @@ CRKrandomholpl_@1(int *bid, bit *inclusi > FN->c = FN->c + incr_pieces; > if(FN->weight > 0) > FN->weight = changeWeight(FN,countBatElements,L1); > - fprintf(ofp,"Idle_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Low= \t %d \t Thread_id= > \t" SZFMT "\n",FN->bid,FN->c,wt,ct,(int)*low,MT_getpid()); > + fprintf(ofp,"Idle_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT > "\n",FN->bid,FN->c,wt,ct,MT_getpid()); > fclose(ofp); > MT_lock_unset(&frequencylock, "getFrequencyStruct"); > > @@ -1371,6 +1372,12 @@ CRKRangeLeftNilTree_@1(int *vid, int *bi > FrequencyNode *FrequencyStructA = getFrequencyStruct('A'); > FILE *ofp; > char *outputFilename1; > + //long long counters[2]; > + //int PAPI_events[] = { > + // PAPI_L2_DCA, > + // PAPI_L2_DCM}; > + > + //PAPI_start_counters(PAPI_events, 2); > > gettimeofday(&tv0,0); > > @@ -1444,8 +1451,10 @@ CRKRangeLeftNilTree_@1(int *vid, int *bi > FN->c = FN->c + incr_pieces; > FN->weight = changeWeight(FN,countBatElements,L1); > gettimeofday(&tv1,0); ct+=dt(tv0,tv1); tv0=tv1; > - fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Hgh= \t %d \t Thread_id= > \t" SZFMT "\n",FN->bid,FN->c,wt,ct,(int)*hgh,MT_getpid()); > -+ fclose(ofp); > + //PAPI_read_counters(counters, 2); > + //fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT "\t > L2_DCA= \t %lld \t L2_DCM \t > %lld\n",FN->bid,FN->c,wt,ct,MT_getpid(),counters[0],counters[1]); > + fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT > "\n",FN->bid,FN->c,wt,ct,MT_getpid()); > + fclose(ofp); > MT_lock_unset(&frequencylock, "getFrequencyStruct"); > > BBPincref(b->batCacheid,TRUE); > @@ -1552,8 +1561,10 @@ CRKRangeLeftNilTree_@1(int *vid, int *bi > if(FN->weight > 0) > FN->weight = changeWeight(FN,countBatElements,L1); > gettimeofday(&tv1,0); ct+=dt(tv0,tv1); tv0=tv1; > - fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Hgh= \t %d \t Thread_id= > \t" SZFMT "\n",FN->bid,FN->c,wt,ct,(int)*hgh,MT_getpid()); > -+ fclose(ofp); > + //PAPI_read_counters(counters, 2); > + //fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT "\t > L2_DCA \t %lld \t L2_DCM= \t %lld > \n",FN->bid,FN->c,wt,ct,MT_getpid(),counters[0],counters[1]); > + fprintf(ofp,"User_Query \t 0 \t Bat_id= \t %d \t Pieces= \t %d \t > Wait_time\t %9.6lf \t Selection_time\t %9.6lf \t Thread_id= \t" SZFMT > "\n",FN->bid,FN->c,wt,ct,MT_getpid()); > + fclose(ofp); > MT_lock_unset(&frequencylock, "getFrequencyStruct"); > > > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/checkin-list > -- | Stefan.Manegold(a)CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

2 1

Re: MonetDB: default - handle added types also in declared tables
by Sjoerd Mullender 11 Nov '13

11 Nov '13

Is this the fix for bug 3394 that you just closed? If so, was this really intended for the default branch (in which case the bug should be NEXTFEATURERELEASE) or should this have gone to the Feb2013 branch? On 2013-11-11 22:14, Niels Nes wrote: > Changeset: 63c54046f8c4 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=63c54046f8c4 > Modified Files: > sql/backends/monet5/sql.mx > sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql > Branch: default > Log Message: > > handle added types also in declared tables > > > diffs (43 lines): > > diff --git a/sql/backends/monet5/sql.mx b/sql/backends/monet5/sql.mx > --- a/sql/backends/monet5/sql.mx > +++ b/sql/backends/monet5/sql.mx > @@ -3993,12 +3993,13 @@ mvc_declared_table_column_wrap(Client cn > str msg = getSQLContext(cntxt,mb, &m, NULL); > sql_schema *s = NULL; > sql_table *t = NULL; > + sql_type *type = NULL; > sql_subtype tpe; > int *ret = (int *) getArgReference(stk, pci, 0); > int *rs = (int *) getArgReference(stk, pci, 1); > str *tname = (str *) getArgReference(stk, pci, 2); > str *name = (str *) getArgReference(stk, pci, 3); > - str *type = (str *) getArgReference(stk, pci, 4); > + str *typename = (str *) getArgReference(stk, pci, 4); > int *digits = (int *) getArgReference(stk, pci, 5); > int *scale = (int *) getArgReference(stk, pci, 6); > > @@ -4006,8 +4007,11 @@ mvc_declared_table_column_wrap(Client cn > return msg; > if (*rs != 0) > throw(SQL, "sql.dtColumn", "Cannot access declared table"); > - if (!sql_find_subtype(&tpe, *type, *digits, *scale)) > + if (!sql_find_subtype(&tpe, *typename, *digits, *scale) && > + (type = mvc_bind_type(m, *typename)) == NULL) > throw(SQL, "sql.dtColumn", "Cannot find column type"); > + if (type) > + sql_init_subtype(&tpe, type, 0, 0); > s = mvc_bind_schema(m, dt_schema); > if ( s == NULL) > throw(SQL,"sql.declared_table_column","3F000!Schema missing"); > diff --git a/sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql b/sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql > --- a/sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql > +++ b/sql/test/BugTracker-2013/Tests/Cannot_Find_Column_Type.Bug-3394.sql > @@ -45,3 +45,8 @@ begin > end; > > select tmp4(); > + > +drop function tmp4; > +drop function tmp3; > +drop function tmp2; > +drop function tmp1; > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/checkin-list > -- Sjoerd Mullender

1 0

How do I get SQL decimal scale in MAL?
by Dru Nelson 11 Nov '13

11 Nov '13

HI, I"m working on writing an aggregate in in C that is a MAL function. I've run into a problem with decimal types. I've noticed that when I inspect the BAT inputs for various types, they are coerced to simpler types. (flt,dbl -> dbl). (int, decimal -> int). There is also no other information in the BAT structure to see the type. I notice that a SQL select gets the type info passed in as parameters for the 'exportValue' output. For example: >* sql.exportValue(1,".","second_single_value","decimal",9,3,8,_4,""); * How can I get this type information ('decimal', etc.) passed into my function? Dru

3 9

about "MT" in gdk module
by 张磊 06 Nov '13

06 Nov '13

hi all, I found that in gdk module of monetdb, the file gdk_posix.c has many functions which begin with “MT”, and I want to ask that what's "MT", is that "MoneT", "Multiple Thread" or others? what's the meaning of "MT"? :) -- Best Wishes! zhanglei

2 1