- developers-list - monetdb.org

Python API's: sql.Binary() fix
by Mate Birkas 04 Feb '13

04 Feb '13

Hi, I may have found a bug in sql.Binary(). Here is the patch: --- pythonize.py 2013-02-03 15:22:09.217186598 +0100 +++ pythonize.py.fix 2013-02-03 15:23:34.613187703 +0100 @@ -119,7 +119,7 @@ def Binary(data): """returns binary encoding of data""" - return ''.join([hex(ord(i))[2:] for i in data]).upper() + return ''.join(["%02X" % ord(i) for i in data]) def DateFromTicks(ticks): """Convert ticks to python Date""" The hex() built-in returns three character string for integers lower than 15. This combined with the original code's [2:] results in corrupt string representations of binary objects having bytes with these values. cheers Mate

3 2

BATsubselect: invalid argument: s must be sorted.
by Tapomay Dey 30 Jan '13

30 Jan '13

I keep getting a GDK error as follows: Query succeeds if I change the order of filters in where clause!!! sql>SELECT count(*****_sales) AS "Sales" more>FROM tableName more>WHERE client_id = 53 more>AND vendor_id = 1; GDK reported error. BATsubselect: invalid argument: s must be sorted. sql> sql> sql>SELECT count(*****_sales) AS "Sales" more>FROM tableName more>WHERE vendor_id = 1 more>AND client_id = 53; +--------+ | Sales | +========+ | 109593 | +--------+ 1 tuple (571.649ms) I am running on an older revision of Feb13 branch. Ubuntu 12.10 Attaching the MAL. PS: http://www.mail-archive.com/checkin-list@monetdb.org/msg09267.html Thanks and Regards, Tapomay

1 1

Re: MonetDB: default - try to fix DataCell compilation error, by sim...
by Martin Kersten 28 Jan '13

28 Jan '13

Yes, that is correct. On 1/28/13 5:10 PM, Jennie Zhang wrote: > Changeset: 50111ec8e490 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=50111ec8e490 > Modified Files: > sql/backends/monet5/datacell/basket.c > Branch: default > Log Message: > > try to fix DataCell compilation error, by simply removing the unused variable that causes the problem. > > Mtest shows this change doesn't make the code worse. > > @Martin: please double check! > > > diffs (24 lines): > > diff --git a/sql/backends/monet5/datacell/basket.c b/sql/backends/monet5/datacell/basket.c > --- a/sql/backends/monet5/datacell/basket.c > +++ b/sql/backends/monet5/datacell/basket.c > @@ -41,10 +41,6 @@ str protocolname[4] = { "<unknown>", "TC > > BSKTbasketRec *baskets; /* the datacell catalog */ > int bsktTop = 0, bsktLimit = 0; > -static MT_Lock bsktLock MT_LOCK_INITIALIZER("bsktLock"); > - > -#define lockBSKTbasketCatalog() MT_lock_set(&bsktLock, "basket"); > -#define unlockBSKTbasketCatalog() MT_lock_unset(&bsktLock, "basket"); > > /* We have to obtain the precise wall-clock time > * This is not produced by GDKusec, which returns microseconds > @@ -90,9 +86,6 @@ static int BSKTnewEntry(void) > if (bsktLimit == 0) { > bsktLimit = MAXBSK; > baskets = (BSKTbasketRec *) GDKzalloc(bsktLimit * sizeof(BSKTbasketRec)); > -#ifdef NEED_MT_LOCK_INIT > - MT_lock_init(&bsktLock, "basket"); > -#endif > bsktTop = 1; /* entry 0 is used as non-initialized */ > } else if (bsktTop == bsktLimit) { > bsktLimit += MAXBSK; > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list >

1 0

Re: Issues with MonetDB
by Stefan Manegold 23 Jan '13

23 Jan '13

Dear Ashish, thank you very much for your feedback. Did you already try Oct2012-SP2, upcoming Oct2012-SP3 (currently available from http://dev.monetdb.org/downloads/testing/ ; will be formally released soon), or the Feb2013 branch from Mercurial (http://dev.monetdb.org/hg/MonetDB/branches)? To be able to further debug the problem on our side, we would need all the ingredients required to reproduce the problem you're experiencing (code, data, queries, detailed instructions). Best, Stefan Ashish Kumar Singh <ashishkumar.singh(a)altair.com> wrote: Dear Monet DB team, We are facing few very critical issues in monetdb in one of the reporting applications we are trying to put up using it. First of all performance improvements are really great using monetdb but we are facing some issues related to data consistency as described below: 1. Duplicate tuples are getting inserted few times. 2. Updates to database are not available for read immediately , sometimes wrong values are returned by database. After certain number of retires these becomes available though can go to 10 times of retires. We are facing this for Oct 2012 Sp1 build. These data related bug are not acceptable in our usage scenario and this will be the case with other folks too! Question to the list is there any released version backwards / upwards which can be used instead of October 2012 Sp1 which does not have these issues? I have filled a bug also for this at http://bugs.monetdb.org/show_bug.cgi?id=3222 Regards, Ashish

2 2

Announcement: New Oct2012-SP3 Bugfix release of MonetDB suite
by Sjoerd Mullender 22 Jan '13

22 Jan '13

The MonetDB team at CWI/MonetDB BV is pleased to announce the Oct2012-SP3 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Oct 2012-SP3 bugfix release Bug Fixes * 2291: small doubles end up as NULL after arithmetic * 2579: SQL: incorrect cast from double to int * 2659: tuples INTERSECT vs count (... INTERSECT ...) differs * 2805: row_number doesn't work in complex query * 2886: warning: Catalog parameter '' ignored * 2977: timestamp minus date results in program error * 2978: now() + 1 results in illegal argument * 2999: Up-cast from SQL drops order information? * 3048: algebra.join undefined when using multiple arithmetic operations in SQL where-clause * 3124: insert into table with two foreign keys crashes mserver5 * 3136: Memleak (in querycache?) while querying * 3143: Type resolution error in SQL procedural code * 3163: mserver5 crashes with large number of concurrent clients * 3168: crash when insert varchar/char/clob with default NULL * 3169: php driver uses call-time pass-by-reference * 3173: SQL queries with limit and offset clauses are unable to use bind parameters for either * 3176: Same query and different results * 3181: Join query returns zero results when there is an index on the tables * 3185: inconsistency between documentation and implementation of command line options * 3186: case evaluted to early * 3188: Storage of client history * 3189: Overflow in calculation * 3190: When subtracting two columns of type "timestamp", no results are returned * 3191: rel_optimizer.c:5596: _rel_optimizer: Assertion `0' failed. * 3192: "No such column with index" error if CASE in SELECT clause * 3199: Inconspicuous sequence of prepare, execute, commit and close produces error * 3205: Inet datatype handling inconsistent between int, cast( as inet) and string * 3208: Unable to execute prepared statements with a large number of arguments * 3209: exp_bin: Assertion `0' failed * 3212: Query cache does not work properly

1 0

Issues with MonetDB
by Ashish Kumar Singh 22 Jan '13

22 Jan '13

Dear Monet DB team, We are facing few very critical issues in monetdb in one of the reporting applications we are trying to put up using it. First of all performance improvements are really great using monetdb but we are facing some issues related to data consistency as described below: 1. Duplicate tuples are getting inserted few times. 2. Updates to database are not available for read immediately , sometimes wrong values are returned by database. After certain number of retires these becomes available though can go to 10 times of retires. We are facing this for Oct 2012 Sp1 build. These data related bug are not acceptable in our usage scenario and this will be the case with other folks too! Question to the list is there any released version backwards / upwards which can be used instead of October 2012 Sp1 which does not have these issues? I have filled a bug also for this at http://bugs.monetdb.org/show_bug.cgi?id=3222 Regards, Ashish

2 1

Fw: Inconsistency in data selection. count*
by Tapomay Dey 21 Jan '13

21 Jan '13

Forwarding to dev forum. Not appropriate for user list. ----- Forwarded Message ----- From: Tapomay Dey <tapomay(a)yahoo.com> To: Communication channel for Monet DB users <users-list(a)monetdb.org> Sent: Monday, January 21, 2013 2:39 PM Subject: Inconsistency in data selection. count* select count(*) from table; Results: 168466 rows select count(*) from table where column=0; Results: 168466 rows select count(*) from table where column<>0; Results: 168466 rows When I do a "select column from table where client_id=0 limit 5;" I see correct non-zero values in the result although the selection condition is that the column value must be 0. I put the data on another instance/machine - I don't see this issue. Plz find a screenshot@ https://picasaweb.google.com/115470548136322675830/January212013?authuser=0… Another case: sql>select count(*) from table2 where column2=0; | 391326 | sql>select count(*) from table2 where column2<>0; | 141108 | sql>select count(*) from table2; | 399326 | sql>select column2 from table2 where column2=0 limit 5; +-----------+ | column2 | +===========+ | 53 | | 53 | | 53 | | 53 | | 53 | +-----------+ 5 tuples (156.631ms) Regards, Tapomay _______________________________________________ users-list mailing list users-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list

3 2

Error in merovingian log while performing a specific select: gdk_batop.c insert_string_bat: Assertion failed
by Tapomay Dey 18 Jan '13

18 Jan '13

ERR msearch_stats_db[4515]: mserver5: gdk_batop.c:175: insert_string_bat: Assertion `v >= ((var_t) (((1<<10) * sizeof(stridx_t)) >> 0))' failed. I see above error in merovingian.log while performing a specific select query and the client says "Connection terminated": select id, col2, col3, col4, col5, timestamp, count(*) from stats_daily where id=38 group by "id", "col2", "col3", "col4", "timestamp", "col5" having count(*) >1; There's a unique key on the table stats_daily on (id,col2,col3, col4, timestamp, col5). However following query succeeds(it just has more selection conditions): select id, col2, col3, col4, col5, timestamp, count(*) from stats_daily where col2 <> '' and col3 <> '' and col4 <> '' and col5 <> '' and id <> 0 group by "id", "col2", "col3", "col4", "timestamp", "col5" having count(*) >1; One thing I know for sure is that there was an error in inserting records into the DB at some point before: Following is an excerpt from the merovingian logs: 2013-01-10 10:40:49 ERR msearch_stats_db[19210]: !mal_mapi.listen: expected filedescriptor, but received something else 2013-01-10 10:40:57 ERR merovingian[8996]: client error: client [XX.XX.XX.XX]:51573 sent challenge in incomplete block: 2013-01-10 10:45:29 ERR msearch_stats_db[19210]: mserver5: bat_storage.c:40: delta_bind_del: Assertion `b' failed. 2013-01-10 10:45:29 ERR msearch_stats_db[19210]: mserver5: bat_storage.c:40: delta_bind_del: Assertion `b' failed. 2013-01-10 23:48:18 ERR msearch_stats_db[31637]: !mal_mapi.listen: expected filedescriptor, but received something else 2013-01-10 23:48:19 ERR msearch_stats_db[31637]: !mal_mapi.listen: expected filedescriptor, but received something else 2013-01-10 23:48:32 ERR msearch_stats_db[31637]: !FATAL: BBPdir: subcommit attempted without backup BBP.dir. 2013-01-11 04:29:31 ERR msearch_stats_db[4480]: mserver5: gdk_batop.c:175: insert_string_bat: Assertion `v >= ((var_t) (((1<<10) * sizeof(stridx_t)) >> 0))' failed. Also, I keep getting "!mal_mapi.listen: expected filedescriptor, but received something else" almost every second(Performing continuous inserts into the db). Also attaching a subset of mervingian log that may contain other kinds of ERR s than above. What other diagnostics can I do? PS: Running on Feb2013 branch. changeset: 38061:d1a99a110b63 Ubuntu 12.10 64 bit. Regards, Tapomay. _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

2 3

MonetDB Clustering
by nguewo dominique 15 Jan '13

15 Jan '13

Dear Developers, I have a database in two systems with the same name. They both have a table with the same name. I have set the shared properties as follows. laptop1% monetdb -h laptop2-P mypassphrase set shared=pump/1/ pump laptop1% monetdb -h laptop3-P mypassphrase set shared=pump/2/ pump From a master node om trying to query the database to access data from the two tables but its not working. How t go about it? _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

2 1

Strange behaviour with MonetDB
by Ashish Kumar Singh 15 Jan '13

15 Jan '13

Hi List , We are facing one strange behavior with Monetdb. We have a simple table called test with following structure: CREATE SEQUENCE "testtable_seq" as bigint START WITH 1; CREATE TABLE testtable (dim_id bigint DEFAULT NEXT VALUE FOR "testtable_seq", dim_type varchar(100) NOT NULL, dim_value varchar(100) NOT NULL, CONSTRAINT unique_dimension UNIQUE(dim_type,dim_value) , CONSTRAINT pk_testtable PRIMARY KEY (dim_id)); We have a program which reads and writes to this table along with other tables using JDBC. We are facing below problems interminently: 1. When we query back data from this table with query like : select dim_id,dim_type,dim_value from testtable where dim_type='user' and dim_value='user1' we are getting back ID for some other value present in testable . 2. We are also seeing duplicate values getting inserted in to this table. Please suggest , we are using Oct SP1 build. Regards, Ashish _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

1 0