- users-list - monetdb.org

Fixed size table performance
by Gustavo Brian 23 Feb '15

23 Feb '15

Hi, I want to implement a calendar based big table with prices for hotel accommodation with MonetDB. Once I have all the data in the table the performance is amazing but now I'm worried about insert/delete/update performance. I've asking at stackoverflow: http://stackoverflow.com/questions/28122178/monetdb-refresh-data-in-backgro… and had a nice approach but now I wonder about having a fixed size table because I can approximate the needed records for having a year of data and update them each time I have to: enable/disable, change free units, update prices, ... Some of the columns will be used for search: "destination", "date", "category", ... others for refinement: "units", "blocked", ... and others as values for the aggregations: "price", "breakfast", ... Is a fixed size table a good approach ? Updating the columns used for refinement or calculation will affect performance ? Thanks, Gustavo Brian Developer

2 1

Table as function parameter
by Bart Lenoir 20 Feb '15

20 Feb '15

To be more precise: SQL table data 'converted' to R data.frame data inside MonetDB (functions).

1 0

Table as function parameter
by Bart Lenoir 20 Feb '15

20 Feb '15

Hi Martin, Thank you for your quick response. I was hoping to find a way to use 'data.frame' in MonetDB's SQL with embedded R functions. Column oriented RDBMS with integrated/embedded R are serious contenders in the (Big) Data Science arena. Kind regards, Bart

1 0

Table as function parameter
by Bart Lenoir 19 Feb '15

19 Feb '15

Do MonetDB functions accept tables as parameters?

2 1

Compilation Error MonetDB-11.19.9
by Bart Lenoir 15 Feb '15

15 Feb '15

Hi Stefan, I filed a bug report: 3672 Thanks. Cheers, Bart

1 0

Compilation Error MonetDB-11.19.9
by Bart Lenoir 15 Feb '15

15 Feb '15

Hi Stefan, Thank you for your quick response. The config output has 600+ lines and the config.log is over 11k lines. Can I send you these as attachment by email? Cheers, Bart

2 1

Compilation Error MonetDB-11.19.9
by Bart Lenoir 15 Feb '15

15 Feb '15

Compilation of MonetDB-11.19.9 generates error in 'make' on Oracle Linux (2.6.18-371.11.1.0.1.el5 - x86_64). /usr/bin/ld: .libs/libbat_la-gdk_utils.o: relocation R_X86_64_PC32 against `MT_global_exit' can not be used when making a shared object; recompile with -fPIC

2 1

Bulk loading with NULL values in a column
by Scott Mathieson 13 Feb '15

13 Feb '15

Hi, Is it possible to perform a binary load of column data that contains NULLs - the documentation seems to indicate that the data is just a binary file of a C array of the appropriate type, but that would imply you can't have NULL values in any of the columns, is that correct? Regards, Scott ________________________________

2 1

Bug : msqldump, drop, create
by Pierre-Adrien Coustillas 07 Feb '15

07 Feb '15

Hello, I finally get to reproduce a table conflict bug still present in the 2014 version of OCT SP1 I run these commands simultaneously in two terminals : ---------------------------------------------------------------------------- terminal 1 : $ msqldump --database=lemonde --table=test_integrite_tra > backup_test_integrite_tra.sql terminal 2 : $ mclient lemonde --statement="SELECT count(*) FROM test_integrite_tra" +----------+ | L1 | +==========+ | 19681703 | +----------+ $ mclient lemonde --statement="DROP TABLE test_integrite_tra" operation successful $ mclient lemonde --statement="CREATE TABLE test_integrite_tra AS SELECT id_unique,device,nbvisistes FROM sys.visiteurs_device_2 WITH NO DATA" operation successful ---------------------------------------------------------------------------- I count the number of table test_integrite_tra sql>SELECT count(*) FROM SYS.TABLES WHERE name='test_integrite_tra'; +------+ | L1 | +======+ | 1 | +------+ And I restart monetdb : # service monetdb5-sql stop ; sleep 30 ; service monetdb5-sql start Stopping MonetDB SQL server: monetdbd. Starting MonetDB SQL server: monetdbd. I count the number of table test_integrite_tra sql>SELECT count(*) FROM SYS.TABLES WHERE name='test_integrite_tra'; +------+ | L1 | +======+ | 2 | +------+ Pierre -- 1G6 52 route de bischwiller 67300 Schiltigheim Société de Services et de Formations en Logiciels Libres http://1g6.biz Tél : 06 64 63 70 35

2 1

strange bug different count(*) two terminals
by Pierre-Adrien Coustillas 07 Feb '15

07 Feb '15

Hi, I have the same request that I run on the same server, the same database in two different mclient . The results are not the same. There is no activity on the server , no other query running. pcoustillas@groupelemonde:~$ mclient lemonde Welcome to mclient, the MonetDB/SQL interactive terminal (Oct2014-SP1) Database: MonetDB v11.19.7 (Oct2014-SP1), 'mapi:monetdb://groupelemonde:50000/lemonde' Type \q to quit, \? for a list of available commands auto commit mode: on sql>TRACE SELECT count(*) FROM ref__cookies__lemonde__os; +------+ | L1 | +======+ | 97 | +------+ 1 tuple (14.885ms) +-------+---------------------------------------------------------------------------------------------------------------------+ | ticks | stmt | +=======+=====================================================================================================================+ | 2 | X_2 := sql.mvc(); | | 13 | X_3:bat[:oid,:oid] =<tmp_32275>[97] := sql.tid(X_2=0,"sys","ref__cookies__lemonde__os"); | | 32 | X_6:bat[:oid,:int] =<tmp_5355>[97] := sql.bind(X_2=0,"sys","ref__cookies__lemonde__os","id",0); | | 9 | X_9=<tmp_26020>[97] := algebra.leftfetchjoin(X_3=<tmp_32275>:bat[:oid,:oid][97],X_6=<tmp_5355>:bat[:oid,:int][97]); | | 1 | X_10 := aggr.count(X_9=<tmp_26020>[97]); | | 503 | barrier X_31 := language.dataflow(); | | 4 | sql.exportValue(1,"sys.L1","L1","wrd",64,0,6,X_10=97:wrd,""); | | 0 | end s2_4; | | 555 | function user.s2_4(); | | 627 | X_5:void := user.s2_4(); | +-------+---------------------------------------------------------------------------------------------------------------------+ 10 tuples (14.976ms) pcoustillas@groupelemonde:~$ mclient lemonde Welcome to mclient, the MonetDB/SQL interactive terminal (Oct2014-SP1) Database: MonetDB v11.19.7 (Oct2014-SP1), 'mapi:monetdb://groupelemonde:50000/lemonde' Type \q to quit, \? for a list of available commands auto commit mode: on sql>TRACE SELECT count(*) FROM ref__cookies__lemonde__os; +------+ | L1 | +======+ | 0 | +------+ 1 tuple (6.841ms) +-------+------------------------------------------------------------------------------------------------------------------+ | ticks | stmt | +=======+==================================================================================================================+ | 2 | X_2 := sql.mvc(); | | 13 | X_3:bat[:oid,:oid] =<tmp_47161>[0] := sql.tid(X_2=0,"sys","ref__cookies__lemonde__os"); | | 9 | X_6:bat[:oid,:int] =<tmp_4226>[0] := sql.bind(X_2=0,"sys","ref__cookies__lemonde__os","id",0); | | 9 | X_9=<tmp_17466>[0] := algebra.leftfetchjoin(X_3=<tmp_47161>:bat[:oid,:oid][0],X_6=<tmp_4226>:bat[:oid,:int][0]); | | 1 | X_10 := aggr.count(X_9=<tmp_17466>[0]); | | 531 | barrier X_29 := language.dataflow(); | | 21 | sql.exportValue(1,"sys.L1","L1","wrd",64,0,6,X_10=0:wrd,""); | | 0 | end s2_1; | | 727 | function user.s2_1(); | | 868 | X_5:void := user.s2_1(); | +-------+------------------------------------------------------------------------------------------------------------------+ 10 tuples (6.951ms) any ideas ? thanks Pierre -- 1G6 52 route de bischwiller 67300 Schiltigheim Société de Services et de Formations en Logiciels Libres http://1g6.biz Tél : 06 64 63 70 35

2 1