- users-list - monetdb.org

Job openings at MonetDB Solutions
by Ying Zhang 14 Jul '15

14 Jul '15

Dear all, MonetDB Solutions, the supporting company of MonetDB, is looking for core database developers. If you’re interested, please see the job description here: https://www.monetdbsolutions.com/company/careers Regards, Jennie

1 0

Re: User for multiple schemas
by Ying Zhang 14 Jul '15

14 Jul '15

Hai Brian, Glad to know it helps. We’ve found the cause of the problem I mentioned. It’s not random. It has something to do with changing the ROLE of a USER, and then the privileges of that ROLE seem not properly handled. We’re working on improving the documentation, extending the test suite, and fixing bugs concerning privileges. Regards, Jennie > On Jul 14, 2015, at 12:10, Brian Hood <brianh6854(a)googlemail.com> wrote: > > Hi Jennie, > > That was actually what i was looking for thanks for that i didn't realize that you could have more than one create schema schema_name AUTHORIZATION per_user > > I'll also see if i encounter the bug and if i can find anything reproducible. > > Regards, > > Brian Hood > > > On Tue, Jul 14, 2015 at 10:03 AM, Ying Zhang <Y.Zhang(a)cwi.nl> wrote: > Hello Brian, > > What authorisation are you looking for? MonetDB does support authorise one user as the owner of multiple schema’s, e.g.: > > create user brian with password ’brian123' name ’brian' schema sys; > create schema schema1 AUTHORIZATION brian; > create schema schema2 AUTHORIZATION brian; > > Not sure if this is what you’re looking for. > > However, we have noticed a problem (in the current default branch, probably also exists in Jul2015) in handling the privileges. After a user has been authorised as the owner of a schema, the user can CREATE, INSERT, UPDATE, … tables, however, *sometimes* the user can’t SELECT from his/her own tables. This seems to happen at random, which makes it extremely difficult to debug. However, restarting the MonetDB server seems to temporarily resolve the problem. > > We’re working on improving handling privileges in MonetDB. If you notice any errors and missing features, please let us know. > > Regards, > > Jennie > > > On Jun 23, 2015, at 08:05, Stefan Manegold <Stefan.Manegold(a)cwi.nl> wrote: > > > > Hi Brian, > > > > If i'm not mistaken and recall correctly, access rights / authorization are per table, not per schema - at least in MonetDB; hence, you'd have to grant access for each table in other than the user's schema separately. > > > > Best, > > Stefan > > > > > > On June 22, 2015 8:45:08 PM CEST, Brian Hood <brianh6854(a)googlemail.com> wrote: > > Hi All, > > > > There is something I have pondered on is there a way to have a username that can be authorized for multiple schemas under your dbfarm. > > > > If not what is the reason ? > > > > I haven't seen a way to do this so far. > > > > Regards, > > > > Brian Hood > > > > > > > > users-list mailing list > > users-list(a)monetdb.org > > https://www.monetdb.org/mailman/listinfo/users-list > > > > -- > > | Stefan.Manegold(a)CWI.nl | DB Architectures (DA) | > > | www.CWI.nl/~manegold/ | Science Park 123 (L321) | > > | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) | > > _______________________________________________ > > users-list mailing list > > users-list(a)monetdb.org > > https://www.monetdb.org/mailman/listinfo/users-list > >

1 0

User for multiple schemas
by Brian Hood 14 Jul '15

14 Jul '15

Hi All, There is something I have pondered on is there a way to have a username that can be authorized for multiple schemas under your dbfarm. If not what is the reason ? I haven't seen a way to do this so far. Regards, Brian Hood

3 2

How do you generate documentation from MonetDB source files?
by Jon Mulieri 12 Jul '15

12 Jul '15

I have long appreciated the wealth of information in the comments of source files throughout the code base. It is apparently formatted for some documentation extraction. Can someone provide instructions for generating the documentation from the source? Thanks! Jon

3 2

Reproducing EmbeddedR results from MonetDB.org site
by George, Glover E ERDC-RDE-ITL-MS 10 Jul '15

10 Jul '15

Hi all, I’ve recently been profiling several techniques for a workflow that we’ve been trying to improve here at USACE. Originally we used python scripts with sqlite, but we ran into scalability problems on large data sets. This led us to MonetDB, with the promise of columnar-based analysis and the hope of both parallel query’s “under-the-hood” and possibly a distributed workflow across an HPC system. Looking at my profiling results, this has led me to a number of questions that hopefully you all can help us with. I have a single table from the TPC-H benchmark – lineitem – populated with 360million entries: "l_orderkey" INTEGER NOT NULL, "l_partkey" INTEGER NOT NULL, "l_suppkey" INTEGER NOT NULL, "l_linenumber" INTEGER NOT NULL, "l_quantity" DECIMAL(15,2) NOT NULL, "l_extendedprice" DECIMAL(15,2) NOT NULL, "l_discount" DECIMAL(15,2) NOT NULL, "l_tax" DECIMAL(15,2) NOT NULL, "l_returnflag" CHAR(1) NOT NULL, "l_linestatus" CHAR(1) NOT NULL, "l_shipdate" DATE NOT NULL, "l_commitdate" DATE NOT NULL, "l_receiptdate" DATE NOT NULL, "l_shipinstruct" CHAR(25) NOT NULL, "l_shipmode" CHAR(10) NOT NULL, "l_comment" VARCHAR(44) NOT NULL, System Setup: Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz - 16 cores (HT off) / 256G RAM MonetDB version 11.19.15 R version 3.2.0 1. I have followed the instructions here: https://www.monetdb.org/content/embedded-r-monetdb and tried to reproduce these results. I only attempt to reproduce the results from R (reading the data from CSV since – as noted in a previous email to this list – R fails to read in the 360 million rows using MonetDB.R but works fine reading the same amount from CSV), MonetDB, as well as MonetDB with Embedded R. - I compile both R and MonetDB from source. When building R, I include the option to build the R shared library (libR.so) and when compiling MonetDB I include the option for embedded R. - When creating the MonetDB database, I set the option for embedr=true. - The R function from the above URL is used, as well as the same SQL query – and it works…. However, the performance is much worse than using R alone. I know I must be overlooking something. Please see the image at https://goo.gl/wUvB2J (png on Google Drive). The X-axis is the number of rows, and the Y axis is the time in seconds. As you can see, embedded R is unexpectedly much worse than the other two. 2. While running the quantile function, only one core is active – whether embeddedR or just MonetDB’s. 3. When running the following query (after altering the table to include a new column z, of course): sql>update lineitem set z=l_extendedprice / l_quantity; 360011594 affected rows (3m 49s) … Multiple cores are active for the first 10 seconds, then it resorts to single core. A. What am I not understanding about MonetDB’s ability to use multiple cores? The only time I really see it use multiple cores seems to be when doing “copy into”. B. Can someone provide assistance in trying to replicate the Embedded R results? Should it be running in parallel? Or might something in my setup be configured incorrectly. Cheers!

3 3

(no subject)
by musa 10 Jul '15

10 Jul '15

Can someone please provide a minimal example (how to start the server) for running the embedded R feature in windows? Regards, mpa

3 2

RE: Concurrency test causes crash of MonetDB 5 server on Windows
by michael.witt＠uniserv.com 08 Jul '15

08 Jul '15

Hello, Guillaume: Thanks for the tip avoiding concurrency conflicts. We already considered that and changed to code to avoid such conflicts. In the meanwhile I tested both on Windows and Linux machines and now it is clear that it is a problem specific to the Windows builds of MonetDB. The mserver5 on Windows starts with 2 threads serving requests as stated in the console after starting... # Serving database 'uniserv', using 2 threads Then I found a statement about the thread implementation on Windows by Stefan Mangegold: https://www.monetdb.org/pipermail/developers-list/2010-July/003492.html "However, we do not know how well the multi-threading works on Windows. We rely on pthreads, and their implementation on Windows might not be as efficient and/or stable as on Unix-like systems ..." This is absolutely true! My tests show that mserver5 started with 2 threads always crashes after some time firing concurrent read requests. By the way, the windows machine has 2 physical and 2 logical cores. But if I do the same on a Linux machine (also with 2 threads) Mserver5 runs stable. What is the solution to stabilize Mserver5 on Windows? Set the number of threads to 1 by setting the start option: --set gdk_nr_threads=1 In the M5server.bat script. After setting that, Mserver5 run stable on Windows, too. Does anyone know better solutions? Kind regards, Michael -----Original Message----- From: users-list [mailto:users-list-bounces+michael.witt=uniserv.com@monetdb.org] On Behalf Of Guillaume Bassot Sent: Dienstag, 30. Juni 2015 10:26 To: Communication channel for MonetDB users Subject: Re: Concurrency test causes crash of MonetDB 5 server Hello Michael, From my experience, all "write" request executed concurrently always end with concurrency conflict. I'm talking of heavey request during several minutes, so it's easy to get concurrent access. Since i only use monetdb with a single process, stability was greatly improved. Regards Guillaume BASSOT Web Developer +33 (0)1 55 48 02 82 gbassot(a)inbox.fr <mailto:gbassot@inbox.fr> 30, rue Vincent Moris 92240 Malakoff - France Fax : +33 (0)1 55 48 02 79 2015-06-30 10:09 GMT+02:00 <michael.witt(a)uniserv.com <mailto:michael.witt@uniserv.com> >: Hi all, It’s a pity that no one answered the question I asked a few weeks ago about crashes of MonetDB 5 server under windows 64 Bit. So I think I offer more information about a scenario where the databases crashes. Hopefully someone could give me a hint how to improve stability of MonetDB under Windows 64 Bit with concurrent client connections. We are using Monet DB for a couple of months and facing some graved issues with concurrent queries. The problem is, when we query the database with two or more clients in a parallel, the database crashes! These are the facts: MonetDB server version: v11.19.9 ================================ # MonetDB 5 server v11.19.9 "Oct2014-SP2" # Serving database 'uniserv', using 2 threads # Compiled for x86_64-pc-winnt/64bit with 64bit OIDs dynamically linked # Found 8.000 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2015 MonetDB B.V., all rights reserved # Visit http://www.monetdb.org/ <http://www.monetdb.org/> for further information # Listening for connection requests on mapi:monetdb://QADQSHWIN:50000/ # MonetDB/SQL module loaded Server crashes also occur on versions v11.19.8 and v11.19.7. Operation system: ================= Microsoft Windows Server 2008 R2 Datacenter Version 6.1.7601 Service Pack 1 Build 7601 hosted on VMWare Virtual Platform x64-based PC 2x Processor Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz, 2800 Mhz, 1 Core(s), 1 Logical Processor(s) Installed Physical Memory (RAM) 8,00 GB Available Physical Memory 5,25 GB Total Virtual Memory 16,0 GB Server installation folder: =========================== E:\Program Files\MonetDB\MonetDB5 Server startup script M5server.bat: =================================== @REM Copyright August 2008-2014 MonetDB B.V. @REM All Rights Reserved. @echo off setlocal rem figure out the folder name set MONETDB=%~dp0 rem remove the final backslash from the path set MONETDB=%MONETDB:~0,-1% rem extend the search path with our EXE and DLL folders set PATH=%MONETDB%\bin;%MONETDB%\lib;%MONETDB%\lib\MonetDB5;%PATH% rem prepare the arguments to mserver5 to tell it where to put the dbfarm REM Uniserv: Don't use APPDATA, so set APPDATA to empty String. set APPDATA= if "%APPDATA%" == "" goto usevar rem if the APPDATA variable does exist, put the database there set MONETDBDIR=%APPDATA%\MonetDB5 set MONETDBFARM="--dbpath=%MONETDBDIR%\dbfarm\demo" goto skipusevar :usevar rem if the APPDATA variable does not exist, put the database in the rem installation folder (i.e. default location, so no command line argument) REM Uniserv: Specify the DB installation folder rem set MONETDBDIR=%MONETDB%\var\MonetDB5 set MONETDBDIR=%MONETDB%\db set MONETDBFARM="--dbpath=%MONETDBDIR%\dbfarm\uniserv" :skipusevar rem the SQL log directory used to be in %MONETDBDIR%, but we now rem prefer it inside the dbfarm, so move it there if not exist "%MONETDBDIR%\sql_logs" goto skipmove for /d %%i in ("%MONETDBDIR%"\sql_logs\*) do move "%%i" "%MONETDBDIR%\dbfarm"\%%~ni\sql_logs rmdir "%MONETDBDIR%\sql_logs" :skipmove rem start the real server "%MONETDB%\bin\mserver5.exe" --set "prefix=%MONETDB%" --set mapi_open=true --set mapi_port=50000 --set max_clients=1000 --set "exec_prefix=%MONETDB%" %MONETDBFARM% %* if ERRORLEVEL 1 pause endlocal MonetDB JDBC Client: ================ We query the database via the latest MonetDB JDBC driver loaded from the central Maven repository: <groupId>monetdb</groupId> <artifactId>monetdb-jdbc</artifactId> <version>2.14</version> Database tables: ================ We create tables called "rule_result_<n>" CREATE TABLE "dq_scorecard"."rule_results_1" ("id" BIGINT NOT NULL PRIMARY KEY AUTO_INCREMENT, "record_id" VARCHAR(1024), "rule_1" INT, "rule_2" INT, ...); Each table has about 50+ INT columns. Query scenarios: ================ We have concurrent read access via JDBC driver and Spring Data Access Objects, the query look like that: *Client 1: 50 aggregate queries on 50 different columns on one database table like that: SELECT AVG("rule_n") FROM "dq_scorecard"."rule_results_1" WHERE "rule_n" >= 0 *Client 2: 50 aggregate queries on 50 different columns on another database table like that: SELECT AVG("rule_n") FROM "dq_scorecard"."rule_results_2" WHERE "rule_n" >= 0 *Client 3: 50 aggregate queries on 50 different columns on another database table like that: SELECT AVG("rule_n") FROM "dq_scorecard"."rule_results_3" WHERE "rule_n" >= 0 All clients run concurrently, at the moment we don't use a connection pool and create a connection for every query. During concurrent access the M5server crashes. The server crashes when each table has 100 records! Our production tables can have up to 50. 000. 000 of records! Kind regards, Michael From: users-list [mailto:users-list-bounces+michael.witt <mailto:users-list-bounces%2Bmichael.witt> =uniserv.com(a)monetdb.org <mailto:uniserv.com@monetdb.org> ] On Behalf Of michael.witt(a)uniserv.com <mailto:michael.witt@uniserv.com> Sent: Donnerstag, 28. Mai 2015 14:32 To: users-list(a)monetdb.org <mailto:users-list@monetdb.org> Subject: Concurrency test causes crash of MonetDB 5 server Hi, we experience a crash of MonetDB 5 server during tests of a multi-threaded client access via JDBC-Driver and MapiSocket: The application is already optimized to avoid “concurrency conflicts” because of the “Optimistic Concurrency Control” concept. The test simulates client access via two threads. All update operations (INSERT, UPDATE, DELETE, DROP TABLE, CREATE TABLE) are done in serial. All read operations are done in parallel to other read operations or to update operations. The test causes a crash of mserver5.exe after a few minutes. If the test uses just one thread, all read and update operations are done in serial and the server does not crash. What is the rule of thumb to avoid crashes when using several client threads? Crash details: Problem signature: Problem Event Name: APPCRASH Application Name: mserver5.exe Application Version: 0.0.0.0 Application Timestamp: 55389f58 Fault Module Name: StackHash_8ec6 Fault Module Version: 6.1.7601.18247 Fault Module Timestamp: 521eaf24 Exception Code: c0000374 Exception Offset: 00000000000c4102 OS Version: 6.1.7601.2.1.0.144.8 Locale ID: 1031 Additional Information 1: 8ec6 Additional Information 2: 8ec62499039d1d8234b025a62c725eb7 Additional Information 3: f8f3 Additional Information 4: f8f3e520847c0684b15d4080171779ef # MonetDB 5 server v11.19.9 "Oct2014-SP2" # Serving database 'uniserv', using 4 threads # Compiled for x86_64-pc-winnt/64bit with 64bit OIDs dynamically linked # Found 10.000 GiB available main-memory. .. # MonetDB/SQL module loaded Michael Witt _______________________________________________ users-list mailing list users-list(a)monetdb.org <mailto:users-list@monetdb.org> https://www.monetdb.org/mailman/listinfo/users-list

2 1

Field conversion sticks to subsequent queries
by Dennis Lorson 08 Jul '15

08 Jul '15

Hi all, I have a table with an INT column. The table is sorted by that column, and monetdb has recognized the sort order. While performing this query: -------------- SELECT * FROM table WHERE column = 12345678900; -------------- monetdb converts <table.column> to BIGINT/LNG as evidenced by the trace: -------------- 3612684 | X_17=<tmp_2352>[89617785] := batcalc.lng(X_16=<tmp_7142>[89617785]); -------------- This seems logical behavior since the condition value would overflow INT. (Of course the result set is empty by definition, but it’s a valid query) However, the same happens when I then perform subsequent queries with values that *can* be represented by INT: -------------- SELECT * FROM table WHERE column = 123; -------------- It is only when an explicit INT value is entered, that the type conversion is stopped for that query and subsequent ones: -------------- SELECT * FROM table WHERE column = CAST(123 AS INT); -------------- In other words, once the type conversion is performed once, it seems to “stick” to subsequent queries. Type conversion on that column takes ~4s on a 90MM row table here, while the regular query time is usually sub-millisecond. Entering the “wrong" value once will influence the DB performance heavily until restarted, which is far from a desirable scenario. Of course I could always clamp my value to INT range at the application level, but this is brittle, and the DB could do the right thing here. Is there a design consideration that I’m missing, or should I file this as a bug/performance issue? Thanks, Dennis

4 4

INNER JOIN with NULL values returning incorrect result
by Dennis Pallett 02 Jul '15

02 Jul '15

Hi all, I'm trying to do a simple INNER JOIN with two tables whereby the 1st table can contain NULL values in the join column. The query is as such: ---------- SELECT "B"."id", "A"."other_id" FROM "A" INNER JOIN "B" ON "B"."id" = "A"."other_id" WHERE "A"."afnemer" = '789' AND "A"."orgid" = 123; ---------- However this returns an incorrect result, such as: ---------- +------+----------+ | id | other_id | +======+==========+ | 143 | 143 | | 166 | 166 | | 147 | 147 | | 264 | 264 | | 323 | null | | 323 | 271 | | 271 | 275 | | 275 | 269 | | 269 | 150 | ---------- Clearly the JOIN has somehow mapped incorrect rows together from tables A and B. If I add a NOT NULL condition to the query on table A, I get correct results. This is the following query: ---------- SELECT "A"."other_id", "B"."id" , "A"."orgid" FROM "A" INNER JOIN "B" ON "B"."id" = "A"."other_id" WHERE "A"."afnemer" = '789' AND "A"."orgid" = 123 AND "A".other_id IS NOT NULL; ---------- Is this a known bug in MonetDB? Should I always add a NOT NULL condition to my JOIN queries? Best regards, Dennis Pallett

2 3

Can't start monetdb 11.19.15
by Brian Hood 01 Jul '15

01 Jul '15

Hi All, I seems when i look at the output i of the error log it seems there are missing methods, i have seen this as a bug report from a while ago online but i can't see the see the solution. Any ideas ? [root@dev-vnc-01 /]# monetdbd start /var/monetdb5/dbfarm [root@dev-vnc-01 /]# [root@dev-vnc-01 /]# monetdb status name state health remarks threatmonitor S 5d 100% 7s mapi:monetdb://dev-vnc-01:50000/threatmonitor [root@dev-vnc-01 /]# monetdb start threatmonitor starting database 'threatmonitor'... FAILED start: starting 'threatmonitor' failed: database 'threatmonitor' started up, but failed to open up a communication channel [root@dev-vnc-01 /]# pacman -Q monetdb monetdb 11.19.15-1 [root@dev-vnc-01 /]# monetdb -v MonetDB Database Server Toolkit v1.1 (Oct2014-SP4) [root@dev-vnc-01 /]# tail -70 /var/monetdb5/dbfarm/merovingian.log 2015-06-25 23:31:58 MSG merovingian[293]: monitoring dbfarm /var/monetdb5/dbfarm 2015-06-25 23:32:18 MSG merovingian[293]: accepting connections on TCP socket 0.0.0.0:50000 2015-06-25 23:32:18 MSG merovingian[293]: accepting connections on UNIX domain socket /tmp/.s.monetdb.50000 2015-06-25 23:32:38 MSG discovery[293]: listening for UDP messages on 0.0.0.0:50000 2015-06-25 23:32:38 MSG control[293]: accepting connections on UNIX domain socket /tmp/.s.merovingian.50000 2015-06-25 23:32:38 MSG discovery[293]: new neighbour dev-vnc-01 (dev-vnc-01) 2015-06-25 23:32:53 MSG control[293]: (local): created database 'threatmonitor' 2015-06-25 23:32:59 MSG control[293]: (local): served status list 2015-06-25 23:32:59 MSG control[293]: (local): released database 'threatmonitor' 2015-06-25 23:32:59 MSG discovery[293]: new database mapi:monetdb://dev-vnc-01:50000/threatmonitor (ttl=660s) 2015-06-25 23:33:08 MSG merovingian[293]: starting database 'threatmonitor', up min/avg/max: 0s/0s/0s, crash average: 0.00 0.00 0.00 (0-0=0) 2015-06-25 23:33:08 MSG merovingian[293]: sending process 304 (database 'threatmonitor') the TERM signal 2015-06-25 23:33:08 MSG threatmonitor[304]: arguments: /usr/bin/mserver5 --dbpath=/var/monetdb5/dbfarm/threatmonitor --set merovingian_uri=mapi:monetdb://dev-vnc-01:50000/threatmonitor --set mapi_open=false --set mapi_port=0 --set mapi_usock=/var/monetdb5/dbfarm/threatmonitor/.mapi.sock --set monet_vault_key=/var/monetdb5/dbfarm/threatmonitor/.vaultkey --set gdk_nr_threads=2 --set max_clients=64 --set sql_optimizer=default_pipe --set monet_daemon=yes 2015-06-25 23:33:08 MSG threatmonitor[304]: # MonetDB 5 server v11.19.15 "Oct2014-SP4" 2015-06-25 23:33:08 MSG threatmonitor[304]: # Serving database 'threatmonitor', using 2 threads 2015-06-25 23:33:08 MSG threatmonitor[304]: # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked 2015-06-25 23:33:08 MSG threatmonitor[304]: # Found 7.411 GiB available main-memory. 2015-06-25 23:33:08 MSG threatmonitor[304]: # Copyright (c) 1993-July 2008 CWI. 2015-06-25 23:33:08 MSG threatmonitor[304]: # Copyright (c) August 2008-2015 MonetDB B.V., all rights reserved 2015-06-25 23:33:08 MSG threatmonitor[304]: # Visit http://www.monetdb.org/ for further information 2015-06-25 23:33:08 MSG threatmonitor[304]: !TypeException:user.main[1412]:object code for command rapi.prelude missing 2015-06-25 23:33:08 MSG threatmonitor[304]: !TypeException:user.main[1412]:'rapi.prelude' undefined in: _1412:void := rapi.prelude() 2015-06-25 23:33:08 MSG merovingian[293]: database 'threatmonitor' (304) has exited with exit status 0 2015-06-25 23:33:08 MSG merovingian[293]: database 'threatmonitor' has shut down 2015-06-25 23:33:08 ERR merovingian[293]: client error: database 'threatmonitor' started up, but failed to open up a communication channel 2015-06-25 23:33:08 MSG merovingian[293]: starting database 'threatmonitor', up min/avg/max: 0s/0s/0s, crash average: 0.00 0.00 0.00 (1-1=0) 2015-06-25 23:33:09 MSG merovingian[293]: sending process 307 (database 'threatmonitor') the TERM signal 2015-06-25 23:33:09 MSG threatmonitor[307]: arguments: /usr/bin/mserver5 --dbpath=/var/monetdb5/dbfarm/threatmonitor --set merovingian_uri=mapi:monetdb://dev-vnc-01:50000/threatmonitor --set mapi_open=false --set mapi_port=0 --set mapi_usock=/var/monetdb5/dbfarm/threatmonitor/.mapi.sock --set monet_vault_key=/var/monetdb5/dbfarm/threatmonitor/.vaultkey --set gdk_nr_threads=2 --set max_clients=64 --set sql_optimizer=default_pipe --set monet_daemon=yes 2015-06-25 23:33:09 MSG threatmonitor[307]: # MonetDB 5 server v11.19.15 "Oct2014-SP4" 2015-06-25 23:33:09 MSG threatmonitor[307]: # Serving database 'threatmonitor', using 2 threads 2015-06-25 23:33:09 MSG threatmonitor[307]: # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked 2015-06-25 23:33:09 MSG threatmonitor[307]: # Found 7.411 GiB available main-memory. 2015-06-25 23:33:09 MSG threatmonitor[307]: # Copyright (c) 1993-July 2008 CWI. 2015-06-25 23:33:09 MSG threatmonitor[307]: # Copyright (c) August 2008-2015 MonetDB B.V., all rights reserved 2015-06-25 23:33:09 MSG threatmonitor[307]: # Visit http://www.monetdb.org/ for further information 2015-06-25 23:33:09 MSG threatmonitor[307]: !TypeException:user.main[1412]:object code for command rapi.prelude missing 2015-06-25 23:33:09 MSG threatmonitor[307]: !TypeException:user.main[1412]:'rapi.prelude' undefined in: _1412:void := rapi.prelude() 2015-06-25 23:33:09 MSG merovingian[293]: database 'threatmonitor' (307) has exited with exit status 0 2015-06-25 23:33:09 MSG merovingian[293]: database 'threatmonitor' has shut down 2015-06-25 23:33:13 ERR merovingian[293]: client error: database 'threatmonitor' started up, but failed to open up a communication channel 2015-06-26 00:08:20 MSG control[293]: (local): served status list 2015-06-26 00:08:20 ERR control[293]: (local): received stop signal for non running database: threatmonitor 2015-06-26 00:08:29 MSG merovingian[293]: caught SIGTERM, starting shutdown sequence 2015-06-26 00:08:30 MSG control[293]: control channel closed 2015-06-26 00:08:31 MSG merovingian[293]: Merovingian 1.7 stopped 2015-07-01 12:57:10 MSG merovingian[9]: Merovingian 1.7 (Oct2014-SP4) starting 2015-07-01 12:57:10 MSG merovingian[9]: monitoring dbfarm /var/monetdb5/dbfarm 2015-07-01 12:57:30 MSG merovingian[9]: accepting connections on TCP socket 0.0.0.0:50000 2015-07-01 12:57:30 MSG merovingian[9]: accepting connections on UNIX domain socket /tmp/.s.monetdb.50000 2015-07-01 12:57:50 MSG discovery[9]: listening for UDP messages on 0.0.0.0:50000 2015-07-01 12:57:50 MSG control[9]: accepting connections on UNIX domain socket /tmp/.s.merovingian.50000 2015-07-01 12:57:50 MSG discovery[9]: new neighbour dev-vnc-01 (dev-vnc-01) 2015-07-01 12:57:50 MSG discovery[9]: new database mapi:monetdb://dev-vnc-01:50000/threatmonitor (ttl=660s) 2015-07-01 12:57:54 MSG control[9]: (local): served status list 2015-07-01 12:58:03 MSG control[9]: (local): served status list 2015-07-01 12:58:03 MSG merovingian[9]: starting database 'threatmonitor', up min/avg/max: 0s/7s/27s, crash average: 0.00 0.00 0.00 (10-10=0) 2015-07-01 12:58:03 MSG merovingian[9]: sending process 15 (database 'threatmonitor') the TERM signal 2015-07-01 12:58:03 MSG threatmonitor[15]: arguments: /usr/bin/mserver5 --dbpath=/var/monetdb5/dbfarm/threatmonitor --set merovingian_uri=mapi:monetdb://dev-vnc-01:50000/threatmonitor --set mapi_open=false --set mapi_port=0 --set mapi_usock=/var/monetdb5/dbfarm/threatmonitor/.mapi.sock --set monet_vault_key=/var/monetdb5/dbfarm/threatmonitor/.vaultkey --set gdk_nr_threads=2 --set max_clients=64 --set sql_optimizer=default_pipe --set monet_daemon=yes 2015-07-01 12:58:03 MSG threatmonitor[15]: # MonetDB 5 server v11.19.15 "Oct2014-SP4" 2015-07-01 12:58:03 MSG threatmonitor[15]: # Serving database 'threatmonitor', using 2 threads 2015-07-01 12:58:03 MSG threatmonitor[15]: # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked 2015-07-01 12:58:03 MSG threatmonitor[15]: # Found 7.411 GiB available main-memory. 2015-07-01 12:58:03 MSG threatmonitor[15]: # Copyright (c) 1993-July 2008 CWI. 2015-07-01 12:58:03 MSG threatmonitor[15]: # Copyright (c) August 2008-2015 MonetDB B.V., all rights reserved 2015-07-01 12:58:03 MSG threatmonitor[15]: # Visit http://www.monetdb.org/ for further information 2015-07-01 12:58:03 MSG threatmonitor[15]: !TypeException:user.main[1412]:object code for command rapi.prelude missing 2015-07-01 12:58:03 MSG threatmonitor[15]: !TypeException:user.main[1412]:'rapi.prelude' undefined in: _1412:void := rapi.prelude() 2015-07-01 12:58:03 MSG merovingian[9]: database 'threatmonitor' (15) has exited with exit status 0 2015-07-01 12:58:03 MSG merovingian[9]: database 'threatmonitor' has shut down 2015-07-01 12:58:03 ERR control[9]: (local): failed to fork mserver: database 'threatmonitor' started up, but failed to open up a communication channel Regards, Brian Hood

2 3

MonetDB performance disappointing
by Martin Schwitalla 30 Jun '15

30 Jun '15

Hello, I`m doing some experiments with a database, which originally runs on PostgreSQL. But some queries take very long on this system. Especially one query type, which takes about 14s to finish. The idea was to port it to MonetDB, because the database is not that big (~8GB) and it`s an analytical task. But suprisingly MonetDB takes even longer to finish. With the default pipeline it takes about 22-23s. I tried various pipelines and the minimal_pipe was the best. It finished the task in about 16,5s, better, but still not great. I`m asking myself what I could do to further improve the performance. I added some primary and foreign key constraints and set the database to readonly, but it didn`t do much. The trace tells me that some joins take the most time and some subselects also take much time. But nothing besides that. The query has 10 joins. Do you have any advices for me? Best regards, Martin

5 11

Concurrency test causes crash of MonetDB 5 server
by michael.witt＠uniserv.com 30 Jun '15

30 Jun '15

Hi, we experience a crash of MonetDB 5 server during tests of a multi-threaded client access via JDBC-Driver and MapiSocket: The application is already optimized to avoid "concurrency conflicts" because of the "Optimistic Concurrency Control" concept. The test simulates client access via two threads. All update operations (INSERT, UPDATE, DELETE, DROP TABLE, CREATE TABLE) are done in serial. All read operations are done in parallel to other read operations or to update operations. The test causes a crash of mserver5.exe after a few minutes. If the test uses just one thread, all read and update operations are done in serial and the server does not crash. What is the rule of thumb to avoid crashes when using several client threads? Crash details: Problem signature: Problem Event Name: APPCRASH Application Name: mserver5.exe Application Version: 0.0.0.0 Application Timestamp: 55389f58 Fault Module Name: StackHash_8ec6 Fault Module Version: 6.1.7601.18247 Fault Module Timestamp: 521eaf24 Exception Code: c0000374 Exception Offset: 00000000000c4102 OS Version: 6.1.7601.2.1.0.144.8 Locale ID: 1031 Additional Information 1: 8ec6 Additional Information 2: 8ec62499039d1d8234b025a62c725eb7 Additional Information 3: f8f3 Additional Information 4: f8f3e520847c0684b15d4080171779ef # MonetDB 5 server v11.19.9 "Oct2014-SP2" # Serving database 'uniserv', using 4 threads # Compiled for x86_64-pc-winnt/64bit with 64bit OIDs dynamically linked # Found 10.000 GiB available main-memory. .. # MonetDB/SQL module loaded Michael Witt

2 2

JDBC PreparedStatement crashing the Database!!
by Vijay Krishna 29 Jun '15

29 Jun '15

Hi, I recently faced an issue with MonetDB JDBC PreparedStatement. I have a table with 15 columns out of which 14 are foreign keys to columns in another 14 tables. When I try to insert a valid record (that satisfies all the FK relations) using PreparedStatement, the database gets crashed while executing the line, preparedStatement = connection.prepareStatement(sqlString); On trial and error testing, I found that this works very fine until a table has 13 FK relations. If the tables has 14 FKs, then the database crashes. On a brighter side, this operation works very fine in terminal (mclient) with 14 FKs even. Is there any limit on the FKs with prepared statement? Or what am I doing wrong here? Any help much appreciated. Thanks in advance. Regards, Vijayakrishna.P. Mobile : (+91) 9500402305.

2 2

Is minimal_pipe enforced on long MAL plans?
by Roberto Cornacchia 22 Jun '15

22 Jun '15

Hi there, Is minimal_pipe enforced under any condition? For example when the the MAL plan generated by rel2bin is longer than a given threshold? Context: I have a pretty long query which results in a MAL plan of 33K lines. Though the query is a bit long, I still would expect a 2-3K lines MAL plan. The plan indeed contains the same pieces of code re-evaluated over and over. It first, I simply blamed commonTerms not doing its job. The thing is, the MAL plans generated with minimal_pipe and default_pipe are absolutely identical for this query. Hence my question above. Best, Roberto

3 3

MonetDb Udf
by Fatma Nur Özdemir 19 Jun '15

19 Jun '15

Hello, We are using MonetDB5 server v11.19.15 “Oct2014-SP4” windows version and we want to use a function that we wrote in C programming language. However, we cannot use this user defined function within MonetDB. Maybe, this problem is about windows version because we are not sure that windows version of MonetDb supports this feature. If anybody knows something about this, please inform us. Thank you in advance. Fatma Nur [http://www.bilyoner.com/fm/mail/mailalti_Bmw-applewatch.jpg]<http://www.bilyoner.com/kampanyalar/2015haziranagustosmp.jspx> Bu elektronik posta ve onunla iletilen butun dosyalar sadece gondericisi tarafindan almasi amaclanan yetkili gercek ya da tuzel kisinin kullanimi icindir. Eger soz konusu yetkili alici degilseniz bu elektronik postanin icerigini aciklamaniz, kopyalamaniz, yonlendirmeniz ve kullanmaniz hukuka aykiri ve yasaktir, eger bu mesaji yanlislikla aldiysaniz lutfen gondereni ile temasa geciniz ve bu elektronik postayi siliniz. B�LYONER �nteraktif Hizmetleri A.S. bu mesajin icerdigi bilgilerin dogrulugu veya eksiksiz oldugu konusunda herhangi bir garanti vermemektedir. Bu nedenle bu bilgilerin ne sekilde olursa olsun iceriginden, iletilmesinden, alinmasindan ve saklanmasindan sorumlu degildir. Bu mesajdaki gorusler yalnizca gonderen kisiye aittir ve Bilyoner �nteraktif Hizmetleri A.S. nin goruslerini yansitmayabilir. Bu e-posta bilinen butun bilgisayar viruslerine karsi taranmistir.

1 0

Re: Monetdb-R integration
by imad hajj chahine 19 Jun '15

19 Jun '15

Hi Hannes, This error is due that the "2-age" column has more than 2 distinct values, there is a space after some values. can you run a trim on the "2-Age" and then try it again. As for the vector thing, I didnt get the point, shouldnt the db engine split the data into vectors and feed the aggregate function which return one data point? Thanks On Fri, Jun 19, 2015 at 11:12 AM, Hannes Mühleisen <Hannes.Muehleisen(a)cwi.nl > wrote: > I am running attached script, which I pieced together from your emails. > This does not run, it produces the following error: > > Error running R expression. Error message: Error in t.test.formula(arg1 ~ > arg2) : > grouping factor must have exactly 2 levels > Calls: as.data.frame -> <Anonymous> -> t.test -> t.test.formula > > > > > In general, for aggregations, the R code needs to return a vector with a > single entry for each group. > > > Best, > > Hannes > > > > > On 19 Jun 2015, at 09:44, imad hajj chahine <imad.hajj.chahine(a)gmail.com> > wrote: > > > > Thanks, if you need more information from my side let me know. > > > > Also can you answer me on the following when i use 2 functions one to > retrieve Pvalue and one for the stat value: > > Am I doing the correct way to retrieve the stat and p-value, is the > ttest get executed twice in this case? is there a more optimal way where i > can retrieve both information. > > > > On Fri, Jun 19, 2015 at 10:39 AM, Hannes Mühleisen < > Hannes.Muehleisen(a)cwi.nl> wrote: > > Looking into this at the moment. > > > > > On 16 Jun 2015, at 09:56, Dimitar Nedev < > dimitar.nedev(a)monetdbsolutions.com> wrote: > > > > > > Hannes, do you know if the STD_DEV is the issue there or if the > queries should actually yield different results? > > > > > > Dimitar > > > > > >> On 2015-Jun-15, at 13:28 , imad hajj chahine < > imad.hajj.chahine(a)gmail.com> wrote: > > >> > > >> Hi, > > >> > > >> Shouldn't we have the same result from running the first query and > the second query? > > >> after all its an aggregate function and should return the test for > each group. > > >> > > >> I checked that monetdb had problem with running group by with > statistics functions like STD_DEV, are these 2 issues related? > > >> > > >> Thank you. > > >> > > >> > > >> > > >> > > >> On Mon, Jun 15, 2015 at 1:52 PM, Dimitar Nedev < > dimitar.nedev(a)monetdbsolutions.com> wrote: > > >> Hi Imad, > > >> > > >> Here is the output I got from running the queries. Note, this might > not be entirely representative since I did clean-up some data before > loading it. > > >> > > >> sql>select "2-Age", "tone"."ttest2"("9-Score",6.08963) from > "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where > "2-Age" is not null group by "2-Age"; > > >> +---------+--------------------------+ > > >> | 2-Age | L1 | > > >> +=========+==========================+ > > >> | [10-20] | 0.89311103869734754 | > > >> +---------+--------------------------+ > > >> 3 tuples (3.218ms) > > >> > > >> sql>select '[10-20]' as "2-Age","tone"."ttest2"("9-Score",6.08963) > from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where > "2-Age" = '[10-20]' > > >> more>union all > > >> more>select '[21-30]' as "2-Age","tone"."ttest2"("9-Score",6.08963) > from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where > "2-Age" = '[21-30]' > > >> more>union all > > >> more>select '[> 30]' as "2-Age","tone"."ttest2"("9-Score",6.08963) > from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where > "2-Age" = '> 30'; > > >> +---------+--------------------------+ > > >> | 2-Age | L1 | > > >> +=========+==========================+ > > >> | [10-20] | 0.14150742355349472 | > > >> | [21-30] | 0.32872830865003566 | > > >> | [> 30] | 0.37127075363219841 | > > >> +---------+--------------------------+ > > >> 3 tuples (8.825ms) > > >> > > >> > > >> sql>select "tone"."ttest2samplesStatistic"("9-Score", "4-Gender") as > "stat", "tone"."ttest2samples"("9-Score", "4-Gender") as "pvalue" from > "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" group by > "2-Age"; > > >> +--------------------------+--------------------------+ > > >> | stat | pvalue | > > >> +==========================+==========================+ > > >> | -2.1588506639013736 | 0.032555033970368859 | > > >> +--------------------------+--------------------------+ > > >> 1 tuple (13.287ms) > > >> > > >> > > >> I dropped the aggregate with: > > >> sql>DROP AGGREGATE "tone"."ttest2samplesStatistic"; > > >> operation successful (2.049ms) > > >> > > >> > > >> Best regards, > > >> Dimitar > > >> > > >>> On 2015-Jun-12, at 00:46 , imad hajj chahine < > imad.hajj.chahine(a)gmail.com> wrote: > > >>> > > >>> Thank you Dimitar, > > >>> > > >>> I was using Squirrel to connect from my host machine to the VM. > > >>> > > >>> Now when I connect using SSH-client and run the short group by query > it works but the result is not similar to the union queries (PS: i also run > it in the VM direclty and had the same result) > > >>> > > >>> > > >>> +---------+--------------------------+ > > >>> | 2-Age | pval | > > >>> +=========+==========================+ > > >>> | [21-30] | 0.99996611809271041 | > > >>> +---------+--------------------------+ > > >>> 3 tuples (2.638ms) > > >>> > > >>> > > >>> What i am trying to achieve is to run a one sample ttest for all the > age categories, and it seems that the group by is ignored. > > >>> > > >>> I have also created 2 functions for the two sample ttest: > > >>> > > >>> CREATE AGGREGATE "tone"."ttest2samples"(arg1 double, arg2 > varchar(250)) RETURNS double LANGUAGE R { t.test(arg1 ~ arg2)$p.value }; > > >>> CREATE AGGREGATE "tone"."ttest2samplesStatistic"(arg1 double, arg2 > varchar(250)) RETURNS double LANGUAGE R { t.test(arg1 ~ arg2)$statistic }; > > >>> > > >>> select "tone"."ttest2samplesStatistic"("9-Score", "4-Gender") as > "stat", "tone"."ttest2samples"("9-Score", "4-Gender") as "pvalue" from > "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" group by > "2-Age" > > >>> > > >>> Am I doing the correct way to retrieve the stat and p-value, is the > ttest get executed twice in this case? is there a more optimal way where i > can retrieve both information. Please note that I also have the same > grouping issue as before. > > >>> > > >>> Do you have the same behavior, or I am missing something in the > creation of these functions. > > >>> > > >>> A final question, how do u drop a R function? i am trying to execute > the following: > > >>> drop all function "tone"."ttest2samplesStat" > > >>> > > >>> > > >>> Thank you. > > >>> > > >>> > > >>> > > >>> On Thu, Jun 11, 2015 at 11:28 PM, Dimitar Nedev < > dimitar.nedev(a)monetdbsolutions.com> wrote: > > >>> Hi Imad, > > >>> > > >>> Hannes asked me to look at your issue with the MonetDB-R VM. > > >>> > > >>> I loaded the data and ran the queries you mentioned, but I did not > encounter any issues. This holds for both the short and the union queries. > I am also not familiar with the issue you report, nor its cause. At this > time I think it is local to your instance. If you can export your db, or > re-load the data, I would recommend you to create a new instance with a > fresh image and try again. If you import the image as a new VM instance, > you can keep your old one around as well. > > >>> > > >>> Please note that during the test: > > >>> - I ran as the admin (monetdb) user, as the one created default on > the VM image cannot create new schemas. > > >>> - I have to clean the data a bit up to load it, removing dozen lines > or so. > > >>> - Renamed ttest1 to ttest2 to match the queries. > > >>> > > >>> Best regards, > > >>> Dimitar > > >>> > > >>>>>>>>> Begin forwarded message: > > >>>>>>>>> > > >>>>>>>>> From: imad hajj chahine <imad.hajj.chahine(a)gmail.com> > > >>>>>>>>> Subject: Re: Monetdb-R integration > > >>>>>>>>> Date: 10 Jun 2015 10:11:48 CEST > > >>>>>>>>> To: Hannes Mühleisen <Hannes.Muehleisen(a)cwi.nl> > > >>>>>>>>> > > >>>>>>>>> Hi, > > >>>>>>>>> > > >>>>>>>>> I am using the virtual box provided from > https://www.monetdbsolutions.com/solutions/cloud/vm: > > >>>>>>>>> OS:linux version 3.10.0-123.9.3.el7.x86_64 ( > builder(a)kbuilder.dev.centos.org) > > >>>>>>>>> Monetdb: V1.7: (Oct2014-SP1) > > >>>>>>>>> R: 3.1.2 (2014-10-31) > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> create table > "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" ("Consumer > Number" INTEGER,"1-Disloyalty" varchar(250),"2-Age" varchar(250),"3-Amount > transferred" INTEGER,"4-Gender" varchar(250),"5-Citiz enship" > varchar(250),"6- Profession" varchar(250),"7-City" varchar(250),"8-1 NC > Billboard" varchar(250),"8-2 NC Friends" varchar(250),"8-3 NC Magazine" > varchar(250),"8-4 NC Others" varchar(250),"9-Score" decimal(18,3),"10- Type > of operation" varchar(250),"11-1 Welcoming" INTEGER,"11-2 Waiting time" > INTEGER,"11-3 Time to finish request" INTEGER,"11-4 Fees" INTEGER,"11-5 > Courtesy of employees" INTEGER,"11-6 Branch layout" INTEGER,"11-7 Attention > to special requests" INTEGER,"12- Total time for service" > decimal(18,3),"13- Distance from POS" decimal(18,3),"14- Weight" INTEGER) > > >>>>>>>>> > > >>>>>>>>> COPY offset 2 INTO > "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" FROM > '/home/App_Data/TestingDataSimple_2003_Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea.csv' > USING DELIMITERS ',','\n','"'; > > >>>>>>>>> > > >>>>>>>>> Thanks > > >>>>>>>>> > > >>>>>>>>> On Wed, Jun 10, 2015 at 10:50 AM, Hannes Mühleisen < > Hannes.Muehleisen(a)cwi.nl> wrote: > > >>>>>>>>> Hello Imad, > > >>>>>>>>> > > >>>>>>>>> which version of MonetDB and R are you using? Which operating > system? > > >>>>>>>>> > > >>>>>>>>> Can you please also include the commands you used to load your > CSV into MonetDB/ create the table? > > >>>>>>>>> > > >>>>>>>>> Thanks, > > >>>>>>>>> > > >>>>>>>>> Hannes > > >>>>>>>>> > > >>>>>>>>>> On 10 Jun 2015, at 00:25, imad hajj chahine < > imad.hajj.chahine(a)gmail.com> wrote: > > >>>>>>>>>> > > >>>>>>>>>> Hi Hannes, > > >>>>>>>>>> > > >>>>>>>>>> I am testing Monetdb-R integration to do some statistical > test, i followed the tutorial you posted on youtube and i have created the > following function: > > >>>>>>>>>> > > >>>>>>>>>> CREATE AGGREGATE "tone"."ttest1"(arg1 double, arg2 double) > RETURNS double LANGUAGE R { t.test(arg1, arg2)$p.value }; > > >>>>>>>>>> > > >>>>>>>>>> this function will basically do a one sample t-test. > > >>>>>>>>>> > > >>>>>>>>>> I have loaded the sample attached file into a demo database > and trying to run the following query: > > >>>>>>>>>> > > >>>>>>>>>> select "2-Age", "tone"."ttest2"("9-Score",6.08963) from > "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where > "2-Age" is not null group by "2-Age" > > >>>>>>>>>> > > >>>>>>>>>> The following error happened > > >>>>>>>>>> Error: protocol violation: unexpected line in data block: . > > >>>>>>>>>> SQLState: M0M10 > > >>>>>>>>>> ErrorCode: 0 > > >>>>>>>>>> > > >>>>>>>>>> alternatively i managed to have the intended result by > running this query: > > >>>>>>>>>> > > >>>>>>>>>> select '[10-20]' as > "2-Age","tone"."ttest2"("9-Score",6.08963) from > "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where > "2-Age" = '[10-20]' > > >>>>>>>>>> union all > > >>>>>>>>>> select '[21-30]' as > "2-Age","tone"."ttest2"("9-Score",6.08963) from > "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where > "2-Age" = '[21-30]' > > >>>>>>>>>> union all > > >>>>>>>>>> select '[> 30]' as "2-Age","tone"."ttest2"("9-Score",6.08963) > from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where > "2-Age" = '> 30' > > >>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> any help or guidance is appreciated. > > >>>>>>>>>> Thank you. > > >>>>>>>>>> > > >>>>>>>>>> > <TestingDataSimple_2003_Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea.csv> > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > >> > > > > > > > > > >

1 0

Fwd: Monetdb-R integration
by Hannes Mühleisen 19 Jun '15

19 Jun '15

(Forwarding to users list, free support is public) > Begin forwarded message: > > From: Hannes Mühleisen <hannes.muehleisen(a)cwi.nl> > Subject: Re: Monetdb-R integration > Date: 19 Jun 2015 10:12:48 CEST > To: imad hajj chahine <imad.hajj.chahine(a)gmail.com> > Cc: Dimitar Nedev <dimitar.nedev(a)monetdbsolutions.com> > > I am running attached script, which I pieced together from your emails. This does not run, it produces the following error: > > Error running R expression. Error message: Error in t.test.formula(arg1 ~ arg2) : > grouping factor must have exactly 2 levels > Calls: as.data.frame -> <Anonymous> -> t.test -> t.test.formula > > > > In general, for aggregations, the R code needs to return a vector with a single entry for each group. > > > Best, > > Hannes > > > >> On 19 Jun 2015, at 09:44, imad hajj chahine <imad.hajj.chahine(a)gmail.com> wrote: >> >> Thanks, if you need more information from my side let me know. >> >> Also can you answer me on the following when i use 2 functions one to retrieve Pvalue and one for the stat value: >> Am I doing the correct way to retrieve the stat and p-value, is the ttest get executed twice in this case? is there a more optimal way where i can retrieve both information. >> >> On Fri, Jun 19, 2015 at 10:39 AM, Hannes Mühleisen <Hannes.Muehleisen(a)cwi.nl> wrote: >> Looking into this at the moment. >> >>> On 16 Jun 2015, at 09:56, Dimitar Nedev <dimitar.nedev(a)monetdbsolutions.com> wrote: >>> >>> Hannes, do you know if the STD_DEV is the issue there or if the queries should actually yield different results? >>> >>> Dimitar >>> >>>> On 2015-Jun-15, at 13:28 , imad hajj chahine <imad.hajj.chahine(a)gmail.com> wrote: >>>> >>>> Hi, >>>> >>>> Shouldn't we have the same result from running the first query and the second query? >>>> after all its an aggregate function and should return the test for each group. >>>> >>>> I checked that monetdb had problem with running group by with statistics functions like STD_DEV, are these 2 issues related? >>>> >>>> Thank you. >>>> >>>> >>>> >>>> >>>> On Mon, Jun 15, 2015 at 1:52 PM, Dimitar Nedev <dimitar.nedev(a)monetdbsolutions.com> wrote: >>>> Hi Imad, >>>> >>>> Here is the output I got from running the queries. Note, this might not be entirely representative since I did clean-up some data before loading it. >>>> >>>> sql>select "2-Age", "tone"."ttest2"("9-Score",6.08963) from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where "2-Age" is not null group by "2-Age"; >>>> +---------+--------------------------+ >>>> | 2-Age | L1 | >>>> +=========+==========================+ >>>> | [10-20] | 0.89311103869734754 | >>>> +---------+--------------------------+ >>>> 3 tuples (3.218ms) >>>> >>>> sql>select '[10-20]' as "2-Age","tone"."ttest2"("9-Score",6.08963) from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where "2-Age" = '[10-20]' >>>> more>union all >>>> more>select '[21-30]' as "2-Age","tone"."ttest2"("9-Score",6.08963) from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where "2-Age" = '[21-30]' >>>> more>union all >>>> more>select '[> 30]' as "2-Age","tone"."ttest2"("9-Score",6.08963) from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where "2-Age" = '> 30'; >>>> +---------+--------------------------+ >>>> | 2-Age | L1 | >>>> +=========+==========================+ >>>> | [10-20] | 0.14150742355349472 | >>>> | [21-30] | 0.32872830865003566 | >>>> | [> 30] | 0.37127075363219841 | >>>> +---------+--------------------------+ >>>> 3 tuples (8.825ms) >>>> >>>> >>>> sql>select "tone"."ttest2samplesStatistic"("9-Score", "4-Gender") as "stat", "tone"."ttest2samples"("9-Score", "4-Gender") as "pvalue" from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" group by "2-Age"; >>>> +--------------------------+--------------------------+ >>>> | stat | pvalue | >>>> +==========================+==========================+ >>>> | -2.1588506639013736 | 0.032555033970368859 | >>>> +--------------------------+--------------------------+ >>>> 1 tuple (13.287ms) >>>> >>>> >>>> I dropped the aggregate with: >>>> sql>DROP AGGREGATE "tone"."ttest2samplesStatistic"; >>>> operation successful (2.049ms) >>>> >>>> >>>> Best regards, >>>> Dimitar >>>> >>>>> On 2015-Jun-12, at 00:46 , imad hajj chahine <imad.hajj.chahine(a)gmail.com> wrote: >>>>> >>>>> Thank you Dimitar, >>>>> >>>>> I was using Squirrel to connect from my host machine to the VM. >>>>> >>>>> Now when I connect using SSH-client and run the short group by query it works but the result is not similar to the union queries (PS: i also run it in the VM direclty and had the same result) >>>>> >>>>> >>>>> +---------+--------------------------+ >>>>> | 2-Age | pval | >>>>> +=========+==========================+ >>>>> | [21-30] | 0.99996611809271041 | >>>>> +---------+--------------------------+ >>>>> 3 tuples (2.638ms) >>>>> >>>>> >>>>> What i am trying to achieve is to run a one sample ttest for all the age categories, and it seems that the group by is ignored. >>>>> >>>>> I have also created 2 functions for the two sample ttest: >>>>> >>>>> CREATE AGGREGATE "tone"."ttest2samples"(arg1 double, arg2 varchar(250)) RETURNS double LANGUAGE R { t.test(arg1 ~ arg2)$p.value }; >>>>> CREATE AGGREGATE "tone"."ttest2samplesStatistic"(arg1 double, arg2 varchar(250)) RETURNS double LANGUAGE R { t.test(arg1 ~ arg2)$statistic }; >>>>> >>>>> select "tone"."ttest2samplesStatistic"("9-Score", "4-Gender") as "stat", "tone"."ttest2samples"("9-Score", "4-Gender") as "pvalue" from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" group by "2-Age" >>>>> >>>>> Am I doing the correct way to retrieve the stat and p-value, is the ttest get executed twice in this case? is there a more optimal way where i can retrieve both information. Please note that I also have the same grouping issue as before. >>>>> >>>>> Do you have the same behavior, or I am missing something in the creation of these functions. >>>>> >>>>> A final question, how do u drop a R function? i am trying to execute the following: >>>>> drop all function "tone"."ttest2samplesStat" >>>>> >>>>> >>>>> Thank you. >>>>> >>>>> >>>>> >>>>> On Thu, Jun 11, 2015 at 11:28 PM, Dimitar Nedev <dimitar.nedev(a)monetdbsolutions.com> wrote: >>>>> Hi Imad, >>>>> >>>>> Hannes asked me to look at your issue with the MonetDB-R VM. >>>>> >>>>> I loaded the data and ran the queries you mentioned, but I did not encounter any issues. This holds for both the short and the union queries. I am also not familiar with the issue you report, nor its cause. At this time I think it is local to your instance. If you can export your db, or re-load the data, I would recommend you to create a new instance with a fresh image and try again. If you import the image as a new VM instance, you can keep your old one around as well. >>>>> >>>>> Please note that during the test: >>>>> - I ran as the admin (monetdb) user, as the one created default on the VM image cannot create new schemas. >>>>> - I have to clean the data a bit up to load it, removing dozen lines or so. >>>>> - Renamed ttest1 to ttest2 to match the queries. >>>>> >>>>> Best regards, >>>>> Dimitar >>>>> >>>>>>>>>>> Begin forwarded message: >>>>>>>>>>> >>>>>>>>>>> From: imad hajj chahine <imad.hajj.chahine(a)gmail.com> >>>>>>>>>>> Subject: Re: Monetdb-R integration >>>>>>>>>>> Date: 10 Jun 2015 10:11:48 CEST >>>>>>>>>>> To: Hannes Mühleisen <Hannes.Muehleisen(a)cwi.nl> >>>>>>>>>>> >>>>>>>>>>> Hi, >>>>>>>>>>> >>>>>>>>>>> I am using the virtual box provided from https://www.monetdbsolutions.com/solutions/cloud/vm: >>>>>>>>>>> OS:linux version 3.10.0-123.9.3.el7.x86_64 (builder(a)kbuilder.dev.centos.org) >>>>>>>>>>> Monetdb: V1.7: (Oct2014-SP1) >>>>>>>>>>> R: 3.1.2 (2014-10-31) >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> create table "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" ("Consumer Number" INTEGER,"1-Disloyalty" varchar(250),"2-Age" varchar(250),"3-Amount transferred" INTEGER,"4-Gender" varchar(250),"5-Citiz enship" varchar(250),"6- Profession" varchar(250),"7-City" varchar(250),"8-1 NC Billboard" varchar(250),"8-2 NC Friends" varchar(250),"8-3 NC Magazine" varchar(250),"8-4 NC Others" varchar(250),"9-Score" decimal(18,3),"10- Type of operation" varchar(250),"11-1 Welcoming" INTEGER,"11-2 Waiting time" INTEGER,"11-3 Time to finish request" INTEGER,"11-4 Fees" INTEGER,"11-5 Courtesy of employees" INTEGER,"11-6 Branch layout" INTEGER,"11-7 Attention to special requests" INTEGER,"12- Total time for service" decimal(18,3),"13- Distance from POS" decimal(18,3),"14- Weight" INTEGER) >>>>>>>>>>> >>>>>>>>>>> COPY offset 2 INTO "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" FROM '/home/App_Data/TestingDataSimple_2003_Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea.csv' USING DELIMITERS ',','\n','"'; >>>>>>>>>>> >>>>>>>>>>> Thanks >>>>>>>>>>> >>>>>>>>>>> On Wed, Jun 10, 2015 at 10:50 AM, Hannes Mühleisen <Hannes.Muehleisen(a)cwi.nl> wrote: >>>>>>>>>>> Hello Imad, >>>>>>>>>>> >>>>>>>>>>> which version of MonetDB and R are you using? Which operating system? >>>>>>>>>>> >>>>>>>>>>> Can you please also include the commands you used to load your CSV into MonetDB/ create the table? >>>>>>>>>>> >>>>>>>>>>> Thanks, >>>>>>>>>>> >>>>>>>>>>> Hannes >>>>>>>>>>> >>>>>>>>>>>> On 10 Jun 2015, at 00:25, imad hajj chahine <imad.hajj.chahine(a)gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>> Hi Hannes, >>>>>>>>>>>> >>>>>>>>>>>> I am testing Monetdb-R integration to do some statistical test, i followed the tutorial you posted on youtube and i have created the following function: >>>>>>>>>>>> >>>>>>>>>>>> CREATE AGGREGATE "tone"."ttest1"(arg1 double, arg2 double) RETURNS double LANGUAGE R { t.test(arg1, arg2)$p.value }; >>>>>>>>>>>> >>>>>>>>>>>> this function will basically do a one sample t-test. >>>>>>>>>>>> >>>>>>>>>>>> I have loaded the sample attached file into a demo database and trying to run the following query: >>>>>>>>>>>> >>>>>>>>>>>> select "2-Age", "tone"."ttest2"("9-Score",6.08963) from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where "2-Age" is not null group by "2-Age" >>>>>>>>>>>> >>>>>>>>>>>> The following error happened >>>>>>>>>>>> Error: protocol violation: unexpected line in data block: . >>>>>>>>>>>> SQLState: M0M10 >>>>>>>>>>>> ErrorCode: 0 >>>>>>>>>>>> >>>>>>>>>>>> alternatively i managed to have the intended result by running this query: >>>>>>>>>>>> >>>>>>>>>>>> select '[10-20]' as "2-Age","tone"."ttest2"("9-Score",6.08963) from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where "2-Age" = '[10-20]' >>>>>>>>>>>> union all >>>>>>>>>>>> select '[21-30]' as "2-Age","tone"."ttest2"("9-Score",6.08963) from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where "2-Age" = '[21-30]' >>>>>>>>>>>> union all >>>>>>>>>>>> select '[> 30]' as "2-Age","tone"."ttest2"("9-Score",6.08963) from "tone"."Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea" where "2-Age" = '> 30' >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> any help or guidance is appreciated. >>>>>>>>>>>> Thank you. >>>>>>>>>>>> >>>>>>>>>>>> <TestingDataSimple_2003_Marketing_Loyalty_4700298d-9862-40b3-9028-b0f15dab9dea.csv> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>>> >>> >> >> >

1 0

Enabling Spatial support?
by Thorsten Wesskallnies 17 Jun '15

17 Jun '15

Hi, I'm having some trouble with the instruction posted on the website here: https://www.monetdb.org/Documentation/Extensions/GIS I am running an OEL Server on version 6.6 and installed MonetDB using yum: Installed Packages Name : MonetDB Arch : x86_64 Version : 11.19.11 Release : 20150423.el6 ... Name : MonetDB-geom-MonetDB5 Arch : x86_64 Version : 11.19.11 Release : 20150423.el6 I also configured and installed the current version of the GEOS Library # geos-config --version >3.4.2 According to the above mentioned website I should now rebuild my DB with the '--enable-geom configure argument'. Unfortunately I'm unable to find the correct way to do it since yum installed a binary on my system and not the sourcecode. The 'MonetDB-geom' package doesn't seem to to the trick since the result of the sample Code on the Website returns an empty result. Hope somebody can point me in the right direction. MfG Thorsten Wesskallnies Avitech GmbH Principal Office: Bahnhofplatz 1 | 88045 Friedrichshafen | Germany Court Registration: Amtsgericht Ulm | HRB 728293 Geschäftsführer/Managing Director: Antonio Maria Gonzalez Gorostiza VAT No.: DE223719716 http://avitech.aero

2 1

trace disabled?
by Roberto Cornacchia 16 Jun '15

16 Jun '15

Hi there, Just to be sure: is it expected that trace is disabled / changed in Jan2015? I can see the trace by inspecting sys.tracelog() after the query, but no longer in one go as before. Roberto

1 1

Performing a quantile in R from a MonetDB.R db with 300million rows (UNCLASSIFIED)
by George, Glover E ERD-MS 15 Jun '15

15 Jun '15

Classification: UNCLASSIFIED Caveats: NONE Hi all, I'm currently trying to compare the performance of R's quantile function to that of MonetDB's. I have a table loaded with the TPC-H benchmark's data (scale factor of 50). I'm trying to return ~300 million rows of data (select l_extendedprice from lineitem), and although I have 256G of RAM, I'm getting the following: Error in paste(0)("",resp, collapse="") : Result would exceed 2^31-1 bytes The R statement is : x = dbGetQuery(conn, "select l_extendedprice from lineitem") Forgive me if this is a simplistic questions, as I am fairly new to R and don't know which avenue to take next. I took a look at bigmemory, but don't know quite how to return a result from monetdb and have it use a big.matrix. Note: the l_extendedprice is a floating (double) value. Any suggestions? Cheers. Glover George Classification: UNCLASSIFIED Caveats: NONE

2 2

1-to-N (bat) UDF
by Roberto Cornacchia 15 Jun '15

15 Jun '15

Hi there, I need a string tokenizer in MonetDB. The problem I have is not with the function itself, but with the fact that this is a 1 to N rows function. Implementing this for a single string value is easy enough, using a table function that takes a string a returns a table: create function tokenize(s string) returns table (token string) external name tokenize; select * from tokenize("one two three"); That's fine. The issue I'm having is with extending this to a column of strings. Ideally, given a string column one two three four five six seven eight I'd like to get an output along these lines (simplistic representation here): one two three | one one two three | two one two three | three four five six | four four five six | five four five six | six seven eight | seven seven eight | eight I can sure code the c function and the mal wrapper to implement this, but I can't see how to map it to SQL, given that table functions don't accept identifiers as parameters. Any idea? Any possible workaround? Thanks, Roberto

4 11

Geommodul and Linestring Query
by Dennis Wiest 15 Jun '15

15 Jun '15

Hello, I have a question for Geomodul. Is it possible to execute the following query with a LineString. This is my query with a point and the sample data set from the documentation. SELECT forests.name,buildings.name FROM forests,buildings WHERE "Intersect"(buildings.outline, Point(53.9,29.9)) = true; Now I want to replace the Point with a LineString like this in mysql. SELECT forests.name,buildings.name FROM forests,buildings WHERE "Intersect"(buildings.outline, LineString(Point(53.9,29.9), Point(53.0, 29.0))) = true; TestDatabase CREATE TABLE forests(id INT,name TEXT,shape MULTIPOLYGON); CREATE TABLE buildings(id INT,name TEXT,location POINT,outline POLYGON); INSERT INTO forests VALUES(109, 'Green Forest', 'MULTIPOLYGON( ((28 26,28 0,84 0,84 42,28 26), (52 18,66 23,73 9,48 6,52 18)), ((59 18,67 18,67 13,59 13,59 18)))'); INSERT INTO buildings VALUES(113, '123 Main Street', 'POINT( 52 30 )', 'POLYGON( ( 50 31, 54 31, 54 29, 50 29, 50 31) )'); INSERT INTO buildings VALUES(114, '215 Main Street', 'POINT( 64 33 )', 'POLYGON( ( 66 34, 62 34, 62 32, 66 32, 66 34) )'); SELECT forests.name,buildings.name FROM forests,buildings WHERE forests.name = 'Green Forest' and Overlaps(forests.shape, buildings.outline) = true; many thanks Dennis ________________________________ Avitech GmbH Principal Office: Bahnhofplatz 1 | 88045 Friedrichshafen | Germany Court Registration: Amtsgericht Ulm | HRB 728293 Gesch?ftsf?hrer/Managing Director: Antonio Maria Gonzalez Gorostiza VAT No.: DE223719716 http://avitech.aero

2 2

how to take output from DELETE and feed it to INSERT?
by integrity 12 Jun '15

12 Jun '15

Dear experts, Does anyone know how to take output from DELETE and feed it to INSERT INTO another table? Since now my pipeline ran into a certain point that 37 seconds of the total time 48 seconds spent on the following queries: INSERT INTO old_to_old SELECT uniqueid, targetid, distance_arcsec FROM associatedsource WHERE uniqueid IN (SELECT old_uniqueid FROM one_to_many) ORDER BY uniqueid, targetid; 42650 affected rows (20.0s) DELETE FROM associatedsource WHERE uniqueid IN (SELECT old_uniqueid FROM one_to_many); 42650 affected rows (16.6s) where associatedsource table is a large table with 1219234829 rows which is the size till the end of second day, while one_to_many table is quite small only 30 rows. associatedsource will accumulate processed data day by day, till the end of first day it has 603553616 rows. As associatedsource table grows, this two queries has severely degraded my pipeline, on first day the time for them were 9.1s and 7.8s. We can see monetdb server engine (randomly?) access the same data twice, for a large table and limited time allocated to a run of pipeline this is very expensive. if we can combine the queries into a single then the logic about which rows to move will be neater and improve performance twice. Thank you and best wishes, Meng

2 2

Dependency Types
by Robert Koch 11 Jun '15

11 Jun '15

Hi all, could someone please add an entry in the online documentation about the meaning of column "depend_type" in sys.dependencies? Recommended place is: https://www.monetdb.org/Documentation/SQLcatalog/TriggersDependencies Thank you. Robert

2 1

MonetDB crashed by some Query
by Dennis Wiest 10 Jun '15

10 Jun '15

Hello, I'm new here. I have the following problem. I have a database that looks like this (see end of email). Now I want to issue the following query. Select b. * FROM open_auctions o, b bidder WHERE (select b3.INCREASE from bidder b3 where b3.id = (select min (b3a.id) from bidder b3a where b3a.open_auction_id = o.open_auction_id)) * 2 <= (Select b2.INCREASE from bidder b2 where b2.id = (SELECT MAX (b2a.id) from bidder b2a where b2a.open_auction_id = o.open_auction_id)) AND o.open_auction_id = b.open_auction_id; The database crashes. If I divide the query individually and settled it works flawlessly. Other complex query also work. Only in this query crashes the database. Can anyone help me further? I installed MonetDB 11:19:11 64 bits on Redhat. 6 Thanks and Regards Dennis CREATE TABLE closed_auctions ( id int NOT NULL AUTO_INCREMENT, seller varchar(255) NOT NULL, buyer varchar(255) NOT NULL, itemref varchar(255) NOT NULL, price double NOT NULL, date varchar(255) NOT NULL, quantitiy int NOT NULL, type varchar(255) NOT NULL, PRIMARY KEY (id) ); INSERT INTO `open_auctions` (`id`, `open_auction_id`, `initial`, `reserve`, `aktuell`, `privacy`, `itemref`, `seller`, `quantity`, `type`, `start`, `ende`) VALUES (1, 'open_auction0', 210.62, 1540.75, 263.12, 'No', 'item0', 'person11', 1, 'Regular', '02/27/1998', '03/09/1999'), (2, 'open_auction1', 69.64, 398.65, 168.64, '', 'item2', 'person10', 1, 'Featured', '06/14/1998', '02/27/1999'), (3, 'open_auction2', 13.9, 0, 16.9, 'No', 'item3', 'person11', 1, 'Featured', '07/16/2000', '10/22/2000'), (4, 'open_auction3', 17.12, 0, 179.12, '', 'item5', 'person13', 1, 'Featured', '02/01/2001', '07/22/1999'), (5, 'open_auction4', 38.21, 116.91, 219.71, 'No', 'item7', 'person11', 4, 'Regular, Dutch', '08/05/2000', '01/09/1999'), (6, 'open_auction5', 75.95, 174.84, 116.45, 'No', 'item9', 'person7', 1, 'Featured', '01/27/2001', '10/08/1999'), (7, 'open_auction6', 67.27, 0, 77.77, 'Yes', 'item10', 'person14', 1, 'Featured', '12/15/2001', '07/13/1999'), (8, 'open_auction7', 35.53, 133.36, 73.03, 'Yes', 'item12', 'person16', 1, 'Regular', '04/06/2001', '04/11/2000'), (9, 'open_auction8', 92.54, 0, 101.54, '', 'item13', 'person12', 1, 'Regular', '10/20/1998', '02/04/2001'), (10, 'open_auction9', 9.88, 0, 137.38, '', 'item14', 'person10', 1, 'Featured', '06/16/1998', '12/05/2000'), (11, 'open_auction10', 86.28, 0, 239.28, 'Yes', 'item16', 'person8', 1, 'Featured', '06/26/2000', '02/04/1998'), (12, 'open_auction11', 4.12, 24.53, 38.62, '', 'item17', 'person12', 1, 'Regular', '11/03/1999', '03/02/2000'); CREATE TABLE bidder ( id int NOT NULL AUTO_INCREMENT, open_auction_id varchar(255) NOT NULL, date varchar(255) NOT NULL, time varchar(255) NOT NULL, personref varchar(255) NOT NULL, increase double NOT NULL, PRIMARY KEY (id) ); -- -- Daten für Tabelle `bidder` -- INSERT INTO `bidder` (`id`, `open_auction_id`, `date`, `time`, `personref`, `increase`) VALUES (1, 'open_auction0', '06/13/2001', '13:16:15', 'person0', 18), (2, 'open_auction0', '09/18/2000', '11:29:44', 'person23', 12), (3, 'open_auction0', '01/07/1998', '10:23:59', 'person14', 18), (4, 'open_auction0', '07/10/2001', '14:00:39', 'person16', 4.5), (5, 'open_auction1', '11/12/1998', '11:23:38', 'person20', 4.5), (6, 'open_auction1', '10/02/2000', '22:48:00', 'person4', 15), (7, 'open_auction1', '12/04/1998', '22:29:38', 'person23', 1.5), (8, 'open_auction1', '06/22/1999', '12:43:47', 'person19', 15), (9, 'open_auction1', '12/02/2001', '13:38:51', 'person15', 45), (10, 'open_auction1', '11/12/2001', '04:50:27', 'person9', 6), (11, 'open_auction1', '05/21/2001', '08:02:16', 'person5', 12), (12, 'open_auction2', '12/04/2000', '14:03:16', 'person5', 3), (13, 'open_auction3', '09/03/2000', '22:45:30', 'person8', 10.5), (14, 'open_auction3', '08/18/1998', '17:13:40', 'person22', 25.5), (15, 'open_auction3', '06/05/1998', '11:57:56', 'person19', 16.5), (16, 'open_auction3', '09/20/1999', '00:39:18', 'person5', 46.5), (17, 'open_auction3', '10/03/2001', '01:08:59', 'person23', 58.5), (18, 'open_auction3', '02/17/2001', '07:13:32', 'person20', 4.5), (19, 'open_auction4', '10/19/1998', '09:00:31', 'person7', 33), (20, 'open_auction4', '03/11/2001', '01:59:02', 'person8', 9), (21, 'open_auction4', '04/16/2001', '23:37:09', 'person8', 6), (22, 'open_auction4', '03/06/1999', '12:19:57', 'person5', 4.5), (23, 'open_auction4', '02/01/2000', '09:37:51', 'person21', 18), (24, 'open_auction4', '01/09/1999', '19:31:44', 'person1', 31.5), (25, 'open_auction4', '11/11/2001', '05:24:08', 'person16', 27), (26, 'open_auction4', '11/19/1998', '16:16:17', 'person10', 7.5), (27, 'open_auction4', '04/05/1999', '00:37:15', 'person17', 7.5), (28, 'open_auction4', '09/14/1999', '12:00:43', 'person12', 37.5), (29, 'open_auction5', '07/07/2000', '08:53:00', 'person15', 6), (30, 'open_auction5', '08/06/2001', '10:16:15', 'person13', 4.5), (31, 'open_auction5', '08/23/1999', '08:26:06', 'person17', 30), (32, 'open_auction6', '01/23/2000', '17:14:42', 'person1', 10.5), (33, 'open_auction7', '10/14/1999', '14:39:18', 'person16', 27), (34, 'open_auction7', '05/19/1999', '23:51:16', 'person14', 9), (35, 'open_auction7', '03/27/1999', '19:14:39', 'person23', 1.5), (36, 'open_auction8', '04/26/2001', '00:41:04', 'person12', 9), (37, 'open_auction9', '04/03/1999', '19:09:46', 'person22', 18), (38, 'open_auction9', '01/21/1999', '08:14:44', 'person19', 19.5), (39, 'open_auction9', '11/24/1999', '02:12:12', 'person11', 12), (40, 'open_auction9', '01/07/2001', '05:33:55', 'person7', 9), (41, 'open_auction9', '07/28/2000', '00:57:52', 'person16', 16.5), (42, 'open_auction9', '01/28/2000', '20:24:02', 'person23', 1.5), (43, 'open_auction9', '05/13/2001', '02:45:46', 'person13', 1.5), (44, 'open_auction9', '12/06/2000', '15:18:07', 'person21', 24), (45, 'open_auction9', '08/16/1998', '09:27:27', 'person14', 3), (46, 'open_auction9', '06/18/2001', '19:57:53', 'person7', 3), (47, 'open_auction9', '12/13/2001', '09:01:23', 'person2', 12), (48, 'open_auction9', '03/18/2001', '08:59:02', 'person13', 7.5), (49, 'open_auction10', '08/14/1998', '16:33:46', 'person23', 33), (50, 'open_auction10', '03/24/1998', '11:45:48', 'person3', 1.5), (51, 'open_auction10', '10/08/1998', '06:20:35', 'person1', 45), (52, 'open_auction10', '01/12/1998', '21:43:02', 'person3', 15), (53, 'open_auction10', '03/02/2001', '20:20:33', 'person0', 9), (54, 'open_auction10', '03/01/2000', '10:08:07', 'person23', 10.5), (55, 'open_auction10', '07/19/2001', '00:50:29', 'person6', 9), (56, 'open_auction10', '10/04/2001', '00:58:25', 'person4', 3), (57, 'open_auction10', '11/27/1998', '00:15:23', 'person21', 27), (58, 'open_auction11', '05/16/1998', '15:08:01', 'person1', 15), (59, 'open_auction11', '05/08/2000', '06:44:20', 'person3', 4.5), (60, 'open_auction11', '10/22/2001', '15:34:49', 'person4', 15); ________________________________ Avitech GmbH Principal Office: Bahnhofplatz 1 | 88045 Friedrichshafen | Germany Court Registration: Amtsgericht Ulm | HRB 728293 Geschäftsführer/Managing Director: Antonio Maria Gonzalez Gorostiza VAT No.: DE223719716 http://avitech.aero

3 3