- users-list - monetdb.org

MonetDB-.Net
by Mitchell Weggemans 11 Feb '21

11 Feb '21

Hey, MonetDB.Net is an entirely community driven project. Therefore, I cannot 100% guarantee it is production ready. I made some effort into testing it however, and it worked fine. If you encounter any problems, please feel free to post them here or on StackOverflow, or even to propose changes over on the GitHub repo. Regards, Mitchell.

4 4

MonetDB-.Net
by imad hajj chahine 09 Feb '21

09 Feb '21

Hi, I am currently using Windows Monetdb ODBC driver to connect from .Net to a running monetdb server. Recently I found the github repo https://github.com/MonetDB/MonetDB-.Net and do some initial testing and it's far better in error reporting and support connection pooling. How mature is this .Net connector and is it recommended for usage in production environments and replace the ODBC driver? Is it the official connector for .Net and backed by the Monetdb team? Many thanks.

1 0

ODBC driver Error on Windows
by imad hajj chahine 08 Feb '21

08 Feb '21

Hi, After upgrading to the Oct 2020-SP2 (11.39.11) version the ODBC driver started to throw the following exception: ERROR [IM003] Specified driver could not be loaded due to system error 126: The specified module could not be found. (MonetDB ODBC Driver, C:\Program Files\MonetDB\MonetDB ODBC Driver\lib\MonetODBC.dll) Rolling back the driver to the version june 2020-SP1(11.37.11.01) the driver is working fine. Previously some driver releases missed the 2 libraries "libeay32.dll" and "ssleay32.dll", and adding them to the ODBC driver installation folder solved the problem, but not this time. Is there any missing dlls in the installation or its a more complicated issue. Thanks. Regards

2 3

forward=redirect file descriptor leak
by Karl Seguin 28 Jan '21

28 Jan '21

It appears that when configured with forward=redirect, there's a leak for every connection. I've reproduced using the two latest releases: ./monetdbd create ./farm ./monetdbd set forward=redirect ./farm ./monetdbd set listenaddr=127.0.0.1 ./farm ./monetdbd start ./farm ./monetdb create test ./monetdb release test lsof -p $(pidof monetdbd) | wc -l 40 ./mclient -d test -s "select 1" lsof -p $(pidof monetdbd) | wc -l 41 ./mclient -d test -s "select 1" lsof -p $(pidof monetdbd) | wc -l 42 ./mclient -d test -s "select 1" lsof -p $(pidof monetdbd) | wc -l 43 Karl

2 1

Announcement: New Oct2020-SP2 Bugfix release of MonetDB suite
by Sjoerd Mullender 25 Jan '21

25 Jan '21

The MonetDB team at MonetDB BV is pleased to announce the Oct2020-SP2 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <https://www.monetdb.org/>. For details on this release, please see the release notes at <https://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <https://www.monetdb.org/downloads/>. Oct2020-SP2 Bugfix Release (11.39.11) SQL Frontend * CREATE [OR REPLACE] TRIGGER schema_name.trigger_name is now disallowed, because the trigger will be stored on the same schema as the table it refers to. Use a schema-qualified on the table reference (ie ON clause) when necessary. Bug Fixes * 6862: mserver5: crashes under update_table() when calling lib_sql.so ( max_clients = 2048) * 7002: monetdb stop fails * 7012: mclient enters an infinite loop when a file on the command line does not exist * 7013: Select * on grouped view: wrong error "cannot use non GROUP BY column 'a1' in query results without an aggregate function" * 7017: mal seems to leak in functions * 7020: release an older savepoint causes "BATproject2: does not match always" * 7021: savepoints crash mserver5 * 7022: transaction with an unreleased savepoint not properly persisted * 7023: CREATE VIEW: SELECT: cannot use non GROUP BY column '%1' in query results without an aggregate function * 7024: DELETE FROM or TRUNCATE on freshly created table leads to loosing all further inserts in same transaction * 7030: DROP TABLE with AUTO_INCREMENT doesn't drop sequence causing left-over dependency * 7034: User with sysadmin role cannot create another user * 7035: UPDATE and SELECT column privileges * 3772: Any user can grant a role.

1 0

Re: MonetDB-PHP Error on parameterized query with timestamp
by Kevork Vartanian 09 Dec '20

09 Dec '20

Thank you Ying and everyone involved. Regards, Kevork Vartanian ________________________________ From: users-list <users-list-bounces+kev=innotta.com.au(a)monetdb.org> on behalf of users-list-request(a)monetdb.org <users-list-request(a)monetdb.org> Sent: Thursday, 10 December 2020 1:56 AM To: users-list(a)monetdb.org <users-list(a)monetdb.org> Subject: users-list Digest, Vol 100, Issue 5 Send users-list mailing list submissions to users-list(a)monetdb.org To subscribe or unsubscribe via the World Wide Web, visit https://www.monetdb.org/mailman/listinfo/users-list or, via email, send a message with subject or body 'help' to users-list-request(a)monetdb.org You can reach the person managing the list at users-list-owner(a)monetdb.org When replying, please edit your Subject line so it is more specific than "Re: Contents of users-list digest..." Today's Topics: 1. Re: MonetDB-PHP Error on parameterized query with timestamp (Ying Zhang) ---------------------------------------------------------------------- Message: 1 Date: Wed, 9 Dec 2020 15:56:28 +0100 From: Ying Zhang <Y.Zhang(a)cwi.nl> To: Communication channel for MonetDB users <users-list(a)monetdb.org> Subject: Re: MonetDB-PHP Error on parameterized query with timestamp Message-ID: <6F309253-9D88-4E52-B079-2F2CBDCF1B81(a)cwi.nl> Content-Type: text/plain; charset="us-ascii" FYI, this error has really been resolved. Deployed a fix under version 1.1.3., for more info see Stack Overflow: - https://stackoverflow.com/questions/65077831/monetdb-php-error-on-parameter… <https://stackoverflow.com/questions/65077831/monetdb-php-error-on-parameter…> Updated the user doc: - https://github.com/MonetDB/MonetDB-PHP#example-3-parameterized-query-with-p… <https://github.com/MonetDB/MonetDB-PHP#example-3-parameterized-query-with-p…> And the protocol doc: - https://github.com/MonetDB/MonetDB-PHP/blob/master/protocol_doc/README.md#7… <https://github.com/MonetDB/MonetDB-PHP/blob/master/protocol_doc/README.md#7…> > On 8 Dec 2020, at 10:45, Ying Zhang <Y.Zhang(a)cwi.nl> wrote: > > Hai Kevork, > > Our MonetDB/PHP expert has answered this question in Stack Overflow: > > https://stackoverflow.com/questions/65077831/monetdb-php-error-on-parameter… <https://stackoverflow.com/questions/65077831/monetdb-php-error-on-parameter…> > > For users on this list, this is the Stack Overflow answer: > > the problem is that the "birth_date" field is not of a "date-time" type, but it's "date" only. So just remove "12:37:16" and it will work. The "char" type is converted to "date" by MonetDB itself, "date" doesn't have a specific literal in the SQL language. This works, I tested: > > $result = $connection->Query(<<<EOF > select > * > from > "cats" > where > "name" = ? > and "weight_kg" > ? > and "birth_date" < ? > limit > 10 > EOF > , [ "D'artagnan", 5.3, "2020-02-28" ]); > > Regards, > Jennie > >> On 7 Dec 2020, at 04:23, Kevork Vartanian <kev(a)innotta.com.au <mailto:kev@innotta.com.au>> wrote: >> >> Hi Sjoerd, >> >> Thank you for getting back to me. >> >> My colleague tested what you suggested and got the same error so it is still failing. He is certain he is passing the correct value as he is able to execute the same query in raw format, so he believed it has to do with the way params are implemented. I'm no expert but he said it looks like an error from C language. >> >> Please advise. >> >> Thank you. >> >> Regards, >> >> Kevork Vartanian >> >> From: users-list <users-list-bounces+kev=innotta.com.au(a)monetdb.org <mailto:users-list-bounces+kev=innotta.com.au@monetdb.org>> on behalf of users-list-request(a)monetdb.org <mailto:users-list-request@monetdb.org> <users-list-request(a)monetdb.org <mailto:users-list-request@monetdb.org>> >> Sent: Friday, 4 December 2020 10:00 PM >> To: users-list(a)monetdb.org <mailto:users-list@monetdb.org> <users-list(a)monetdb.org <mailto:users-list@monetdb.org>> >> Subject: users-list Digest, Vol 100, Issue 2 >> >> Send users-list mailing list submissions to >> users-list(a)monetdb.org <mailto:users-list@monetdb.org> >> >> To subscribe or unsubscribe via the World Wide Web, visit >> https://www.monetdb.org/mailman/listinfo/users-list <https://www.monetdb.org/mailman/listinfo/users-list> >> or, via email, send a message with subject or body 'help' to >> users-list-request(a)monetdb.org <mailto:users-list-request@monetdb.org> >> >> You can reach the person managing the list at >> users-list-owner(a)monetdb.org <mailto:users-list-owner@monetdb.org> >> >> When replying, please edit your Subject line so it is more specific >> than "Re: Contents of users-list digest..." >> >> >> Today's Topics: >> >> 1. MonetDB-PHP Error on parameterized query with timestamp >> (Kevork Vartanian) >> 2. Re: MonetDB-PHP Error on parameterized query with timestamp >> (Sjoerd Mullender) >> >> >> ---------------------------------------------------------------------- >> >> Message: 1 >> Date: Fri, 4 Dec 2020 00:11:59 +0000 >> From: "Kevork Vartanian" <kev(a)innotta.com.au <mailto:kev@innotta.com.au>> >> To: "users-list(a)monetdb.org <mailto:users-list@monetdb.org>" <users-list(a)monetdb.org <mailto:users-list@monetdb.org>> >> Subject: MonetDB-PHP Error on parameterized query with timestamp >> Message-ID: >> <SYBP282MB0346DC1924EC1C610E29428B81F10(a)SYBP282MB0346.AUSP282.PROD.OUTLOOK.COM <mailto:SYBP282MB0346DC1924EC1C610E29428B81F10@SYBP282MB0346.AUSP282.PROD.OUTLOOK.COM>> >> >> Content-Type: text/plain; charset="iso-8859-1" >> >> Hi, >> >> The below is from my colleague who is not a member on this list, so I'm sending on his behalf. >> >> I'm using MonetDB with MonetDB-PHP library. >> >> >> I have followed the documentation from: https://github.com/MonetDB/MonetDB-PHP <https://github.com/MonetDB/MonetDB-PHP> >> >> >> Everything is working fine, but if I set parameter for timestamp type column I get the following error: >> >> Error from MonetDB: 42000!Wrong type for argument 1 of function call: char, expected timestamp >> >> For example, this is working: >> >> $result = $connection->Query(' >> select >> * >> from >> "cats" >> where >> "name" = ? >> and "weight_kg" > ? >> limit >> 10', [ "D'artagnan", 5.3 ]); >> >> but this will not work: >> >> $result = $connection->Query(' >> select >> * >> from >> "cats" >> where >> "name" = ? >> and "weight_kg" > ? >> and "birthdate" < ? // timestamp data type >> limit >> 10 >> ', [ "D'artagnan", 5.3, "2020-02-28 12:37:16" ]); >> >> >> The error occurs for any column that is of timestamp type and only when passing value as parameter. >> >> >> What am I doing wrong? >> >> Thank you. >> >> >> Regards, >> >> Kevork Vartanian >> >> This email correspondence may contain privileged information and it is intended to be transmitted to the addressee abovementioned. If you are not the intended recipient of this email correspondence, you must not distribute, copy, forward or rely upon its contents. We ask that you notify the sender of this error and immediately delete this email correspondence. >>

1 0

Re: MonetDB-PHP Error on parameterized query with timestamp
by Kevork Vartanian 09 Dec '20

09 Dec '20

Hi Sjoerd, Thank you for getting back to me. My colleague tested what you suggested and got the same error so it is still failing. He is certain he is passing the correct value as he is able to execute the same query in raw format, so he believed it has to do with the way params are implemented. I'm no expert but he said it looks like an error from C language. Please advise. Thank you. Regards, Kevork Vartanian ________________________________ From: users-list <users-list-bounces+kev=innotta.com.au(a)monetdb.org> on behalf of users-list-request(a)monetdb.org <users-list-request(a)monetdb.org> Sent: Friday, 4 December 2020 10:00 PM To: users-list(a)monetdb.org <users-list(a)monetdb.org> Subject: users-list Digest, Vol 100, Issue 2 Send users-list mailing list submissions to users-list(a)monetdb.org To subscribe or unsubscribe via the World Wide Web, visit https://www.monetdb.org/mailman/listinfo/users-list or, via email, send a message with subject or body 'help' to users-list-request(a)monetdb.org You can reach the person managing the list at users-list-owner(a)monetdb.org When replying, please edit your Subject line so it is more specific than "Re: Contents of users-list digest..." Today's Topics: 1. MonetDB-PHP Error on parameterized query with timestamp (Kevork Vartanian) 2. Re: MonetDB-PHP Error on parameterized query with timestamp (Sjoerd Mullender) ---------------------------------------------------------------------- Message: 1 Date: Fri, 4 Dec 2020 00:11:59 +0000 From: "Kevork Vartanian" <kev(a)innotta.com.au> To: "users-list(a)monetdb.org" <users-list(a)monetdb.org> Subject: MonetDB-PHP Error on parameterized query with timestamp Message-ID: <SYBP282MB0346DC1924EC1C610E29428B81F10(a)SYBP282MB0346.AUSP282.PROD.OUTLOOK.COM> Content-Type: text/plain; charset="iso-8859-1" Hi, The below is from my colleague who is not a member on this list, so I'm sending on his behalf. I'm using MonetDB with MonetDB-PHP library. I have followed the documentation from: https://github.com/MonetDB/MonetDB-PHP Everything is working fine, but if I set parameter for timestamp type column I get the following error: Error from MonetDB: 42000!Wrong type for argument 1 of function call: char, expected timestamp For example, this is working: $result = $connection->Query(' select * from "cats" where "name" = ? and "weight_kg" > ? limit 10', [ "D'artagnan", 5.3 ]); but this will not work: $result = $connection->Query(' select * from "cats" where "name" = ? and "weight_kg" > ? and "birthdate" < ? // timestamp data type limit 10 ', [ "D'artagnan", 5.3, "2020-02-28 12:37:16" ]); The error occurs for any column that is of timestamp type and only when passing value as parameter. What am I doing wrong? Thank you. Regards, Kevork Vartanian This email correspondence may contain privileged information and it is intended to be transmitted to the addressee abovementioned. If you are not the intended recipient of this email correspondence, you must not distribute, copy, forward or rely upon its contents. We ask that you notify the sender of this error and immediately delete this email correspondence.

2 2

MonetDB-PHP Error on parameterized query with timestamp
by Kevork Vartanian 04 Dec '20

04 Dec '20

Hi, The below is from my colleague who is not a member on this list, so I'm sending on his behalf. I'm using MonetDB with MonetDB-PHP library. I have followed the documentation from: https://github.com/MonetDB/MonetDB-PHP Everything is working fine, but if I set parameter for timestamp type column I get the following error: Error from MonetDB: 42000!Wrong type for argument 1 of function call: char, expected timestamp For example, this is working: $result = $connection->Query(' select * from "cats" where "name" = ? and "weight_kg" > ? limit 10', [ "D'artagnan", 5.3 ]); but this will not work: $result = $connection->Query(' select * from "cats" where "name" = ? and "weight_kg" > ? and "birthdate" < ? // timestamp data type limit 10 ', [ "D'artagnan", 5.3, "2020-02-28 12:37:16" ]); The error occurs for any column that is of timestamp type and only when passing value as parameter. What am I doing wrong? Thank you. Regards, Kevork Vartanian This email correspondence may contain privileged information and it is intended to be transmitted to the addressee abovementioned. If you are not the intended recipient of this email correspondence, you must not distribute, copy, forward or rely upon its contents. We ask that you notify the sender of this error and immediately delete this email correspondence.

2 1

MonetDB bug tracker has moved to github
by Sjoerd Mullender 01 Dec '20

01 Dec '20

The MonetDB bug tracker has been moved from our self-hosted bugzilla instance to github issues. All bug IDs have remained the same in the transition, making referencing bugs easier. The new bug tracker can be found at https://github.com/MonetDB/MonetDB/issues Don't forget to follow this tracker (if you're interested in doing that) or follow individual bugs. Due to the way we had to do the move, the old stars that you may have given to the MonetDB github repo have been lost, so please, star it again (or for the first time) if you feel so inclined. The old bugzilla tracker will remain on-line for the time being but entry of new bugs has been turned off. Shortcuts to bugs are forwarded to github. (Shortcuts are URLs in the form of https://www.monetdb.org/bugzilla/<bugid> and https://bugs.monetdb.org/<bugid>.) -- Sjoerd Mullender

1 0

MonetDB bug tracker is going to move
by Sjoerd Mullender 29 Nov '20

29 Nov '20

LS, The MonetDB team wishes to announce the end of our reliance on Bugzilla for bug tracking and enhancement requests. Instead, we switch over to the MonetDB Github issues repo (https://github.com/monetdb/monetdb) which is an hourly based mirror of the Mercurial repository managed at the development group. The move will take place on Friday, November 27, 2020. The actual transfer of the Bugzilla archive into the Github Issues may take a number of hours. A redirect will be in place to send people from Bugzilla towards the MonetDB GitHub repository instead. -- Sjoerd Mullender

1 1

Announcement: New Oct2020-SP1 Bugfix release of MonetDB suite
by Sjoerd Mullender 24 Nov '20

24 Nov '20

The MonetDB team at MonetDB BV is pleased to announce the Oct2020-SP1 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <https://www.monetdb.org/>. For details on this release, please see the release notes at <https://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <https://www.monetdb.org/downloads/>. Oct 2020-SP1 bugfix release (11.39.7) Bug Fixes * 6890: Add support of xz/lzma (de)compression on MS Windows * 6891: Add support of lz4 (de)compression on MS Windows * 6971: Parsing table returning function on remote server fails * 6981: Oct2020: PREPARE DDL statement silently fails * 6983: monetdb allows to use non-existing optimizer pipe * 6998: MAL profiler buffer limitations * 7001: crossproduct generated for a simple (semi-)join * 7003: Segfault on large chain of constant decimal multiplication * 7005: Dropping a STREAM TABLE does not remove the associated column info from sys._columns * 7010: deallocate <id> results in all prepared statements being deallocated (not error-related) * 7011: uuid() called only once when used in projection list

1 0

Martin Kersten appointed Knight in the Royal Order of the Netherlands Lion and thanks for your support
by Ying Zhang 20 Nov '20

20 Nov '20

Dear list, Please allow me to proudly share with you the news that Martin Kersten, the founding father of MonetDB, has just been appointed Knight in the Royal Order of the Netherlands Lion [1] as a recognition for his 45+ years contribution to the research, innovation, education and development of database management systems, the results of which have been reflected in MonetDB. However, Martin and the MonetDB team have always been keenly aware that all achievements of Martin&MonetDB wouldn't have been possible without group efforts. So, taking this opportunity, the MonetDB team would like to thank all MonetDB users and contributors through the years for your support! Now, more than ever, the MonetDB team is motivated and determined to make MonetDB even better with every check-in 😀 Best regards, Jennie (a 15+ years MonetDB member and counting :)) [1] https://www.royal-house.nl/topics/decorations-and-honours/personal-decorati…

1 0

Need help using SQuirrel or another Windows SQL client
by marc＠scifinsys.com 19 Nov '20

19 Nov '20

Hi all -- Hopefully someone in this group can help me. :-) I am new to MonetDB and am having a problem setting up the connection for an SQL client. Part of me is wondering if the problem is related to using the latest version of MonetDB (Oct 2020) with this MonetDB JDBC driver (monetdb-jdbc-2.29.jre7.jar). I randomly chose SQuirrel on Windows and am open to alternatives. The connection I am trying to make is to MonetDB on Linux. I followed the instructions carefully at: https://www.monetdb.org/Documentation/ClientInterfaces/SQuirreL 1. From Linux, here is my connection. I have no problems logging in on the host using mclient. marc@HPZ620A: ip address inet 10.102.96.66/24 brd 10.102.96.255 scope global dynamic noprefixroute eno1 marc@HPZ620A:~/tmp/mydbfarm$ mclient -u monetdb -d voc password: Welcome to mclient, the MonetDB/SQL interactive terminal (Oct2020) Database: MonetDB v11.39.5 (Oct2020), 'mapi:monetdb://HPZ620A:50001/voc' sql> 2. Still on Linix, here is the Server Running. marc@HPZ620A: ps -auxw | grep 50001 marc 21727 0.2 0.2 2640864 92616 ? Ssl Nov13 2:50 /usr/bin/mserver5 --dbpath=/home/marc/tmp/mydbfarm/voc --set merovingian_uri mapi:monetdb://HPZ620A:50001/voc --set mapi_listenaddr none --set mapi_usock /home/marc/tmp/mydbfarm/voc/.mapi.sock --set monet_vault_key /home/marc/tmp/mydbfarm/voc/.vaultkey --set gdk_nr_threads 32 --set max_clients 64 --set sql_optimizer default_pipe 3. From Windows, I can ping that server. C:\Users\Admin>ping 10.102.96.66 Pinging 10.102.96.66 with 32 bytes of data: Reply from 10.102.96.66: bytes=32 time=59ms TTL=63 Reply from 10.102.96.66: bytes=32 time=55ms TTL=63 Reply from 10.102.96.66: bytes=32 time=58ms TTL=63 Reply from 10.102.96.66: bytes=32 time=58ms TTL=63 Ping statistics for 10.102.96.66: Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), Approximate round trip times in milli-seconds: Minimum = 55ms, Maximum = 59ms, Average = 57ms 4. The Squirrel Setup. Note that I did download the jar file from MonetDB, per the instructions. 5. And finally.. The error message when I try to connect! Any suggestions on how I could solve this issue with SQuirrel or another Windows SQL client would be greatly appreciated. Thanks!! --- Marc

4 8

sub-second epoch precision
by Karl Seguin 17 Nov '20

17 Nov '20

I couldn't find a nice way to turn a timestamp into a sub-second epoch value. What I came up with was: sys.epoch(t) * 1000000 + cast((("second"(t) - floor("second"(t)))) * 1000000 as int) Most functions seem to treat seconds as the lowest unit, e.g. extract(seconds...) and time_to_str Is there a better option that I'm missing? Thanks, Karl

1 0

changes with temporal types
by Roberto Cornacchia 03 Nov '20

03 Nov '20

Hi team, I like the Oct2020 release very much. It has some discontinuities with past releases, and that's ok. One that I find a bit too painful though is the stricter time and interval typing. Not that I am against it, it is now more SQL compliant. But perhaps the transition could have been a bit softer. It boils down to date arithmetics between temporal and numeric types. Something like this was allowed before: 1 + (date1 - date2) (integer + interval) As the release notes say, a new function epoch_ms() has been added to help the transition. This function can turn dates and intervals into the number (int) of milliseconds since 1970-01-01 00:00:00 UTC. So if one really needs such arithmetics, could do something like 1 + epoch_ms(date1 - date2) The problem with this is that this function was not available in earlier releases. This makes the migration of existing applications very hard, because there is no combination that works in all cases: Deployed application Old MonetDB New MonetDB int + interval works fails int + cast(interval as int) works fails int + epoch_ms(interval) fails works As you see, there is no overlap between the solutions that worked with MonetDB < Oct2020 and those that work with MonetDB Oct2020. I wonder, would it have been such a bad idea to make the transition as it was done, but leave the ability to cast an interval to a number? At least for a couple of releases? We are now facing the issue that if we want to roll forward to MonetDB Oct2020, at the same time we need to make sure to redeploy our code to be compatible with it. There is so much that could go wrong with this! It's scary. I've nothing against breaking backward compatibility, but honestly I don't see the urgency in removing that cast, it would have helped a lot. Roberto Cornacchia +31 (0) 6 27 232 270 www.spinque.com

3 3

Github mirror
by Roberto Cornacchia 26 Oct '20

26 Oct '20

Hello, I was wondering, is the syncing of the github repository mirror not scheduled? I see that the latest commit on master is from today, but the latest commit on Oct2020 branch is from 14 days ago.

2 2

Announcement: New Oct2020 Feature release of MonetDB suite
by Sjoerd Mullender 19 Oct '20

19 Oct '20

The MonetDB team at MonetDB BV is pleased to announce the Oct2020 feature release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <https://www.monetdb.org/>. For details on this release, please see the release notes at <https://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <https://www.monetdb.org/downloads/>. Oct 2020 feature release (11.39.5) MonetDB5 Server * The settings for specifying how mserver5 should listen to "The Internet" have been overhauled. See the manual for details. In brief, mapi_autosense, mapi_ipv6 and mapi_open are gone. If mapi_listenaddr equals "localhost" or "all", we listen to both IPv4 and IPv6 (if available), if "127.0.0.1" or "0.0.0.0", we listen to IPv4 only, if "::1" or "::" we listen to IPv6 only. The first of each pair is loopback interface only, the second is all interfaces. If mapi_listenaddr is "none", then no IP port is opened, you need to use a UNIX domain socket. If mapi_port is 0, we let the operating system choose a free port (like mapi_autosense). Default behavior has not changed. Whole System * Finished a first version of the new monitoring function user_statistics(), which is only intended for the DBAs. For each database user who has logged in during the current mserver5 session, it returns "username": login name of the database user, "querycount": the number of queries this user has executed since his/her first login, "totalticks": the total execution time (in microsecond) of the queries ran by this user, "maxquery": the query with the longest execution time (if two queries have the same execution time, the newer overwrites the older), "maxticks": the execution time of the 'maxquery' (in microsecond), "started": the start timestamp of the 'maxquery', "finished": the finish timestamp of the 'maxquery'. * Removed support for LiDAR data, that is the SQL procedures sys.lidarattach, sys.lidarload, and sys.lidarexport. * The sys.queue() has been turned into a circular buffer to allow for inspection of both active, paused and recently executed queries. Client Package * mclient and msqldump now also look in $XDG_CONFIG_HOME for the monetdb configuration file. SQL Frontend * Extended the system monitor with a table-returning function user_statistics() which keeps some statistics for each SQL user, e.g. the user's query count, total time spent, and maximal query seen. * Removed '@' syntax used to refer into a variable in a query. It was a non-standard method, which was replaced by a schema addition to variables. Variables in the global scope now have schema. All default global variables are set under schema "sys". However variables inside PSM don't have a schema, because there are no transaction semantics inside PSM at the moment. * Removed declared variables and tables from the global scope. They were transaction agnostic and incompatible with the SQL standard, i.e. they are valid exclusively under PSM (e.g. functions, procedures and triggers). * Scoping semantics were added for both variables and tables. Variables with the same name at a query are now resolved under the following precedence rules: 1. Tables, Views and CTEs at the FROM clause. 2. Variable declared in the body of function/procedure, i.e. local variable. 3. Function/procedure parameter. 4. Variable from the global scope. Tables with the same name now have the following precedence rules at a SQL query: 1. Table declared in the body of function/procedure, ie local table. 2. Temporary table. 3. Table from the current session schema. This means the query: SELECT * FROM "keys"; will list keys from temporary tables instead of persisted ones, because "keys" table is available for both "sys" and "tmp" schemas. * The table returning function "var" was extended with more details about globally declared variables, namely their schema, type and current value. * Removed obsolete sys.getContent(url) function. * Removed obsolete json.output(json) function. * Removed compatibility between interval types and other numeric types in favor for a more strict SQL standard compliance. This means operations between temporal types and other numeric types such as INT and DECIMAL are no longer possible, instead use interval types. e.g. SELECT date '2020-01-01' + 1; now gives the error. Instead do: SELECT date '2020-01-01' + interval '1' day; if 1 was meant to be a day interval. Setting an interval variable such as the session's current timezone with a number e.g. SET current_timezone = 1; is no longer possible. Instead do SET current_timezone = interval '1' hour; Casting between interval and other numeric types is no longer possible as well, because they are not compatible. * Because of incompatibilities this change may create, if a user intends to convert a numeric value to an interval, the multiplication function can be used in the form: <numeric value> * interval '1' <interval length> e.g. 10 * interval '1' second = interval '10' second. As for the other way around, the 'EPOCH' option was added to the extract syntax. This option returns the number of milliseconds since the UNIX epoch 1970-01-01 00:00:00 UTC for date, timestamp and time values (it can be negative). Meanwhile, for day and second intervals, it returns the total number of milliseconds in the interval. As a side note, the 'EPOCH' option is not available for month intervals, because this conversion is not transparent for this type. * Made general logarithm function log(x,base) compliant with the SQL standard, by swapping the input parameters. Instead of log(x,base), now is log(base,x). Bug Fixes * 3553: All schema access to ubiquitous functions * 3815: Incorrect results when expression contains implicit float/integer conversions * 6415: Date arithmetic types are inconsistent * 6814: provide native implementations for scalar functions sys.degrees(rad) and sys.radians(deg) * 6843: function sys.getcontent(url) always returns "Feature not supported" * 6857: remove not implemented aggregate function json.output(js json) * 6870: Missing bulk operators * 6878: SQL Connection Error when running SELECT queries containing AND command * 6910: SQLancer query: 'bat.append' undefined * 6930: SQLancer crash on join with coalesce * 6931: Allow EDITOR to be used for the current command in mclient * 6935: Wrong result when dividing interval by literal float * 6937: Lost the microsecond precisions * 6938: Segmentation fault in MalOptimizer * 6939: Error in optimizer multiplex when selecting profiler.getlimit() or wlc.clock() or wlc.tick() or wlr.clock() or wlr.tick() * 6941: SELECT queries on remote table fail when using LIKE in WHERE conditions * 6943: JSON parser is too permissive * 6948: msqldump with Empty BLOBs cannot be imported * 6949: Loosing timing precision * 6950: redundant/replicated code line in gdk/gdk_hash.c * 6951: Use a different naming scheme for MAL blocks * 6954: FILTER functions no longer find their implementation * 6955: ROUND(DECIMAL, PRECISION) gives incorrect result with non-scalar precision parameter * 6960: implementation of log(arg1,arg2) function is not compliant with the SQL standard, arguments are switched * 6962: "SELECT * FROM ids LIMIT 1" produces: exp_bin: !ERROR: Could not find %173.id * 6964: Table returning function: Cannot access column descriptor * 6965: Crash when using distinct on the result of a table returning function * 6974: Oct2020-branch cannot attach and load FITS files * 6976: Oct2020: default dbfarm cannot be started * 6978: Oct2020: \d shows empty result in schema created by include sql script * 6979: timestamp add integer * 6980: Oct2020: wrong mel definition for str.epilogue

1 0

Thread safety in python UDFs
by Ioannis Foufoulas 01 Oct '20

01 Oct '20

Hi, One question on python udfs. What about thread safety? In case of concurrent execution of numpy UDFs should the UDF developer use thread-safe structures or Monetdb handles this in some way? For example, pandas is not thread safe. This means that it should not be used in a UDF? Best, Yannis

2 1

Building MonetDBe from source
by Avik Sengupta 24 Sep '20

24 Sep '20

Hi, I've been trying to build MoneDBe from source, using Github master. I do not want to build the full executables, so I have used cmake --build . --target monetdbe With this, I am able to successfully build libmonetdbe.so. So that is great. However there does not seem to be an install-monetdbe or similar target. Running the `install` target tries to compile the whole application, which is not what I want. How do I copy the compiled artifacts (libmonetdbe.so and dependencies) to my install prefix? I'm trying not to have to manually copy the libraries. Regards - Avik

1 0

.mal and .sql files in Oct2020 lib folder
by Roberto Cornacchia 24 Sep '20

24 Sep '20

Hi there, I'm trying to compile from the Oct2020 branch and I have a question about the /lib64/monetdb5 folder. This folder used to contain .mal files. It also contained an autoload/ subfolder and a createdb/ subfolder (with .sql files). I don't see the same in the Oct2020 installation. I see that the content of /sql/scripts/CMakeLists.txt is entirely commented out. Is the installation of all these files temporarily disabled during development, or is this handled differently now? Roberto

4 4

Re: Internals of intermediate results in MonetDB
by Guodong Jin 24 Sep '20

24 Sep '20

Thanks! The point to MAL plan really helps me out! Best, Guodong On Sep 21, 2020, 06:00 -0400, users-list-request(a)monetdb.org, wrote: > Send users-list mailing list submissions to > users-list(a)monetdb.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://www.monetdb.org/mailman/listinfo/users-list > or, via email, send a message with subject or body 'help' to > users-list-request(a)monetdb.org > > You can reach the person managing the list at > users-list-owner(a)monetdb.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of users-list digest..." > > > Today's Topics: > > 1. Internals of intermediate results in MonetDB (Guodong Jin) > 2. Re: Internals of intermediate results in MonetDB (Martin Kersten) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Sun, 20 Sep 2020 23:31:50 -0400 > From: Guodong Jin <guod.jin(a)gmail.com> > To: users-list(a)monetdb.org > Subject: Internals of intermediate results in MonetDB > Message-ID: <932d01d5-a742-4f57-8e19-ba7599667e42@Spark> > Content-Type: text/plain; charset="utf-8" > > Hi all, > > Thanks for your hard works on this great open source project. > I?m a student newly working on MonetDB to implement some research ideas, and I want to understand internals of how MonetDB chooses to materialize and how it represents intermediate results. > As I understand, table data and intermediate results in MonetDB are all stored as BATs, but I?m not sure if there are some special optimizations on BATs, rather than just array(s) of atoms. Here are two simple examples to elaborate my questions a little bit: > > ?? ?1.Given two tables,?Items(id, order, price, tax), and?Orders(id, discount). > ?? ? ? ? ?Items > ?? ? ? ? ? ? ? ? ?[I1, I2, I3, I4, I5, I6, I7, I8, I9, I10, I11...] > ?? ? ? ? ? ? ? ? ?[O3, O3, O3, O3, O3, O3, O3, O3, O3, O3, O4...] > ?? ? ? ? ? ? ? ? ?[10, 11, 20, 15, 110, 80, 90, 12, 13, 88, 30...] > ?? ? ? ? ? ? ? ? ?[0.1, 0.15, 0, 0.1, 0.1, 0.15, 0.11, 0.18, 0.10, 0.15, 0.20, ...] > ?? ? ? ? ?Orders > ?? ? ? ? ? ? ? ? ?[O1, O2, O3] > ?? ? ? ? ? ? ? ? ?[0.8, 0.9, 0.95] > > ?? ? ? ? ?When we perform a join between these two tables on the field `order` (one-to-many relationship represented by the primary-foreign key, O3 matches with [I1, I2, ?, I10]),?in the output intermediate BATs of the join, will MonetDB duplicate `O3` 10 times? Are there any optimizations currently in MonetDB to remove/reduce the duplication? > > ?? ?2. Given a table?item(id, price, tax), when MonetDB performs the filter `price<10` on the table,?will MonetDB actually copy all matched tuples into intermediate BATs? Or just keep a list of OIDs of matched tuples as references? > > Thanks! > > Best, > Guodong >

1 0

Internals of intermediate results in MonetDB
by Guodong Jin 21 Sep '20

21 Sep '20

Hi all, Thanks for your hard works on this great open source project. I’m a student newly working on MonetDB to implement some research ideas, and I want to understand internals of how MonetDB chooses to materialize and how it represents intermediate results. As I understand, table data and intermediate results in MonetDB are all stored as BATs, but I’m not sure if there are some special optimizations on BATs, rather than just array(s) of atoms. Here are two simple examples to elaborate my questions a little bit: 1.Given two tables, Items(id, order, price, tax), and Orders(id, discount). Items [I1, I2, I3, I4, I5, I6, I7, I8, I9, I10, I11...] [O3, O3, O3, O3, O3, O3, O3, O3, O3, O3, O4...] [10, 11, 20, 15, 110, 80, 90, 12, 13, 88, 30...] [0.1, 0.15, 0, 0.1, 0.1, 0.15, 0.11, 0.18, 0.10, 0.15, 0.20, ...] Orders [O1, O2, O3] [0.8, 0.9, 0.95] When we perform a join between these two tables on the field `order` (one-to-many relationship represented by the primary-foreign key, O3 matches with [I1, I2, …, I10]), in the output intermediate BATs of the join, will MonetDB duplicate `O3` 10 times? Are there any optimizations currently in MonetDB to remove/reduce the duplication? 2. Given a table item(id, price, tax), when MonetDB performs the filter `price<10` on the table, will MonetDB actually copy all matched tuples into intermediate BATs? Or just keep a list of OIDs of matched tuples as references? Thanks! Best, Guodong

2 1

Merge table error with one table
by Ioannis Foufoulas 17 Sep '20

17 Sep '20

Hi, we encounter an error when only one table is added to a merge table definition During a query like "select * from merge table” we get: “Table: missing ')'" Probably merge tables cannot contain just one table but the returned error looks like a syntax error. Some more info to reproduce: the table that has been added to the merge table is a remote table. Best, Yannis

3 4

Recommended compiler version and flags for Linux x86_64
by Daniel Glöckner 15 Sep '20

15 Sep '20

Hi, I'm currently building and testing MonetDB on CentOS7, x86_64. I was wondering about the recommended compiler version and compiler flags. So far I'm using gcc 9 and specifically enabled SSE3 extensions (though I did not notice any performance gain). Here's my cmake command cmake3 -DCMAKE_C_FLAGS="pthread -msse3 -O -Wall" -DCMAKE_INSTALL_PREFIX=../install ../MonetDB Is there a list of recommended compiler flags? Kind regards, Daniel

4 4

Nested tables?
by louie＠gmx.cn 14 Sep '20

14 Sep '20

Hi, Does MonetDB support nested tables? Oracle diagram for reference: https://docs.oracle.com/cd/B10501_01/appdev.920/a96594/adobjdes.htm#441615 Thanks, Louie

2 1