- developers-list - monetdb.org

[Monetdb-developers] PhD opening at CWI - Adaptive indexing techniques for modern database systems
by Stratos Idreos 23 Jun '11

23 Jun '11

Subject: Adaptive indexing techniques for modern database systems. The Centrum Wiskunde & Informatica (CWI) has a full time vacancy for a talented PhD candidate in the Database Architectures group (http://www.cwi.nl/en/research-groups/Database-Architectures) The position is in the broad area of adaptive indexing techniques for modern database systems. Adaptive indexing is a major challenge in database research; it tries to completely alleviate the need for indexing and tuning steps leading to database systems that require no physical design set-up and can cope immediately with any workload. This leads to database systems that are instantly usable and thus more applicable to numerous new applications that now consider databases too slow, too complex and too old. This position will focus specifically on adaptive indexing for extremely large databases where traditional indexing represents a major bottleneck. The Database Architectures group is one of the world-wide leading groups in system-oriented database research, e.g., it received the 10-year best paper award at VLDB 2009 for their pioneering research on hardware-aware database technology and the column-store model and the 2011 ACM SIGMOD Jim Gray Dissertation award for the database cracking work. The group has a unique methodology that combines fundamental database research with active participation of all group members in database engineering, centred around the open-source analytical database system MonetDB (http://www.monetdb.org/) An internship at one of the partnering database research labs world-wide is considered part of the PhD track. REQUIREMENTS The PhD candidates must have a master degree in computer science (or a 5 year diploma), (specialisation databases, distributed systems, software engineering) mathematics, or related fields. Preferable qualifications for candidates include proven research talent, system programming skills (C/C++), practical experience with using and implementing database systems, and software development in a team. Candidates are expected to have an excellent command of English, and good academic writing and presentation skills. CENTRUM WISKUNDE & INFORMATICA (CWI) Founded in 1946, the Centrum Wiskunde & Informatica (CWI) is the national research institute for mathematics and computer science in the Netherlands. It is located at the Science Park Amsterdam and is part of the “Netherlands Organisation for Scientific Research” (NWO). The institute is internationally focused and renowned for its high quality research, a substantial fraction of which is carried out in the framework of (inter)national programs. Over 160 researchers conduct pioneering research and share their acquired knowledge with society. More than 30 researchers are employed as professors at universities. The institute has generated twenty-one spin-off companies. CWI maintains excellent relations with industry and the academic world, both in the Netherlands as well as abroad. After their research careers at CWI, an increasing number of young staff members find employment in these sectors or in spin-off companies that are based on research results from CWI. Of course, library and computing facilities are first-rate. CWI's non-scientific services to its personnel include career planning, training and courses, assistance in finding housing, and tailor-made solutions to problems that may occasionally arise. TERMS AND CONDITIONS The terms of employment are in accordance with the Dutch Collective Labour Agreement for Research Institutes ("CAO-onderzoeksinstellingen"). Moreover CWI offers attractive working conditions, including flexible scheduling and help with housing for expat employees. The gross monthly salary, for an employee on a full time basis, is €2,037 during the first year and increases to €2,610 over a four year period. CWI also offers excellent and flexible terms of employment, including an employee pension fund. INFORMATION Additional information can be obtained from: dr. Stratos Idreos, email stratos.idreos(a)cwi.nl, telephone +31(0)20 592 4169. or dr. Stefan Manegold, email stefan.manegold(a)cwi.nl, telephone +31(0)20 592 4212, or prof. dr. Martin Kersten, email martin.kersten(a)cwi.nl, telephone +31(0)20 592 4066. APPLICATION Please send your application before 31 July 2011 to: pd(a)cwi.nl. Applications should include a detailed CV, a motivation letter, a list of your M.SC. courses and grades, a copy of your master thesis, and preferably a list of publications.

1 0

[Monetdb-developers] PhD position at CWI Database Architecture group
by Stefan Manegold 14 Jun '11

14 Jun '11

CWI is an internationally renowned research institute in mathematics and computer science, located in Amsterdam, The Netherlands. The focus is on fundamental research problems, inspired by societal needs. Research is carried out in 18 research groups and a substantial fraction is carried out in the framework of (inter)national programs. VACANCY CWI has a vacancy for a talented PhD candidate in the DB Architectures group (http://www.cwi.nl/en/research-groups/Database-Architectures) DISTRIBUTED DATABASE ARCHITECTURES FOR SCIENCE APPLICATIONS The Database Architectures group is one of the world-wide leading groups in system-oriented database research, e.g., it received the 10-year best paper award at VLDB 2009 for their pioneering research on hardware-aware database technology and the column-store model. The group has a unique methodology that combines fundamental database research with active participation of all group members in database engineering, centered around the open-source analytical database system MonetDB (http://www.monetdb.org/) You will be expected to write both papers and contribute to this code base. The focus of the group is on hard core data management and for this position specifically on database architectures to support large scale scientific applications in the context of the SciLens project (http://www.scilens.org) The goal is to leverage the potential power of a 330 node dedicated database machine to improve science in, e.g., astronomy and seismology. (http://www.scilens.org/content/platform) CWI maintains excellent relations with industry and the academic world, both in the Netherlands as well as abroad. An internship at one of the partnering database research labs world-wide is considered part of the PhD track. After their research careers at CWI, many staff members find employment in these sectors or in spin-off companies based on research results from CWI. Of course, library and computing facilities are first-class. CWI's non-scientific services to its personnel include career planning, training and courses, assistance in finding housing, and tailor-made solutions to problems that may occasionally arise. REQUIREMENTS The PhD candidates must have a master degree in computer science, (specialization distributed systems, database, software engineering) mathematics, or related fields. Preferable qualifications for candidates include proven research talent, system programming skills (C/C++), practical experience with database systems, and software development in a team. One should bring good academic writing and presentation skills. Candidates are expected to have an excellent command of English. TERMS AND CONDITIONS The terms of employment are in accordance with the Dutch "CAO-onderzoeksinstellingen". Moreover, CWI offers attractive working conditions, including flexibility and help with housing for foreigners. The gross monthly salary (on a full time basis) will be â¬ 2,037 during the first year and will reach â¬ 2,610 during the fourth year. INFORMATION Additional information can be obtained from prof.dr. Martin Kersten, email martin.kersten(a)cwi.nl, telephone +31(0)20 592 4066, or dr. Stefan Manegold, email stefan.manegold(a)cwi.nl, telephone +31(0)20 592 4212. -- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |

1 0

[Monetdb-developers] Basics about MonetDB
by 叶亮 01 Jun '11

01 Jun '11

Hi, I'm a new comer with some questions about basic conceptions of MonetDB. 1. The executor I've ever found the executor of postgreSQL at src\backend\executor, but cannot make sure where it is like that in MonetDB src. MonetDB\MonetDB\src\gdk or MonetDB5-server\MonetDB5\src\mal ? 3. MAL MAL (MonetDB Assembly Language) is a script tool only for MonetDB or a common script language that can be applied to other softwares. Why it is a must in MonetDB ? 4. .mx files In MonetDB, .mx files are compiled to make .h and .c files generated.(in this way ?) Why is this routines ? (not just coding in .h and .c files directly) Yel ---- Best Regards richardroky(a)gmail.com

8 10

[Monetdb-developers] Announcement: New Apr2011-SP1 bugfix release
by Fabian Groffen 31 May '11

31 May '11

The MonetDB team at CWI/MonetDB BV is pleased to announce the Apr2011-SP1 bugfix release of the MonetDB suite of programs. At the time of this release, we also officially changed to our new website at http://www.monetdb.org/. This new website is our central source of information, and comes with our new logo and style. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>.

1 0

[Monetdb-developers] Django adapter for MonetDB 11.3.1
by Marco Quartulli 30 May '11

30 May '11

Dear all, an adapter to the Django web development framework for MonetDB 11.3.1 is available at https://github.com/marcoq/monetdb-python The code is functional and already running an experimental image retrieval site, yet full tests will need to be passed in order to consider inclusion in the Django tree as a proper backend. A merger into the source tree at https://github.com/vikram/monetdb-python has been requested. Marco

2 1

[Monetdb-developers] Qualifying and fixing issues found by the test suite
by Gregory Burd 12 May '11

12 May '11

Hello all, I'm new to MonetDB, but I'm not new to databases or coding. I've been building the Apr2011 branch on my home system, a Fedora release 14 (Laughlin) (8x Intel(R) Xeon(R) CPU X3440 @ 2.53GHz, Memory 8187MB) using clang (clang version 2.8 (branches/release_28) Target: x86_64-redhat-linux-gnu Thread model: posix) and having great success - I am thrilled to be able to work with such an amazing piece of software that has such an elegant and well thought out engineering design and structured methodology (nice work!). Everything builds and runs as expected. However when I run "make check" there are a number of things that catch my eye and I want to know from the experts how you'd like me to help with resolving these potential issues. First, here's how I'm building things: export JAVA_HOME=/usr/java/jdk1.5.0_22 export PATH=${JAVA_HOME}/bin:$PATH export CC=clang ./configure --enable-testing --enable-developer --enable-debug --enable-assert --enable-instrument --enable-merocontrol --enable-strict --enable-warning --enable-dependency-tracking --enable-bits=64 --enable-jdbc --enable-odbc make -k --load-average=90 --jobs=`cat /proc/cpuinfo | grep processor | wc -l` && make check Failures include "major differences" found in the following: tst830.mal in mal vacuum.mal in modules/kernel attach00.mal in modules/mal common.mal in optimizer perl_dbi.MAL.sh in perl/dbi The attach differences I'm seeing don't seem (at first glance) to match those of http://bugs.monetdb.org/show_bug.cgi?id=2751 My general question is, should I report these as bugs? What kind of information from the test run would you like me to add to the bug record? How would I find out if these are already reported (I've tried a few searches already)? I'm happy to dig in and start working on these issues, contributing patches where/when I can. I hope to follow whatever established patterns there are for developing/fixing MonetDB. Also, I see a lot of output like "(attach00.test.err.FILTERED) significantly" and "(pithole.test.out.FILTERED) significantly" what does this mean? Are there tests being skipped? Is there some issue/error that's being filtered out (removing noise so as to better see the signal)? Is there a way to say, run all the tests including those that are expected to fail? Another, semi on-topic, question. I happen to use emacs, has anyone taken the time to write up a .mx mode so that it's a bit easier to develop against the .mx source files? Any debugging hints/tips/tricks hidden on the web anywhere? best, -greg

1 0

[Monetdb-developers] JDBC 4 effort
by Christophe Galerne 01 May '11

01 May '11

Hi, Is there an effort to make the JDBC driver JDBC 4 compliant ? If this is the case, is there a way to participate ? Cdlt, Christophe

2 1

[Monetdb-developers] Announcement: New Apr2011 feature release of MonetDB suite
by Sjoerd Mullender 28 Apr '11

28 Apr '11

The MonetDB team at CWI/MonetDB BV is pleased to announce the Apr2011 feature release of the MonetDB suite of programs. As announced one month ago to the day (March 28, 2011), this release marks the start of a new era: development of MonetDB4 and MonetDB/XQuery has ceased. Development of the Pathfinder compiler continues unabated at the University of Tübingen [1], but there is no longer a link being maintained with MonetDB. For details on this release, please see the release notes at <http://monetdb.cwi.nl/Development/Releases/Apr2011/>. [1] http://www.pathfinder-xquery.org/ -- Sjoerd Mullender

1 0

[Monetdb-developers] Announcement: New Mar2011 feature release of MonetDB suite
by Sjoerd Mullender 28 Mar '11

28 Mar '11

The MonetDB team at CWI/MonetDB BV is pleased to announce the Mar2011 feature release of the MonetDB suite of programs. This release marks the last planned release of MonetDB4 and Pathfinder, and hence the last planned release of MonetDB/XQuery. Development of the Pathfinder compiler continues at the University of Tübingen. The next release, currently planned for April 2011, should be a smooth upgrade from this release, even if MonetDB/XQuery is installed (which will of course then not be upgraded). This release also marks the first release of the new way of building the MonetDB suite. For details on both these issues, and on the other features and bug fixes of this release, please see the release notes at <http://monetdb.cwi.nl/Development/Releases/Mar2011/>. As usual, the download location is <http://dev.monetdb.org/downloads/>. -- Sjoerd Mullender

1 0

[Monetdb-developers] snappy library for BAT compression?
by Roberto Cornacchia 25 Mar '11

25 Mar '11

>From opt_compression.mx: @f opt_compression @- The compressed database Column stores mostly exploit some form of compression to reduce the footprint on disk and to improve disk/memory/cache bandwidth at the expense of cpu/memory cycles. A naive approach is to take a (*preferrably lightweight*) compression algorithm and deploy it against the units of access, e.g. disk/buffers. In MonetDB our granularity is a BAT, which therefore forms the basis for (de)compressed access. I don't know whether this is still an actively developed idea. If it is, perhaps this can help: http://code.google.com/p/snappy/ Roberto

1 0