- developers-list - monetdb.org

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/testing Mtest.py.in, , 1.307, 1.308
by Sjoerd Mullender 18 Sep '07

18 Sep '07

Please revert and update your clients. The -o option for mclient is gone. Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/testing > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv20410 > > Modified Files: > Mtest.py.in > Log Message: > mclient -lx -oxml -fxml > > produces very oddly escaped and pre-abled results (correct/bug?) > in any case, such output is not what the testweb expects > > therefore: removing -fxml > > > > Index: Mtest.py.in > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/testing/Mtest.py.in,v > retrieving revision 1.307 > retrieving revision 1.308 > diff -u -d -r1.307 -r1.308 > --- Mtest.py.in 14 Sep 2007 16:09:12 -0000 1.307 > +++ Mtest.py.in 17 Sep 2007 23:12:34 -0000 1.308 > @@ -2700,7 +2700,7 @@ > dft['MALCLIENT'] = "'mclient -lmal'" > dft['SQLCLIENT'] = "'mclient -lsql'" > dft['SQLDUMP'] = "'msqldump'" > - dft['XQUERYCLIENT'] = "'mclient -lxquery -fxml'" > + dft['XQUERYCLIENT'] = "'mclient -lxquery -oxml'" > dft['X100CLIENT'] = "'x100run_mapi'" > > #par = {} > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/benchmarks/MBench/Tests qj01.timeout, , 1.1, 1.2
by Stefan Manegold 18 Sep '07

18 Sep '07

Peter, just for info: This test/query used to run in 20-50 secs (depending on the platform). Now is seems to take at least 104 secs even on our fastest platforms. See also grep -w qj01 /ufs/monet/Testing/Current/pathfinder/.CheckLists/Mtest10..2007.0[89].*.time Stefan On Mon, Sep 17, 2007 at 09:24:23PM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/pathfinder/benchmarks/MBench/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv20637 > > Modified Files: > qj01.timeout > Log Message: > > > Index: qj01.timeout > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/benchmarks/MBench/Tests/qj01.timeout,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- qj01.timeout 13 May 2007 09:43:08 -0000 1.1 > +++ qj01.timeout 17 Sep 2007 21:24:20 -0000 1.2 > @@ -1 +1 @@ > -2 > +4 > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] SQL temporary table not working?
by Agustin Schapira 14 Sep '07

14 Sep '07

Hi, I am having problems with SQL TEMPORARY TABLES: even when I insert rows into them, they remain empty. See for example: monetdb-> create local temporary table d (id int); Operation successful monetdb-> insert into d values(1); 1 affected row monetdb-> select * from d; +--------+ | id | +========+ +--------+ 0 rows If I create a TEMPORARY TABLE from a SELECT ... WITH DATA statement, it gets the correct structure but no data. Also, if I later insert rows into the temporary table, it still remains empty. Here's a sample session that demonstrates the problem: monetdb-> create table a (id int); Operation successful monetdb-> insert into a values(1); 1 affected row monetdb-> select * from a; +--------+ | id | +========+ | 1 | +--------+ 1 row monetdb-> create temporary table b as select * from a with data; Operation successful monetdb-> select * from b; +--------+ | id | +========+ +--------+ 0 rows monetdb-> insert into b values(5); 1 affected row monetdb-> select * from b; +--------+ | id | +========+ +--------+ 0 rows monetdb-> insert into b select * from a; 1 affected row monetdb-> select * from b; +--------+ | id | +========+ +--------+ 0 rows This happens with the latest release, compiled yesterday with the -- nightly='stable' switch: # MonetDB Server v5.0.1 # Copyright (c) 1993-2007 CWI, all rights reserved # Compiled for i686-apple-darwin8.10.1/32bit with 32bit OIDs dynamically linked Database: MonetDB 1.18.3 Driver: MonetDB Native Driver 1.6 (Steadfast/MCL-1.0 20070913) auto commit mode: on By the way, this used to work with MonetDB Server v5.0.0_beta1_2 (although the WITH DATA option didn't load the data: I had to create the structure and then INSERT into the table to get the rows). Any ideas? Am I doing something wrong? Are TEMPORARY TABLES not supposed to be used like this? Thanks for your help, -- Agustin

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB4/src/mapi/Tests manyMapiClients.MIL.py, , 1.2, 1.3
by Fabian Groffen 14 Sep '07

14 Sep '07

On 13-09-2007 23:09:33 +0000, Stefan Manegold wrote: > Update of /cvsroot/monetdb/MonetDB4/src/mapi/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv1511/MonetDB4/src/mapi/Tests > > Modified Files: > manyMapiClients.MIL.py > Log Message: > > clean-up: > do not play any tricks to find where Mapi.py is installed; > rather assume that it is in Python's default search path, > or that `monetdb-clients-config --pythonlibdir` is in PYTHONPATH > +# assume module MonetDB is in Python's default search path, > +# or `monetdb-clients-config --pythonlibdir` is in PYTHONPATH > from MonetDB import Mapi Alternatively, maybe you can do something like try: from MonetDB import Mapi except ImportError: sys.path.insert(0, "autoconf-path-to-mapi") from MonetDB import Mapi ? Of course using the correct python commands for this so it works.

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/src/sqlhelpers/xmlshred xmlshred.c, , 1.19, 1.20
by Sjoerd Mullender 13 Sep '07

13 Sep '07

Manuel Mayr wrote: > Update of /cvsroot/monetdb/pathfinder/src/sqlhelpers/xmlshred > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv12897/src/sqlhelpers/xmlshred > > Modified Files: > xmlshred.c > Log Message: > > > -- snprintf "bug" > -- fn:number implemented > > > Index: xmlshred.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/src/sqlhelpers/xmlshred/xmlshred.c,v > retrieving revision 1.19 > retrieving revision 1.20 > diff -u -d -r1.19 -r1.20 > --- xmlshred.c 13 Sep 2007 11:46:08 -0000 1.19 > +++ xmlshred.c 13 Sep 2007 13:40:21 -0000 1.20 > @@ -281,8 +281,10 @@ > guideout = SHopen_write (guideoutfile); > } > > + > + char outfile[FILENAME_MAX]; > snprintf (status.outfile, FILENAME_MAX, "%s.csv", status.outfile); Shouldn't you chante status.outfile to outfile here? > - shout = SHopen_write (status.outfile); > + shout = SHopen_write (outfile); > } > else > shout = stdout; > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/src/sqlhelpers/xmlshred/include shred_helper.h, , 1.9, 1.10
by Manuel Mayr 13 Sep '07

13 Sep '07

Thanks a lot. Best regards, Manuel Stefan Manegold wrote: > Update of /cvsroot/monetdb/pathfinder/src/sqlhelpers/xmlshred/include > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv32155/src/sqlhelpers/xmlshred/include > > Modified Files: > shred_helper.h > Log Message: > > for the sake of compatibility and portability: > > To ensure that all C files equally benefit from what configure finds out > we need to make pf_config.h the *first* include in each C file > (either explicitly, or implicitly via some other common header file; > since the xmlshredded C files do not seem to share a single common > header file, we go for the explicit solution). > > > Index: shred_helper.h > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/src/sqlhelpers/xmlshred/include/shred_helper.h,v > retrieving revision 1.9 > retrieving revision 1.10 > diff -u -d -r1.9 -r1.10 > --- shred_helper.h 12 Sep 2007 20:07:36 -0000 1.9 > +++ shred_helper.h 12 Sep 2007 20:12:37 -0000 1.10 > @@ -28,7 +28,6 @@ > #ifndef SHRED_HELPER_H__ > #define SHRED_HELPER_H__ > > -#include "pf_config.h" > #include <unistd.h> > #include <stdlib.h> > #include <stdio.h> > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Microsoft > Defy all challenges. Microsoft(R) Visual Studio 2005. > http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- Manuel Mayr, Dipl. Inf. Institut fuer Informatik, TU Muenchen Tel.: +49 89 289-17259

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/semantics heuristic.c
by Jan Rittinger 12 Sep '07

12 Sep '07

Hi Peter, I have two small comments to your changes: 1. Is there a reason for including monet_utils.h here? -- In my eyes it introduces an unnecessary dependency to MonetDB (as we want the SQL code generation to compile even without MonetDB). Index: milprint_summer.c =================================================================== RCS file: /cvsroot/monetdb/pathfinder/compiler/mil/milprint_summer.c,v retrieving revision 1.404 retrieving revision 1.405 diff -u -d -r1.404 -r1.405 --- milprint_summer.c 5 Sep 2007 17:06:54 -0000 1.404 +++ milprint_summer.c 11 Sep 2007 22:15:29 -0000 1.405 @@ -56,6 +56,7 @@ #define USE_DEPRECATED_ACCESS_TO_TYPE_SYSTEM 1 #include "pathfinder.h" +#include "monet_utils.h" #include <stdio.h> #include <assert.h> 2. I think you should use "#pf" (PFns_pf) as prefix for variables names instead of "pf" (PFns_lib). Namespace PFns_lib can be used in the query which allows a user to create pf:heur* variables that might conflict lateron (whereas PFns_pf can only be created inside pathfinder). --- NEW FILE: heuristic.c --- ... static PFpnode_t* var_(PFloc_t loc, int varnum) { PFpnode_t *r = p_leaf(p_varref, loc); if (r) { r->sem.qname_raw.prefix = "pf"; r->sem.qname_raw.loc = (char*) PFmalloc(8); if (r->sem.qname_raw.loc) snprintf(r->sem.qname_raw.loc, 8, "heur%03d", varnum); } return r; } On 09/12/2007 12:15 AM, Peter Boncz wrote with possible deletions: > Update of /cvsroot/monetdb/pathfinder/compiler/semantics > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv24884/compiler/semantics > > Modified Files: > Makefile.ag xquery_fo.c > Added Files: > heuristic.c > Log Message: > The infamous push-selections-down heuristic rewrite > =================================================== > > the good: equi comparisons on attributes, texts and elements in MXQ can now > be done in sublinear time thanks to indices. This involves the > "reversing"of multi-step XPath paths if required. > > the bad: it is a heuristic so no performance improvement assured, though much > of the performance pitfalls are mitigated by a loop-lifted run-time > decision whether to use the index plan or the original plan. > > the ugly: well, since I can't (or couldn't) stomach XQuery core plan, it is all > implemeted on the absssyn level. > > there are quite a few comments/explanations in compiler/semantics/heuristic.c > > runtime/pathfinder.mx > - major changes to the indexing scheme, supporting the pf:text/pf:attribute functions > - added run-time behavior to vx_lookup: for those iterations where index lookup is > not beneficial, it returns a bogus node (1@0, recognizable as a docnode) so > the original (non index-pushdown) plan is used for those iterations > > runtime/pf_support.mx > - new xquery hash function, with less collisions and the ability to preserve equality > semantics for any XQuery type (currently supported..). > - added a new dbl(byte1,...byte8) constructor that allows a IEEE double to be > constructed from its 8 binary bytes (per byte to avoid little/big endian issues) > without any precision loss. > - optimization for the ll_htordered_thetajoin in case we have constant join columns > > compiler/compile.c > compiler/include/Makefile.ag > compiler/semantics/Makefile.ag > - add heuristic.[ch] > - added heuristic index pushdown opt (currently only in mps, but alg/M4 should follow) > > compiler/semantics/xquery_fo.c > compiler/mil/milprint_summer.c > - rewrote pf:atttribute and pf:text to give approximate answers > - new pf:supernode function > - pass parsed decimals/doubles using the new byte-wise MIL dbl() constructor > (to avoid precision loss in the pf -> MonetDB transition) > - bugfix in empty ipik opt for the for-rule > > compiler/debug/abssynprint.c > - PFabssyn_stdout for debugging sanity > compiler/debug/prettyp.c > - margin=6 for better debug output readability > -- Jan Rittinger Database Systems Technische Universität München (Germany) http://www-db.in.tum.de/~rittinge/

2 1

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/mapiclient MapiClient.mx, , 1.86, 1.87
by Fabian Groffen 12 Sep '07

12 Sep '07

On 11-09-2007 15:51:28 +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/clients/src/mapiclient > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv2455/src/mapiclient > > Modified Files: > MapiClient.mx > Log Message: > Coalesced mclient's -o and -f options into a single -f (output format) > option. > > The -o option was used to specify output formatting for XQuery, > whereas -f was used to specify output formatting for the other > languages. Now the same option is used for both (similar) functions. > > This also frees up -o for a future, possible -o output file option. Is there a chance the two could be switched? -f traditionally is in use for [f]ile. JdbcClient also happens to have implemented the -f flag like that.

2 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_client.mx, , 1.157, 1.158
by Martin Kersten 12 Sep '07

12 Sep '07

Niels Nes wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv15887 > > Modified Files: > mal_client.mx > Log Message: > dirty fix for block mode (from end of block find new line, shift all > characters up to new line add EOS and increment length of read data UGH > possible problem new line in string) Not dirty. They should be escaped to be acceptable in MAL. The new line terminates the instruction.

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/testing Makefile.ag, , 1.20, 1.21 Mtest.py.in, , 1.300, 1.301
by Stefan Manegold 11 Sep '07

11 Sep '07

On Tue, Sep 11, 2007 at 11:11:49AM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB/src/testing > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv17756/src/testing > > Modified Files: > Makefile.ag Mtest.py.in > Log Message: > Put Python files in their own Python module MonetDB. > In the RPMs, put Python files in the Python hierarchy. > Created a new RPM MonetDB-python which contains monet_options.py and other such files. > Added merovingian man page to RPM. > Fixed MonetDB5 spec file. > Removed Python ODBC interface: it was not directly related to MonetDB. These changes requires to set PYTHONPATH="MONETDB_PREFIX/`python -c 'import distutils.sysconfig; print distutils.sysconfig.get_python_lib(0,0,"")'`" before calling Mtest.py, unless MONETDB_PREFIX is /usr . Should we consider making Mtest.py search automatically for modules in the above path (as it IMHO did before), or shall we just document the above requirement? Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 3