I'm sorry for the flood of e-mails. When I add a DISTINCT to the creation clause.. count( distinct case when gear in ( 3 , 4 ) then mpg end )*1 ..then median() and prod() break as well! Here is the EXPLAIN and TRACE output. Sorry, I should've tried this on fake data sooner! Now that I know I can re-create this error with public data, should I file a bug report? Thanks!!!! sql>explain select median( gears ) from mtcars4; +--------------------------------------------------------------------+ | mal | +====================================================================+ | function user.s2_2{autoCommit=true}():void; | | X_17 := nil:lng; | | barrier X_34 := language.dataflow(); | | X_2 := sql.mvc(); | | X_3:bat[:oid,:oid] := sql.tid(X_2,"sys","mtcars4"); | | X_6 := sql.bind(X_2,"sys","mtcars4","gears",0); | | (X_9,r1_9) := sql.bind(X_2,"sys","mtcars4","gears",2); | | X_12 := sql.bind(X_2,"sys","mtcars4","gears",1); | | X_14 := sql.delta(X_6,X_9,r1_9,X_12); | | X_15 := algebra.leftfetchjoin(X_3,X_14); | | X_16 := algebra.selectNotNil(X_15); | | X_17 := aggr.median(X_16); | | exit X_34; | | sql.exportValue(1,"sys.mtcars4","L1","bigint",53,0,6,X_17,""); | | end s2_2; | +--------------------------------------------------------------------+ 15 tuples (2.267ms) sql>explain select prod( gears ) from mtcars4; +--------------------------------------------------------------------+ | mal | +====================================================================+ | function user.s3_2{autoCommit=true}():void; | | X_17:lng := nil:lng; | | barrier X_34 := language.dataflow(); | | X_2 := sql.mvc(); | | X_3:bat[:oid,:oid] := sql.tid(X_2,"sys","mtcars4"); | | X_6 := sql.bind(X_2,"sys","mtcars4","gears",0); | | (X_9,r1_9) := sql.bind(X_2,"sys","mtcars4","gears",2); | | X_12 := sql.bind(X_2,"sys","mtcars4","gears",1); | | X_14 := sql.delta(X_6,X_9,r1_9,X_12); | | X_15 := algebra.leftfetchjoin(X_3,X_14); | | X_16 := algebra.selectNotNil(X_15); | | X_17:lng := aggr.prod(X_16); | | exit X_34; | | sql.exportValue(1,"sys.mtcars4","L1","bigint",53,0,6,X_17,""); | | end s3_2; | +--------------------------------------------------------------------+ 15 tuples (2.173ms) sql>trace select prod( gears ) from mtcars4; +------+ | L1 | +======+ | 0 | +------+ 1 tuple (38.356ms) +------+----------------------------------------------------------------------+ | tick | stmt | : s : : +======+======================================================================+ | 1 | X_17:lng := nil:lng; | | 3 | X_2 := sql.mvc(); | | 15 | X_3:bat[:oid,:oid] =<tmp_1070>[6] := sql.tid(X_2=0,"sys","mtcars4"); | | 16 | X_12=<tmp_33>[0] := sql.bind(X_2=0,"sys","mtcars4","gears",1); | | 15 | (X_9=<tmp_21>[0],r1_9=<tmp_33>[0]) := sql.bind(X_2=0,"sys","mtcars4" | : : ,"gears",2); : | 5 | X_6=<tmp_1237>[6] := sql.bind(X_2=0,"sys","mtcars4","gears",0); | | 4 | X_14=<tmp_1237>[6] := sql.delta(X_6=<tmp_1237>[6],X_9=<tmp_21>[0],r1 | : : _9=<tmp_33>[0],X_12=<tmp_33>[0]); : | 16 | X_15=<tmp_1005>[6] := algebra.leftfetchjoin(X_3=<tmp_1070>:bat[:oid, | : : :oid][6],X_14=<tmp_1237>[6]); : | 5 | X_16=<tmp_1005>[6] := algebra.selectNotNil(X_15=<tmp_1005>[6]); | | 25 | X_17:lng := aggr.prod(X_16=<tmp_1005>[6]); | | 877 | barrier X_34 := language.dataflow(); | | 7 | sql.exportValue(1,"sys.mtcars4","L1","bigint",53,0,6,X_17=0:lng,""); | | 2 | end s3_2; | | 1073 | X_5:void := user.s3_2(); | +------+----------------------------------------------------------------------+ 14 tuples (43.881ms) sql>trace select median( gears ) from mtcars4; +------+ | L1 | +======+ | 3 | +------+ 1 tuple (5.458ms) +------+----------------------------------------------------------------------+ | tick | stmt | : s : : +======+======================================================================+ | 2 | X_17 := nil:lng; | | 5 | X_2 := sql.mvc(); | | 72 | X_3:bat[:oid,:oid] =<tmp_1152>[6] := sql.tid(X_2=0,"sys","mtcars4"); | | 19 | X_12=<tmp_33>[0] := sql.bind(X_2=0,"sys","mtcars4","gears",1); | | 19 | (X_9=<tmp_21>[0],r1_9=<tmp_33>[0]) := sql.bind(X_2=0,"sys","mtcars4" | : : ,"gears",2); : | 10 | X_6=<tmp_1237>[6] := sql.bind(X_2=0,"sys","mtcars4","gears",0); | | 7 | X_14=<tmp_1237>[6] := sql.delta(X_6=<tmp_1237>[6],X_9=<tmp_21>[0],r1 | : : _9=<tmp_33>[0],X_12=<tmp_33>[0]); : | 28 | X_15=<tmp_1235>[6] := algebra.leftfetchjoin(X_3=<tmp_1152>:bat[:oid, | : : :oid][6],X_14=<tmp_1237>[6]); : | 12 | X_16=<tmp_1235>[6] := algebra.selectNotNil(X_15=<tmp_1235>[6]); | | 63 | bn=<tmp_1231>[1] := aggr.submedian(b=<tmp_1235>[6],false); | | 7 | return X_4 := algebra.fetch(bn=<tmp_1231>[1],0); | | 145 | X_17 := aggr.median(X_16=<tmp_1235>[6]); | | 1280 | barrier X_34 := language.dataflow(); | | 11 | sql.exportValue(1,"sys.mtcars4","L1","bigint",53,0,6,X_17=3:lng,""); | | 3 | end s2_2; | | 1614 | X_5:void := user.s2_2(); | +------+----------------------------------------------------------------------+ 16 tuples (16.329ms) sql> On Wed, Apr 24, 2013 at 5:00 PM, Anthony Damico <ajdamico@gmail.com> wrote:
I wrote an R script (for Windows) that created some dummy data and reproduced *three* of the five errors. median and prod still do not work in my confidential data. sign, stddev, and stddev_pop do not work when using the R script pasted below. I created this the same way as before:
create table mtcars2 as select carb , count( case when gear in ( 3 , 4 ) then mpg end ) as gears from mtcars group by carb with data;
The starting data set I used is the `mtcars` data.frame that you can view if you open up R and type `mtcars`.. but I've pasted it below so you can see it's nothing special.
Here's the three EXPLAIN commands (run in mclient).. below that, I've pasted R code to precisely re-create the database as I have it on my computer. :)
When I add a *1 on the end of the count( case when gear in ( 3 , 4 ) then mpg end )*1 clause, I get the same errors..
Thanks!!!!
sql>explain select sign( gears ) from mtcars2; TypeException:user.s1_2[16]:'bat.insert' undefined in: _53:any := bat.insert(_43 :bat[:oid,:int], _51:oid, _50:bte) +-------------------------------------------------------------+ | mal | +=============================================================+ | function user.s1_2{autoCommit=true}():void; | | X_15 := nil:bat[:oid,:wrd]; | | barrier X_36 := language.dataflow(); | | X_2 := sql.mvc(); | | X_3:bat[:oid,:oid] := sql.tid(X_2,"sys","mtcars2"); | | X_6 := sql.bind(X_2,"sys","mtcars2","gears",0); | | (X_9,r1_9) := sql.bind(X_2,"sys","mtcars2","gears",2); | | X_12 := sql.bind(X_2,"sys","mtcars2","gears",1); | | X_14 := sql.delta(X_6,X_9,r1_9,X_12); | | X_15 := algebra.leftfetchjoin(X_3,X_14); | | exit X_36; | | X_41 := bat.reverse(X_15); | | X_43 := bat.new(nil:oid,nil:int); | | barrier (X_47,X_48) := iterator.new(X_15); | | X_50 := calc.sign(X_48); | | X_51 := algebra.fetch(X_41,X_47); | | bat.insert(X_43,X_51,X_50); | | redo (X_47,X_48) := iterator.next(X_15); | | exit (X_47,X_48); | | X_16:bat[:oid,:int] := X_43; | | X_20 := sql.resultSet(1,1,X_16); | | sql.rsColumn(X_20,"sys.","sign_gears","int",32,0,X_16); | | X_25 := io.stdout(); | | sql.exportResult(X_25,X_20); | | end s1_2; | +-------------------------------------------------------------+ 25 tuples (2.451ms) sql>explain select stddev( gears ) from mtcars2;
SELECT: no such unary operator 'stddev(wrd)' sql>explain select stddev_pop( gears ) from mtcars2;
SELECT: no such unary operator 'stddev_pop(wrd)' sql>
============================ R code to reproduce mtcars2 in Windows (shouldn't require much of a modification to get it working on other OSes) ============================
install.packages("MonetDB.R")
require(MonetDB.R) # load the MonetDB.R package (connects r to a monet database)
batfile <- monetdb.server.setup(
# set the path to the directory where the initialization batch file and all data will be stored database.directory = "C:/My Directory/MonetDB" , # must be empty or not exist
# find the main path to the monetdb installation program monetdb.program.path = "C:/Program Files/MonetDB/MonetDB5" ,
# choose a database name dbname = "test" ,
# choose a database port # this port should not conflict with other monetdb databases # on your local computer. two databases with the same port number # cannot be accessed at the same time dbport = 50000 )
dbname <- "test" dbport <- 50000
# run the MonetDB server pid <- monetdb.server.start( batfile )
# connect to the MonetDB server monet.url <- paste0( "monetdb://localhost:" , dbport , "/" , dbname ) db <- dbConnect( MonetDB.R() , monet.url )
# write the example mtcars data.frame to monetdb dbWriteTable( db , 'mtcars' , mtcars )
# create a new table the same way as before dbSendUpdate( db , 'create table mtcars2 as select carb , count( case when gear in ( 3 , 4 ) then mpg end ) as gears from mtcars group by carb with data' )
# this works now, still doesn't work in my confidential data dbGetQuery( db , 'select median( gears ) from mtcars2' ) dbGetQuery( db , 'select prod( gears ) from mtcars2' )
# this *does not* work dbGetQuery( db , 'select sign( gears ) from mtcars2' ) dbGetQuery( db , 'select stddev( gears ) from mtcars2' ) dbGetQuery( db , 'select stddev_pop( gears ) from mtcars2' )
============================ here's the entire mtcars table ============================
mpg cyl disp hp drat wt qsec vs am gear carb Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4 Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4 Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1 Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1 Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2 Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1 Duster 360 14.3 8 360.0 245 3.21 3.570 15.84 0 0 3 4 Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00 1 0 4 2 Merc 230 22.8 4 140.8 95 3.92 3.150 22.90 1 0 4 2 Merc 280 19.2 6 167.6 123 3.92 3.440 18.30 1 0 4 4 Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90 1 0 4 4 Merc 450SE 16.4 8 275.8 180 3.07 4.070 17.40 0 0 3 3 Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60 0 0 3 3 Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00 0 0 3 3 Cadillac Fleetwood 10.4 8 472.0 205 2.93 5.250 17.98 0 0 3 4 Lincoln Continental 10.4 8 460.0 215 3.00 5.424 17.82 0 0 3 4 Chrysler Imperial 14.7 8 440.0 230 3.23 5.345 17.42 0 0 3 4 Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47 1 1 4 1 Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52 1 1 4 2 Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90 1 1 4 1 Toyota Corona 21.5 4 120.1 97 3.70 2.465 20.01 1 0 3 1 Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87 0 0 3 2 AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30 0 0 3 2 Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41 0 0 3 4 Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05 0 0 3 2 Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90 1 1 4 1 Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70 0 1 5 2 Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90 1 1 5 2 Ford Pantera L 15.8 8 351.0 264 4.22 3.170 14.50 0 1 5 4 Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50 0 1 5 6 Maserati Bora 15.0 8 301.0 335 3.54 3.570 14.60 0 1 5 8 Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60 1 1 4 2
On Tue, Apr 23, 2013 at 3:34 PM, Anthony Damico <ajdamico@gmail.com>wrote:
Am I right that this clause is embedded in a SQL statement like
create table ... as select ... <clause> ... from <table> with data; where <table> has columns UNIQUE_ROW_IDENTIFIER and MY_CODE ?
Yes, precisely. :)