- users-list - monetdb.org

[MonetDB-users] protocol violation: unexpected line in data block
by toshiki.shiga＠alsi.co.jp 07 Aug '08

07 Aug '08

Hi, All Please explain this message? "protocol violation: unexpected line in data block: #02 #GDKmemchk (memcur=16870976,memmax=1741950382) (vmcur=1047527424,vmmax=1610612736)" Regards, Shiga

3 5

[MonetDB-users] Update statement to update from other table
by Cronje Fourie 05 Aug '08

05 Aug '08

Hi all... I'm testing MonetDB and evaluating all functionality. One item I've not been able to find much info on is updating table A from table B. ie... UPDATE PERSON SET SALARY = sal.newval FROM PERSON P, SAL_DATA sal WHERE p.id = sal.p_id Or something to that effect :) Is it possible? Thanks Cronje

2 1

[MonetDB-users] Is there a recommended OS for MonetDB?
by McKennirey.Matthew 04 Aug '08

04 Aug '08

2 1

[MonetDB-users] monetdb copy command
by ashokguruswamy 01 Aug '08

01 Aug '08

my seasonal compliments.. this is ashok. i am using monetdb for my application with java. just i need to copy the monetdb table to a csv file.. in an sql manual i read the syntax for copying from table to csvfile is Syntax: COPY <subquery> INTO <file_name> [ [USING] DELIMITERS tuple_separator [’,’ record_separator [ ’,’ string_quote ]]] [ NULL AS null_string ]; Operating System: Windows XP My query: copy select * from table_name into 'D:/file_name.csv' using delimiters '|'; but if i execute this, am facing the following problem.. any suggestion? asap... Error: Syntax error, unexpected SELECT, expecting INTO in: “copy select”.. Also the query specified below which having --with null as 'null_String"-- is not working.. copy select * from table_name into 'D:/file_name.csv' using delimiters '|' with null as ' '; I want a way to copy monetdb tables to csv files.. -- View this message in context: http://www.nabble.com/monetdb-copy-command-tp18752294p18752294.html Sent from the monetdb-users mailing list archive at Nabble.com.

4 4

Re: [MonetDB-users] [Questions] Shredding 1GB XML File and Query Performance
by John 31 Jul '08

31 Jul '08

Thank you for your response! > Were you able to see any (error-) message in the server window? I could not see any message in the server window as it was directly closed. > On you 64-bit hardware, are you running 64-bit or 32-bit windows? > If 64-bit, did you install the 64-bit or 32-bit MonetDB/XQuery? I am using 32-bit windows. > The serialized size ("1 GB") does not say much about the actual complexity > of the XML document, e.g., how many nodes, attributes, etc. does the > document contain? > Do you know these statistics, or could you share your document with us for > testing? I tested using XBench DCSD. The total numbers of nodes and attributes were almost 22-23 millions and 1.5 millions, respectively. Thanks! John

1 0

[MonetDB-users] constant bulk inserts to monetdb
by uriel katz 30 Jul '08

30 Jul '08

i have a application where i have constant bulk inserts(about 50000 rows of 1Kbyte each) every 1 minute,i am wondering which is the fastest and most efficient way to insert data. i am using now the COPY command but it is kind of awkward since i need to dump my data as csv and then execute COPY to insert it,is there any streaming method or a special api for bulk inserts? also when i issue a copy command it uses a little bit of cpu aroud 2%(it is a quad core setup with windows so i guess this means 8% of one cpu) and keep loading and releasing memory(i have 8GB of ram) even that it doesn`t get near 2GB. is this ok,what it is actually doing? P.S.: are insert/selects multi threaded? thanks for this awsome peace of software! -Uriel

4 3

[MonetDB-users] constant bulk inserts to monetdb
by uriel katz 30 Jul '08

30 Jul '08

>>>> >>>> ok,but why it don`t utilize one core to the max,it seem to keep using 8% >>>> of >>>> the core and takes about 17 seconds to insert 200,000 record of 1Kb each >>>> (the actual file is 64MB). >>>> >>>> >>> >>> That depends on the total setup. Especially, when you are exceeding >>> memory then Linux >>> is not the best operating system. One of the issues is that dirty pages >>> are not properly flushed. >>> A BATsave in the new bulk loader at critical points helped to avoid this >>> case. >>> if you do a COPY into a clean bat, then the log overhead is neglectable. >>> >>>> >>>> can i some how skip the logs and make it insert right into the bat >>>> files? >>>> also how can i stream the tuples programaticlly from C mapi or ODBC? >>>> >>>> >>> >>> See the C Mapi library. Or you might look at the Stethoscope, which >>> streams tuples >>> from server to an application. >>> >> >> i am running MonetDB on windows with a 8GB of ram. >> > > That should be more then enough ; ) > >> what is Stethoscope? >> > > it is part of the source distribution and a Linux utility that picks up a > stream of tuples from the server. does it work on windows,and how it works,using a special mil/mal syntax or does it is a plugin in the server for fast loads? also how you guys load data into benchmark databases which are(according to papers i have seen) 1-100GB of data. > > The information you provide is hard to track down to a possible cause. > a COPY operation most likely reads the complete file into its buffers > before processing it. > > One pitfall you may have stumbled upon is the following. > Did you indicate the number of records that you are about to copy into the > table? > If not, then the system has to guess and will repeatedly adjust this guess, > which > involves quite some overhead. > Pleae use, COPY 50000 RECORDS INTO ..... even if i want to read all the file? >>> >>> Do you happen to be a Ruby-on-Rails expert? >>> >> >> i am not a ruby on rails expert,sorry i am python guy :) >> >>>> >>>> thanks again. >>>> >>>> Martin Kersten wrote: >>>> >>>> >>>>> >>>>> uriel katz wrote: >>>>> >>>>> >>>>>> >>>>>> i have a application where i have constant bulk inserts(about 50000 >>>>>> rows of 1Kbyte each) every 1 minute,i am wondering which is the fastest and >>>>>> most efficient way to insert data. >>>>>> >>>>>> >>>>> >>>>> COPY into is the fastest >>>>>

2 1

Re: [MonetDB-users] constant bulk inserts to monetdb
by Martin Kersten 30 Jul '08

30 Jul '08

uriel katz wrote: >>> ok,but why it don`t utilize one core to the max,it seem to keep using 8% of >>> the core and takes about 17 seconds to insert 200,000 record of 1Kb each >>> (the actual file is 64MB). >>> >>> >> That depends on the total setup. Especially, when you are exceeding memory then Linux >> is not the best operating system. One of the issues is that dirty pages are not properly flushed. >> A BATsave in the new bulk loader at critical points helped to avoid this case. >> if you do a COPY into a clean bat, then the log overhead is neglectable. >> >>> can i some how skip the logs and make it insert right into the bat files? >>> also how can i stream the tuples programaticlly from C mapi or ODBC? >>> >>> >> See the C Mapi library. Or you might look at the Stethoscope, which streams tuples >> from server to an application. >> > i am running MonetDB on windows with a 8GB of ram. > That should be more then enough ; ) > what is Stethoscope? > it is part of the source distribution and a Linux utility that picks up a stream of tuples from the server. The information you provide is hard to track down to a possible cause. a COPY operation most likely reads the complete file into its buffers before processing it. One pitfall you may have stumbled upon is the following. Did you indicate the number of records that you are about to copy into the table? If not, then the system has to guess and will repeatedly adjust this guess, which involves quite some overhead. Pleae use, COPY 50000 RECORDS INTO ..... >> Do you happen to be a Ruby-on-Rails expert? >> > i am not a ruby on rails expert,sorry i am python guy :) > >>> thanks again. >>> >>> Martin Kersten wrote: >>> >>> >>>> uriel katz wrote: >>>> >>>> >>>>> i have a application where i have constant bulk inserts(about 50000 rows of 1Kbyte each) every 1 minute,i am wondering which is the fastest and most efficient way to insert data. >>>>> >>>>> >>>> COPY into is the fastest >>>> >>>> >>>>> i am using now the COPY command but it is kind of awkward since i need to dump my data as csv and then execute COPY to insert it,is there any streaming method or a special api for bulk inserts? >>>>> >>>>> >>>>> >>>> I think it is possible to inline the tuples into the sql stream as well. The SQL developer will answer this one. >>>> >>>> >>>>> also when i issue a copy command it uses a little bit of cpu aroud 2%(it is a quad core setup with windows so i guess this means 8% of one cpu) and keep loading and releasing memory(i have 8GB of ram) even that it doesn`t get near 2GB. >>>>> is this ok,what it is actually doing? >>>>> >>>>> >>>> We have recently upgraded our bulk loader to utilize as many cores as possible >>>> This is not yet in the release. >>>> The preview of effects you can see in http://monetdb.cwi.nl/projects/monetdb//SQL/Benchmark/TPCH/ >>>> >>>> >>>>> P.S.: are insert/selects multi threaded? >>>>> >>>>> thanks for this awsome peace of software! >>>>> >>>>> -Uriel >>>>> >>>>> >>>

1 0

[MonetDB-users] [Questions] Shredding 1GB XML File and Query Performance
by John 30 Jul '08

30 Jul '08

I just installed MonetDB/XQuery 0.24.0 (released on 30 June 2008) and wanted to store some XML documents. When I tried to shred an XML document with almost 1GB filesize, I received the following error message. > MAPI = monetdb@localhost:50000 > ACTION= read_line > QUERY = pf:add-doc("C:/Data/TestData-10.xml","TestData-10.xml") > ERROR = Connection terminated After receiving this error on my mclient window, I noticed that the MonetDB XQuery Server and MClient were terminated. FYI, I used a Windows XP Pro SP3 PC with Intel Core2 Duo E6550 processor and 3.25GB of RAM. The size of my hard disk is 232 GB. May I know how I can shred this file? Another question is about to test the query performance. I tried to execute an XQuery using the following command. > mclient.bat -lxq -t -G XQuery-1.xq This command will print out the query result and return the "Timer". a. Can I hide the result? I tried to add "-f none" to the above command, but it did not work. b. What is the "Timer"? How can I get only the query time? Thanks John

3 3

[MonetDB-users] [Question]How to change the format of datetime?
by chenhao333333 28 Jul '08

28 Jul '08

Are there any functions like date_format in MonetDB, I want to do something like date_format(zncsrq, '%Y%m%d', that is Mysql's function, in MonetDB. Best regards!

2 1

[MonetDB-users] JESUS LOPEZ LOPEZ - F009939R está ausente de la oficina.
by jesus.lopez＠correo.aeat.es 28 Jul '08

28 Jul '08

Estaré ausente de la oficina desde el 28/07/2008 y no volveré hasta el 08/08/2008. Responderé a su mensaje cuando regrese.

1 0

[MonetDB-users] MonetDB/XQuery XQTS results available?
by Richard Eckart 28 Jul '08

28 Jul '08

Hello everybody, are there any results of the official XML Query Test Suite on MonetDB/ XQuery available or is there an easy way to generate them? Regards, Richard

1 0

[MonetDB-users] Is there Function likes TRUNCATE ?
by nori 25 Jul '08

25 Jul '08

Hi, All. Is there the function such as "TRUNCATE TABLE" in other DB? Regards, Nori. -- Nori tunohiko(a)gmail.com

4 4

[MonetDB-users] Cannot compile MonetDB_4-24
by Stefan Klinger 23 Jul '08

23 Jul '08

Thanks for your help, however I still cannot compile. Actually, I just need to work with most current versions of Pathfinder, and maybe try some other branches of that one as well, until I find out where the fixes end up, and which one works for me. Unortunately I was unable to find a detailed description of which branches of what modules are required to build which other branches of whatever modules I need anyway. If someone would be so kind as to show me how I can achieve this without touching CVS, I would be deeply grateful. Until then, I'll try to follow the CVS trail. On 17 July 2008, Stefan Manegold wrote with possible deletions: > In case you prefer to use the CVS sources, and you do not require the latest > cutting-edge (potentially instable) development version we recommend to > checkout the latest Stable branches. > I ust realize that the respective branch tags are not (yet?) listed on the > MonetDB web site, hence I'll share them here: > > buildtools: MonetDB_1-24 > MonetDB: MonetDB_1-24 > clients: Clients_1-24 > MonetDB4: MonetDB_4-24 > MonetDB5: MonetDB_5-6 > pathfinder: XQuery_0-24 > sql: SQL_2-24 > geom: Geom_0-4 Thank you for this information, but compilation fails for MonetDB4 on the 'make' command with the following error message: /home/sk/opt/MonetDB/include/MonetDB/gdk/gdk_system.h:117: error: expected ‘)’ before ‘*’ token A detailed description of what I did is in the attached 'report' file, which actually is a bash script. The resulting logfile [1] from report 2>&1 | tee logfile is available for download. Kind regards Stefan ____________________ [1] logfile, link valid for one week, 409565 Bytes https://depot.uni-konstanz.de/get/72fwr6 -- Stefan Klinger o/klettern /\/ bis zum send plaintext only - max size 32kB - no spam \ Abfallen http://stefan-klinger.de

4 10

[MonetDB-users] Problems With CREATE TEMPORARY TABLE
by James Leigh 21 Jul '08

21 Jul '08

Hi all, I am having trouble using MonetDB, with dynamic temporary table creation. I have included a simple unit test to demonstrate the problem. These tests work fine on other JDBC SQL servers, but fail with the below exceptions when using MonetDB. Any ideas on how to make new tables available to other connections or keep new tables from interrupting other jdbc statements? Thanks, James ---%<--- java.sql.SQLException: INSERT INTO: no such table 'paints_2' at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.executeQuery(MonetConnection.java:2058) at nl.cwi.monetdb.jdbc.MonetConnection$ResponseList.processQuery(MonetConnection.java:1808) at nl.cwi.monetdb.jdbc.MonetStatement.internalExecute(MonetStatement.java:371) at nl.cwi.monetdb.jdbc.MonetStatement.execute(MonetStatement.java:340) at nl.cwi.monetdb.jdbc.MonetPreparedStatement.<init>(MonetPreparedStatement.java:102) at nl.cwi.monetdb.jdbc.MonetConnection.prepareStatement(MonetConnection.java:625) at nl.cwi.monetdb.jdbc.MonetConnection.prepareStatement(MonetConnection.java:586) at org.apache.commons.dbcp.DelegatingConnection.prepareStatement(DelegatingConnection.java:248) at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.prepareStatement(PoolingDataSource.java:302) at MonetDBJdbcTest.testDualCreateTable(MonetDBJdbcTest.java:28) ---%<--- java.sql.SQLException: Query did not produce a result set at nl.cwi.monetdb.jdbc.MonetPreparedStatement.executeQuery(MonetPreparedStatement.java:228) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93) at MonetDBJdbcTest.testSelectWhileCreateTable(MonetDBJdbcTest.java:77) ---%<--- import java.sql.Connection; import java.sql.PreparedStatement; import java.sql.ResultSet; import java.sql.SQLException; import java.sql.Statement; import junit.framework.TestCase; import org.apache.commons.dbcp.BasicDataSource; public class MonetDBJdbcTest extends TestCase { private BasicDataSource ds1; public void testDualCreateTable() throws Exception { Connection c4 = ds1.getConnection(); c4.setAutoCommit(true); Connection c76 = ds1.getConnection(); c76.setAutoCommit(false); Statement s93 = c76.createStatement(); s93.execute("CREATE TEMPORARY TABLE TRANSACTION_STATEMENTS (\n ctx INTEGER NOT NULL,\n subj INTEGER NOT NULL,\n pred INTEGER NOT NULL,\n obj INTEGER NOT NULL,\n expl BOOL NOT NULL\n)"); s93.close(); Statement s96 = c4.createStatement(); s96.execute("CREATE TABLE paints_2 (\n ctx INTEGER NOT NULL,\n subj INTEGER NOT NULL,\n obj INTEGER NOT NULL,\n expl BOOL NOT NULL\n)"); s96.close(); PreparedStatement ps102 = c76.prepareStatement("INSERT INTO paints_2\nSELECT DISTINCT ctx, subj, obj, expl FROM TRANSACTION_STATEMENTS tr\nWHERE NOT EXISTS (SELECT * FROM paints_2 st\nWHERE st.ctx = tr.ctx AND st.subj = tr.subj AND st.obj = tr.obj AND st.expl = tr.expl)"); ps102.close(); c76.close(); c4.close(); } public void testSelectWhileCreateTable() throws Exception { Connection c2 = ds1.getConnection(); c2.setAutoCommit(true); Statement s7 = c2.createStatement(); s7.execute("CREATE TABLE HASH_VALUES (\n id INTEGER NOT NULL,\n value BIGINT NOT NULL\n)"); s7.close(); PreparedStatement ps72 = c2.prepareStatement("SELECT id, value\nFROM HASH_VALUES\nWHERE value IN (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)"); ps72.setLong(1, 157585763729791056l); ps72.setLong(2, 1105705122070497121l); ps72.setLong(3, 940939309403574879l); ps72.setLong(4, 44738479624713631l); ps72.setLong(5, 93693228172326007l); ps72.setLong(6, 909856949769965718l); ps72.setLong(7, 388219017765868455l); ps72.setLong(8, 498326321060763331l); ps72.setLong(9, 917168269028472831l); ps72.setLong(10, 560146884310966732l); ps72.setLong(11, 178986943741094305l); ps72.setNull(12, -5); ps72.setNull(13, -5); ps72.setNull(14, -5); ps72.setNull(15, -5); ResultSet rs73 = ps72.executeQuery(); rs73.next(); rs73.close(); Statement s76 = c2.createStatement(); s76.execute("CREATE TABLE TRIPLES (\n ctx INTEGER NOT NULL,\n subj INTEGER NOT NULL,\n pred INTEGER NOT NULL,\n obj INTEGER NOT NULL,\n expl BOOL NOT NULL\n)"); s76.close(); ps72.setLong(1, 157585763729791056l); ps72.setLong(2, 93693228172326007l); ps72.setLong(3, 44738479624713631l); ps72.setLong(4, 909856949769965718l); ps72.setLong(5, 388219017765868455l); ps72.setLong(6, 917168269028472831l); ps72.setNull(7, -5); ps72.setNull(8, -5); ps72.setNull(9, -5); ps72.setNull(10, -5); ps72.setNull(11, -5); ps72.setNull(12, -5); ps72.setNull(13, -5); ps72.setNull(14, -5); ps72.setNull(15, -5); ResultSet rs88 = ps72.executeQuery(); rs88.close(); ps72.close(); c2.close(); } @Override protected void setUp() throws Exception { Class.forName("nl.cwi.monetdb.jdbc.MonetDriver"); ds1 = new BasicDataSource(); ds1.setUrl("jdbc:monetdb://localhost/jdbc_test"); ds1.setUsername("monetdb"); ds1.setPassword("monetdb"); } @Override protected void tearDown() throws Exception { Connection c106 = ds1.getConnection(); Statement s107 = c106.createStatement(); try { s107.execute("DROP TABLE HASH_VALUES"); s107.execute("DROP TABLE TRIPLES"); } catch (SQLException exc) { // ignore } try { s107.execute("DROP TABLE TRANSACTION_STATEMENTS"); s107.execute("DROP TABLE paints_2"); } catch (SQLException exc) { // ignore } s107.close(); c106.close(); ds1.close(); } }

2 6

Re: [MonetDB-users] [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures
by Martin Kersten 19 Jul '08

19 Jul '08

SOL ZADEH wrote: > > Thanks Martin; let me explain better: > > if table update are too costly (slow etc) then could try insertion > instead (having/including the timestamps as an index) > providing the server can cope with very frequent table insertions. > > Is there any benchmark tests in relation to table insertions? you can have a look at the TPCH loading figures. http://monetdb.cwi.nl/projects/monetdb//SQL/Benchmark/TPCH/ I have no hard figures in my head, but the DVD store benchmark we ran 2 years back came out directly after MySQL for high-volume business transactions. http://monetdb.cwi.nl/projects/monetdb/SQL/Benchmark/DVDstore/index.html so it all depends what you consider costly/slow. > > Regarding : > >> Concurrent transactions can freely read a consistent copy of the > database. > does this mean "dirty reads" ? no, only consistent reads > Regards > > > > ----- Original Message ---- > From: Martin Kersten <Martin.Kersten(a)cwi.nl> > To: SOL ZADEH <solzadeh(a)yahoo.com> > Cc: Niels Nes <Niels.Nes(a)cwi.nl>; monetdb-developers(a)lists.sourceforge.net > Sent: Saturday, July 19, 2008 2:22:16 PM > Subject: Re: [Monetdb-developers] tables/databases simultaneous > updates & extended-stored-procedures > > SOL ZADEH wrote: > > > > Thanks Neils for your prompt reply. > > > > Is there a quantified limitation on "insertions" on scenarios I > > mentioned below (multiple tables/database)? > > I.e. Does very frequent insertions on 2 or more tables (on same > > database or other database on the same server) > > in any way effect the performance of the other queries > > (select,insert,update) on the "same" > > or "other" tables (i.e. is parallel processing possible & locking > > performance etc). > > Regards > Trying to interpret you question what it means. > MonetDB does not lock tables or databases during update. Concurrent > transactions can > freely read a consistent copy of the database. > All interference comes from sharing the same CPU, memory and IO channels. > > > > ----- Original Message ---- > > From: Niels Nes <Niels.Nes(a)cwi.nl <mailto:Niels.Nes@cwi.nl>> > > To: SOL ZADEH <solzadeh(a)yahoo.com <mailto:solzadeh@yahoo.com>> > > Cc: monetdb-developers(a)lists.sourceforge.net > <mailto:monetdb-developers@lists.sourceforge.net> > > Sent: Saturday, July 19, 2008 8:49:55 AM > > Subject: Re: [Monetdb-developers] tables/databases simultaneous > > updates & extended-stored-procedures > > > > On Fri, Jul 18, 2008 at 05:13:54PM -0700, SOL ZADEH wrote: > > > Hi > > > > > > > > > I have a couple of questions and really appreciate if any one > > > could answer them or instruct me to the relevant forum topics: > > > > > > > > > 1- what is the limitations (speed, threshold etc) on > > > simultaneous tables /databases update i.e. via multiple odbc > > > connection lets say (also any other faster API to interface > > > with the MonetDB ?) > > MonetDB research concentrated mostly in low update/high query loads. The > > update implementation is still quite capable, but no reall performance > > experiments on updates have been conducted. Next to odbc we have > > mapi and jdbc APIs available. > > > > > > > > > 2- Is there a way to have the triggers to generate > > > real-world (non-db) events i.e. similar to the Extended Stored > > > Procedure in SqlServer or the way Oracle allows you to run Java > > > code inside the stored procedures. > > MonetDB can be extended using C-code and that code could be run within > > the triggers. > > > > Niels > > > > > > Thanks > > > > > > > > ------------------------------------------------------------------------- > > > This SF.Net email is sponsored by the Moblin Your Move Developer's > > challenge > > > Build the coolest Linux based applications with Moblin SDK & win > > great prizes > > > Grand prize is a trip for two to an Open Source event anywhere in > > the world > > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > <http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/>> > > > _______________________________________________ > > > Monetdb-developers mailing list > > > Monetdb-developers(a)lists.sourceforge.net > <mailto:Monetdb-developers@lists.sourceforge.net> > > <mailto:Monetdb-developers@lists.sourceforge.net > <mailto:Monetdb-developers@lists.sourceforge.net>> > > > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > > > > -- > > > > Niels Nes, Centre for Mathematics and Computer Science (CWI) > > Kruislaan 413, 1098 SJ Amsterdam, The Netherlands > > room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 > > url: http://www.cwi.nl/~niels <http://www.cwi.nl/%7Eniels> > <http://www.cwi.nl/%7Eniels> e-mail: > > Niels.Nes(a)cwi.nl <mailto:Niels.Nes@cwi.nl> <mailto:Niels.Nes@cwi.nl > <mailto:Niels.Nes@cwi.nl>> > > > > ------------------------------------------------------------------------ > > > > > ------------------------------------------------------------------------- > > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > > Build the coolest Linux based applications with Moblin SDK & win > great prizes > > Grand prize is a trip for two to an Open Source event anywhere in > the world > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > <http://moblin-contest.org/redirect.php?banner_id=100&url=/> > > ------------------------------------------------------------------------ > > > > _______________________________________________ > > Monetdb-developers mailing list > > Monetdb-developers(a)lists.sourceforge.net > <mailto:Monetdb-developers@lists.sourceforge.net> > > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > >

1 0

Re: [MonetDB-users] Range join question [MonetDB]
by Martin Kersten 18 Jul '08

18 Jul '08

Vasilis Vassalos wrote: > Hello again, > > for the student project I've told you about, we need to perform range > joins, so we tried some on MonetDB. > We're having trouble getting range joins on strings working properly. > > Michalis, my student, has looked into it and reports that > ALGrangejoin (algebra.c) calls BATrangejoin (gdk_rangejoin.c) that > performs the join and returns a BAT > as a result. BATrangejoin has a switch with a case for TYPE_chr that > compares strings You are really delving deep in the sources ; ) An area only meant for the brave at heart. > > When we try to perform a range join on a string attribute (char(n), > even for n=1, varchar(n)) we get > an exception: > !MALException:algebra.rangejoin:GDKerror > !ERROR: BATrangejoin: type not implemented > > The switch statement skips the TYPE_chr case and goes to the default. > For example, > >> sql>create table s1 (id int, v char(10)); >> sql>create table s2 (id int, v char(10)); >> sql>insert into s1 values (1,'s1'); >> sql>insert into s1 values (2,'s2'); >> sql>insert into s1 values (3,'s3'); >> sql>insert into s1 values (4,'s4'); >> sql>insert into s1 values (5,'s5'); >> sql>insert into s1 values (6,'s6'); >> sql>insert into s2 values (1,'s1'); >> sql>insert into s2 values (2,'s2'); >> sql>insert into s2 values (3,'s3'); >> sql>insert into s2 values (4,'s4'); >> sql>insert into s2 values (5,'s5'); >> sql>insert into s2 values (6,'s6'); >> sql>select s1.id from s1, s2 where s1.v between s2.v and s2.v||'c' ; >> !MALException:algebra.rangejoin:GDKerror >> !ERROR: BATrangejoin: type not implemented > This is an instance of the more general theta join. We will have a look into the issue.. It certainly should not have falled back to an error this low in the system. > whereas > >> sql>select s1.id from s1, s2 where s2.id=2 and s1.id between s2.id >> and s2.id+1 ; >> +----+ >> | id | >> +====+ >> | 2 | >> | 3 | >> +----+ > > Thanks! >

1 0

[MonetDB-users] Two questions with XQuery
by Andreas Meinl 17 Jul '08

17 Jul '08

Hi there, I'm currently porting some XQuery scripts to MonetDB/XQuery, and encountered two maybe simple obstacles. The first one is that I can't use fn:collection, but instead always have to apply pf:collection. The online documentation [1] states both alternatives should be practicable. For example in eXist and Sedna I can write: let $a := fn:collection("samples") return $a//id But this does not work for MonetDB/XQuery! Here I have to use: let $a := pf:collection("samples")/child::document-node() return $a//id My second question is that I cannot execute this kind of queries, which runs well in eXist and Sedna: <average> { fn:round(fn:avg( for $doc in fn:collection("samples") return $doc/example/@sum )) } </average> For MonetDB/XQuery I have to pull out pf:collection and add a second return statement: let $col := pf:collection("samples")/child::document-node() return <average> { fn:round(fn:avg( for $doc in $col return $doc/example/@sum )) } </average> So what am I doing wrong? Does MonetDB/XQuery by any chance comply more with any standards than eXist and Sedna do? Or ist fn:collection just not implemented in the current release of MonetDB/XQuery? I would be glad if someone could give me a hint! It's so confusing... Thank you! Regards, Andreas Meinl [1] http://monetdb.cwi.nl/projects/monetdb/XQuery/QuickTour/DOCMGT/ index.html#openall

4 10

[MonetDB-users] Compile: buildtools -> hard, MonetDB -> fails
by Stefan Klinger 17 Jul '08

17 Jul '08

Hello, it took me quite a while to compile the build tools, since the make process failed without any meaningful error messages, but I cannot build Monetdb. I'd expect the configure script to fail with a descriptive error message if required packages (in my case 'libtool', 'flex') are missing. > prefix="${HOME}/opt/MonetDB" > cvs -d:pserver:anonymous@monetdb.cvs.sourceforge.net:/cvsroot/monetdb checkout buildtools [...] > pushd buildtools > ./bootstrap [...] ./bootstrap: line 29: libtoolize: command not found [...] The message about a missing 'libtoolize' is easily overlooked, and configure was running fine anyway: > ./configure --prefix="${prefix}" [...] But the make fails > make [...] /tmp/sk/2/buildtools/mel/mel.yy:331: undefined reference to `mel_yyerror(char const*)' [...] make: *** [all] Error 2 In case you don't know that 'yyerror' hints at flex, you're lost. Well, I figured that out and went on: > make install > popd Then I tried to continue with MonetDB: > cvs -d:pserver:anonymous@monetdb.cvs.sourceforge.net:/cvsroot/monetdb checkout MonetDB > pushd MonetDB > ./bootstrap automake 1.10.1 is 1.7 or newer. Good. autoconf 2.61 is 2.57 or newer. Good. libtool 1.5.26Debian1.5.26-4 is 1.4 or newer. Good. Python 2.5.2 is 2.0.0 or newer. Good. Traceback (most recent call last): File "/home/sk/opt/MonetDB/bin/autogen.py", line 29, in <module> from autogen import am ImportError: No module named autogen Now this leaves me completely clueless... Any help wouldbe appreciated. Kind regards, Stefan -- Stefan Klinger o/klettern /\/ bis zum send plaintext only - max size 32kB - no spam \ Abfallen http://stefan-klinger.de

3 3

[MonetDB-users] mserver5 seg fault
by mark 14 Jul '08

14 Jul '08

i have over 6gb free space, but it crashes like this.. [mark@localhost ~]$ sudo mserver5 # MonetDB server v5.7.0, based on kernel v1.25.0 # Serving database 'demo' # Compiled for i686-redhat-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) !ERROR: BATSIGcrash: Mserver internal error (Segmentation fault), please restart. !ERROR: (One potential cause could be that your disk might be full...) [mark@localhost ~]$ df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup00-LogVol00 19G 12G 6.7G 63% / /dev/sda3 194M 19M 165M 10% /boot tmpfs 2.0G 1.1M 2.0G 1% /dev/shm /dev/sda2 50G 40G 9.9G 80% /mnt/c gvfs-fuse-daemon 19G 12G 6.7G 63% /home/mark/.gvfs

3 4

[MonetDB-users] creating database - monetdb not found
by mark 14 Jul '08

14 Jul '08

i installed MonetDB using yum and these packages were installed Installed: MonetDB.i686 0:1.25.0-1_Fedora9.oid32 MonetDB-client.i686 0:1.25.0-1_Fedora9.oid32 MonetDB-client-python.i686 0:1.25.0-1_Fedora9.oid32 MonetDB-testing.i686 0:1.25.0-1_Fedora9.oid32 MonetDB5-server.i686 0:5.7.0-1_Fedora9.oid32 Dependency Installed: MonetDB-python.i686 0:1.25.0-1_Fedora9.oid32 now i want to create a database like in the documentation shell> monetdb create demo successfully created database 'demo' [mark@localhost ~]$ monetdb bash: monetdb: command not found what other packages do i need to install? thanks

2 2

[MonetDB-users] Repeated database corruption - v2.24.0
by Kirk Abbott 13 Jul '08

13 Jul '08

Hello, I am using Monetdb on Windows XP (see the server specs below). Unfortunately, I seem to corrupt the database very frequently involving a complete removal of the MonetDB5 directory (and all associated work). Corruption seems to occur if I hit a Ctrl-C (say on a long running query). Questions: 1) Is this a problem only on Windows? or is it a problem with this version of the server? 2) Is there a better way to kill a long running query? Clearly, corrupting the entire database (it won't restart!) just by killing a query, does not confidence build Any ideas? Kirk. # MonetDB server v5.6.0, based on kernel v1.24.0 # Serving database 'demo' # Compiled for i686-pc-win32/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-2008 CWI, all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see C:\Program Files\CWI\MonetDB5\etc\monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.24.0 loaded >

2 2

[MonetDB-users] SQL Table partitioning in MonetDB
by Napoma 10 Jul '08

10 Jul '08

I have this problem... i have a table with 33.000.000 of records.. the table is named i_predicate with four columns as follows (oid, name, isubj, iobj)... i want to execute a physical partition on i-predicate respect to the values of name column.. in this way if i query i_predicate monetdb has to use only the respective partition with the respective value of name... does it exist a sql statement for creating partitions of i_predicate? does it exist a script for this partition on MonetDB? and if i create the partition... i have to define function to query correctly the partitions? Thanks -- View this message in context: http://www.nabble.com/SQL-Table-partitioning-in-MonetDB-tp18384206p18384206… Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] PF: warning: query will always return an error
by Ying Zhang 10 Jul '08

10 Jul '08

Hello, In stable branch + milprint_summer, executing the following query (you need to have a "hello.xml" doc shredded in collection "hello"): let $path := 'backup/test/hello/' let $index := element documents { for $document at $pos in pf:documents('hello') let $uri := concat($path, string(10000 + (($pos div 10000)) cast as xs:integer), '/', string($pos) , '.xml') return (text { "
 " }, element document { attribute uri {$uri}, $document/text() }), text { "
" } } return (put($index, concat($path,'documents.xml')), for $document in $index/document return put(exactly-one(doc(string($document))), exactly-one($document/@uri))) Results in the first 'put' is done, while the second 'put' is not executed, actually, the MIL code generated by 'pf' contains only translation of (the first) one 'put'. Also, the query gives a warning: query will always return an error If I comment out the first 'put', the second 'put' in the for-loop get executed, *without* the warning. Executing a similar query: (put(<a/>, "a.xml"), for $n in ("b.xml", "c.xml") return put(exactly-one(doc("hello.xml")), $n) ) also results in the warning, however, the generated MIL code contains translation of both 'put' and three documents are put in dbfarm. I'd like to know why the first query fails, and what has triggered the warning. Thanks a lot! Kind regards, Jennie

6 11

Re: [MonetDB-users] MonetDB/XQuery - Bug 1899258
by Ying Zhang 10 Jul '08

10 Jul '08

On Wed, Jul 09, 2008 at 06:29:08PM +0200, Andreas Meinl wrote: > Hi Ying Zhang, > > regarding bug 1899258 "PF: Error message with Administrative Console": I > still have the same problem, even with the current release of > MonetDB/XQuery, which I downloaded just today. The package is called > MonetDB4-XQuery-Installer-i386-20080624.msi. You have closed this bug on 20 > June 2008. How can I check which version of libxml2 I have installed (or, > is bundled with this release of MonetDB/XQuery)? I've attached two > screenshots with similar error messages. Thanks a lot! Hello Andreas, Given the second screenshot, it indeed looks like you are still having this problem. Is it true that if you click on one of the buttons for the first time, it will first hang for about 30 seconds, before you get this error message? In the current release, the Windows installer contains (should contain) an older version of libxml2 (2.6.30) due to this problem. So, this error should actually not happen. You can find the libxml2 DLL file in the lib directory of your installation dir, which is typically 'program files\cwi'. So please check you have the correct version of libxml2 in your installation. Regards, Jennie > > Regards, > > Andreas Meinl > > > > > >

1 0