- users-list - monetdb.org

[MonetDB-users] Bulk-Load Problem
by algatt 27 Oct '07

27 Oct '07

I am using MonetDB 5.0.0 and 1GB Ram on Windows XP. I am trying to use the TPC-H benchmark. With 1GB of test data everything worked fine, but if I try to load a table with more than 1GB of data the server crashes. Does this happen due to the 1GB of RAM? Also, when I use the number of records with the COPY command it copies more records. Any pointers? Thanks -- View this message in context: http://www.nabble.com/Bulk-Load-Problem-tf4702911.html#a13442730 Sent from the monetdb-users mailing list archive at Nabble.com.

3 2

[MonetDB-users] Very slow group by sql query
by Arjen van der Meijden 22 Oct '07

22 Oct '07

Hi list, I was just doing some basic queries on MonetDB5/SQL to see if it is suitable for my application, I'm doing lots of aggregates on some logfile-abstractions. Basically they all boil down to 'how many unique visitors and total pageviews where there in period X-Y in section Z'. I have this table: pageviews ( timestamp timestamp not null, clientip varchar(15) not null, sectionid smallint not null, itemid integer not null, channelid smallint default 0 ) Currently it only contains data for last september, with about 2M records/day, and 5.6M in total. There are no additional indexes in this case. When doing a query like this, monetdb very fast. Once the data is in the memory cache, it returns (according to trace) in about half a second. select count(*) from pageviews where timestamp between '2007-09-21 00:00:00' and '2007-09-22 00:00:00'; The result is 1916813 This one is also pretty fast, taking about 1.7 second select count(distinct clientip) from pageviews where timestamp between '2007-09-21 00:00:00' and '2007-09-22 00:00:00'; The result is 165700 And the third which is pretty fast: select channelid, count(*) from pageviews where timestamp between '2007-09-21 00:00:00' and '2007-09-22 00:00:00' group by channelid; Here's the distribution, and its returned in about 0.6 second [ 0, 538187 ] [ 1, 1108478 ] [ 4, 42867 ] [ 3, 145565 ] [ 2, 81716 ] But when I combine those last two queries, the result isn't returned in a reasonable amount of time, I waited for more than half an hour and it still hadn't returned the results. select channelid, count(distinct clientip), count(*) from pageviews where timestamp between '2007-09-21 00:00:00' and '2007-09-22 00:00:00' group by channelid; I'm not very good at reading your explain output yet, so I've attached the resulting explain for that query. Is there a way to speed up this type of query? It seems a bit odd that it's taking more than half an hour (postgresql does it in about 20 seconds) while the other queries return much faster (postgresql does them in about 14 seconds). Best regards, Arjen function user.s5_1():void; _1:bat[:oid,:timestamp]{rows=55914459:lng,bid=1968} := sql.bind("sys","pageviews","timestamp",0); _10:bat[:oid,:timestamp]{rows=0:lng,bid=2323} := sql.bind("sys","pageviews","timestamp",1); constraints.emptySet(_10); _10:bat[:oid,:timestamp]{rows=0:lng,bid=2323} := nil; _12:bat[:oid,:timestamp]{rows=0:lng,bid=2324} := sql.bind("sys","pageviews","timestamp",2); constraints.emptySet(_12); _12:bat[:oid,:timestamp]{rows=0:lng,bid=2324} := nil; _17:bat[:oid,:sht]{notnil=true,rows=55914459:lng,bid=1969} := sql.bind("sys","pageviews","channelid",0); _24:bat[:oid,:str]{rows=55914459:lng,bid=1961} := sql.bind("sys","pageviews","clientip",0); _8{rows=27957230:lng} := algebra.uselect(_1,2007-09-21 00:00:00.000,2007-09-22 00:00:00.000,true,true); _1:bat[:oid,:timestamp]{rows=55914459:lng,bid=1968} := nil; _15{rows=27957230:lng} := algebra.markT(_8,0@0); _8{rows=27957230:lng} := nil; _16{rows=27957230:lng} := bat.reverse(_15); _15{rows=27957230:lng} := nil; _19{rows=27957230:lng} := algebra.join(_16,_17); (ext40,grp38):= group.new(_19); _19{rows=27957230:lng} := nil; _22 := bat.mirror(ext40); ext40 := nil; _23 := algebra.joinPath(_22,_16,_17); _17:bat[:oid,:sht]{notnil=true,rows=55914459:lng,bid=1969} := nil; _26{rows=27957230:lng} := algebra.join(_16,_24); _16{rows=27957230:lng} := nil; _24:bat[:oid,:str]{rows=55914459:lng,bid=1961} := nil; (_27,grp55):= group.new(grp38); (_29,grp57):= group.derive(_27,grp55,_26); _27 := nil; grp55 := nil; _31 := bat.mirror(_29); _29 := nil; _32 := algebra.semijoin(_26,_31); _26{rows=27957230:lng} := nil; _31 := nil; _33:bat[:oid,:int] := aggr.count_no_nil(_32,grp38,_22); _32 := nil; _34:bat[:oid,:int] := aggr.count(grp38,grp38,_22); grp38 := nil; _22 := nil; _35 := sql.resultSet(3,1,_23); sql.rsColumn(_35,"sys.pageviews","channelid","smallint",16,0,_23); _23 := nil; sql.rsColumn(_35,"sys.pageviews","count_no_nil_clientip","int",15,0,_33); _33:bat[:oid,:int] := nil; sql.rsColumn(_35,"sys.pageviews","count_channelid","int",32,0,_34); _34:bat[:oid,:int] := nil; sql.exportResult(_35,""); end s5_1;

4 6

[MonetDB-users] Server Crashes when Client is Opened
by algatt 21 Oct '07

21 Oct '07

Hello, I have installed Monet and created the TPC-H schema and populated it with data. Once all data was copied, I restarted the computer to try the queries. However, now the server starts, but when I open the client everything closes immediately. I uninstalled it, and re-installed it and the same happens. Any help? Thank You. Regards, Alan -- View this message in context: http://www.nabble.com/Server-Crashes-when-Client-is-Opened-tf4657643.html#a… Sent from the monetdb-users mailing list archive at Nabble.com.

3 6

[MonetDB-users] delete query with where clause
by pawan123 10 Oct '07

10 Oct '07

When I use without where clause if ((hdl = mapi_query(dbh,"select * from logException )) == NULL || mapi_error(dbh) != MOK) die(dbh, hdl); It is working fine. But when I use with where condition if ((hdl = mapi_query(dbh,"delete * from logException where logid=1 )) == NULL || mapi_error(dbh) != MOK) die(dbh, hdl); It is deleting the record only from memory not from database. -- View this message in context: http://www.nabble.com/delete-query-with-where-clause-tf4598673.html#a131295… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] configure warning
by Ying Zhang 09 Oct '07

09 Oct '07

Hello, During 'configure' of the MonetDB4 module (Stable branch, MonetDB_4-20), I got the warning: configure: WARNING: fcntl.h: present but cannot be compiled configure: WARNING: fcntl.h: check for missing prerequisite headers? configure: WARNING: fcntl.h: see the Autoconf documentation configure: WARNING: fcntl.h: section "Present But Cannot Be Compiled" configure: WARNING: fcntl.h: proceeding with the preprocessor's result configure: WARNING: fcntl.h: in the future, the compiler will take precedence The same warning was given about several other header files, e.g. limits.h, pwd.h, time.h, sys/time.h, utime.h, ... The compilation was finished without further problems, but I would like to know why I got these warnings, since this is something new. Thanks! Jennie

2 1

[MonetDB-users] how to measure a query execution time
by xxiao 08 Oct '07

08 Oct '07

Hi, I need to measure the sql query execution time. So I used "-t" option with mclient command. For example, I use "mclient -lsql -umonetdb -Pmonetdb -t < 15.sql" to execute query 15 in TPC-H benchmark. I have the following outputs: Timer 935.765 msec Timer 717.294 msec Timer 0.163 msec % sys.supplier, sys.supplier, sys.supplier, sys.supplier, sys.revenue0 # table_name % s_suppkey, s_name, s_address, s_phone, total_revenue # name % int, varchar, varchar, varchar, decimal # type % 4, 18, 17, 15, 21 # length [ 8449, "Supplier#000008449", "Wp34zim9qYFbVctdW", "20-469-856-8873", 1772627.2087 ] Timer 3559.856 msec Timer 0.079 msec Timer 63.676 msec Timer 0.890 msec % .stats, .stats # table_name % rewrite, count # name % clob, int # type % 7, 1 # length [ "joinidx", 0 ] Timer 1.043 msec There are multiple lines started with "Timer" and ended by a time measurement in milli-sec. So is the execution time of query 15 in TPC-H equal to the sum of all these time measurements. In this case, 935.765+717.294+0.163+3559.856+0.079+63.676+0.890+1.043=5278.766 msec. I appreciate your response. Xiang -- View this message in context: http://www.nabble.com/how-to-measure-a-query-execution-time-tf4588760.html#… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] convert string to timestamp in MonetDB
by pawan123 04 Oct '07

04 Oct '07

is there any function in MonetDB that can convert string (i.e.Thu Oct 04 14:36:17 2007) in to timestamp; Thanks Pawan -- View this message in context: http://www.nabble.com/convert-string-to-timestamp-in-MonetDB-tf4567699.html… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] What is optimizer_stats()
by Pranav Vaidya 03 Oct '07

03 Oct '07

Hi, I am new to MonetDB and I am trying to run the TPC-H benchmarks and I was able to successfully load and execute the benchmarks in MonetDB version 4. I also verified whether the tables were populated using Dbvis. However, what seems to fail is the lack of a function called optimizer_stats() in the run.all script. Is this a procedure or a function defined additionally which is needed. And why is it not present ? Do I need to run some additional scripts to have this run.all script go through successfully without any errors. Thanks and Regards, Pranav. -- View this message in context: http://www.nabble.com/What-is-optimizer_stats%28%29-tf4564307.html#a13027620 Sent from the monetdb-users mailing list archive at Nabble.com.

3 4

[MonetDB-users] (no subject)
by Matt Magoffin 02 Oct '07

02 Oct '07

Hello, I am interested in evaluating MonetDB/XQuery. I have some XML collections for a project I work on that are of 1-2 million individual XML documents for which I use XQuery to access for OLAP style reporting operations. This is a Java-based project, and while working on this project I developed a thin XQuery-centric API so that I could evaluate/use many different XQuery implementations, which my company released as an open source project called Xaj (http://sourceforge.net/projects/xaj) Currently I am using a Berkeley DB XML implementation, but am interested in exploring other options. I'd like to implement a MonetDB version of this API now, but I am having some difficulty finding out how to effectively access MonetDB through Java. So far I was able to use the MonetDB JDBC driver to construct XQuery statements and get XML results, and also I was able to construct MonetDB pf:add-doc() statements to add documents, but I am wondering if this is the best approach (and if so, how to add documents to a remote MonetDB server using the pf:add-doc() mechanism). The API I am trying to implement you can view here, to give you an idea what I'm trying to do: http://xaj.svn.sourceforge.net/viewvc/xaj/xaj/src/net/sf/xaj/XmlDb.java?rev… It was somewhat modeled after the defunct XML:DB API, but focused just on add/store/XQuery operations. Any help/advise would be greatly appreciated! -- m@

1 0

[MonetDB-users] how we convert the value of timestamp in minutes
by pawan123 28 Sep '07

28 Sep '07

how we convert the value of timestamp in minutes -- View this message in context: http://www.nabble.com/how-we-convert-the-value-of-timestamp-in-minutes-tf45… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] how we get the timestamp value 10 minutes before from current_timestamp
by pawan123 28 Sep '07

28 Sep '07

how we get the timestamp value 10 minutes before from current_timestamp -- View this message in context: http://www.nabble.com/how-we-get-the-timestamp-value-10-minutes-before-from… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] how to run TPC-H benchmark on MonetDB
by xxiao 27 Sep '07

27 Sep '07

hi, I am a beginner of MonetDB. I want to run TPC-H benchmark on MonetDB. I found there are SQL queries and related files under monetdb source folder <monetdb-source>/sql/src/benchmark/tpch. I ran the script 'run.all'. But that gave me many errors and did not succeed. Can anyone describe briefly the steps I need to carry out in order to run TPC-H benchmark? Any documentations I can refer to is highly appreciated. Thank you. -- View this message in context: http://www.nabble.com/how-to-run-TPC-H-benchmark-on-MonetDB-tf4524693.html#… Sent from the monetdb-users mailing list archive at Nabble.com.

4 5

[MonetDB-users] minus 10 minutes from current_timestamp
by pawan123 27 Sep '07

27 Sep '07

how we minus 10 minutes from current_timestamp. because i have to fetch all the records from a table 10 minutes before currenttimestamp. so pls tell me how we deternine 10 min before timestamp value. Thanks pawan -- View this message in context: http://www.nabble.com/minus-10-minutes-from-current_timestamp-tf4526685.htm… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] I want to select records from MonetDB
by pawan123 25 Sep '07

25 Sep '07

I want to select records from a table on the basis of date in MonetDB and then insert all these selected records in a table i.e. present in oracle using C or Pro*C. can any one help me in writing the code. Thanks in advance. Pawan -- View this message in context: http://www.nabble.com/I-want-to-select-records-from-MonetDB-tf4514715.html#… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] Database tool
by Venks 25 Sep '07

25 Sep '07

Hi, What's the good database tool that I can use to connect to MonetDB, run queries and browse the objects? I used to use DBVisualizer earlier and now both 5.1.1 and 6.0.x version are giving errors. I installed the latest version of the MonetDB couple of weeks ago and I think the changes in the new version of MonetDB (JDBC) are causing these issues. Thanks, -Venks

3 2

[MonetDB-users] building client on Windows
by Sander Kruseman 24 Sep '07

24 Sep '07

Hi, I want to construct a Monet client app in C on Windows but find very sparse info on this. I took notice of the fact that Windows is apparently not exactly Monet's main target platform. Still, I tried using nmake on the client sources but ran into errors involving missing (or incorrectly placed) files (see below). Do I really have to go through the complete 'Experts > Windows Installation', i.e. building MonetDB server itself? regards, Sander ...\clients-1.18.2\src\mapilib>nmake -f makefile.msc Microsoft (R) Program Maintenance Utility Version 8.00.50727.42 Copyright (C) Microsoft Corporation. All rights reserved. makefile.msc(8) : fatal error U1052: file '.\..\..\rules.msc' not found

2 1

[MonetDB-users] Cannot manipulate XML Document
by Timothy Marc 24 Sep '07

24 Sep '07

Hello all, I've downloaded MonetDB XQuery for evaluating the XQuery Update Facility. I've shredderd a document and can perform xqueries from MapiClient successfully. But, when i try to update a document, the process fails with error message: !ERROR updating read-only document. May i have to specify some flags or something else??? Thx Timothy

2 1

[MonetDB-users] can we create cache group in MonetDB
by pawan123 24 Sep '07

24 Sep '07

all we know about Timesten Database with oracle. can we use this MonetDB like Timesten Database with oracle.means can we create cache group in MonetDB. Thanks Pawan -- View this message in context: http://www.nabble.com/can-we-create-cache-group-in-MonetDB-tf4492681.html#a… Sent from the monetdb-users mailing list archive at Nabble.com.

3 3

[MonetDB-users] can we create cache group in MonetDB
by Pawan Kumar Gupta 21 Sep '07

21 Sep '07

all we know about Timesten Database with oracle. can we use this MonetDB like Timesten Database with oracle.means can we create cache group in MonetDB. Thanks Pawan

1 0

[MonetDB-users] Persistent Stored Modules and a SQL issue
by Venks 18 Sep '07

18 Sep '07

Two questions. 1. Can I execute a dynamic DDL statement using PSM? 2. I am trying to create a script where I would like to DROP A TABLE before re-creating it. If I include the DROP TABLE in the script, MonetDB throws an error and STOPs execution if the table is not found. This is rather painful as I would like MonetDB to continue with the next SQL command. For. e.g DROP TABLE table1 ; CREATE TABLE table1 .... If I include the above 2 commands in one script, then the above scripts stops execution if "table1" doesn't exists. Thanks, -Venks

2 3

[MonetDB-users] MonetDB vs MySQL naive benchmark.
by Dan Libby 16 Sep '07

16 Sep '07

Hi, I just downloaded and started experimenting with MonetDB today. We have a large PHP/mysql app that runs millions of small/simple queries to generate various reports. (It needs to be refactored, but that is hard). Anyway, for starters, I wrote a very small/stupid benchmark script for both monetdb and mysql. I expected monetdb to be slower at populating the table, and faster at selecting from it, but it was slower at both. So below I am presenting my results, and my php scripts, and I would be very interested to know if there is a problem in my methodology, or if I should be running certain types of queries that monetdb will excel at. Mysql Results: -------------- $ php testmysql.php MySQL Test Dropping previous table (if present) Dropped in 0.000669 seconds creating table Created in 0.007732 seconds populating table Populated in 1.163141 seconds selecting from table queried 10000 records in 1.446646 seconds MonetDB Results: ---------------- $ php testmonet.php MonetDB Test Dropping table Dropped in 0.039597 seconds creating table Created in 0.001858 seconds populating table Populated in 7.513073 seconds selecting from table Queried 10000 records in 2.680834 seconds One interesting thing I noticed is that if I did not include the primary key index on the where-clause column, then mysql took ~80 seconds, and Monet still took about ~2.5 seconds. I guess this is because Monet just uses user-specified indexes as hints, so it had really created one anyway, yes? Anyway, here are the PHP scripts I used: testmonet.php ---------------- <?php echo "MonetDB Test\n"; $db = @monetdb_connect('sql', 'localhost', 50000, 'monetdb', 'monetdb') or die('Failed to connect to MonetDB<br>'); echo "Dropping table\n"; $start_time = microtime(true); $sql = "drop table big_table;"; $res = monetdb_query($sql); echo sprintf( "Dropped in %f seconds\n\n", microtime(true) - $start_time); echo "creating table\n"; $start_time = microtime(true); $sql = "create table big_table( col1 int primary key, col2 varchar(20), col3 int, col4 varchar(20) );"; $res = monetdb_query($sql) or die ("failed to create table" ); echo sprintf( "Created in %f seconds\n\n", microtime(true) - $start_time); echo "populating table\n"; $start_time = microtime(true); for( $i = 0; $i < 10000; $i ++ ) { $sql = "insert into big_table values ($i, 'col2 $i', $i, 'col4 $i' )"; $res = monetdb_query( $sql ) or die ("failed to insert at row $i " ); } echo sprintf( "Populated in %f seconds\n\n", microtime(true) - $start_time); echo "selecting from table\n"; $start_time = microtime(true); for( $i = 0; $i < 10000; $i ++ ) { $sql = "select col1 from big_table where col1 = $i"; $res = monetdb_query($sql); while ( $row = monetdb_fetch_assoc($res) ) { // print_r($row); } } echo sprintf( "Queried 10000 records in %f seconds\n\n", microtime(true) - $start_time); ?> testmysql.php ---------------- <?php echo "MySQL Test\n"; $db = @mysql_connect('localhost', 'root', '', 'monetdb') or die('Failed to connect to MySQL<br>'); mysql_select_db( "perftest" ) or die ("Failed to select DB" ); echo "Dropping previous table (if present)\n"; $start_time = microtime(true); $sql = "drop table big_table"; $res = mysql_query($sql); echo sprintf( "Dropped in %f seconds\n\n", microtime(true) - $start_time); echo "creating table\n"; $start_time = microtime(true); $sql = "create table big_table( col1 int primary key, col2 varchar(20), col3 int, col4 varchar(20) );"; $res = mysql_query($sql) or die ("failed to create table" ); echo sprintf( "Created in %f seconds\n\n", microtime(true) - $start_time); echo "populating table\n"; $start_time = microtime(true); for( $i = 0; $i < 10000; $i ++ ) { $sql = "insert into big_table values ($i, 'col2 $i', $i, 'col4 $i' )"; $res = mysql_query( $sql ) or die ("failed to insert at row $i " ); } echo sprintf( "Populated in %f seconds\n\n", microtime(true) - $start_time); echo "selecting from table\n"; $start_time = microtime(true); for( $i = 0; $i < 10000; $i ++ ) { $sql = "select col1 from big_table where col1 = $i"; $res = mysql_query($sql); while ( $row = mysql_fetch_assoc($res) ) { // print_r($row); } } echo sprintf( "queried 10000 records in %f seconds\n\n", microtime(true) - $start_time); ?> </body> </html>

3 4

[MonetDB-users] MonetDB vs MySQL naive benchmark.
by Dan Libby 16 Sep '07

16 Sep '07

Hi, I just downloaded and started experimenting with MonetDB today. We have a large PHP/mysql app that runs millions of small/simple queries to generate various reports. (It needs to be refactored, but that is hard). Anyway, for starters, I wrote a very small/stupid benchmark script for both monetdb and mysql. I expected monetdb to be slower at populating the table, and faster at selecting from it, but it was slower at both. So below I am presenting my results, and my php scripts, and I would be very interested to know if there is a problem in my methodology, or if I should be running certain types of queries that monetdb will excel at. Mysql Results: -------------- $ php testmysql.php MySQL Test Dropping previous table (if present) Dropped in 0.000669 seconds creating table Created in 0.007732 seconds populating table Populated in 1.163141 seconds selecting from table queried 10000 records in 1.446646 seconds MonetDB Results: ---------------- $ php testmonet.php MonetDB Test Dropping table Dropped in 0.039597 seconds creating table Created in 0.001858 seconds populating table Populated in 7.513073 seconds selecting from table Queried 10000 records in 2.680834 seconds One interesting thing I noticed is that if I did not include the primary key index on the where-clause column, then mysql took ~80 seconds, and Monet still took about ~2.5 seconds. I guess this is because Monet just uses user-specified indexes as hints, so it had really created one anyway, yes? Anyway, here are the PHP scripts I used: testmonet.php ---------------- <?php echo "MonetDB Test\n"; $db = @monetdb_connect('sql', 'localhost', 50000, 'monetdb', 'monetdb') or die('Failed to connect to MonetDB<br>'); echo "Dropping table\n"; $start_time = microtime(true); $sql = "drop table big_table;"; $res = monetdb_query($sql); echo sprintf( "Dropped in %f seconds\n\n", microtime(true) - $start_time); echo "creating table\n"; $start_time = microtime(true); $sql = "create table big_table( col1 int primary key, col2 varchar(20), col3 int, col4 varchar(20) );"; $res = monetdb_query($sql) or die ("failed to create table" ); echo sprintf( "Created in %f seconds\n\n", microtime(true) - $start_time); echo "populating table\n"; $start_time = microtime(true); for( $i = 0; $i < 10000; $i ++ ) { $sql = "insert into big_table values ($i, 'col2 $i', $i, 'col4 $i' )"; $res = monetdb_query( $sql ) or die ("failed to insert at row $i " ); } echo sprintf( "Populated in %f seconds\n\n", microtime(true) - $start_time); echo "selecting from table\n"; $start_time = microtime(true); for( $i = 0; $i < 10000; $i ++ ) { $sql = "select col1 from big_table where col1 = $i"; $res = monetdb_query($sql); while ( $row = monetdb_fetch_assoc($res) ) { // print_r($row); } } echo sprintf( "Queried 10000 records in %f seconds\n\n", microtime(true) - $start_time); ?> testmysql.php ---------------- <?php echo "MySQL Test\n"; $db = @mysql_connect('localhost', 'root', '', 'monetdb') or die('Failed to connect to MySQL<br>'); mysql_select_db( "perftest" ) or die ("Failed to select DB" ); echo "Dropping previous table (if present)\n"; $start_time = microtime(true); $sql = "drop table big_table"; $res = mysql_query($sql); echo sprintf( "Dropped in %f seconds\n\n", microtime(true) - $start_time); echo "creating table\n"; $start_time = microtime(true); $sql = "create table big_table( col1 int primary key, col2 varchar(20), col3 int, col4 varchar(20) );"; $res = mysql_query($sql) or die ("failed to create table" ); echo sprintf( "Created in %f seconds\n\n", microtime(true) - $start_time); echo "populating table\n"; $start_time = microtime(true); for( $i = 0; $i < 10000; $i ++ ) { $sql = "insert into big_table values ($i, 'col2 $i', $i, 'col4 $i' )"; $res = mysql_query( $sql ) or die ("failed to insert at row $i " ); } echo sprintf( "Populated in %f seconds\n\n", microtime(true) - $start_time); echo "selecting from table\n"; $start_time = microtime(true); for( $i = 0; $i < 10000; $i ++ ) { $sql = "select col1 from big_table where col1 = $i"; $res = mysql_query($sql); while ( $row = mysql_fetch_assoc($res) ) { // print_r($row); } } echo sprintf( "queried 10000 records in %f seconds\n\n", microtime(true) - $start_time); ?> </body> </html>

2 3

[MonetDB-users] [Newbie] sizeof(ssize_t) error on Solaris 10
by Pranav Vaidya 13 Sep '07

13 Sep '07

Hello, I am trying to install MonetDB on Solaris 10/UltraSparc III and Fedora6/AMD. I tried running monetdb-install.sh as suggested in the documentation. The Fedora installation went on fine without any hitches. However, the solaris 10 installation failed. The script is failing due to some error on the test which determines sizeof(ssize_t). To see if there was some problem in my sys/types.h I compiled and executed a code which I think is used by the configure script. This test program ran without any issues writing a value of 4 to the conftest.val file. My guess is ssize_t is typedefd as an int on my machine. The test program is as follows : #include <stddef.h> #include <sys/types.h> long longval () { return (long) (sizeof (ssize_t)); } unsigned long ulongval () { return (long) (sizeof (ssize_t)); } #include <stdio.h> #include <stdlib.h> int main () { FILE *f = fopen ("conftest.val", "w"); if (! f) exit (1); if (((long) (sizeof (ssize_t))) < 0) { long i = longval (); if (i != ((long) (sizeof (ssize_t)))) exit (1); fprintf (f, "%ld\n", i); } else { unsigned long i = ulongval (); if (i != ((long) (sizeof (ssize_t)))) exit (1); fprintf (f, "%lu\n", i); } exit (ferror (f) || fclose (f) != 0); ; return 0; } I am attaching the relevant portion of the config.log that is produced. I would appreciate any inputs on how to resolve this issue and why it arises. ------------------------------------------------------------------------------------------------------------------------------------------------------ #include <sys/types.h> | | long longval () { return (long) (sizeof (ssize_t)); } | unsigned long ulongval () { return (long) (sizeof (ssize_t)); } | #include <stdio.h> | #include <stdlib.h> | int | main () | { | | FILE *f = fopen ("conftest.val", "w"); | if (! f) | exit (1); | if (((long) (sizeof (ssize_t))) < 0) | { | long i = longval (); | if (i != ((long) (sizeof (ssize_t)))) | exit (1); | fprintf (f, "%ld\n", i); | } | else | { | unsigned long i = ulongval (); | if (i != ((long) (sizeof (ssize_t)))) | exit (1); | fprintf (f, "%lu\n", i); | } | exit (ferror (f) || fclose (f) != 0); | | ; | return 0; | } configure:26151: error: cannot compute sizeof (ssize_t), 77 See `config.log' for more details. The following is the configure output - MonetDB>./configure checking build system type... sparc-sun-solaris2.10 checking host system type... sparc-sun-solaris2.10 checking target system type... sparc-sun-solaris2.10 checking for a BSD-compatible install... /usr/local/bin/ginstall -c checking whether build environment is sane... yes checking for gawk... gawk checking whether make sets $(MAKE)... yes checking for style of include used by make... GNU checking for gcc... gcc checking for C compiler default output file name... a.out checking whether the C compiler works... yes checking whether we are cross compiling... no checking for suffix of executables... checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ANSI C... none needed checking dependency style of gcc... none checking for egrep... egrep checking for ANSI C header files... no checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking how to run the C preprocessor... gcc -E checking for gcc... (cached) gcc checking whether we are using the GNU C compiler... (cached) yes checking whether gcc accepts -g... (cached) yes checking for gcc option to accept ANSI C... (cached) none needed checking dependency style of gcc... (cached) none checking for long... yes checking size of long... 4 checking whether byte ordering is bigendian... yes checking if your compiler is C99 compliant... yes checking for ant... no checking for java... /bin/java checking for Java >= 1.4, but < 1.6... yes -> 1.5.0_12 found checking for javac... /bin/javac checking for jar... /bin/jar checking for javadoc... /bin/javadoc checking for a sed that does not truncate output... /usr/local/bin/gsed checking for option to reload object files... -r checking for BSD-compatible nm... /usr/local/bin/nm -B checking whether ln -s works... yes checking how to recognise dependent libraries... pass_all checking dlfcn.h usability... no checking dlfcn.h presence... yes configure: WARNING: dlfcn.h: present but cannot be compiled configure: WARNING: dlfcn.h: check for missing prerequisite headers? configure: WARNING: dlfcn.h: see the Autoconf documentation configure: WARNING: dlfcn.h: section "Present But Cannot Be Compiled" configure: WARNING: dlfcn.h: proceeding with the preprocessor's result configure: WARNING: dlfcn.h: in the future, the compiler will take precedence configure: WARNING: ## --------------------------- ## configure: WARNING: ## Report this to monet(a)cwi.nl ## configure: WARNING: ## --------------------------- ## checking for dlfcn.h... yes checking for g++... g++ checking whether we are using the GNU C++ compiler... yes checking whether g++ accepts -g... yes checking dependency style of g++... none checking how to run the C++ preprocessor... g++ -E checking for g77... g77 checking whether we are using the GNU Fortran 77 compiler... yes checking whether g77 accepts -g... yes checking for flex... flex checking lex output file root... lex.yy checking whether yytext is a pointer... no checking for a BSD-compatible install... /usr/local/bin/ginstall -c checking for ld used by gcc... /usr/ccs/bin/ld checking if the linker (/usr/ccs/bin/ld) is GNU ld... no checking the maximum length of command line arguments... 262144 checking command to parse /usr/local/bin/nm -B output from gcc object... ok checking for objdir... .libs checking for ar... ar checking for ranlib... ranlib checking for strip... strip checking if gcc supports -fno-rtti -fno-exceptions... no checking for gcc option to produce PIC... -fPIC checking if gcc PIC flag -fPIC works... yes checking if gcc static flag -static works... no checking if gcc supports -c -o file.o... yes checking whether the gcc linker (/usr/ccs/bin/ld) supports shared libraries... yes checking whether -lc should be explicitly linked in... yes checking dynamic linker characteristics... solaris2.10 ld.so checking how to hardcode library paths into programs... immediate checking whether stripping libraries is possible... yes checking for shl_load... no checking for shl_load in -ldld... no checking for dlopen... yes checking whether a program can dlopen itself... yes checking whether a statically linked program can dlopen itself... yes checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... no configure: creating libtool appending configuration tag "CXX" to libtool checking for ld used by g++... /usr/ccs/bin/ld checking if the linker (/usr/ccs/bin/ld) is GNU ld... no checking whether the g++ linker (/usr/ccs/bin/ld) supports shared libraries... yes checking for g++ option to produce PIC... -fPIC checking if g++ PIC flag -fPIC works... yes checking if g++ static flag -static works... no checking if g++ supports -c -o file.o... yes checking whether the g++ linker (/usr/ccs/bin/ld) supports shared libraries... yes checking dynamic linker characteristics... solaris2.10 ld.so checking how to hardcode library paths into programs... immediate appending configuration tag "F77" to libtool checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... no checking for g77 option to produce PIC... -fPIC checking if g77 PIC flag -fPIC works... yes checking if g77 static flag -static works... no checking if g77 supports -c -o file.o... yes checking whether the g77 linker (/usr/ccs/bin/ld) supports shared libraries... yes checking dynamic linker characteristics... solaris2.10 ld.so checking how to hardcode library paths into programs... immediate checking for ANSI C header files... (cached) no checking whether time.h and sys/time.h may both be included... yes checking for dirent.h that defines DIR... yes checking for library containing opendir... none required checking alloca.h usability... no checking alloca.h presence... yes configure: WARNING: alloca.h: present but cannot be compiled configure: WARNING: alloca.h: check for missing prerequisite headers? configure: WARNING: alloca.h: see the Autoconf documentation configure: WARNING: alloca.h: section "Present But Cannot Be Compiled" configure: WARNING: alloca.h: proceeding with the preprocessor's result configure: WARNING: alloca.h: in the future, the compiler will take precedence configure: WARNING: ## --------------------------- ## configure: WARNING: ## Report this to monet(a)cwi.nl ## configure: WARNING: ## --------------------------- ## checking for alloca.h... yes checking getopt.h usability... no checking getopt.h presence... yes configure: WARNING: getopt.h: present but cannot be compiled configure: WARNING: getopt.h: check for missing prerequisite headers? configure: WARNING: getopt.h: see the Autoconf documentation configure: WARNING: getopt.h: section "Present But Cannot Be Compiled" configure: WARNING: getopt.h: proceeding with the preprocessor's result configure: WARNING: getopt.h: in the future, the compiler will take precedence configure: WARNING: ## --------------------------- ## configure: WARNING: ## Report this to monet(a)cwi.nl ## configure: WARNING: ## --------------------------- ## checking for getopt.h... yes checking netdb.h usability... no checking netdb.h presence... yes configure: WARNING: netdb.h: present but cannot be compiled configure: WARNING: netdb.h: check for missing prerequisite headers? configure: WARNING: netdb.h: see the Autoconf documentation configure: WARNING: netdb.h: section "Present But Cannot Be Compiled" configure: WARNING: netdb.h: proceeding with the preprocessor's result configure: WARNING: netdb.h: in the future, the compiler will take precedence configure: WARNING: ## --------------------------- ## configure: WARNING: ## Report this to monet(a)cwi.nl ## configure: WARNING: ## --------------------------- ## checking for netdb.h... yes checking for sys/types.h... (cached) yes checking for special C compiler options needed for large files... no checking for _FILE_OFFSET_BITS value needed for large files... no checking for _LARGE_FILES value needed for large files... no checking for an ANSI C-conforming const... yes checking for size_t... no checking return type of signal handlers... int checking for ptrdiff_t... yes checking for ssize_t... yes checking for __int64... no checking for long long... no checking for char... no checking size of char... 0 checking for short... no checking size of short... 0 checking for int... no checking size of int... 0 checking for long... (cached) yes checking size of long... (cached) 4 checking for void *... no checking size of void *... 0 checking for size_t... (cached) no checking size of size_t... 0 checking for ssize_t... (cached) yes checking size of ssize_t... configure: error: cannot compute sizeof (ssize_t), However, I think the problem is somewhere above this line as I was getting sizeof(char), sizeof (long long) as zeros. Kindly guide me as I am a relative newbie to MonetDB. Thanks in advance, Pranav. -- View this message in context: http://www.nabble.com/-Newbie--sizeof%28ssize_t%29-error-on-Solaris-10-tf44… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] [newbie] Loading a directory of XML files into a collection
by Philip Webster 11 Sep '07

11 Sep '07

Hi, I have a directory containing XML files, all sharing a common structure. I want to load them all into a collection so I can run queries against them using the XQuery interface in MonetDB4. The tutorials give useful examples that show how to load a single file into a collection, but I need an automated process to load all of the XML files I have. There are over 60,000 files, currently spread over 16 directories to make them more managable. I've been looking around on the Web, but I haven't found any XQuery examples that do what I want. Is it possible? If so, can anyone give an example to show me how to load my data? Thanks, Phil -- View this message in context: http://www.nabble.com/-newbie--Loading-a-directory-of-XML-files-into-a-coll… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3

[MonetDB-users] Not responding after sql server restart
by Franco Guidoli 11 Sep '07

11 Sep '07

Hi all: I'm trying to measure the response time of MonetDB against a commercial RDBMS, so I've made a dump of the data from my current database in order to load into MonetDB. I have approximately 2.6 million rows, divided into 26 flat files of 100k rows each one, which I load using then SQL command "copy into....". Everything works ok with the data load (performing a commit after each 100k file), and I can make use of that data in the same session from which I've loaded the data, but when I restart MonetDB Server, I can't login via SQL (I can start MonetDB Server, but SQL Client doesn't respond). Apparently, from what I can realize, after the shutdown of MonetDB Server, there is a big log file in Monet's sql_logs directory, and when I get a response from SQL Client, the log file is apparently empty (I've realized this loading only 200k rows). Is this the expected behaviour for the MonetDB SQL Server? Did I miss anything in order to avoid this? After the second start of the server, this doesn't happen anymore until I load new data. I'm working with MonetDB Server v5.0.0_beta1_2 (downloaded msi from sourceforge) over Windows XP, and the SQL Client is via JDBC. Thanks in advance for any help you can give me. Franco -- View this message in context: http://www.nabble.com/Not-responding-after-sql-server-restart-tf3762198.htm… Sent from the monetdb-users mailing list archive at Nabble.com.

5 4