- users-list - monetdb.org

[MonetDB-users] Large XML instances with MonetDB/XQuery 4.38.5
by Christian Grün 02 Oct '10

02 Oct '10

Hi everyone, is it still possible to shred large XML instances with MonetDB/XQuery, or do I need more memory for shredding? I was just trying to the 1GB instance of XMark with WinXP 32Bit and 2GB RAM, and this is what I got: MonetDB>shred_doc("1gb.xml", "xmark"); #GDKmmap(536870912) fails, try to free up space [memory in use=36143780,virtual memory in use=1015480320] #GDKmmap(536870912) result [mem=26016940,vm=1005387776] !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0@0. !ERROR: [shred_url]: first error was: !ERROR: HEAPextend: failed to extend to 536870912 for 06\632theap !ERROR: shredBAT_append_str: APPEND-STR[_prop_text]( follow murders prov shoes p resent eager delivered defy bend viol here marquis powers complexion pillar cran ts agate ), BUNappend fails !ERROR: CMDshred_url: operation failed. pf:add-doc(...) produces the same output; the XML document itself is well-formed. Thanks, Christian

2 6

[MonetDB-users] Embedded SQL Example Hangs?
by Hering Cheng 23 Sep '10

23 Sep '10

Hi, I am trying to run the example embedded MonetDB server using the June 2010 SP2 release: $ ./Mbeddedsql5 --config=monetdb5.conf --time --dbname=test_db After entering a simple SQL statement on the standard input and pressing <ENTER>, the program hangs at mapi_query. Here is the stack trace: [1] _read(0x5, 0xffffffff7fffdf16, 0x2, 0x0, 0x0, 0x0), at 0xffffffff7a6d3d90 [2] read(0x5, 0xffffffff7fffdf16, 0x2, 0x0, 0x0, 0x0), at 0xffffffff7a6c48b8 [3] pipe_read(s = 0x10015fe50, buf = 0xffffffff7fffdf16, elmsize = 2U, cnt = 1U), line 3194 in "stream.c" [4] stream_readSht(s = 0x10015fe50, val = 0xffffffff7fffdf16), line 2679 in "stream.c" [5] bs_read(ss = 0x10015fcd0, buf = 0x100f7a012, elmsize = 1U, cnt = 8190U), line 2368 in "stream.c" [6] stream_read(s = 0x10015fcd0, buf = 0x100f7a012, elmsize = 1U, cnt = 8190U), line 181 in "stream.c" [7] read_line(mid = 0x100133950), line 2515 in "Mapi.c" [8] read_into_cache(hdl = 0x100f73f30, lookahead = 1), line 2993 in "Mapi.c" [9] mapi_execute_internal(hdl = 0x100f73f30), line 3240 in "Mapi.c" [10] mapi_query(mid = 0x100133950, cmd = 0x100147010 "select count(1) from taq.trade\n"), line 3277 in "Mapi.c" [11] main(argc = 4, av = 0xffffffff7fffe628), line 212 in "prog.c" Here is my MonetDB configuration: $ ./mserver5 --version MonetDB server v5.20.5 (64-bit), based on kernel v1.38.5 (64-bit oids) Release Jun2010-SP2 Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2010 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Found 64.0GiB available memory, 16 available cpu cores Configured for prefix: /GAAL/chenher/share/monetdb/distro-sparc-jun2010-sp2-64bit Libraries: libpcre: 8.10 2010-06-25 (compiled with 8.10) openssl: OpenSSL 1.0.0a 1 Jun 2010 (compiled with ) libxml2: 2.6.23 (compiled with 2.6.23) Compiled by: chenher@sfouxsrv073 (sparc-sun-solaris2.10) Compilation: cc -m64 -xcode=pic32 -I/GAAL/chenher/share/hans_boehm_gc/distro-sparc-7.1-64bit//include/ -g Linking : /usr/ccs/bin/ld -m64 -L/GAAL/chenher/share/openssl/distro-sparc-1.0.0a-64bit//lib/64/ -L/GAAL/chenher/share/pcre/distro-sparc-8.10-64bit//lib -L/GAAL/chenher/share/hans_boehm_gc/distro-sparc-7.1-64bit//lib/ The database test_db was created by a non-embedded mserver5 using the same configuration file. The non-embedded mserver5 was gracefully shut down just before running the embedded version. Thanks. Hering

1 0

Re: [MonetDB-users] newbies question
by Peter Boncz 21 Sep '10

21 Sep '10

Hello Olivier, MonetDB/XQuery and MonetDB/SQL are currently different servers, based on different MonetDB kernel versions (4 and 5). The new python library you are probably referring to, however, only works for MonetDB5 (thus SQL). MonetDB/XQuery can be accessed using JDBC, XRPC and C (mapi), as per the MonetDB/XQuery API documentation. Peter > -----Original Message----- > From: o.fournier(a)iktios.fr [mailto:o.fournier@iktios.fr] > Sent: Tuesday, September 21, 2010 5:57 PM > To: monetdb-users(a)lists.sourceforge.net > Subject: [MonetDB-users] newbies question > > Hi, > > I find the concept of MonnetDb interresting... > > So, I would like use MonnetDB in SQL and XML mode with python > interface. > Could I use the python MAPI module to request XML mode? > If not, have you plan to do it? > Or what method could I use to access XML Monnetdb from python? > > Thank you > > Olivier Founier > > > > ---------------------------------------------------------------------- > -------- > Start uncovering the many advantages of virtual appliances > and start using them to simplify application deployment and > accelerate your shift to cloud computing. > http://p.sf.net/sfu/novell-sfdev2dev > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users

1 0

[MonetDB-users] newbies question
by o.fournier＠iktios.fr 21 Sep '10

21 Sep '10

Hi, I find the concept of MonnetDb interresting... So, I would like use MonnetDB in SQL and XML mode with python interface. Could I use the python MAPI module to request XML mode? If not, have you plan to do it? Or what method could I use to access XML Monnetdb from python? Thank you Olivier Founier

1 0

[MonetDB-users] about create index command
by kun ren 17 Sep '10

17 Sep '10

Dear all, I have a problem on create index command, my table is t1,and have two column, c1 and c2. when I execute the sql command "create index index_c1 on t1(c1);" but the MonetDB said "Segmentation fault", what the question? Best regards!

2 2

Re: [MonetDB-users] MonetDB Copy File INTO
by Fabian Groffen 14 Sep '10

14 Sep '10

On 14-09-2010 01:04:41 +0000, mikeschill(a)users.sourceforge.net wrote: > Username: MikeSchill > > I really want to use the MonetDB for our processing but getting > problems trying to do a COPY INTO: Always fails on last line stating > missing '(field delimeter) line (last line) field (last field) > failed to import table > > COPY into STATEDATA from > C:\\Books\\RED.txt' using > delimiters '\t','\n'; > > No idea what I am doing wrong....fails on record 101 if I say COPY 100 > Records... Can you give us any details on what version of MonetDB you are using (such as the release, e.g. Jun2010-SP2)? Also is your data public, or can we get a copy of it to see if we can reproduce the problem? Regards, Fabian Groffen

1 0

[MonetDB-users] 64 bit build with 64 bit OIDs - Invalid data for large string table
by Alex Bo. 07 Sep '10

07 Sep '10

Hi, I built June-SP1 on Windows 64 bit 64 bit OIDs. I loaded a table with one string field with approximately 500M strings. I am running 'Select * from table limit 10', and what I see is this: #1: myVal1 #2: null #3: myVal2 #4: null #5: myVal3 #6: null ... It seems that nulls are inserted between every two consecutive values in the source. The rowcount of the table is correct. I looked inside the dbfarm folders and saw that the theap file is ~26GB, and the tail ~4.6GB. Inserting only 1M of the same data worked fine. Please advise, Thanks. -- View this message in context: http://old.nabble.com/64-bit-build-with-64-bit-OIDs---Invalid-data-for-larg… Sent from the monetdb-users mailing list archive at Nabble.com.

1 0

[MonetDB-users] Building June10-SP1 64 with 64 OID on Windows
by Alex Bo. 06 Sep '10

06 Sep '10

When using MONET_OID64=1 to build June10-SP1 on Windows 64, I get this in the MonetDB5 module: .\..\..\..\..\src\modules\mal\tokenizer.mx(562) : warning C4267: '=' : conversion from 'size_t' to 'int', possible loss of data How can I overcome this? (This did not happen with 32 bit OIDs) Thanks. -- View this message in context: http://old.nabble.com/Building-June10-SP1-64-with-64-OID-on-Windows-tp29632… Sent from the monetdb-users mailing list archive at Nabble.com.

2 2

[MonetDB-users] strPut error with large string tables
by Alex Bo. 02 Sep '10

02 Sep '10

Hi, (June2010 SP1 built on Windows) I loaded a table with a single string column successfully with approximately 500M string values. Running 'Select * from table limit 10' gives me this error: 'strPut: string heaps gets larger than 15GB.' What does this mean? -- View this message in context: http://old.nabble.com/strPut-error-with-large-string-tables-tp29593089p2959… Sent from the monetdb-users mailing list archive at Nabble.com.

3 3

[MonetDB-users] June2010 SP2 failed to build on Windows 64
by Alex Bo. 02 Sep '10

02 Sep '10

Hi, I have successfully built June2010 SP2 on Windows 32 bit. However, the same on 64 bit fails in the Monet module while trying to build 'monet_options.c'. I am getting a bunch of errors related to ws2tcpip.h: C:\Program Files (x86)\Microsoft Visual Studio 8\VC\PlatformSDK\include\ws2tcpip.h(29) : error C2079: 'imr_multiaddr' uses undefined struct 'in_addr' C:\Program Files (x86)\Microsoft Visual Studio 8\VC\PlatformSDK\include\ws2tcpip.h(30) : error C2079: 'imr_interface' uses undefined struct 'in_addr' C:\Program Files (x86)\Microsoft Visual Studio 8\VC\PlatformSDK\include\ws2tcpip.h(38) : error C2079: 'imr_multiaddr' uses undefined struct 'in_addr' C:\Program Files (x86)\Microsoft Visual Studio 8\VC\PlatformSDK\include\ws2tcpip.h(39) : error C2079: 'imr_sourceaddr' uses undefined struct 'in_addr' C:\Program Files (x86)\Microsoft Visual Studio 8\VC\PlatformSDK\include\ws2tcpip.h(40) : error C2079: 'imr_interface' uses undefined struct 'in_addr' C:\Program Files (x86)\Microsoft Visual Studio 8\VC\PlatformSDK\include\ws2tcpip.h(46) : error C2079: 'imsf_multiaddr' uses undefined struct 'in_addr' Please advise. Thanks. -- View this message in context: http://old.nabble.com/June2010-SP2-failed-to-build-on-Windows-64-tp29593272… Sent from the monetdb-users mailing list archive at Nabble.com.

2 3