- users-list - monetdb.org

[MonetDB-users] Invalid Credentials for user when restarted mserver5
by mobigital1 18 Apr '08

18 Apr '08

I imported some data into database from 6 files or so. I restarted database after each file. on latest file, after stopping the database, I decided to start it up manually and ran like this: /opt/monetdb/bin/mserver5 -dbinit="include sql;" --dbname=<bbb> --set mapi_open=true when opened mclient, it said: !InvalidCredentialsException:checkCredentials:Invalid credentials for user '....' HOWEVER, as last hope I decided to try starting again via merovigian, and I think it worked, except that it's taking its time now to sync up sql_log into the dbfarm. so for some reason starting database via merovigian and manually like above is not the same thing. Does merovigian pass some environment variables to the mserver5 process? -- View this message in context: http://www.nabble.com/Invalid-Credentials-for-user-when-restarted-mserver5-… Sent from the monetdb-users mailing list archive at Nabble.com.

3 4

[MonetDB-users] corruption on db restart
by mobigital1 17 Apr '08

17 Apr '08

I imported some millions of rows into a table: sql>select part, count(*) from frag group by part order by part; +------+-----------+ | part |count_node | +======+===========+ | 1 | 25205085 | | 2 | 25618423 | | 3 | 27380780 | | 4 | 26963069 | | 5 | 25661196 | | 6 | 27021186 | | 7 | 26058891 | | 8 | 28092822 | | 9 | 27528646 | | 10 | 26429092 | | 11 | 25194504 | | 12 | 25136210 | | 13 | 25105453 | | 14 | 24860071 | | 16 | 20672348 | | 17 | 19138139 | +------+-----------+ then I stopped the database, and wanted to start it back up to see how quickly it would come up. it took a few minutes to come up while it was comitting uncomitted transactions. When i started it up the space usage looked like this: 251721152 ./var/MonetDB5/dbfarm (251gb) 24181152 ./var/MonetDB5/sql_logs (24gb) after a few minutes it became like this: 249855172 ./var/MonetDB5/dbfarm (249gb) 12 ./var/MonetDB5/sql_logs however when it came up, i guess the data became corrupted because look at what happened to my query results now: sql>select part, count(*) from frag group by part order by part; +------+-----------+ | part |count_node | +======+===========+ | 1 | 25205085 | | 0 | 361722691 | | 17 | 19138139 | | 18 | 21414794 | +------+-----------+ there are total about 427 M rows, of which 361.7M are corrupted. There is nothing in the merovingian.log file at all since stop/start of database. Can someone advise what to do with this? 1. if possible to recover data, please let me know 2. otherwise what can I do to prevent this in the future? this is a huge roadblock. -- View this message in context: http://www.nabble.com/corruption-on-db-restart-tp16737747p16737747.html Sent from the monetdb-users mailing list archive at Nabble.com.

3 7

[MonetDB-users] SQLException in executeQuery() =Query did not produce a result set
by sateesh 17 Apr '08

17 Apr '08

Hi, When i try to execute a Query using Prepared Statement some times i am getting the below listed Error. It seems like when no rows are returned it throws this Exception.. I am hoping that it is a safely ignorable one.. When i use Statement i don't get this Error!! Regards Sateesh [08-59-15 09:59] ERROR com.lmco.dpa.core.services.persistance.QueryPerformer (129)- SQLException in executeQuery() =Query did not produce a result set at nl.cwi.monetdb.jdbc.MonetPreparedStatement.executeQuery(MonetPreparedStatement.java:228) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:93) at com.lmco.dpa.core.services.persistance.QueryPerformer.executeQuery(QueryPerformer.java:86) at com.lmco.dpa.storage.rdf.framework.DPARepositoryModelBuilder.getModelProperty(DPARepositoryModelBuilder.java:279) at com.lmco.dpa.storage.rdf.framework.DPARepositoryModelBuilder.getMetadataModelsMap(DPARepositoryModelBuilder.java:121) at com.lmco.dpa.storage.rdf.framework.DPAModelMetadataManager.init(DPAModelMetadataManager.java:185) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeCustomInitMethod(AbstractAutowireCapableBeanFactory.java:1237) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1203) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1167) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:427) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:339) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:267) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:110) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1095) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:857) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:423) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:249) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:155) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:246) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:160) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:291) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:352) at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:122) at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:76) at com.lmco.dpa.ui.common.dao.rdf.impl.UIRepositoryFacadeDaoImplTest.onSetUp(UIRepositoryFacadeDaoImplTest.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.internal.runners.ClassRoadie.runBefores(ClassRoadie.java:49) at org.junit.internal.runners.ClassRoadie.runProtected(ClassRoadie.java:36) at org.junit.internal.runners.JUnit4ClassRunner.run(JUnit4ClassRunner.java:42) at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:38) at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:460) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:673) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:386) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:196) -- View this message in context: http://www.nabble.com/SQLException-in-executeQuery%28%29-%3DQuery-did-not-p… Sent from the monetdb-users mailing list archive at Nabble.com.

2 1

[MonetDB-users] db log shrink
by Colin Foss 17 Apr '08

17 Apr '08

Is there any method, besides restarting the database, of shrinking the sql log file? When I am performing a large set of large inserts (via COPY INTO) the log file gets very large. I wish there was a way to cycle the log file. Also during these large batches of inserts the database server becomes less and less responsive until I am forced to restart the server. Upon restart and the normal recovery monet returns to a very responsive state.

3 2

[MonetDB-users] COPY INTO of data containing hebrew letters
by ewilde 16 Apr '08

16 Apr '08

hello again. now i have another problem. following your suggestion of using COPY INTO for the migration of my database from MSSql to MonetDB5, i indeed succeeded in copying some tables, enjoying very good performances (for example, one table with ~8 millions of records in ~13 seconds). the new problem i'm facing now is that using COPY INTO for data with hebrew letters ends up with error. i tried to supply COPY INTO a UNICODE enoded file, but than i have not succeeded in defining the tuple and record seperators. the MonetDB5 itself is capable of storing and retrieving hebrew letters. i can tell this because i have no problem inserting such data through JDBC (actually, right now i have a java process working hard and slowly on copying such a table). so the problem is probably somewhere in the mclient application. is there any workaround for that? thanks, ewilde.

2 1

Re: [MonetDB-users] how to completely remove the MonetDB5installation
by ewilde 16 Apr '08

16 Apr '08

hello! thanks for the latest info. i indeed found all the stuff in %APPDATA%, and i removed it, and the MonetDB5 has come back to life again. if you think i may be able to supply more info about that bug i described in the first place, don't hesitate to contact me. ewilde.

1 0

[MonetDB-users] Sorted materialized views
by Nils Grimsmo 16 Apr '08

16 Apr '08

Hello, all! I am about to prototype something, and it would be convenient to use SQL to throw it together quickly to see if it flies. I downloaded MonetDB yesterday, so I am quite fresh :-) I have a table with a set of columns, and the like to have a few materialized views or projections (or whatever you DB people call it ;-)) sorted on different columns. The views may also have selection, I am not sure yet. And given problem (a data query), I use some statistics to decide which sorting order is most convenient, look up a (preferably continuous) vertical part of the columns, scan through it, and possibly do some filtering. The queries may also be trees, in which case I might use a different sorting order for each branch, and then do merging based on some of the columns. Assume: CREATE TABLE t (a INT, b INT); INSERT INTO t VALUES (1, 3), (4, 2); I would like to do something like: CREATE VIEW v AS SELECT b, a FROM t ORDER BY b, a; This is not allowed (works if I remove ORDER BY). I would also like to have an index over v(b,a), like: CREATE UNIQUE INDEX j USING BTREE ON v (b, a) ; But this is never allowed on a view, right? Since updates are not an issue in the prototype, I could just create a new table like this: CREATE TABLE v (b int, a int, PRIMARY KEY(b, a), INDEX i USING BTREE (b ASC, a ASC)) AS SELECT b, a FROM t ORDER BY b, a; (Using both PRIMARY KEY and INDEX is always butter on bacon?) But this is not allowed because of the table definition, all I am allowed to do is: CREATE TABLE v (b, a) AS SELECT b, a FROM t ORDER BY b, a WITH DATA; If I use PRIMARY KEY(b, a), am I then guaranteed the table to be sorted on (b, a)? Is there any other way of enforcing this in SQL? 1. Any suggestions for what I should do? Is my best option to create all "views" as tables from scratch, and fill them by hand? 2. How much slower would this be than using low-level stuff like BATs and BUNs myself? (The merges between branches in my (problem level) queries are simple, but cannot be expressed as SQL.) Klem fra Nils

3 4

Re: [MonetDB-users] Trouble connecting - Invalid credentials
by kykim_lists＠mac.com 16 Apr '08

16 Apr '08

I found this subject in the archives, and I am having the same problem I am running on Mac OS X 10.4.11 I built MonetDB from source from MonetDB-Feb2008-SuperBall I am new to MonetDB, so please forgive any ignorance.. Here's what I did: > monetdb create foo # create the db > mserver5 --dbname=foo --dbinit="include sql;" # start the db > ./mclient -lsql sql>CREATE USER "bar" WITH PASSWORD 'password' NAME 'Foobar User' SCHEMA "sys"; sql>CREATE SCHEMA "bar" AUTHORIZATION "bar"; sql>ALTER USER "bar" SET SCHEMA "bar"; > ./mclient -lsql -ubar Password:password sql>\q > ./mclient -lsql -ubar Password:password !InvalidCredentialsException:checkCredentials:Invalid credentials for user 'ifm' Two things: 1) I am able to login as user 'monetdb' without any problem 2) If i stop and start 'mserver5', I can login ONCE I know that I probably should be using 'merovingian', but I'm still playing around. Any pointers? Anything I can do to help debug? Thanks, -kevin

3 6

[MonetDB-users] fail to connect via merovingian
by McKennirey.Matthew 16 Apr '08

16 Apr '08

2 2

Re: [MonetDB-users] how to completely remove the MonetDB5installation
by ewilde 14 Apr '08

14 Apr '08

the operationg system i want to completely remove MonetDB5 from is: windows server 2003 x64 r2

2 1