IRC log of #zope for Thursday, 2011-04-14

*** bowe has quit IRC00:06
*** davisagli has quit IRC00:08
*** davisagli has joined #zope00:09
*** Reite has quit IRC00:29
*** thetet has quit IRC00:34
*** hever has quit IRC00:34
*** linguini has joined #zope00:35
*** alexpilz1 has joined #zope00:39
*** Gogo|gui has quit IRC00:41
*** alexpilz has quit IRC00:41
*** m8 has quit IRC00:48
*** waldi_ has joined #zope00:58
*** mitchell`off has quit IRC00:58
*** waldi has quit IRC00:58
*** mitchell1off has joined #zope00:58
*** Arfrever has quit IRC01:07
*** planetzopebot has quit IRC01:07
*** planetzopebot has joined #zope01:09
*** runyaga has quit IRC01:16
*** J1m has quit IRC01:32
*** rodgort has quit IRC01:40
*** rodgort has joined #zope01:40
*** slackrunner has joined #zope01:42
*** hever has joined #zope02:03
*** shastry_ has quit IRC02:04
*** hever has quit IRC02:10
koshhail freaks!02:15
*** slackrunner has quit IRC02:16
*** eperez has quit IRC02:31
*** supton has quit IRC02:41
*** alga has quit IRC02:44
*** alecm has joined #zope02:45
*** srichter has quit IRC02:59
*** srichter has joined #zope03:04
*** FSCV has quit IRC03:11
*** zenwryly has quit IRC03:27
*** srichter has quit IRC03:30
*** srichter has joined #zope03:31
*** tiwula has quit IRC03:49
*** zenwryly has joined #zope04:03
*** tiwula has joined #zope04:04
*** alexpilz1 has quit IRC04:12
*** alexpilz has joined #zope04:16
*** webmaven has quit IRC04:33
*** linguini has quit IRC05:00
*** alexpilz has quit IRC05:02
*** alexpilz has joined #zope05:07
*** alecm has quit IRC05:09
*** alecm has joined #zope05:09
*** davisagli has quit IRC06:00
*** davisagli has joined #zope06:01
*** kleist has joined #zope07:02
*** Gogo|gui has joined #zope07:13
*** alecm has quit IRC07:14
*** alecm has joined #zope07:16
*** alecm has joined #zope07:16
*** Gogo|gui has quit IRC07:29
CIA-83davisagli * r121420 persistent/persistent/tests/ (test_picklecache.py test_pypicklecache.py): moving to avoid name collision on case-insensitive fs :-[07:32
CIA-83davisagli * r121421 persistent/ (buildout.cfg setup.py): include all test dependencies07:32
*** Reite has joined #zope07:39
*** sm has quit IRC07:59
*** tiwula has quit IRC08:16
*** Gogo|gui has joined #zope08:29
*** supton has joined #zope08:29
*** Gogo|gui has quit IRC08:33
CIA-83davisagli * r121422 persistent/persistent/__init__.py: fix spelling08:38
CIA-83davisagli * r121423 persistent/persistent/ (timestamp.py tests/test_timestamp.py): add missing __repr__ to Python TimeStamp08:38
*** wosc has joined #zope08:49
*** yvl has joined #zope09:00
*** __mac__ has joined #zope09:04
*** hever has joined #zope09:14
*** altipard has joined #zope09:15
*** zagy has joined #zope09:21
*** ccomb has joined #zope09:32
*** jimz has quit IRC09:35
*** trustedsage has quit IRC09:36
*** avoinea has joined #zope09:36
*** alga has joined #zope09:37
*** trustedsage has joined #zope09:39
*** Wu has joined #zope09:43
*** ccomb has quit IRC09:45
*** supton has quit IRC09:47
CIA-83icemac * r121424 zc.security/ (bootstrap.py buildout.cfg): added bootstrap.py + fixed URL of versions.cfg09:47
CIA-83icemac * r121425 zc.security/ (8 files in 3 dirs): Conform to repository policy.09:47
*** zobbo has joined #zope09:52
*** agroszer has joined #zope09:57
*** jimz has joined #zope09:59
*** alexpilz has quit IRC10:07
*** planetzopebot has quit IRC10:08
*** planetzopebot has joined #zope10:09
*** kleist_ has joined #zope10:09
*** eperez has joined #zope10:12
*** kleist has quit IRC10:13
*** kleist_ has quit IRC10:24
CIA-83icemac * r121426 zc.set/ (setup.py buildout.cfg CHANGES.txt):10:33
CIA-83- Added test extra to declare test dependency on ``zope.testing``.10:33
CIA-83- Added change log to tell that the packackes seems not to be compatible with Python 2.6+10:33
CIA-83icemac * r121427 zc.set/ (LICENSE.txt bootstrap.py COPYRIGHT.txt): Conform to repository policy.10:33
betabughmmm, doesn't Zope 2.13 have CatalogPathAware any more?10:34
betabugtrying this old app on 2.13 and it says ImportError: cannot import name CatalogPathAware10:34
betabughmmm, according to the code it's deprecated, but not yet removed10:38
*** goschtl has joined #zope10:58
*** sylvain has joined #zope11:01
*** vaninwagen has joined #zope11:18
*** ccomb has joined #zope11:26
vaninwagencan anyone help me with this bug in zopeproject: Error: There is a version conflict. We already have: zc.buildout 1.5.2 ?11:31
*** vaninwagen has quit IRC11:36
*** vaninwagen has joined #zope11:37
betabugvaninwagen: you get that with easy_install?11:41
vaninwagenzopeproject? yes11:42
vaninwageni installed it with distribute/easy_install11:42
betabugdid you use virtualenv?11:43
vaninwagenno11:43
vaninwagenis this recommended?11:43
vaninwageni used zopeproject-0.4.2-py2.6.egg11:43
betabugso probably the python you are using already has zc.buildout somewhere11:43
betabugwell, to tell you the truth, I don't know or use zopeproject11:44
vaninwagenso, is there an easier way?11:44
betabugbut this kind of thing is exactly what you avoid with virtualenv and --no-site-packages11:44
*** gwik has joined #zope11:44
betabugso, usually people use easy_install inside virtualenv11:45
*** mr_jolly has joined #zope11:45
*** mr_jolly has left #zope11:45
vaninwagenbut why is it a problem to have another buildout somewhere?11:47
betabugif the versions don't match, maybe it's not working fine11:47
vaninwagenok, which version is recommended?11:48
betabugI have no idea11:51
betabugjust install virtualenv11:52
betabugthen create an "empty" environment with that11:52
vaninwagenok, thanks11:52
betabugand use easy_install to install zopeproject there, it will get what it needs11:52
vaninwageni just found it to inconvenient always to switch to the virtualenv11:52
vaninwagenok, i will use virtualenv as a fallback11:52
vaninwagenthanks again :)11:53
betabugwell, maybe someone with more knowledge of zopeproject could tell you more11:53
betabugbut virtualenv is good to separate things11:53
vaninwagenso, did it in virtualenv but getting an error in meta.zcml12:04
vaninwagenis this known behaviour, easy to fix?12:04
betabugno idea, sorry12:09
betabugmaybe put the error on a pastebin ans ask here12:09
betabugsomeone more knowledgeable with this particular thing might wake up12:10
*** menesis has joined #zope12:13
vaninwagenso, here it is: http://paste.lisp.org/+2LQN12:15
vaninwagenwhen invoking :bin/<project_name>-ctl fg12:15
*** ccomb1 has joined #zope12:15
*** ccomb has quit IRC12:15
vaninwagenwithout the colon12:15
*** zobbo has left #zope12:16
*** TomBlockley has joined #zope12:19
*** mitchell1off is now known as mitchell`12:19
*** ccomb1 has quit IRC12:19
*** alexpilz has joined #zope12:20
betabughmmm, got my big, old app to run on 2.1312:29
betabugwith some hax0ring12:29
betabughmmmm, how do I run my tests in 2.13??12:32
betabugzopectl has forgotten all knowledge about "test"?12:32
*** mr_jolly has joined #zope12:33
*** j-w has joined #zope12:36
*** teix has joined #zope12:39
*** ccomb has joined #zope12:48
*** vaninwagen has quit IRC12:52
*** ccomb has quit IRC13:13
koshbetabug: no idea about that one13:24
betabughey kosh13:24
betabughow do you run your tests?13:24
koshbetabug: so far I have still not gotten relstorage to run as fast as zeo but it is only a few percent behind most of the time13:25
koshon the plus side though even with 500 simul connections I get no errors and zeo does not handle that, it starts giving conflicterrors even on reads13:25
koshI don't have any real tests13:25
betabugso, relstorage has its uses :-)13:25
koshI don't agree with test driven development13:25
betabugaha, well, I have lots of tests13:25
betabugand now playing around with 2.13, I'd like to run them13:26
koshI run into so few bugs per year that writing tests for so much code seems like a gigantic waste of time13:26
betabugthis unicode migration I'm doing now would be *really* scary without tests13:26
koshhave wget crawl the entire site and check the error log for errors13:27
betabugthat won't turn up all the rats13:28
betabugsince we're talking about how input is handled13:28
betabugso you input something e.g. in screen 2 and won't get an error till you hit screen 413:29
koshah I see13:29
betabugall my current tests pass, but now I'm createing a "walkthrough" with mechbrowser13:29
betabugthat goes through every corner of the UI and plays with all the interfaces13:30
koshusually if I do input testing I write a simple little script to do posting of various things and all my documents use the same form processor so if it works on one it will work on all13:30
betabugyeah, this codebase is not that organized unfortunately13:30
koshactually I have the same form processor for every document on every site with the way I have it setup :)13:31
betabugyeah, that's cool13:31
koshat least for the edit interface stuff, a lot of public viewer facing forms use a different form processing framework13:32
kosheventually I need to unify that13:32
koshI try to make as many things shared as possible13:35
betabugless code is good13:35
koshand whenever I find myself doing the same thing in more then a few sites I try to build it into one of my products13:35
betabugthis app has lots and lots of duplication13:35
koshand then find everyplace that used the old way and rip that way out and use only the new system13:35
koshit makes it so much easier to keep things updated13:35
koshthat is why when I put the version information on my images it fixed it on about 99%+ of cases without any changes on all sites, even ones that have not been updated in 5 years13:36
koshwhich makes every site faster with no manual work13:36
koshI am impressed though with relstorage doign stuff in very very high loads13:37
*** daMaestro has joined #zope13:37
*** ccomb has joined #zope13:37
*** menesis has quit IRC13:37
koshat 100 concurrency from ab and hitting the same page 100K times I would get about 5 errors with zeo and 0 with relstorage, at 500 concurrency I still get 0 with relstorage and hundreds with zeo and zeo won't really complete 1000 and relstorage handled 1000 on the last test still with no errors13:38
koshbut very slowly at that point13:38
koshright now I am running wget across a site to get profiling data13:39
*** goschtl has quit IRC13:48
*** thetet has joined #zope13:52
*** thetet has quit IRC13:52
teixkosh: interesting! are you using it with MySQL or PosgreSQL?13:54
betabugpostgre IIRC13:54
koshI have been testing with postgres13:56
koshthere is no way I would use mysql13:56
koshusing mysql seems to be exactly like saying I don't care about my data and I love spending time restoring systems13:58
*** TomBlockley_ has joined #zope13:58
CIA-83janwijbrand * r121428 megrok.chameleon/ (4 files in 3 dirs):13:59
CIA-83Grok's idea of view template namespaces is put into the 'options' namespace by13:59
CIA-83z3c.pt. This means namespaces like 'viewlet' and 'viewletmanager', but also13:59
CIA-83whatever namespace was set by the view component's namespace() method would not13:59
CIA-83be directly available in the template. This is fixed by updating the template13:59
CIA-83context with Grok's idea of template namespaces. Added a test to demonstrate the13:59
CIA-83issue.13:59
CIA-83janwijbrand * r121429 megrok.chameleon/src/megrok/chameleon/tests/cpt_fixture/app_templates/namespace.cpt: forgot to add the template13:59
*** TomBlockley has quit IRC14:00
*** TomBlockley_ is now known as TomBlockley14:00
teixkosh: eheh14:09
koshteix: mysql just does not seem reliable in practice, don't know exactly why just that it is not14:11
koshso far in 8 years or so I have not once had to restore a filestorage database14:13
koshbetabug: I just realized that zope.conf can use includes so I have started moving stuff common between my zope.conf into a seperate file14:31
koshbetabug: so now I can just configure all my databases in one file instead of 414:31
betabugnice14:33
*** dayne has joined #zope14:35
*** slackrunner has joined #zope14:39
*** goschtl has joined #zope14:46
*** vaninwagen has joined #zope14:46
*** j-w has quit IRC14:47
koshbetabug: my script that creates blobs from all the files/images in a db runs at least 10x faster thoug with zeo then with relstorage strangely enough14:52
betabugmaybe the blob support in relstorage is not optimal?14:53
koshbetabug: that script walks the entire db opening every container to find the objects it needs, guess that is a worse case scenario for rel storage though14:53
koshwell the conversion seems to run about the same speed, it is the finding process that is ungodly faster with zeo14:53
betabugaha14:53
betabuggrrrrr, I want to run my tests!!!14:59
koshhmm I went back to zeo and changed a single setting for caching my transient object container and now zeo is maintaining 500 requests concurrently with no errors and 18 req/s compared to relstorage at the same level of 6 req/s15:02
*** Wu has quit IRC15:02
koshhmm it also looks like with the pure zope + zeo setup I can pure more memory into caching since they take less memory then zope + relstorage + memcache + postgres does15:03
koshI have 4 zopes connected to 3 zeo servers, 1 zeo server for the main db, 1 zeo server for transient stuff and 1 zeo server for persistent session stuff15:05
koshseemed like a good idea to break it up instead of having 1 zeo server serve 3 dbs15:05
koshzeo definitely kicks a lot more ass in zope 2.1315:07
koshand this is just with blobstorage15:07
koshlater I want to test zlibstorage also15:07
koshsupposed to be even faster and better for memory usage15:08
*** menesis has joined #zope15:15
*** menesis has quit IRC15:25
* betabug installing 2.13 via buildout now, as that's supposed to have a testrunner15:32
*** vaninwagen has quit IRC15:34
koshI kind of installed mine with buildout15:35
kosh2.13 though is probably one of the biggest changes in zope in a long time, zope 2.x devel seems to be improving15:35
betabugwell, according to docs, virtualenv is the official way15:35
koshheh that was a disaster when I tried to get that working right, autostarting etc15:35
betabugwell, no idea, just wanted to see if it runs without ruining my system python15:37
koshwhen I did the buildout version it did not put anything in the system python15:39
koshwhat it did was make zopectl and zeoctl files that had all the eggs listed that zope uses15:39
koshso nothing was put anywhere other then where I built it15:40
betabugdunno, I now have a buildout inside a virtualenv :-)15:40
*** Arfrever has joined #zope15:42
betabughmmm, so buildout and easy_install do not mix15:45
koshI did not use easy_install for anything15:46
betabugwell, SimpleUserFolder wants ZRDB.Result15:46
betabugwhich now lives in Products.ZSQLMethods15:46
betabugwell, adding it to buildout.cfg gave an error, but it worked :-)15:48
*** slackrunner has quit IRC16:01
*** Reite has quit IRC16:02
*** huajie has joined #zope16:10
*** slackrunner has joined #zope16:10
*** slackrunner has joined #zope16:11
koshbetabug: well your idea better work or I am sending godzilla to wipe out greece16:23
betabugthe result will probably be you looking a few days later and finding godzilla drinking and partying with the greeks16:24
betabugmy ideas are great, but I still can't test my products with the buildout setup16:24
koshmaybe I will send him to japan instead then, they should be expecting him at this point given their major screwup16:24
*** dayne has quit IRC16:26
*** sm has joined #zope16:28
koshsee you freaks later16:31
betabughf kosh16:31
* kosh hands sm a crate a grenades and tosses betabug a bunch of pins16:31
*** bowe has joined #zope16:34
smlater kosh16:36
*** FSCV has joined #zope16:40
*** wosc has quit IRC16:42
betabugtrying my luck again with the zope mailing list16:50
betabug2 mails in 1 day, the listserver will break down16:50
*** daMaestro has quit IRC16:52
*** jimz has quit IRC16:58
*** __mac__ has quit IRC17:00
*** RiverRat has quit IRC17:02
*** Wu has joined #zope17:10
*** sm_ has joined #zope17:11
*** sm has quit IRC17:15
*** sm_ is now known as sm17:15
*** goschtl has quit IRC17:15
*** jimz has joined #zope17:23
*** Wu has quit IRC17:41
*** mcdonc has quit IRC17:45
*** thetet has joined #zope17:46
*** astoon has joined #zope17:47
*** mcdonc has joined #zope17:49
*** jeffschuler has joined #zope17:58
*** alvaro_o has joined #zope18:03
*** J1m has joined #zope18:06
*** huajie has quit IRC18:10
*** astoon has quit IRC18:16
*** altipard has quit IRC18:20
*** runyaga has joined #zope18:26
*** bowe has quit IRC18:26
*** supton has joined #zope18:28
*** avoinea has left #zope18:28
*** agroszer has quit IRC18:36
*** alvaro_o has quit IRC18:39
*** srichter has quit IRC18:40
*** strichter has joined #zope18:40
*** bowe has joined #zope18:41
*** Wu has joined #zope18:43
*** runyaga has quit IRC18:43
*** alga has quit IRC18:47
*** m8 has joined #zope18:59
jeffschuleri've got a corrupted ZODB. [Python 2.5.1 Plone 2.5.5 and I believe Zope3-1.0.] If I restore from a backup is it possible to apply the non-corrupted newer transactions from my corrupted Data.fs to the restored Data.fs?19:09
betabugjeffschuler: I don't think so19:11
betabugjeffschuler: what you would try is to take the corrupted data.fs and "cut" it from the back, till you get it functioning again19:11
jeffschulerbetabug: i believe the corruption came from hardware issues, so my thinking is that the corruption might not be at the end of the file. am i incorrect in this assumption?19:18
betabugno idea19:18
betabugif it's hardware indeed, it might be anywhere19:19
jeffschuleris there a good tool for "cutting" the file from the back?19:19
*** astoon has joined #zope19:19
betabughmmm, I think there is a procedure, a friend of mine used some while ago, let me ask19:19
*** Gogo|gui has joined #zope19:20
jeffschulerwhen starting zeo, i get a "ERROR ZODB.Connection Couldn't load state for 0x0c2f" -- a BadPickleGet error. is there a way to trace this to the transaction that failed?19:21
*** tiwula has joined #zope19:21
betabugI don't know, in 8 years of zope I never had those problems personally19:21
jeffschuler:-/19:21
betabugok, here is what my friend used: http://davidjb.com/blog/2010/07/plonezope-truncating-a-data-fs-back-to-a-certain-datetime19:24
betabugif it's at the end of the DB, your chances are good19:24
betabugif it's really hardware that ate your zodb, it might be tougher19:24
jeffschulerthanks betabug.19:25
betabugwell, good luck :-)19:25
*** eperez has quit IRC19:34
*** Spanktar has joined #zope19:34
*** altipard has joined #zope19:38
*** thetet has left #zope19:47
*** giampaolo has joined #zope19:59
*** runyaga has joined #zope20:01
*** runyaga has quit IRC20:01
*** runyaga has joined #zope20:01
*** TomBlockley has quit IRC20:03
*** eperez has joined #zope20:03
*** altipard has quit IRC20:07
*** webmaven has joined #zope20:08
*** altipard has joined #zope20:16
*** gwik has quit IRC20:28
*** alga has joined #zope20:29
jeffschuleri truncated Data.fs per betabug's suggestion to no success. I still get a "cPickle.BadPickleGet: 758" error when starting up my zeocluster client... any idea what this points to or how to debug further?20:31
betabugoutch, suxx20:32
jeffschulertesting Data.fs with fsrefs.py also ultimately fails with this error20:32
jeffschuleri'm about to try fsrecover.py though I imagine it may suffer same consequences20:33
jeffschulerdo you know what this points to? this is an inherited server and I'm new to Zope.20:34
*** mitchell` is now known as mitchell`off20:34
*** alexpilz has quit IRC20:36
betabugme I don't know this error20:37
betabugI know that serious damage to data.fs is only happening from hardware problems20:38
betabugwhile most problems are "at the end" of the file, with bad things happening while writing20:38
betabugso most people get off fine with truncating the data.fs20:38
betabugbut all of this is hearsay20:38
jeffschulerpickling is Python's object serialization, right? so BadPickleGet indicates that a binary object in the db was corrupted, and that trying to de-serialize it is failing  hard. can I somehow figure out which object this is happening on, and since Data.fs is an ordered transaction log, fix those transactions using those from a backup?20:42
betabugI think that should be possible, but I'm not the guy to talk to myself :-)20:42
*** alecm_ has joined #zope20:45
*** alecm_ has joined #zope20:45
*** alecm has quit IRC20:49
*** alecm_ is now known as alecm20:49
*** giampaolo has quit IRC21:10
*** rogererens has joined #zope21:16
*** rogererens1 has joined #zope21:16
*** RiverRat has joined #zope21:17
*** Wu has quit IRC21:21
*** teix has quit IRC21:33
*** menesis has joined #zope21:41
*** teix has joined #zope21:44
*** alecm has quit IRC21:46
*** bowe has quit IRC21:47
*** rogererens has quit IRC21:53
*** bowe has joined #zope22:01
*** gqlewis has joined #zope22:03
*** ccomb has quit IRC22:05
*** gqlewis has left #zope22:17
*** goschtl has joined #zope22:28
*** Gogo|gui has quit IRC22:36
*** goschtl has quit IRC22:36
*** jeffschuler has left #zope22:43
CIA-83ldr * r121430 z3c.form/src/z3c/form/widget.txt: typos22:49
CIA-83ldr * r121431 z3c.form/src/z3c/form/widget.txt: typos22:49
*** ccomb has joined #zope22:58
*** rogererens has joined #zope23:05
*** teix has quit IRC23:07
*** menesis has quit IRC23:27
*** m8 has quit IRC23:55
*** menesis has joined #zope23:56
*** alexpilz has joined #zope23:58

Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!