IRC log of #zope3-dev for Wednesday, 2008-11-26

*** regebro1 has quit IRC00:04
*** flox has left #zope3-dev00:05
*** nyo has quit IRC00:06
*** nyo has joined #zope3-dev00:06
*** JaRoel|4D has quit IRC00:10
*** timte has quit IRC00:11
*** thetet has joined #zope3-dev00:23
*** markusleist has joined #zope3-dev00:25
*** romanofski has quit IRC00:31
*** pelle_ has quit IRC00:37
*** norro has quit IRC00:42
*** mintsauce has joined #zope3-dev00:50
mintsauceIs there someway I can raise a zope.security.interfaces.IForbidden error?00:50
*** malthe is now known as malthe|Zzz00:51
*** junkafarian has quit IRC01:02
*** dunny_ has joined #zope3-dev01:03
*** dunny has quit IRC01:05
*** sp0cksbeard has quit IRC01:11
*** lucielejard has quit IRC01:12
*** jamur2 has quit IRC01:19
*** mcdonc has quit IRC01:23
*** reco has quit IRC01:25
*** lurkymclurkleton has quit IRC01:27
*** mintsauce has quit IRC01:28
*** nyo has quit IRC01:35
*** greenman has quit IRC01:49
*** nathany has quit IRC01:50
*** replaceafill has quit IRC01:53
*** rocky has quit IRC01:55
*** J1m has quit IRC02:07
*** aaronv has joined #zope3-dev02:14
*** greenman has joined #zope3-dev02:16
*** aaronv has quit IRC02:17
*** Jell-O-Fishi has quit IRC02:17
*** jhauser has quit IRC02:21
*** fairwinds has joined #zope3-dev02:27
*** thetet has left #zope3-dev02:37
*** fmail has joined #zope3-dev03:01
*** fmail has left #zope3-dev03:01
*** whit has quit IRC03:07
*** jfkw has quit IRC03:07
*** quodt has quit IRC03:13
*** markusleist has quit IRC03:15
*** yota has quit IRC03:16
*** jsadjohnson has joined #zope3-dev03:23
*** jsadjohnson has left #zope3-dev03:24
*** kaeru has joined #zope3-dev03:31
*** dunny_ has quit IRC04:00
*** benji has quit IRC04:04
*** kaeru_ has joined #zope3-dev04:05
*** davisagli has left #zope3-dev04:10
*** kaeru_ has quit IRC04:14
*** mcdonc has joined #zope3-dev04:23
*** andycat has joined #zope3-dev04:25
*** dunny has joined #zope3-dev04:25
*** andycat has quit IRC04:34
*** strichter has quit IRC04:43
*** greenman has quit IRC05:16
*** whit has joined #zope3-dev05:21
*** alecm has quit IRC05:37
*** stub has joined #zope3-dev05:44
*** binseer has joined #zope3-dev06:13
*** fairwinds has quit IRC06:36
*** greenman has joined #zope3-dev06:39
*** davisagli has joined #zope3-dev06:44
*** stub has quit IRC07:12
*** stub has joined #zope3-dev07:12
*** stub has quit IRC07:17
*** jayaraj has joined #zope3-dev07:32
*** baijum has joined #zope3-dev07:52
*** whit has quit IRC08:12
*** baijum has quit IRC08:14
*** basti has joined #zope3-dev08:21
*** afd_ has joined #zope3-dev08:24
*** davisagli has left #zope3-dev08:26
*** jukart has joined #zope3-dev08:29
*** jukart has quit IRC08:37
*** agroszer has joined #zope3-dev08:43
*** greenman has quit IRC08:43
*** greenman has joined #zope3-dev08:45
*** markusleist has joined #zope3-dev08:49
*** Theuni1 has joined #zope3-dev08:57
*** __mac__ has joined #zope3-dev09:02
*** davisagli has joined #zope3-dev09:10
*** jukart has joined #zope3-dev09:20
*** afd__ has joined #zope3-dev09:21
*** afd_ has quit IRC09:21
*** agroszer_ has joined #zope3-dev09:25
*** agroszer has quit IRC09:33
*** srichter has joined #zope3-dev09:38
*** JaRoel|4D has joined #zope3-dev09:40
*** zagy has joined #zope3-dev09:44
*** iham|away is now known as iham09:49
*** zagy has quit IRC09:49
*** thetet has joined #zope3-dev09:51
*** zagy has joined #zope3-dev09:56
*** sm has quit IRC09:56
*** afd__ has quit IRC10:01
*** thetet has left #zope3-dev10:01
*** afd__ has joined #zope3-dev10:02
*** pelle_ has joined #zope3-dev10:03
*** baijum has joined #zope3-dev10:06
*** afd___ has joined #zope3-dev10:07
*** junkafarian has joined #zope3-dev10:08
*** afd____ has joined #zope3-dev10:12
*** quodt has joined #zope3-dev10:15
*** greenman has quit IRC10:18
*** afd__ has quit IRC10:22
*** davisagli has quit IRC10:22
*** greenman has joined #zope3-dev10:24
*** afd___ has quit IRC10:24
*** JaRoel|4_ has joined #zope3-dev10:25
*** romanofski has joined #zope3-dev10:32
*** mkerrin has joined #zope3-dev10:35
*** baijum has quit IRC10:36
*** MJ has joined #zope3-dev10:37
*** strichter has joined #zope3-dev10:41
*** malthe|Zzz is now known as malthe10:43
*** goschtl has joined #zope3-dev10:47
*** JaRoel|4D has quit IRC10:50
*** philiKON has joined #zope3-dev10:53
*** JaRoel|4_ has quit IRC10:54
*** srichter has quit IRC10:57
*** baijum has joined #zope3-dev11:00
*** JaRoel|4D has joined #zope3-dev11:02
*** ccomb has joined #zope3-dev11:23
*** pyqwer has joined #zope3-dev11:26
*** sawdog has joined #zope3-dev11:27
*** agroszer_ is now known as agroszer11:31
*** ktwilight_ has quit IRC11:31
*** JaRoel|4_ has joined #zope3-dev11:32
*** Count-Duckula has joined #zope3-dev11:37
Count-DuckulaWhat's the best way of creating a new Z3?  I'm used to using paster for Z2?11:37
*** JaRoel|__ has joined #zope3-dev11:38
afd____maybe zopeproject (I haven't used it, though)11:38
ccombCount-Duckula: http://new.zope.org/get-started11:38
*** nyo has joined #zope3-dev11:39
*** ktwilight has joined #zope3-dev11:44
*** JaRoel|4D has quit IRC11:46
Count-Duckulaccomb: Thanks looks liek what I was after11:48
*** junkafarian has quit IRC11:49
*** JaRoel|4_ has quit IRC11:53
*** harobed has joined #zope3-dev11:56
*** harobed has quit IRC11:59
*** harobed has joined #zope3-dev12:04
*** junkafarian_ has joined #zope3-dev12:31
*** junkafarian_ is now known as junkafarian12:33
*** regebro has joined #zope3-dev12:42
*** thetet has joined #zope3-dev12:51
*** jfkw has joined #zope3-dev13:00
*** tarek has joined #zope3-dev13:04
*** tarek has quit IRC13:18
*** tarek has joined #zope3-dev13:18
*** dunny has quit IRC13:19
*** rocky has joined #zope3-dev13:23
*** rocky has quit IRC13:24
*** jfkw_ has joined #zope3-dev13:25
*** jfkw has quit IRC13:25
*** BjornT has quit IRC13:25
*** wgrant has quit IRC13:25
*** BjornT has joined #zope3-dev13:25
*** wgrant has joined #zope3-dev13:25
*** greenman has quit IRC13:26
*** Count-Duckula has quit IRC13:37
*** MJ is now known as MJ|lunch13:45
*** rocky has joined #zope3-dev13:47
*** aaronv has joined #zope3-dev13:55
*** fairwinds has joined #zope3-dev14:01
*** thetet has left #zope3-dev14:02
*** iham has quit IRC14:27
*** jsadjohnson has joined #zope3-dev14:34
*** MJ|lunch is now known as MJ14:45
*** mgedmin has joined #zope3-dev14:48
*** ignas has joined #zope3-dev14:59
*** pelle_ has quit IRC15:08
*** harobed_ has joined #zope3-dev15:12
*** goschtl has quit IRC15:12
*** rocky has quit IRC15:25
*** yotaff has joined #zope3-dev15:25
*** pelle_ has joined #zope3-dev15:26
*** goschtl has joined #zope3-dev15:29
*** J1m has joined #zope3-dev15:29
*** benji has joined #zope3-dev15:31
*** benji has quit IRC15:37
*** benji_ has joined #zope3-dev15:37
*** benji_ is now known as benji15:37
*** projekt01 has joined #zope3-dev15:40
*** binseer has quit IRC15:43
*** binseer has joined #zope3-dev15:44
*** baijum has quit IRC15:49
*** iham has joined #zope3-dev15:54
*** redir has joined #zope3-dev15:59
*** jamur2 has joined #zope3-dev16:01
*** lurkymclurkleton has joined #zope3-dev16:01
*** benji has quit IRC16:01
*** lurkymclurkleton has quit IRC16:01
*** lurkymclurkleton has joined #zope3-dev16:02
*** benji has joined #zope3-dev16:04
*** redir has quit IRC16:06
*** lucielejard has joined #zope3-dev16:15
*** Jell-O-Fishi has joined #zope3-dev16:15
*** aaronv has quit IRC16:16
*** aaronv has joined #zope3-dev16:19
*** sp0cksbeard has joined #zope3-dev16:22
*** ktwilight has quit IRC16:24
*** aaronv_ has joined #zope3-dev16:27
*** aaronv has quit IRC16:27
*** harobed_ has quit IRC16:30
*** pelle_ has quit IRC16:32
*** aaronv has joined #zope3-dev16:33
*** aaronv_ has quit IRC16:34
*** nyo has quit IRC16:45
*** nyo has joined #zope3-dev16:49
*** thruflo has joined #zope3-dev16:52
*** sp0cksbeard has quit IRC16:57
*** ccomb1 has joined #zope3-dev17:01
*** iham has quit IRC17:06
*** binseer has quit IRC17:09
*** jayaraj has quit IRC17:11
*** iham has joined #zope3-dev17:11
*** whit has joined #zope3-dev17:14
*** ccomb has quit IRC17:16
*** ccomb has joined #zope3-dev17:24
*** rocky has joined #zope3-dev17:31
*** ccomb1 has quit IRC17:41
*** lucielejard has quit IRC17:43
*** MJ has quit IRC17:43
*** jamur2 has quit IRC17:54
*** lucielejard has joined #zope3-dev17:57
*** jamur2 has joined #zope3-dev18:00
*** sm has joined #zope3-dev18:07
*** goschtl has quit IRC18:08
*** whitmo has joined #zope3-dev18:09
*** jsadjohnson has quit IRC18:20
*** Theuni has joined #zope3-dev18:21
*** whit has quit IRC18:25
*** rocky has quit IRC18:34
J1mTheuni, ayt?18:35
*** Theuni1 has quit IRC18:35
J1mguess not18:35
benjiheh18:36
*** rocky has joined #zope3-dev18:36
*** ktwilight has joined #zope3-dev18:38
TheuniJ1m: here18:38
J1mI think we have a problem with managing ZEO client non-shared blob directories.18:39
TheuniHmm.18:39
J1mThe blob code doesn't expect blobs to dissappear from the blob dir.18:39
TheuniInteresting. From the top of my head that was a minor design goal along the way.18:40
J1mso if someone tried to implement some cron job to remove blob files that haven't been accessed in a while, there's a chance that a blob might need to read the file.18:40
J1mI think I'm going to have to:18:40
J1m- make the blob code more robust wrt disappearing files, and18:40
*** redir has joined #zope3-dev18:41
J1m- find some way to make sure that the file access stat is updated when a blob file is opened or when committed() is called.18:41
J1mespecially the later.18:41
J1mJust thought I'd see if you have any thoughts before I start.18:42
*** jukart has quit IRC18:42
* benji really wishes we didn't have to depend on a periodic process to clean up disused blobs.18:42
* benji mostly just hates cron.18:42
J1mI hate cron too, but I want multiple clients on a machine to share a common blob directory.18:43
J1mso It's hard to see how some in-process cache is going to know when blobs can be removed.18:43
benjithe same way a cron-run script would know, perhaps?18:44
benjii.e., the mtime18:44
J1mYeah, but then you have to implement cron-like functionality.18:44
J1mif it bugs you, we could implement cron with zc.async. :)18:44
benjior clean them up gradually18:44
benjiheh18:44
*** JaRoel|4D has joined #zope3-dev18:45
*** projekt01 has quit IRC18:45
mgedminJ1m: I used to be able to write to /var/www/download.zope.org/zope3.4/ on download.zope.org, but now I can't18:45
mgedmincould someone with write permissions there upload a new versions.cfg?18:45
benjisay, every time you access a blob file see if there are some old blobs to clean up (probably with a limit, so you don't spend too much time at any one blob access)18:46
mgedminthe current one hardcodes setuptools to 0.6c8, which doesn't work with svn 1.518:46
*** JaRoel|4_ has joined #zope3-dev18:46
J1mmgedmin, strichter is the owner of zope3.4.18:47
J1mstrichter, should I make that dir group writabe?18:48
mgedminok18:48
mgedminhe appears to be offline atm18:48
J1mbenji, yeah, we could do something like that, although it is potentionally kina complicated.18:48
J1mbenji, you really want to size-limit the blob cache.18:49
*** ccomb has quit IRC18:49
benjitrue; that sounds like an argument against doing the clean-up incrementally, but I don't understand it18:49
J1mdon't understand what?18:50
*** sawdog has quit IRC18:50
benjiwhy size-limiting the blob cache would require a periodic process18:50
J1mIt doesn't require one, but I suspect it would be simpler to implement with one.18:51
benjiin fact, enforcing the limit in an on-going way sounds safer than doing it periodically18:51
J1mYes, but computing the total size is expensive and keeping a running total isn't practical with multiple clients.18:51
benjimmm18:52
*** tarek has quit IRC18:53
J1munless maybe the clients stored the size in a file.18:54
*** redir has quit IRC18:54
J1manother option might be to employ some sort of fs quota system.18:54
J1mor putting the blobs on a separate partition.18:54
benjiI see some parallels between this and the external GC idea; maybe that analogy will lead to good ideas18:56
J1mI see it as being more like the object cache, where we really wish we had hard limits.18:57
*** ignas has quit IRC18:58
J1mwhich is a strike against a periodic process.18:59
*** tarek has joined #zope3-dev18:59
benjihmm18:59
*** JaRoel|__ has quit IRC19:00
benjiso there could be a file in the root of the blob dir that stores the total size of the contained blobs that the clients updated when they added/removed blobs and which they could use to decide when to remove an old blob file19:00
J1myeah19:01
J1mThen when you decide to remove a file, you have a lot os stating to do to decide what to remove.19:01
*** JaRoel|4D has quit IRC19:01
J1mThen when you decide to remove a file, you have a lot of stating to do to decide what to remove.19:01
benjihmm, could we have a ring file that stored blob IDs and last access time and use that instead of stat-o-rama?  Kinda like the ZEO cache ring.19:02
*** whit has joined #zope3-dev19:03
*** whitmo has quit IRC19:03
*** philiKON has quit IRC19:03
J1mwell, you could build some sort of duplicate directory implementation. Yes. :)19:03
benjiactually, you might not even have access time in there, just remove the "oldest" file referred to in the file19:03
J1mWe certainly wouldn't want it to behave like the refular cache file.19:03
benjiIOW, keep a MRU list on-disk and use that19:03
benjiright, not as stupid as a hard ring, more MRU-like (which may be too tricky to get right)19:04
J1mUnless we just used the standard directory data structures.19:04
TheuniJ1m: sorry. was gone for a second due to local interruption.19:04
J1mAlso, I suppose we could be less incremental.19:05
*** JaRoel|4_ has quit IRC19:05
J1mso, say, when you reach the limit, you might decide to remove some significant percentage of blobs from the cache (e.g. 50%) rather than just enough to fit.19:05
J1mThen you'd amortise the stats a bit.19:06
benjiwe don't have to remove the oldest possible file each time either, we could have some age after which we're willing to remove the blob file19:06
J1mI also assume that stats benefit from disk caches.19:06
J1myeah19:06
benjiyeah; wouldn't want to do that much work during a request though, so that approach would have to be a periodic process, I'd think19:06
J1mThen you're back to not having a hard limit.19:07
TheuniHmm.19:07
*** harobed has quit IRC19:07
J1mOr maybe you have a softer limit in addition to the hard limit.19:07
TheuniJ1m: ClientStorage was designed to cope with files going away. The blob itself not, unfortunately.19:08
J1mso when you hit the soft limit, you start removing things, but if you hit the hard limit, you have to block.19:08
J1mTheuni, yup19:08
TheuniBecause we load the blob when we load the proxy object, so committed data that goes away while having a reference to a Blob instance is a case not dealt with.19:08
TheuniWe could make the blob instance re-issue a load in that case ...19:09
J1mTheuni, yes19:09
J1mThat was my plan.19:09
J1mIt means we have to be a bit more defensive.19:09
Theuniyup19:09
benjiJ1m: the hard/soft combo is interesting19:09
J1mThe potentional race conditions will need some careful thought.19:10
Theunistats do benefit from disk caches19:10
Theuniunfortunately access stats are very often tuned away on current systems19:10
Theuniinitially the blob storage kept track of the sizes19:11
J1mYeah, although not on any I've tried recently. :)19:11
*** malthe is now known as malthe|away19:11
Theuniactually, initially it determined the size of the database together with the blob data19:11
Theuniwhen moving to the bushy directories this caused huge latencies on commit19:11
*** tarek has quit IRC19:11
* Theuni wonders what the 'relatime' flag is19:12
*** redir has joined #zope3-dev19:12
*** __mac__ has quit IRC19:12
Theuniah. it only updates if the old atime is older than the mtime.19:13
J1mI also suspect that the ZEO blob cache would benefit from a simpler directory layout.19:13
Theuniyou could chose to use the flat layout in that case19:13
*** nyo has quit IRC19:13
TheuniJ1m: this is true if your cache is significantly smaller than the storage19:14
Theunii guess having 65k blobs in the cache is sufficient for cache situations19:14
J1mThat's generally the idea. :)19:14
TheuniJ1m: that depends on whether your application suffers from load issues and you want your data to be everywhere :)19:15
Theunigotta go back scrubbing my flat. having dinner guests. :)19:16
J1mIN that case, I'd use a local replica, rather than a cache.19:16
J1mnp19:16
J1mI'm gonna go get something to eat myself.19:16
*** benji has quit IRC19:16
*** J1m has quit IRC19:16
*** benji has joined #zope3-dev19:18
*** philiKON has joined #zope3-dev19:22
*** tarek has joined #zope3-dev19:23
*** jamur2 has quit IRC19:28
*** davisagli has joined #zope3-dev19:30
*** toutpt has joined #zope3-dev19:31
*** strichter is now known as srichter19:31
*** rcrafton has joined #zope3-dev19:32
*** tarek has quit IRC19:43
*** philiKON has quit IRC19:45
*** toutpt has quit IRC19:45
*** iham has quit IRC19:46
*** iham has joined #zope3-dev19:48
*** iham has quit IRC19:49
*** markusleist has quit IRC20:02
*** lurkymclurkleton has quit IRC20:04
*** mkerrin has quit IRC20:08
*** quodt has quit IRC20:14
*** whitmo has joined #zope3-dev20:17
*** whit has quit IRC20:17
*** benji has quit IRC20:18
*** JaRoel|4D has joined #zope3-dev20:21
*** baijum has joined #zope3-dev20:22
*** whitmo has quit IRC20:26
*** whit has joined #zope3-dev20:26
*** benji has joined #zope3-dev20:27
*** nyo has joined #zope3-dev20:35
*** romanofs1i has joined #zope3-dev20:40
*** baijum has quit IRC20:40
*** baijum has joined #zope3-dev20:40
*** J1m has joined #zope3-dev20:44
*** romanofski has quit IRC20:51
*** baijum has quit IRC20:52
*** flox has joined #zope3-dev20:57
*** alecm has joined #zope3-dev20:59
*** ktwilight has quit IRC21:02
*** greenman has joined #zope3-dev21:02
*** ktwilight has joined #zope3-dev21:03
*** ktwilight has quit IRC21:05
*** pelle_ has joined #zope3-dev21:11
*** reco has joined #zope3-dev21:13
*** yotaff has quit IRC21:17
*** rocky has quit IRC21:20
*** ktwilight has joined #zope3-dev21:23
*** rocky has joined #zope3-dev21:25
*** nyo1 has joined #zope3-dev21:29
*** nyo has quit IRC21:30
*** mgedmin has quit IRC21:31
*** thruflo has quit IRC21:34
*** whitmo has joined #zope3-dev21:36
*** whit has quit IRC21:38
*** ktwilight has joined #zope3-dev21:41
*** ktwilight has quit IRC21:42
*** nyo1 has quit IRC21:45
*** nyo has joined #zope3-dev21:47
*** dunny has joined #zope3-dev21:49
*** philiKON has joined #zope3-dev21:51
*** ktwilight has joined #zope3-dev21:53
*** yota has joined #zope3-dev22:02
*** rocky has quit IRC22:08
*** rocky has joined #zope3-dev22:11
*** mcdonc has quit IRC22:13
*** natea_ has joined #zope3-dev22:17
*** ktwilight has joined #zope3-dev22:19
*** natea__ has joined #zope3-dev22:20
*** natea_ has quit IRC22:21
*** junkafarian has quit IRC22:22
*** benji has quit IRC22:26
*** TresEquis has joined #zope3-dev22:29
*** jukart has joined #zope3-dev22:39
*** malthe|away is now known as malthe22:51
*** philiKON has quit IRC22:58
*** afd____ has quit IRC22:59
*** norro has joined #zope3-dev23:02
*** nyo has quit IRC23:05
*** natea__ has quit IRC23:05
*** greenman has quit IRC23:06
*** malthe_ has joined #zope3-dev23:08
*** agroszer has quit IRC23:09
*** reco has quit IRC23:14
*** malthe has quit IRC23:14
*** malthe_ is now known as malthe23:15
*** philiKON has joined #zope3-dev23:16
*** mcdonc has joined #zope3-dev23:25
*** jukart has quit IRC23:32
*** redir has quit IRC23:50
*** greenman has joined #zope3-dev23:50
*** iham has joined #zope3-dev23:53

Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!