*** greenman has quit IRC | 00:02 | |
*** quodt has joined #zope3-dev | 00:04 | |
*** junkafarian has joined #zope3-dev | 00:05 | |
*** philiKON has quit IRC | 00:06 | |
*** malthe has quit IRC | 00:09 | |
*** junkafarian has quit IRC | 00:10 | |
*** flox has quit IRC | 00:10 | |
*** flox has joined #zope3-dev | 00:11 | |
*** lucielejard has quit IRC | 00:13 | |
*** davisagli has quit IRC | 00:25 | |
*** davisagli has joined #zope3-dev | 00:27 | |
*** reco has quit IRC | 00:27 | |
*** pelle_ has quit IRC | 00:32 | |
*** junkafarian has joined #zope3-dev | 00:34 | |
*** aaronv has quit IRC | 00:40 | |
*** philiKON has joined #zope3-dev | 00:42 | |
*** norro has quit IRC | 00:46 | |
*** redir has quit IRC | 00:48 | |
*** jhauser has quit IRC | 00:52 | |
*** benji has quit IRC | 00:52 | |
*** regebro has left #zope3-dev | 00:53 | |
*** nyo1 has quit IRC | 01:09 | |
*** quodt has quit IRC | 01:11 | |
*** philiKON has quit IRC | 01:11 | |
*** jamur2 has quit IRC | 01:11 | |
*** lurkymclurkleton has quit IRC | 01:15 | |
*** J1m has quit IRC | 01:21 | |
*** sp0cksbeard has quit IRC | 01:34 | |
*** flox has quit IRC | 01:45 | |
*** redir has joined #zope3-dev | 01:52 | |
*** redir_ has joined #zope3-dev | 01:56 | |
*** tarek has quit IRC | 02:04 | |
*** harobed has quit IRC | 02:06 | |
*** redir__ has joined #zope3-dev | 02:09 | |
*** nathany has quit IRC | 02:14 | |
*** redir_ has quit IRC | 02:14 | |
*** _srichter has joined #zope3-dev | 02:17 | |
*** redir_ has joined #zope3-dev | 02:19 | |
*** redir has quit IRC | 02:20 | |
*** redir_ has quit IRC | 02:23 | |
*** strichter has quit IRC | 02:26 | |
*** _srichter has quit IRC | 02:31 | |
*** _srichter has joined #zope3-dev | 02:31 | |
*** yota has quit IRC | 02:39 | |
*** redir__ has quit IRC | 02:41 | |
*** kaeru has joined #zope3-dev | 02:48 | |
*** davisagli has quit IRC | 02:59 | |
*** whit has joined #zope3-dev | 03:01 | |
*** kaeru has quit IRC | 03:11 | |
*** kaeru has joined #zope3-dev | 03:21 | |
*** davisagli has joined #zope3-dev | 03:39 | |
*** davisagli has quit IRC | 03:43 | |
*** davisagli has joined #zope3-dev | 03:43 | |
*** jfkw has quit IRC | 04:04 | |
*** davisagli has quit IRC | 04:07 | |
*** davisagli has joined #zope3-dev | 04:07 | |
*** greenman has joined #zope3-dev | 04:12 | |
*** andycat has joined #zope3-dev | 04:16 | |
*** dunny has joined #zope3-dev | 04:23 | |
*** junkafarian has quit IRC | 04:29 | |
*** andycat has quit IRC | 04:41 | |
*** davisagli_ has joined #zope3-dev | 04:47 | |
*** davisagli has quit IRC | 04:47 | |
*** alecm has quit IRC | 05:08 | |
*** strichter has joined #zope3-dev | 05:17 | |
*** dunny has quit IRC | 05:27 | |
*** dunny has joined #zope3-dev | 05:29 | |
*** _srichter has quit IRC | 05:32 | |
*** aaronv has joined #zope3-dev | 05:39 | |
*** davisagli_ has left #zope3-dev | 05:42 | |
*** aaronv has quit IRC | 05:44 | |
*** dunny has quit IRC | 05:55 | |
*** bigkevmcd has quit IRC | 06:02 | |
*** kaeru has quit IRC | 06:33 | |
*** jayaraj has joined #zope3-dev | 06:43 | |
*** fairwinds has quit IRC | 06:59 | |
*** binseer has joined #zope3-dev | 07:00 | |
*** greenman has quit IRC | 07:15 | |
*** brandon_rhodes has quit IRC | 07:29 | |
*** davisagli has joined #zope3-dev | 07:32 | |
*** jayaraj has quit IRC | 07:53 | |
*** Aiste has quit IRC | 07:54 | |
*** binseer_ has joined #zope3-dev | 07:56 | |
*** jayaraj has joined #zope3-dev | 07:56 | |
*** Aiste has joined #zope3-dev | 07:57 | |
*** binseer has quit IRC | 08:07 | |
*** andycat has joined #zope3-dev | 08:08 | |
*** whit has quit IRC | 08:09 | |
*** whit has joined #zope3-dev | 08:21 | |
*** andycat has quit IRC | 08:23 | |
*** afd__ has joined #zope3-dev | 08:34 | |
*** JaRoel|4D has quit IRC | 08:41 | |
*** basti has joined #zope3-dev | 08:43 | |
*** jukart has joined #zope3-dev | 08:46 | |
*** tarek has joined #zope3-dev | 08:47 | |
*** jukart has quit IRC | 08:48 | |
*** agroszer_ has joined #zope3-dev | 08:49 | |
*** jukart has joined #zope3-dev | 08:52 | |
*** yota has joined #zope3-dev | 08:59 | |
*** dunny has joined #zope3-dev | 09:01 | |
*** __mac__ has joined #zope3-dev | 09:03 | |
*** binseer has joined #zope3-dev | 09:08 | |
*** jayaraj_ has joined #zope3-dev | 09:08 | |
*** dunny has quit IRC | 09:16 | |
*** basti has quit IRC | 09:17 | |
*** basti has joined #zope3-dev | 09:17 | |
*** fmail has joined #zope3-dev | 09:20 | |
*** jayaraj has quit IRC | 09:20 | |
*** binseer_ has quit IRC | 09:21 | |
*** fmail has left #zope3-dev | 09:21 | |
*** alga has joined #zope3-dev | 09:25 | |
*** afd__ has quit IRC | 09:26 | |
*** afd__ has joined #zope3-dev | 09:26 | |
*** afd__ has quit IRC | 09:31 | |
*** afd___ has joined #zope3-dev | 09:31 | |
*** dunny has joined #zope3-dev | 09:38 | |
*** JaRoel|4D has joined #zope3-dev | 09:44 | |
*** wgrant_ has joined #zope3-dev | 09:45 | |
*** JaRoel|4_ has joined #zope3-dev | 09:46 | |
*** fRiSi has joined #zope3-dev | 09:46 | |
*** wgrant has quit IRC | 09:46 | |
*** pelle_ has joined #zope3-dev | 09:57 | |
*** pyqwer has joined #zope3-dev | 09:58 | |
*** projekt01 has joined #zope3-dev | 10:02 | |
*** JaRoel|4D has quit IRC | 10:03 | |
*** mkerrin has joined #zope3-dev | 10:04 | |
*** whit has quit IRC | 10:06 | |
*** whit has joined #zope3-dev | 10:07 | |
*** whit has quit IRC | 10:09 | |
*** jpcw has joined #zope3-dev | 10:11 | |
*** junkafarian has joined #zope3-dev | 10:12 | |
*** binseer_ has joined #zope3-dev | 10:19 | |
*** malthe has joined #zope3-dev | 10:24 | |
*** greenman has joined #zope3-dev | 10:27 | |
*** philiKON has joined #zope3-dev | 10:34 | |
*** kaeru has joined #zope3-dev | 10:34 | |
*** binseer has quit IRC | 10:36 | |
*** jayaraj_ has quit IRC | 10:37 | |
*** jayaraj_ has joined #zope3-dev | 10:39 | |
*** wgrant_ is now known as wgrant | 10:39 | |
*** quodt has joined #zope3-dev | 10:54 | |
*** harobed has joined #zope3-dev | 10:58 | |
*** davisagli has left #zope3-dev | 10:59 | |
*** whit has joined #zope3-dev | 11:08 | |
*** MJ has joined #zope3-dev | 11:11 | |
*** binseer_ has quit IRC | 11:12 | |
*** binseer has joined #zope3-dev | 11:15 | |
*** regebro has joined #zope3-dev | 11:24 | |
*** ccomb has joined #zope3-dev | 11:24 | |
*** jfkw has joined #zope3-dev | 11:25 | |
*** toutpt has joined #zope3-dev | 11:34 | |
*** nyo has joined #zope3-dev | 11:35 | |
*** sawdog has joined #zope3-dev | 11:36 | |
*** MJ has quit IRC | 11:42 | |
*** sawdog has quit IRC | 11:48 | |
*** markusleist has joined #zope3-dev | 11:49 | |
*** junkafarian_ has joined #zope3-dev | 11:57 | |
*** junkafarian has quit IRC | 12:02 | |
*** agroszer_ is now known as agroszer | 12:02 | |
*** sawdog has joined #zope3-dev | 12:02 | |
*** basti has quit IRC | 12:23 | |
*** junkafarian_ is now known as junkafarian | 12:34 | |
*** thruflo has joined #zope3-dev | 12:36 | |
*** MJ has joined #zope3-dev | 12:44 | |
*** Theuni1 has joined #zope3-dev | 12:45 | |
*** whit has quit IRC | 12:53 | |
*** tarek has quit IRC | 12:57 | |
*** greenman has quit IRC | 12:58 | |
*** dunny has quit IRC | 12:59 | |
*** pelle_ has quit IRC | 13:01 | |
*** aaronv has joined #zope3-dev | 13:03 | |
*** tarek has joined #zope3-dev | 13:05 | |
*** tarek has quit IRC | 13:20 | |
*** tarek has joined #zope3-dev | 13:20 | |
*** projekt01 has quit IRC | 13:20 | |
*** toutpt has quit IRC | 13:35 | |
*** jukart has quit IRC | 13:37 | |
*** sunew has joined #zope3-dev | 13:37 | |
*** thetet has joined #zope3-dev | 13:43 | |
*** rocky has quit IRC | 13:51 | |
*** zagy has joined #zope3-dev | 13:52 | |
*** rocky has joined #zope3-dev | 13:52 | |
*** jhauser has joined #zope3-dev | 13:58 | |
*** thetet has left #zope3-dev | 13:58 | |
*** goschtl has joined #zope3-dev | 13:59 | |
*** jayaraj_ has quit IRC | 14:13 | |
*** jayaraj has joined #zope3-dev | 14:13 | |
*** jukart has joined #zope3-dev | 14:22 | |
*** pelle_ has joined #zope3-dev | 14:23 | |
*** aaronv has quit IRC | 14:32 | |
*** agroszer_ has joined #zope3-dev | 14:39 | |
*** agroszer has quit IRC | 14:39 | |
*** danfairs has joined #zope3-dev | 14:46 | |
*** tarek has quit IRC | 14:48 | |
*** tarek has joined #zope3-dev | 14:48 | |
*** brandon_rhodes has joined #zope3-dev | 14:57 | |
*** ignas has joined #zope3-dev | 15:00 | |
*** yotaff has quit IRC | 15:01 | |
*** fairwinds has joined #zope3-dev | 15:05 | |
*** yotaff has joined #zope3-dev | 15:12 | |
*** toutpt has joined #zope3-dev | 15:20 | |
*** Theuni1 has quit IRC | 15:23 | |
*** Theuni1 has joined #zope3-dev | 15:25 | |
*** benji has joined #zope3-dev | 15:26 | |
*** J1m has joined #zope3-dev | 15:33 | |
*** pelle_ has quit IRC | 15:35 | |
*** afd___ has quit IRC | 15:40 | |
*** afd___ has joined #zope3-dev | 15:40 | |
*** chaoflow has quit IRC | 15:46 | |
*** JaRoel|4_ has quit IRC | 15:46 | |
*** chaoflow has joined #zope3-dev | 15:47 | |
*** aaronv has joined #zope3-dev | 15:59 | |
*** agroszer_ is now known as agroszer | 16:01 | |
*** jamur2 has joined #zope3-dev | 16:01 | |
*** lurkymclurkleton has joined #zope3-dev | 16:01 | |
*** lurkymclurkleton has joined #zope3-dev | 16:02 | |
*** goschtl has left #zope3-dev | 16:06 | |
*** kiorky has quit IRC | 16:07 | |
*** alga has quit IRC | 16:11 | |
*** kiorky has joined #zope3-dev | 16:11 | |
*** aaronv has quit IRC | 16:13 | |
*** Theuni2 has joined #zope3-dev | 16:18 | |
*** Theuni1 has quit IRC | 16:20 | |
*** thruflo has quit IRC | 16:21 | |
*** thruflo has joined #zope3-dev | 16:21 | |
*** afd____ has joined #zope3-dev | 16:24 | |
*** afd___ has quit IRC | 16:24 | |
*** thruflo has left #zope3-dev | 16:24 | |
*** aaronv has joined #zope3-dev | 16:32 | |
*** sunew has quit IRC | 16:45 | |
*** sp0cksbeard has joined #zope3-dev | 16:54 | |
*** __mac__ has quit IRC | 16:54 | |
*** menesis has joined #zope3-dev | 16:59 | |
*** kaeru has quit IRC | 17:02 | |
*** whit has joined #zope3-dev | 17:07 | |
*** jayaraj has quit IRC | 17:13 | |
*** binseer has quit IRC | 17:15 | |
*** romanofski has quit IRC | 17:16 | |
*** reco has joined #zope3-dev | 17:20 | |
*** philiKON has quit IRC | 17:25 | |
*** visitor_olol has joined #zope3-dev | 17:26 | |
*** visitor_olol has quit IRC | 17:27 | |
*** oubaouba has joined #zope3-dev | 17:27 | |
*** menesis has quit IRC | 17:29 | |
*** oubaouba has quit IRC | 17:29 | |
*** menesis has joined #zope3-dev | 17:30 | |
*** JaRoel|4D has joined #zope3-dev | 17:42 | |
*** strichter has quit IRC | 17:43 | |
*** nathany has joined #zope3-dev | 17:46 | |
*** Theuni2 has quit IRC | 17:50 | |
*** strichter has joined #zope3-dev | 17:56 | |
*** lucielejard has joined #zope3-dev | 17:59 | |
*** afd____ has quit IRC | 18:14 | |
*** afd____ has joined #zope3-dev | 18:15 | |
*** philiKON has joined #zope3-dev | 18:17 | |
*** MJ has quit IRC | 18:24 | |
*** jukart has quit IRC | 18:25 | |
*** Theuni1 has joined #zope3-dev | 18:26 | |
*** goschtl has joined #zope3-dev | 18:28 | |
*** davisagli has joined #zope3-dev | 18:33 | |
*** strichter has quit IRC | 18:34 | |
*** strichter has joined #zope3-dev | 18:34 | |
*** iham is now known as iham|brb | 18:37 | |
Theuni1 | J1m: If I understand your blob zeo cache patch correctly, the default check frequency option will cause the real cache boundary to be up to 200% of the cache size boundary | 18:38 |
---|---|---|
J1m | Yes. | 18:38 |
J1m | That math probably wants to be reworked. | 18:38 |
J1m | It also gets more complex with multiple clients sharing the same blob directory. | 18:39 |
Theuni1 | right | 18:39 |
Theuni1 | My concern for the default value would be to choose something where the results are obvious to the user. | 18:40 |
J1m | We'll often have 8 clients sharing a blob directory. | 18:40 |
J1m | Yeah, although they will also probably be wrong. | 18:40 |
J1m | also note that the default is to put no limit on it. | 18:40 |
Theuni1 | Ah. That's an obvious default. :) | 18:40 |
J1m | But things could be rearranged a bit. I'll probably revisit this when I have a bit more time. | 18:41 |
Theuni1 | So the math for one client is "worst case size = limit size * (1 + check_size/100)" | 18:41 |
J1m | Yes, I think so. | 18:42 |
Theuni1 | for multiple clients I'd assume worst case = limit_size * (1 + check_size*clients/100) | 18:42 |
J1m | There are lots of edge cases. | 18:42 |
Theuni1 | I think the worst case is relatively straight. | 18:42 |
*** strichter has quit IRC | 18:42 | |
*** strichter has joined #zope3-dev | 18:43 | |
J1m | It might be better to set the check size to something much smaller, like 10 or 20 and then reduce the size to (1-check) * target | 18:43 |
J1m | or 100- or whatever. | 18:44 |
J1m | so if we check every 10% of the target, we'd reduce to 90% of the target. | 18:44 |
J1m | so then the target would be the theoretical worst case. | 18:44 |
J1m | I didn't put much effort into this detail in the first cut as there are harder issues to deal with. | 18:45 |
Theuni1 | sure. | 18:45 |
Theuni1 | i stumbled over this first as I'm reading the diff top down :) | 18:45 |
J1m | OT, I'm going to refactor blob storage into a mix-in and the existing wrapper. | 18:47 |
J1m | I'm then going to make FileStorage and MappingStorage support blobs directly. | 18:47 |
J1m | This will allow much better packing. | 18:48 |
Theuni1 | Sounds like you ran into issues with the proxy? | 18:48 |
Theuni1 | ah | 18:48 |
*** agroszer_ has joined #zope3-dev | 18:48 | |
Theuni1 | thought something like that | 18:48 |
J1m | I think the proxy was a good start as it allowed us to work things out without disturbing too many other things. | 18:48 |
Theuni1 | yup | 18:49 |
J1m | But now, I'm inclined to make it easy for storages to support blobs directly, mainly, again, to do a better job with packing. | 18:49 |
J1m | The biggest challenge will be coming up with reusable tests. | 18:49 |
Theuni1 | Interesting. I would have expected them to be. | 18:50 |
Theuni1 | At least for zeoraid we've thrown them into the mix IIRC. | 18:50 |
J1m | I don't now what "them" you are refering to. | 18:50 |
Theuni1 | the blob tests. but we didn't. right. they're in doctests. | 18:51 |
Theuni1 | I've gotta grab food and be social a bit. :) | 18:52 |
J1m | doctests can be made resuable. | 18:52 |
Theuni1 | i'm not arguing that | 18:52 |
J1m | sure, I'm hungry too. | 18:52 |
Theuni1 | they just aren't in the current state :) | 18:52 |
J1m | Yup | 18:52 |
Theuni1 | enjoy your food | 18:52 |
J1m | you too | 18:52 |
*** nathany has quit IRC | 18:53 | |
*** nathany has joined #zope3-dev | 18:54 | |
*** bigkevmcd has joined #zope3-dev | 18:56 | |
*** iham|brb is now known as iham | 18:58 | |
*** pyqwer has quit IRC | 19:03 | |
*** agroszer has quit IRC | 19:04 | |
*** iham is now known as iham|away | 19:04 | |
*** davisagli has left #zope3-dev | 19:04 | |
*** fRiSi has quit IRC | 19:09 | |
*** lucielejard has quit IRC | 19:09 | |
*** Theuni2 has joined #zope3-dev | 19:10 | |
*** Theuni1 has quit IRC | 19:10 | |
*** sm has joined #zope3-dev | 19:11 | |
*** goschtl has quit IRC | 19:14 | |
*** whit has quit IRC | 19:18 | |
*** norro has joined #zope3-dev | 19:20 | |
*** toutpt has quit IRC | 19:23 | |
*** sawdog has quit IRC | 19:24 | |
*** nyo has quit IRC | 19:25 | |
*** redir has joined #zope3-dev | 19:26 | |
*** ccomb has quit IRC | 19:30 | |
*** JaRoel|4_ has joined #zope3-dev | 19:38 | |
*** davisagli has joined #zope3-dev | 19:39 | |
*** romanofski has joined #zope3-dev | 19:40 | |
*** malthe has quit IRC | 19:47 | |
Theuni2 | J1m: i ran a simulation on your check ration and size suggestion and doing 10% check size and 100-check target for cache compaction i end up with a high mark of 104% and a low mark of 89% while checking about every 0.002% of all operations | 19:48 |
Theuni2 | s/ration/ratio/ | 19:48 |
Theuni2 | Ah. Actually, the margin that we grow over the cache size equals roughly under the maximum object size in the database. | 19:50 |
*** JaRoel|4D has quit IRC | 19:53 | |
*** JaRoel|4_ has quit IRC | 19:55 | |
*** mkerrin has quit IRC | 19:55 | |
*** lucielejard has joined #zope3-dev | 20:07 | |
*** junkafarian has quit IRC | 20:07 | |
*** alecm has joined #zope3-dev | 20:07 | |
*** harobed has quit IRC | 20:09 | |
*** jukart has joined #zope3-dev | 20:11 | |
*** ignas has quit IRC | 20:15 | |
*** afd____ has quit IRC | 20:17 | |
*** nathany has quit IRC | 20:19 | |
*** afd____ has joined #zope3-dev | 20:22 | |
*** _srichter has joined #zope3-dev | 20:22 | |
*** nathany has joined #zope3-dev | 20:23 | |
*** strichter has quit IRC | 20:24 | |
*** sunew has joined #zope3-dev | 20:28 | |
*** Theuni2 has quit IRC | 20:28 | |
*** reco has quit IRC | 20:38 | |
*** quodt has quit IRC | 20:41 | |
*** toutpt has joined #zope3-dev | 20:43 | |
*** lucielejard has quit IRC | 20:45 | |
*** lucielejard has joined #zope3-dev | 20:51 | |
*** aaronv has quit IRC | 20:52 | |
*** jukart has quit IRC | 20:54 | |
*** aaronv has joined #zope3-dev | 20:55 | |
*** benji is now known as Guest45237 | 20:58 | |
*** benji_ has joined #zope3-dev | 20:58 | |
*** JaRoel|4D has joined #zope3-dev | 20:58 | |
*** benji_ is now known as benji | 20:59 | |
*** MrTopf has joined #zope3-dev | 21:06 | |
*** agroszer_ is now known as agroszer | 21:13 | |
*** philiKON_ has joined #zope3-dev | 21:13 | |
*** ignas has joined #zope3-dev | 21:17 | |
*** aaronv has quit IRC | 21:17 | |
*** sunew has quit IRC | 21:25 | |
*** dunny has joined #zope3-dev | 21:28 | |
*** philiKON has quit IRC | 21:28 | |
*** zagy has quit IRC | 21:31 | |
*** markusleist has quit IRC | 21:32 | |
*** __mac__ has joined #zope3-dev | 21:35 | |
*** benji is now known as Guest85953 | 21:46 | |
*** benji_ has joined #zope3-dev | 21:47 | |
*** nyo has joined #zope3-dev | 21:56 | |
*** romanofs1i has joined #zope3-dev | 22:02 | |
*** aaronv has joined #zope3-dev | 22:03 | |
*** romanofski has quit IRC | 22:03 | |
*** __mac__ has quit IRC | 22:04 | |
*** aaronv has quit IRC | 22:04 | |
*** afd____ has quit IRC | 22:10 | |
*** elro has joined #zope3-dev | 22:13 | |
*** flox has joined #zope3-dev | 22:14 | |
*** ignas has quit IRC | 22:17 | |
*** aaronv has joined #zope3-dev | 22:21 | |
*** davisagli has quit IRC | 22:40 | |
*** ignas has joined #zope3-dev | 23:00 | |
*** MrTopf has quit IRC | 23:13 | |
*** ignas has quit IRC | 23:22 | |
*** redir_ has joined #zope3-dev | 23:37 | |
*** aaronv has quit IRC | 23:39 | |
*** MrTopf has joined #zope3-dev | 23:45 | |
*** redir has quit IRC | 23:46 | |
*** elro has quit IRC | 23:46 | |
*** ktwilight has quit IRC | 23:46 | |
*** romanofs1i has quit IRC | 23:50 | |
*** davisagli has joined #zope3-dev | 23:54 | |
*** davisagli_ has joined #zope3-dev | 23:55 | |
*** ktwilight_ has joined #zope3-dev | 23:57 |
Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!