| *** alga has quit IRC | 00:05 | |
| *** sp0cksbeard has quit IRC | 00:14 | |
| *** theo_ has joined #zope | 00:39 | |
| *** hever has joined #zope | 00:41 | |
| *** m8 has quit IRC | 00:56 | |
| *** hever has quit IRC | 01:12 | |
| *** J1m has quit IRC | 01:25 | |
| *** runyaga has joined #zope | 01:31 | |
| *** runyaga has quit IRC | 01:31 | |
| *** runyaga has joined #zope | 01:31 | |
| *** runyaga has quit IRC | 01:37 | |
| *** supton_ has joined #zope | 01:43 | |
| *** supton has quit IRC | 01:47 | |
| *** daMaestro has quit IRC | 01:51 | |
| *** daMaestro has joined #zope | 02:01 | |
| *** ccomb has joined #zope | 02:07 | |
| *** sunew has quit IRC | 02:51 | |
| *** _mup_ has quit IRC | 03:00 | |
| *** _mup_ has joined #zope | 03:00 | |
| *** theo_ has quit IRC | 03:03 | |
| *** daMaestro has quit IRC | 03:10 | |
| *** mr_jolly has joined #zope | 03:10 | |
| *** River_Rat has joined #zope | 03:11 | |
| *** RiverRat has quit IRC | 03:13 | |
| *** mr_jolly has quit IRC | 03:17 | |
| *** Spanktar has quit IRC | 03:40 | |
| *** tiwula has quit IRC | 03:44 | |
| *** benji has quit IRC | 04:25 | |
| *** River_Rat has quit IRC | 04:35 | |
| *** RiverRat has joined #zope | 04:35 | |
| *** do3cc has quit IRC | 04:42 | |
| *** benji has joined #zope | 05:49 | |
| *** River_Rat has joined #zope | 06:10 | |
| *** RiverRat has quit IRC | 06:13 | |
| *** River-Rat has joined #zope | 07:28 | |
| *** River_Rat has quit IRC | 07:30 | |
| *** Wu_ has joined #zope | 08:13 | |
| *** mgedmin_ has joined #zope | 08:14 | |
| *** kiorky_ has joined #zope | 08:15 | |
| *** dixond has joined #zope | 08:17 | |
| *** avn has quit IRC | 08:21 | |
| *** Wu has quit IRC | 08:21 | |
| *** zenwryly has quit IRC | 08:21 | |
| *** mgedmin has quit IRC | 08:21 | |
| *** zsh has quit IRC | 08:21 | |
| *** blueyed has quit IRC | 08:21 | |
| *** frapell has quit IRC | 08:21 | |
| *** lahwran has quit IRC | 08:21 | |
| *** kosh has quit IRC | 08:21 | |
| *** mcdonc has quit IRC | 08:21 | |
| *** kiorky has quit IRC | 08:21 | |
| *** dixond_ has quit IRC | 08:21 | |
| *** mitchell`off has quit IRC | 08:21 | |
| *** gawel has quit IRC | 08:21 | |
| *** raydeo has quit IRC | 08:21 | |
| *** benji has quit IRC | 08:21 | |
| *** benbangert has quit IRC | 08:21 | |
| *** rodgort has quit IRC | 08:21 | |
| *** benji has joined #zope | 08:22 | |
| *** frapell has joined #zope | 08:22 | |
| *** zsh has joined #zope | 08:22 | |
| *** blueyed has joined #zope | 08:22 | |
| *** mcdonc has joined #zope | 08:22 | |
| *** zenwryly has joined #zope | 08:22 | |
| *** mitchell`off has joined #zope | 08:22 | |
| *** lahwran has joined #zope | 08:22 | |
| *** benbangert has joined #zope | 08:22 | |
| *** gawel has joined #zope | 08:22 | |
| *** kosh has joined #zope | 08:22 | |
| *** raydeo has joined #zope | 08:22 | |
| *** rodgort has joined #zope | 08:22 | |
| *** alga has joined #zope | 08:22 | |
| *** River_Rat has joined #zope | 08:23 | |
| *** avn has joined #zope | 08:24 | |
| *** River-Rat has quit IRC | 08:26 | |
| *** alga has quit IRC | 08:29 | |
| *** tisto has joined #zope | 08:34 | |
| *** River-Rat has joined #zope | 08:54 | |
| *** __mac__ has joined #zope | 08:57 | |
| *** River_Rat has quit IRC | 08:57 | |
| *** zagy has joined #zope | 09:00 | |
| *** theo_ has joined #zope | 09:05 | |
| *** Wu_ has quit IRC | 09:23 | |
| *** Wu has joined #zope | 09:23 | |
| *** thetet has joined #zope | 09:24 | |
| *** menesis has joined #zope | 10:03 | |
| *** giacomos has joined #zope | 10:04 | |
| *** River_Rat has joined #zope | 10:36 | |
| *** mitchell`off is now known as mitchell` | 10:37 | |
| *** River-Rat has quit IRC | 10:38 | |
| *** sunew has joined #zope | 10:45 | |
| *** theo_ has quit IRC | 10:46 | |
| *** avoinea has joined #zope | 10:53 | |
| *** mr_jolly has joined #zope | 10:55 | |
| *** eperez has joined #zope | 10:55 | |
| *** avn has quit IRC | 11:00 | |
| *** avn has joined #zope | 11:00 | |
| *** River_Rat has quit IRC | 11:01 | |
| *** zsh has quit IRC | 11:01 | |
| *** River_Rat has joined #zope | 11:01 | |
| *** zsh has joined #zope | 11:02 | |
| *** MrTango has joined #zope | 11:20 | |
| *** tisto has quit IRC | 11:23 | |
| *** TomBlockley has joined #zope | 11:28 | |
| *** tisto has joined #zope | 11:34 | |
| *** maurits has joined #zope | 11:37 | |
| *** do3cc has joined #zope | 11:44 | |
| *** evilbungle has joined #zope | 12:01 | |
| *** evilbungle has quit IRC | 12:06 | |
| *** evilbungle has joined #zope | 12:09 | |
| *** tisto has quit IRC | 12:09 | |
| *** zenwryly has quit IRC | 12:09 | |
| *** zenwryly has joined #zope | 12:09 | |
| *** tisto has joined #zope | 12:10 | |
| *** River-Rat has joined #zope | 12:12 | |
| *** River_Rat has quit IRC | 12:15 | |
| *** River-Rat is now known as RiverRat | 12:15 | |
| *** sunew has quit IRC | 12:18 | |
| *** menesis has quit IRC | 12:36 | |
| *** teix has joined #zope | 12:48 | |
| *** fredvd has joined #zope | 12:49 | |
| *** goschtl has joined #zope | 12:57 | |
| *** RichyB has joined #zope | 12:59 | |
| *** sunew has joined #zope | 13:05 | |
| *** J1m has joined #zope | 13:09 | |
| *** jakke has left #zope | 13:17 | |
| *** menesis has joined #zope | 13:21 | |
| *** theo_ has joined #zope | 13:41 | |
| *** tisto is now known as tisto|away | 14:06 | |
| *** paolo has joined #zope | 14:07 | |
| *** J1m has quit IRC | 14:18 | |
| *** giacomos has quit IRC | 14:25 | |
| *** menesis has left #zope | 14:27 | |
| *** menesis_ has joined #zope | 14:28 | |
| *** menesis_ is now known as menesis | 14:31 | |
| *** giacomos has joined #zope | 14:33 | |
| *** thetet has quit IRC | 14:34 | |
| *** paolo has left #zope | 14:42 | |
| *** dayne has joined #zope | 14:45 | |
| *** giacomos has quit IRC | 14:57 | |
| *** giacomos has joined #zope | 14:59 | |
| *** eperez has quit IRC | 14:59 | |
| *** menesis has quit IRC | 15:07 | |
| *** theo_ has quit IRC | 15:09 | |
| *** menesis has joined #zope | 15:11 | |
| *** River_Rat has joined #zope | 15:25 | |
| *** RiverRat has quit IRC | 15:27 | |
| *** __mac__ has quit IRC | 15:28 | |
| *** giacomos has quit IRC | 15:33 | |
| *** giacomos has joined #zope | 15:35 | |
| *** thetet has joined #zope | 15:38 | |
| *** menesis has quit IRC | 15:45 | |
| *** dayne has quit IRC | 15:48 | |
| *** esteele has joined #zope | 15:48 | |
| *** dayne has joined #zope | 15:48 | |
| *** thetet has quit IRC | 15:58 | |
| *** sp0cksbeard has joined #zope | 16:02 | |
| *** J1m has joined #zope | 16:02 | |
| *** __mac__ has joined #zope | 16:05 | |
| *** tisto|away is now known as tisto | 16:12 | |
| *** J1m has quit IRC | 16:21 | |
| *** tisto has quit IRC | 16:23 | |
| *** zenwryly has quit IRC | 16:30 | |
| *** J1m has joined #zope | 16:35 | |
| *** tisto has joined #zope | 16:36 | |
| *** J1m has quit IRC | 16:37 | |
| *** J1m has joined #zope | 16:38 | |
| *** MrTango has quit IRC | 16:45 | |
| *** eperez has joined #zope | 17:05 | |
| *** thetet has joined #zope | 17:09 | |
| *** zagy1 has joined #zope | 17:25 | |
| *** zagy has quit IRC | 17:26 | |
| *** dayne has quit IRC | 17:27 | |
| *** roq_ has joined #zope | 17:32 | |
| *** roq_ has quit IRC | 17:32 | |
| *** roq_ has joined #zope | 17:33 | |
| roq_ | Hello, I'm commiting a simple object at a btreefolder2 but I thing it is getting too long to finish the commit. My btreefolder2 has about 8.000 itens and 100 new itens take about 25 seconds... | 17:36 |
|---|---|---|
| roq_ | Is this normal? | 17:36 |
| RichyB | Seems a bit high. Are you getting ConflictErrors? | 17:40 |
| roq_ | RichyB: no | 17:41 |
| roq_ | my object is something like: class MyObject(Implicit, Persistent, RoleManager, Item): ... | 17:47 |
| betabug | 1st, simply base it on SimpleItem instead of on all that laundry list | 17:48 |
| betabug | 2nd, are you manually committing these things? | 17:48 |
| betabug | (or instead of SimpleItem, base on Folder) | 17:49 |
| *** runyaga has joined #zope | 17:50 | |
| *** runyaga has quit IRC | 17:50 | |
| *** runyaga has joined #zope | 17:50 | |
| roq_ | betabug: ok, I wil try this. But this is correct? (all that inheritance) | 17:50 |
| betabug | probably | 17:50 |
| roq_ | betabug: I am creating 100 and commiting | 17:51 |
| betabug | if you are writing a filesystem based Zope 2 product check out my sample code http://papakiteliatziar.gr/BetaBoring | 17:51 |
| betabug | why are you committing manually then? | 17:51 |
| roq_ | betabug: because at the and I will have a lot of objects (5,000,000) | 17:52 |
| roq_ | I was testing if 100 is a good number. Actually I dont know what is the best strategy | 17:53 |
| betabug | you plan on adding them all in a loop or so? | 17:53 |
| roq_ | yes | 17:54 |
| betabug | right, then you'd want some intermediary commits | 17:54 |
| betabug | but adding 100 items to a BTreeFolder2 shouldn't take so long | 17:54 |
| roq_ | I do not have all objects ready now, but at the end will be that number | 17:54 |
| betabug | are these big objects? | 17:55 |
| roq_ | betabug: the object has about 20 string attributes and 4 methods | 17:56 |
| roq_ | some attributes are integers | 17:56 |
| betabug | well, if the string attributes don't contain 1MB each, that wouldn't qualify as "big" | 17:56 |
| betabug | so, this is not normal behaviour, you are doing something wrong | 17:56 |
| roq_ | each string attribute has less than 200 chars | 17:57 |
| *** zagy1 has quit IRC | 17:57 | |
| betabug | how are you adding them? can you put some snippet on a pastebin somewhere? | 17:57 |
| roq_ | betabug: http://pastebin.com/ZeqLriMT | 18:02 |
| *** sunew has quit IRC | 18:02 | |
| roq_ | the commit is on line 96 | 18:02 |
| roq_ | the folder we are adding is pastaCnpj, line 91 | 18:03 |
| roq_ | criaCnpj returns a new Cnpj object | 18:04 |
| *** daMaestro has joined #zope | 18:05 | |
| betabug | hmm, which zope version is this, Zope 2? | 18:06 |
| roq_ | yes | 18:07 |
| roq_ | Zope Version (2.13.12, python 2.6.6, linux2) | 18:07 |
| roq_ | the same Zope has a Plone site, so we need to use this version | 18:07 |
| betabug | when you say "if num_sempontos not in pastaCnpj", what is pastaCnpj exactly here? | 18:09 |
| roq_ | pastaCnpj is the BTreeFolder2 | 18:09 |
| roq_ | I can not insert the same object twice, so I verify if it is already there | 18:10 |
| betabug | hmmm | 18:10 |
| teix | roq_: code variables names should be english too or only us and a couple of other folks could read it ;) | 18:11 |
| betabug | try with "if num_sempontos not in pastaCnpj.objectIds():" | 18:11 |
| betabug | teix: yeah, especially you ;-) | 18:11 |
| teix | betabug: eheh | 18:11 |
| betabug | but in this case I just didn't see what the assignment on the top was coming too | 18:12 |
| roq_ | betabug: ok | 18:12 |
| roq_ | betabug: the place where it hangs is between lines 95 and 97 | 18:13 |
| roq_ | where the commit is | 18:13 |
| betabug | hmmm | 18:13 |
| betabug | which is where it would write to disk | 18:14 |
| *** esteele is now known as esteele|away | 18:14 | |
| betabug | is that zope instance working normally otherwise? | 18:16 |
| teix | roq_: what about using Folder as base? | 18:16 |
| betabug | +1 | 18:17 |
| roq_ | betabug: yes, it is working properly | 18:17 |
| betabug | not for the large object, there BTreeFolder2 should be fine | 18:17 |
| *** m8 has joined #zope | 18:17 | |
| betabug | but for the child object | 18:17 |
| roq_ | teix: I think Folder will not be happy with 5,000,000 objects | 18:17 |
| *** m8 has quit IRC | 18:18 | |
| roq_ | am I right? | 18:18 |
| teix | roq_: hmmm implements(ICnpj, IIndexableContent) maybe the bottleneck is on indexing? | 18:18 |
| *** m8 has joined #zope | 18:18 | |
| betabug | teix: I'm rusty... would that happen on comitting? | 18:18 |
| teix | betabug: hmm not sure | 18:19 |
| betabug | but it's one thing to check | 18:19 |
| roq_ | teix: we are not cataloging it yet | 18:19 |
| roq_ | teix: we are only inserting. The catalog is empty for now | 18:20 |
| teix | roq_: pastaCnpj and pastaInfo are what kind of folders? | 18:20 |
| betabug | there is one other thing that strikes me | 18:20 |
| betabug | pastaCnpj[num_sempontos] = criaCnpj(cnpj, num_sempontos) | 18:21 |
| betabug | this is where you actually add stuff to the BTreeFolder2 | 18:21 |
| roq_ | both -> BTreeFolder 2 | 18:21 |
| betabug | right? | 18:21 |
| teix | roq_: ok | 18:21 |
| roq_ | yes | 18:21 |
| betabug | hmm, have to look it up, but I don't think this is the way it's done | 18:22 |
| roq_ | betabug: it works, we can see the objects at the ZMI and access them via code. I will find more info about it | 18:23 |
| betabug | usually you add stuff to a Folder/BTreeFolder2 using xy.manage_addProduct['ProductName'].productsAddMethod(...) | 18:23 |
| betabug | and internally it would use self._setObject(...) | 18:24 |
| betabug | roq_: "it works", but you have a problem... you might as well make sure that you're doing it right | 18:24 |
| roq_ | betabug: yeah | 18:25 |
| roq_ | thanks for all help | 18:25 |
| roq_ | I will try what you said | 18:25 |
| teix | roq_: +1 | 18:25 |
| teix | roq_: boa sorte! ;) | 18:25 |
| roq_ | and look for that docs (BTreeFolder2) | 18:25 |
| roq_ | teix, thanks to you too. Obrigado! | 18:26 |
| *** supton has joined #zope | 18:29 | |
| *** menesis has joined #zope | 18:35 | |
| *** goschtl has quit IRC | 18:39 | |
| *** zsh has quit IRC | 18:46 | |
| *** esteele|away is now known as esteele | 18:48 | |
| *** fredvd has quit IRC | 18:49 | |
| *** River_Rat has quit IRC | 18:56 | |
| *** River_Rat has joined #zope | 18:59 | |
| *** tiwula has joined #zope | 19:05 | |
| *** alga has joined #zope | 19:06 | |
| *** giacomos has quit IRC | 19:06 | |
| *** alga has quit IRC | 19:11 | |
| *** zsh has joined #zope | 19:16 | |
| *** Spanktar has joined #zope | 19:17 | |
| *** mitchell` is now known as mitchell`off | 19:27 | |
| *** polysix has quit IRC | 19:28 | |
| *** polysix has joined #zope | 19:29 | |
| *** maurits has quit IRC | 19:40 | |
| *** tiwula has quit IRC | 19:42 | |
| *** zsh has quit IRC | 19:47 | |
| *** tisto has quit IRC | 19:48 | |
| *** __mac__ has quit IRC | 19:59 | |
| *** menesis has left #zope | 20:00 | |
| *** running_clam has joined #zope | 20:00 | |
| *** avoinea has quit IRC | 20:03 | |
| *** runyaga has quit IRC | 20:05 | |
| *** iana has joined #zope | 20:16 | |
| *** tiwula has joined #zope | 20:19 | |
| *** iana has quit IRC | 20:21 | |
| *** iana has joined #zope | 20:21 | |
| *** runyaga has joined #zope | 20:24 | |
| *** runyaga has quit IRC | 20:24 | |
| *** runyaga has joined #zope | 20:24 | |
| *** evilbungle has quit IRC | 20:29 | |
| *** running_clam1 has joined #zope | 20:32 | |
| *** running_clam has quit IRC | 20:32 | |
| *** iana has quit IRC | 20:33 | |
| *** iana has joined #zope | 20:35 | |
| *** iana has quit IRC | 20:37 | |
| *** iana has joined #zope | 20:40 | |
| *** iana has quit IRC | 20:43 | |
| *** zenwryly has joined #zope | 20:44 | |
| *** iana has joined #zope | 20:46 | |
| *** esteele is now known as esteele|away | 20:46 | |
| *** running_clam1 has quit IRC | 20:47 | |
| *** running_clam has joined #zope | 20:47 | |
| *** esteele|away is now known as esteele | 20:52 | |
| *** running_clam has quit IRC | 20:53 | |
| *** zagy has joined #zope | 21:00 | |
| *** iana has quit IRC | 21:01 | |
| *** iana has joined #zope | 21:02 | |
| *** menesis has joined #zope | 21:13 | |
| *** TomBlockley has quit IRC | 21:15 | |
| *** menesis has quit IRC | 21:16 | |
| *** menesis has joined #zope | 21:19 | |
| *** iana has quit IRC | 21:25 | |
| *** iana has joined #zope | 21:28 | |
| *** running_clam has joined #zope | 21:32 | |
| *** running_clam has left #zope | 21:33 | |
| *** iana has quit IRC | 21:35 | |
| *** iana has joined #zope | 21:36 | |
| *** iana has quit IRC | 21:41 | |
| *** iana has joined #zope | 21:46 | |
| *** teix has quit IRC | 21:56 | |
| *** iana has quit IRC | 22:11 | |
| *** iana has joined #zope | 22:11 | |
| *** RichyB has quit IRC | 22:26 | |
| *** iana has quit IRC | 22:27 | |
| *** iana has joined #zope | 22:34 | |
| *** menesis has quit IRC | 22:37 | |
| *** iana has quit IRC | 22:43 | |
| *** zagy has quit IRC | 22:46 | |
| *** iana has joined #zope | 22:49 | |
| *** iana has quit IRC | 22:57 | |
| *** iana has joined #zope | 22:58 | |
| *** iana has quit IRC | 23:00 | |
| *** iana has joined #zope | 23:03 | |
| *** J1m has quit IRC | 23:38 | |
| *** ccomb has quit IRC | 23:40 | |
| *** iana has quit IRC | 23:41 | |
| *** J1m has joined #zope | 23:43 | |
| *** three18ti has quit IRC | 23:48 | |
| *** iana has joined #zope | 23:48 | |
Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!