*** thetet has joined #zope | 00:00 | |
*** m8 has quit IRC | 00:33 | |
*** supton_ has joined #zope | 00:43 | |
*** supton has quit IRC | 00:46 | |
*** ccomb has quit IRC | 00:53 | |
*** dcarmean has left #zope | 00:53 | |
*** thetet has quit IRC | 01:21 | |
*** menesis has quit IRC | 01:35 | |
*** mr_jolly has joined #zope | 01:38 | |
*** mr_jolly has quit IRC | 01:43 | |
*** J1m has quit IRC | 02:01 | |
*** supton has joined #zope | 02:06 | |
*** thetet has joined #zope | 02:13 | |
*** sp0cksbeard has quit IRC | 02:23 | |
*** alga has quit IRC | 02:51 | |
*** thetet has quit IRC | 02:52 | |
*** _mup_ has quit IRC | 03:00 | |
*** _mup_ has joined #zope | 03:00 | |
*** thetet has joined #zope | 03:03 | |
*** tiwula has quit IRC | 03:10 | |
*** runyaga has joined #zope | 03:13 | |
*** runyaga has quit IRC | 03:13 | |
*** runyaga has joined #zope | 03:13 | |
*** mcdonc has quit IRC | 03:36 | |
*** mcdonc has joined #zope | 03:36 | |
*** thetet has quit IRC | 03:59 | |
*** jan_s has quit IRC | 04:10 | |
*** TomBlockley has joined #zope | 04:18 | |
*** daMaestro has left #zope | 04:20 | |
*** Spanktar has quit IRC | 04:23 | |
*** mcdonc has quit IRC | 04:38 | |
*** tiwula has joined #zope | 04:49 | |
*** mcdonc has joined #zope | 04:57 | |
*** jham has quit IRC | 05:08 | |
*** jham has joined #zope | 05:08 | |
*** jham has joined #zope | 05:08 | |
*** nande has quit IRC | 06:06 | |
*** dayne has joined #zope | 06:36 | |
*** supton has quit IRC | 07:13 | |
*** runyaga has quit IRC | 07:25 | |
*** superbofh has quit IRC | 07:49 | |
*** tiwula has quit IRC | 08:24 | |
*** agroszer has joined #zope | 08:30 | |
*** zagy has joined #zope | 08:56 | |
*** tisto has joined #zope | 09:00 | |
*** __mac__ has joined #zope | 09:40 | |
*** running_clam has joined #zope | 09:42 | |
*** running_clam has left #zope | 09:42 | |
*** running_clam has joined #zope | 09:44 | |
*** running_clam has left #zope | 09:44 | |
*** running_clam has joined #zope | 09:46 | |
*** running_clam has left #zope | 09:46 | |
*** yvl has joined #zope | 09:49 | |
*** thevishy has quit IRC | 10:02 | |
*** thevishy has joined #zope | 10:02 | |
*** mr_jolly has joined #zope | 10:21 | |
*** menesis has joined #zope | 10:30 | |
*** eperez has joined #zope | 10:36 | |
*** ccomb has joined #zope | 10:43 | |
*** alga has joined #zope | 10:50 | |
*** alga has quit IRC | 10:52 | |
*** alga has joined #zope | 10:52 | |
*** avoinea has joined #zope | 10:54 | |
*** alga has quit IRC | 10:55 | |
*** alga has joined #zope | 10:55 | |
*** ganeshu has joined #zope | 10:59 | |
*** ganeshu has quit IRC | 11:04 | |
*** mitchell`off is now known as mitchell` | 11:17 | |
*** running_clam has joined #zope | 11:29 | |
*** running_clam has left #zope | 11:30 | |
*** m8 has joined #zope | 11:38 | |
*** m8 has joined #zope | 11:38 | |
*** maurits has joined #zope | 12:22 | |
*** maurits has left #zope | 12:22 | |
*** ganeshu has joined #zope | 12:23 | |
*** mr_jolly has quit IRC | 12:27 | |
ganeshu | hi.. i want to store my text file contents to zodb, total text files' size is 1 MB, but the ZODB .fs file size is 10MB.....how to avoid this? | 12:38 |
---|---|---|
*** ganeshu is now known as ganesh_ariveguru | 12:40 | |
ganesh_ariveguru | hi.. i want to store my text file contents to zodb, total text files' size is 1 MB, but the ZODB .fs file size is 10MB.....how to avoid this? | 12:41 |
*** MrTango has joined #zope | 12:53 | |
*** menesis has quit IRC | 12:55 | |
bigkevmcd | ganesh_ariveguru: you're not really providing enough information | 12:55 |
bigkevmcd | ganesh_ariveguru: how are you storing the text file? are you indexing it? | 12:55 |
*** teix has joined #zope | 12:55 | |
bigkevmcd | ganesh_ariveguru: are you packing the database? | 12:55 |
bigkevmcd | ganesh_ariveguru: FWIW, I just uploaded a 992k file into an otherwise empty Data.fs file, and it's not 1.1M | 12:57 |
bigkevmcd | s/it's not/it's now/ | 12:57 |
*** MrTango has quit IRC | 12:57 | |
ganesh_ariveguru | no...i am not directly storing text files.... | 12:58 |
ganesh_ariveguru | i am extracting content from text files | 12:58 |
ganesh_ariveguru | and storing on it | 12:59 |
*** MrTango has joined #zope | 13:02 | |
ganesh_ariveguru | hi...bigkevmcd | 13:26 |
ganesh_ariveguru | pls tell some solutions | 13:27 |
ganesh_ariveguru | bigkevmcd: while appending data to db, it's size is growing rapidly | 13:27 |
bigkevmcd | ganesh_ariveguru: that makes sense | 13:28 |
bigkevmcd | ganesh_ariveguru: you're adding objects to the database | 13:28 |
bigkevmcd | ganesh_ariveguru: if you have older, unreferenced objects, then packing will remove them | 13:28 |
ganesh_ariveguru | bigkevmcd: but instead appending , if i stored all objects in one shot....db size is very less | 13:29 |
bigkevmcd | ganesh_ariveguru: the Zope db stores a history of transactions | 13:29 |
bigkevmcd | ganesh_ariveguru: packing will remove what it can | 13:29 |
ganesh_ariveguru | how to do packing...when to do packing | 13:29 |
*** zagy has quit IRC | 13:30 | |
*** __mac__ has quit IRC | 13:30 | |
ganesh_ariveguru | bigkevmcd:packing before each transactions? | 13:30 |
bigkevmcd | ganesh_ariveguru: no, don't pack before each transaction | 13:30 |
bigkevmcd | ganesh_ariveguru: pack daily or something | 13:30 |
bigkevmcd | ganesh_ariveguru: that's what most folk do | 13:31 |
ganesh_ariveguru | my transaction is done by a for loop.....for each object i'll append to db, and commit the transaction.... | 13:31 |
ganesh_ariveguru | so it is growing and having history for each object | 13:32 |
ganesh_ariveguru | so...how i can get rid of it... | 13:32 |
bigkevmcd | ganesh_ariveguru: not necessarily | 13:32 |
bigkevmcd | ganesh_ariveguru: only if the objects are changing | 13:32 |
bigkevmcd | ganesh_ariveguru: there's a subtle difference between changing objects, and adding objects | 13:33 |
ganesh_ariveguru | see.....this will be my one object in db{ | 13:35 |
ganesh_ariveguru | "question_papers" : [{ | 13:35 |
ganesh_ariveguru | "q_id " : "1", | 13:35 |
ganesh_ariveguru | "question" : "some text" | 13:35 |
ganesh_ariveguru | } | 13:35 |
bigkevmcd | whooah | 13:35 |
ganesh_ariveguru | ] | 13:35 |
ganesh_ariveguru | } | 13:35 |
bigkevmcd | pastebin | 13:35 |
ganesh_ariveguru | i question papers' list i will add, like this many elements{ | 13:36 |
ganesh_ariveguru | "q_id " : "2", | 13:36 |
ganesh_ariveguru | "question" : "some text" | 13:37 |
ganesh_ariveguru | } | 13:37 |
bigkevmcd | ganesh_ariveguru: please use http://paste.lisp.org/new/zope to paste multiline things | 13:37 |
*** tisto_ has joined #zope | 13:37 | |
ganesh_ariveguru | bigkevmcd you got what am asking? | 13:40 |
bigkevmcd | ganesh_ariveguru: yes | 13:40 |
*** tisto has quit IRC | 13:41 | |
bigkevmcd | ganesh_ariveguru: and you're changing the top-level object, so it will maintain the history in each transaction | 13:41 |
ganesh_ariveguru | so how to delete the history? | 13:41 |
bigkevmcd | packing! | 13:42 |
bigkevmcd | <ganesh_ariveguru> i have written my own ZODB class there is no pack method | 13:42 |
bigkevmcd | I doubt that's true | 13:42 |
bigkevmcd | but, if it is, you'll need to write your own | 13:42 |
bigkevmcd | I suspect you're using the standard ZODB class | 13:42 |
bigkevmcd | and, in that case, you can call pack on it | 13:42 |
ganesh_ariveguru | wait i will post my ZOdb class | 13:43 |
ganesh_ariveguru | bigkevmcd:http://paste.lisp.org/new/zope...how to select channel in this....\ | 13:44 |
bigkevmcd | ganesh_ariveguru: select None and paste the URL | 13:44 |
ganesh_ariveguru | http://paste.lisp.org/+2RRT | 13:46 |
ganesh_ariveguru | bigkevmcd: i have pasted my zodb class there.... | 13:47 |
bigkevmcd | sure | 13:47 |
bigkevmcd | so, your pack method doesn't need that first line, but you're calling pack on the db, which is correct | 13:47 |
ganesh_ariveguru | you told me based on my zodb class....how to write packing script....pls | 13:48 |
bigkevmcd | call pack | 13:50 |
bigkevmcd | it's as simple as that | 13:50 |
ganesh_ariveguru | ya...when to call | 13:50 |
bigkevmcd | at 18:01:33UTC | 13:51 |
ganesh_ariveguru | after finishing all transactions..? | 13:51 |
bigkevmcd | on alternate days, if they have a e in them | 13:51 |
ganesh_ariveguru | nice comedy... | 13:51 |
ganesh_ariveguru | a e, what's tha? | 13:51 |
ganesh_ariveguru | what's that? | 13:51 |
bigkevmcd | basically, call when you need to | 13:53 |
bigkevmcd | if you really want to call after every transaction, I think that's stupid, but feel free | 13:53 |
bigkevmcd | its your application | 13:53 |
*** do3cc has joined #zope | 13:55 | |
ganesh_ariveguru | bigkevmcd: thanks....i will try | 13:55 |
*** ccomb has quit IRC | 13:55 | |
bigkevmcd | ganesh_ariveguru: what is it you're worried about? | 13:56 |
ganesh_ariveguru | not really...but i have to find solution for tha...so... | 13:56 |
*** thetet has joined #zope | 13:57 | |
ganesh_ariveguru | bigkevmcd:how long u r , using zodb? | 13:57 |
bigkevmcd | I've been using Zope off and on for between 13 and 14 years... | 13:57 |
*** fredvd has joined #zope | 14:01 | |
ganesh_ariveguru | bigkevmcd:oh...really nice... i am totally new to coding world, last year i finished my studies, and now working in python | 14:01 |
*** goschtl has joined #zope | 14:04 | |
*** tisto_ is now known as tisto|away | 14:04 | |
*** zagy has joined #zope | 14:04 | |
ganesh_ariveguru | bigkevmcd: thank, i packed my db, now in that directroy, data.fs, data.fs.old files are there, i have to keep data.fs.old | 14:07 |
ganesh_ariveguru | ? | 14:07 |
bigkevmcd | no, not unless you want to | 14:07 |
*** __mac__ has joined #zope | 14:08 | |
bigkevmcd | ganesh_ariveguru: bear in mind that backing up a live zodb is fraught, so backup a .old might be desirable | 14:08 |
ganesh_ariveguru | so keeping that old file also will cause the application size....so can i delete this...? how? | 14:11 |
*** fredvd has quit IRC | 14:16 | |
*** fredvd has joined #zope | 14:19 | |
*** menesis has joined #zope | 14:21 | |
ganesh_ariveguru | bigkevmcd:so keeping that old file also will cause the application size....so can i delete this...? how? | 14:21 |
*** yvl has quit IRC | 14:22 | |
bigkevmcd | ganesh_ariveguru: eh? | 14:28 |
bigkevmcd | ganesh_ariveguru: why do you think that? | 14:28 |
ganesh_ariveguru | consider if one person is using my application in his mobile....he will add new notes or some data to db, so after packing, .fs file will be there with reduced size, but .fs.old wil be with big size. ... so it will cause the application size, so i want to delete that... | 14:31 |
*** thevishy has quit IRC | 14:32 | |
*** dayne has quit IRC | 14:38 | |
*** ganesh_ariveguru has left #zope | 14:48 | |
*** fredvd has quit IRC | 15:00 | |
*** ccomb has joined #zope | 15:00 | |
*** menesis has quit IRC | 15:18 | |
*** menesis has joined #zope | 15:19 | |
*** goschtl has quit IRC | 15:22 | |
*** __mac__ has quit IRC | 15:36 | |
*** __mac__ has joined #zope | 15:36 | |
*** zagy has quit IRC | 15:37 | |
*** zagy has joined #zope | 15:45 | |
*** tisto|away is now known as tisto | 15:48 | |
*** ericof has quit IRC | 15:53 | |
*** J1m has joined #zope | 15:57 | |
*** eperez has quit IRC | 16:08 | |
*** sp0cksbeard has joined #zope | 16:12 | |
*** ccomb1 has joined #zope | 16:20 | |
*** ccomb1 has quit IRC | 16:20 | |
*** ccomb has quit IRC | 16:21 | |
*** J1m has quit IRC | 16:24 | |
*** zenwryly has quit IRC | 16:28 | |
*** zenwryly has joined #zope | 16:28 | |
*** ericof has joined #zope | 16:30 | |
*** ccomb has joined #zope | 16:36 | |
*** supton has joined #zope | 16:36 | |
*** J1m has joined #zope | 16:49 | |
*** supton has quit IRC | 17:29 | |
*** zagy has quit IRC | 17:34 | |
*** agroszer has quit IRC | 17:41 | |
*** J1m has quit IRC | 17:43 | |
*** J1m has joined #zope | 17:49 | |
*** tiwula has joined #zope | 17:50 | |
*** __mac__ has quit IRC | 17:59 | |
*** daMaestro has joined #zope | 18:00 | |
*** supton has joined #zope | 18:04 | |
*** jakke has left #zope | 18:05 | |
*** tisto has quit IRC | 18:17 | |
*** ccomb has quit IRC | 18:17 | |
*** giacomos has joined #zope | 18:27 | |
*** avoinea has quit IRC | 18:28 | |
*** dTordable has joined #zope | 18:42 | |
dTordable | Hello, anyone. | 18:43 |
*** nande has joined #zope | 19:03 | |
*** supton has quit IRC | 19:13 | |
*** supton has joined #zope | 19:15 | |
*** goschtl has joined #zope | 19:17 | |
*** Spanktar has joined #zope | 19:30 | |
*** dTordable has quit IRC | 19:36 | |
*** goschtl has quit IRC | 19:44 | |
*** runyaga has joined #zope | 19:51 | |
*** runyaga has quit IRC | 19:51 | |
*** runyaga has joined #zope | 19:51 | |
*** benji has quit IRC | 20:01 | |
*** menesis has quit IRC | 20:13 | |
*** runyaga is now known as run|away | 20:22 | |
*** bigkevmcd has quit IRC | 20:28 | |
*** ericof has quit IRC | 20:30 | |
*** goschtl has joined #zope | 20:38 | |
kosh | greetings lifeforms | 20:40 |
*** thetet has quit IRC | 20:55 | |
*** giacomos has quit IRC | 21:14 | |
*** benji has joined #zope | 21:14 | |
*** supton_ has joined #zope | 21:37 | |
*** supton has quit IRC | 21:41 | |
*** ccomb has joined #zope | 21:44 | |
*** ccomb has quit IRC | 21:51 | |
*** mcdonc has quit IRC | 22:03 | |
*** mcdonc has joined #zope | 22:03 | |
*** goschtl has left #zope | 22:15 | |
*** teix has quit IRC | 22:28 | |
*** ericof has joined #zope | 22:36 | |
*** ccomb has joined #zope | 23:03 | |
*** rbanffy has joined #zope | 23:38 | |
*** mcdonc has quit IRC | 23:39 | |
*** mcdonc has joined #zope | 23:43 |
Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!