IRC log of #zope3-dev for Tuesday, 2010-08-24

« Monday, 2010-08-23 Index Wednesday, 2010-08-25 »
*** sunew has quit IRC00:06
*** ccomb has quit IRC00:10
*** timte has quit IRC00:34
*** lurkymclurkleton has quit IRC00:48
*** afd_ has quit IRC01:06
*** dunny has joined #zope3-dev01:07
*** strichter has quit IRC01:22
*** J1m has quit IRC02:06
*** menesis has quit IRC02:16
*** ignas has joined #zope3-dev02:58
*** davisagli is now known as davisagli|away03:09
*** strichter has joined #zope3-dev03:14
*** davisagli|away is now known as davisagli03:30
*** davisagli is now known as davisagli|away03:32
*** ignas has quit IRC03:35
*** allisterb has quit IRC03:50
*** aaronv has quit IRC03:55
*** aaronv has joined #zope3-dev03:57
*** allisterb has joined #zope3-dev04:05
*** davisagli|away is now known as davisagli04:11
*** afd_ has joined #zope3-dev04:12
*** davisagli is now known as davisagli|away04:13
*** davisagli|away is now known as davisagli04:16
*** davisagli is now known as davisagli|away04:20
*** davisagli|away is now known as davisagli04:23
*** gary_poster has quit IRC04:24
*** davisagli is now known as davisagli|away04:28
*** strichter has quit IRC04:32
*** afd_ has quit IRC04:38
*** davisagli|away is now known as davisagli04:59
*** benji has quit IRC06:16
*** bbot_kgs341 has joined #zope3-dev07:00
bbot_kgs341build #10 of Python2.4.6 64bit linux is complete: Success [build successful]  Build details are at http://buildbot.afpy.org/kgs3.4/builders/Python2.4.6%2064bit%20linux/builds/1007:20
bbot_kgs341build #10 of Python2.5.5 64bit linux started, including []07:20
*** stub has joined #zope3-dev07:32
bbot_kgs341build #10 of Python2.5.5 64bit linux is complete: Success [build successful]  Build details are at http://buildbot.afpy.org/kgs3.4/builders/Python2.5.5%2064bit%20linux/builds/1007:42
*** sweh has joined #zope3-dev07:53
*** bbot_ztk10 has joined #zope3-dev08:16
*** bbot_kgs341 has quit IRC08:31
*** Theuni1 has quit IRC08:31
*** bbot_kgs341 has joined #zope3-dev08:32
*** Theuni1 has joined #zope3-dev08:32
*** davisagli is now known as davisagli|away08:34
*** davisagli|away is now known as davisagli08:37
bbot_ztk10build #10 of Python2.7.0 Linux 64bit is complete: Failure [failed test ztk test zopeapp]  Build details are at http://buildbot.afpy.org/ztk1.0/builders/Python2.7.0%20Linux%2064bit/builds/1008:37
*** afd_ has joined #zope3-dev08:38
bbot_ztk10build #10 of Python2.4.6 Linux 64bit is complete: Success [build successful]  Build details are at http://buildbot.afpy.org/ztk1.0/builders/Python2.4.6%20Linux%2064bit/builds/1008:38
bbot_ztk10build #10 of Python2.6.5 Linux 64bit is complete: Success [build successful]  Build details are at http://buildbot.afpy.org/ztk1.0/builders/Python2.6.5%20Linux%2064bit/builds/1008:39
bbot_ztk10build #10 of Python2.5.5 Linux 64bit is complete: Success [build successful]  Build details are at http://buildbot.afpy.org/ztk1.0/builders/Python2.5.5%20Linux%2064bit/builds/1008:39
*** JaRoel|4D has quit IRC08:41
*** zagy has joined #zope3-dev08:44
*** timte has joined #zope3-dev08:47
*** jfkw has quit IRC08:54
*** davisagli is now known as davisagli|away09:01
*** menesis has joined #zope3-dev09:21
*** alga has joined #zope3-dev09:23
*** menesis has quit IRC09:29
*** menesis has joined #zope3-dev09:30
*** agroszer has joined #zope3-dev09:30
*** ccomb has joined #zope3-dev09:31
*** timte has quit IRC09:59
*** ccomb has quit IRC10:31
*** projekt01 has joined #zope3-dev10:43
*** goschtl has joined #zope3-dev10:48
*** ccomb has joined #zope3-dev11:06
*** jukart has joined #zope3-dev11:09
*** sunew has joined #zope3-dev11:18
*** agroszer has quit IRC11:23
*** agroszer_ has joined #zope3-dev11:23
*** agroszer_ is now known as agroszer11:23
*** ignas has joined #zope3-dev11:24
*** JaRoel|4D has joined #zope3-dev11:25
*** menesis has quit IRC11:30
*** menesis has joined #zope3-dev11:32
*** stub has left #zope3-dev11:35
*** stub has joined #zope3-dev11:37
*** stub has joined #zope3-dev11:37
*** stub has quit IRC11:42
*** sunew has quit IRC11:49
*** stub has joined #zope3-dev11:49
*** MJ has joined #zope3-dev11:49
*** jhauser has joined #zope3-dev11:52
*** fcorrea has joined #zope3-dev12:11
*** timte has joined #zope3-dev12:12
*** jhauser has quit IRC12:26
*** goschtl has quit IRC12:28
*** bbot_ztk10 has quit IRC12:39
*** mgedmin has quit IRC12:39
*** bbot_kgs341 has quit IRC12:39
*** Theuni1 has quit IRC12:39
*** MJ has quit IRC12:39
*** jukart has quit IRC12:39
*** projekt01 has quit IRC12:39
*** sweh has quit IRC12:39
*** alga has quit IRC12:39
*** stub has quit IRC12:39
*** fcorrea has quit IRC12:39
*** zagy has quit IRC12:39
*** timte has quit IRC12:39
*** allisterb has quit IRC12:39
*** hazmat has quit IRC12:39
*** yvl has quit IRC12:39
*** jml has quit IRC12:39
*** davisagli|away has quit IRC12:39
*** mcdonc has quit IRC12:39
*** alecm has quit IRC12:39
*** teratorn has quit IRC12:39
*** ccomb has quit IRC12:39
*** jpcw has quit IRC12:39
*** multani has quit IRC12:39
*** daniel_bot has quit IRC12:39
*** kiorky has quit IRC12:39
*** agroszer has quit IRC12:39
*** markusleist has quit IRC12:39
*** menesis has quit IRC12:39
*** JaRoel|4D has quit IRC12:39
*** kobold_ has quit IRC12:39
*** afd_ has quit IRC12:39
*** ignas has quit IRC12:39
*** dunny has quit IRC12:39
*** BjornT has quit IRC12:39
*** cbcunc has quit IRC12:39
*** avn has quit IRC12:39
*** goschtl has joined #zope3-dev12:40
*** timte has joined #zope3-dev12:40
*** fcorrea has joined #zope3-dev12:40
*** MJ has joined #zope3-dev12:40
*** stub has joined #zope3-dev12:40
*** menesis has joined #zope3-dev12:40
*** JaRoel|4D has joined #zope3-dev12:40
*** ignas has joined #zope3-dev12:40
*** agroszer has joined #zope3-dev12:40
*** jukart has joined #zope3-dev12:40
*** ccomb has joined #zope3-dev12:40
*** projekt01 has joined #zope3-dev12:40
*** alga has joined #zope3-dev12:40
*** zagy has joined #zope3-dev12:40
*** afd_ has joined #zope3-dev12:40
*** Theuni1 has joined #zope3-dev12:40
*** bbot_kgs341 has joined #zope3-dev12:40
*** bbot_ztk10 has joined #zope3-dev12:40
*** sweh has joined #zope3-dev12:40
*** allisterb has joined #zope3-dev12:40
*** dunny has joined #zope3-dev12:40
*** mcdonc has joined #zope3-dev12:40
*** markusleist has joined #zope3-dev12:40
*** alecm has joined #zope3-dev12:40
*** jpcw has joined #zope3-dev12:40
*** multani has joined #zope3-dev12:40
*** BjornT has joined #zope3-dev12:40
*** kiorky has joined #zope3-dev12:40
*** hazmat has joined #zope3-dev12:40
*** yvl has joined #zope3-dev12:40
*** davisagli|away has joined #zope3-dev12:40
*** cbcunc has joined #zope3-dev12:40
*** mgedmin has joined #zope3-dev12:40
*** avn has joined #zope3-dev12:40
*** kobold_ has joined #zope3-dev12:40
*** daniel_bot has joined #zope3-dev12:40
*** teratorn has joined #zope3-dev12:40
*** jml has joined #zope3-dev12:40
*** Theuni1 has quit IRC12:41
*** stub has quit IRC12:44
*** stub has joined #zope3-dev12:53
*** stub has joined #zope3-dev12:53
*** Theuni1 has joined #zope3-dev12:55
*** jhauser has joined #zope3-dev13:04
*** menesis has quit IRC13:05
*** El_Rolando has joined #zope3-dev13:17
*** benji has joined #zope3-dev13:20
*** menesis has joined #zope3-dev13:38
*** projekt01 has quit IRC13:41
*** gary_poster has joined #zope3-dev13:55
*** jhauser has quit IRC13:59
*** jhauser has joined #zope3-dev13:59
*** chaoflow has quit IRC14:35
*** chaoflow has joined #zope3-dev14:36
*** aaronv has joined #zope3-dev14:43
*** strichter has joined #zope3-dev14:48
*** stub has quit IRC15:00
*** jml has quit IRC15:13
*** stub has joined #zope3-dev15:13
*** stub has joined #zope3-dev15:13
*** fcorrea has quit IRC15:13
*** allisterb has quit IRC15:29
*** chaoflow has quit IRC15:35
*** chaoflow has joined #zope3-dev15:35
*** aaronv has quit IRC15:37
*** aaronv has joined #zope3-dev15:41
*** allisterb has joined #zope3-dev15:43
*** lamike has joined #zope3-dev15:48
*** J1m has joined #zope3-dev16:04
*** lamike has left #zope3-dev16:33
*** MJ has quit IRC16:48
*** timte has quit IRC16:51
*** mcdonc has quit IRC16:58
*** mcdonc has joined #zope3-dev16:59
*** fcorrea has joined #zope3-dev17:04
*** allisterb has quit IRC17:04
*** alga has quit IRC17:07
*** MJ has joined #zope3-dev17:17
*** allisterb has joined #zope3-dev17:17
*** lurkymclurkleton has joined #zope3-dev17:21
*** dunny has quit IRC17:41
*** davisagli|away is now known as davisagli18:07
*** El_Rolando has quit IRC18:08
*** davisagli is now known as davisagli|away18:13
*** jukart has quit IRC18:21
*** goschtl has quit IRC18:24
*** zagy has quit IRC18:26
*** sweh has quit IRC18:32
*** alga has joined #zope3-dev18:38
*** stub has quit IRC18:40
*** davisagli|away is now known as davisagli18:41
*** JaRoel|4D has quit IRC18:56
*** alga has quit IRC19:00
*** benji is now known as benji-lunch19:00
*** sweh has joined #zope3-dev19:04
*** ccomb1 has joined #zope3-dev19:28
*** ccomb has quit IRC19:31
*** benji-lunch is now known as benji20:04
*** ccomb1 has quit IRC20:19
*** menesis has quit IRC20:26
strichtercan someone remond me why zope.server does not support the write() function in its WSGI implementation? When I set write = task.write, everything works perfectly in a little test setup and it enables streaming of data.20:50
strichter(Not that this is useful to zope.publisher-based apps, but it is for other non-publisher WSGI apps.)20:50
strichterif nobody objects in the next minutes, I am going to write a test and check this change in. :-)20:51
*** zagy has joined #zope3-dev20:52
*** jukart has joined #zope3-dev20:54
mgedminis write() still part of wsgi?  I thought it was deprecated or something20:55
strichtermgedmin: oh I should check20:55
strichtermgedmin: but it is incredibly useful :-)20:55
mgedmindoesn't it break middleware or something like that?20:56
strichtermgedmin: so PEP 333 still has the write function as a requirement20:57
mgedminok, write() is mentioned in PEP-333, it's _not_ deprecated (as in the word "deprecated" is not used), but the pep says "New WSGI applications and frameworks *should not* use the write() callable if it is possible to avoid doing so."20:57
strichtermgedmin: you are right, it would break middleware that messes with the output20:58
strichtermgedmin: mmh, it puts some burden on the app to produce iterables20:58
mgedminI believe Graham Dumpleton occasionally blogs about the problems with the WSGI spec20:59
mgedminthere was something about wsgi lacking proper support for streaming20:59
mgedminbut I forgot all the details :(20:59
strichterI guess I will fix my app code instead, creating an iterator wrapper20:59
strichtermgedmin: I am working on a proxy server and right now it must receive all the data from the target server before it can serve the result; while the server does not suffer a performance hit, the user perceived performance on the client suffers, because the browser cannot start rendering the partially received data21:01
strichterI can definitely see why streaming is not supported if you need app logic within the stream generation21:03
*** zagy has quit IRC21:05
*** agroszer has quit IRC21:17
J1mstrichter, streaming should be done using an iterator21:33
J1mwrite was actually included, I think, for compat w z2, which is sad.21:33
strichterJ1m: right, though zope.server did not support it correctly21:33
strichterJ1m: since it only made one call to task.write()21:33
strichterJ1m: I changed the code so that the WSGI server code itself iterates through the result iterable causing multiple task.write calls21:34
J1mI thought we made zope.server work properly for handling streaming large files.21:34
strichterdefinitely not21:35
J1mdang21:35
J1mmaybe we did a bunch of work in the publisher but never checked properly that it was properly plumbed through the server.21:35
strichterit is a two line change on the server21:35
strichterI just need to write a decent test for it now.21:36
J1mThat's good. It's just very very sad that it took this long to fix it.21:36
J1mstill almost unbeleavable.21:36
strichteryeah, I was beating my head why the performance of my proxy seemed to be so bad21:37
J1mI dount your fix is enough.21:37
*** menesis has joined #zope3-dev21:37
J1mdoubt21:37
strichterI tested it and it streams fine for me now21:38
J1mIt's not enough to call task.write (assuming I understand what that does) for each return of iterator.next.21:38
strichterwhy not?21:38
J1mas task.write probably queues up the data.21:38
strichterah, but only to a certain point, I think21:38
strichterlet me find the file and line21:38
J1mdoes task.write block?21:39
J1mIt has to queue when the socket stops taking data.21:39
J1mYou need some way to "drain" the iterator only when the output socket is writable.21:39
strichterit defers the queue to dualmodechannel21:39
strichterdualmodechannel.py, line 15221:40
strichterfrom what I can tell, dual mode channel does the heavy lifting on managing the transport21:41
J1mso basically, you slurp data from a file into a buffer, probably in memory, or, at best a temporary file.21:41
strichteryeah21:42
J1mThis doesn't really buy you much.21:42
strichterall I do is an httplib call21:42
strichtercreates a result object21:42
J1mYou want something like twisted consumer/producer framework.21:42
J1mOr zc.ngi's abaility to queue an iterator that gets consumed only when the socket can take data.21:43
strichterright now my file sizes are relatively small21:43
strichterusual web stuff, but the user-perceived performance sucks, because none of the data is forwarded from the original server until all of it is received21:44
J1mah21:44
J1mThen it does buy you something.21:44
strichteryep :-)21:44
J1mespecially since zope.server tries hard to output data as soon as possible, not waiting to get back into asyncore's select loop.21:45
strichteryeah the initial response time dropped from 900ms to 250ms for a 300k file21:46
strichter(the reason it takes 250ms is largely due to the fact that I need to make a socket connection and read the response headers before I can start forwarding)21:46
*** runyaga has joined #zope3-dev22:03
*** ccomb has joined #zope3-dev22:12
*** jukart has quit IRC22:19
*** timte has joined #zope3-dev22:34
*** timte has quit IRC22:44
*** runyaga has quit IRC22:45
*** runyaga has joined #zope3-dev22:47
*** jhauser has quit IRC22:58
*** sweh has quit IRC23:08
*** alga has joined #zope3-dev23:17
*** timte has joined #zope3-dev23:19
*** afd_ has quit IRC23:26
*** dunny has joined #zope3-dev23:31
*** aaronv has quit IRC23:33
*** jpcw has quit IRC23:44
*** strichter has quit IRC23:56
« Monday, 2010-08-23 Index Wednesday, 2010-08-25 »

Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!