[ ijbswa-Bugs-3464439 ] Page truncation
<SourceForge.net>
2012-02-05 08:58:14 GMT
Bugs item #3464439, was opened at 2011-12-23 08:15
Message generated for change (Comment added) made by qqqqqw
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=111118&aid=3464439&group_id=11118
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Pending
Resolution: None
Priority: 5
Private: No
Submitted By: Kevin (photo2110)
Assigned to: Fabian Keil (fabiankeil)
Summary: Page truncation
Initial Comment:
When working with Opera 11.60 and Privoxy, pages, images, etc will randomly get truncated. It just started
with the Opera upgrade, so it might be a bug with Opera, but when I stopped using Privoxy, I couldn't get any
pages to fail. Note: 'stopped using' means configuring Opera to not go through Privoxy, simply
unchecking 'Enable' on the Privoxy menu doesn't do it.
I attempted to capture data with Wireshark, but the pages I caught were gzipped and I can't be certain that
they were good. I did notice that they were http 1.1, if that makes a difference.
Only one other person has mentioned on the Opera news group that they are having an issue like this. They too
are running Privoxy.
NYTimes.com seems especially bad to me, but it happens on all sites including SouceForge.
Privoxy 3.0.18.
Opera 11.60
Windows 7 and Windows XP (I have two machines, both have the trouble)
No other proxy software. Windows Firewall and MSE on both machines.
SF user: photo2110
----------------------------------------------------------------------
Comment By: qqqqqw (qqqqqw)
Date: 2012-02-05 00:58
Message:
Yes, is from mashable.com
when i have some time i post a new log
----------------------------------------------------------------------
Comment By: Fabian Keil (fabiankeil)
Date: 2012-01-23 10:33
Message:
I assume in the logfile from sendspace.com/ the truncated output is the
response for mashable.com?
I tried reproducing it by sending the same headers Opera used, but the
response appears to be complete.
Unfortunately Privoxy's log buffer is smaller than the receive buffer so
full receive buffers aren't logged completely in which case the received
data can't be reconstructed.
Can you still reproduce the problem if you enable +prevent-compression? A
log file without compressed content would probably be easier to analyze.
----------------------------------------------------------------------
Comment By: qqqqqw (qqqqqw)
Date: 2012-01-17 11:31
Message:
I never use turbo mode
----------------------------------------------------------------------
Comment By: Lee (ler762)
Date: 2012-01-15 12:59
Message:
Try disabling turbo mode in Opera.
I installed Opera and, with extremely limited testing, it worked fine until
I enabled "turbo mode". At which point it broke.
Changing the privoxy config to
keep-alive-timeout 0
helped some, but did NOT fix all of the problems.
I had wireshark capturing traffic during my testing. I thought I'd figured
out the problem but now I'm not so sure :( I need to look at the packet
traces again.
Lee
----------------------------------------------------------------------
Comment By: qqqqqw (qqqqqw)
Date: 2012-01-14 06:15
Message:
I cannot see "add a file" so i upload another log file (with same debugs
enabled) here:
http://www.sendspace.com/file/n4v8k2
Another 2 thing:
1. I have never page truncation on https
2. If i have page truncation on a site and the i use a cgi proxy to go to
the same page i have no page truncation
----------------------------------------------------------------------
Comment By: Fabian Keil (fabiankeil)
Date: 2012-01-13 14:23
Message:
Downloading the file from zshare.net doesn't work for me.
The download server doesn't even bother to return HTTP headers.
In theory you should be able to upload a file through the "Add a file"
section on this page.
----------------------------------------------------------------------
Comment By: qqqqqw (qqqqqw)
Date: 2012-01-13 03:30
Message:
Page truncation on mashable.com with Opera 11.60 + Privoxy 3.0.19 and
socks4a + Tor
Log file with this debug enabled:
debug 1
debug 2
debug 4
debug 8
debug 64
debug 128
debug 256
debug 512
debug 1024
debug 4096
debug 8192
debug 32768
Log file is here:
http://www.zshare.net/download/986014474c9073b3/
How can i attach log file in this discussion?
----------------------------------------------------------------------
Comment By: qqqqqw (qqqqqw)
Date: 2012-01-01 10:09
Message:
Yes, i use Opera 11.60 and the problem is always on same site (i dont know
why)
After the upgrade to 3.0.19 and a quick surf seem that the problem is
socks5 + Tor (so Privoxy 3.0.18 for bug in socks4a) and NOT socks4a + Tor
(so Privoxy 3.0.19)
But i need more test (surf to more internet pages and try to use socks5 on
Privoxy 3.0.19)
If i have other page truncation i post a log
----------------------------------------------------------------------
Comment By: Fabian Keil (fabiankeil)
Date: 2011-12-31 05:02
Message:
qqqqqw, are you using Opera as well?
Is the problem easy to reproduce?
Can you provide a logfile with the usual debug directives and additionally
"debug 16" and "debug 32768"?
It would be especially useful to additionally get a pcap file that shows
the packages Privoxy was receiving and sending.
I think it's unlikely that upgrading to 3.0.19 makes a difference. You
could try the recently uploaded privoxy-3.0.19-ipv4only.zip as it uses
different code paths, but it probably will not make a difference either.
----------------------------------------------------------------------
Comment By: Kevin (photo2110)
Date: 2011-12-29 11:58
Message:
Sorry I've not replied sooner. Xmas break took priority. I put in a section
to downgrade the NYTimes, and couldn't get any more issues with that site.
So, I put in a downgrade for all of .com, and haven't seen anymore short
pages on a .com site.
I'll have to try the new .19 version.
----------------------------------------------------------------------
Comment By: qqqqqw (qqqqqw)
Date: 2011-12-29 11:53
Message:
I have the same problem.
Initially i think that this problem is related with socks4a/5 bug, but
after read this i'm not so sure.
I have page truncation with Privoxy 3.0.18, not with 3.0.17.
Now i try with 3.0.19
----------------------------------------------------------------------
Comment By: Fabian Keil (fabiankeil)
Date: 2011-12-23 11:21
Message:
Thanks.
I can't see any obvious problems in the log. Please additionally add "debug
16" so the data written to the network is included as well.
Does it make a difference if you add the following to one of your action
files?:
{+downgrade-http-version}
# Sticky Actions = +downgrade-http-version
# URL = http://www.nytimes.com/pages/travel/index.html
.nytimes.com/
----------------------------------------------------------------------
Comment By: Kevin (photo2110)
Date: 2011-12-23 10:06
Message:
New log file added with debug 32768 turned on. Truncated page is
http://www.nytimes.com/pages/travel/index.html which dies at:
<h6 class="kicker">Practical Traveler</h6>
<div class="thumbnail">
<a
href="http://travel.nytimes.com/2011/12/25/travel/apps-to-keep-children-happy.html?ref=travel"><img
src="http://graphics8.nytimes.com/images/2011/12/25/travel/25PRAC/25PRAC-thumbStandard-v2.jpg"
width="75" height="75" alt="" border="0" /></a>
</div>
<h3><a href="http://trav
----------------------------------------------------------------------
Comment By: Fabian Keil (fabiankeil)
Date: 2011-12-23 09:41
Message:
Please additionally add "debug 32768" so we can see the data read from the
network.
----------------------------------------------------------------------
Comment By: Kevin (photo2110)
Date: 2011-12-23 09:23
Message:
I've attached a log file for a truncated page.
http://www.nytimes.com/interactive/2011/12/22/magazine/the-lives-they-lived.html?hp#view=dennis_ritchie
Opera's source view goes along until:
"100000001233615":{count:93, commentsEnabled:false},
"100000001233630":{count:57, commentsEnabled:false},
"100000001233632":{count:318, commentsEnabled:false},
"100000001233655":{count:441, commentsEnabled:fa
and we see it just stops in the middle of the word false.
I'm apparently not understanding the log file, it looks like it grabbed the
page twice, with the second grab bad.
----------------------------------------------------------------------
Comment By: Fabian Keil (fabiankeil)
Date: 2011-12-23 08:36
Message:
Thanks for the report.
Please reproduce the problem after enabling logging as described at
http://www.privoxy.org/user-manual/contact.html#CONTACT-BUGS and provide a
log file.
If you can make the pcap file created with Wireshark available, that may be
useful, too.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=111118&aid=3464439&group_id=11118
------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
RSS Feed