headers
Douglas Gregor | 1 Aug 2007 01:08
Picon
Gravatar

Re: development branch(es)

On Jul 31, 2007, at 3:40 PM, David A. Greene wrote:
>> Then, it suggests either some particular flakiness in your network
>> environment, or your svn client is somehow broken.
>
> If "flakiness" means "latency," then that may very well be the  
> case.  But
> network latency is not an issue of "flake."  It's a reality of  
> life.  Things
> should not break due to latency.  Certainly working directories should
> not get corrupted!  That is a showstopper for me and is why I  
> refuse to
> put any of my personal projects into Subversion.

Okay, I looked into this.

Here's my theory: you are checking out a large repository to a  
networked filesystem, say, NFS. The Subversion client downloads a ton  
of data and writes it to many, many small files. The networked  
filesystem slows to a crawl under the load (creating many small files  
is a particularly bad case for many networked file systems), and  
essentially the Subversion client can't keep up with the server that  
is feeding its data. After a while, the Subversion server gets bored  
of waiting for the client and closes the connection.

Why does turning off http compression help? Probably because turning  
off compression makes for much more Subversion server->client  
traffic, and gives the networked file system time to catch up when it  
is writing files. Since compression ratios for source code can be  
very high, and networked file systems generally don't compress data  
when transmitting files, there would be a very large imbalance
(Continue reading)

Permalink | Reply | 4 comments |
headers
Douglas Gregor | 1 Aug 2007 01:12
Picon
Gravatar

Re: development branch(es)

On Jul 31, 2007, at 7:08 PM, Douglas Gregor wrote:
> Here's my theory: you are checking out a large repository to a
> networked filesystem, say, NFS. The Subversion client downloads a ton
> of data and writes it to many, many small files. The networked
> filesystem slows to a crawl under the load (creating many small files
> is a particularly bad case for many networked file systems), and
> essentially the Subversion client can't keep up with the server that
> is feeding its data. After a while, the Subversion server gets bored
> of waiting for the client and closes the connection.

More evidence for this theory... you seem to have said that upgrading  
from Subversion 1.3.1 to 1.4.x helped a bit. Since 1.4.0 introduced a  
new, more compact representation of the working copy of a Subversion  
repository, a checkout with 1.4.x requires much less disk activity (=  
network activity, for a networked file system) than a checkout with  
pre-1.4.0 Subversion. So, you wouldn't see the timeout problem as  
often, because the networked file system is more likely to keep up  
with the server.

	- Doug
_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost
Permalink | Reply | 3 comments |
headers
Peter Dimov | 1 Aug 2007 01:31
Favicon

Re: [Important] Boost Subversion repository is now online

Douglas Gregor wrote:
...
> The main Boost development branch is available via anonymous, read-
> only checkout at:
>
> http://svn.boost.org/svn/boost/trunk/
>
> Or for developer read/write access at:
>
> https://svn.boost.org/svn/boost/trunk/
>
> Information about accessing the Boost Subversion repository is
> available at:
>
> http://svn.boost.org/trac/boost/wiki/BoostSubversion

So I've made the mistake of checking out

https://svn.boost.org/svn/boost/

This is somewhat excessive. :-) How do people manage to keep their working 
copy reasonably small while still keeping an eye on non-trunk parts and a 
branch or two as needed? 

_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost
Permalink | Reply | 3 comments |
headers
Eric Niebler | 1 Aug 2007 01:42
Picon
Favicon

Re: [Important] Boost Subversion repository is now online


Douglas Gregor wrote:
> Please report any problems to me to the main Boost list, and we will  
> try to resolve them as quickly as possible.

I just checked out the svn repository, and I noticed that every file I 
ever deleted from the cvs repository is back. For instance, the entire 
directory "boost/xpressive/detail/static/productions" is old dead code I 
deleted eons ago, and now it lives again. This is a major problem, if 
it's happening to other people, too.

--

-- 
Eric Niebler
Boost Consulting
www.boost-consulting.com

The Astoria Seminar ==> http://www.astoriaseminar.com
_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost
Permalink | Reply | 4 comments |
headers
Rene Rivera | 1 Aug 2007 01:53
Picon
Gravatar

Re: [Important] Boost Subversion repository is now online

Eric Niebler wrote:
> Douglas Gregor wrote:
>> Please report any problems to me to the main Boost list, and we will  
>> try to resolve them as quickly as possible.
> 
> I just checked out the svn repository, and I noticed that every file I 
> ever deleted from the cvs repository is back. For instance, the entire 
> directory "boost/xpressive/detail/static/productions" is old dead code I 
> deleted eons ago, and now it lives again. This is a major problem, if 
> it's happening to other people, too.

Hm, one instance of removed files I know of is the old Boost.Build 
version at tools/build/v1. I don't see it in the checkout I just 
finished doing, or any of the older BBv1 files that lived in 
tools/build. But I see the same extra files you mention.

--

-- 
-- Grafik - Don't Assume Anything
-- Redshift Software, Inc. - http://redshift-software.com
-- rrivera/acm.org - grafik/redshift-software.com
-- 102708583/icq - grafikrobot/aim - grafikrobot/yahoo
_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost
Permalink | Reply | 0 comments |
headers
Douglas Gregor | 1 Aug 2007 02:47
Picon
Gravatar

Re: [Important] Boost Subversion repository is now online


On Jul 31, 2007, at 7:31 PM, Peter Dimov wrote:
> So I've made the mistake of checking out
>
> https://svn.boost.org/svn/boost/
>
> This is somewhat excessive. :-)

That's a big checkout. Thanks for stress-testing our server <G>

> How do people manage to keep their working
> copy reasonably small while still keeping an eye on non-trunk parts  
> and a
> branch or two as needed?

I just check out several branches separately, although I imagine  
there are other solutions.

	- Doug
_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost
Permalink | Reply | 0 comments |
headers
David A. Greene | 1 Aug 2007 02:49

Re: development branch(es)

On Tuesday 31 July 2007 18:12, Douglas Gregor wrote:
> On Jul 31, 2007, at 7:08 PM, Douglas Gregor wrote:
> > Here's my theory: you are checking out a large repository to a
> > networked filesystem, say, NFS. The Subversion client downloads a ton
> > of data and writes it to many, many small files. The networked
> > filesystem slows to a crawl under the load (creating many small files
> > is a particularly bad case for many networked file systems), and
> > essentially the Subversion client can't keep up with the server that
> > is feeding its data. After a while, the Subversion server gets bored
> > of waiting for the client and closes the connection.

I absolutely agree with your diagnosis.

The problem with Subversion is not the timeouts per se.  If that's
all that happened, it would be an annoyance.

The problem with Subversion is that these timeouts can sometimes
cause working directory corruption.  That is absolutely, positively
unacceptable for anyone doing critical work.  Note that I'm not
talking about errors from the network filesystem itself (broken
connections causing errors on file I/O, etc.).  I'm talking about http
protocol timeouts.  Subversion should be resilient enough to exit
gracefully under such circumstances and it doesn't always do that.

                                      -Dave
_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost
Permalink | Reply | 2 comments |
headers
Douglas Gregor | 1 Aug 2007 03:11
Picon
Gravatar

Re: [Important] Boost Subversion repository is now online


On Jul 31, 2007, at 7:42 PM, Eric Niebler wrote:

>
> Douglas Gregor wrote:
>> Please report any problems to me to the main Boost list, and we will
>> try to resolve them as quickly as possible.
>
> I just checked out the svn repository, and I noticed that every file I
> ever deleted from the cvs repository is back. For instance, the entire
> directory "boost/xpressive/detail/static/productions" is old dead  
> code I
> deleted eons ago, and now it lives again. This is a major problem, if
> it's happening to other people, too.

I'm guessing this is related to
	http://cvs2svn.tigris.org/faq.html#atticprob
and is caused by corruption in the SourceForge CVS repository that  
had some files in both a CVS directory and in the Attic. I don't know  
how this corruption occurred, but the safest route (from the  
perspective of preserving history) is to keep both copies of the  
files. That may be what happened here.

I wonder what other files are affected... I'll be happy to clean this  
up if we can figure out how to identify these files.

	- Doug
_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost
(Continue reading)

Permalink | Reply | 2 comments |
headers
Andrew Sutton | 1 Aug 2007 03:21
Picon

Re: Upcoming review of Time Series

>> And if anybody would like to peruse the documentation online, you can
>> find it here:
>>
>>    http://boost-sandbox.sourceforge.net/libs/time_series/doc/html/

I'm curious about the property maps reference in the time series  
documentation. Boost already has a property maps library (actually  
just a header file). It's used heavily by Boost.Graph. I'm curious  
how your interpretation differs and whether or not it's worth trying  
to merge them or if they're just fundamentally different.

Andrew Sutton
asutton <at> cs.kent.edu
_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost
Permalink | Reply | 3 comments |
headers
Beman Dawes | 1 Aug 2007 04:59
Picon
Favicon
Gravatar

Re: [Important] Boost Subversion repository is now online

Douglas Gregor wrote:
> Hello all,
> 
> The Boost Subversion repository is now back online. All of the files  
> in CVS (including their histories) have been imported into the  
> Subversion repository.

After an apparently successful checkout, diff from log isn't working.

Edit a file. Say trunk/configure.
Using TortoiseSVN, select it. Right click to get context menu. Select 
diff. Works fine.

Using TortoiseSVN, select it again if needed. Right click to get context 
menu. Select show log. Works fine. Select one of the log messages. Right 
click for context menu. Select Compare with working copy.

This results in an error dialog: PROPFIND request failed on 
'/svn/boost/svn/bc/36681/trunk/boost/configure' ... 207 Multi-Status 
(https://svn.boost.org)

--Beman
Permalink | Reply | 11 comments |

Gmane