Ikram M. Khan | 1 Jun 23:39 2010
Picon

Request for help

Dear All,

I am searching desperately for some help to simulate FreeNet Simulator (http://github.com/freenet/simulator-simsalabim). I request you all, Freenet Developer, to kindly help me for running this simulator. Does anyone experimented this simulator?

with bests,
imk

_______________________________________________
Devl mailing list
Devl@...
http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Ikram M. Khan | 2 Jun 22:31 2010
Picon

How to write a script file for tests

Hi All,

I am working on Freenet simulator and am happy to successfully compiled and run the simulator. I want to have some test to see the behaviour of FreeNet simulator. What is basically mentioned in the Main.java file that the input for the simulating scenario should be of the form:

Usage:  simsalabim.Main  <scriptfile> <settings> <logfile> [prng seed]

I am wondering how to write a script file for running simple tests? Is there any specific format? Is there samples?

Sincerely,
imk

P.S: I request all developers for your precious time. I believe it would contribute to newbie's and the purpose of this mailing list.

_______________________________________________
Devl mailing list
Devl@...
http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Ximin Luo | 3 Jun 00:01 2010
Picon
Picon

Re: How to write a script file for tests

Hi Ikram,

Thanks for your interest in freenet, and sorry that there hasn't been much
reply to your question. The thing with freenet these days is that there is very
little developer time going into it (toad is the only developer doing regular
work), and the documentation is poor.

As far as I know there are no examples for running these tests you want. Also,
the codebase is always changing so I don't know if that simulator reflects the
current behaviour (although the basic gist of it should be there).

The author of that code is vive <vive@...> who is on this
mailing list; I don't know what they're up to and why they haven't replied yet.

You'll need to look through the source code I'm afraid. It's a bad situation
that this project is in, but that's the state of things. :(

If you plan to stay with us, then please do add whatever documentation you
manage to work out, to our new wiki at [1]. If I have some time over the
summer, I'll try to organise the project infrastructure better; you're welcome
to help out, and so is anyone else.

X

[1] http://new-wiki.freenetproject.org/

On 02/06/10 21:31, Ikram M. Khan wrote:
> Hi All,
> 
> I am working on Freenet simulator and am happy to successfully compiled and
> run the simulator. I want to have some test to see the behaviour of FreeNet
> simulator. What is basically mentioned in the Main.java file that the input
> for the simulating scenario should be of the form:
> 
> Usage:  simsalabim.Main  <scriptfile> <settings> <logfile> [prng seed]
> 
> I am wondering how to write a script file for running simple tests? Is there
> any specific format? Is there samples?
> 
> Sincerely,
> imk
> 
> P.S: I request all developers for your precious time. I believe it would
> contribute to newbie's and the purpose of this mailing list.
> 
> 
> 
> 
> _______________________________________________
> Devl mailing list
> Devl@...
> http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Ikram M. Khan | 3 Jun 13:43 2010
Picon

Re: Devl Digest, Vol 6, Issue 3

Dear Luo,
 
Thanks for your reply and encouragement. I would like to contibute by keeping this mailing list alive.
I would request (one more time) all developers that kindly share your expierences or tips to overcome genuine issues.
 
With thanks and bests,
imk
 
ps. I would compile my experiences (by making a 'HowTo' tutorial for the wiki).

On Wed, Jun 2, 2010 at 11:00 PM, <devl-request <at> freenetproject.org> wrote:
Send Devl mailing list submissions to
       devl <at> freenetproject.org

To subscribe or unsubscribe via the World Wide Web, visit
       http://freenetproject.org/cgi-bin/mailman/listinfo/devl
or, via email, send a message with subject or body 'help' to
       devl-request-RdDMkVZAZeuJnvDnx1genB2eb7JE58TQ@public.gmane.org

You can reach the person managing the list at
       devl-owner-RdDMkVZAZeuJnvDnx1genB2eb7JE58TQ@public.gmane.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Devl digest..."


Today's Topics:

  1. How to write a script file for tests (Ikram M. Khan)
  2. Re: How to write a script file for tests (Ximin Luo)


----------------------------------------------------------------------

Message: 1
Date: Wed, 2 Jun 2010 22:31:09 +0200
From: "Ikram M. Khan" <engr.ikram-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
To: devl-RdDMkVZAZeuJnvDnx1genB2eb7JE58TQ@public.gmane.org
Subject: [freenet-dev] How to write a script file for tests
Message-ID:
       <AANLkTinNPKBygUs8dPWh4GW2bxyi5mRIZIa0EPyPQppO <at> mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi All,

I am working on Freenet simulator and am happy to successfully compiled and
run the simulator. I want to have some test to see the behaviour of FreeNet
simulator. What is basically mentioned in the Main.java file that the input
for the simulating scenario should be of the form:

Usage:  simsalabim.Main  <scriptfile> <settings> <logfile> [prng seed]

I am wondering how to write a script file for running simple tests? Is there
any specific format? Is there samples?

Sincerely,
imk

P.S: I request all developers for your precious time. I believe it would
contribute to newbie's and the purpose of this mailing list.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://freenetproject.org/pipermail/devl/attachments/20100602/3aa42064/attachment-0001.html>

------------------------------

Message: 2
Date: Wed, 02 Jun 2010 23:01:46 +0100
From: Ximin Luo <xl269-KWPb1pKIrIJaa/9Udqfwiw@public.gmane.org>
To: Discussion of development issues <devl-RdDMkVZAZeuJnvDnx1genB2eb7JE58TQ@public.gmane.org>
Subject: Re: [freenet-dev] How to write a script file for tests
Message-ID: <4C06D4CA.7010405 <at> cam.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1

Hi Ikram,

Thanks for your interest in freenet, and sorry that there hasn't been much
reply to your question. The thing with freenet these days is that there is very
little developer time going into it (toad is the only developer doing regular
work), and the documentation is poor.

As far as I know there are no examples for running these tests you want. Also,
the codebase is always changing so I don't know if that simulator reflects the
current behaviour (although the basic gist of it should be there).

The author of that code is vive <vive-RdDMkVZAZeuJnvDnx1genB2eb7JE58TQ@public.gmane.org> who is on this
mailing list; I don't know what they're up to and why they haven't replied yet.

You'll need to look through the source code I'm afraid. It's a bad situation
that this project is in, but that's the state of things. :(

If you plan to stay with us, then please do add whatever documentation you
manage to work out, to our new wiki at [1]. If I have some time over the
summer, I'll try to organise the project infrastructure better; you're welcome
to help out, and so is anyone else.

X

[1] http://new-wiki.freenetproject.org/

On 02/06/10 21:31, Ikram M. Khan wrote:
> Hi All,
>
> I am working on Freenet simulator and am happy to successfully compiled and
> run the simulator. I want to have some test to see the behaviour of FreeNet
> simulator. What is basically mentioned in the Main.java file that the input
> for the simulating scenario should be of the form:
>
> Usage:  simsalabim.Main  <scriptfile> <settings> <logfile> [prng seed]
>
> I am wondering how to write a script file for running simple tests? Is there
> any specific format? Is there samples?
>
> Sincerely,
> imk
>
> P.S: I request all developers for your precious time. I believe it would
> contribute to newbie's and the purpose of this mailing list.
>
>
>
>
> _______________________________________________
> Devl mailing list
> Devl-RdDMkVZAZeuJnvDnx1genB2eb7JE58TQ@public.gmane.org
> http://freenetproject.org/cgi-bin/mailman/listinfo/devl


------------------------------

_______________________________________________
Devl mailing list
Devl <at> freenetproject.org
http://freenetproject.org/cgi-bin/mailman/listinfo/devl

End of Devl Digest, Vol 6, Issue 3
**********************************

_______________________________________________
Devl mailing list
Devl@...
http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Ximin Luo | 5 Jun 05:28 2010
Picon
Picon

recent Library changes

Hey toad,

Could you please explain the following:

- SkelTreeMap: What are you trying to do with it? None of the changes make any
functional difference AFAICS. There's no point "encapsulating" SkelValue stuff
into separate methods; that class is used only within SkelTreeMap.

- SkelBTreeMap: In update(), what did you do to the main loop?

- Notifier: what's it for?

- ObjectProcessor: What's the new stuff (capacity, etc) you've added for?

How is performance now? If it's still a problem, then it'll probably be better
to make the async design changes I mentioned, rather than repeatedly add lots
of hacks that bloat the code. (For example, data structures classes shouldn't
need to have arbitrary queue limits hard-coded into them.)

Some minor changes that I will be making anyways:

1. adding a Objects.idString() instead of using System.identityHashcode in 3
separate classes to do the same thing. Where have you used Object.toString()
implicitly? I only know of "+this+", and I'll be replacing those snippets with
"+Objects.idString(this)+".

2. re-implementing SkelBTreeMap.keySetAutoDeflate() to NOT DUPLICATE CODE.
Instead, BTreeMap.entrySet() will use a separate BTreeIterator class with
parameters/hooks(onDscInto,onAscFrom)/etc which SkelBTreeMap can use

3. finding a better alternative to TaskAbortExceptionConverter and
ExceptionConverter which iirc were temporary hacks anyways.

Ximin
Matthew Toseland | 5 Jun 13:03 2010
Picon

Re: [GitHub] spencerjackson sent you a pull request from spencerjackson/fred-staging

On Thursday 03 June 2010 23:58:31 you wrote:
> 
> spencerjackson wants you to pull from spencerjackson/fred-staging at ContentFilter
> 
> Body: Moves content filtration to the client layer. In this branch, the content filter is called from
ClientGetter's onSuccess method, depending on whether or not a variable is set in the FetchContext.
Other filter related variables are placed into the Context. Changes, both visible and invisible, are
made to FProxy, enabling it to create multiple fetches for the same key, with slightly different
FetchContexts, and placing checkboxes to toggle filtration. By default, filtration is enabled for
FProxy. For FCP, filtration is disabled by default, but may be enabled by added FilterData=true to the
ClientGet message.
> 
> View repository: http://github.com/spencerjackson/fred-staging/tree/ContentFilter
> 
Ok. I don't plan to merge this before 1248, which should be real soon, but which so far I have been delaying
until the Spider/Library changes are ready. A very brief look over it:

I don't understand 
56ddea7c8ae4f13dc35b0b3c7f7c93b5a867bc0f ("Store a request's charset in FetchContext for the
filter"). If the charset is provided on insert then it will be part of the MIME type on the ClientMetadata.
If it's not we have to autodetect it, in which case we should update the MIME type somehow.

Overriding the MIME type in the FetchContext does however make sense. You might want to investigate its
interaction with transparent unpacking. Transparent unpacking = insert data as a zip at CHK <at> blah, then
access it as CHK <at> blah/fileinzip.txt.

Re FetchContext.hashCode(), many of the elements on FetchContext are mutable IIRC, so if changed on the
fly could change the hashCode, so be careful ... Hmmm, you removed this code anyway...

Anyway, good stuff, I'll try to get it merged in the not too distant future.
_______________________________________________
Devl mailing list
Devl@...
http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Matthew Toseland | 5 Jun 13:10 2010
Picon

Re: recent Library changes

On Saturday 05 June 2010 04:28:55 Ximin Luo wrote:
> Hey toad,
> 
> Could you please explain the following:
> 
> - SkelTreeMap: What are you trying to do with it? None of the changes make any
> functional difference AFAICS. There's no point "encapsulating" SkelValue stuff
> into separate methods; that class is used only within SkelTreeMap.

I wanted to ensure that we always maintain consistency (e.g. w.r.t. isLoaded). This is the usual reason for
encapsulation. However, this was added during debugging, wierd things were happening; if you want to
change it back then do so.
> 
> - SkelBTreeMap: In update(), what did you do to the main loop?

Ummm, several things? The most obvious thing I did was to create a wrapper method to deal with overflow -
stuff that doesn't fit in a node. Other stuff includes processing the queued data in the right order so we
don't generate load until we've dealt with as much as possible. Much of that was designed to ensure, and
enable, finite queue lengths, to avoid OutOfMemory / constant Full GC's.
> 
> - Notifier: what's it for?

Avoiding all the 1 second Thread.sleep()'s.
> 
> - ObjectProcessor: What's the new stuff (capacity, etc) you've added for?

Detecting overflow and thus preventing deadlocks. Look at the call stack.
> 
> How is performance now? If it's still a problem, then it'll probably be better
> to make the async design changes I mentioned, rather than repeatedly add lots
> of hacks that bloat the code. (For example, data structures classes shouldn't
> need to have arbitrary queue limits hard-coded into them.)

That would be great but I want to ship a working system ASAP.

IMHO performance is reasonable at this point. I have still had some OOMs and other wierd errors (e.g. the
Packer stuff recently), but I'm hoping to ship this on Monday.
> 
> Some minor changes that I will be making anyways:
> 
> 1. adding a Objects.idString() instead of using System.identityHashcode in 3
> separate classes to do the same thing. Where have you used Object.toString()
> implicitly? I only know of "+this+", and I'll be replacing those snippets with
> "+Objects.idString(this)+".

IMHO it is cleaner to have a proper toString(), and third party code will NEVER rely on it
> 
> 2. re-implementing SkelBTreeMap.keySetAutoDeflate() to NOT DUPLICATE CODE.
> Instead, BTreeMap.entrySet() will use a separate BTreeIterator class with
> parameters/hooks(onDscInto,onAscFrom)/etc which SkelBTreeMap can use

Sounds good.
> 
> 3. finding a better alternative to TaskAbortExceptionConverter and
> ExceptionConverter which iirc were temporary hacks anyways.

I doubt that there is one, unless you want to store the RuntimeException's.
> 
> Ximin
_______________________________________________
Devl mailing list
Devl@...
http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Ikram M. Khan | 6 Jun 00:16 2010
Picon

How to figure out number of online Freenet users

Dear All,


How can one figure out the number of online FreeNet Users? How to estimate total number of FreeNet users and what is the total number of Freenet Users? 

With best regards,
ikram
_______________________________________________
Devl mailing list
Devl@...
http://freenetproject.org/cgi-bin/mailman/listinfo/devl
DJ Amireh | 6 Jun 04:59 2010
Picon

Re: How to figure out number of online Freenet users

Ikram,

AFAIK (which isn't that much) the only estimate you can get is that of opennet peers. All opennet peers are harvestable by nature (they are advertised publicly). On the Freenet Message System, there is a user who posts the opennet peers occasionally. Here is his latest post: http://pastebin.com/XD78EHmz

- DJ Amireh

On Sat, Jun 5, 2010 at 6:16 PM, Ikram M. Khan <engr.ikram-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
Dear All,

How can one figure out the number of online FreeNet Users? How to estimate total number of FreeNet users and what is the total number of Freenet Users? 

With best regards,
ikram

_______________________________________________
Devl mailing list
Devl-RdDMkVZAZeuJnvDnx1genB2eb7JE58TQ@public.gmane.org
http://freenetproject.org/cgi-bin/mailman/listinfo/devl

_______________________________________________
Devl mailing list
Devl@...
http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Evan Daniel | 6 Jun 06:11 2010
Picon

Re: How to figure out number of online Freenet users

Or, you can check my stats freesite, which has regular updates and graphs:
http://127.0.0.1:8888/USK <at> gjw6StjZOZ4OAG-pqOxIp5Nk11udQZOrozD4jld42Ac,BYyqgAtc9p0JGbJ~18XU6mtO9ChnBZdf~ttCn48FV7s,AQACAAE/graphs/459/

Typical numbers for users online vary from about 6300 to 8100,
depending mostly on time of day.  Number of total users is somewhere
in the 15k-20k range, and depends mostly on how you define "user".

The data is generated based on probe requests; see that site, my flog
(linked from it), and the mailing list archives for more details.

Evan Daniel

On Sat, Jun 5, 2010 at 10:59 PM, DJ Amireh <cactusbin@...> wrote:
> Ikram,
>
> AFAIK (which isn't that much) the only estimate you can get is that of
> opennet peers. All opennet peers are harvestable by nature (they are
> advertised publicly). On the Freenet Message System, there is a user who
> posts the opennet peers occasionally. Here is his latest post:
> http://pastebin.com/XD78EHmz
>
> - DJ Amireh
>
> On Sat, Jun 5, 2010 at 6:16 PM, Ikram M. Khan <engr.ikram@...> wrote:
>>
>> Dear All,
>> How can one figure out the number of online FreeNet Users? How to estimate
>> total number of FreeNet users and what is the total number of Freenet
>> Users?
>> With best regards,
>> ikram
>> _______________________________________________
>> Devl mailing list
>> Devl@...
>> http://freenetproject.org/cgi-bin/mailman/listinfo/devl
>
>
> _______________________________________________
> Devl mailing list
> Devl@...
> http://freenetproject.org/cgi-bin/mailman/listinfo/devl
>

Gmane