Peter Van Epp | 1 May 04:30
Picon
Picon
Favicon
Gravatar

Re: segfault at 000000000311c000 rip 000000000040fb46 rsp 0000007fbffff830 error 4

On Thu, Apr 30, 2009 at 11:09:40AM +0200, Gunnar Lindberg wrote:
> I'm new to this list and I hope my question is relevant for it. If
> the subject has been beaten to death please direct me to the archives.
> 
> We have 2 Argus collector machines, each with opto splitters and
> 2 Myricom 10GbE cards (using only the Rx side, of course). Then a
> third machine merging all data.
> 
> Recently both collectors have started to report as below (and stopped
> collecting data until argus is restarted). It happens roughly once a
> day and we're not happy - a litte worse than just annoying.
> 
> 
> /var/log/messages (and dmesg)
> 
> Apr 28 15:38:07 argc kernel: argus[17240]: segfault at 0000000004a14000 rip 000000000040fb46 rsp
0000007fbffff830 error 4
> Apr 28 15:18:42 argc kernel: argus[16262] general protection rip:3fabc696bd rsp:7fbffff5c0 error:0
> 
> Apr 29 15:50:21 argv kernel: argus[2511]: segfault at 000000000311c000 rip 000000000040fb46 rsp
0000007fbffff830 error 4
> Apr 29 16:35:20 argv kernel: argus[2641] general protection rip:40efbf rsp:7fbffff778 error:0
> 
> 
> Bad memeory?
> 
> 
> 	Gunnar Lindberg, IRT,
> 	Chalmers University of Technology,
> 	Gothenburg, Sweden
(Continue reading)

Peter Van Epp | 1 May 04:47
Picon
Picon
Favicon
Gravatar

Re: gdb data for model....

On Wed, Apr 29, 2009 at 09:01:11AM -0400, Carter Bullard wrote:
> Hey Peter,
> Thanks for the reply!!!
> I've made quite a number of changes to try to solve this problem, but
> haven't heard a peep in a while, so I'd love to think that the problem
> is solved ;o)
>
> I do know better, so is anyone having problems with their argus
> stopping?
>
> Carter
>

	SFU is having problems of some kind (reported as missing flows although
I'm not yet sure exactly what that means, it may mean that DSCC is reporting 
flows that argus is missing or that argus is stopping as Russell is seeing). 
The poor fellow that inheirited most of my tasks when I retired is upgrading 
to the latest beta code in between fire fighting so I may get some more info 
from there later. 
	I've put the latest beta code on a HP AMD machine with FreeBSD on my
ADSL link (the HP being quiet enough to leave on continuously :-)) at home and 
I'll see what happens. 
	As to syslog, would I be correct in assuming that "enabling syslog" 
involves commenting out the 

#undef ARGUS_SYSLOG

at line 1757 of common/argus_util.c? If you don't do that I believe syslog will
be disabled because the

(Continue reading)

Peter Van Epp | 1 May 04:53
Picon
Picon
Favicon
Gravatar

Re: best way to collect traffic

On Fri, Apr 24, 2009 at 08:44:33AM +0300, Oguz Yarimtepe wrote:
> 
> I am generally using a dataset [1] for testing purposes. What i do is
> converting the tcpdump files to arg3 records and analyse the results. 
> 
> A few days ago i tried to check my own traffic so i run the tcpdump
> while surfing. After a while i break the process by ctrl+c and converted
> the dumo file arg3 and check the results. I saw some <?> values at the
> direction field. So i thought, collecting the traffing in this way is
> not a good idea or i broke the connection an packages so the flow data
> was missing. 
> 
> What is the good way to collect a traffic for analyzing via argus?
> 
> -- 
> Oguz Yarimtepe
> http://www.loopbacking.info
> 

	Another thought just occurred to me: are you using ra to check the 
results or racluster? Argus flushes flow status every 2 minutes by default so
a long lasting connection (such as an ssh session) will have an initial 
report with the direction field correct and a bunch more for the same flow 
with a <?> direction (as it has no longer seen the syn / syn-ack sequence).
I believe racluster (it used to he ragator in 2.x) is the current way of 
combining the flows by 5 tuple so the direction field will be correct and 
you will get what you expect.

Peter Van Epp

(Continue reading)

Rodney McKee | 1 May 05:11
Favicon
Gravatar

simple question

Hello again,

Trying to calculate the in/out traffic loads, I'm comparing the figures against what I'm seeing from interface metrics that we collect but I feel like I'm missing something.

What I'm doing is:
ra -M rmon -r 27.gz -s +load +sload +dload +smac +dmac -w - | rabins -r - -M hard time 1h -m srcid -s stime sbytes:20 dbytes:20 bytes:20 sload:20 dload:20 load:20 - ether src host 00:15:60:0C:B5:6A

So I'm figuring that SrcLoad is Outbound traffic. The figures I see from the interface metrics are closer though to the Load figures given from above.

argus output
                 StartTime             SrcBytes             DstBytes             TotBytes              SrcLoad              DstLoad                 Load
27/04/2009-04:00:00.000000            544139830             83161971            627301801       1209197.250000        184803.750000       1394002.250000
27/04/2009-05:00:00.000000           1979298092            146014107           2125312199       4398437.500000        324475.156250       4722913.500000
27/04/2009-06:00:00.000000           2412275071            480879101           2893154172       5360608.500000       1068619.125000       6429229.500000
27/04/2009-07:00:00.000000           6970566762            966247468           7936814230      15490145.000000       2147215.750000      17637362.000000
27/04/2009-08:00:00.000000          17933268517           2423718411          20356986928      39851704.000000       5386040.000000      45237748.000000
27/04/2009-09:00:00.000000          23271491312           3829316888          27100808200      51714424.000000       8509592.000000      60224016.000000
27/04/2009-10:00:00.000000          26257970562           4233687703          30491658265      58351044.000000       9408194.000000      67759240.000000
27/04/2009-11:00:00.000000          23591095772           4389753056          27980848828      52424656.000000       9755006.000000      62179660.000000
27/04/2009-12:00:00.000000          16555652766           3240043773          19795696539      36790336.000000       7200096.000000      43990436.000000
27/04/2009-13:00:00.000000          19559899519           4991517679          24551417198      43466440.000000      11092260.000000      54558704.000000
27/04/2009-14:00:00.000000          23574890868           5109169305          28684060173      52388644.000000      11353708.000000      63742352.000000
27/04/2009-15:00:00.000000          21761664067           5834251251          27595915318      48359252.000000      12965001.000000      61324256.000000
27/04/2009-16:00:00.000000          24161715148           5922949812          30084664960      53692696.000000      13162109.000000      66854808.000000
27/04/2009-17:00:00.000000          23003436222           4492372342          27495808564      51118744.000000       9983048.000000      61101796.000000
27/04/2009-18:00:00.000000          11435713134           2486263593          13921976727      25412694.000000       5525029.000000      30937724.000000
27/04/2009-19:00:00.000000           6142658199           1634763128           7777421327      13650349.000000       3632805.500000      17283156.000000
27/04/2009-20:00:00.000000           2377635585            922213731           3299849316       5283632.000000       2049362.375000       7332996.500000
27/04/2009-21:00:00.000000           3329400706            674401100           4003801806       7398665.500000       1498668.000000       8897335.000000
27/04/2009-22:00:00.000000           1568776400            720788697           2289565097       3486167.500000       1601751.250000       5087920.500000

interface metrics
                       BytesIn        BytesOut
Mon Apr 27 05:00:00    23390.387      152500.974
Mon Apr 27 06:00:00    41009.981      559265.829
Mon Apr 27 07:00:00    135087.280     674614.462
Mon Apr 27 08:00:00    271467.261     1964860.180
Mon Apr 27 09:00:00    686449.192     5002815.168
Mon Apr 27 10:00:00    1077715.488    6472908.352
Mon Apr 27 11:00:00    1186174.633    7323689.670
Mon Apr 27 12:00:00    1232380.087    6576175.580
Mon Apr 27 13:00:00    903910.123     4618560.018
Mon Apr 27 14:00:00    1403423.108    5483045.482
Mon Apr 27 15:00:00    1428080.515    6568581.137
Mon Apr 27 16:00:00    1640070.165    6043557.655
Mon Apr 27 17:00:00    1656852.362    6755519.181
Mon Apr 27 18:00:00    1257393.787    6388033.646
Mon Apr 27 19:00:00    685312.993     3148833.982
Mon Apr 27 20:00:00    457994.878     1707114.485
Mon Apr 27 21:00:00    255553.813     668281.440
Mon Apr 27 22:00:00    192650.760     929612.043
Mon Apr 27 23:00:00    197845.619     436765.695


Rgds
Rodney
Peter Van Epp | 1 May 05:12
Picon
Picon
Favicon
Gravatar

Re: gdb data for model....

<snip>
> 
> #ifdef ARGUS_SYSLOG at line 1805 won't be true and syslog won't get called as
> far as I can see and since I'm not seeing any syslog messages from argus so
> far, it either hasn't decided to log anything yet or this is true :-).  I'll
> comment this out and see what happens. 
> 
> Peter Van Epp

	Looks correct. changing that to a #define ARGUS_SYSLOG 1 (and moving 
the undef to the bottom of the routine which probbaly isn't needed) makes 
syslog work on my FreeBSD box. Argus syslogged the started and interface up
messages on boot which it hadn't been doing before (syslog.conf needed an
addition for daemon which isn't logged by default as well). We may want to 
change (or at least arrange to allow a change during config) of the facility
to something other than daemon (such as one of the LOCALs). FreeBSD doesn't 
seem to log much to daemon but SFU's Suns tend to fill daemon with all kinds
of messages bind being particularly verbose which could be a pain to deal 
with.

Peter Van Epp

Carter Bullard | 1 May 05:13

Re: gdb data for model....

Whoa,
I had completely missed the #undef ARGUS_SYSLOG, fixed!!!!!!!!
Carter

On Apr 30, 2009, at 10:47 PM, Peter Van Epp wrote:

> On Wed, Apr 29, 2009 at 09:01:11AM -0400, Carter Bullard wrote:
>> Hey Peter,
>> Thanks for the reply!!!
>> I've made quite a number of changes to try to solve this problem, but
>> haven't heard a peep in a while, so I'd love to think that the  
>> problem
>> is solved ;o)
>>
>> I do know better, so is anyone having problems with their argus
>> stopping?
>>
>> Carter
>>
>
> 	SFU is having problems of some kind (reported as missing flows  
> although
> I'm not yet sure exactly what that means, it may mean that DSCC is  
> reporting
> flows that argus is missing or that argus is stopping as Russell is  
> seeing).
> The poor fellow that inheirited most of my tasks when I retired is  
> upgrading
> to the latest beta code in between fire fighting so I may get some  
> more info
> from there later.
> 	I've put the latest beta code on a HP AMD machine with FreeBSD on my
> ADSL link (the HP being quiet enough to leave on continuously :-))  
> at home and
> I'll see what happens.
> 	As to syslog, would I be correct in assuming that "enabling syslog"
> involves commenting out the
>
> #undef ARGUS_SYSLOG
>
> at line 1757 of common/argus_util.c? If you don't do that I believe  
> syslog will
> be disabled because the
>
> #ifdef ARGUS_SYSLOG at line 1805 won't be true and syslog won't get  
> called as
> far as I can see and since I'm not seeing any syslog messages from  
> argus so
> far, it either hasn't decided to log anything yet or this is  
> true :-).  I'll
> comment this out and see what happens.
>
> Peter Van Epp
>

Attachment (smime.p7s): application/pkcs7-signature, 3815 bytes
Carter Bullard | 1 May 05:25

Re: simple question

Hey Rodney,
If you want to compare argus data with interface data, you need to
make sure that the concept of "interface" is preserved in the argus
aggregation, so we need to get the "smac" into the aggregation.

 I would suggest that you do this instead:
  
   rabins -M rmon -r 27.gz -M hard time 1h -m srcid smac -w - | \
      ra -s stime srcid smac sbytes:20 dbytes:20 bytes:20 sload:20 dload:20 load:20 - ether src host 00:15:60:0C:B5:6A

The main difference, is that we have added "smac" to the aggregation.
We need the second ra(), so we can select the record where the mac
address is the source, which is the single record where the metrics
represent the input and output values for the interface.

Carter

On Apr 30, 2009, at 11:11 PM, Rodney McKee wrote:

Hello again,

Trying to calculate the in/out traffic loads, I'm comparing the figures against what I'm seeing from interface metrics that we collect but I feel like I'm missing something.

What I'm doing is:
ra -M rmon -r 27.gz -s +load +sload +dload +smac +dmac -w - | rabins -r - -M hard time 1h -m srcid -s stime sbytes:20 dbytes:20 bytes:20 sload:20 dload:20 load:20 - ether src host 00:15:60:0C:B5:6A

So I'm figuring that SrcLoad is Outbound traffic. The figures I see from the interface metrics are closer though to the Load figures given from above.

argus output 
                 StartTime             SrcBytes             DstBytes             TotBytes              SrcLoad              DstLoad                 Load
27/04/2009-04:00:00.000000            544139830             83161971            627301801       1209197.250000        184803.750000       1394002.250000
27/04/2009-05:00:00.000000           1979298092            146014107           2125312199       4398437.500000        324475.156250       4722913.500000
27/04/2009-06:00:00.000000           2412275071            480879101           2893154172       5360608.500000       1068619.125000       6429229.500000
27/04/2009-07:00:00.000000           6970566762            966247468           7936814230      15490145.000000       2147215.750000      17637362.000000
27/04/2009-08:00:00.000000          17933268517           2423718411          20356986928      39851704.000000       5386040.000000      45237748.000000
27/04/2009-09:00:00.000000          23271491312           3829316888          27100808200      51714424.000000       8509592.000000      60224016.000000
27/04/2009-10:00:00.000000          26257970562           4233687703          30491658265      58351044.000000       9408194.000000      67759240.000000
27/04/2009-11:00:00.000000          23591095772           4389753056          27980848828      52424656.000000       9755006.000000      62179660.000000
27/04/2009-12:00:00.000000          16555652766           3240043773          19795696539      36790336.000000       7200096.000000      43990436.000000
27/04/2009-13:00:00.000000          19559899519           4991517679          24551417198      43466440.000000      11092260.000000      54558704.000000
27/04/2009-14:00:00.000000          23574890868           5109169305          28684060173      52388644.000000      11353708.000000      63742352.000000
27/04/2009-15:00:00.000000          21761664067           5834251251          27595915318      48359252.000000      12965001.000000      61324256.000000
27/04/2009-16:00:00.000000          24161715148           5922949812          30084664960      53692696.000000      13162109.000000      66854808.000000
27/04/2009-17:00:00.000000          23003436222           4492372342          27495808564      51118744.000000       9983048.000000      61101796.000000
27/04/2009-18:00:00.000000          11435713134           2486263593          13921976727      25412694.000000       5525029.000000      30937724.000000
27/04/2009-19:00:00.000000           6142658199           1634763128           7777421327      13650349.000000       3632805.500000      17283156.000000
27/04/2009-20:00:00.000000           2377635585            922213731           3299849316       5283632.000000       2049362.375000       7332996.500000
27/04/2009-21:00:00.000000           3329400706            674401100           4003801806       7398665.500000       1498668.000000       8897335.000000
27/04/2009-22:00:00.000000           1568776400            720788697           2289565097       3486167.500000       1601751.250000       5087920.500000

interface metrics
                       BytesIn        BytesOut
Mon Apr 27 05:00:00    23390.387      152500.974
Mon Apr 27 06:00:00    41009.981      559265.829
Mon Apr 27 07:00:00    135087.280     674614.462
Mon Apr 27 08:00:00    271467.261     1964860.180
Mon Apr 27 09:00:00    686449.192     5002815.168
Mon Apr 27 10:00:00    1077715.488    6472908.352
Mon Apr 27 11:00:00    1186174.633    7323689.670
Mon Apr 27 12:00:00    1232380.087    6576175.580
Mon Apr 27 13:00:00    903910.123     4618560.018
Mon Apr 27 14:00:00    1403423.108    5483045.482
Mon Apr 27 15:00:00    1428080.515    6568581.137
Mon Apr 27 16:00:00    1640070.165    6043557.655
Mon Apr 27 17:00:00    1656852.362    6755519.181
Mon Apr 27 18:00:00    1257393.787    6388033.646
Mon Apr 27 19:00:00    685312.993     3148833.982
Mon Apr 27 20:00:00    457994.878     1707114.485
Mon Apr 27 21:00:00    255553.813     668281.440
Mon Apr 27 22:00:00    192650.760     929612.043
Mon Apr 27 23:00:00    197845.619     436765.695


Rgds
Rodney

Attachment (smime.p7s): application/pkcs7-signature, 3815 bytes
Harry Hoffman | 1 May 21:36
Favicon

argus threaded

Hi All,

As a was building the latest version of argus I noticed that there is 
the option to run argus as a threaded process.

Currently we run 4 seperate version of argus with different bpf filters 
(we have 4 cpus in our argus box).

Wondering if anyone is running argus with threads under linux and what 
your experience/thoughts are with this type of setup.

Cheers,
Harry

Peter Van Epp | 2 May 04:52
Picon
Picon
Favicon
Gravatar

Re: argus threaded

On Fri, May 01, 2009 at 03:36:54PM -0400, Harry Hoffman wrote:
> Hi All,
>
> As a was building the latest version of argus I noticed that there is  
> the option to run argus as a threaded process.
>
> Currently we run 4 seperate version of argus with different bpf filters  
> (we have 4 cpus in our argus box).
>
> Wondering if anyone is running argus with threads under linux and what  
> your experience/thoughts are with this type of setup.
>
> Cheers,
> Harry
>

	Unless you are (as I often do) removing .thread in the top level of 
the clients directory, you are running threads by default if your machine 
supports it. It is still disabled by default (no .thread) in the argus 
distribution, I had a variety of problems with hangs early in 3.0 and I think 
we eventually decided it was problematic and disabled it (again, I was in any 
case :-)) but Carter will have the best opinion on how stable it may be if
enabled.

Peter Van Epp 

Rodney McKee | 4 May 01:26
Favicon
Gravatar

errors running rahisto

Getting a seg fault when running rahisto against a rabins output file.
The run works against the previous days collected data.
What details can I provide to work out what might be the problem.

argus <at> nas2.drp.acx:/var/log/argus/archive/dxb/fw1/2009/05
$ rabins -M rmon hard time 5m -m smac -r 02.gz -w rabins.out

argus <at> nas2.drp.acx:/var/log/argus/archive/dxb/fw1/2009/05
$ rahisto -r rabins.out -H sload 10 - ether src host 00:15:60:0C:B5:6A
Segmentation fault



Rgds
Rodney

Gmane