[e2e] MRTG data at Berkeley

[qiw3 at lehigh.edu]

It is truly wonderful to receive so many helps within few hours of my request. 
Special thanks go to Bill, Randy, Mark, Alex, and Ken!!!  I will discuss with 
Ken offlist. 

Some information on my project: 
I am working on an available bandwidth measurement tool using active probing.  
Our tool is called FEAT (FishEye Available bandwidth Tool). It is similar to 
pathChirp [Ribeiro 2003] in a sense that FEAT sends a probe stream covering a 
range of packet rate. However, the stream pattern in FEAT is different and 
a “fisheye” effect of the packet stream should improve the measurement 
accuracy (to be tested on Internet paths). FEAT is a part of AwareWare 
middleware (https://www.fastlane.nsf.gov/servlet/showaward?award=0438300) I 
proposed in my dissertation research. 

To test FEAT on real Internet, I follow the MRTG test method discussed in 
spruce [Strauss 2003]. I test the tool from one machine at Berkeley to another 
machine at Lehigh, and record the measured end-to-end available bandwidth. In 
order to check our measured results against the “true values”, MRTG validation 
requires access to MRTG raw data from *all links* of a path, and the capacity 
of each link. The end-to-end available bandwidth is calculated as the minimum 
of (capacity – cross traffic) of all links along the path. Although 5 minutes 
resolution is low, the MRTG data so far is the most accurate way to validate 
the output of an avi-bw tool.

The path (16 hops) from Lehigh to Berkeley goes from Lehigh campus network -> 
magpi.net->Abilene->cenic->Berkeley campus (the result from traceroute). If I 
can collect MRTG data for Berkeley campus, there are still few links missing, 
especially one link from Lehigh to magpi backbone, the link from magpi 
backbone to Abilene backbone, and 3 links on cenic. Although these missing 
links are all 1G capacities, they should have less or no impact on final avi-
bw calculation, until checked carefully, I am not at ease to draw conclusions. 

Available bandwidth measurement should be an interesting topic for the end2end 
community. From my experience, the difficult (and time consuming) thing for 
tool validation on real Internet is to find appropriate remote hosts and 
collect “true value” data (e.g. MRTG data). It may need a large collaboration 
in our community. Any one try to discuss this on PAM 2005 
(http://www.pam2005.org/)?

[Ribeiro 2003] V. Ribeiro, R. Riedi, R. Baraniuk, J. Navratil, and L. 
Cottrell. pathChirp: Efficient available bandwidth estimation for network 
paths. In Passive and Active Measurement Workshop, (April 2003).

[Strauss 2003] Jacob Strauss, Dina Katabi, Frans Kaashoek. A measurement study 
of available bandwidth estimation tools. In Proceedings of the 2003 ACM 
SIGCOMM conference on Internet measurement, pp. 39-44, USA , Oct. 27 - 29, 
2003.


Thanks, 

Qiang Wang

Dept. of Computer Science and Engineering
Lehigh University


Quoting ken lindahl <lindahl at berkeley.edu>:

> hi Qiang,
> 
> you can view the graphs of berkeley's data at
> http://cricket.berkeley.edu
> 
> (we are also an NLANR AMP site, if that's of any interest:
> http://watt.nlanr.net/active/amp-ucb/HPC/body.html )
> 
> if you're requesting access to the raw data, please contact me
> offlist, and we'll see what sort of arrangements we can make.
> 
> thanks,
> ken lindahl
> uc berkeley
> 
> At 05:32 PM 10/13/2004, qiw3 at lehigh.edu wrote:
> >Dear all: 
> >I am working on network bandwidth measurement and would like to know how to
> 
> >get real time MRTG data log of Berkeley's campus network. We have collected
> 
> >Lehigh's campus network MRTG data (requires an Lehigh account to access) and
> 
> >the Internet-2 MRTG data (free online at internet-2). In order to get the
> end-
> >to-end MRTG information, Berkeley's MRTG is highly desired. We have an 
> >collaborator at Berkeley but don't know where to find the data. If MRTG is 
> >accessable to an Berkeley's account, we really appreciate if anyone can tell
> 
> >us how to find the data. 
> >
> >Thanks, 
> >
> >Qiang Wang
> >
> >Dept. of Computer Science and Engineering
> >Lehigh University
> >
> >-------------------------------------------------
> >This mail sent through IMP: http://horde.org/imp/
> 




-------------------------------------------------
This mail sent through IMP: http://horde.org/imp/