create new tag
view all tags

Bean - BES-III Analysis Framework


The tests are being performed at slcXX.ihep.ac.cn machines with 2x Xeon 2.66G Quad Core CPU's using TProofLite.

The goal is to measure the scalability and find out the main performance bottleneck's such as Network I/O or so.

The first test case consists of 10 BES3 DST files served by lustre filesystem at /besfs/.

The run cmdline is as follows:

  bash-3.00$ ./bean.exe -u Bhabha /besfs/offline/data/650-1/dst/090707/run_0010387_All_file011_SFO-* /besfs/offline/data/650-1/dst/090707/run_0010387_All_file011_SFO-* /besfs/offline/data/650-1/dst/090707/run_0010387_All_file012* /besfs/offline/data/650-1/dst/090707/run_0010387_All_file013* /besfs/offline/data/650-1/dst/090707/run_0010387_All_file04* /besfs/offline/data/650-1/dst/090707/run_0010387_All_file015* /besfs/offline/data/650-1/dst/090707/run_0010387_All_file016_SFO-* -p "/?workers=3" -h test_hist3.root 

With number of workers varying from 1 to 8.

All the User Analysis histogram are saved in test_histN.root as well as PROOF performance histograms.

Let's analyse this histograms.

The mean processing time of packet by workers:


multiplied by number of packets and divided by total number of workers it will give us approximate processing time

    PROOF_ProcTimeHist->GetMean(2) * PROOF_ProcTimeHist->GetEntries() /PROOF_ProcTimeHist->GetXaxis()->GetNbins()   


Let's estimate I/O overhead as

(PROOF_ProcTimeHist->GetMean(2) - PROOF_CpuTimeHist->GetMean(2)) * PROOF_ProcTimeHist->GetEntries() /PROOF_ProcTimeHist->GetXaxis()->GetNbins()

Another way to do this is to use proof->GetRealTime and proof->GetCpuTime. Such a output is presented by Bean.

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r2 - 2010-02-12 - EugenyBoger
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback