Difference: HowToSubmitAJob (1 vs. 5)

Revision 42012-12-19 - Donal

Line: 1 to 1



How to submit a BOSS job


set up Boss environment


Line: 31 to 31
 OutputDir = "/publicfs/zangds/662-1/jpsi/root/"; //NTupleSvc.Output = { "FILE1 DATAFILE='/tmp/run_0028375_All_file001n2.root' OPT='NEW' TYP='ROOT'"};

How to submit a BEAN job

set up BEAN environment


copy your dst files to HDFS

usually this is done by the Hadoop admins, and you can find your files under /hdfs/ directory on the hadoop nodes.
ls /hdfs/
if you want to copy files, please contact dmdp-lab@ihep.ac.cn

Running analysis jobs on Hadoop cluster

1. login to one of the hadoop node (hadoop01.ihep.ac.cn ~ hadoop08.ihep.ac.cn) using your AFS account

if you have problems login to the hadoop nodes, please contact us dmdp-lab@ihep.ac.cn with your AFS account

2. run the job

bean.hadoop jobOptions_bean.txt

note: The hadoop job will proccess all the dst files in $Hadoop.InputDir , and output the result file to $Hadoop.OutputDir . The jobOptions_bean.txt looks like

Hadoop.InputDir = "/hdfs/offline/data/655-1/jpsi/dst/";
Hadoop.OutputDir = "/home/cc/zangds/offline/data/655-1/jpsi/root/";
//user function
Bean.Uname = "Rhopi";
//whether should output ROOT tree file (default: no output is written)
Bean.out_file = "false";

Revision 32012-10-25 - Donal

Revision 22016-11-23 - TWikiGuest

Revision 12012-10-17 - Donal

Line: 1 to 1
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback