HowToSubmitAJob
How to submit a BOSS job
set up Boss environment
How_to_setup_BOSS_environment_on_lxslc
copy your dst files to HDFS
usually this is done by the Hadoop admins, and you can find your files under /hdfs/ directory on the hadoop nodes.
ls /hdfs/
if you want to copy files, please contact
dmdp-lab@ihep.ac.cn
Running analysis jobs on Hadoop cluster
1. login to one of the hadoop node (hadoop01.ihep.ac.cn ~ hadoop08.ihep.ac.cn) using your AFS account
if you have problems login to the hadoop nodes, please contact us
dmdp-lab@ihep.ac.cn with your AFS account
2. run the job
boss.hadoop jobOptions_ana_rhopi.hadoop.txt
note: The hadoop job will proccess all the dst files in $Hadoop.InputDir , and output the result root file to $Hadoop.OutputDir . So the jobOption file is similiar with the option file that runing on localhost or PBS except two params:
// Input REC or DST file name
Hadoop.InputDir = "/hdfs/offline/data/662-1/jpsi/dst/";
//EventCnvSvc.digiRootInputFile = {"rhopi.dst"};
Hadoop.NtuplePath = "FILE1";
Hadoop.OutputDir = "/publicfs/zangds/662-1/jpsi/root/";
//NTupleSvc.Output = { "FILE1 DATAFILE='/tmp/run_0028375_All_file001n2.root' OPT='NEW' TYP='ROOT'"};
How to submit a BEAN job
set up BEAN environment
http://boss.ihep.ac.cn/~offlinesoftware/index.php/BEAN
copy your dst files to HDFS
usually this is done by the Hadoop admins, and you can find your files under /hdfs/ directory on the hadoop nodes.
ls /hdfs/
if you want to copy files, please contact
dmdp-lab@ihep.ac.cn
Running analysis jobs on Hadoop cluster
1. login to one of the hadoop node (hadoop01.ihep.ac.cn ~ hadoop08.ihep.ac.cn) using your AFS account
if you have problems login to the hadoop nodes, please contact us
dmdp-lab@ihep.ac.cn with your AFS account
2. run the job
bean.hadoop jobOptions_bean.txt
note: The hadoop job will proccess all the dst files in $Hadoop.InputDir , and output the result file to $Hadoop.OutputDir . The jobOptions_bean.txt looks like
Hadoop.InputDir = "/hdfs/offline/data/655-1/jpsi/dst/";
Hadoop.OutputDir = "/home/cc/zangds/offline/data/655-1/jpsi/root/";
//user function
Bean.Uname = "Rhopi";
//whether should output ROOT tree file (default: no output is written)
Bean.out_file = "false";
//the prefix for hist_file and out_file
Bean.hist_prefix = "Hist";
Bean.out_prefix = "Select";
Topic revision: r5 - 2012-12-20
- Donal