Difference: HowToSubmitAJob (4 vs. 5)

Revision 52012-12-20 - Donal

Line: 1 to 1
 

HowToSubmitAJob

<--optional-->

How to submit a BOSS job

set up Boss environment

How_to_setup_BOSS_environment_on_lxslc

copy your dst files to HDFS

usually this is done by the Hadoop admins, and you can find your files under /hdfs/ directory on the hadoop nodes.
ls /hdfs/
if you want to copy files, please contact dmdp-lab@ihep.ac.cn

Running analysis jobs on Hadoop cluster

1. login to one of the hadoop node (hadoop01.ihep.ac.cn ~ hadoop08.ihep.ac.cn) using your AFS account

if you have problems login to the hadoop nodes, please contact us dmdp-lab@ihep.ac.cn with your AFS account

2. run the job

boss.hadoop jobOptions_ana_rhopi.hadoop.txt
 

note: The hadoop job will proccess all the dst files in $Hadoop.InputDir , and output the result root file to $Hadoop.OutputDir . So the jobOption file is similiar with the option file that runing on localhost or PBS except two params:

// Input REC or DST file name 
Hadoop.InputDir = "/hdfs/offline/data/662-1/jpsi/dst/";
//EventCnvSvc.digiRootInputFile = {"rhopi.dst"};

Hadoop.NtuplePath = "FILE1";
Hadoop.OutputDir = "/publicfs/zangds/662-1/jpsi/root/";
//NTupleSvc.Output = { "FILE1 DATAFILE='/tmp/run_0028375_All_file001n2.root' OPT='NEW' TYP='ROOT'"}; 
Added:
>
>
 

How to submit a BEAN job

set up BEAN environment

http://boss.ihep.ac.cn/~offlinesoftware/index.php/BEAN

copy your dst files to HDFS

usually this is done by the Hadoop admins, and you can find your files under /hdfs/ directory on the hadoop nodes.
ls /hdfs/
if you want to copy files, please contact dmdp-lab@ihep.ac.cn

Running analysis jobs on Hadoop cluster

1. login to one of the hadoop node (hadoop01.ihep.ac.cn ~ hadoop08.ihep.ac.cn) using your AFS account

if you have problems login to the hadoop nodes, please contact us dmdp-lab@ihep.ac.cn with your AFS account

2. run the job

bean.hadoop jobOptions_bean.txt
 

note: The hadoop job will proccess all the dst files in $Hadoop.InputDir , and output the result file to $Hadoop.OutputDir . The jobOptions_bean.txt looks like

Hadoop.InputDir = "/hdfs/offline/data/655-1/jpsi/dst/";
Hadoop.OutputDir = "/home/cc/zangds/offline/data/655-1/jpsi/root/";
//user function
Bean.Uname = "Rhopi";
//whether should output ROOT tree file (default: no output is written)
Bean.out_file = "false";
Added:
>
>
//the prefix for hist_file and out_file Bean.hist_prefix = "Hist"; Bean.out_prefix = "Select";
 
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback