Difference: Space_Monitoring (1 vs. 2)

Revision 22008-06-23 - ZhangXiaomei

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Deleted:
<
<
 

CMS Space Monitoring

Line: 5 to 4
 
Changed:
<
<
This segment introduces how to use CRAB and the bugs of some CRAB versions I met when I do the tests on our UI.
>
>
This segment introduces the T2, T3 of the Beijing site space usage monoitring.

goals


1.help administrators control the usage and distribution of T3 and T2 space
2.help users know the space status before doing the subscription in PhEDEx and moving dataset between T3 and T2
3.help users and administrators know the subscription status in the PhEDEx and clean up the occupied space in time. It become more necessary when more and more storage resources are added
4.easy to find the discrepancy between the site space information and the information from the CMS central publishing system
5.find a way to count the correct space information in order to cope with the bug from dCache NFS system.When the file size >2GB, the space information can not correctly be displayed,only srmls works

functions


1.Display T2 space usage
T2: name, directory, size, remark
2.Display T3 space usage in cmsd01 and cmsd02
T3: name, directory, size, remark
3.Display the PhEDEx subscription information
PhEDEx subscription: requestor, the LFN of dataset or block, size, the time when the data is created, remark

policies


1. Automatically use system commands and SRM commands to count the amount of space usage once or twice each day.
2. Automatically collect information from the PhEDEx system
3. The information is outputted in XML format and displayed in web page
4. The tools used here:du,df,srmls,wget
5. The language used here: perl, xml, xsl
 
Changed:
<
<

The goals

There are two ways. one way is to use CRAB installed at CERN, the other is to install CRAB in our UI.
*Use CRAB installed at CERN:
1.The last version of CRAB is already installed at CERN, just do:
      source  /afs/cern.ch/cms/ccs/wm/scripts/Crab/crab.(c)sh
2.Then copy locally the crab.cfg file from dir $CRABDIR/python/crab.cfg.
*Use CRAB installed in cmsui01 or lcg003:
   1.download the last CRAB_X_Y_Z tgz archive from [[http://cmsdoc.cern.ch/cms/ccs/wm/www/Crab/download.html][Download]] or from the CERN afs server:
     /afs/cern.ch/cms/ccs/wm/scripts/Crab/      
   2. untar the tgz file in a directory "YOUR_DIR" of your UI
   3. run the configure file you can find in "YOUR_DIR"/CRAB_X_Y_Z/ from a clean shell: 
       cd YOUR_DIR/CRAB_X_Y_Z/
       ./configure 
   4. source YOUR_DIR/CRAB_X_Y_Z/crab.(c)sh.

The functions and realization

I have tried to install three CRAB versions in cmsui01. I am successful with CRAB_2_0_4, CRAB_2_1_2, but failed with CRAB_2_2_1.
*the following error found when I use crab_2_2_1 in lcg003
crab: Scheduler Session: 'Cannot create scheduler SchedulerGLiteAPI  \t \n         missing glite environment.\n         Try export PYTHONPATH=$PYTHONPATH GLITE_LOCATION/lib\n         No module named SOAPpy.Client'
*the following error found when I use crab_2_2_1 in cmsui01
Error: Unable to find pyOpenSSL module
>
>

space monitoring link

http://cmsui01.ihep.ac.cn/space_BJ.xml
  *Please feel free to give some comments.

Revision 12008-06-23 - ZhangXiaomei

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="WebHome"

CMS Space Monitoring

This segment introduces how to use CRAB and the bugs of some CRAB versions I met when I do the tests on our UI.

The goals

There are two ways. one way is to use CRAB installed at CERN, the other is to install CRAB in our UI.
*Use CRAB installed at CERN:
1.The last version of CRAB is already installed at CERN, just do:
      source  /afs/cern.ch/cms/ccs/wm/scripts/Crab/crab.(c)sh
2.Then copy locally the crab.cfg file from dir $CRABDIR/python/crab.cfg.
*Use CRAB installed in cmsui01 or lcg003:
   1.download the last CRAB_X_Y_Z tgz archive from [[http://cmsdoc.cern.ch/cms/ccs/wm/www/Crab/download.html][Download]] or from the CERN afs server:
     /afs/cern.ch/cms/ccs/wm/scripts/Crab/      
   2. untar the tgz file in a directory "YOUR_DIR" of your UI
   3. run the configure file you can find in "YOUR_DIR"/CRAB_X_Y_Z/ from a clean shell: 
       cd YOUR_DIR/CRAB_X_Y_Z/
       ./configure 
   4. source YOUR_DIR/CRAB_X_Y_Z/crab.(c)sh.

The functions and realization

I have tried to install three CRAB versions in cmsui01. I am successful with CRAB_2_0_4, CRAB_2_1_2, but failed with CRAB_2_2_1.
*the following error found when I use crab_2_2_1 in lcg003
crab: Scheduler Session: 'Cannot create scheduler SchedulerGLiteAPI  \t \n         missing glite environment.\n         Try export PYTHONPATH=$PYTHONPATH GLITE_LOCATION/lib\n         No module named SOAPpy.Client'
*the following error found when I use crab_2_2_1 in cmsui01
Error: Unable to find pyOpenSSL module

*Please feel free to give some comments.

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback