create new tag
view all tags

Job Split


My scripts are very simple. The work divides into two scripts.

  • one is the number generator
  • another is job generator.

The path of the job split is /afs/ihep.ac.cn/users/l/lint/jobsplit.

You can see two python scripts and some other bash scripts.

number generator

You can use the scripts like this:

[lint@lxslc504 jobsplit]$ ./pyenv27 ./js_gen.py 'Random:1000,Seed:100'

If you want to generate more , you can use --totaltimes, like this:

[lint@lxslc504 jobsplit]$ ./pyenv27 ./js_gen.py 'Random:1000,Seed:100' --totaltimes 15

job generator

By using the pipelines, we can use js_fill.py to generate the jobs with a job template.

[lint@lxslc504 jobsplit]$ ./pyenv27 ./js_gen.py 'Random:1000,Seed:100' | ./pyenv27 ./js_fill.py test/job_template.bash

The job template file is ordinary, except for the conherence with the number generator. The job template is like this:

1 #!/bin/bash      
3 echo '${Random}'       
4 echo '${Seed}'       

-- LinTao - 2012-05-24

Topic revision: r1 - 2012-05-24 - LinTao
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback