Using LSF

By specifying -batchsystem lsf on the command line, Simcenter STAR-CCM+ automatically distributes processes to all CPUs/cores allocated to the job.

General information about job submission with batch systems can be found in Working in Unix-Based Batch Systems.

Please also refer to the specific cluster documentation and the batch system documentation for additional and required parameters or settings.

Documentation Reference

Useful Commands for Job Submission and Monitoring

Display LSF Release Version

$ lsid
IBM Spectrum LSF Community Edition 10.1.0.6, May 25 2018
[...]

Submit a Job

$ bsub < <job_script>

Show Job Status

$ bjobs <jobid>

Terminate Job

$ bkill <jobid>

Job Submission

A minimal, example jobscript to launch Simcenter STAR-CCM+ and automatically extract the information about allocated resources:

#!/bin/bash
 
#BSUB -J starsim
#BSUB -n 32
#BSUB -nnodes 2
#BSUB -W 1:00:00
 
STAR_PATH=/path/to/star/bin
$STAR_PATH/starccm+ -bs lsf -batch step my.sim

Job Submission Information

Job File Submission Prefix

The batch script may contain options preceded with #BSUB before any executable commands in the script. bsub stops processing further #BSUB directives once the first non-comment non-whitespace line has been reached in the script.

Submission Options

These arguments can be used either in a submission command or with a submission command file preceded by the submission prefix.


Parameter	Description
`-J <name_of_job>`	name of the job
`-n <number_cores>`	number of cores to assign to job
`-nnodes <number_nodes>`	number of nodes (computers) to assign to job
`-W <walltime>`	wall time
`-q <queue_name>`	name of queue to assign job
`-o <output_filename>`	name of the output file

Submission Environment Variables

There are several environment variables that are active when a job is running. These variables are preceded by ‘LSB_’. This is a list of some of the more useful ones.


Environment Variable	Description
`LSB_JOBID`	job ID
`LSB_DJOB_NUMPROC`	number of processes assigned to job
`LSB_DJOB_HOSTFILE`	filename of machine file
`LSB_HOSTS`	list of hosts running job
`LSB_MCPU_HOSTS`	list of hosts and number of cores in the format `<hostname1> <number_cores> <hostname2> <number_cores>...`
`LSB_QUEUE`	name of queue job is queued from
`LSB_OUTDIR`	output directory pathname

Gathering Information about Failed Jobs

When a job has failed more information can be collected about the job failure from these commands:

$ bhist -l <JobId>
$ bacct -l <JobId>