Statistics: NCSU Computing

Statistics Department

Computing

PAMS College, has a linux cluster available for student and faculty use. The "Statistical" software packages available are: SAS, R and MATLAB. There are also a couple of high level compilers available, and the cluster does support MPI coding. http://www.pams.ncsu.edu/pco/hpc/linux.html#software

First thing you have to do is get an account on the cluster. This is an automatted feature so it may take a day to generate your access.

Activate Account: http://www.pams.ncsu.edu/pco/hpc/linux_accounts.html
Login to Cluster: ssh bigdog.pams.ncsu.edu
Copy Files to Cluster: scp [program] bigdog.pams.ncsu.edu
or use graphical WINSCP available on Department PCs

[Job Submission] {SAS}

Save the script to the directory where your SAS files are located:

#!/bin/tcsh

#$ -cwd -N program.sas -m e -M $USER@ncsu.edu
/opt/SAS_9.1/sas program.sas

Feel free to rename it to anyname. I'm going to refer to it as "script".
Modify program.sas to be the same name of your programs.
Modify $USER@unity.ncsu.edu to be your email address.

[Job Submission] {R}

Save the script to the directory where your R files are located:

#!/bin/tcsh

#$ -cwd -N program.r -m e -M $USER@ncsu.edu
/opt/R-2.5.0/bin/R CMD BATCH --vanilla program.r program.out

Feel free to rename it to anyname. I'm going to refer to it as "script".
Modify program.r to be the same name of your programs.
Modify $USER@unity.ncsu.edu to be your email address.

[Job Submission] {MATLAB}

Save the script to the directory where your R files are located:

#!/bin/tcsh

#$ -cwd -N program.m -m e -M $USER@ncsu.edu
/opt/matlab/bin/matlab -nodisplay -nosplash -nojvm < program.m > program.out

Feel free to rename it to anyname. I'm going to refer to it as "script".
Modify program.m to be the same name of your programs.
Modify $USER@unity.ncsu.edu to be your email address.

% qsub script
This will submit your program to the "NODE" that has the least load ready to run your program.

% qstat | grep $USER
This will show the status of your jobs.

% qdel XXXX
This will allow you to delete any job that you have submitted.

NOTE: You'll notice 2 new files created in your working directory: [program].eXXXX and [program].oXXXX where XXXX is the submitted job number. The eXXXX file is an error file and the oXXXX is the standard out messages. The system will mail you when your job has ended, if you submitted a correctly modified "script".

To make job submission similar to that of the STAT cluster, feel free to copy the following files to your home directory on bigdog.pams.ncsu.edu.

bwsubmit	bwclean	bwcheck
bwkill	bwload	.cshrc

Perform the following commands to grab all the above files.

$ cd ~
$ wget -r -I it/pamshpc -nH --cut-dirs=2 http://www.stat.ncsu.edu/it/pamshpc/ .
$ chmod -R 755 ~/bin
$ source .cshrc
$ bwsubmit <program> <filename>

For more information about computing clusters offered by the PAMS, please visit: http://www.pams.ncsu.edu/pco/hpc/

[Back] webmaster@stat.ncsu.edu