MATLAB at WestGrid

Table of Contents

Introduction

About MATLAB

MATLAB is a general-purpose high-level programming package for numerical work such as linear algebra, signal processing and other calculations involving matrices or vectors of data. Visualization tools are also included for presentation of results. The basic MATLAB package is extended through add-on components including SIMULINK, and the Image Processing, Optimization, Neural Network, Signal Processing, Spline and Wavelet Toolboxes.

MATLAB Licensing on WestGrid

There are three methods of accessing MATLAB on WestGrid systems, as determined by the type of licensing (license-free standalone applications, donated academic licenses and WestGrid Distributed Computing Server license). 

For users with access to a MATLAB compiler license, either their own or provided by their institutions, on a machine with an architecture and system similar to a target WestGrid machine, it may be possible to create a standalone application from their code using the MATLAB compiler.  The application can then be run on a WestGrid system without using any licenses at run time.

On most WestGrid systems there is a "normal" MATLAB distribution, which is run using donated academic licenses from individual institutions.  Often this is provided only to access the MATLAB compiler to produce standalone applications.  Under the terms of those licenses MATLAB jobs can be run by researchers from SFU only on Bugaboo, University of Alberta researchers only on Jasper, UBC researchers only on Glacier and Orcinus, University of Calgary researchers only on the Breezy, Lattice or Parallel, University of Manitoba researchers only on Grex and UVic researchers only on Hermes and Nestor.

However, in late 2009, WestGrid purchased a new 64-worker "consortium" license for the MATLAB Distributed Computing Server.  The consortium license allows researchers from Canadian academic institutions who have licensed the Parallel Computing Toolbox (or have access to it through a local server) to submit jobs to a WestGrid cluster, even if it is not located at their home institution.  In March 2013 the number of licensed workers was increased to 160. Orcinus is the only WestGrid cluster on which the Distributed Computing Server workers run under the consortium license. The separate SFU site license allows for Distributed Computing Server jobs to be run on Bugaboo.

The notes below relate to creating and running standalone applications.  Instructions for using the Distributed Computing Server license are given here.  Instructions for using MATLAB under the donated academic licenses are given on a separate page.

Creating and running standalone applications

Introduction

If you (or your institution) own a MATLAB compiler license running on a Linux machine with an architecture similar to a WestGrid compute node you may be able to create a standalone application from your code.  Such an application may then be run as a serial (or in some cases, a single-node parallel) job on an appropriate WestGrid system without using any licenses at run time.  Two cases in which this approach may be useful are when there is a need to run many copies of the code simultaneously and when you need access to machines with a large amount of memory (such as Breezy, which has 256 GB per compute node).  Note that explicit parallel processing commands, such as matlabpool, are not supported by the MATLAB compiler.

For several WestGrid institutions, there are local machines on which the MATLAB compiler is available to researchers from the corresponding institution.  For example, University of Calgary researchers may use MATLAB on the WestGrid Lattice cluster to create applications that can then be deployed to other WestGrid clusters, such as Hermes or Breezy.  In a similar manner, SFU researchers may use the compiler on Bugaboo, UBC researchers may use Orcinus, etc.  Please contact support@westgrid.ca to discuss your particular situation.

Creating a standalone application

The MATLAB mcc command is used to compile source code (.m files) into a standalone excecutable.  There are a couple of important considerations to keep in mind when creating an executable that can be run in the WestGrid batch-oriented environment.  One is that there is no graphical display attached to your session and the other is that the number of threads used by the standalone application has to be controlled. 

For example, with code mycode.m a source directory src, with the compiled files being written to a directory called deploy, the following mcc command line (at the Linux shell prompt) could be used:

mkdir deploy
cd src
mcc -R -nodisplay \
-R -nojvm \
 -R -singleCompThread \
-m -v -w  enable \
 -d ../deploy \
mycode.m

Note the option -singleCompThread has been included in order to limit the executable to just one computational thread.

In the deploy directory, an executable mycode will be created along with a script run_mycode.sh.  These two files should be copied to the target machine where the code is to be run.

Running a standalone application

After the standalone executable mycode and corresponding script run_mycode.sh have been transferred to a directory on the target system (such as Hermes or Breezy) on which they will be run, a batch job script needs to be created in the same directory.  Here is an example batch job script.

#!/bin/bash
#PBS -S /bin/bash

MCR=/global/software/matlab/mcr/v714

echo "Running on host: `hostname`"

cd $PBS_O_WORKDIR
echo "Current working directory is `pwd`"

echo "Starting run at: `date`"
./run_mycode.sh $MCR
echo "Job finished at: `date`"

The job is then submitted as any ordinary WestGrid batch job with the qsub command. See the Running Jobs page for more information.  If the above script is called matlab.pbs, it could be submitted using:

qsub -l walltime=72:00:00,mem=6gb matlab.pbs

The specified walltime and total memory (mem) limits should be adjusted to appropriate values for your particular run.

An important part of the above script is the location of the MATLAB Compiler Runtime (MCR) directory.  This directory contains files necessary for the standalone application to run.  The version of the MCR files specified (v714 in the example, which corresponds to MATLAB R2010b) must match the version of MATLAB used to compile the code. 

A complete list of the MATLAB distributions and the corresponding compiler and MCR versions is given on the Mathworks web site.  The most recent versions are listed below, along with the corresponding installation directory to which the MCR variable should be set in the example script.  Not all systems have all versions installed, so, check the /global/software/matlab/mcr directory on the system you are proposing to use (except Bugaboo, where the files are in /usr/local/matlab-mcr). If the MCR version you need has not been installed please write to support@westgrid.ca to request that it be installed, or use a different version of MATLAB for your compilation.

 

MATLAB Release Compiler Version MCR Version MCR directory*
R2009b 4.11 7.11 /global/software/matlab/mcr/v711
R2009bSP1 4.12 7.12 Not installed
R2010a 4.13 7.13 /global/software/matlab/mcr/v713
R2010b 4.14 7.14 /global/software/matlab/mcr/v714
R2011a 4.15 7.15 /global/software/matlab/mcr/v715
R2011b 4.16 7.16 /global/software/matlab/mcr/v716
R2012a 4.17 7.17 /global/software/matlab/mcr/v717
R2012b 4.18 8.0 /global/software/matlab/mcr/v80
R2013a ? ? not yet installed

* Please note that the MCR directories on Bugaboo are located under /usr/local/matlab-mcr instead of /global/software/matlab/mcr.


Updated 2013-03-26.