Running PBJelly on Hyak:

I’ve got PBJelly successfully compiled and tested (using the procedure from here) so now we’re going to try running it!

First, check my Protocol.xml file. This is the thing that tells PBJelly where to look for the reference scaffolds, Location of new read files, blasr arguments to use (the important one being the # of cores to use), and a job section for each individual input file.

Screen Shot 2017-04-12 at 12.11.17 PM

I also built a little shell script to load the various libraries and path requirements for the different programs used in PBJelly to make life easier, since we have to have special local versions of libraries thanks to the lack of root permissions. It’s entitled PBJelly.sh, and is stored in /gscratch/srlab/scripts

Screen Shot 2017-04-12 at 11.51.21 AM

The shell script is run via source /gscratch/srlab/scripts/PBJelly.sh

You can test to make sure this worked by echoing the $PATH

Screen Shot 2017-04-12 at 12.15.20 PM

Next, I wrote another shell script to run the 6 different sections of PBJelly sequentially, so in theory it should be treated as a single job by the SLURM manager and we won’t get in trouble for wasting resources.

Screen Shot 2017-04-12 at 12.20.10 PM

Finally, the scary part. Hitting go.

sbatch -p srlab -A srlab> PBRun.sh

should be enough to begin our script and use only our single node.

After chasing down some XML errors from my protocol (Each in XML) and fixing a missing python library, I think it’s working!

The job initiation isn’t super exciting but the job ID # given to you is important, as it is how you track your job.

Screen Shot 2017-04-12 at 1.35.54 PM

Job tracking is done via the scontrol show job command, and it outputs

Screen Shot 2017-04-12 at 1.37.31 PM

with the important parts being the 4th line stating that the Job is still running, and the second to the last line that shows the file that StdOut is being written to, in our case slurm-7091.out which looks like

Screen Shot 2017-04-12 at 1.39.18 PM

Now… I guess we wait and keep our fingers crossed?

Advertisements