Discover MakerZone

MATLAB and Simulink resources for Arduino, LEGO, and Raspberry Pi

Learn more

Discover what MATLAB® can do for your career.

Opportunities for recent engineering grads.

Apply Today

Differences createCommunicatingJob( ..., 'Type','pool') and ...'Type', 'SPMD')

Asked by Tobias on 23 Nov 2012

I'm just introducing myself into Parallel Computing Toolbox and trying to organize all its functionality - for better understanding purposes.

Now, I'm wondering:

  • createJob(...) creates an Independent Job (check!)
  • createCommunicatingJob(..., 'Type', 'SPMD') creates a communcating Job which runs simulatneously on all workers, due to synchronized interprocess communication purposes, bla, bla... (check!)

BUT:

  • createCommunicatingJob(..., 'Type', 'Pool') creates a communicating Job which: A 'pool' job runs the specified task function with a MATLAB pool available to run the body of parfor loops or spmd blocks.

WHAT?!?:

  • the inside of a parfor loop? parfor is independent so, why classifying as CommunicatingJob? (hmm#1)
  • spmd tasky must be run simultaneously .. otherwise communication might be quite tricky ... (hmm#2)

So, where's my understanding problem ...? I'm a little ... confused ...

Enlightenment whished-for ... :)

Cheers, Tobi

0 Comments

Tobias

1 Answer

Answer by Thomas Ibbotson on 23 Nov 2012
Accepted answer

Both spmd and parfor require a matlabpool to be open to send their work to each worker in the pool. You can create the matlabpool on your client using the 'matlabpool' function, which creates an interactive matlabpool tied to the lifetime of your MATLAB session.

If however you wish to run your code in the background, or submit it to a cluster to run later, you create a communicating job of type 'Pool'. This creates a job that starts a matlabpool on the cluster, using one of the workers as the 'client' and the remaining workers to form the matlabpool.

6 Comments

Thomas Ibbotson on 26 Nov 2012

Hi Tobi,

I think there is some confusion over the role of the 'matlabpool'. From the matlabpool documentation:

matlabpool enables the full functionality of the parallel language features (parfor and spmd) in MATLAB by creating a special job on a pool of workers, and connecting the pool to the MATLAB client.

This means a matlabpool is only required if you have 'parfor' or 'spmd' in the code you wish to run.

'batch' however allows you to run any code on a cluster, regardless of whether it contains parallel language features or not. Hence, a matlabpool is not in general required for 'batch'.

Similarly for createJob() and createCommunicatingJob(..., 'Type', 'spmd'), these allow you to run any code on the cluster and therefore do not require a matlabpool.

Apart from that misconception about 'matlabpool', which I hope I've clarified here, I believe all your other statements are correct.

Thanks, Tom

Tobias on 26 Nov 2012

enlightment proccess ... completed! :D

Thanks a lot for your patience and your explaining skills ... ;) This helped a lot. Next time I will double(-cross) iterate the manual following "RTFM" ;)

cheers, tobi

Thomas Ibbotson on 26 Nov 2012

Hi Tobi,

I'm glad that helped. I don't think that this is a particularly easy set of concepts to grasp, it took me a while to fully understand it all. Although all the information is contained in the manual, it often takes someone else who understands it to help link it all together. I certainly didn't learn it by just reading the documentation, I had lots of discussions with my colleagues, and I'm happy to be able to pass on what I have learnt.

Thanks, Tom

Thomas Ibbotson

Contact us