Q. I am using the "HP MPI Distributed Parallel for x86 64" start method for my CFX distributed parallel runs on a IBM machine equiped with Myrinet interconnect. But the CFX solver seems to using standard ethernet, although the documentation says the HP MPI method will automatically use the fastest available interconnect. How can I get CFX Solver to use the Myrinet interconnect?

A. The problem is where the GM protocol shared libraries are located on IBM machines. By default HP MPI loads the driver from here:

/opt/gm/lib/libgm.so (32 bit driver)
/opt/gm/lib64/libgm.so (64 bit driver)


But on IBM machines the libraries are stored in a different location. You can fix this by adding this environment variable to override
the default path:

setenv MPI_ICLIB_GM /opt/gm-some-path/lib64/libgm.so

you need to find the correct path from your IBM rep. Usually the path is:

/opt/gm/2.0.18-2.6.5-7.139-smp/lib64/libgm.so

To get the CFX Solver to use this environment variable you may have to do the following:

1) Create a text file called cfx5rc (no extensions), which contains the following line:

setenv MPI_ICLIB_GM /opt/gm-some-path/lib64/libgm.so

2) Put the file in the following folder:

~/.cfx/10.0


Q. I am using the "HP MPI Distributed Parallel for x86 64" start method for my CFX distributed parallel runs on a IBM machine equiped with Myrinet interconnect. But the CFX solver seems to using standard ethernet, although the documentation says the HP MPI method will automatically use the fastest available interconnect. How can I get CFX Solver to use the Myrinet interconnect?

A. The problem is where the GM protocol shared libraries are located on IBM machines. By default HP MPI loads the driver from here:

/opt/gm/lib/libgm.so (32 bit driver)
/opt/gm/lib64/libgm.so (64 bit driver)


But on IBM machines the libraries are stored in a different location. You can fix this by adding this environment variable to override
the default path:

setenv MPI_ICLIB_GM /opt/gm-some-path/lib64/libgm.so

you need to find the correct path from your IBM rep. Usually the path is:

/opt/gm/2.0.18-2.6.5-7.139-smp/lib64/libgm.so

To get the CFX Solver to use this environment variable you may have to do the following:

1) Create a text file called cfx5rc (no extensions), which contains the following line:

setenv MPI_ICLIB_GM /opt/gm-some-path/lib64/libgm.so

2) Put the file in the following folder:

~/.cfx/10.0





Show Form
No comments yet. Be the first to add a comment!