saturne stopped working - pls help

More
15 years 11 months ago #2016 by Claus
Replied by Claus on topic Re:saturne stopped working - pls help
Hi again - to make a (very) long story short: openmpi is not working.

When I recently compiled Code_Saturne-1.3.2, I used the installed openmpi (1.2.5) on my ubuntu I got this return from configuring 'fvm':

Configuration options:
use debugging code: false
MPI (Message Passing Interface) support: yes
MPI I/O support: no
MPI2 one-sided communication support: yes
HDF (Hierarchical Data Format) support: yes
CGNS (CFD General Notation System) support: yes
MED (Model for Exchange of Data) support: yes

awright, I was able to finish the visualization for my project (thx!) using ONE core, since sat-1.3.2 segfaulted when enabling 2 cores

Today I tried to recompile 'fvm' using --prefix=..../opt/openmpi-1.2.6 etc. but the make-process errors out (see below)

So I tried compiling and using openmpi-1.2.5 but I get the same error as with 1.2.6 - what could be wrong?

Heres the 'configure' command and errormessage from 'make -j 2':

Hope I have provided the necessary information - thx :)

[code:1]
./configure --prefix=/optsaturne-1.3.2/opt/fvm-0.10.0/arch/Linux --with-bft=/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux --with-hdf5=/usr/ --with-cgns=/opt/saturne-1.3.2/opt/cgnslib_2.5/arch/Linux/ --with-mpi=/opt/saturne-1.3.2/opt/openmpi-1.2.*/arch/Linux/ && make -j 2
[/code:1]

[code:1]
--snip--
mkdir .libs
cc -std=c99 -funsigned-char -pedantic -W -Wall -Wshadow -Wpointer-arith -Wcast-qual -Wcast-align -Wwrite-strings -Wstrict-prototypes -Wmissing-prototypes -Wmissing-declarations -Wnested-externs -Wunused -Wfloat-equal -Wpadded -funroll-loops -O2 -Wuninitialized -march=i686 -O -o .libs/fvm_file_test fvm_file_test.o -L/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux/lib -L/usr//lib -L/opt/saturne-1.3.2/opt/cgnslib_2.5/arch/Linux//lib -L/opt/saturne-1.3.2/opt/openmpi-1.2.5/arch/Linux//lib ../src/.libs/libfvm.so //opt/saturne-1.3.2//opt/bft-1.0.6/arch/Linux/lib/libbft.so /usr/lib/libmedC.so -L/usr/lib -lcgns /usr/lib/libhdf5.so -L/usr/lib/mpich/lib/ -lpthread -lz -lmpi -lm -Wl,--rpath -Wl,/optsaturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib -Wl,--rpath -Wl,//opt/saturne-1.3.2//opt/bft-1.0.6/arch/Linux/lib
fvm_file_test.o: In function `main':
fvm_file_test.c:«»(.text+0x64): undefined reference to `ompi_mpi_comm_world'
fvm_file_test.c:«»(.text+0x74): undefined reference to `ompi_mpi_comm_world'
fvm_file_test.c:«»(.text+0x8a): undefined reference to `ompi_mpi_comm_world'
fvm_file_test.c:«»(.text+0x2c2): undefined reference to `ompi_mpi_comm_world'
fvm_file_test.c:«»(.text+0x2d6): undefined reference to `ompi_mpi_int'
fvm_file_test.c:«»(.text+0x5be): undefined reference to `ompi_mpi_comm_world'
fvm_file_test.c:«»(.text+0x5d2): undefined reference to `ompi_mpi_int'
fvm_file_test.c:«»(.text+0x867): undefined reference to `ompi_mpi_comm_world'
fvm_file_test.c:«»(.text+0x8b7): undefined reference to `ompi_mpi_comm_world'
fvm_file_test.c:«»(.text+0x8cb): undefined reference to `ompi_mpi_int'
fvm_file_test.c:«»(.text+0xbed): undefined reference to `ompi_mpi_comm_world'
fvm_file_test.c:«»(.text+0xc01): undefined reference to `ompi_mpi_int'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_info_null'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_short'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_op_min'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_unsigned_short'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_comm_null'
../src/.libs/libfvm.so: undefined reference to `MPI_File_read_ordered'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_long_long_int'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_op_max'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_file_null'
../src/.libs/libfvm.so: undefined reference to `MPI_File_read_shared'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_unsigned'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_datatype_null'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_unsigned_long_long'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_double'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_long_int'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_unsigned_long'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_op_sum'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_float'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_byte'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_long'
collect2: ld returned 1 exit status
make[2]: *** [fvm_file_test] Error 1
make[2]: *** Waiting for unfinished jobs....
cc -std=c99 -funsigned-char -pedantic -W -Wall -Wshadow -Wpointer-arith -Wcast-qual -Wcast-align -Wwrite-strings -Wstrict-prototypes -Wmissing-prototypes -Wmissing-declarations -Wnested-externs -Wunused -Wfloat-equal -Wpadded -funroll-loops -O2 -Wuninitialized -march=i686 -O -o .libs/fvm_interface_test fvm_interface_test.o -L/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux/lib -L/usr//lib -L/opt/saturne-1.3.2/opt/cgnslib_2.5/arch/Linux//lib -L/opt/saturne-1.3.2/opt/openmpi-1.2.5/arch/Linux//lib ../src/.libs/libfvm.so //opt/saturne-1.3.2//opt/bft-1.0.6/arch/Linux/lib/libbft.so /usr/lib/libmedC.so -L/usr/lib -lcgns /usr/lib/libhdf5.so -L/usr/lib/mpich/lib/ -lpthread -lz -lmpi -lm -Wl,--rpath -Wl,/optsaturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib -Wl,--rpath -Wl,//opt/saturne-1.3.2//opt/bft-1.0.6/arch/Linux/lib
fvm_interface_test.o: In function `main':
fvm_interface_test.c:«»(.text+0x55): undefined reference to `ompi_mpi_comm_world'
fvm_interface_test.c:«»(.text+0x68): undefined reference to `ompi_mpi_comm_world'
fvm_interface_test.c:«»(.text+0x7b): undefined reference to `ompi_mpi_comm_world'
fvm_interface_test.c:«»(.text+0x245): undefined reference to `ompi_mpi_comm_world'
fvm_interface_test.c:«»(.text+0x259): undefined reference to `ompi_mpi_int'
fvm_interface_test.c:«»(.text+0x712): undefined reference to `ompi_mpi_comm_world'
fvm_interface_test.c:«»(.text+0x726): undefined reference to `ompi_mpi_int'
fvm_interface_test.c:«»(.text+0x92b): undefined reference to `ompi_mpi_comm_world'
fvm_interface_test.c:«»(.text+0x93f): undefined reference to `ompi_mpi_int'
fvm_interface_test.c:«»(.text+0x962): undefined reference to `ompi_mpi_comm_world'
fvm_interface_test.c:«»(.text+0x976): undefined reference to `ompi_mpi_int'
fvm_interface_test.o: In function `_bft_printf_proxy':
fvm_interface_test.c:«»(.text+0xc24): undefined reference to `ompi_mpi_comm_world'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_info_null'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_short'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_op_min'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_unsigned_short'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_comm_null'
../src/.libs/libfvm.so: undefined reference to `MPI_File_read_ordered'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_long_long_int'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_op_max'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_file_null'
../src/.libs/libfvm.so: undefined reference to `MPI_File_read_shared'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_unsigned'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_datatype_null'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_unsigned_long_long'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_double'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_long_int'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_unsigned_long'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_op_sum'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_float'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_byte'
../src/.libs/libfvm.so: undefined reference to `ompi_mpi_long'
collect2: ld returned 1 exit status
make[2]: *** [fvm_interface_test] Error 1
make[2]: Leaving directory `/opt/saturne-1.3.2/src/fvm-0.10.0/tests'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/opt/saturne-1.3.2/src/fvm-0.10.0'
make: *** [all] Error 2
claus@kafka:/opt/saturne-1.3.2/src/fvm-0.10.0$ ./configure --prefix=/optsaturne-1.3.2/opt/fvm-0.10.0/arch/Linux --with-bft=/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux --with-hdf5=/usr/ --with-cgns=/opt/saturne-1.3.2/opt/cgnslib_2.5/arch/Linux/ && make -j 2
[/code:1]

Code_Aster release : STA11.4 on OpenSUSE 12.3 64 bits - EDF/Intel version

Please Log in or Create an account to join the conversation.

More
15 years 11 months ago #2017 by David Monfort
Replied by David Monfort on topic Re:saturne stopped working - pls help
Hi,

You've got exactly the same problem as before. The thing is one tries to locate HDF5 libraries before MPI ones (because of a possible dependency of HDF5 on MPI...). So, if you set the path to find HDF5 libraries to /usr and another MPI library is installed in this directory, then the configure script will find this library instead of the one you propose with --with-mpi=...

This is the command line you should use to have your compilation work:
[code:1]./configure --prefix=/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux --with-bft=/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux --with-cgns=/opt/saturne-1.3.2/opt/cgnslib_2.5/arch/Linux/ --with-mpi=/opt/saturne-1.3.2/opt/openmpi-1.2.6/arch/Linux/ && make -j 2[/code:1]This way the configure script will find your openmpi libraries and the HDF5 libraries will be found in the usual path (i.e. /usr but at the end of the script). Nevertheless, I think we will have to have a look at these scripts to see if one can avoid the issue!

By the way, I corrected two errors (on the prefix path and on the openmpi version number).

Tell me if it doesn't work.<br /><br />Post edited by: David Monfort, at: 2008/05/20 20:09

Please Log in or Create an account to join the conversation.

More
15 years 11 months ago #2018 by Claus
Replied by Claus on topic Re:saturne stopped working - pls help
well - you were right, fvm compiles now, but launching a two-core calculation results in this error (see below)

Maybe I need to recompile a local HDF5 for saturne instead of using the one on ubuntu.

your thoughts?

/usr/bin/gfortran -o &quot;cs13.exe&quot; -O \
-L/opt/saturne-1.3.2/Noyau/ncs-1.3.2/arch/Linux/lib -lsaturneBASE -lsaturneCFBL -lsaturneCOGZ -lsaturneCPLV -lsaturneELEC -lsaturneFUEL -lsaturneLAGR -lsaturneMATI -lsaturneRAYT -lsaturneBASE -lsaturneCFBL -lsaturneCOGZ -lsaturneCPLV -lsaturneELEC -lsaturneFUEL -lsaturneLAGR -lsaturneMATI -lsaturneRAYT -L/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib -lfvm -L/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux/lib -lbft -L/opt/saturne-1.3.2/opt/cgnslib_2.5/arch/Linux//lib -lcgns -lhdf5 -lmedC -lhdf5 -rdynamic -Wl,-rpath -Wl,/usr/lib:/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib:/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux/lib:/usr/lib:/usr/lib:/opt/saturne-1.3.2/opt/openmpi-1.2.6/arch/Linux/lib:/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux/lib:/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib -L/usr/lib -lxml2 -L/usr/lib -lcblas -latlas -pthread -L/opt/saturne-1.3.2/opt/openmpi-1.2.6/arch/Linux/lib -lmpi -lopen-rte -lopen-pal -ldl -Wl,--export-dynamic -lnsl -lutil -lm -ldl -L/opt/saturne-1.3.2/opt/bft-1.0.6/arch/Linux/lib -lbft -L/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib -lfvm -lm -lpthread
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_info_null'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_short'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_int'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_op_min'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_unsigned_short'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_comm_null'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `MPI_File_read_ordered'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_long_long_int'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_op_max'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_file_null'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `MPI_File_read_shared'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_unsigned'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_datatype_null'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_unsigned_long_long'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_double'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_long_int'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_unsigned_long'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_op_sum'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_float'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_byte'
/opt/saturne-1.3.2/opt/fvm-0.10.0/arch/Linux/lib/libfvm.so: undefined reference to `ompi_mpi_long'
collect2: ld returned 1 exit status
make[4]: *** [privcmdlink] Error 1
make[4]: Leaving directory `/home/claus/tmp_Saturne/PIPE.CAS1.05201955/fort_saturne'
make[3]: *** [privmodlink] Error 2
make[3]: Leaving directory `/home/claus/tmp_Saturne/PIPE.CAS1.05201955/fort_saturne'
make[2]: *** [privlink] Error 2
make[2]: Leaving directory `/home/claus/tmp_Saturne/PIPE.CAS1.05201955/fort_saturne'
make[1]: *** [link] Error 2
make[1]: Leaving directory `/home/claus/tmp_Saturne/PIPE.CAS1.05201955/fort_saturne'
make: *** [saturne] Error 2

Code_Aster release : STA11.4 on OpenSUSE 12.3 64 bits - EDF/Intel version

Please Log in or Create an account to join the conversation.

More
15 years 11 months ago #2022 by David Monfort
Replied by David Monfort on topic Re:saturne stopped working - pls help
Unfortunately it is still the same issue!

I can find a reference to /usr/lib while you are linking the code, it shouldn't appear there. I assume you still have a problem in the macros definition file within the libmxl2 part (see one of the previous post for more information).

As a rule, when looking for a library in the /usr/lib you mustn't have: [code:1]--with-mylib=/usr[/code:1]and you mustn't have[code:1]MYLIB_HOME=/usr[/code:1]in the macros definition file as well.

Hope it'll work finally!

Please Log in or Create an account to join the conversation.

More
15 years 11 months ago #2023 by Claus
Replied by Claus on topic Re:saturne stopped working - pls help
Awright - so far so good. I corrected the macros.Linux.mk to this

[code:1]
# Macro pour XML
#

# Option XML
XML =1

XML_HOME =

XML_INC =-i/usr/include/libxml2/
XML_LIB =-lxml2
[/code:1]

and the compile of ran - next the preprocessor complained about not finding 'med' although it is placed in the correct folder. Installed 'med' via synaptic. Now the preprocessor also runs. Alas I thought the solution would run, but this error occurs (see below), I'll also include the 'listing' file, but it seems mpi (which IS 1.2.6 since I installed it system-wide) still doesn't want to play nice. Single-core works fine though.

[code:1] ********************************************
Execution
********************************************

Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_RANK and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_RANK and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_SPLIT and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_SIZE and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_RANK and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_SIZE and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_FREE and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_SPLIT and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_SIZE and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_RANK and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_SIZE and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_COMM_FREE and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_BARRIER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_BARRIER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_BARRIER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLREDUCE and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLGATHER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLGATHER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLGATHER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLGATHER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_BARRIER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLREDUCE and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLGATHER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLGATHER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLGATHER and code is 197
Fatal error; unknown error handler
May be MPI call before MPI_INIT. Error message is MPI_ALLGATHER and code is 197
[/code:1]

end of 'listing'

[code:1]

Renumerotation du maillage:



** VECTORISATION (1 : POSSIBLE, 0 : IMPOSSIBLE)

Faces internes Faces de bord
IVECTI 0 IVECTB 0

[/code:1]

Code_Aster release : STA11.4 on OpenSUSE 12.3 64 bits - EDF/Intel version

Please Log in or Create an account to join the conversation.

More
15 years 11 months ago #2024 by David Monfort
Replied by David Monfort on topic Re:saturne stopped working - pls help
It seems that the MPI_Init function (MPI initialization) is failing. My suggestion is that the mpirun script that runs the parallel computation (via the &quot;lance&quot; script) is messed up with the MPI distribution you are linking with.

Did you change the CS_MPI_PATH variable in the cs_profile file (under Noyau/ncs-1.3.2/bin) accordingly with your OpenMPI 1.2.6 distribution ? Otherwise the launch script may find another one which might be incompatible with OpenMPI.
It should look like:[code:1]CS_MPI_PATH=/opt/saturne/openmpi-1.2.6/bin[/code:1]

Could you check this line so that I have a more precise idea of your problem? And possibly its solution.. ;-)<br /><br />Post edited by: David Monfort, at: 2008/05/22 01:37

Please Log in or Create an account to join the conversation.

Moderators: catux
Time to create page: 0.158 seconds
Powered by Kunena Forum