libMajaChain.so.3.2 about maja HOT 21 CLOSED

i updated start_maja as you suggested, and it works for the other tile. ok I will open a new issue right away

from maja.

Hi, sorry for the issue.
Did "setting the environment variable LD_LIBRARY_PATH to /opt/MAJA/lib where the library libMajaChain.so.3.2 is stored" worked ?
If not, please send the log, and describe the Linux flavour and version you are using.
Best regards
Olivier

from maja.

When we set the environment variable, it show the path to the concerned library.
The output of the execution of "python start_maja.py -f folders.txt -c GIPP_MAJA_3.1.2_TM_CAMS -t 30STB -s morocco_centre -d 20190211 -e 20190222 -i** "is as follow:
2019-03-11 14:32:34,574 - Start-Maja - INFO - processing /mnt/archive/dwn_def/s2/default/morocco_centre/S2A_MSIL1C_20190218T110111_N0207_R094_T30STB_20190218T130332.SAFE in Init Mode
2019-03-11 14:32:34,574 - Start-Maja - INFO - Init mode goes with suboptimal performances
2019-03-11 14:32:34,575 - Start-Maja - INFO - MAJA logfile: /home/smiej/MAJA/L2Aproduct/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//S2A_MSIL1C_20190218T110111_N0207_R094_T30STB_20190218T130332.SAFE.log
2019-03-11 14:32:34,575 - Start-Maja - INFO - #################################
2019-03-11 14:32:34,590 - Start-Maja - INFO - => processing date 20190221
2019-03-11 14:32:34,593 - Start-Maja - INFO - Processing in init mode
2019-03-11 14:32:34,598 - Start-Maja - INFO - Linking /home/smiej/MAJA/CAMS/S2__TEST_EXO_CAMS_20190221T030000_20190308T143018.DBL.DIR in /home/smiej/MAJA/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//in//S2__TEST_EXO_CAMS_20190221T030000_20190308T143018.DBL.DIR
2019-03-11 14:32:34,598 - Start-Maja - INFO - Linking /home/smiej/MAJA/CAMS/S2__TEST_EXO_CAMS_20190221T150000_20190308T165712.DBL.DIR in /home/smiej/MAJA/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//in//S2__TEST_EXO_CAMS_20190221T150000_20190308T165712.DBL.DIR
2019-03-11 14:32:34,598 - Start-Maja - INFO - Linking /home/smiej/MAJA/CAMS/S2__TEST_EXO_CAMS_20190222T030000_20190308T171557.DBL.DIR in /home/smiej/MAJA/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//in//S2__TEST_EXO_CAMS_20190222T030000_20190308T171557.DBL.DIR
2019-03-11 14:32:34,599 - Start-Maja - INFO - Linking /home/smiej/MAJA/CAMS/S2__TEST_EXO_CAMS_20190222T150000_20190308T171938.DBL.DIR in /home/smiej/MAJA/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//in//S2__TEST_EXO_CAMS_20190222T150000_20190308T171938.DBL.DIR
2019-03-11 14:32:34,599 - Start-Maja - INFO - Linking /home/smiej/MAJA/CAMS/S2__TEST_EXO_CAMS_20190221T030000_20190308T143018.HDR in /home/smiej/MAJA/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//in//S2__TEST_EXO_CAMS_20190221T030000_20190308T143018.HDR
2019-03-11 14:32:34,599 - Start-Maja - INFO - Linking /home/smiej/MAJA/CAMS/S2__TEST_EXO_CAMS_20190221T150000_20190308T165712.HDR in /home/smiej/MAJA/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//in//S2__TEST_EXO_CAMS_20190221T150000_20190308T165712.HDR
2019-03-11 14:32:34,599 - Start-Maja - INFO - Linking /home/smiej/MAJA/CAMS/S2__TEST_EXO_CAMS_20190222T030000_20190308T171557.HDR in /home/smiej/MAJA/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//in//S2__TEST_EXO_CAMS_20190222T030000_20190308T171557.HDR
2019-03-11 14:32:34,599 - Start-Maja - INFO - Linking /home/smiej/MAJA/CAMS/S2__TEST_EXO_CAMS_20190222T150000_20190308T171938.HDR in /home/smiej/MAJA/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//in//S2__TEST_EXO_CAMS_20190222T150000_20190308T171938.HDR
2019-03-11 14:32:34,599 - Start-Maja - INFO - #################################
2019-03-11 14:32:34,599 - Start-Maja - INFO - #################################
2019-03-11 14:32:34,599 - Start-Maja - INFO - processing /mnt/archive/dwn_def/s2/default/morocco_centre/S2A_MSIL1C_20190221T111101_N0207_R137_T30STB_20190221T113849.SAFE in Init Mode
2019-03-11 14:32:34,599 - Start-Maja - INFO - Init mode goes with suboptimal performances
2019-03-11 14:32:34,599 - Start-Maja - INFO - MAJA logfile: /home/smiej/MAJA/L2Aproduct/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//S2A_MSIL1C_20190221T111101_N0207_R137_
The log file still contain the same error, only one line: /opt/MAJA/bin/maja-processing-3.2.2: error while loading shared libraries: libMajaChain.so.3.2: cannot open shared object file: No such file or directory
Concerning Linux information :
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

Virtual machine with CPU - 12 Core and 16GB RAM

from maja.

Thanks, so the installation of MAJA is still unsuccessful in your case.
We did not test MAJA on a virtual machine.

I passed the info to the colleague in charge, @petket-5 , who should get in touch.
Olivier

from maja.

we resolved the problem of libMajaChain.so.3.2 by creating a file in etc/ld.so-conf.d, that contain the path to the library (/opt/MAJA/lib), but we still have another problem reported on the following log file :
2019-03-11T15:09:26.633704 localhost.localdomain maja-processing-3.2.2 3.2 [000000022421] [I] MAJA Software Version : 3.2.2
2019-03-11T15:09:26.634598 localhost.localdomain maja-processing-3.2.2 3.2 [000000022421] [E] vns::Data::ERROR: : Error while copying the filename <OUT_DIR/share/config/Templates/PMC_LxREPT.EEF> to </home/smiej/MAJA/L2Aproduct/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//PMC_LxREPT.EEF> ! [vnsSystem.cxx:CopyFile:406]
2019-03-11T15:09:26.634923 localhost.localdomain maja-processing-3.2.2 3.2 [000000022421] [E] ****************************************************************************************************** [vnsMajaMainProcessor.cxx:main:73]
2019-03-11T15:09:26.634974 localhost.localdomain maja-processing-3.2.2 3.2 [000000022421] [E] Application handler initialization: vns::Data::ERROR: : Error while copying the filename <OUT_DIR/share/config/Templates/PMC_LxREPT.EEF> to </home/smiej/MAJA/L2Aproduct/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS//PMC_LxREPT.EEF> ! [vnsSystem.cxx:406] [MAJA Data Exception] [vnsMajaMainProcessor.cxx:main:73]
2019-03-11T15:09:26.634999 localhost.localdomain maja-processing-3.2.2 3.2 [000000022421] [E] [vnsMajaMainProcessor.cxx:main:73]
2019-03-11T15:09:26.635012 localhost.localdomain maja-processing-3.2.2 3.2 [000000022421] [E] ****************************************************************************************************** [vnsMajaMainProcessor.cxx:main:73]

from maja.

Hi,

Good news that you resolved the first error.
What is OUT_DIR in the log you provided? What are the contents of your folders.txt?

Kind regards,
Peter

from maja.

The contents of folders.txt is as follow:
repCode=/home/sm/Start-MAJA-master
repWork=/home/sm/MAJA/work
repL1 =/mnt/archive/dwn_def/s2/default
repL2 =/home/sm/MAJA/L2Aproduct
repMaja=/opt/MAJA/bin/maja
repCAMS=/home/sm/MAJA/CAMS

from maja.

Sorry i didn't mention that the OUT_DIR is not provided in the log file

from maja.

Hi,

I was able to reproduce the error on a CentOS VM. It seems that you didn't chmod the folder correctly: You probably installed maja as root (cause /opt/ is not in the default user-accessible space), but then forgot to give access rights to all users:
To solve it, please execute
sudo chmod -R 777 /opt/MAJA/
and then try to run maja again.

Kind regards,
Peter

from maja.

Thank you for your response.
I executed the command to give right access to all users, and i ran start_maja as root, but i still have the same error on the log file.

from maja.

Hi,
We finally overcome the error, we shouldn't install maja on opt folder.
So i still have an error, provided on the log:
S2A_MSIL1C_20190211T111201_N0207_R137_T30STB_20190211T114747.SAFE.log

from maja.

Hi, thanks for the news and feedback.

Several preliminary remarks :
1- we found a bug in MAJA 3.2 with CAMS option activated. As a result (as mentioned recently in the readme file) we do not recommend to activate the CAMS option with the current version, even if the bug only has consequences in some particular cases.

2 - tile 30STB in Morocco is already processed by Theia (without the CAMS option which was maybe the reason why you wanted to use MAJA). Data avalable from https://theia.cnes.fr

Now back to your issue.
MAJA fails with the following command :
tar -xf /home/smiej/MAJA_folder/work/morocco_centre/30STB/GIPP_MAJA_3.1.2_TM_CAMS/in/S2A_TEST_GIP_L2TOCR_L_BLACKCAR_50001_00000000_99999999.DBL

Could you please check the presence of S2A_TEST_GIP_L2TOCR_L_BLACKCAR_50001_00000000_99999999.DBLfile in the GIPP folder you provided as input ?

best regards
Olivier

from maja.

yes you're right, i checked the file in the considered folder, it doesn't exist, so i downloaded the necessary file, and I ran maja again.
I'll let you know about the news.

from maja.

The L2AVALD are generated, but i still have one problem, as mentioned
S2A_MSIL1C_20190221T111101_N0207_R137_T30STB_20190221T113849.SAFE.log
on the log file

from maja.

Oups, I know how to correct this one. Could you download again the GIPP repository from http://tully.ups-tlse.fr/olivier/gipp_maja/tree/master/GIPP_MAJA_3.1.2_TM_CAMS (I guess it is the one you used).

Sorry for the difficulties, three of you are trying this version of Start-Maja and MAJA 3.2.2, in parallel, and you seem to be the first ones (or the first to have issues)

Have a nice week-end
Olivier

from maja.

Hi,
I downloaded the updated GIPP, and it finally works fine for the tile 30STB. the L2VALD and QCK are generated. However when i tried with another tile 29 SNR, it gives the following error :
File "start_maja.py", line 621, in
start_maja(folder_file, context, site, tile, orbit, nb_backward, options, debug_mode)
File "start_maja.py", line 424, in start_maja
add_parameter_files(repGipp, repWork + "/in/", tile, repCams)
File "start_maja.py", line 160, in add_parameter_files
os.symlink(fic, repWorkIn + '/' + base)
OSError: [Errno 2] No such file or directory

from maja.

All right, so this issue was solved, and process worked for one tile, but you get another issue. which is the same as #2

This issue has not been fully solved, but I have updated start_maja to catch this exception. Could you please update and tell me if it works better ?

Thanks,
Olivier

from maja.

Thank you for your response, i suppose that the error mentionned in the other issue is different from what i am getting. In my case it can't create in directory .

from maja.

OK, you are right, i did not pay enough attention.

Could you still update so that I have the line numbers right, and also could you run the same command with -v option (verbose mode), and send me the 20 last lines before it fails ?

from maja.

hi,
I was able to overcome the problem, maja works even with another tile, i tested both 30STB and 29SNR.
I have one more question, does maja work on landsat8 products.

from maja.

Hi Good news !
Could you share the resolution, for other users facing the same issue one day ?
Could you open another issue with your new question, for the same reason ?
I will answer, I swear ;)
Olivier

from maja.