In step 9 the command is ambiguous if you're installing as you are already in the deploy directory. Update the instructions to be relative but still state that one should be in the deploy directory.

Newest Version to 0.9

Augment instructions to include JAVA_HOME env setting

This is needed in order for chunk to work

Update documentation to include maven version to use during build as part of prereq

(memex)ubuntu@ip-10-47-164-122:/mnt/deploy/tomcat7/bin$ cd $OODT_HOME/resmgr/bin/ && ./start_memex_stubs
-bash: ./start_memex_stubs: No such file or directory

change to start-memex-stubs

But then another issue:

(memex)ubuntu@ip-10-47-164-122:/mnt/deploy/resmgr/bin$ ./start-memex-stubs
./start-memex-stubs: ./batch_stub: /bin/tcsh: bad interpreter: No such file or directory

In step 11 we should specify where to get each of the jar files from. I propose that we grab them from their component directory (i.e. cas-filemgr-VERSION.jar from filemgr/lib/cas-filemgr-VERSION.jar)

These were missing after unpackaging

root@7dc72cda3f49:/deploy/pge/extractors# tree
.
|-- filename
|   `-- chunkfile_extractor.xml
`-- metout
    `-- chunkfile_metout.xml

cp resmgr/lib/cas-filemgr-0.9-20150413.232341-126.jar workflow/lib/

and various other locations

cc @MJJoyce

Professor,

In the process of seting up imagecat, I found a bug. This occurs once you're run ./install.sh, and are in the process of running ./start.sh inside deploy.

On line 47 of /bin/env.sh, there is

export OODT_HOME=--OODT_HOME--

Which interferes with the startup process and should be removed. We're already setting OODT_HOME in bin/imagecatenv.sh, so this line can either be removed, or edited to take the value from imagecatenv.sh.

Similarly, another file contains the same substring tomcat7/conf/Catalina/localhost/solr.xml.

For reference, I found these files by running the command

egrep -ril '\-\-OODT_HOME\-\-' .  

Inside the deploy folder.

I am receiving the below error in oodt.out after running $OODT_HOME/bin/chunker. Tomcat and Solr both appear to be starting correctly and the path to images is correct in the roxy file. I have also set permissions liberally for the image files but am unable to get any results. Images are all jpegs with no spaces or special chars.

Sep 16, 2015 1:25:25 PM org.apache.oodt.cas.workflow.engine.IterativeWorkflowProcessorThread checkTaskRequiredMetadata
INFO: Task: [Chunker] has no required metadata fields
Exception in thread "Thread-4" java.lang.NullPointerException: value cannot be null
    at org.apache.lucene.document.Field.<init>(Field.java:240)
    at org.apache.lucene.document.Field.<init>(Field.java:216)
    at org.apache.oodt.cas.workflow.instrepo.LuceneWorkflowInstanceRepository.addInstanceMetadataToDoc(LuceneWorkflowInstanceRepository.java:576)
    at org.apache.oodt.cas.workflow.instrepo.LuceneWorkflowInstanceRepository.toDoc(LuceneWorkflowInstanceRepository.java:543)
    at org.apache.oodt.cas.workflow.instrepo.LuceneWorkflowInstanceRepository.addWorkflowInstanceToCatalog(LuceneWorkflowInstanceRepository.java:459)
    at org.apache.oodt.cas.workflow.instrepo.LuceneWorkflowInstanceRepository.updateWorkflowInstance(LuceneWorkflowInstanceRepository.java:200)
    at org.apache.oodt.cas.workflow.engine.IterativeWorkflowProcessorThread.persistWorkflowInstance(IterativeWorkflowProcessorThread.java:563)
    at org.apache.oodt.cas.workflow.engine.IterativeWorkflowProcessorThread.run(IterativeWorkflowProcessorThread.java:258)
    at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
    at java.lang.Thread.run(Thread.java:745)

After install, throws error saying it cant find a logs folder in tomcat7 so the user has to add their own.

Images are partially processed but not parsed correctly:

INFO: on.SolrException: org.apache.tika.exception.TikaException: TIKA-198: Illegal IOException from org.apache.tika.parser.jpeg.JpegParser@5c0bae4a
OUTPUT:         at org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:225)
OUTPUT:         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
OUTPUT:         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
OUTPUT:         at org.apache.solr.core.RequestHandler
Apr 15, 2015 9:18:29 PM org.apache.oodt.commons.io.LoggerOutputStream flush

Warn users this happens or fix?

For integrating ImageCat into the Memex crawler pipeline, we would like to run the integration code in Storm for real-time processing. Is it possible to provide a streaming API for ImageCat?

Thanks,
Steve

The urls listed for Solr need to be changed to:
http://localhost:8081/solr/#/imagecatoodt
and
http://localhost:8081/solr/#/imagecatdev

The prereq lists xmlrpc as a prerequisite. I believe this should be xmlrpclib. This comes standard in python version 2.7.

Removing all of the slf jars made the opsui not function either this step 12 of the installation needs to be removed or the slf jar files need to be put into the tomcat/common/lib so they are available across all webapps.

Tomcat overwrites temp dir in tomcat7

/deploy/tomcat7/temp
/deploy/tomcat/temp

There is an ImportError when running sha1sum.py from /deploy/pge/bin/sha1sum inside the docker container.

http://localhost:8081/solr/imagecatdevge/bin/sha1sum && python2.7 sha1sum.py -s
Traceback (most recent call last):
File "sha1sum.py", line 24, in
import pysolr
ImportError: No module named pysolr