Class Name is required, it's a select, but it has no values.

(From LexPredict/lexpredict-legal-dictionary#5)

It would be great if there was a docker container that I could just fire up so that I could have a play around. I'm going through the installation steps now and there's quite a bit to do before I can get my hands dirty. Would be great if all that was abstracted away.

I am using the latest deployment script which, I believe, uses RabbitMQ. However, on running the Locate task, I get the following error:

INFO 2018-01-12 16:22:57,615 | Start task "Locate", id=10
INFO 2018-01-12 16:22:57,622 | Deleted 0 RatioUsage objects
INFO 2018-01-12 16:22:57,625 | Deleted 0 TextUnitTag(tag=ratio)
INFO 2018-01-12 16:22:57,628 | Deleted 0 CurrencyUsage objects
INFO 2018-01-12 16:22:57,631 | Deleted 0 TextUnitTag(tag=currency)
INFO 2018-01-12 16:22:57,634 | Deleted 0 AmountUsage objects
INFO 2018-01-12 16:22:57,636 | Deleted 0 TextUnitTag(tag=amount)
INFO 2018-01-12 16:22:57,639 | Deleted 0 UrlUsage objects
INFO 2018-01-12 16:22:57,642 | Deleted 0 TextUnitTag(tag=url)
INFO 2018-01-12 16:22:57,644 | Deleted 0 CopyrightUsage objects
INFO 2018-01-12 16:22:57,647 | Deleted 0 TextUnitTag(tag=copyright)
INFO 2018-01-12 16:22:57,650 | Deleted 0 PercentUsage objects
INFO 2018-01-12 16:22:57,654 | Deleted 0 TextUnitTag(tag=percent)
INFO 2018-01-12 16:22:57,657 | Deleted 0 DefinitionUsage objects
INFO 2018-01-12 16:22:57,659 | Deleted 0 TextUnitTag(tag=definition)
INFO 2018-01-12 16:22:57,662 | Deleted 0 GeoEntityUsage objects
INFO 2018-01-12 16:22:57,665 | Deleted 0 GeoAliasUsage objects
INFO 2018-01-12 16:22:57,667 | Deleted 0 TextUnitTag(tag=geoentity)
INFO 2018-01-12 16:22:57,670 | Deleted 0 CourtUsage objects
INFO 2018-01-12 16:22:57,673 | Deleted 0 TextUnitTag(tag=court)
INFO 2018-01-12 16:22:57,675 | Deleted 0 TermUsage objects
INFO 2018-01-12 16:22:57,678 | Deleted 0 TextUnitTag(tag=term)
INFO 2018-01-12 16:22:57,681 | Deleted 0 CitationUsage objects
INFO 2018-01-12 16:22:57,683 | Deleted 0 TextUnitTag(tag=citation)
INFO 2018-01-12 16:22:57,686 | Deleted 0 PartyUsage objects
INFO 2018-01-12 16:22:57,689 | Deleted 0 TextUnitTag(tag=party)
INFO 2018-01-12 16:22:57,691 | Deleted 0 TrademarkUsage objects
INFO 2018-01-12 16:22:57,694 | Deleted 0 TextUnitTag(tag=trademark)
INFO 2018-01-12 16:22:57,697 | Deleted 0 DistanceUsage objects
INFO 2018-01-12 16:22:57,699 | Deleted 0 TextUnitTag(tag=distance)
INFO 2018-01-12 16:22:57,702 | Deleted 0 DateDurationUsage objects
INFO 2018-01-12 16:22:57,705 | Deleted 0 TextUnitTag(tag=duration)
INFO 2018-01-12 16:22:57,708 | Deleted 0 DateUsage objects
INFO 2018-01-12 16:22:57,711 | Deleted 0 TextUnitTag(tag=date)
INFO 2018-01-12 16:22:57,714 | Deleted 0 RegulationUsage objects
INFO 2018-01-12 16:22:57,717 | Deleted 0 TextUnitTag(tag=regulation)
INFO 2018-01-12 16:22:57,931 | Run location of [ratio; amount; currency; copyright; percent; definition; geoentity; citation; term; party; court; trademark; distance; regulation; duration; date; url].
INFO 2018-01-12 16:22:57,933 | Locate in [paragraphs].
INFO 2018-01-12 16:22:57,948 | Found 12750 Text Units. Added 12750 subtasks.
ERROR 2018-01-12 16:22:57,950 | ERROR
ERROR 2018-01-12 16:22:57,953 | ConnectionError: Error 111 connecting to 127.0.0.1:6379. Connection refused.
ERROR 2018-01-12 16:22:57,955 | Traceback (most recent call last):
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 484, in connect
sock = self._connect()
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 541, in _connect
raise err
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 529, in _connect
sock.connect(socket_address)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/ve/lib/python3.5/site-packages/redis/client.py", line 667, in execute_command
connection.send_command(*args)
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 610, in send_command
self.send_packed_command(self.pack_command(*args))
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 585, in send_packed_command
self.connect()
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 489, in connect
raise ConnectionError(self._error_message(e))
redis.exceptions.ConnectionError: Error 111 connecting to 127.0.0.1:6379. Connection refused.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 484, in connect
sock = self._connect()
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 541, in _connect
raise err
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 529, in _connect
sock.connect(socket_address)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/task/tasks.py", line 208, in run
self.process(**kwargs)
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/task/tasks.py", line 760, in process
transfer.put(key=locate_cache_key, value=locate)
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/common/advancedcelery/transfer.py", line 162, in put
self._del_non_active_from_redis([key, *active_keys])
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/common/advancedcelery/transfer.py", line 123, in _del_non_active_from_redis
redis_keys = self._get_active_keys_from_storage()
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/common/advancedcelery/transfer.py", line 114, in _get_active_keys_from_storage
return [bb.decode('utf-8') for bb in self._redis.keys(TransferManager._full_key('*'))]
File "/opt/ve/lib/python3.5/site-packages/redis/client.py", line 1032, in keys
return self.execute_command('KEYS', pattern)
File "/opt/ve/lib/python3.5/site-packages/redis/client.py", line 673, in execute_command
connection.send_command(*args)
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 610, in send_command
self.send_packed_command(self.pack_command(*args))
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 585, in send_packed_command
self.connect()
File "/opt/ve/lib/python3.5/site-packages/redis/connection.py", line 489, in connect
raise ConnectionError(self._error_message(e))
redis.exceptions.ConnectionError: Error 111 connecting to 127.0.0.1:6379. Connection refused.

INFO 2018-01-12 16:22:57,960 | End of main task "Locate", id=10
INFO 2018-01-12 16:22:57,965 | There are 12750 uncompleted subtasks remaining. Please wait.

I believe it looks like it is trying to connect to redis instead.

I was successfully able to use the txt based samples to upload and run the locate task. I cleared them out and uploaded two PDFs. When running the admin "Locate command" after uploading and running Elasticsearch, nothing was identified. This was the task details:

NFO 2018-01-18 15:18:19,662 | Run location of [amount; trademark; court; currency; regulation; date; ratio; citation; duration; url; definition; distance; geoentity; party; term; copyright; percent].
INFO 2018-01-18 15:18:19,665 | Locate in [paragraphs].
INFO 2018-01-18 15:18:19,670 | Found 0 Text Units. Added 0 subtasks.
INFO 2018-01-18 15:18:19,777 | End of main task "Locate", id=20

Amy I missing a step that needs to be taken with PDF documents or do they manually need to be converted to text prior to uploading?

I made use of the update_local.sh script to update my release 1.0.3 installation to 1.0.4.
After the script was completed I can log into the web applications, but failed to run the basic tasks, like the "LoadTerms" task. It will just sit in the queue with a pending status.

I noticed that in updating to release 1.0.4, the way celery is started becomes different from 1.0.3. Previously the way to start was:
celery multi start 2 -A apps.task -f celery.log -l info -B

but now in 1.0.4 it became:
celery multi start 2 -A apps -f celery.log -l info -B

Is the changes in removing reference to task.py intended and right? Documentation in 1.0.4 is not updated yet and still refer to "apps.task" (pg 7 of the Admin Guide manual) Checking on "registered tasks" and "active tasks" returned failure status led me to believe that the issue has to do with celery. Please see error log below.

If that is not the issue, can you please help to advice what to look for if an admin task remains pending with 0% progress? I was able to complete this task before upgrading to 1.0.4.

(ve) contraxsuite@llb-ideacentre-510S-08IKL:/contraxsuite/lexpredict-contraxsuite/contraxsuite_services$ celery inspect registered -A apps
Traceback (most recent call last):
File "/contraxsuite/ve/bin/celery", line 11, in
sys.exit(main())
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/main.py", line 14, in main
_main()
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/celery.py", line 326, in main
cmd.execute_from_commandline(argv)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/celery.py", line 488, in execute_from_commandline
super(CeleryCommand, self).execute_from_commandline(argv)))
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 281, in execute_from_commandline
return self.handle_argv(self.prog_name, argv[1:])
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/celery.py", line 480, in handle_argv
return self.execute(command, argv)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/celery.py", line 412, in execute
).run_from_argv(self.prog_name, argv[1:], command=argv[0])
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 285, in run_from_argv
sys.argv if argv is None else argv, command)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 367, in handle_argv
*self.parse_options(prog_name, argv, command))
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 403, in parse_options
self.parser = self.create_parser(prog_name, command)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 413, in create_parser
epilog=self._format_epilog(self.epilog),
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/control.py", line 167, in epilog
self.list_commands(indent=4, help=True, app=self.app)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/control.py", line 56, in list_commands
choices = cls._choices_by_group(app)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/control.py", line 152, in _choices_by_group
app.loader.import_default_modules()
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 111, in import_default_modules
return [self.import_task_module(m) for m in self.default_modules]
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 111, in
return [self.import_task_module(m) for m in self.default_modules]
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 97, in import_task_module
return self.import_from_cwd(module)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 106, in import_from_cwd
package=package,
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/utils/imports.py", line 101, in import_from_cwd
return imp(module, package=package)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 100, in import_module
return importlib.import_module(module, package=package)
File "/contraxsuite/ve/lib/python3.5/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 986, in _gcd_import
File "", line 969, in _find_and_load
File "", line 958, in _find_and_load_unlocked
File "", line 673, in _load_unlocked
File "", line 665, in exec_module
File "", line 222, in _call_with_frames_removed
File "/contraxsuite/lexpredict-contraxsuite/contraxsuite_services/apps/task/tasks.py", line 76, in
from tika import parser
File "/contraxsuite/ve/lib/python3.5/site-packages/tika/parser.py", line 19, in
from .tika import parse1, callServer, ServerEndpoint
File "/contraxsuite/ve/lib/python3.5/site-packages/tika/tika.py", line 142, in
fileHandler = logging.FileHandler(log_file)
File "/usr/lib/python3.5/logging/init.py", line 1008, in init
StreamHandler.init(self, self._open())
File "/usr/lib/python3.5/logging/init.py", line 1037, in _open
return open(self.baseFilename, self.mode, encoding=self.encoding)
PermissionError: [Errno 13] Permission denied: '/tmp/tika.log'

(ve) contraxsuite@llb-ideacentre-510S-08IKL:/contraxsuite/lexpredict-contraxsuite/contraxsuite_services$ celery inspect active -A apps
Traceback (most recent call last):
File "/contraxsuite/ve/bin/celery", line 11, in
sys.exit(main())
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/main.py", line 14, in main
_main()
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/celery.py", line 326, in main
cmd.execute_from_commandline(argv)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/celery.py", line 488, in execute_from_commandline
super(CeleryCommand, self).execute_from_commandline(argv)))
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 281, in execute_from_commandline
return self.handle_argv(self.prog_name, argv[1:])
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/celery.py", line 480, in handle_argv
return self.execute(command, argv)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/celery.py", line 412, in execute
).run_from_argv(self.prog_name, argv[1:], command=argv[0])
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 285, in run_from_argv
sys.argv if argv is None else argv, command)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 367, in handle_argv
*self.parse_options(prog_name, argv, command))
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 403, in parse_options
self.parser = self.create_parser(prog_name, command)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/base.py", line 413, in create_parser
epilog=self._format_epilog(self.epilog),
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/control.py", line 167, in epilog
self.list_commands(indent=4, help=True, app=self.app)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/control.py", line 56, in list_commands
choices = cls._choices_by_group(app)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/bin/control.py", line 152, in _choices_by_group
app.loader.import_default_modules()
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 111, in import_default_modules
return [self.import_task_module(m) for m in self.default_modules]
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 111, in
return [self.import_task_module(m) for m in self.default_modules]
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 97, in import_task_module
return self.import_from_cwd(module)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 106, in import_from_cwd
package=package,
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/utils/imports.py", line 101, in import_from_cwd
return imp(module, package=package)
File "/contraxsuite/ve/lib/python3.5/site-packages/celery/loaders/base.py", line 100, in import_module
return importlib.import_module(module, package=package)
File "/contraxsuite/ve/lib/python3.5/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 986, in _gcd_import
File "", line 969, in _find_and_load
File "", line 958, in _find_and_load_unlocked
File "", line 673, in _load_unlocked
File "", line 665, in exec_module
File "", line 222, in _call_with_frames_removed
File "/contraxsuite/lexpredict-contraxsuite/contraxsuite_services/apps/task/tasks.py", line 76, in
from tika import parser
File "/contraxsuite/ve/lib/python3.5/site-packages/tika/parser.py", line 19, in
from .tika import parse1, callServer, ServerEndpoint
File "/contraxsuite/ve/lib/python3.5/site-packages/tika/tika.py", line 142, in
fileHandler = logging.FileHandler(log_file)
File "/usr/lib/python3.5/logging/init.py", line 1008, in init
StreamHandler.init(self, self._open())
File "/usr/lib/python3.5/logging/init.py", line 1037, in _open
return open(self.baseFilename, self.mode, encoding=self.encoding)
PermissionError: [Errno 13] Permission denied: '/tmp/tika.log'
(ve) contraxsuite@llb-ideacentre-510S-08IKL:/contraxsuite/lexpredict-contraxsuite/contraxsuite_services$

While installing the local_setup.sh the password for localhost is not working.I changed my ubuntu name password from the fabricrc file but still it keeps on prompting to enter the password.What should be the problem ?

I loaded a sample of agreements and ran the task to parse the documents. No documents were found:

INFO 2018-01-11 22:53:33,099 | Start task "Load Documents", id=6
[2018-01-11 22:53:33,099: INFO/ForkPoolWorker-6] Load Documents[d2432905-ece4-4ad0-942b-b549a4e0d71d]: Start task "Load Documents", id=6
INFO 2018-01-11 22:53:33,103 | Parse new at LocalFileAccess: /opt/lexpredict-contraxsuite/contraxsuite_services/media/data/documents/
[2018-01-11 22:53:33,103: INFO/ForkPoolWorker-6] Load Documents[d2432905-ece4-4ad0-942b-b549a4e0d71d]: Parse new at LocalFileAccess: /opt/lexpredict-contraxsuite/contraxsuite_services/media/data/documents/
INFO 2018-01-11 22:53:33,105 | Detected 0 files. Added 0 subtasks.
[2018-01-11 22:53:33,105: INFO/ForkPoolWorker-6] Load Documents[d2432905-ece4-4ad0-942b-b549a4e0d71d]: Detected 0 files. Added 0 subtasks.
INFO 2018-01-11 22:53:33,108 | End of main task "Load Documents", id=6
[2018-01-11 22:53:33,108: INFO/ForkPoolWorker-6] Load Documents[d2432905-ece4-4ad0-942b-b549a4e0d71d]: End of main task "Load Documents", id=6
[2018-01-11 22:53:33,117: INFO/ForkPoolWorker-6] Task Load Documents[d2432905-ece4-4ad0-942b-b549a4e0d71d] succeeded in 0.03349612400052138s: 'ok'

Yet, /opt/lexpredict-contraxsuite/contraxsuite_services/media/data/documents/ is loaded with txt files. Is there a filter used to identify documents?

I have been getting the same errors when trying to run contraxsuite. Attached is a log when you can see I am updating to the latest version, verifying that all application ports are not in use, verifying all services were created, and then when I run the suite, I get failures with port already in use for kibana and uwsgi. Here is my terminal session:

hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master/docker$ sudo ./update_local_contraxsuite_to_latest_version.sh
[sudo] password for hainsworths:
=== This script will update local Contraxsuite instance to the latest docker image
=== Assume Contraxsuite is configured in ./setenv_local.sh file.
=== Pulling contraxsuite image from DockerHub
Using default tag: latest
latest: Pulling from lexpredict/lexpredict-contraxsuite
Digest: sha256:91b61f160a8c7b3cee831db1d2aa4c78decc7c41994d65159aefcfe7c72a9175
Status: Downloaded newer image for lexpredict/lexpredict-contraxsuite:latest
=== Deploying Contraxsuite stack to Docker Swarm...
/lexpredict-contraxsuite-master/docker/deploy /lexpredict-contraxsuite-master/docker
/lexpredict-contraxsuite-master/docker /lexpredict-contraxsuite-master/docker/deploy /lexpredict-contraxsuite-master/docker
/lexpredict-contraxsuite-master/docker/deploy /lexpredict-contraxsuite-master/docker
Creating service contraxsuite_contrax-celery
Creating service contraxsuite_contrax-rabbitmq
Creating service contraxsuite_contrax-curator_metricbeat
Creating service contraxsuite_contrax-filebeat
Creating service contraxsuite_contrax-flower
Creating service contraxsuite_contrax-jupyter
Creating service contraxsuite_contrax-curator_filebeat
Creating service contraxsuite_contrax-metricbeat
Creating service contraxsuite_contrax-kibana
Creating service contraxsuite_contrax-elasticsearch
Creating service contraxsuite_contrax-tika
Creating service contraxsuite_contrax-uwsgi
Creating service contraxsuite_contrax-redis
Creating service contraxsuite_contrax-db
/lexpredict-contraxsuite-master/docker
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master/docker$ sudo lsof -i
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
systemd-r 739 systemd-resolve 12u IPv4 20657 0t0 UDP localhost:domain
systemd-r 739 systemd-resolve 13u IPv4 20658 0t0 TCP localhost:domain (LISTEN)
avahi-dae 825 avahi 12u IPv4 24088 0t0 UDP *:mdns
avahi-dae 825 avahi 13u IPv6 24089 0t0 UDP *:mdns
avahi-dae 825 avahi 14u IPv4 24090 0t0 UDP *:45476
avahi-dae 825 avahi 15u IPv6 24091 0t0 UDP *:49363
dhclient 1494 root 6u IPv4 27695 0t0 UDP *:bootpc
dockerd 1575 root 20u IPv6 38681 0t0 TCP *:7946 (LISTEN)
dockerd 1575 root 21u IPv6 38682 0t0 UDP *:7946
dockerd 1575 root 25u IPv6 38513 0t0 TCP *:2377 (LISTEN)
dhclient 1641 root 5u IPv6 28167 0t0 UDP SEH-Ubuntu-T500:dhcpv6-client
cupsd 16866 root 6u IPv6 95668 0t0 TCP ip6-localhost:ipp (LISTEN)
cupsd 16866 root 7u IPv4 95669 0t0 TCP localhost:ipp (LISTEN)
cups-brow 16874 root 7u IPv4 95692 0t0 UDP *:ipp
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master/docker$ sudo docker service ls
ID NAME MODE REPLICAS IMAGE PORTS
sipkhbym2qsw contraxsuite_contrax-celery replicated 2/2 lexpredict/lexpredict-contraxsuite:latest
i7eplqrr0pk7 contraxsuite_contrax-curator_filebeat replicated 1/1 stefanprodan/es-curator-cron:latest
zbliyteohgee contraxsuite_contrax-curator_metricbeat replicated 1/1 stefanprodan/es-curator-cron:latest
q2croh89kysc contraxsuite_contrax-db replicated 0/1 postgres:9.6
1cda0c35c3r8 contraxsuite_contrax-elasticsearch replicated 1/1 docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
pgm3hhl3naws contraxsuite_contrax-filebeat global 0/1 docker.elastic.co/beats/filebeat:6.2.4
a440th0p8lpb contraxsuite_contrax-flower replicated 1/1 lexpredict/lexpredict-contraxsuite:latest *:5555->5555/tcp
8e4dcjx5pvd9 contraxsuite_contrax-jupyter replicated 1/1 lexpredict/lexpredict-contraxsuite:latest *:8888->8888/tcp
zlr6jdfufwbw contraxsuite_contrax-kibana replicated 0/1 docker.elastic.co/kibana/kibana-oss:6.2.4 *:5601->5601/tcp
e5dvlujpvxbv contraxsuite_contrax-metricbeat global 0/1 docker.elastic.co/beats/metricbeat:6.2.4
5o6fqquuj0jh contraxsuite_contrax-rabbitmq replicated 1/1 rabbitmq:3-management
snv12uw9vcwa contraxsuite_contrax-redis replicated 0/1 redis:latest
6jzbepq1dhqb contraxsuite_contrax-tika replicated 0/3 lexpredict/tika-server:latest
6mtzzahmby72 contraxsuite_contrax-uwsgi replicated 0/1 lexpredict/lexpredict-contraxsuite:latest *:65080->8080/tcp, *:65443->4443/tcp
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master/docker$ ls
build cors_support deploy outer_nginx_config.example README.md setenv.sh setup_local_contraxsuite_ubuntu_16_04.sh update_local_contraxsuite_to_latest_version.sh util
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master/docker$ cd ..
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master$ ls
contraxsuite_services 'Development Guide.md' docker documentation LICENSE notebook-examples README.md static version.txt
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master$ cd docker
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master/docker$ ls
build cors_support deploy outer_nginx_config.example README.md setenv.sh setup_local_contraxsuite_ubuntu_16_04.sh update_local_contraxsuite_to_latest_version.sh util
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master/docker$ cd deploy
hainsworths@SEH-Ubuntu-T500:/lexpredict-contraxsuite-master/docker/deploy$ ls
dependencies elasticsearch.yml.template new_contraxsuite_cluster_ubuntu_16_04.sh run-contraxsuite-docker-compose.sh
deploy-contraxsuite-to-swarm-cluster.sh filebeat.yml.template push-image-from-dockerhub-to-private-registry.sh temp
docker-compose.yml metricbeat.yml.template registry undeploy-deploy-contraxsuite-from-swarm-cluster.sh
hainsworths@SEH-Ubuntu-T500:~/lexpredict-contraxsuite-master/docker/deploy$ sudo ./run-contraxsuite-docker-compose.sh
~/lexpredict-contraxsuite-master/docker ~/lexpredict-contraxsuite-master/docker/deploy
~/lexpredict-contraxsuite-master/docker/deploy
WARNING: The DOCKER_ELASTICSEARCH_CPUS variable is not set. Defaulting to a blank string.
WARNING: The DOCKER_TIKA_CPUS variable is not set. Defaulting to a blank string.
WARNING: Some services (contrax-celery, contrax-db, contrax-elasticsearch, contrax-filebeat, contrax-flower, contrax-jupyter, contrax-kibana, contrax-metricbeat, contrax-rabbitmq, contrax-redis, contrax-tika, contrax-uwsgi) use the 'deploy' key, which will be ignored. Compose does not support 'deploy' configuration - use docker stack deploy to deploy to a swarm.
WARNING: Some services (contrax-elasticsearch, contrax-filebeat, contrax-metricbeat) use the 'configs' key, which will be ignored. Compose does not support 'configs' configuration - use docker stack deploy to deploy to a swarm.
WARNING: The Docker Engine you're using is running in swarm mode.

Compose does not use swarm mode to deploy services to multiple nodes in a swarm. All containers will be scheduled on the current node.

To deploy your application across the swarm, use docker stack deploy.

Starting deploy_contrax-curator_metricbeat_1 ...
Starting deploy_contrax-curator_metricbeat_1
Starting deploy_contrax-tika_1 ...
Starting deploy_contrax-rabbitmq_1 ...
Starting deploy_contrax-rabbitmq_1
Starting deploy_contrax-tika_1
Starting deploy_contrax-elasticsearch_1 ...
Starting deploy_contrax-elasticsearch_1
Starting deploy_contrax-db_1 ...
Starting deploy_contrax-redis_1 ...
Starting deploy_contrax-db_1
Starting deploy_contrax-redis_1
Starting deploy_contrax-curator_filebeat_1 ...
Starting deploy_contrax-elasticsearch_1 ... done
Starting deploy_contrax-kibana_1 ...
Starting deploy_contrax-db_1 ... done
Recreating deploy_contrax-celery_1 ...
Starting deploy_contrax-kibana_1 ... error

ERROR: for deploy_contrax-kibana_1 Cannot start service contrax-kibana: driver failed programming external connectivity on endpoint deploy_contrax-kibana_1 (34f0c3da7705daa767Recreating deploy_contrax-celery_1 ... done
Recreating deploy_contrax-uwsgi_1 ...
Recreating deploy_contrax-uwsgi_1 ... error

ERROR: for deploy_contrax-uwsgi_1 Cannot start service contrax-uwsgi: driver failed programming external connectivity on endpoint deploy_contrax-uwsgi_1 (fba3fa1470e775e9b8da0ff1e5434ca1c81533c63de2df746935296bb9c1cacd): Error starting userland proxy: listen tcp 127.0.0.1:65443: bind: address already in use

ERROR: for contrax-kibana Cannot start service contrax-kibana: driver failed programming external connectivity on endpoint deploy_contrax-kibana_1 (34f0c3da7705daa767ca2e50716c6da9800025fbdaf64836a5dcdc4efe7586c6): Error starting userland proxy: listen tcp 127.0.0.1:5601: bind: address already in use

ERROR: for contrax-uwsgi Cannot start service contrax-uwsgi: driver failed programming external connectivity on endpoint deploy_contrax-uwsgi_1 (fba3fa1470e775e9b8da0ff1e5434ca1c81533c63de2df746935296bb9c1cacd): Error starting userland proxy: listen tcp 127.0.0.1:65443: bind: address already in use
ERROR: Encountered errors while bringing up the project.

It identifies Ted LLC as the party when actually it's Bill & Tedd LLC

I had successfully installed lexpredict version1.0.1 by following steps of local installation setup mentioned here: https://github.com/LexPredict/lexpredict-contraxsuite-deploy/tree/1.0.1

and I was able to access through localhost. see the below screenshot:

But after the system restart, I can't access the lexpredict. see the below screen:

I checked all the services are running, but don't know what's the issue.

Both the Reports -> Document Counterparties and Reports -> Risk Summary point to /document/document-property/list.

Should they link to different areas to pull the risk summary and/or counterparty list?

Hello,

I'm trying to deploy the LexNLP system in my Ubuntu 16.04 machine using
the "Docker Swarm" method, but I'm having the following issue. In the
image attached, I have a unique IP address, and I'm using that one to
setup the swarm. But every time I type the IP address (or 127.0.0.1 or
simply I leave it blank) I get the message "Error response from daemon:
This node is already part of a swarm". According to the documentation, I
should have an internal and external IP address, but in my case I have a
unique one. How should I proceed in this scenario? I also tried to
deploy the system using the "quick start" method, but I get error
messages like "dateparser 0.7.0 required but 0.6.0 detected which is
incompatible" (this happens with other libraries as well). Do you have
any suggestion in this case? or I should deploy through Docker containers?

If you need further information, please let me know. Thanks in advance

Do the documents need to be OCRed prior to uploading?

Hi

I was testing out the api for contraxsuite, documents uploaded successfully and are listed in the ui but making a get request to:
/api/v1/document/documents/
gives 500 Error: Internal Server Error

other api requests work well like creating a project and authentication do work correctly.

I am trying to deploy on a local machine but the service will not start after running setup_local_contraxsuite_ubuntu_16_04.sh.

Running
sudo docker service logs -f contraxsuite_contrax-uwsgi as suggested shows it is stuck because Postgres is not starting:
contraxsuite_contrax-uwsgi.1.8lfpaq32i2yy@osboxes | Sleeping 5 seconds to let Postgres start

This is the result of running docker container ls -a

CONTAINER ID        IMAGE                                                     COMMAND                  CREATED              STATUS                          PORTS                                                 NAMES
8defb649fa07        postgres:11.5                                             "docker-entrypoint.s…"   3 seconds ago        Created                                                                               contraxsuite_contrax-db.1.8995lvl5lgjtz5zihmbeh9ktk
9c108c2c3e52        postgres:11.5                                             "docker-entrypoint.s…"   9 seconds ago        Exited (1) 3 seconds ago                                                              contraxsuite_contrax-db.1.qw8avdasugvrnm9yl8eiu3ltc
4d21668abc9c        postgres:11.5                                             "docker-entrypoint.s…"   16 seconds ago       Exited (1) 10 seconds ago                                                             contraxsuite_contrax-db.1.xi6qq03tlpbgp7vp78pp9gz7i
980a570b9f33        postgres:11.5                                             "docker-entrypoint.s…"   23 seconds ago       Exited (1) 16 seconds ago                                                             contraxsuite_contrax-db.1.pwwwa7l7ye7pslc8cq0rejyhm
bd5818eff066        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   26 seconds ago       Up 20 seconds                                                                         contraxsuite_contrax-celery-beat.1.xo1bm8gz12imnu7b3p2pu4t1s
f3ed5d2681bb        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   27 seconds ago       Up 21 seconds                                                                         contraxsuite_contrax-celery-doc-load.ek9kgekmur92xhscmeoqhskd1.99p1gqp3v9lf8gjjluynbvxb6
f0ff704acae2        postgres:11.5                                             "docker-entrypoint.s…"   30 seconds ago       Exited (1) 24 seconds ago                                                             contraxsuite_contrax-db.1.e2vmahgf96yj14dkkoknrc5xk
9c257fac30ba        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   35 seconds ago       Up 29 seconds                                                                         contraxsuite_contrax-celery.ek9kgekmur92xhscmeoqhskd1.dsu63ql361d318vpkcwbnw02b
34b07104d6f2        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   About a minute ago   Exited (1) 28 seconds ago                                                             contraxsuite_contrax-celery-beat.1.hs46t9be5ml5725fha6gb6d6r
e30e251ea158        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   About a minute ago   Exited (1) 28 seconds ago                                                             contraxsuite_contrax-celery-doc-load.ek9kgekmur92xhscmeoqhskd1.ezkfuqquup7wy3q4hv4v5d29r
7af196fcbcf1        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   About a minute ago   Exited (1) 36 seconds ago                                                             contraxsuite_contrax-celery.ek9kgekmur92xhscmeoqhskd1.zijj5u528h5v4566ar6xhcop8
b768ccb329a6        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   2 minutes ago        Exited (1) About a minute ago                                                         contraxsuite_contrax-celery-beat.1.wf950drwlzjmc0bevz7m2ykka
dee2b2e1693e        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   2 minutes ago        Exited (1) About a minute ago                                                         contraxsuite_contrax-celery-doc-load.ek9kgekmur92xhscmeoqhskd1.vf0lg4lotl8xp88kvffkn8x4o
3be7b7bba662        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   2 minutes ago        Exited (1) About a minute ago                                                         contraxsuite_contrax-celery.ek9kgekmur92xhscmeoqhskd1.18jop00ivsq4lmsewotf156h1
0742f8644bf4        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   2 minutes ago        Exited (1) 2 minutes ago                                                              contraxsuite_contrax-celery-beat.1.190r5k1jvkp0yxyo4tjgtzoep
63292d27f5cb        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   2 minutes ago        Exited (1) 2 minutes ago                                                              contraxsuite_contrax-celery-doc-load.ek9kgekmur92xhscmeoqhskd1.dw0qwsskue1x6bsawkm6m8m8b
9dca8480d512        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   2 minutes ago        Exited (1) 2 minutes ago                                                              contraxsuite_contrax-celery.ek9kgekmur92xhscmeoqhskd1.6kpems1sp3qv3igag6mzg922w
67c3b67a92e5        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   3 minutes ago        Exited (1) 2 minutes ago                                                              contraxsuite_contrax-celery-beat.1.78orpw6iluawfsv0zoscgxaht
b24e3d37cc32        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   3 minutes ago        Exited (1) 2 minutes ago                                                              contraxsuite_contrax-celery-doc-load.ek9kgekmur92xhscmeoqhskd1.dvmkqscwto6796ue385b7heqp
96b63fff758f        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   3 minutes ago        Exited (1) 2 minutes ago                                                              contraxsuite_contrax-celery.ek9kgekmur92xhscmeoqhskd1.rfgb4lb05abnshjcpocdctjel
f52cb47f56f5        docker.elastic.co/beats/filebeat:6.5.4                    "/usr/local/bin/dock…"   10 minutes ago       Up 10 minutes                                                                         contraxsuite_contrax-filebeat.ek9kgekmur92xhscmeoqhskd1.zf2l1w3vbxyt5ijio0wfhmf1l
7598fdbd490f        docker.elastic.co/beats/filebeat:6.5.4                    "/usr/local/bin/dock…"   10 minutes ago       Exited (1) 10 minutes ago                                                             contraxsuite_contrax-filebeat.ek9kgekmur92xhscmeoqhskd1.jcfs4o7tdqbsf1l4qt9r62acq
a9f4a8bc13d6        docker.elastic.co/beats/filebeat:6.5.4                    "/usr/local/bin/dock…"   10 minutes ago       Exited (1) 10 minutes ago                                                             contraxsuite_contrax-filebeat.ek9kgekmur92xhscmeoqhskd1.qwicmthup8ftdalmnf0huw77d
092ccb2ea9d3        nginx:stable                                              "nginx -g 'daemon of…"   10 minutes ago       Up 10 minutes                   80/tcp                                                contraxsuite_contrax-nginx.1.d5tbc9sq6otmetwlqoechj0x3
ba8d61ddb3c6        docker.elastic.co/beats/filebeat:6.5.4                    "/usr/local/bin/dock…"   10 minutes ago       Exited (1) 10 minutes ago                                                             contraxsuite_contrax-filebeat.ek9kgekmur92xhscmeoqhskd1.m74fa2zbffnoh3hwct429h9xh
df676c540532        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   10 minutes ago       Up 10 minutes                                                                         contraxsuite_contrax-uwsgi.1.8lfpaq32i2yytxrq8r4ggj0vz
8e049fba2de2        nginx:stable                                              "nginx -g 'daemon of…"   10 minutes ago       Exited (1) 10 minutes ago                                                             contraxsuite_contrax-nginx.1.rdrl9fn7h7yodwpb8stpwxxcc
3a9fcaed9511        docker.elastic.co/kibana/kibana-oss:6.5.4                 "/usr/local/bin/kiba…"   10 minutes ago       Up 10 minutes                   5601/tcp                                              contraxsuite_contrax-kibana.1.np3m1nb1i66u6xonvlgi4ch0z
a55ad05e9be7        docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4   "/usr/local/bin/dock…"   10 minutes ago       Up 10 minutes                   9200/tcp, 9300/tcp                                    contraxsuite_contrax-elasticsearch.1.rcoioc3ajud93y82y1sdyz1qg
f434b2ce725f        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   10 minutes ago       Up 10 minutes                                                                         contraxsuite_contrax-jupyter.1.zc1zigt2k9qbnuh2ssqi4233w
3a3c79952fcd        redis:latest                                              "docker-entrypoint.s…"   10 minutes ago       Up 10 minutes                   6379/tcp                                              contraxsuite_contrax-redis.1.o5rq3f1ocghd6h9gbb7jcaboi
1154d47c5114        docker.elastic.co/beats/filebeat:6.5.4                    "/usr/local/bin/dock…"   10 minutes ago       Exited (1) 10 minutes ago                                                             contraxsuite_contrax-filebeat.ek9kgekmur92xhscmeoqhskd1.gcxeglzvsq9f7tpd18mxhah1x
95a3efaf3e15        lexpredict/lexpredict-contraxsuite:latest                 "/usr/bin/tini -- /s…"   10 minutes ago       Up 10 minutes                                                                         contraxsuite_contrax-daphne.1.r5s4t09tzeozcof6xjr7fkty8
dd3fe5a319d8        bytemark/webdav:2.4                                       "docker-entrypoint.s…"   10 minutes ago       Up 10 minutes                   80/tcp, 443/tcp                                       contraxsuite_contrax-webdav.1.x8x90gs8gv2jr941qtota7p8m
f0f691a44463        stefanprodan/es-curator-cron:latest                       "/usr/bin/entrypoint…"   10 minutes ago       Up 10 minutes                                                                         contraxsuite_contrax-curator_filebeat.1.sk9nqijy7wcnw5wz29qwdg7rw
201a4762528d        tutum/logrotate:latest                                    "crond -f"               10 minutes ago       Up 10 minutes                                                                         contraxsuite_contrax-logrotate.ek9kgekmur92xhscmeoqhskd1.0jd6jsyqygkxinq1dn95jtxef
c22f81b92956        rabbitmq:3-management                                     "docker-entrypoint.s…"   10 minutes ago       Up 10 minutes                   4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 25672/tcp   contraxsuite_contrax-rabbitmq.1.36fd5sc23rca2l57px975jcpp

Possibly related - none of the listed ports is pingable apart from 80.

I had successfully installed lexpredict version1.0.1 by following steps of local installation setup mentioned here: https://github.com/LexPredict/lexpredict-contraxsuite-deploy/tree/1.0.1

Now I want to use the system through API's where I can do the following:

• upload file
• Create Task
• Run Task
• Fetch document analysis result
• Fetch document type
• Fetch parties
• create classifiers
  etc.

Is there any API documentation avaialble for lexpredict ?

This may be a user issue, but I have classified several text units and the suggestion list continues to be empty. Is it functional?

Working on a Windows 8 machine.
I cloned the repo https://github.com/LexPredict/lexpredict-contraxsuite-deploy/tree/1.0.1.
I tried to follow the instructions that said to edit the file base/fabicrc.
But I cannot open that file...
What do you suggest?
Thanks!
[email protected]

I'm wondering why we need 100GB storage for just deploying this application? In the docker deployment documentation we have the following:

Storage:
Either 100GB disk at /
or 32GB disk at / for the OS and an additional 100GB disk at /data for Docker and Contraxsuite (safer).

Could you elaborate a bit the reasons why this application needs such amount of storage just to get started?

After running lexpredict-contraxsuite-deploy and logging in, I'm note that it can't find a large portion of CSS & JS. In the place where it's looking for them is a single REAME.md with:
Please see the Installation and Configuration Guide for more details on obtaining the Canvas theme.

Unfortunately there is no mention of Canvas in the Installation and Configuration Guide.

Hi I am trying to figure out how to use this app. I've got this error in uwsgi log file unable to load app 0 (mountpoint='') (callable not found or import error). Do you have any idea what might cause the issue.

Hi, I have successfully install the contraxsuite by using docker. But when I face a problem when I load the document. I first upload a file to a folder "test",

then in Admin Task, I choose "Load Document"

But it is failed and the detail is below

Could you please help me to see where is the problem from?

Many thanks!

https://github.com/LexPredict/lexpredict-contraxsuite-deploy script is not working as mentioned in the guide
I am installing on same machine so I have modified required files setup_local.sh and other files but it stopped moving ahead at the "Login Password for 'ubuntu'" even after entering Correct password

My Linux OS : Ubuntu 16.04

Please refer the attached file.

Nginx fails to start because /var/log/nginx directory is missing.

Hi,
I need some help please. I am trying to deploy ContraxSuite according to this instruction on an Ubuntu 18.04 LTS image on Azure.

I downloaded the non-commercial version of jQWidgets accordingly and put it where it belongs.

Deployment finished with nginx not starting up, according to sudo docker service logs -f contraxsuite_contrax-nginx the reason being the daphne container not starting up:

contraxsuite_contrax-nginx.1.ss080t3cwdim@ContraxUbu18    | 2021/08/29 11:31:47 [emerg] 1#1: host not found in upstream "contrax-daphne" in /etc/nginx/conf.d/default.conf:40
contraxsuite_contrax-nginx.1.ss080t3cwdim@ContraxUbu18    | nginx: [emerg] host not found in upstream "contrax-daphne" in /etc/nginx/conf.d/default.conf:40

Now, a sudo docker service logs -f contraxsuite_contrax-nginx is not very helpful:
contraxsuite_contrax-daphne.1.s4mihc8huw7q@ContraxUbu18 | [FATAL] Executing child process 'daphne' failed: 'No such file or directory'

Interestingly, a sudo tail -f /var/log/syslog shows apparently some issues with the docker bridge:

Aug 29 11:33:41 ContraxUbu18 kernel: [ 7144.653136] eth0: renamed from veth1e66169
Aug 29 11:33:41 ContraxUbu18 systemd-timesyncd[22538]: Network configuration changed, trying to establish connection.
Aug 29 11:33:41 ContraxUbu18 systemd-timesyncd[22538]: Synchronized to time server 91.189.94.4:123 (ntp.ubuntu.com).
Aug 29 11:33:41 ContraxUbu18 kernel: [ 7144.669190] docker_gwbridge: port 10(vethe5c7bc1) entered disabled state
Aug 29 11:33:41 ContraxUbu18 kernel: [ 7144.713393] eth1: renamed from veth3fdad22
Aug 29 11:33:41 ContraxUbu18 systemd-timesyncd[22538]: Network configuration changed, trying to establish connection.
Aug 29 11:33:41 ContraxUbu18 systemd-timesyncd[22538]: Synchronized to time server 91.189.94.4:123 (ntp.ubuntu.com).
Aug 29 11:33:41 ContraxUbu18 systemd-networkd[22472]: vethe5c7bc1: Gained carrier
Aug 29 11:33:41 ContraxUbu18 systemd-timesyncd[22538]: Network configuration changed, trying to establish connection.
Aug 29 11:33:41 ContraxUbu18 kernel: [ 7144.737105] docker_gwbridge: port 10(vethe5c7bc1) entered blocking state
Aug 29 11:33:41 ContraxUbu18 kernel: [ 7144.737107] docker_gwbridge: port 10(vethe5c7bc1) entered forwarding state
Aug 29 11:33:41 ContraxUbu18 systemd-timesyncd[22538]: Synchronized to time server 91.189.94.4:123 (ntp.ubuntu.com).
Aug 29 11:33:41 ContraxUbu18 containerd[1497]: time="2021-08-29T11:33:41.948146534Z" level=info msg="shim reaped" id=4037b23a7b61a3b4fe9d0448cab9aca08a949664036117a76ab73a4b9c3ea82e
Aug 29 11:33:41 ContraxUbu18 dockerd[28430]: time="2021-08-29T11:33:41.958054610Z" level=info msg="ignoring event" module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7144.971227] br0: port 8(veth781) entered disabled state
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7144.971298] veth1e66169: renamed from eth0
Aug 29 11:33:42 ContraxUbu18 systemd-udevd[24467]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Aug 29 11:33:42 ContraxUbu18 systemd-timesyncd[22538]: Network configuration changed, trying to establish connection.
Aug 29 11:33:42 ContraxUbu18 networkd-dispatcher[1406]: WARNING:Unknown index 5388 seen, reloading interface list
Aug 29 11:33:42 ContraxUbu18 systemd-timesyncd[22538]: Synchronized to time server 91.189.94.4:123 (ntp.ubuntu.com).
Aug 29 11:33:42 ContraxUbu18 systemd-networkd[22472]: vethe5c7bc1: Lost carrier
Aug 29 11:33:42 ContraxUbu18 systemd-timesyncd[22538]: Network configuration changed, trying to establish connection.
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7145.055495] docker_gwbridge: port 10(vethe5c7bc1) entered disabled state
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7145.055591] veth3fdad22: renamed from eth1
Aug 29 11:33:42 ContraxUbu18 systemd-timesyncd[22538]: Synchronized to time server 91.189.94.4:123 (ntp.ubuntu.com).
Aug 29 11:33:42 ContraxUbu18 systemd-udevd[24490]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Aug 29 11:33:42 ContraxUbu18 systemd-timesyncd[22538]: Network configuration changed, trying to establish connection.
Aug 29 11:33:42 ContraxUbu18 networkd-dispatcher[1406]: WARNING:Unknown index 5390 seen, reloading interface list
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7145.120576] docker_gwbridge: port 10(vethe5c7bc1) entered disabled state
Aug 29 11:33:42 ContraxUbu18 systemd-networkd[22472]: vethe5c7bc1: Link DOWN
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7145.122677] device vethe5c7bc1 left promiscuous mode
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7145.122682] docker_gwbridge: port 10(vethe5c7bc1) entered disabled state
Aug 29 11:33:42 ContraxUbu18 systemd-timesyncd[22538]: Synchronized to time server 91.189.94.4:123 (ntp.ubuntu.com).
Aug 29 11:33:42 ContraxUbu18 systemd-timesyncd[22538]: Network configuration changed, trying to establish connection.
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7145.182658] br0: port 8(veth781) entered disabled state
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7145.182973] device veth781 left promiscuous mode
Aug 29 11:33:42 ContraxUbu18 kernel: [ 7145.182975] br0: port 8(veth781) entered disabled state
Aug 29 11:33:42 ContraxUbu18 systemd-timesyncd[22538]: Synchronized to time server 91.189.94.4:123 (ntp.ubuntu.com).
Aug 29 11:33:42 ContraxUbu18 dockerd[28430]: time="2021-08-29T11:33:42.339721363Z" level=error msg="fatal task error" error="task: non-zero exit (1)" module=node/agent/taskmanager node.id=n9qqhiaxuyjq2itiun4nxf5rq service.id=oi3sqzyeanrk0w63r699jej9q task.id=y65q5mmfxorm79wmc1r76szc1

I have no idea how to fix this. It even seems to be an issue in Docker (maybe in correlation with Ubuntu - but I tried numerous different Ubuntu images without any success - the error remains in all of them).

Can anyone advise? Thanks in advance!

Hi, I followed the steps in the docker deployment section on a fresh Ubuntu 16.04 LTS. Upon checking the services I get the following output

But none of the services are accessible at localhost:65080 or localhost.

Upon digging further, in the docker volume in the folder " contraxsuite_contraxsuite_internal_nginx_logs" I see two entries in error.logs:

8#8: *2 "/etc/nginx/html/index.html" is not found (2: No such file or directory), client: MY_INTERNAL_IP_ADDRESS, server: contrax-nginx, request: "GET / HTTP/1.1", host: "MY_IP_ADDRESS"

I am not able to find proper logs to debug what went wrong in docker deployment. It appears everything installed correctly but nginx logs say otherwise.

Any help or direction on docker deployment will be helpful. Am I missing any steps or pre-configuration in deploying a docker image on a clean ubuntu 16.04?

Trying https://github.com/LexPredict/lexpredict-contraxsuite/blob/master/notebook-examples/document_model_tutorial.ipynb in the Docker deployment, at

# Setup django environment
os.environ.setdefault("DJANGO_SETTINGS_MODULE", "config.settings.local")
django.setup()

I get:

ModuleNotFoundError                       Traceback (most recent call last)
<ipython-input-5-71fc31a6daec> in <module>()
      5 # Setup django environment
      6 os.environ.setdefault("DJANGO_SETTINGS_MODULE", "config.settings.local")
----> 7 django.setup()

/contraxsuite_services/venv/lib/python3.6/site-packages/django/__init__.py in setup(set_prefix)
     17     from django.utils.log import configure_logging
     18 
---> 19     configure_logging(settings.LOGGING_CONFIG, settings.LOGGING)
     20     if set_prefix:
     21         set_script_prefix(

/contraxsuite_services/venv/lib/python3.6/site-packages/django/conf/__init__.py in __getattr__(self, name)
     77         """Return the value of a setting and cache it in self.__dict__."""
     78         if self._wrapped is empty:
---> 79             self._setup(name)
     80         val = getattr(self._wrapped, name)
     81         self.__dict__[name] = val

/contraxsuite_services/venv/lib/python3.6/site-packages/django/conf/__init__.py in _setup(self, name)
     64                 % (desc, ENVIRONMENT_VARIABLE))
     65 
---> 66         self._wrapped = Settings(settings_module)
     67 
     68     def __repr__(self):

/contraxsuite_services/venv/lib/python3.6/site-packages/django/conf/__init__.py in __init__(self, settings_module)
    155         self.SETTINGS_MODULE = settings_module
    156 
--> 157         mod = importlib.import_module(self.SETTINGS_MODULE)
    158 
    159         tuple_settings = (

/contraxsuite_services/venv/lib/python3.6/importlib/__init__.py in import_module(name, package)
    124                 break
    125             level += 1
--> 126     return _bootstrap._gcd_import(name[level:], package, level)
    127 
    128 

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _gcd_import(name, package, level)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _find_and_load(name, import_)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _find_and_load_unlocked(name, import_)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _gcd_import(name, package, level)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _find_and_load(name, import_)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _find_and_load_unlocked(name, import_)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _gcd_import(name, package, level)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _find_and_load(name, import_)

/contraxsuite_services/venv/lib/python3.6/importlib/_bootstrap.py in _find_and_load_unlocked(name, import_)

ModuleNotFoundError: No module named 'config'

I am trying to process a PDF document but I seem to be out of luck. I created a new folder (via "Browse/Upload Documents" called test and uploaded a PDF document into it.

I guess that next I have to run an admin task (via "Admin Tasks") to move the document inside the document engine. So I did:

1. Run Task
2. Load Data
3. Load Documents
4. Source path test
5. Source Type Document(?)
6. Document Type pdf
7. Unchecked Delete existing Documents
8. Load

The task is now pending for some minutes with no progress shown. What could it be?

The "cluster by" field is somewhat broken. I think it's supposed to be a drop down, instead it's a text field.
image

Even if I type "terms" into that it doesn't work.

These notes are based on my experience of installing ContraxSuite locally on an Ubuntu 16.04 LTS Virtual Machine. I have little experience in server administration and even less in administrating enterprise Software.

I used setup_local.sh to install the software and referred to the Installation and Configuration Guide which I rather scanned than read thoroughly. That's probably why I missed the Quick Start Guide. The section on pre-installation is a bit confusing as I haven't noticed that the installation script is actually capable of installing the necessary software. The same is true for the Quick Start Installation Guide for Linux.

Just as in this issue I have also overlooked the dependencies for Canvas5 and jQWidgets.

During the automatic installation process I had to install openssh_server before being able to use to the script.

After installation, adding the dependencies was a bit troublesome as I had to figure out that django needs to be told to reload dependencies from the static folder and this reloading is not included in the start routine as described in the Administration Guide for Linux. I used python manage.py collectstatic to reload the static files which worked fine. I also had to move style.css from staticfiles/theme to staticfiles/theme/css. When downloaded from Themeforest, Canvas5 has style.css not in the css folder.

I would suggest to add a paragraph to the installation guide explaining how the dependencies can be added, maybe also provide a script which can pick them up and copy them in place.

Hello,

I am trying to create the docker install of the system, and that doesn't seem to be working. I got some of the stuff working, however, the bundle doesnt seem to have access to contraxsuite-frontend-demo.tar.gz which we can use for the front end.

Can you please give me access to the same ? I am hoping the front end is a part of the opensource. I am trying to install 1.1.3

Thanks,
Alok

Fixed, error was with jqwidgets archive

If I have a successful installation of release 1.0.3, what would the best approach in updating it to the latest 1.0.4 release?
Or every release is expecting a fresh installation?
Given you have a monthly release this become an administrative task to be planned even for testing out features in ContraxSuite.

Also I may have overlooked but don't seem to find any manual on the web frontend in any of the documentation folder? Not even the most basic one?

Thanks for making an OS effort in this area.

I successfully installed contraxsuite, but i read about the new UI, which seems to me much more helpful regarding categorization within documents. Is there a way to get this new UI or isn't it part of the open-source project?

While trying to run the notebook notebook-examples/document_model_tutorial.ipynb I am geting this error in the 5th cell

NameError Traceback (most recent call last)
in ()
1 # Iterate and print
----> 2 for d in Document.objects.all()[0:10]:
3 print(d)

NameError: name 'Document' is not defined

Also the Document name is not resolved in the main code.

This may have been a slight stress test, but after loading the documents, I did the following:

1. Document->Text Units->Text Unit List
2. Filtered on "liability" and then found a limitation of liability clause
3. Classify Text Unit - > Class Name = "Limitation of Liability" and Class Value = "limitation" (the documentation doesn't state the significance of these variables so I was guessing)
4. Admin Tasks - > Analyze - > Classify Text Unit (selecting "Limitation of Liability")

The task errored out (as it should) with a "ValueError: Cannot have number of splits n_splits=3 greater than number of samples: 1"

However, now the admin task list is empty. When I add a new task (which runs per celery.log), the admin task list remains empty.

I tried to load documents and am now getting the task as "Pending." Here was the error:

`Unable to fetch logs from ElasticSearch:
Traceback (most recent call last):
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/connection.py", line 141, in _new_conn
(self.host, self.port), self.timeout, **extra_kw)
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/util/connection.py", line 83, in create_connection
raise err
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/contraxsuite_services/venv/lib/python3.6/site-packages/elasticsearch/connection/http_urllib3.py", line 147, in perform_request
response = self.pool.urlopen(method, url, body, retries=False, headers=self.headers, **kw)
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 639, in urlopen
_stacktrace=sys.exc_info()[2])
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/util/retry.py", line 333, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/packages/six.py", line 686, in reraise
raise value
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 601, in urlopen
chunked=chunked)
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/connectionpool.py", line 357, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/usr/lib/python3.6/http/client.py", line 1239, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
self.send(msg)
File "/usr/lib/python3.6/http/client.py", line 964, in send
self.connect()
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/connection.py", line 166, in connect
conn = self._new_conn()
File "/contraxsuite_services/venv/lib/python3.6/site-packages/urllib3/connection.py", line 150, in _new_conn
self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "./apps/task/models.py", line 218, in get_task_log_from_elasticsearch
body=es_query)
File "/contraxsuite_services/venv/lib/python3.6/site-packages/elasticsearch/client/utils.py", line 76, in _wrapped
return func(*args, params=params, **kwargs)
File "/contraxsuite_services/venv/lib/python3.6/site-packages/elasticsearch/client/init.py", line 636, in search
doc_type, '_search'), params=params, body=body)
File "/contraxsuite_services/venv/lib/python3.6/site-packages/elasticsearch/transport.py", line 314, in perform_request
status, headers, data = connection.perform_request(method, url, params, body, headers=headers, ignore=ignore, timeout=timeout)
File "/contraxsuite_services/venv/lib/python3.6/site-packages/elasticsearch/connection/http_urllib3.py", line 156, in perform_request
raise ConnectionError('N/A', str(e), e)
elasticsearch.exceptions.ConnectionError: ConnectionError(: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(: Failed to establish a new connection: [Errno 111] Connection refused)`

Purging the task leads to a crash of contraxtsuite. Is there another way to purge that task?

Hi All,

Has anyone been able to get the Contraxsuite docker swarm up and running?

Also does the text-extraction-system stack need to be run alongside the Contraxsuite stack? I ask as the nginx external conf references /text_extraction_system and proxy_pass http://tes-web-api:8000; but there is no call for this services within the any of the docker templates.

Thank You

When trying to run Locate, I get the following error:

`NFO 2018-02-14 15:34:15,262 | Start task "Locate", id=24
INFO 2018-02-14 15:34:15,270 | Deleted 0 UrlUsage objects
INFO 2018-02-14 15:34:15,274 | Deleted 0 TextUnitTag(tag=url)
INFO 2018-02-14 15:34:15,277 | Deleted 0 DateDurationUsage objects
INFO 2018-02-14 15:34:15,280 | Deleted 0 TextUnitTag(tag=duration)
INFO 2018-02-14 15:34:15,282 | Deleted 0 CourtUsage objects
INFO 2018-02-14 15:34:15,285 | Deleted 0 TextUnitTag(tag=court)
INFO 2018-02-14 15:34:15,288 | Deleted 0 CopyrightUsage objects
INFO 2018-02-14 15:34:15,290 | Deleted 0 TextUnitTag(tag=copyright)
INFO 2018-02-14 15:34:15,293 | Deleted 0 DefinitionUsage objects
INFO 2018-02-14 15:34:15,296 | Deleted 0 TextUnitTag(tag=definition)
INFO 2018-02-14 15:34:15,298 | Deleted 0 RatioUsage objects
INFO 2018-02-14 15:34:15,301 | Deleted 0 TextUnitTag(tag=ratio)
INFO 2018-02-14 15:34:15,304 | Deleted 0 CurrencyUsage objects
INFO 2018-02-14 15:34:15,306 | Deleted 0 TextUnitTag(tag=currency)
INFO 2018-02-14 15:34:15,309 | Deleted 0 PartyUsage objects
INFO 2018-02-14 15:34:15,311 | Deleted 0 TextUnitTag(tag=party)
INFO 2018-02-14 15:34:15,314 | Deleted 0 DateUsage objects
INFO 2018-02-14 15:34:15,317 | Deleted 0 TextUnitTag(tag=date)
INFO 2018-02-14 15:34:15,320 | Deleted 0 TrademarkUsage objects
INFO 2018-02-14 15:34:15,324 | Deleted 0 TextUnitTag(tag=trademark)
INFO 2018-02-14 15:34:15,327 | Deleted 0 DistanceUsage objects
INFO 2018-02-14 15:34:15,330 | Deleted 0 TextUnitTag(tag=distance)
INFO 2018-02-14 15:34:15,332 | Deleted 0 PercentUsage objects
INFO 2018-02-14 15:34:15,335 | Deleted 0 TextUnitTag(tag=percent)
INFO 2018-02-14 15:34:15,338 | Deleted 0 AmountUsage objects
INFO 2018-02-14 15:34:15,340 | Deleted 0 TextUnitTag(tag=amount)
INFO 2018-02-14 15:34:15,343 | Deleted 0 GeoEntityUsage objects
INFO 2018-02-14 15:34:15,345 | Deleted 0 GeoAliasUsage objects
INFO 2018-02-14 15:34:15,348 | Deleted 0 TextUnitTag(tag=geoentity)
INFO 2018-02-14 15:34:15,351 | Deleted 0 CitationUsage objects
INFO 2018-02-14 15:34:15,354 | Deleted 0 TextUnitTag(tag=citation)
INFO 2018-02-14 15:34:15,356 | Deleted 0 RegulationUsage objects
INFO 2018-02-14 15:34:15,359 | Deleted 0 TextUnitTag(tag=regulation)
INFO 2018-02-14 15:34:15,362 | Deleted 0 TermUsage objects
INFO 2018-02-14 15:34:15,365 | Deleted 0 TextUnitTag(tag=term)
INFO 2018-02-14 15:34:23,614 | Run location of [url; duration; court; definition; ratio; distance; party; date; trademark; copyright; percent; amount; geoentity; currency; citation; regulation; term].
INFO 2018-02-14 15:34:23,617 | Locate in [paragraphs and sentences].
INFO 2018-02-14 15:34:23,629 | Found 39238 Text Units. Added 39238 subtasks.
ERROR 2018-02-14 15:35:09,604 | ERROR
ERROR 2018-02-14 15:35:09,638 | OperationalError: [Errno 111] Connection refused
ERROR 2018-02-14 15:35:09,640 | Traceback (most recent call last):
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 494, in _ensured
return fun(*args, **kwargs)
File "/opt/ve/lib/python3.5/site-packages/kombu/messaging.py", line 203, in _publish
mandatory=mandatory, immediate=immediate,
File "/opt/ve/lib/python3.5/site-packages/amqp/channel.py", line 1734, in _basic_publish
(0, exchange, routing_key, mandatory, immediate), msg
File "/opt/ve/lib/python3.5/site-packages/amqp/abstract_channel.py", line 50, in send_method
conn.frame_writer(1, self.channel_id, sig, args, content)
File "/opt/ve/lib/python3.5/site-packages/amqp/method_framing.py", line 166, in write_frame
write(view[:offset])
File "/opt/ve/lib/python3.5/site-packages/amqp/transport.py", line 258, in write
self._write(s)
ConnectionResetError: [Errno 104] Connection reset by peer

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 414, in _reraise_as_library_errors
yield
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 515, in _ensured
reraise_as_library_errors=False,
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 405, in ensure_connection
callback)
File "/opt/ve/lib/python3.5/site-packages/kombu/utils/functional.py", line 333, in retry_over_time
return fun(*args, **kwargs)
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 261, in connect
return self.connection
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 802, in connection
self._connection = self._establish_connection()
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 757, in _establish_connection
conn = self.transport.establish_connection()
File "/opt/ve/lib/python3.5/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection
conn.connect()
File "/opt/ve/lib/python3.5/site-packages/amqp/connection.py", line 282, in connect
self.transport.connect()
File "/opt/ve/lib/python3.5/site-packages/amqp/transport.py", line 109, in connect
self._connect(self.host, self.port, self.connect_timeout)
File "/opt/ve/lib/python3.5/site-packages/amqp/transport.py", line 150, in _connect
self.sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/task/tasks.py", line 210, in run
self.process(**kwargs)
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/task/tasks.py", line 822, in process
task_id='%d_%s' % (self.task.id, fast_uuid()))
File "/opt/ve/lib/python3.5/site-packages/celery/app/task.py", line 536, in apply_async
**options
File "/opt/ve/lib/python3.5/site-packages/celery/app/base.py", line 737, in send_task
amqp.send_task_message(P, name, message, **options)
File "/opt/ve/lib/python3.5/site-packages/celery/app/amqp.py", line 554, in send_task_message
**properties
File "/opt/ve/lib/python3.5/site-packages/kombu/messaging.py", line 181, in publish
exchange_name, declare,
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 527, in _ensured
errback and errback(exc, 0)
File "/usr/lib/python3.5/contextlib.py", line 77, in exit
self.gen.throw(type, value, traceback)
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 419, in _reraise_as_library_errors
sys.exc_info()[2])
File "/opt/ve/lib/python3.5/site-packages/vine/five.py", line 178, in reraise
raise value.with_traceback(tb)
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 414, in _reraise_as_library_errors
yield
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 515, in _ensured
reraise_as_library_errors=False,
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 405, in ensure_connection
callback)
File "/opt/ve/lib/python3.5/site-packages/kombu/utils/functional.py", line 333, in retry_over_time
return fun(*args, **kwargs)
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 261, in connect
return self.connection
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 802, in connection
self._connection = self._establish_connection()
File "/opt/ve/lib/python3.5/site-packages/kombu/connection.py", line 757, in _establish_connection
conn = self.transport.establish_connection()
File "/opt/ve/lib/python3.5/site-packages/kombu/transport/pyamqp.py", line 130, in establish_connection
conn.connect()
File "/opt/ve/lib/python3.5/site-packages/amqp/connection.py", line 282, in connect
self.transport.connect()
File "/opt/ve/lib/python3.5/site-packages/amqp/transport.py", line 109, in connect
self._connect(self.host, self.port, self.connect_timeout)
File "/opt/ve/lib/python3.5/site-packages/amqp/transport.py", line 150, in _connect
self.sock.connect(sa)
kombu.exceptions.OperationalError: [Errno 111] Connection refused

INFO 2018-02-14 15:35:09,646 | End of main task "Locate", id=24
INFO 2018-02-14 15:35:09,654 | There are 39001 uncompleted subtasks remaining. Please wait.`

Our contractor has faced issues with the ContraxSuite live url: whilst all links below the localhost url are working, when configured below localhost url with nginx then all links below the live url are broken and not working correctly - except for /jupyter url.

We have followed all docs of ContraxSuite to fix live url issues. but are still not able to fix issues.

Localhost url:
http://localhost:8888
http://localhost:65080/advanced/
http://localhost:65080/api/
http://localhost:65080/rest-auth/
http://localhost:5601

live url:
https://contraxsuite.logicontract.com.au/ (not working)
https://contraxsuite.logicontract.com.au/jupyter (working) (password= Administrator )
https://contraxsuite.logicontract.com.au/advanced (not working)
https://contraxsuite.logicontract.com.au/api (not working)
https://contraxsuite.logicontract.com.au/rest-auth (not working)
https://contraxsuite.logicontract.com.au/kibana (not working)

Hey! I was able to run the solution and upload files but I couldnt find the exact way how to train the model and extract the terms or use cases of this product. Any help would be really appreciated.

Ran the admin task to load common legal terms and got this error:

INFO 2018-01-15 18:03:51,325 | Parse "https://raw.githubusercontent.com/LexPredict/lexpredict-legal-dictionary/1.0.5/en/legal/common_law_top1000.csv"
ERROR 2018-01-15 18:03:51,387 | ERROR
ERROR 2018-01-15 18:03:51,393 | HTTPError: HTTP Error 404: Not Found
ERROR 2018-01-15 18:03:51,395 | Traceback (most recent call last):
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/task/tasks.py", line 208, in run
self.process(**kwargs)
File "/opt/lexpredict-contraxsuite/contraxsuite_services/apps/task/tasks.py", line 469, in process
data = pd.read_csv(path)
File "/opt/ve/lib/python3.5/site-packages/pandas/io/parsers.py", line 705, in parser_f
return _read(filepath_or_buffer, kwds)
File "/opt/ve/lib/python3.5/site-packages/pandas/io/parsers.py", line 429, in _read
filepath_or_buffer, encoding, compression)
File "/opt/ve/lib/python3.5/site-packages/pandas/io/common.py", line 190, in get_filepath_or_buffer
req = _urlopen(filepath_or_buffer)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found

INFO 2018-01-15 18:03:51,399 | End of main task "Load Terms", id=3
INFO 2018-01-15 18:03:51,401 | There are 1 uncompleted subtasks remaining. Please wait.

the error

Traceback (most recent call last):
File "C:/Users/Fa/Desktop/test1.py", line 2, in
from docx import Document
ModuleNotFoundError: No module named 'docx'

the code ::

import datetime
from docx import Document

def create_shift_schedule(start_date, end_date, employees):
"""
Creates a table in Word with the automatically redistributed shifts.

Args:
start_date: The start date of the schedule.
end_date: The end date of the schedule.
employees: A list of employee names.

Returns:
A table in Word with the automatically redistributed shifts.
"""

Create a list of dates.

dates = []
for day in range(datetime.date.fromisoformat(start_date), datetime.date.fromisoformat(end_date) + 1):
dates.append(day)

Create a Word document.

doc = Document()

Create a table in the Word document.

table = doc.add_table(rows=len(dates), cols=len(employees) + 1)

Populate the table with the dates and employee names.

for i, date in enumerate(dates):
for j, employee in enumerate(employees):
table.cell(i, j).text = date
table.cell(i, j + 1).text = employee

Get the list of employees on vacation.

vacation_employees = []
for employee in employees:
if employee in vacation_employees:
continue
vacation_start_date = input("Enter the start date of the employee's vacation (YYYY-MM-DD): ")
vacation_end_date = input("Enter the end date of the employee's vacation (YYYY-MM-DD): ")
vacation_employees.append((employee, vacation_start_date, vacation_end_date))

Exclude employees on vacation from the shift schedule.

for employee, vacation_start_date, vacation_end_date in vacation_employees:
for i in range(len(dates)):
if dates[i] >= vacation_start_date and dates[i] <= vacation_end_date:
table.cell(i, j + 1).text = ""

Save the Word document.

doc.save("shift_schedule.docx")

if name == "main":

Get the start and end dates from the user.

start_date = input("Enter the start date (YYYY-MM-DD): ")
end_date = input("Enter the end date (YYYY-MM-DD): ")

Get the list of employee names from the user.

employees = input("Enter the list of employee names (separated by commas): ").split(",")

Create the shift schedule.

create_shift_schedule(start_date, end_date, employees)

Referring to issues #37 and #35 , it appears the frontend artifact is not included in the release. Also, no documentation were found which would mention any workarounds to make the application work.

I spent today setting up an instance of ContraxSuite in a VM and I must admit that the documentation appears a bit patchy and the collection of PDF files is slightly confusing at times. Maybe it's worth considering to use some web-based documentation such as readthedocs, Gitbook or the Github Wiki? Maybe that's something I could contribute to.

I have recently installed Contraxsuite with manual installation. I want to use notebook example codes for sample documents. I put some sample documents in following directory,
"anaconda3/lib/python3.6/site-packages/django/apps/lexpredict-contraxsuite/contraxsuite_services/media/data/documents"

My code is following,

> import os
> import sys
> import pandas
> import matplotlib.pyplot as plt

> sys.path.append("/home/takken/anaconda3/lib/python3.6/site-packages/django/apps/lexpredict-contraxsuite/")

> import django
> from django.db import IntegrityError
> os.environ['DJANGO_SETTINGS_MODULE'] = 'django.apps.lexpredict-contraxsuite.contraxsuite_services.settings'
> django.setup()

> import nltk
> from apps.document import *
> from apps.task.utils.nlp import *
> from apps.task.utils.text import *
> from apps.task.tasks import normalize, stem_tokens, stemmer
> 
> for d in Document.objects.all()[0:10]:
>     print(d)

when i run the code, following error happens,

NameError Traceback (most recent call last)
in ()
18 from apps.task.tasks import normalize, stem_tokens, stemmer
19
---> 20 for d in Document.objects.all()[0:10]:
21 print(d)

NameError: name 'Document' is not defined'

Is there any mistake in importing documents? or the procedure is not correct?