zesch / pydkpro Goto Github PK

It should be possible to also have Python-based components and mix them with DKPro processing.

The activation should be directly after virtualenv and seperate after conda.

Creating virtual environment

Install virtualenv if not already installed.

$ python -m pip install virtualenv
Create virtual environment. Replace [env_name] with a name of your choice.

$ mkdir [env_name]

$ virtualenv -p python3 [env_name]

or

$ python3 -m venv [env_name]

Activate created virtual environment.

For Windows:

$ [env_name]Scriptsactivate.bat

For Linux and Mac OS:

$ source [env_name]/bin/activate



Creating virtual environment using conda

Create virtual environment with conda. Replace [env_name] with a name of your choice.

$ conda create --name [env_name] python=3.6

To activate the environment (on Windows, MacOS and Unix),

$ conda activate [env_name]

When trying to run the examples notebook, I get this error:

---------------------------------------------------------------------------
OSError                                   Traceback (most recent call last)
<ipython-input-10-f26cb6887958> in <module>
----> 1 for token in To_spacy(cas)():
      2     print(token.text, token.tag_)

~/git/pydkpro/pydkpro/external.py in __call__(self)
     11 
     12     def __call__(self):
---> 13         nlp = spacy.load("en_core_web_sm")
     14         text = 'Backgammon is one of the oldest known board games.'
     15         doc = nlp(text)

~/git/pydkpro/venv/lib/python3.7/site-packages/spacy/__init__.py in load(name, **overrides)
     28     if depr_path not in (True, False, None):
     29         deprecation_warning(Warnings.W001.format(path=depr_path))
---> 30     return util.load_model(name, **overrides)
     31 
     32 

~/git/pydkpro/venv/lib/python3.7/site-packages/spacy/util.py in load_model(name, **overrides)
    167     elif hasattr(name, "exists"):  # Path or Path-like to model data
    168         return load_model_from_path(name, **overrides)
--> 169     raise IOError(Errors.E050.format(name=name))
    170 
    171 

OSError: [E050] Can't find model 'en_core_web_sm'. It doesn't seem to be a shortcut link, a Python package or a valid path to a data directory.

It would be nice if there would be some file in the repository root which can be used to install all required Python packages with a single command (on any platform, so please not a shell script ;) ).

Also, please document how to get started, i.e.:

• how to set up a virtual environment
• how to install the dependencies
• how to open the examples notebook

IN [3]:
from pydkpro import Pipeline, Component
p = Pipeline(version="2.0.0", language='en')
p.add(Component().opennlp_segmenter())
p.add(Component().opennlp_postagger(param_tagset=True))
p.build()

ModuleNotFoundError Traceback (most recent call last)
in
----> 1 from pydkpro import Pipeline, Component
2 p = Pipeline(version="2.0.0", language='en')
3 p.add(Component().opennlp_segmenter())
4 p.add(Component().opennlp_postagger(param_tagset=True))
5 p.build()

~/PyDKPro/pydkpro-master/pydkpro/init.py in
2
3 from .cas import Cas
----> 4 from .pipeline import Pipeline, Component
5 from .typesystems import DKProCoreTypeSystem
6 from .external import From_spacy, To_spacy, From_nltk, To_nltk, File2str

~/PyDKPro/pydkpro-master/pydkpro/pipeline.py in
7 import codecs
8 from generate_basic_pipeline import build_pipeline
----> 9 from dkpro_cli import cliDefinition, killAllRunningContainers
10 import requests
11 import json

~/PyDKPro/pydkpro-master/pydkpro/dkpro_cli.py in
4
5
----> 6 import click # package for easy cli generation
7 import subprocess # package to execute the shell,
8 import re

ModuleNotFoundError: No module named 'click'

IN [3]: FileNotFoundError: [Errno 2] No such file or directory: '/Users/***/pydkpro/pydkpro-master/pydkpro/pipelines/pom.xml'

Install dependencies using pip

$ python -m pip install -r requirements.txt

ERROR: Could not open requirements file: [Errno 2] No such file or directory: 'requirements.txt'

Getting an error when trying the UseCases.ipynb

what to do to fix it?

when building container ner, this issue arised.

FileNotFoundError Traceback (most recent call last)
in
3 p.add(Component().opennlp_segmenter())
4 p.add(Component().opennlp_postagger(param_tagset=True))
----> 5 p.build()

FileNotFoundError: [Errno 2] No such file or directory: '/home/allan/GoogleDrive/00_Projekte/02_Github_repo/pydkpro_back/pydkpro/pipelines/deployment/target/docker': '/home/allan/GoogleDrive/00_Projekte/02_Github_repo/pydkpro_back/pydkpro/pipelines/deployment/target/docker'

complete error message:
error.txt

ModuleNotFoundError: No module named 'cassis'