Dense Passage Retrieval models for the Scandinavian languages.
Link to original Dense Passage Retrieval paper.
Developers:
- Dan Saattrup Nielsen ([email protected])
- Run
make install
, which installs Poetry (if it isn't already installed), sets up a virtual environment and all Python dependencies therein. - Run
source .venv/bin/activate
to activate the virtual environment.
To install new PyPI packages, run:
$ poetry add <package-name>
Simply write make
to display a list of the commands available. This includes the
above-mentioned make install
command, as well as building and viewing documentation,
publishing the code as a package and more.
- Poetry: Dependency management
- hydra: Manage configuration files
- pre-commit plugins: Automate code reviewing formatting
- pdoc: Automatically create an API documentation for your project
.
├── .github
│ └── workflows
│ ├── ci.yaml
│ └── docs.yaml
├── .gitignore
├── .pre-commit-config.yaml
├── CHANGELOG.md
├── CODE_OF_CONDUCT.md
├── CONTRIBUTING.md
├── LICENSE
├── README.md
├── config
│ ├── __init__.py
│ ├── config.yaml
│ └── hydra
│ └── job_logging
│ └── custom.yaml
├── makefile
├── models
├── poetry.toml
├── pyproject.toml
├── src
│ ├── scandi_dpr
│ │ ├── __init__.py
│ │ ├── data.py
│ │ ├── data_collator.py
│ │ ├── evaluate.py
│ │ ├── loss.py
│ │ ├── model.py
│ │ ├── tokenization.py
│ │ ├── train.py
│ │ └── utils.py
│ └── scripts
│ ├── fix_dot_env_file.py
│ ├── train_model.py
│ └── versioning.py
└── tests
├── __init__.py
└── test_dummy.py