For inital background information about this project please refer to the Request for Proposals.
$ git clone [email protected]:hbz/oerworldmap.git
$ cp conf/application.example.conf conf/application.conf
$ cd third-party
$ wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.2.1.zip
$ unzip elasticsearch-6.2.1.zip
$ cd elasticsearch-6.2.1
$ bin/elasticsearch-plugin install analysis-icu
$ bin/elasticsearch
Check with curl -X GET http://localhost:9200/ if all is well.
Optionally, you may want to use the head plugin. This basically comes down to
$ cd .. # back to oerworldmap/third-party or choose any directory outside this project
$ git clone git://github.com/mobz/elasticsearch-head.git
$ cd elasticsearch-head
$ npm install
$ npm run start
$ open http://localhost:9100/
If you are in an environment where your instance of elasticsearch won't be the only one on the network, you might want
to configure your cluster name to be different from the default elasticsearch. To do so, shut down elasticsearch and
edit cluster.name in third-party/elasticsearch-2.4.1/config/elasticsearch.yml and es.cluster.name
in conf/application.conf before restarting.
# from oerworldmap/ run
$ curl -H "Content-type: application/json" -X PUT http://localhost:9200/oerworldmap/ -d @conf/index-config.json
If you're caught with some kind of buggy index during development, simply delete the index and re-create:
$ curl -X DELETE http://localhost:9200/oerworldmap/
$ curl -X PUT http://localhost:9200/oerworldmap/ -d @conf/index-config.json
Download Keycloak 4.8.3:
$ curl https://downloads.jboss.org/keycloak/4.8.3.Final/keycloak-4.8.3.Final.tar.gz | tar xvz
Modify standalone/configuration/standalone.xml file and add the proxy-address-forwarding="true" attribute to <http-listener> element under <server>
Create the admin user:
$ bin/add-user-keycloak.sh -u admin
Start the server:
$ bin/standalone.sh -Dkeycloak.profile.feature.scripts=enabled
Next, login in to the admin UI at http://localhost:8080/auth/ and complete the following steps:
- Create a realm called oerworldmap
- Enable "User registration", "Email as username", "Forgot password" and "Login with email" in the "Realm Settings > Login" section
- If you want to enable Email verification, configure an SMTP server in the "Realm Settings > Email" section
- Install & configure theme from https://github.com/hbz/oerworldmap-keycloak-theme:
cd themes && git clone [email protected]:hbz/oerworldmap-keycloak-theme.git- Set
oerworldmap-keycloak-themeas "Login Theme", "Account Theme" and "Email Theme" in the "Realm Settings > Themes" section
- For ReCaptcha support, configure "Realm Settings > Security Defenses":
SAMEORIGIN; ALLOW-FROM https://www.google.comas X-Frame-Optionsframe-src 'self' https://www.google.com; frame-ancestors 'self'; object-src 'none';as Content-Security-Policy
- Select the "account" client ID in the "Clients" section and as follows:
- Set
/*as "Valid Redirect URIs" and set/.loginas the Base URL in the "Settings" section - Set up Mappers for profile_id and groups in the "Mappers" section
- Set
- Copy the client secret from the "Clients > account > Credentials" section to
conf/vhost.conf(line 14) - In the "Authentication > Flows" section, copy the "Registration" flow and name it "Registration with Validation and Newsletter":
- Click "Add Execution", select "Script" from the "Provider" drop down and hit save, the new script will show up at the bottom of the table
- Set it to "REQUIRED" and select "Config" from the "Actions drop down"
- Set the "Alias" to "Validate custom attributes"
- Copy the script provided in
scripts/keycloakValidateCustomAttributes.jsto "Script Source" - Click "Add Execution", select "Script" from the "Provider" drop down and hit save, the new script will show up at the bottom of the table
- Set it to "REQUIRED" and select "Config" from the "Actions drop down"
- Set the "Alias" to "Subscribe newsletter"
- Copy the script provided in
scripts/keycloakRegisterNewsletter.jsto "Script Source"
- Finally, configure the Keykloak connection in the APIs
conf/application.conf:- keycloak.realm="oerworldmap"
- keycloak.username="YOUR_KEYCLOAK_ADMIN_USER"
- keycloak.password="YOUR_KEYCLOAK_ADMIN_PASSWORD"
- keycloak.client="admin-cli"
Install mod_auth_openidc, if not on a supported system build from source:
$ git clone https://github.com/zmartzone/mod_auth_openidc.git
$ cd mod_auth_openidc
$ ./autogen.sh
$ zypper in apache2-devel
$ zypper in libcurl-devel
$ wget http://mirror.centos.org/centos/7/os/x86_64/Packages/jansson-2.10-1.el7.x86_64.rpm
$ rpm -i jansson-2.10-1.el7.x86_64.rpm
$ wget http://mirror.centos.org/centos/7/os/x86_64/Packages/jansson-devel-2.10-1.el7.x86_64.rpm
$ rpm -i jansson-devel-2.10-1.el7.x86_64.rpm
$ ln -s /lib64/libcrypto.so.1.0.0 /usr/lib64/libcrypto.so.10
$ wget https://mod-auth-openidc.org/download/cjose-0.5.1-1.el7.centos.x86_64.rpm
$ rpm -iv cjose-0.5.1-1.el7.centos.x86_64.rpm --nodeps
$ zypper in pcre-devel
$ ./configure --with-apxs2=/usr/bin/apxs2
$ make
$ make install
$ a2enmod auth_openidc
$ sudo apt-get install apache2 libapache2-mod-auth-openidc
$ sudo a2enmod proxy proxy_html proxy_http rewrite auth_openidc ssl headers
$ mkdir data/auth
$ cd data/auth
$ touch htpasswd htgroups htprofiles
Edit sudo visudo and add permission to the user
username ALL = NOPASSWD: /usr/sbin/apache2ctl
Configure variables for conf/vhost.conf
Define PUBLIC_HOST oerworldmap.localhost
Define PUBLIC_PORT 80
Define PUBLIC_EMAIL [email protected]
Define AUTH_DIR /home/fo/local/src/oerworldmap/data
Define API_HOST http://localhost:9000
Define UI_HOST http://localhost:3000
Define KIBANA_HOST http://localhost:5601
Define PAGES_HOST http://localhost:4000
#Define SSL_CIPHER_SUITE
#Define SSL_CERT_FILE
#Define SSL_CERT_KEY_FILE
#Define SSL_CERT_CHAIN_FILE
Enable the site
$ sudo ln -s /home/username/oerworldmap/conf/vhost.conf /etc/apache2/sites-available/oerworldmap.conf
$ sudo a2ensite oerworldmap.conf
$ sudo apache2ctl graceful
Modify the path in data/permissions/.system
AuthUserFile /home/username/oerworldmap/data/auth/htpasswd
AuthGroupFile /home/username/oerworldmap/data/auth/htgroups
Set up the hostname in /etc/hosts
127.0.0.1 localhost oerworldmap.local
$ mkdir -p data/consents/objects
$ touch data/consents/history
$ mkdir -p data/commits/objects/
$ touch data/commits/history
Download sbt (version 0.13.11), then
$ sbt clean stage; sbt run
If you are running bintray packages, make sure to install correct version:
$ sudo apt-get install sbt=0.13.11
UI Components are available at https://github.com/hbz/oerworldmap-ui
- copy
scripts/services/services.example.conftoscripts/services/services.confand update vars - copy
scripts/services/*.serviceto/etc/systemd/systemand updateEnvironmentFile,UserandGroupin each service - run
sudo systemctl daemon-reload
Using activator, integration to Eclipse and IDEA IntelliJ is provided by running eclipse or idea from within activator. To run the OER World Map JUnit tests inside IntelliJ, it is necessary to set the test's working directory to the root directory of this project (i. e. oerworldmap):
Run | Edit configurations... | JUnit | <MyTest> | Configuration | Working directory:
<absolute/path/to/oerworldmap>
[ERROR] Failed to construct terminal; falling back to unsupported java.lang.NumberFormatException: For input string: "0x100"
Workaround for this is to export correct xterm (put it in your .bashrc or similar):
export TERM=xterm-color
[info] Loading project definition from /home/vagrant/oerworldmap/project java.lang.NullPointerException
Make sure your sbt is correct version (0.13.11).
org.elasticsearch.ElasticsearchException: Unable to find a field mapper for field [link_count]. No 'missing' value defined. at org.elasticsearch.index.query.functionscore.FieldValueFactorFunctionBuilder.doToFunction(FieldValueFactorFunctionBuilder.java:151) ~[elasticsearch-6.2.1.jar:6.2.1]
Make sure that when you create and configure oerworldmap index, you do it from oerworldmap/ folder.
# Reset elasticsearch index
curl -X DELETE http://localhost:9200/oerworldmap/
curl -H "Content-type: application/json" -X PUT http://localhost:9200/oerworldmap/ -d @conf/index-config.json
# Delete triple store
rm data/tdb/*
# Delete history
rm -r data/commits/
# Extract history from archive
tar -xzf commits.tar.gz -C data/
Afterwards, restart sbt and wait until it fully rebuilds triplestore and Elastic Search index. Once it's done, you can check if it's working correctly by running:
curl localhost:9000/resource.json
When updating vocabulary definitions, you need to update triple store by running:
(example for publications.json)
curl -H "Content-type: application/json" http://localhost:9000/import/ -d @src/json/publications.json
Indent blocks by two spaces and wrap lines at 100 characters. For more details, refer to the Google Java Style Guide.
Please file bugs as an issue labeled "Bug" here. Include browser information and screenshot(s) when applicable.
This product includes GeoLite2 data created by MaxMind, available from http://www.maxmind.com.
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot]")
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent