日本語

RE:SEARCHER is a personal search engine for your bookmarks.

Search title, every word of content, excerpt, and url of bookmarks powered by Elasticsearch. Search box accepts Elasticsearch search_query, for example a AND b, "Quick Brown Fox", abc*efg, site:github.com, bookmarkedAt:[2021-10 TO 2021-11].

Query string query | Elasticsearch Guide [7.15] | Elastic

Automatically guessing the language of the content, indexing with each language analyzer. Currently supports English, German, Japanese, Korean, and Chinese. Others are analyzed as Elasticsearch default.

Your bookmarks will be saved to your local machine. No cloud services.

Easy to bookmark from browser toolbar. Import bookmarks from your browser's bookmarks, exported bookmark html, textarea.

Only content body of webpage will be extracted as much as possible thanks to mozilla/readability. Also, you can read articles with simple and fast page view without visiting website.

Codes in content are automatically detected and highlighted with highlightjs/highlight.js.

Switch the results UI - Search engine like view, with OGP(Open Graph Protocol) image, simple favicon and title view, tiled card style.

Bookmarks marked as "Read Later" will be pinned on the top of Home. Also, you can easily find articles by the query isReadLater:true or pushpin icon on sidebar menu.

5 stars rank of each bookmark to filter and weight search results.

Filter video bookmarks from sidebar. Official video player will be embedded on view page. Currently supports only YouTube.

Firefox Addon Page

You need to install webextension to browser and Elasticsearch as a search backend.

https://github.com/andots/researcher-docker

git clone https://github.com/andots/researcher-docker
# build & start
docker compose -p researcher up --build
# start
docker compose -p researcher up

1. Install Elasticsearch ver. 7.10.1
2. Install Elasticsearch Plugins
3. Save sudachi.json to config/sudachi/sudachi.json
4. Start Elasticsearch
5. Create indices from our browser extension
6. (Optional) Install Kibana

Please see How to setup for Windows 10.

Currently we only support Elasticsearch ver. 7.10.1 for our search backend because of the plugins' dependencies. Please make sure your Elasticsearch version is 7.10.1.

Download Elasticsearch for your platform from the official.

https://www.elastic.co/downloads/past-releases/elasticsearch-7-10-1

Decompress the file and locate to e.g. /usr/share/elasticsearch.

Copy docs/bash/researcher_setup.sh in a root folder of Elasticsearch, then execute it.

And save sudachi.json to config/sudachi/sudachi.json.

cd path_to_your_elasticsearch

bin/elasticsearch-plugin install https://github.com/WorksApplications/elasticsearch-sudachi/releases/download/v2.1.0/analysis-sudachi-7.10.1-2.1.0.zip
bin/elasticsearch-plugin install analysis-smartcn
bin/elasticsearch-plugin install analysis-nori

mkdir -p config/sudachi
curl -Lo sudachi-dictionary-20210802-full.zip http://sudachi.s3-website-ap-northeast-1.amazonaws.com/sudachidict/sudachi-dictionary-20210802-full.zip
unzip sudachi-dictionary-20210802-full.zip
mv sudachi-dictionary-20210802/system_full.dic config/sudachi/system_core.dic
rm -rf sudachi-dictionary-20210802-full.zip sudachi-dictionary-20210802/

curl -LO https://raw.githubusercontent.com/uschindler/german-decompounder/master/de_DR.xml
curl -LO https://raw.githubusercontent.com/uschindler/german-decompounder/master/dictionary-de.txt
mkdir -p config/analysis/de
mv de_DR.xml config/analysis/de
mv dictionary-de.txt config/analysis/de

touch config/sudachi/sudachi.json

{
  "systemDict": "system_core.dic",
  "inputTextPlugin": [
    { "class": "com.worksap.nlp.sudachi.DefaultInputTextPlugin" },
    {
      "class": "com.worksap.nlp.sudachi.ProlongedSoundMarkInputTextPlugin",
      "prolongedSoundMarks": ["ー", "-", "⁓", "〜", "〰"],
      "replacementSymbol": "ー"
    }
  ],
  "oovProviderPlugin": [
    { "class": "com.worksap.nlp.sudachi.MeCabOovProviderPlugin" },
    {
      "class": "com.worksap.nlp.sudachi.SimpleOovProviderPlugin",
      "oovPOS": ["補助記号", "一般", "*", "*", "*", "*"],
      "leftId": 5968,
      "rightId": 5968,
      "cost": 3857
    }
  ],
  "pathRewritePlugin": [
    { "class": "com.worksap.nlp.sudachi.JoinNumericPlugin", "joinKanjiNumeric": true },
    {
      "class": "com.worksap.nlp.sudachi.JoinKatakanaOovPlugin",
      "oovPOS": ["名詞", "普通名詞", "一般", "*", "*", "*"],
      "minLength": 3
    }
  ]
}

Execute bin/elasticsearch to start Elasticsearch.

Please see the official document to find more information.

Install Elasticsearch from archive on Linux or MacOS | Elasticsearch Guide [7.15] | Elastic

Finally, create indices for RE:SEARCHER from our browser extension. Open app and click the button "CREATE INDICES".

If you need Kibana, downalod it from the the below. The version of Elasticsearch and Kibana must be the same.

https://www.elastic.co/downloads/past-releases/kibana-7-10-1

npm install -g pnpm
pnpm install
pnpm dev

Then load extension in browser with the extension/ folder,

To build the extension, run

pnpm build

And then pack files under extension.