nextcloud / fulltextsearch Goto Github PK

🔍 Core of the full-text search framework for Nextcloud

License: GNU Affero General Public License v3.0

Makefile 0.59% PHP 72.76% CSS 1.01% JavaScript 25.64%

fulltextsearch's Introduction

Full text search

Full text search is the core app of a full-text search framework for your Nextcloud. To have it operate, and get content indexed, some other apps are needed:

Some Providers Apps to extract content from your Nextcloud.
A Platform App that communicate with a search platform (ie. Elastic Search, Solr, …) in order to index the content provided by the Providers.
Note: There is no limit to the number of platform-apps that can be installed, however only one can be selected from the admin interface

Documentation

Can be found on the wiki

fulltextsearch's People

Contributors

Stargazers

Watchers

fulltextsearch's Issues

RENAME & DELETE buttons shall not be available to anonymous users

Issue found in nextant-0.10.x-0.6.912

When I use Nextant search as non-logged, anonymous user, I see RENAME and DELETE buttons.
Anonymous user shall not have these buttons.

If user tries to use them, he'll get error:
Could not rename "..."
Error deleting file "...".

indexing documents from federated cloud shares

with nextcloud10.0.1 and nextant 0.6.1 we tried to index documents from a federated cloud share... but nothing will be indexed, should that work or not - is it a planned feature?

Solarium\Exception\RuntimeException while running first indexing

I tried to run first indexing, but got the error.
Tried again and got exact same error:

root@sf-hosting:/var/www/html# sudo -u www-data ./occ nextant:index
nextant v0.6.3 (beta)

* Extracting files:
/StanM                          0/    0 [>---------------------------]   0%
+slavik/files                17601/307912 [=>--------------------------]   5%
    [extracting] Solr memory: 68.3 MB (%13.9)

  [Solarium\Exception\RuntimeException]
  Extract query file path/url invalid or not available

Where can I find Nextant log file to see details?

Here is what I found so far:

root@sf-hosting:/var/www/html/data# cat  nextcloud.log | grep nextant
{"reqId":"Cypgos8TEXsym0AJGaQU","remoteAddr":"","app":"PHP","message":"Invalid argument supplied for foreach() at \/var\/www\/html\/apps\/nextant\/lib\/Service\/IndexService.php#343","level":3,"time":"2016-11-04T05:54:41+00:00","method":"--","url":"--","user":"--"}
{"reqId":"Cypgos8TEXsym0AJGaQU","remoteAddr":"","app":"PHP","message":"Invalid argument supplied for foreach() at \/var\/www\/html\/apps\/nextant\/lib\/Command\/Index.php#244","level":3,"time":"2016-11-04T05:54:41+00:00","method":"--","url":"--","user":"--"}
{"reqId":"qhVOltZPbTBSAi0w0LUf","remoteAddr":"","app":"PHP","message":"Invalid argument supplied for foreach() at \/var\/www\/html\/apps\/nextant\/lib\/Service\/IndexService.php#343","level":3,"time":"2016-11-04T06:53:16+00:00","method":"--","url":"--","user":"--"}
{"reqId":"qhVOltZPbTBSAi0w0LUf","remoteAddr":"","app":"PHP","message":"Invalid argument supplied for foreach() at \/var\/www\/html\/apps\/nextant\/lib\/Command\/Index.php#244","level":3,"time":"2016-11-04T06:53:16+00:00","method":"--","url":"--","user":"--"}

Versions:

NextCloud: 10.0.1 (stable)	
Nextant Version: 0.6.3 (beta)

solr-spec 6.2.1
solr-impl 6.2.1 43ab70147eb494324a1410f7a9f16a896a59bc6f - shalin - 2016-09-15 05:20:53
lucene-spec 6.2.1
lucene-impl 6.2.1 43ab70147eb494324a1410f7a9f16a896a59bc6f - shalin - 2016-09-15 05:15:20

NC 10.0.1 debug issue with nextant (from nc board)

Hi, as requested the debug view:
from thread:
https://help.nextcloud.com/t/nextant-full-text-search-within-all-your-files-and-shared-documents/2954/31

that User does not have a trashbin:

martin@ubuntu-gamestore:/var/www/owncloud$ sudo ls data/dev-wa
cache  contacts  files

martin@ubuntu-gamestore:/var/www/owncloud$ sudo -u www-data ./occ nextant:index --debug --force
nextant v0.5.1 (beta)

* Extracting files to Solr:
 dev-wa/files:               15/   15 [============================] 100%
 dev-wa/files_trashbin:       0/    0 [>---------------------------]   0%

An unhandled exception has been thrown:
Error: Call to a member function getStorage() on null in /var/www/owncloud/lib/private/Files/View.php:1335
Stack trace:
#0 /var/www/owncloud/lib/private/Files/Node/HookConnector.php(144): OC\Files\View->getFileInfo('/files_external')
#1 /var/www/owncloud/lib/private/Files/Node/HookConnector.php(88): OC\Files\Node\HookConnector->getNodeForPath('/files_external')
#2 /var/www/owncloud/lib/private/legacy/hook.php(106): OC\Files\Node\HookConnector->create(Array)
#3 /var/www/owncloud/lib/private/Files/View.php(1231): OC_Hook::emit('OC_Filesystem', 'create', Array)
#4 /var/www/owncloud/lib/private/Files/View.php(1109): OC\Files\View->runHooks(Array, '/files_external')
#5 /var/www/owncloud/lib/private/Files/View.php(263): OC\Files\View->basicOperation('mkdir', '/files_external', Array)
#6 /var/www/owncloud/lib/private/Security/CertificateManager.php(104): OC\Files\View->mkdir('/files_external...')
#7 /var/www/owncloud/lib/private/Security/CertificateManager.php(207): OC\Security\CertificateManager->createCertificateBundle()
#8 /var/www/owncloud/lib/private/Http/Client/Client.php(74): OC\Security\CertificateManager->getAbsoluteBundlePath(NULL)
#9 /var/www/owncloud/lib/private/Http/Client/Client.php(136): OC\Http\Client\Client->setDefaultOptions()
#10 /var/www/owncloud/apps/federatedfilesharing/lib/DiscoveryManager.php(92): OC\Http\Client\Client->get('https://cloud.r...', Array)
#11 /var/www/owncloud/apps/federatedfilesharing/lib/DiscoveryManager.php(131): OCA\FederatedFileSharing\DiscoveryManager->discover('https://cloud.r...')
#12 /var/www/owncloud/apps/files_sharing/lib/External/Storage.php(85): OCA\FederatedFileSharing\DiscoveryManager->getWebDavEndpoint('https://cloud.r...')
#13 /var/www/owncloud/lib/private/Files/Mount/MountPoint.php(145): OCA\Files_Sharing\External\Storage->__construct(Array)
#14 /var/www/owncloud/lib/private/Files/Mount/MountPoint.php(170): OC\Files\Mount\MountPoint->createStorage()
#15 /var/www/owncloud/lib/private/Files/Config/UserMountCache.php(92): OC\Files\Mount\MountPoint->getStorage()
#16 [internal function]: OC\Files\Config\UserMountCache->OC\Files\Config\{closure}(Object(OCA\Files_Sharing\External\Mount))
#17 /var/www/owncloud/lib/private/Files/Config/UserMountCache.php(93): array_filter(Array, Object(Closure))
#18 /var/www/owncloud/lib/private/Files/Config/MountProviderCollection.php(134): OC\Files\Config\UserMountCache->registerMounts(Object(OC\User\User), Array)
#19 /var/www/owncloud/lib/private/Files/Filesystem.php(426): OC\Files\Config\MountProviderCollection->registerMounts(Object(OC\User\User), Array)
#20 /var/www/owncloud/lib/private/Files/Filesystem.php(371): OC\Files\Filesystem::initMountPoints('devzero')
#21 /var/www/owncloud/apps/nextant/lib/Command/Index.php(231): OC\Files\Filesystem::init('devzero', '')
#22 /var/www/owncloud/apps/nextant/lib/Command/Index.php(152): OCA\Nextant\Command\Index->browseUserDirectory(Object(Symfony\Component\Console\Output\ConsoleOutput), 'devzero', '/files', Array, Array)
#23 /var/www/owncloud/3rdparty/symfony/console/Command/Command.php(259): OCA\Nextant\Command\Index->execute(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#24 /var/www/owncloud/core/Command/Base.php(159): Symfony\Component\Console\Command\Command->run(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#25 /var/www/owncloud/3rdparty/symfony/console/Application.php(844): OC\Core\Command\Base->run(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#26 /var/www/owncloud/3rdparty/symfony/console/Application.php(192): Symfony\Component\Console\Application->doRunCommand(Object(OCA\Nextant\Command\Index), Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#27 /var/www/owncloud/3rdparty/symfony/console/Application.php(123): Symfony\Component\Console\Application->doRun(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#28 /var/www/owncloud/lib/private/Console/Application.php(146): Symfony\Component\Console\Application->run(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#29 /var/www/owncloud/console.php(90): OC\Console\Application->run()
#30 /var/www/owncloud/occ(11): require_once('/var/www/ownclo...')

cheers devzero

Nextant not scraping documents

Firstly my apologies if this has already been covered. I could not see a similar issue.

On a frash solr install and nextant 0.6.6 I am unable to complete a full test search

running nextant:check --info results in the following

array (
'instant' => true,
'configured' => '1',
'ping' => true,
'solr_url' => 'HIDDEN',
'solr_core' => 'HIDDEN',
'solr_timeout' => '30',
'nextant_version' => '0.6.6 (beta)',
'index_files' => '1',
'index_files_needed' => '0',
'index_files_max_size' => '40',
'index_files_tree' => '1',
'index_files_sharelink' => '1',
'index_files_external' => '0',
'index_files_encrypted' => '0',
'index_files_filters_text' => '1',
'index_files_filters_pdf' => '1',
'index_files_filters_office' => '1',
'index_files_filters_image' => '0',
'index_files_filters_audio' => '0',
'index_files_filters_extensions' => '',
'display_result' => '2',
'replace_core_search' => 0,
'current_docs' => 93199,
'current_segments' => 22,
'bookmarks_app_enabled' => false,
'index_bookmarks' => '1',
'index_bookmarks_needed' => '0',
'index_live' => '1',
'index_live_queuekey' => '540???',
'index_delay' => '2',
'index_locked' => '1479409886',
'index_files_last' => '1479339676',
'index_files_last_format' => 'Wed, 16 Nov 2016 23:41:16 +0000',
'index_bookmarks_last' => '1479339676',
'index_bookmarks_last_format' => 'Wed, 16 Nov 2016 23:41:16 +0000',
'source' => 'check',
)
Pinging 10.72.0.2:8983/solr/nextant2 : ok
Checking Solr schema fields

Checking dynamic-field 'nextant_attr_*' : ok
Checking field 'nextant_path' : ok
Checking field 'text' : ok
Checking field 'nextant_owner' : ok
Checking field 'nextant_mtime' : ok
Checking field 'nextant_share' : ok
Checking field 'nextant_sharegroup' : ok
Checking field 'nextant_deleted' : ok
Checking field 'nextant_source' : ok
Checking field 'nextant_tags' : ok
Checking field 'nextant_extracted' : ok
Checking field 'nextant_ocr' : ok
Checking field 'nextant_unmounted' : ok
Checking field-type 'text_general' : fail

Indexing Java code source using JHighlight

http://freecode.com/projects/jhighlight

However, nextant might needs to detect the presence of jhighlight first.

escape using queryhelper

Add some escape using queryhelper to the request to Solr

IndexService.php

I'm getting this every few hours.

PHP Fatal error: Call to a member function setMessage() on null in /usr/local/www/nextcloud/apps/nextant/lib/Service/IndexService.php on line 277
{"reqId":"frcLsR4fKgQLk48rP/FV","remoteAddr":"","app":"PHP","message":"Call to a member function setMessage() on null at /usr/local/www/nextcloud/apps/nextant/lib/Service/IndexService.php#277","level":3,"time":"2016-11-20T07:45:31+00:00","method":"--","url":"/nextcloud/cron.php","user":"--"}

HTML files incorrectly shown in the search results

Found while searching for random in the public share, on https://notes.propovednik.com/
The problem happens, when results contains HTML files.
That resulted in search results looking incorrect.
I'm not sure why, but it seems like Nextant tries to login to the NextCloud, so it shows controls to enter username/password.
May be security issue.

When I tried to reproduce, while logged in, then it shows NextCloud nested in NextCloud.

Enable Nextant to work for public shares

Currently, all search functionality (native or via nextant) available only for logged users.

This is the feature request for a solution, which would enable search functionality for NON-LOGGED users.

Example of the scenario (use case):
I'm sharing (publishing) folder of files, and want general public to be able to search for files in that share without them being users of my NextCloud.

Parameters for exact search

Assume I am searching for a file that contains wordA and wordB.

Searching wordA wordB returns me files that contain either wordA or wordB or both. It would be nice to be able to tell nextant that a word has to be in the results.

Google once supported + parameters. So +wordA wordB would return results with wordA definitely in the results and wordB could be there or not. I think that is not possible anymore in google but something like this would be useful in nextant. As "wordA wordB" seems to return only results that have exactly the string in the quotation marks I could imagine that "wordA" wordB would return the same result as google back in the days using +

Search suggestions shown only for logged user

Search suggestions shown only for logged user.
Would be nice, to show them, while searching in public share, too.

Search within the trash bin

Ability to search in the deleted file, if the Trashbin app is available

Make Live Index work without semaphores

Semaphores are a security risk with FreeBSD jails. It would be great if Live Index could work without it.

Auto-check configuration on upgrade

Candid question

Hi!

I run a shared instance for 100 of users, and I'm wondering if this will expose documents owned by other people?
I guess not, but it is just to make sure :)

Thanks for your work, and please close it as soon as your responded!

Non-English characters incorrectly handled in search suggestions

While testing search suggestion for public shares, I found, that they it is working correctly for Engligh characters, but show one string multiple times for russian characters.
I tested with christmas and рождество (that's christmas in russian).

Memory issues

Couldn't figure out where the log was. Your comment here helped.

Seems, the issue was with a txt file which had around 100Mb of unique entries. Apparently 1Gb of RAM is not enough for that. But that file it crashed on was not to be found within the last 10 files that were processed when using --debug. It was in the first 20 or 30 entries. It seems to me that nextant does not "forget" the processed files immediately, filling the memory more than necessary.

Forbidden Exception when ./occ nextant:scan

When attempting to nextant:scan, I get the following error:

Scanning files from 09C085BF-A7CF-450A-BB9D-EE0F6497648F (13/425)
extracted files: 0/0
Scanning files from 0A2504BA-F0DC-459D-9502-67EBC206B5CA (14/425)
extracted files: 0/0
Scanning files from 0AA217C5-5367-4D36-8393-B0E60270962A (15/425)

[OC\ForbiddenException]

nextant:scan [--output [OUTPUT]]

Is there anything I can run or try to help diagnose/debug this issue ?

A 'nextant:check' yields the following:

Ping: ok
Checking Solr schema fields

field nextant_owner: ok.

field nextant_share: ok.

field nextant_sharegroup: ok.

field nextant_deleted: ok.
Your solr contains 1086 documents

Translations

implementing l10n

Add ability to go to found file location

Currently, search results are just links, which opens (downloads) found file.
There are scenarios, when user is looking for the folder, not the file.
There are scenarios, when user is looking for the folder, where files are located.

I'm proposing to add link, which would open location (folder), not the file:

update schema using API

schema should be updated using Solr Schema API

your nextant is not configured for Live Index

sudo -u www-data /var/www/nextcloud/occ nextant:live
nextant v0 (beta)

your nextant is not configured for Live Index

How would I configure it?

Also version number is broken...

Enhancement: OCR

If it is not outside of the scope of the addon, I would like to request an OCR feature. I work with scientific papers a lot and many of the old ones are just jpegs converted to pdfs. It would be nice if those would be added a text layer if they don't have one yet.

word.doc files not recognized as changed and therefore not indexed (file extension .doc)

other types like docx are working, we tried to upload doc or change/edit doc (with documents app), but the occ nextant:index does not recognize them. how to configure nextant/solr to work with doc files too?

(nextcloud 10.0.1 + nextant 0.6 + php7 + solr 6.2.0)

Updating to the latest release leaves instance in maintenance mode

Hi,

Updating the nextant to the latest release leaves instance in maintenance mode.
I ended it up restoring the VM. To get it to work the procedure I used was to remove and install it again.

Thanks,

Supporting epub and openoffice documents

Supporting epub and openoffice documents, and more ...

Cannot parse .....

using NextCloud 10 and latest zip of nextant from github,

org.apache.solr.common.SolrException: org.apache.solr.search.SyntaxError: Cannot parse 'nextant_owner:"kb-sync" OR nextant_share:"kb-sync" OR': Encountered "" at line 1, column 53.
Was expecting one of:
...
"+" ...
"-" ...
...
"(" ...
"" ...
...
...
...
...
...
"[" ...
"{" ...
...
"filter(" ...
...
...
"" ...

at org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:218)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:154)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2089)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:652)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:459)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1092)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:518)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:244)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:246)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)

nextant:check yields:

Ping: ok
Checking Solr schema fields

Checking dynamic-field 'nextant_attr_*': ok.
Checking field 'nextant_owner': ok.
Checking field 'nextant_mtime': ok.
Checking field 'nextant_share': ok.
Checking field 'nextant_sharegroup': ok.
Checking field 'nextant_deleted': ok.
Your solr contains 593 documents

0.6.0 Update fails from GUI

Sends cloud into maintenance mode, any ideas?

Number of documents

display the number of documents already in the Solr library in the administration page

an unhandled exception has been thrown (nextant:index)

Hello,
latest nextant 0.6.5 installed from appstore
i run nextcloud as a docker instance and solr as service.
connect and test all went fine... but when i run
nextant:index
i get:

# docker exec -it nextcloud occ nextant:index
nextant v0 (beta)
An unhandled exception has been thrown:
Error: Call to undefined function OCA\Nextant\Service\msg_remove_queue() in /apps2/nextant/lib/Service/QueueService.php:67
Stack trace:
#0 /apps2/nextant/lib/Command/Index.php(183): OCA\Nextant\Service\QueueService->emptyQueue()
#1 /nextcloud/3rdparty/symfony/console/Command/Command.php(259): OCA\Nextant\Command\Index->execute(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#2 /nextcloud/core/Command/Base.php(159): Symfony\Component\Console\Command\Command->run(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#3 /nextcloud/3rdparty/symfony/console/Application.php(844): OC\Core\Command\Base->run(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#4 /nextcloud/3rdparty/symfony/console/Application.php(192): Symfony\Component\Console\Application->doRunCommand(Object(OCA\Nextant\Command\Index), Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#5 /nextcloud/3rdparty/symfony/console/Application.php(123): Symfony\Component\Console\Application->doRun(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#6 /nextcloud/lib/private/Console/Application.php(146): Symfony\Component\Console\Application->run(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#7 /nextcloud/console.php(90): OC\Console\Application->run()
#8 /nextcloud/occ(11): require_once('/nextcloud/cons...')

flag the configuration as incomplete

Nextant should not be running while the configuration is still by default.

suggestions when searching: Could not load conf for core nextant: Error loading solr config from

I tried to follow this guide

However, this resulted in SolrCore Initialization Failures:
nextant: org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Could not load conf for core nextant: Error loading solr config from /var/solr/data/nextant/conf/solrconfig.xml Please check your logs for more information

Looking into the logs:


HttpSolrCall
null:org.apache.solr.common.SolrException: SolrCore 'nextant' is not available due to init failure: Could not load conf for core nextant: Error loading solr config from /var/solr/data/nextant/conf/solrconfig.xml
null:org.apache.solr.common.SolrException: SolrCore 'nextant' is not available due to init failure: Could not load conf for core nextant: Error loading solr config from /var/solr/data/nextant/conf/solrconfig.xml
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1095)
	at org.apache.solr.servlet.HttpSolrCall.init(HttpSolrCall.java:251)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:413)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1092)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
	at org.eclipse.jetty.server.Server.handle(Server.java:518)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:244)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:246)
	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: Could not load conf for core nextant: Error loading solr config from /var/solr/data/nextant/conf/solrconfig.xml
	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:85)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:836)
	at org.apache.solr.core.CoreContainer.lambda$load$0(CoreContainer.java:494)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	... 1 more
Caused by: org.apache.solr.common.SolrException: Error loading solr config from /var/solr/data/nextant/conf/solrconfig.xml
	at org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:183)
	at org.apache.solr.core.ConfigSetService.createSolrConfig(ConfigSetService.java:97)
	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:77)
	... 7 more
Caused by: org.apache.solr.core.SolrResourceNotFoundException: Can't find resource '/var/www/html/apps/nextant/config/nextant_solrconfig.xml' in classpath or '/var/solr/data/nextant'
	at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:386)
	at org.apache.solr.util.SystemIdResolver.resolveEntity(SystemIdResolver.java:141)
	at com.sun.org.apache.xerces.internal.util.EntityResolver2Wrapper.resolveEntity(EntityResolver2Wrapper.java:177)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.resolveEntityAsPerStax(XMLEntityManager.java:997)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1212)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEntityReference(XMLDocumentFragmentScannerImpl.java:1908)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:3061)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602)
	at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
	at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:243)
	at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:339)
	at org.apache.solr.core.Config.<init>(Config.java:143)
	at org.apache.solr.core.Config.<init>(Config.java:90)
	at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:198)
	at org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:175)
	... 9 more

Versions:

NextCloud: 10.0.1 (stable)	
Nextant Version: 0.6.3 (beta)

solr-spec 6.2.1
solr-impl 6.2.1 43ab70147eb494324a1410f7a9f16a896a59bc6f - shalin - 2016-09-15 05:20:53
lucene-spec 6.2.1
lucene-impl 6.2.1 43ab70147eb494324a1410f7a9f16a896a59bc6f - shalin - 2016-09-15 05:15:20

nextant scanning but not indexing

Hi,

just installed nextant and solr. nextant app tells me that solr is installed correctly. However when I run ./occ nextant:index it results in

0 file(s) processed ; 0 orphan(s) removed
0 documents indexed ; 0 fully extracted

and

0 document(s) updated ; 0 failure(s)

However it runs through all users and shows > 40k documents. What am I missing?

Regards,
JP

PHP Fatal error: Call to a member function getStorage() on External Storage

Hi,
【FYI】
I have a problem when I used command,
occ nextant:index
occ aborted with a following message:
PHP Fatal error: Call to a member function getStorage() ...

I thought the cause is External Storage ( ex. Dropbox ),
and I turned off External Storage option .
So, occ nextant:index command succeeded.

For Your Information!

Filter file types

A possible enhancement would be to be able to choose which file types to index. For example I'd like to index pdfs but not jpgs.

Also I get a lot of stuff like this:
Error #41 (OK)
Failed to extract document #11114 (/somepath/wizard/WorkingSetSelectionPage.java)

It is not supposed to index .java files, as far as I understand. Why does it even try?

Search on non-admin users

Hi, great contribution and loving it. Thank you!
I installed on the latest nextcloud and I'm able to search files as admin, but not as regular user.
Please advise.

Best regards,

Crash indexing with nextant 0.6.6 in encrypted files

Using encrypted files in extant we have an error ( next cloud 10):

[OC\Encryption\Exceptions\DecryptionFailedException]
Can not decrypt this file, probably this is a shared file. Please ask the file owner to reshare the file with you.

PHP Fatal error: Uncaught Error: Access to undeclared static property: OC\Files\Filesystem::$normalizedPathCache in /var/www/html/nextcloud/lib/private/Files/Filesystem.php:773
Stack trace:
#0 /var/www/html/nextcloud/lib/private/Files/View.php(2034): OC\Files\Filesystem::normalizePath('/4B51B0EB-E30D-...')
#1 /var/www/html/nextcloud/lib/private/Files/View.php(1152): OC\Files\View->unlockFile('/4B51B0EB-E30D-...', 1)
#2 [internal function]: OC\Files\View->OC\Files{closure}()
#3 /var/www/html/nextcloud/3rdparty/icewind/streams/src/CallbackWrapper.php(109): call_user_func(Object(Closure))
#4 [internal function]: Icewind\Streams\CallbackWrapper->stream_close()
#5 {main}
thrown in /var/www/html/nextcloud/lib/private/Files/Filesystem.php on line 773

Sory for my bad english.

Some search queries results in HTTP 404

While searching in public shares,
some queries works fine,
but some produce HTTP 404 while accessing /index.php/s/false
Search results still looks correct, even with HTTP 404. So, this issue is not a blocker.

I noticed, that 404 is shown, when I enter query, which match some folder name in the share.
For example on https://notes.propovednik.com/
query test works with no errors
but query _Foreign gives HTTP 404. There is such folder in the share.

double display

results are displayed twice since 0.2

Trying to get property of non-object

Reproduce:

Open settings

What can I see:

Solr starts using a lot of CPU
Nextant settings look as if nextant is not configured at all (all fields empty, no indexes ran)
After a few seconds the settings look correct
Error:
Trying to get property of non-object at /var/www/nextcloud/apps/nextant/lib/Controller/SettingsController.php#113

Nextant indexing performance concerns

I'm running instance of NextCloud 10.0.1 on VM:

OS: Ubuntu 16.04 x64
HDD (RAID5)
2vCPU
4GB RAM
2GB Solr heap
~300000 files. ~100GB. Mostly small PDFs

When I started indexing, using Nextant 0.6.3 it died on some requests, with Solr timeout:

  Solr HTTP error: HTTP request failed, Operation timed out after 5001 milliseconds with 0 bytes received

Now, I'm using 0.6.4 and timeout is set to 30 seconds. It not dies anymore, but scanning takes very long time. Some request are timing out, but indexing continues
Also, I noticed, that at the beginning indexing works faster, but eventually slows down. I started indexing about a day ago, and now it is 52% done and still in progress.

Here is few metrics:
top shows 100% CPU load:

slavik@sf-hosting:~$ top
top - 13:27:52 up 23 days,  7:04,  2 users,  load average: 1.37, 1.18, 1.12
Tasks: 160 total,   1 running, 159 sleeping,   0 stopped,   0 zombie
%Cpu(s): 49.2 us,  1.3 sy,  0.0 ni, 48.4 id,  0.8 wa,  0.0 hi,  0.2 si,  0.0 st
KiB Mem :  4046656 total,   144432 free,  3308512 used,   593712 buff/cache
KiB Swap:  8384508 total,  6304596 free,  2079912 used.   469956 avail Mem

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
21673 solr      20   0 5720728 1.932g  59316 S  86.4 50.1 912:51.49 java
26237 www-data  20   0 2175420 1.002g   4616 S  13.0 26.0 758:50.63 php
 1023 mysql     20   0 1555336  97496   3348 S   0.7  2.4   1511:45 mysqld
  932 root      20   0  263804   2372   2096 S   0.3  0.1  27:28.94 vmtoolsd
22210 root      20   0       0      0      0 S   0.3  0.0   0:00.24 kworker/u4:1
22320 slavik    20   0   40672   3900   3144 R   0.3  0.1   0:00.01 top
    1 root      20   0  119916   4100   2812 S   0.0  0.1   0:35.41 systemd
    2 root      20   0       0      0      0 S   0.0  0.0   0:03.38 kthreadd
...

iotop shows low reading and high writing:

Total DISK READ :       0.00 B/s | Total DISK WRITE :      21.09 M/s
Actual DISK READ:       0.00 B/s | Actual DISK WRITE:     420.81 K/s
  TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND
  365 be/3 root        0.00 B/s    3.93 K/s  0.00 %  0.16 % [jbd2/dm-0-8]
21710 be/4 solr        0.00 B/s   43.26 K/s  0.00 %  0.08 % java -server -Xms2048m -Xmx2048m -XX:NewRati~ /var/solr/logs -jar start.jar --module=http
21739 be/4 solr        0.00 B/s   21.03 M/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRati~ /var/solr/logs -jar start.jar --module=http
    1 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % systemd --system --deserialize 20
    2 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kthreadd]
    3 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [ksoftirqd/0]
    5 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kworker/0:0H]...

When looking at the bottom of iotop output I see quite a few solr processes somewhere down the list:

...
15009 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [jfsSync]
21673 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
15530 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kworker/0:2]
  683 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [ext4-rsv-conver]
21680 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21681 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21682 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21683 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
 1114 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % polkitd --no-debug [gmain]
21685 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21686 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21687 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21688 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21689 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21692 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21693 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21694 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21695 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21696 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21697 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21698 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
  195 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [scsi_eh_2]
  196 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [scsi_tmf_2]
  197 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [bioset]
21702 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
  199 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [ttm_swap]
21704 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21705 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21706 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21707 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
 1183 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % vmtoolsd [gmain]
21709 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21710 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21711 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
15057 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kworker/0:0]
21717 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21718 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21719 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
21721 be/4 solr        0.00 B/s    0.00 B/s  0.00 %  0.00 % java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:~bution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
24289 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % lxcfs /var/lib/lxcfs/
21734 be/4 www-data    0.00 B/s    0.00 B/s  0.00 %  0.00 % apache2 -k start
20177 be/4 www-data    0.00 B/s    0.00 B/s  0.00 %  0.00 % apache2 -k start
26236 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % sudo -u www-data ./occ nextant:index --debug
...

But for some reason, I can't see there processes, when using ps aux. Am I doing it right?:

root@sf-hosting:/home/slavik# ps aux | grep solr
solr     21673 32.1 50.0 5722812 2026540 ?     Sl   Nov05 916:24 java -server -Xms2048m -Xmx2048m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:gc -XX:+PrintHeapAtGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -Dsolr.allow.unsafe.resourceloading=true -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs -jar start.jar --module=http
root     22409  0.0  0.0  12944  1032 pts/1    S+   13:32   0:00 grep --color=auto solr

Does anyone see anything wrong with my configuration?
Any advice to improve performance?
Or is it Solr issue, but not Nextant?

Search within the shared file

include shared file to the search database.

Why can't I force indexing in UI without a delay?

I entered an index delay of 0.0001h. I know that this will probably not work... but it is possible. Not possible is to enter a 0 into the box (because cron does not support it?). Anyway why can't I speed this up a little? Why does it have to be hours?
I realize I still can ./occ nextant:index.

"Home" button stops working after any search in public share

Steps to reproduce:

open any public share
search for any string
press HOME button

Defect:

HOME button does nothing

Expected:

HOME button would go public share list of files (that's what happens, when no search was used)

Environment:

NextCloud 10.0.1
Nextant 0.6.4
Browser: Chrome, Version 54.0.2840.71 m (64-bit) running on Win7x64

Suggestions

nextant should suggest search/words to the user

'Error opening new searcher' while index

Trying to nextant:index on 1,257 files shared from one account to 20 test accounts (test_1 to test_20). The index process aborts at different times (15-30 minutes) - without using external storage. Storage is local - 20GB and a mixture of files (PDF, txt, XLS, DOC).

/occ nextant:index
This is an alpha release, please report any issue to
https://help.nextcloud.com/t/nextant-navigate-through-your-cloud-using-solr/2954/

admin: 1257/ 1257 [============================] 100%
kb-sync: 1257/ 1257 [============================] 100%
test_1: 1257/ 1257 [============================] 100%

PHP Fatal error: Call to a member function getStorage() on null in /var/www/public_html/lib/private/Files/View.php on line 1689

Open rather than download files

This is really an enhancement request to have the option to open and not just download a file in search results.

server-side encryption

Hi!

When trying to run ./occ nextant:index for the first time the process died for me with this error message

   [preparing]                                     

  [Solarium\Exception\HttpException]      
  Solr HTTP error: HTTP request failed,

Configuration of Solr went fine until then, and the connection test in owncloud worked too. (all green)

I'm using 0.5 of the app on owncloud 9.11. What could have gone wrong, could the problem be that I use server-side encryption?

Thx,

Jens

Ups, found the mistake. Obviously curl_exec was disabled by default for cli, not for Apache though. (Ubuntu 16.04)

Sorry to have bothered you. I'll leave this here for others if that's ok...

Undefined index

I constantly get that error after installing 0.5.0 and running nextant:index:
Undefined index: extension at /var/www/nextcloud/apps/nextant/lib/Service/SolrService.php#181