appbaseio / dejavu Goto Github PK

We have divergent branches that require some major code changes for every release cycle. It would be nice if we can separate code concerns that are specific to a branch (for example, in the chrome app - we have to use an async storage API instead of localstorage; we can move the storage code and it's dependencies in a single file).

We can also create an automated merge script to simplify the release creation process.

Installing the 0.7.1 release tarball as a plugin fails with

[2016-06-14 09:40:28,120][ERROR][bootstrap ] Exception
java.lang.IllegalStateException: Could not load plugin descriptor for existing plugin [dejaVu]. Was the plugin built before 2.0?

Installing plugin-descriptor.properties to .../elasticsearch/plugins/dejaVu fixes this.

Please add plugin-descriptor.properties to the release tarball on github.

Saving an app's URL connection configuration would be nice to implement an autofill functionality based on the app name. Autofilling connection configurations would help users multitask b/w different apps easily.

Autofill would work based on the appname field. To add some spice, it can also have an autocomplete suggestion functionality.

Note: For security reasons, this should only be implemented in the ES plugin and chrome app (and not on the gh-pages URL) branches.

It seems that the infinite scroll doesn't work on a 4K monitor.

Can be a nifty use-case for many scenarios. Is it possible to use the scroll API effectively from the browser? How does it work when the data sizes are large?

Reference: http://stackoverflow.com/questions/3665115/create-a-file-in-memory-for-user-to-download-not-through-server

Support column width resizing to better view data.

• Long ids are hard to view as the current UI truncates values longer than 20 characters, see #11.
• Columns with smaller fields can be compacted and columns with long text data can be expanded to better utilize the screen estate.

The ideal solution should be similar to excel / google sheet's resizing behavior, contributions are welcome :-).

• elastic search is running and I can browse data using sense.
• installed dejavu as a chrome extension
• no instruction as to what I should enter for appname or host, tried appname as anything and host as 'localhost' and 'localhost:9200', all of which result in dejavu blocking any user input and continual blue loader at top
• tried host as 'http://localhost:9200' and 'http://127.0.0.1:9200' which also don't work, but at least get an 'authentication' error
• tried with above hosts and using my index name for app name, still the same authentication error.

Looks like a great tool, just what I've been looking for, but needs a getting started/how to use section in the read me.

I am trying the default app (2016primaries) and adding / updating data in the type "test" doesn't reflect the changes unless I hit the "reload" button.

Index should be created if it is not exists.

Elasticsearch 2.3.3 fails to start with the dejaVu plugin:

[2016-06-14 09:44:41,077][ERROR][bootstrap ] Exception
java.lang.IllegalArgumentException: Plugin [dejaVu] is a site plugin but has no '_site/' directory

dejaVu currently has a site directory. Changing this to _site lets elasticsearch start

Hello, in the UI, the password is entred in plaintext as part of the connection url (http(s)://user:pass@server:port).
After connection, le url - with the plaintext password - is still displayed.
=> Anyone who looks at my screen can see my credentials.

Could you update your UI to hide the password please ?

Using ElasticSearch plugin via Chrome app I cannot select the content of a record. When I click on the brackets icon {...} I can see the content but I cannot select and copy it

I can't see the filter icons, what could be wrong?

elastic v1.5.1

dejaVu installed as an ES plugin.

WebSocket connection to 'ws://xxxx:9200/meta' failed: Error during WebSocket handshake: Unexpected response code: 200

Is there an extra plugin dependency for the live-reload to work? Or is this a feature only supported within appbase?

Since we announced dejavu's open-source launch on Product Hunt in March, it has found home with 1,000+ developers. I would like to thank everyone here for giving the project an early visibility 😃 . It means a great deal for a side project being built by a small team!

Hi,

I tried to deploy this application locally on a Linux environment, and it failed to launch with an error:

[09:13:26] Using gulpfile /tmp/dejaVu/gulpfile.js
[09:13:26] Starting 'browserify'...
[09:13:26] Starting 'connect'...
[09:13:26] Finished 'connect' after 6.67 ms
[09:13:26] Server started http://localhost:1358
[09:13:26] LiveReload started on port 35729
events.js:141
      throw er; // Unhandled 'error' event
      ^

Error: Cannot find module './homePage.jsx' from '/tmp/dejaVu/_site/src/js'
    at /tmp/dejaVu/node_modules/resolve/lib/async.js:55:21
    at load (/tmp/dejaVu/node_modules/resolve/lib/async.js:69:43)
    at onex (/tmp/dejaVu/node_modules/resolve/lib/async.js:92:31)
    at /tmp/dejaVu/node_modules/resolve/lib/async.js:22:47
    at FSReqWrap.oncomplete (fs.js:82:15)

Checking the src/js folder, I can see that it contains a file "HomePage.jsx"

For some preliminary checks so that it at least starts up - I renamed (locally):

However, I'd recommend a more permanent fix of standardizing the filenames to be a specific case, and modify either the code referencing it, or the file name to suit whichever this standard is.

The README.md tells how to install the plugin, and what elasticsearch configuration is needed, but not how to access it once it's installed (or I'm missing it)

dejavu URL links now should be using a lowercase 'v' in share links to https://appbaseio.github.io/dejavu because of the repository rename from dejaVu to dejavu.

We need to change this in all the relevant branches and create a new release.

Update data window is not working anymore, I used this before and it worked properly.
Now 'Update' button from Update Data window doesn't do anything

Chrome Apps will be deprecated in 2017 and disabled shortly after on all platforms except ChromeOS. In this light, we should publish a native version of dejaVu. A Mac / PC app can certainly be a starting point.

Type should be visible only if data exists in that type.

In the data view, when selecting a row with a specific id, other rows that have the same id but different types also get selected. That shouldn't be the case.

I've got weird behavior installing dejavu as an ES plugin, and running it stand-alone. This is all using chrome.

as a plugin:

1. works OK locally
2. 404s on main.min.js in another environment when loading splash page

built + run locally (npm install, bower install, gulp watch):

1. splash page loads. bombs out on something about chrome localstorage when I try to connect. chrome.storage is undefined (in chrome). "url" == e.name ? chrome.storage.local.set({

Am I missing something?

If your type + id strings are longer than about 20 characters, it gets truncated in the id column (which is expected, to an extent). It would be nice if there was a way to expand the width of the ID column to make a larger portion of IDs visible. This would make it a lot easier to browse data; which is pretty difficult right now.

Additionally, the {...} show json button takes up a lot of screen real estate.

This can prevent a clutter of types on the app, since starting v2.0: ES doesn't allow mapping modifications.

Refactor the code, sync with other branches should be smooth.

I had installed dejaVu successful. And config as below:
`http.port: 9200

http.cors.allow-origin: "http://127.0.0.1:9200"

http.cors.enabled: true

http.cors.allow-headers : "X-Requested-With,X-Auth-Token,Content-Type, Content-Length, Authorization"

http.cors.allow-credentials: true`

but when I open http://localhost:9200/_plugin/dejaVu/, I got error:
`feed.js:19 Uncaught TypeError: Cannot read property 'split' of null(anonymous function) @ feed.js:19

main.min.js:12 Download the React DevTools for a better development experience: https://fb.me/react-devtools

main.min.js:2 Uncaught TypeError: Cannot read property 'length' of undefined`

I am using ES 2.3.2

The URL generated is of the form

http://appbaseio.github.io#?input_state=...

It should be of the form

http://appbaseio.github.io/dejaVu/live#?input_state=...

It would be a nice feature to get implemented to be able to filter, sort etc and then export that as a elasticsearch query.

One of the key ideas for dejaVu is that it's a client side app and can be used within a browser or as an Elasticsearch plugin.

The idea is to capture dejaVu's state within it's URL: Things like ES host, index name, selected types, applied filters. That way, passing the state is as easy as sharing the dejaVu URL. Potential benefits are:

1. An easier way to debug while developing,
2. Sharing public data sets in Elasticsearch would be super easy,

Of course, localhost URLs won't be accessible and there's a potential pitfall security concern wise (but if you were securing ES by obscurity, you have bigger problems).

its fine if there is a screenshot of dejavu in README

It would be great if there was a config option to make everything readonly, unless an index/type was whitelisted as write enabled. This doesn't exist already does it?

Continuous pagination returns less than 20 records at a time. I believe the issue is duplication of returned documents.

dejavu should set a preference string at the start of a session so that consistent ordering of results can be maintained across pagination search requests.

Reference: https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-preference.html

Thanks for this project and its sister mirage. Both serve an important gap in the ES GUI space.

I've been playing around with a local installation against my data and trying to get a better feel for how 'input_state' is working, in terms of it somehow encoding a 'state' ... ie. client-connection info, index selection and perhaps type selection. I don't think it's base64 encoded ... but I can see you are using cryptojs in some way.

Are there any spec documents as to how this is working ... or perhaps an example of an encoded/decoded payload.

I was also wondering if it's possible to include a query that gets applied to the given 'state', and pass that as part of the url ... in either encoded or plain JSON form?

Thanks.

With Elasticsearch 5.0 being GA, the site plugins have been removed. Instead, Elastic encourages Kibana plugins.

While dejavu can be still usable with the github hosted app and chrome app (which is going away next year), we should consider supporting dejavu as a Kibana plugin.

Hi there! This isn't a issue but I didn't know where to ask!
Are you accepting donations or supports? Because may you get some extra support for dejaVu.
I don't trying to spam you, but I want to invite you to beerpay.io, a simple platform to monetize open source projects, like hamburgers.
I know that the open source is free, but it's okay if someone want to contribute in other way.

Thanks for this work man!

Google Chrome Web console:

/_plugin/dejaVu/src/js/helper/feed.js
---------------------------------------------
        filterUrl: function(url) {
            if (url) {
                var obj = {
                    USERNAME: 'test',
                    PASSWORD: 'test',
                    URL: url
                };
                var urlsplit = url.split(':');
                --> var pwsplit = urlsplit[2].split('@');

Exception:

Uncaught TypeError: Cannot read property 'split' of undefined

A "No data to view!" message is shown in the data browser even if there's data and it's loading; the message goes away after data is ready. Perhaps something like "Loading data..." would be better.

When connecting to an index which has no mappings specified, the connection fails.

Ideal behavior should be to connect and show the "add new data" button.

In the chrome plugin, switching to a different index correctly updates the "Types" panel, but does not refresh the main data view.

Also, there isn't really much of a "loading" indicator or anything when connecting/switching types, which can be a bit disconcerting.

I have an ES dev server with Access-Control-Allow-Origin set to * (and does not have any auth credentials). Dejavu refuses to connect - I see the following in browser console log

XMLHttpRequest cannot load http://example.com:9200/foobar/_search?search_type=query_then_fetch. Response to preflight request doesn't pass access control check: A wildcard '*' cannot be used in the 'Access-Control-Allow-Origin' header when the credentials flag is true. Origin 'http://opensource.appbase.io' is therefore not allowed access. The credentials mode of an XMLHttpRequest is controlled by the withCredentials attribute.

Looks dejavu should recognize that there no credentials supplied and withCredentials flag accordingly.

I'm using the hosted version of dejavu: http://opensource.appbase.io/dejavu/live on Chrome 53.

Thanks for the great product. I love all the three products such as GEM, Mirage and Dejavu.

I am heavily using them for my local testing. I am facing the problem that I have to frequently switch between tabs. It is really disturbing. Atleast Mirage and Dejavu can be single app so developer can visualise and then test different query from same page.

Hi,

Thank you so much for your Chrome extensions. Really helpful !

Can you add a button to (un)select all the results, please ?

My use case is to select all the result in order to delete them through your extension !

Thanks,
Rasmey

For instance, the JSON data is not selectable. And the "watch video" and "Create your own ElasticSearch in cloud with appbase.io" hyperlinks don't open in a browser.

Both could be separate issues, nonetheless, something we should look into.

Is there a way to know what's happening with a connection? I'm trying to connect to our instance and get no feedback on what the connection issue is.

Adding support for filtering by true / false radio buttons on a boolean field type.

https://www.elastic.co/guide/en/elasticsearch/reference/current/boolean.html

I use elasticsearch 5.0.0 with this index:

curl -XPUT http://localhost:9200/cnaes -d '
{
 "mappings" : {
  "_default_" : {
   "properties" : {
    "code" :          {"type": "keyword" },
    "descripcion" :   {"type": "string" },
    "value":          {"type": "integer"}
   }
  }
 }
}
';

When I access to Dejavu and inspect index, filter option does not appear for strings and keywords fields.

Any help?

I tried installing the chrome extension and connects to localhost:9200. It kept loading.

Finally I got it working by adding the following to config/elasticsearch.yml:

 http.port: 9200
 http.cors.allow-origin: "chrome-extension://jopjeaiilkcibeohjdmejhoifenbnmlh"
 http.cors.enabled: true
 http.cors.allow-headers: "X-Requested-With,X-Auth-Token,Content-Type, Content-Length, Authorization"
 http.cors.allow-credentials: true

I think there should be error messages that is more informative, and the need for configuring allow-origin to chrome-extension should be addressed in README.