Any way to reindex a subset of types in an index? about chewy HOT 9 CLOSED

Howdy! I'm not sure you really need this. I think it is much more effective to reset the whole index. Because the whole index might be just deleted completely, but as for types - ES can't do something similar and you have to delete documents from index manually. And I'm not sure it can be done using type condition. The deletion happens in batches and you have to pass all the documents ids you want to delete. This approach seems to be quite slow.

However if you still need this or I'm wrong about the way to perform it - I'd like to see it more like MyIndex::MyType.reset!. As type object method.

from chewy.

The reason why I thought this would be useful for me is because I need to periodically update all the elements of a single type in my index (for permissioning) and the number of documents in this type is very small compared to the overall size of the index. So I think it is more efficient for me to just update that type.

I was thinking use the delete by query api (http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/docs-delete-by-query.html) to delete all the documents of that type, then use bulk api to index the new documents of that type with updated info. Does that make sense? You're right, it should be a type object method if anything.

from chewy.

Ah, there is delete by query api. So yep, you can add MyIndex::MyType.delete and MyIndex::MyType.reset methods (and maybe bang methods as well). It will be conform enough and convenient in some cases such as yours.

from chewy.

Oh, I've thought it will be even much better to add delete_all method to query. And use it in reset. What do you think?

from chewy.

Sorry, could you clarify what you mean?

from chewy.

I mean we can do it like this: MyIndex.query(...).filter { ... }.delete_all. And this will delete all the documents matching this query. It is very similar to activerecord's delete_all scope method.
After we would be able to implement reset method like this:

def Chewy::Type::Base.reset
  delete_all
  import
end

from chewy.

Ah yes, that looks good. I'll work on it and make a PR

from chewy.

Awesome, thanks!

from chewy.

#55

from chewy.