[enhancement] Storing serialized_data in a JSONField instead of a TextField? about django-reversion HOT 3 CLOSED

Rewriting this project to only support PostgreSQL and JSON serialization would allow indexing on the versioned data, yes.

The loss of general usefulness to support a single use-case seems like a bad tradeoff to me.

If efficient introspection of the versioned data is required, I'd suggest going one step further and having a dedicated version table for each model. That would avoid any JSON overhead whatsoever.

from django-reversion.

I'm not sure how this could be implemented. A database field that is one type or another based on a setting is tricky, since the migrations would have to vary depending on that setting too! And if a user changed the setting after running the migrations, a new migration would have to be made, and where would Django store it?

I'm not sure Django really supports the idea of a database field that is dependent on a setting. I fear this would cause a lot of weird behavior for people.

filtering very efficiently a QuerySet of Version instances

Unfortunately, this would still likely involve a sequential table scan in postgres. It's likely that for large tables this would still be prohibitive.

from django-reversion.

Thank you for your feedback (and for your work here).

I had the feeling that such a change could quickly become a burden in terms of development and maintenance cost. But I wanted to hear your perspectives on this idea. You're right that this is probably not feasible without deeply rethinking the extension / without significant breaking changes, which is not an option...

Unfortunately, this would still likely involve a sequential table scan in postgres. It's likely that for large tables this would still be prohibitive.

That being said, I'm not an expert on the subject but isn't it exactly the contrary? According to Django documentation:

PostgreSQL users
PostgreSQL has two native JSON based data types: json and jsonb. The main difference between them is how they are stored and how they can be queried. PostgreSQL’s json field is stored as the original string representation of the JSON and must be decoded on the fly when queried based on keys. The jsonb field is stored based on the actual structure of the JSON which allows indexing. The trade-off is a small additional cost on writing to the jsonb field. JSONField uses jsonb.

As I understand it, that means PostgreSQL users (the vast majority of Django users) should be able to add indexes to JSONFields. Admittedly, this seems to be a recent & not commonly used feature in Django. So from a pure theoretical point of view, should you rewrite the extension from scratch for PostgreSQL users only & for users who would never use anything else than JSON to serialize data, don't you think the idea could make sense?
(Yeah, that makes quite a few conditions)

from django-reversion.