JSON output of data qualities. about openml HOT 3 CLOSED

Any news on this?

I am currently iterating over the R code and this will soon get focus....

from openml.

Ok, I went full McGuyver on this one :)

Turns out there is a bug in the specific version of CodeIgniter (PHP backend) we are using. I guess Jan ran against the same issue. I found a github commit that fixes it and used it to patch our system:
bcit-ci/CodeIgniter@effd013

Next, for this specific query, the database data types are no real help because the qualities are stored as strings (for extensibility reasons). I wrote a quick check that detects when a string is actually an integer or a double. This is now returned:

http://openml.org/api_query/?q=SELECT%20d.name%20AS%20dataset,%20MAX(IF(dq.quality=%27NumberOfFeatures%27,%20dq.value,%20NULL))%20AS%20NumberOfFeatures,MAX(IF(dq.quality=%27NumberOfInstances%27,%20dq.value,%20NULL))%20AS%20NumberOfInstances,MAX(IF(dq.quality=%27NumberOfClasses%27,%20dq.value,%20NULL))%20AS%20NumberOfClasses,MAX(IF(dq.quality=%27MajorityClassSize%27,%20dq.value,%20NULL))%20AS%20MajorityClassSize,MAX(IF(dq.quality=%27MinorityClassSize%27,%20dq.value,%20NULL))%20AS%20MinorityClassSize,MAX(IF(dq.quality=%27NumberOfInstancesWithMissingValues%27,%20dq.value,%20NULL))%20AS%20NumberOfInstancesWithMissingValues,MAX(IF(dq.quality=%27NumberOfMissingValues%27,%20dq.value,%20NULL))%20AS%20NumberOfMissingValues,MAX(IF(dq.quality=%27NumberOfNumericFeatures%27,%20dq.value,%20NULL))%20AS%20NumberOfNumericFeatures,MAX(IF(dq.quality=%27NumberOfSymbolicFeatures%27,%20dq.value,%20NULL))%20AS%20NumberOfSymbolicFeatures%20FROM%20dataset%20d,%20data_quality%20dq%20WHERE%20d.did%20=%20dq.data%20AND%20d.isOriginal%20=%20%27true%27%20GROUP%20BY%20dataset

However, this will still fail in case of missing values. If you want to be absolutely sure, you can do a second free query to get the datatype from the quality table (this is also new):
http://openml.org/api_query/?q=SELECT%20name,%20datatype%20FROM%20quality

And do a lookup there.

Are we good?

from openml.

Think this is solved?

from openml.