uxifiit / gazetoolkit Goto Github PK

CSV format support was added in commits ab6c11a and 9e1694f, but converters for all data types have been implemented yet. Currently, only write converter for EyeMovement is available for CSV in the UXI.GazeToolkit.Serialization library, but for JSON, converters for all main data types are available.

Data formats are not documented which makes the library hard to use

Hi, I've tried running the command line tool with json data files and csv data files and neither has worked for me.
I tried running the fillingaps command and the vt-classify command from the command line passing in a data file containing the example json given in #4 (comment). This is part of the following error message: Unhandled Exception: System.AggregateException: One or more errors occurred. ---> System.FormatException: Input string was not in a correct format. at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal) at System.Number.ParseInt64(String value, NumberStyles options, NumberFormatInfo numfmt) at System.Int64.Parse(String s) at UXI.GazeToolkit.Serialization.Converters.TimestampFromTicksConverter.Convert(String value).
I also tried using the sample csv file format given for raw gaze data (#4 (comment)) and hit errors as it seems to get deserialized as a JSON object (the error begins with: Unhandled Exception: System.AggregateException: One or more errors occurred. ---> Newtonsoft.Json.JsonReaderException: Unexpected character encountered while parsing value: T. Path '', line 0, position 0. at Newtonsoft.Json.JsonTextReader.ParseValue() at Newtonsoft.Json.JsonTextReader.Read() at UXI.Serialization.Json.JsonDataReader.TryRead(Object& data)).
How can I get my csv file to be interpreted as a csv file? Can you provide updated data file format examples if there have been updates?

I have a CSV file which has Tobii eye-tracker data (using as a sample file). It looks something like this

.
The data is in the same format as described in the Readme file of this project.

I am executing the following line in the command window. myData1.csv is my input file with raw eye gaze data and fixations.csv is where I want to write the fixations.
i-vt.exe D:\myData1.csv --format CSV --timestamp-format ticks:us --fillin --select Average --denoise --denoise-alpha 0.3 --frequency 300 --threshold 30 --merge --merge-max-gap 75 --discard --discard-min-duration 60 --output-format CSV --output D:\fixations.csv

After the code execution, the output file is simply blank with only the header. No data is there.

Here is the terminal view after the execution of code:

Can you please suggest if I am doing something wrong?

I have also tried pipeline code execution as described here: #18

Kindly help me out of this
Thanks

Hi

I have a raw gaze data set in csv format, do you have an option to input csv file?

or could you show some examples of the dataset.json, I can convert my csv into json.

Thanks

If the CSV input file contains nan value to represent "not a number", the default deserializer for double fails to recognize it as Double.NaN. The nan value is used in Python to represent it.

EyeMovement class contains the property Samples with EyeVelocity objects that belong to the movement if it was fixation. If JSON output format is requested, there should be option whether to include samples or not, if they are not needed. CSV output format naturally ignores the samples property.

This prevents use of filters in pipeline without -q argument set, because the log messages will get written to the pipe too.