rohatgia / cmsc314_seniorproject Goto Github PK

Upon selecting this button the user will see a menu that allows them to see the parameters of the currently selected algorithm and be able to select and edit this parameters

As a user I want an evaluation Options menu so that when I can choose how and what evaluation measures are executed.

Evaluation Options Menu should display something along the lines of

0.) Output to File (when selected you will be prompted to input file name)
1.) Confusion Matrix (True/False)
2.) Instances tested as correct (True/False)
3.) Instances tested as incorrect (True/False)
and other common evaluations metrics...

if an option is selected as True then it will be displayed when evaluation is called upon.

Currently, an option exists to allow the user to configure the name of the stream. This change picks the name up of the stream automatically from the file name.

Displays a menu that allows you to select and add an algorithm to the ArrayList of AbstractClassifiers in LearnOptions.java

As a user
When I select the Export stream menu

The export stream menu should look like the following
1.) Selected Stream (will show stream that is currently selected) Once selected it will cycle through the streams that are currently loaded.
2.) Export (Saves the selected stream to an arff)

This feature should let the program automatically pick up the class index from the stream. Currently the user has to set it, but this may lead to an imbalance in what the user enters, and what the index of the class is.

The user should be able to remove any attribute from the list of attributes in the stream. This functionality would have to first get a list of attributes, then send them to the user, and finally remove the attribute from the set.

As a user I want a Build Task Menu
So that I can set up how my environment will learn, test and evaluate.

The menu should look like

1.) Learn Options
2.) Test Options
3.) Evaluation Options
4.) Batch Size (default is 1)
5.) Configure Flow

The exportStream method in ConfigureStream does not currently support user input or automatic input for the stream file name. This method should be updated to allow the user to manually set the name of the output stream, or to automatically pick it up as so,e combination of the input stream and the algorithm.

As a user,
When I click the edit stream menu
I have the option to
1.) Select a stream
2.) Rename the selected stream (only in the program not the actual file)
3.) Remove Attributes
4.) Remove the selected stream

As a user I want to be able to easily load, edit and export a stream.
So that I can have a stream to run in a task or be able to execute tools that will create or edit streams.

Some of the menu options should be

A list of streams that are currently "loaded" will appear here.
1.) Add Stream
2.) Edit Stream
2.) Export Stream

Train Module takes in a reference to a stream used for training and a reference to an algorithm that the stream is tested on

The user has the option to set and edit the parameters of an algorithm in this menu. Some parameters are of type ENUM, and setting them to a non ENUM type would crash the algorithm. This is not always clear though, so the user should have some kind of indication that the parameter being edited is an ENUM.

As a user I want to have a Main Menu
where I can select options that let me configure and execute my "Task"
Items on this menu can be selected by entering the numbered option.

Items to be included on the menu so far would be.
1.) Configure Stream
2.) Build Task
3.) Execute Task

As a user I want a test options menu to select how my algorithm will test its model
1.) Testing Stream (the stream that the model uses for testing)

You can access this menu by going to the EditStream menu

This menu should display all of the attributes in the currently Selected stream
and you should be able to select and remove attributes that you wish to remove and then back out of the menu

This functionality would have to first get a list of attributes, then send them to the user, and finally remove the attribute from the set.

As a user, when I select the Learn Options Menu I will be able to select a learning algorithm and be able to select and modify the parameters for the selected algorithm

Learn Options menu should look something like.
1.) Selected algorithm
2.) Learning stream (the stream that the algorithm will learn from)
2.) parameter 1
3.) parameter 2
4.) parameter 3
etc...

This button points to the "Selected Stream" variable in ConfigureStream.Java
The "Selected Stream" is the stream that changes are being made to.

When the user executes a task in CS314Menu, the program spits out a Task Completed message, but without any of the two metrics indicated, we cannot confirm is the task has been completed. We must determine whether the task is actually being, and if not, where it is breaking. If it is working, we must figure out why the two metrics are not appearing.

Test Module takes in a reference to a stream used for testing and reference to an algorithm that the stream is tested on

This Tool should allow you to Export the selected Stream to an arff file (this can be done using the MOA API)

upon clicking this button you will enter a name for the file and then afterwards the file is exported

As a user I want to be able to Initialize and Execute my task that I have set up
and receive my results in the desired way.

As a user, when I select the add stream Menu I want to type in a file name and that file be loaded into the environment and appear in the Configure Stream Menu

The stream that the selected will become the Test stream

If multiple algorithms are part of the ensemble, then we should be able to run then one after another without additional user input.

The set BatchSize function currently exists in the EditStream menu. This functionality should be moved up into the ConfigureStream menu.

The tempDoTask function is currently "Half-Ass Broken". This method should be updated to include the ability to insert other tasks when executing this (? or is this the currently unimportant configureflow), and also fix the ability to run the current tasks in the method.

Removes the selected Stream from the list of Streams

The stream that is selected will become the learning stream

In using the program, Brandon has found that only some ARFF's work properly, while others cause the program to crash. We must determine why certain files work while others don't.

• Automatically set the total instances variable to the total amount of instances in the selected stream
• Implement the configure flow functionality to allow the user to set up multiple tasks and streams (?)

As a user I want to be able to choose which order and to have the ability to reorder the flow of control of my task, this would allow me to test ideas that arnt commonly used or tested in data streams.

The Menu will look something along the lines of.

Current Flow will be displayed here
1.) Current selected flow module
2.) Add Module to flow
3.) Remove selected Module from flow