Giter Club home page Giter Club logo

ar-instructions-unity's Introduction

AR Instructions

This application is under development. When you find a bug or have some suggestions, please create an issue here.

AR Instructions is an authoring tool for creating instructions for AR in AR. The very general structure of the application allows to create instructions for basically everything.

The structure of an instruction is the following: An instruction has a name and contains one or more steps. Each step has a step number, a text to descript what to do in this step, can have multiple photos and videos as well as holograms. Photos and videos can be captured directly in the application. At the moment there are three different: box, arrow and circular arrow. The holograms which can be placed in space by simple hand gestures. The user can set the color of the holograms, available colors are red, yellow and green. Additionally, little tool tips can be added to the holograms.

There is also a desktop application to edit and prepare instructions, see https://github.com/UniSiegenWiNeMe/AR-Instructions-Editor-UWP

Main UI

This is the main UI. While creating in there are three panels. On the left side you have a panel for photos and videos. You can directly capture photos and videos from the application.

The panel in the middle is for the text description. You see the current and maximal stepnumber and go through the steps.

On the right side you can select holograms which can be placed freely in space. This panel is hidden in replay mode.

Main UI

Closer look at the different panels. Photo and video panel:

Description panel:

Item panel:

Selection menu, left normal mode, right editor mode

Selecting different colors

Placing an object in space

Quickstart guide:

  1. Get a vuforia (developer) license at: https://developer.vuforia.com/
  2. Create a new VuMark database (Target Manager)
  3. Use the created license
  4. Use VuMark template from Assets/MarkerForPrinting
  5. Print VuMark
  6. Download database for unity
  7. Import unity package and adjust the Vumark in the main scene

ar-instructions-unity's People

Contributors

florianja avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

ar-instructions-unity's Issues

Customize UI

Add a function to enable the user to customize the UI

  • change size
  • position
  • ...

High memory usage

The application needs a lot of memory and the memory is not freed properly. This could cause crashes.

Same instruction names

When creating a new instruction check if there is one instruction with the same name before.
If there is the same name, add a number to the new instruction.

Offset function

Add a function to set an offset to the holograms to adjust the position. e.g. for the case the marker moved

Button Icons

After MRTK update, some button are showing incorrect icons

Can't access Interactable script on HomeButton

In HoloLens, the mainpanel is inactive on startup. This results in not getting the mainpanelcontroller by the getComponent method. Pass the reference to the Button / Interactable in another way.

var mainPanelController = _instructionMenu.GetComponentInChildren<MainPanelController>();
if (mainPanelController != null)
{
var interactable = mainPanelController.HomeButton.GetComponent<Interactable>();
if (interactable != null)
{
interactable.OnClick.AddListener(Reset);
}
}
else
{
Debug.Log("mainPanelController is null");
}

Data logging

Integrate a data logger to analyse how long a worker needed for which step. In first iteration this logger can store the data offline (in a normal txt file) but later this data should be stored somewhere in the cloud.

Add "end editing" button

There should be a button for explicitly stopping/ending the editing of an instruction without leaving the instruction.

Importing the same instruction

The name of the intstruction does not change to the new name when importing an instruction with a name which is already there.

Scale of FixedMovement

The scale of the handles of the FixedMovementhandler are broken. Thex should scale depending on the collider size. When rotating an object, the rotation is not included in the calculation of the size of the handles. This can cause the handles to disapear in the collider (bounding box).

Markertracking HoloLens2

Vuforia is not working on HoloLens 2.
Errorlog: no capture device found.
Maybe just a configuration problem

Fixing button texts

At some buttons the text cannot be read correctly. This happens mostly at buttons with two lines of text.

Holograms are instable

Holograms are not stable and sometimes are displayed on a wrong position. A spatial anchor could decrease or even solve this problem

Instruction menu size

Adjust the layout of the main panel in the instruction menu for make more space for the instruction text.

Tooltip scaling

When scaling an object the tool tip scales up too and could get too large when loading.

Failed to take photo

Taking photos can produce following error.

failed to take photo

Application still runs fine. Waiting for more informationen on this.

Chinese font

Chinese text is not displayed correctly on the hololens.

chinese font desktop

chinese font hl

Grouping of holograms

For the editing mode there should be a function to goup multiple holograms. Gouped holograms shouled be transformed (moved, rotated, scaled) all together.

Select step

Add function to go to a specific step without clicking the next button mulitple times

Video import

There is a problem with videos when instuctions are imported from the desktop application. Videos do not show up in the list

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.