The same repository is also backed up at ETH Arch Chair's repo: https://github.com/architecture-building-systems/FCL-Exhibition-2023-ARUnity

This project is an iPad mobile app created for the Future Cities Lab Exhibition 2023 at ETH Zurich, aiming to visualize influential data of photovoltaic power usage using augmented reality. It utilizes 3D printed models of two sites, Zurich and Singapore, and is composed of three key modules: energy demand(cooling and heating), mobility flow (both vehicle and non-vehicle), and social economics(energy trading within these regions). By inputting these data in a specific format, the project creates a virtual overlay on the physical 3D models, providing a direct and clear view of the real situations in the designated areas.

The ARFoundationAllBackup branch represents the final version of this repository. It is compatible with Unity 2021.2 and later.

This project is developed based on AR Foundation 5.1 and its demonstration example AR Foundation Sample Project.

It depends on 2 Unity packages:

• AR Foundation
• Apple ARKit XR Plug-in on iOS
  To check the packages in unity editor, go to Windows > Packages manager

To build on iOS mobile devices, it requires an external development environment:

• Xcode available on macOS and developer account

This project can be directly built to iOS device providing input data in specific formats.
In this case, Unity is not required. Follow the steps below:

Xcode part
(See tutorial video that demonstrates the following steps.)

1. Clone this repository and go to 1610FinalBuild folder, open Unity-iPhone.xcodeproj using Xcode 14.0 or later.

2. Plug in your iOS device (with developer mode enabled) to the compmuter, and select this device on top of the window in Xcode.

3. In Xcode, click on "Unity-iPhone" on folder hierarchy on the top left, and then "Signing & Capabilities" in the middle.

4. In "Signing & Capabilities" page, check "automatically manages signing"

5. "Add an account" under "Team" selection options, and then choose your account for Team.

6. Run the project by clicking the triangle "run" button on top left. This way Xcode builds the app to your device.

Device part

7. On your iOS device, sign in to the Apple developer account the same as "Team"

8. "Verify" this app in Settings > General > VPN & Device Management

9. Transfer the data for visualization to the device under App document folder(Example file formats are described below). There are many ways to do this. For example, use 3rd-party iOS file explorers, such as iMazing or iExplorer. Navigate to ../Apps/FCL AR Visualization/Developer/Documents, and copy-paste the folder PersistantFilePath including the files in it to this path (i.e., the whole file path can be: ../Apps/FCL AR Visualization/Developer/Documents/PersistantFilePath/ZurichEnergyTrade.json). For the app document file path, see Unity Persistant File Path.

10. The app is ready to use.

To modify project on models, scenes, scripts,...,etc, follow the steps below:

Unity part

1. Install Unity Hub. In Unity Hub, go to "Install" to install Unity 2021.2 or later, add 2 modules: "Visual Studio for Mac" and "iOS Build Support".

2. Clone this repository and open the Unity project at the root of this repository.

3. Modify the projects as needed.

4. Go to Build Settings, select a target platform(iOS in this sample), and build this project in a new folder. In this way, unity automatically build a Xcode project.

Xcode part

5. After finishing building, go to that new folder and open Unity-iPhone.xcodeproj using Xcode 14.0 or later.

6. Follow the steps of case1

Sample data can be found in this repository under folder PersistantFilePath. To customize data to visualize, prepare new data in the following format, update the file name in code,and follow step#9 of previous section case1.

{
"houses":
[
{
"id": "B6327",
"load": "227630.1"
},
{
"id": "B117045",
"load": "0"
},...
]}

{
"type": "FeatureCollection",
"features": [
{ "type": "Feature", "properties": { "uid": 0.0, "Time": "2023-07-31T02:23:32.083", "Lat": 1.3906850104627779, "Lon": 103.89404394884859, "is_vehicle": 0.0 }, "geometry": { "type": "Point", "coordinates": [ 103.894043948848591, 1.390685010462778 ] } },
{ "type": "Feature", "properties": { "uid": 0.0, "Time": "2023-07-31T02:23:32.083", "Lat": 1.3906829774271761, "Lon": 103.89404762958823, "is_vehicle": 0.0 }, "geometry": { "type": "Point", "coordinates": [ 103.894047629588229, 1.390682977427176 ] } },
...]}

{
"DataEnergyTrade":[
{
"From": "B1082_demand.csv",
"To": "B1030_demand.csv",
"Transmission": "4",
"T": "12"
},
{
"From": "B1108_demand.csv",
"To": "B1047_demand.csv",
"Transmission": "1",
"T": "12"
},
...]}

../Asset/Scenes/ImageTracking/Menu

Menu

The menu scene is the start page of the app. It allows users (1)select the city, then (2)select the data module.

../Asset/Scenes/ImageTracking/Images

ReferenceImageLibrary.asset manages the images that can be detected in physical world. Use this to modify or add new images.
After modifying images, add the cooresponding prefabs that will be instantiated when the new image is detected under: (A module's scene, eg., EnergyDemandScene.unity) > Hierarchy > gameobject ARF XR Origin Set Up > gameobject XR Origin > Inspector > component PrefabImagePairManager(Script) > PrefabList.

The matched prefabs are instantiated in the virtual world when the corresponding image is detected in physical world. The location and rotation are set by functionAssignPrefab in the scriptPrefabImagePairManager.cs.

Detailed explanation can be found in AR Foundation Image Tracking package documentation.

Prefabs location: ../Asset/Scenes/ImageTracking/Prefabs
Scenes location: ../Asset/Scenes/ImageTracking/ImageTrackingWithMultiplePrefabs
Scripts location: ../Asset/Scenes/ImageTracking/Scripts

Zurich Cooling Demand

Zurich Heating Demand

Singapore Cooling Demand

The annual energy demand is measured in kWh, and it's represented by a color bar on the right. This bar uses different shades of blue(for cooling)/red(for heating) to indicate the level of demand. Darker shades of blue/red represent higher demand. The darkest level matches the highest demand within the area of study. Each building displays its annual demand on top of the model, and its color corresponds to the color scale bar to show the level of demand. The annual cooling demand data is visualized on both Zurich and Singapore models; the annual heating demand data is visualized only on Zurich model.

The following table summarizes the code for Zurich case, the Singapore case shares the same structure.

Zurich Mobility Flow

Singapore Mobility Flow

The mobility flow of vehicles and non-vehicles is demonstrated on virtual models which include the terrain and buildings within areas of study. Given the location(latitude, longitude) and time, each user(a person/a vehicle) is represented by one dot(a sphere prefab) showing on the models according to time sequence. Based on real-time records, the mobility flow is speeded up by timeSpeedupFactor, which default value is 1000 times faster than real-time.

The following table summarizes the code for the Zurich case, the Singapore case shares the same structure.

Zurich Energy Trade

Singapore Energy Trade

The social economics module illustrates energy trading among buildings in the area over the course of a day. When a building's PV panel generates surplus electricity, it trades it with neighboring buildings. Buildings turn blue when selling excess energy, displaying the amount in kWh above them, while those purchasing electricity turn yellow, showing the electricity they receive. Arrows indicate the trading direction and amount (indicated by arrow width).

The following table summarizes the code for Zurich case, the Sinagpore case shares the same structure.

../Asset/Scenes/ImageTracking/BasicImageTracking
This scene is used for checking the image detection works. It is disabled by default. To enable this function, go to menu.unity scene, find Debug button under Canvas, and check the box in Inspector.