About the project

Macrophighters is a fun and interactive AR game where the users will try to eat incoming bacterias before they reach the blood system and can cause a fever. On this website we will present the development of Macrophighters and how the app looks like today.

During this project we have been motivated to learn more about AR development and integrate parts of the immune system in an educational way. This project has been centered around three main goals. The first goal has been to create an interactive experience in an AR environment. The second goal has been to create a cool and visually pleasing experience. And the third goal was to create a good learning experience about the immune system.



The development of the app

In the first stage of the development we used Unity to create an MVP of the app. We only had two game objects, the macrophighter and the bacteria, and they were very simple objects with no textures or details. The game logic was also very simple, the bacterias could only move in one direction and it was a never-ending game.

From the MVP we improved graphics, interactions and game logic. First we modeled new and more detailed 3D game objects in Blender. These models were imported in Unity where the whole game was put together. We had to specify a game field and to do that we used AR fondation to implement image tracking. The center of the game field was then displayed on the image while another 3D model marked the border of the field. To improve the interactions we implemented both haptics and sounds, as well as UI objects for controls and screen info. To step up the game logic we implemented animations on the bacteria to make them move in a randomized pattern, as well as a counter that ends the game if you have missed too many bacterias.

In the final upgrade we have implemented a ‘no go zone’, making it impossible for you to cheat by standing too close to the wound where the bacterias can get in. A new feature where you could get help catching the bacterias was implemented with help of image tracking. Three pyscial cards could be scanned for different kinds of help. We also worked on improving the haptics and animations.

User comments

"This is fun, The spawner is slowly drifting away, The difficulty seems to be increasing. The world is pretty stable given that you move the camera so much."
“*laughing* Oh, the sound is very disgusting. *aah* Wow that was fun, really cool. Well done."
"You really have to move, it’s easy to catch them when you understand where they are going. So I can scan these [cards] If I want to, Oh and then they automatically catch them. Alright!"

Challenges & Learnings

In a very early stage, when we did our first user test, we learned that we had to work more on the interaction part. We learned that the instructions of how the game worked was lacking and that the user didn’t get enough feedback to understand if the user managed to complete tasks. We implemented several things to improve the interaction. First of all we onboarded the user to the app by implementing a start screen with instructions. Then we implemented both haptics and sounds to indicate that the user caught a bacteria. And in the final stage we also implemented animations to show this.

When we worked with the visual and graphics we had some difficulties exporting all materials from Blender to Unity. This was a problem we didn’t really expect since we believed Blender and Unity should be easy to use together. We tried to work with different file formats but in the end we had to create and add the materials in Unity.

Throughout the whole project we have been challenged in balancing the educational part with the game aspects without making this project too large and complex. We wanted the game to be a fun way to learn about the very complex system that the immune system actually is. Therefore the game logic has always been reflected by the real immune system, to try to describe real situations. Although, we had to scoop the project and in an early stage we tried to define what parts of the immune system we should focus on. We got help from an expert in the field, and she also confirmed the fact that we had to scoop the project and only focus on a very little part of the immune system. Therefore, the project became more of a game inspired by the immune system rather than an educational product. All this scooping and finding a good balance turned out to be a very good learning experience.


The team

Johanna

simfors@kth.se

I was in charge of the 3D modelling. I built the macrophage, the bacerias and the game board. This also included creating textures and materials, and researching how my 3D models could at best be integrated with future animations.
Leo

leobergq@kth.se

Together with Olle responsible for AR, Game Design / -Logic, Interaction Programming and UI
Moa

moaeng@kth.se

In this project I've been responsible for creating the start and finish screen of the app. I've also worked with preparing user tests and building this website.
Nils

nmerkel@kth.se

I have worked with the game design and game logic. This also included research about the immune system.
Olle

ohovmark@kth.se

I've been responsible for AR, interaction programming, haptics and sounds. Which also included testing and merging everyone's work together.

Related projects

Tower Defense with Augmented Reality

Păduraru, Bogdan-Mihai, and Adrian Iftene. "Tower Defense with Augmented Reality." Proceedings of the 14th Conference on Human Computer Interaction-RoCHI. 2017.
Cells of War: A Serious Game for Familiarizing Players With the Immune System

Konstantara, Konstantina, and Stelios Xinogalos. "Cells of War: A Serious Game for Familiarizing Players With the Immune System." Simulation & Gaming 49.5 (2018): 567-589.
Using Unity 3D to facilitate mobile augmented reality game development

Kim, Sung Lae, et al. "Using Unity 3D to facilitate mobile augmented reality game development." 2014 IEEE World Forum on Internet of Things (WF-IoT). IEEE, 2014.