Assignment 1: AR Application Idea Proposal + AR Trends

Assignment brief

We are to provide 3 different ideas for creating an AR mobile application, it can be educative, informative, playable, the most important things is that it should be interactive. Besides the main assignment, we are to explore on AR trends. By following class exercises, we are able to learn the AR technology/developing mechanics. We also need to explore on more topics about AR, like all kinds of AR application, its newest development and etc.

Progress

Jump Link: 

Week 1 

Week 2 

Week 3 

Week 4

Week 1

AR Application Proposal

After assignment brief, I decide to form group with Renee. We both agreed that we should think of proposal ideas first, then, we will discuss with lecturer in class about our proposals. I have thought of some ideas shown as below. 

Ideas:

AR Trends

Since I have started to do brainstorming for the AR application ideas, I started to do some research too. I will list out some of my findings below:

Understanding AR application 

I research about AR mobile application, to understand and learn more about it, how it function, how it developed, what can it do. From these two articles, written by Sarrah Pitaliya and Digitalfren, I get to understand the concept of AR more and know what benefits it brings. 

AR stands for augmented reality. It is a combination of virtual and real life environment. In an augmented reality experience, users are able to interact with virtual objects, while being inside of a virtual and real life environment. Users need headset, smart glass, or right now, we can use mobile application to experience AR. 

AR used to popularized in game industry, as players are able to experience a more realistic and better game environment and experiences. But as times goes by, AR are being used in health industry, education, and more. It helps to provide an unique and personalized experience, better branding to create better competition and so on. 

Developing AR applications always start with ideation, we need to have a strong problem statement to start with, to solve and issues or create better version of something. Next, we need to do user research to fully understand user's needs. During the design stage, it included UI/UX design, graphic design, and maybe 3D modelling. We then move on to application development which involves coding and using SDK. We create prototype and go for testing stage until we finally complete a functional, useful and beautiful application. 

Link: 

https://digitalfren.com/9-step-ar-apps-development-guide/

https://sarrahpitaliya.medium.com/understanding-the-eccentricities-of-ar-application-development-ed44b25ecc02

Augmented Reality Mobile App for Children Learning on Colour 

by Muhammad Helmi bin Jamaludin

I found a very similar project from 2015. The overall concept and objectives are similar but instead of making it an environment exploring application, they use story books. They scan a marker (an image/icon) to trigger and open up the application. Then, a storybook will pop up and allow the children to read and interact with it. This project is very nice and inspiring. I learned something from this project, and it inspired me to develop my idea better. 

AR anatomy (mobile application)

I'm trying to find similar apps that allow a simulation/choosing option for storytelling purposes. As I have an idea for a refugee life simulation, I want to do more research on it. I found this application that teach people's about anatomy. They let user scan the book, and it will pop up 3D models of organs or whole human skeletons. This is actually similar to other senior's works which used the same concept and technology. 

I want to try it out but unfortunately, my phone cannot download it since this application is developed for older android versions. 

Week 2

AR Application Proposal

We have a consultation session with Mr.Razif to discuss on our proposal. For my ideas, the AR Colour Learning application is quite a fun idea, but it is not workable in this module. This idea needs to incorporate AI technology, but we are not going to learn this, so this idea cannot work. The next idea is about an AR game to play with friend; this idea is also fun but not applicable. As this also need to incorporate AI technology, so I cannot use this idea too. The last idea, AR Refugee Learning apps, is workable, but it needs a little bit of alteration. 

For Renee's idea, one of her idea is workable too, it's about a clue searching game, with the theme of building's history. We need to create 3D building, insert clues, and let user to find it inside the building. With the clues, they can discover the fun facts and history of the famous building. 

Since we need 3 proposals for assignment 1 for each of us, we decide to think of more ideas before choosing the one we will be creating for future assignments. 

I have an idea that I keep hidden before as I think it can't be developed during this module, but I decided it now to add into proposal. It's about women empowerment. The idea is creating a storybook full of illustration about inspiring women, users scan the illustration and it will open up the animation of different 3D models. Users can interact with the models to learn about history about women and women's contribution.

Idea: 

AR Trends

We started to have class exercise to learn more about AR. 

Class Exercise

Journey Map Group Activity

- we need to have a location, and we are to create a user journey map for that place

- we need to conclude AR solution to solve problem in the journey map

- include pain points, good sides and all

For our group, we do a student life in Taylor's University, it shows the journey of the student in a day. We each brainstorm for different activities and write down the points. We mentioned all kinds of the good side and bad side of the facilities, journey, and it indirectly showed our emotion as a user. The process is very fun as we all have some unique and weird ideas for our solution. We then present our journey map in the class. 

We decide to create an AR application for Taylor's University students only. Our main feature is having a cute mascot to guide users throughout the journey whether is in application or in real-life. We also have multiple time-tabling system to help our user to book or check the availability of the facilities. The features are in AR mode, for example, our mascot will be shown on user's phone, but the background is still in real-life environment. This way, our mascot can guide them walking through the whole school easily. 

What we are doing in this exercise is a current journey map, after we understand the current journey, we are to improve the experience, we will then create a future journey map. Our user experience will be greatly improved, so that the student life can get better. As you can see from below, the user journey is a lot smoother and happy. 

I found a useful tutorial that might be useful for me in the future while developing the application. 

Link: https://medium.com/@suleimanabdullah/making-ar-mysterious-game-in-unity3d-8b87b28f8086

AR Storybook

1. My Favourite Days

I want to explore more on AR storybook, as this is the most workable idea, that we can complete during this module. In Singapore, they created an AR storybook. How does it work? While the children are flipping the book, they will notice QR code at the bottom of the pages. They need to scan the QR code which will bring them to a facebook page and the AR effect will pop up. But, it is not only animation, children can actually interact with it, there are buttons provided, so the children can review the weather, colours and etc. Unfortunately, when I try to scan the QR code in the digital storybook version, the QR code is no longer activated, so I couldn't try it out myself. But from what I saw in the videos, Iwould say that this project is very interesting and it is very beneficial for children to learn on technologies. They objective is to use technology to teach children about technology. I like this idea a lot. 

Keynote:

- Using QR code to activate AR effect

- Interactable AR features

- Use technology to teach children about technology

Link: 

AR Storybook

my-favourite-days-e-copy.pdf

2. AR storybook for HEI Schools Senayan

First of all, the visuals are so cute, I really like it. In this project, they are trying to teach children about recycling in a storybook form. There will be 3D AR effect pop up, but unfortunately, it looks like it is not interactable. They show a little bit of process on how this is being done, and I found it encouraging and inspiring, hoping that I could do something nice like this. 

Keynote:

- Using Augmented Reality for an interactive children’s story book to encourage recycling

- Teach kids on what things they can make just by using leftover boxes

- Using Blender, Unity, Vuforia

Link:

New Age of AR in Children’s Storybook | by Sixty Two | Sixty Two Tales | Medium

Storybook Read Aloud

Week 3

AR Application Proposal

I have thought of new ideas as shown below. For the women empowerment idea, it has been in my mind for some time, but I feel like it is not good enough, so I did not show this idea to sir. For the horror game idea, I have been doing quite a number of horror theme projects, I feel like this is something I can do better with. So, I think of adding horror elements into daily home, how do I do that? Maybe a game? Through some brainstorming session, I finally come out with this idea, it is still not the final version, I will need to discuss with lecturer before finalize anything.

I have another idea about tarot, people like tarot readings. We can actually see it in our university, there are a lot of tarot reading stall from time to time, and it is always with customers. So, I try to incorporate AR into tarot reading, I do some research too. There are a lot of tarot reading application, and also an AR tarot cards (only cards). So far, there's no AR tarot that allow users to do tarot reading themselves at home. So, I try to develop a proposal that benefits people loves tarot reading, like me. 

Ideas:

We have another consultation session with Mr.Razif. 

AR Trends

Class Exercise

We have a class exercise. we need to choose a place to apply AR technology and we are to provide a simple prototype, to visualize the product. This is a group exercise, after some discussion, we decide our location to be at a hair salon. We use smart mirror to apply AR technology. The screen is on the mirror, and the user will interact with the mirror screen to change their hairstyle, colour and length. This allows user to communicate with the hair stylist more smoothly and to avoid any miscommunication. 

AR Smart Mirror:

We then have a small tutorial on using Unity with Vuforia, exploring AR function. First, we are to register into the Vuforia Engine, creating an account in it. By using the account, we download the Vuforia Engine, import into the Unity that we have previously downloaded. Now, we can use it to create AR objects. We import 3D objects and image cue; the 3D object will appear when the system scans the image. We then use our own phone to simulate the AR function. 

Using a cube:

Using a 3D machine hand that I've created previously: 

AR Tarot deck

I found AR tarot cards online, the logic behind is when user scan the card, whether in digital or physical card, it will reveal the readings or visuals of the card. It looks very interesting and fun to interact with. Unfortunately, I am not able to download their applications because it was not available anymore. 

Link: 

Tarot AR: Reveal the Tarot with just your camera

Home | Dale Forward

Online Tarot reading

This online tarot reading is really beautifully designed; it is functional too. The graphic and animation is smooth and clear. This showed me how digital tarot readings can be done. Even though this is not an AR application, this website serves a great case study for me to learn about digital tarot reading that user can done it alone. 

Link: TarotCards.io | Free Tarot & Psychic Readings With AI

Horror game AR

I didn't really play this game before, but I did watch the game streaming before. This is a really terrifying horror game, it has jump scare and creepy ambience that makes players scare and is on their nerve all the time. It serves as a good case study for me to learn about horror elements and how they transfer the elements into gaming efficiently. From the trailer video, I can see that it is indeed very scary and immersive. It feels like the horror character is directly chasing the players in real life. 

Link: 

Five Nights at Freddy's AR: Special Delivery -- Building jump scares in augmented reality | VentureBeat

Trailer

Week 4

AR Application Proposal

I have the last consultation for assignment 1 with Mr. Razif, my ideas are already complete, and the document looks fine. I just need to write a little bit more about the visual references. Below is my finalized idea proposal. 

Finalize Idea Proposal:

AR Trends

Class Exercise

Today, we continue last week's exercise. We learn to switch the build settings, from web to android (phone) version. This allows us to have clearer visuals on how the AR turn out. We need the event system to allow the button works; we can manually add it if we don't have it in the hierarchy. We learn to add button and add condition. So, when we click the 'hide' button, the 3d object will be hidden, while if we click 'show' button, it will show. 

AR Button (show and hide)

We then use the keyframe to create simple animation for the 3D objects. It will automatically play when we scan the image. 

AR Animation

We then use the button to control the animation. Either we control it together or one by one, and we can set whether we want two buttons appeared at the same time or not. 

AR Button (start and stop animation)

1. Both buttons appeared

2. Hide button version

3. AR Control both 3d Objects with different button

Reflection

I have learned a lot about augmented reality in this class, throughout this assignment. Besides having the lectures, we do research, critical thinking and brainstorming about augmented reality. We understand the concept of AR, the application of it, the benefits it brings to the society and how we can use it for our own good. By researching about AR, I know that there is a huge world outside that I have yet discovered, not only in AR but also VR and MR. This inspires me to keep on learning and explore more on these topics, to keep on improving my knowledges and also being updated about technologies in this world.

Throughout the assignment, I have a really fun time exploring different ideas. The brainstorming session and discussion with classmates have been fun, we keep on exploring new ideas and creativity. Even though some of the ideas is unable to work, I still have a great time thinking about solution. I want to thank my lecturer, Mr. Razif and my friends for guiding me during these few weeks. I appreciate every opinion and guidance given. Thank you.