Mr Zi Siang See

© 2017 Pacific Neighborhood Consortium (PNC). In this project, we are interested in providing and customizing a distributable workflow of virtual reality 360 (VR360) suitable for compassion relief operation. Recruiting volunteers for disaster operation can face a number of obstacles and issues, these include physically and mentally challenges for volunteers. Disaster workers are usually volunteers from across the country and across the world. Most operations involves logistics in terms of financial support, transportation, emergency response vehicles and provide the victims and communities shelter, food, clothing, relief supplies and even comfort to those in need. In an ideal situation, we are looking at setting up a manageable workflow which can be operated by workers of compassion relief organization in terms of simplified method and apparatus for acquiring and generating 360 virtual content. The content should be operated and produced by multiple small teams of minimum-trained taskforces which have the capability to obtain and processing these 360 content in digital media.

This demonstration presents the development of a mobile augmented reality (AR) murmur simulator that can be used for clinical teaching for medical trainees. Medical training often requires educators and trainees to work with vast amount of experience-based knowledge, hearing and recognizing murmurs is part of the fundamental training for medical students. In this study, we propose a wearable clothing system that is developed to work with mobile audible AR that provides heart murmurs simulation for facilitating medical learning experience.

© 2016 ACM. This paper presents the development of a mobile Augmented Reality (AR) heart rate murmur simulator that can be used for clinical teaching for medical trainees. Traditional medical training often requires the trainees to have hands on experience with real patients. However, it is not often possible to find certain types of heart murmurs with patients available for training. To overcome this limitation, we have developed a wearable clothing system using mobile audible AR that provides heart murmur simulation for facilitating medical learning experience. In this paper we describe the proposed system, a user evaluation study and directions for future work.

© 2016 IEEE. This paper presents an experimental method and apparatus of augmented reality (AR) for nDimensional (nD) building information modeling (BIM). BIM allows nD information to be visualized simultaneously by architects, engineers and constructors to gain a synchronized understanding viewing from different perspectives. However, BIM is conventionally being operated on a desktop-based computer which makes collaboration less flexible, and it also creates an isolation gap between the model and reality. This isolation gap does not severely affect experienced and skilled professionals, as they can bridge the isolation gap with their intuition developed over the years. Nevertheless, users who are lack of such experience will feel the isolation gap between the digital realm and practicable reality, which could be the hurdle in project participation and decision making. AR allows virtual content to be mixed with real environment for user experience. In the context of our study, AR is functional to present the nD information of BIM, at the same time retaining users' connection with the reality. It is not just being utilized solely for presentation, but also to maximize the potential for communication, interaction and experience. This pilot study investigates effective technological approach of using AR as an effective collaboration technology combining with BIM through proposed key aspects of contextualization, customization and curation. Contextualization is significant to enable users to understand the AR content by making the presented information meaningful to the target audience, implemented thru the means of 2D annotations, animations and options comparison. This study compares both AR BIM with and without contextualization. Customization can generate unique virtual environment and content for different level of users tailored to their needs and preference to create intuitive interaction with AR BIM. Curation is crucial to provide users with a reliable experience, and to formulate a continually improving AR BIM thru log data and users' feedback. All in all, this paper explores the major aspects of contextualization, customization and curation, to distinguish effective approach in the currently 'free for all' AR BIM development. Finally, an implication is provided for future study in terms of balance in information sufficiency and complexity for AR BIM.

© 2016 IEEE. A peppergram allows a user to experience a visual image floating in the air. This paper explores how to add interactive controls to a peppergram. An investigation was conducted to explore the suitability of two different integrative methods for navigating a peppergram as a multimedia presentation tool; a Myo armband, and touch screen input. These methods were used with prototype 3D visual images experienced on a high-resolution mobile tablet device. A pilot study was conducted to evaluate the user experience. We found that using freehand gesture input with the Myo could be one way to provide interaction with peppergram virtual content without requiring any touch input. These results could be used as the basis for further development of interactive peppergram displays.

This demonstration presents an experimental method and apparatus configuration for producing spherical panoramas with high dynamic range imaging (HDRI). Our method is optimized for providing high fidelity augmented reality (AR) image-based environment recognition for mobile devices. We developed HDRI method that requires single acquisition which extends dynamic range from digital negative, this approach is to be used for multiple angles necessary for reconstructing accurately reproduced spherical panorama with sufficient luminance.

This paper presents an experimental method and apparatus for producing spherical panoramas with high dynamic range imaging (HDRI). Our method is optimized for providing high fidelity augmented reality (AR) image-based environment recognition for mobile devices. Previous studies have shown that a pre-produced panorama image can be used to make AR tracking possible for mobile AR applications. However, there has been little research on determining the qualities of the source panorama image necessary for creating high fidelity AR experiences. Panorama image production can have various challenges that can result in inaccurate reproduction of images that do not allow correct virtual graphics to be registered in the AR scene. These challenges include using multiple angle photograph images that contain parallax error, nadir angle difficulty and limited dynamic range. For mobile AR, we developed a HDRI method that requires a single acquisition that extends the dynamic range from a digital negative. This approach that needs least acquisition time is to be used for multiple angles necessary for reconstructing accurately reproduced spherical panorama with sufficient luminance.

The paper examines the imagery information and the qualitative characteristic of archiving non-bias architectural image using High Dynamic Range (HDR) imaging approach. Photography imaging became possible in the period of 19 century, it was a combination of several different scientific discoveries. Architectural photo imaging began with monochrome recording limitation, and the dynamic range recorded was inadequate even with analog color film. Often it was arguable if the photography image would provide reliable imagery information, either for aesthetic visualization purpose or to record accurate imagery information. The paper aims to analyze the limitations and issues that affect visual accuracy of HDR imaging digital workflow, including the environmental technical obstacles. Due to the situations of very contrast lighting condition, the extended dynamic range may be needed for archiving the real-world scene of architectural subject. The paper also explores the possibility of HDR imaging as an improved approach for non-bias architectural imaging archive. © 2011 IEEE.