2018 |
Santano D, See ZS, Fong CH, Thwaites H, 'Aerial virtual reality 360 research-creation', Proceedings of the 2017 23rd International Conference on Virtual Systems and Multimedia, VSMM 2017 (2018)
© 2017 IEEE. This paper presents a development of an aerial virtual reality 360 video capture approach. A drone was converted and retrofitted with a 360 spherical panorama camera ... [more]
© 2017 IEEE. This paper presents a development of an aerial virtual reality 360 video capture approach. A drone was converted and retrofitted with a 360 spherical panorama camera for acquiring source aerial visual content. In this case study, an experiment of a 360-fly-by video was reproduced for the intended use of an event launching where user perception was being observed in terms of practicality and suitability. Utilizing a consumer 360 camera the Samsung Gear 360 and the DJI Inspire 1, it allowed the researcher to capture aerial 360-degree video. The paper documented the process of retrofitting the 360-camera onto the drone. Research findings on why certain drones are suitable for the 360-degree camera will be presented. A user study was conducted to gauge the usability for comparing aerial VR360 being experienced on hand-held multimedia tablets and head-mount-devices (HMD). In this paper we describe the proposed configuration and workflow of aerial 360-video and identifying its potential capabilities and limitation, a user evaluation study and directions for future work.
|
|
|
2018 |
See ZS, Xia Sheng L, Brimo A, Thwaites H, Goodman L, 'MOOC for AR VR Training', 2018 IEEE Games, Entertainment, Media Conference (GEM), Ireland (2018)
|
|
|
2018 |
See Z, Santano D, Fong CH, Thwaites H, 'Tomb of a Sultan: A VR Digital Heritage Approach', Digital Heritage 2018 3rd International Congress & Expo, San Francisco (2018) |
|
|
2017 |
See ZS, Sunar MS, Billinghurst M, Dey A, Santano D, Esmaeili H, Thwaites H, 'Demo: Exhibition Approach Using an AR and VR Pillar', SA'17: SIGGRAPH ASIA 2017 MOBILE GRAPHICS & INTERACTIVE APPLICATIONS, Los Angeles, CA (2017)
|
|
|
2017 |
See Z, Billinghurst M, Dey A, Santano D, Esmaeili H, Thwaites H, 'An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective Exploration', https://diglib.eg.org/handle/10.2312/2631902, Adelaide (2017)
|
|
|
2017 |
See ZS, Blundell D, Thwaites H, 'Virtual reality 360 content preservation for disaster relief', Proceedings of the 2017 Pacific Neighborhood Consortium Annual Conference and Joint Meetings: Data Informed Society, PNC 2017 (2017)
© 2017 Pacific Neighborhood Consortium (PNC). In this project, we are interested in providing and customizing a distributable workflow of virtual reality 360 (VR360) suitable for ... [more]
© 2017 Pacific Neighborhood Consortium (PNC). In this project, we are interested in providing and customizing a distributable workflow of virtual reality 360 (VR360) suitable for compassion relief operation. Recruiting volunteers for disaster operation can face a number of obstacles and issues, these include physically and mentally challenges for volunteers. Disaster workers are usually volunteers from across the country and across the world. Most operations involves logistics in terms of financial support, transportation, emergency response vehicles and provide the victims and communities shelter, food, clothing, relief supplies and even comfort to those in need. In an ideal situation, we are looking at setting up a manageable workflow which can be operated by workers of compassion relief organization in terms of simplified method and apparatus for acquiring and generating 360 virtual content. The content should be operated and produced by multiple small teams of minimum-trained taskforces which have the capability to obtain and processing these 360 content in digital media.
|
|
|
2016 |
See ZS, Rengganaten V, Billinghurst M, Soo S, 'Demo: Mobile audible AR experience for medical learning murmurs simulation', SA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications (2016)
This demonstration presents the development of a mobile augmented reality (AR) murmur simulator that can be used for clinical teaching for medical trainees. Medical training often... [more]
This demonstration presents the development of a mobile augmented reality (AR) murmur simulator that can be used for clinical teaching for medical trainees. Medical training often requires educators and trainees to work with vast amount of experience-based knowledge, hearing and recognizing murmurs is part of the fundamental training for medical students. In this study, we propose a wearable clothing system that is developed to work with mobile audible AR that provides heart murmurs simulation for facilitating medical learning experience.
|
|
|
2016 |
See ZS, Rengganaten V, Billinghurst M, Soo S, 'Medical learning murmurs simulation with mobile audible augmented reality', SA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications (2016)
© 2016 ACM. This paper presents the development of a mobile Augmented Reality (AR) heart rate murmur simulator that can be used for clinical teaching for medical trainees. Traditi... [more]
© 2016 ACM. This paper presents the development of a mobile Augmented Reality (AR) heart rate murmur simulator that can be used for clinical teaching for medical trainees. Traditional medical training often requires the trainees to have hands on experience with real patients. However, it is not often possible to find certain types of heart murmurs with patients available for training. To overcome this limitation, we have developed a wearable clothing system using mobile audible AR that provides heart murmur simulation for facilitating medical learning experience. In this paper we describe the proposed system, a user evaluation study and directions for future work.
|
|
|
2016 |
Lee XS, Khamidi MF, See ZS, Lees TJ, Chai C, 'Augmented reality for ndimensional building information modelling: Contextualization, Customization and Curation', Proceedings of the 2016 International Conference on Virtual Systems and Multimedia, VSMM 2016 (2016)
© 2016 IEEE. This paper presents an experimental method and apparatus of augmented reality (AR) for nDimensional (nD) building information modeling (BIM). BIM allows nD informatio... [more]
© 2016 IEEE. This paper presents an experimental method and apparatus of augmented reality (AR) for nDimensional (nD) building information modeling (BIM). BIM allows nD information to be visualized simultaneously by architects, engineers and constructors to gain a synchronized understanding viewing from different perspectives. However, BIM is conventionally being operated on a desktop-based computer which makes collaboration less flexible, and it also creates an isolation gap between the model and reality. This isolation gap does not severely affect experienced and skilled professionals, as they can bridge the isolation gap with their intuition developed over the years. Nevertheless, users who are lack of such experience will feel the isolation gap between the digital realm and practicable reality, which could be the hurdle in project participation and decision making. AR allows virtual content to be mixed with real environment for user experience. In the context of our study, AR is functional to present the nD information of BIM, at the same time retaining users' connection with the reality. It is not just being utilized solely for presentation, but also to maximize the potential for communication, interaction and experience. This pilot study investigates effective technological approach of using AR as an effective collaboration technology combining with BIM through proposed key aspects of contextualization, customization and curation. Contextualization is significant to enable users to understand the AR content by making the presented information meaningful to the target audience, implemented thru the means of 2D annotations, animations and options comparison. This study compares both AR BIM with and without contextualization. Customization can generate unique virtual environment and content for different level of users tailored to their needs and preference to create intuitive interaction with AR BIM. Curation is crucial to provide users with a reliable experience, and to formulate a continually improving AR BIM thru log data and users' feedback. All in all, this paper explores the major aspects of contextualization, customization and curation, to distinguish effective approach in the currently 'free for all' AR BIM development. Finally, an implication is provided for future study in terms of balance in information sufficiency and complexity for AR BIM.
|
|
|
2016 |
Fong CH, Billinghurst M, See ZS, Esmaeili H, 'PepperGram with interactive control', Proceedings of the 2016 International Conference on Virtual Systems and Multimedia, VSMM 2016 (2016)
© 2016 IEEE. A peppergram allows a user to experience a visual image floating in the air. This paper explores how to add interactive controls to a peppergram. An investigation was... [more]
© 2016 IEEE. A peppergram allows a user to experience a visual image floating in the air. This paper explores how to add interactive controls to a peppergram. An investigation was conducted to explore the suitability of two different integrative methods for navigating a peppergram as a multimedia presentation tool; a Myo armband, and touch screen input. These methods were used with prototype 3D visual images experienced on a high-resolution mobile tablet device. A pilot study was conducted to evaluate the user experience. We found that using freehand gesture input with the Myo could be one way to provide interaction with peppergram virtual content without requiring any touch input. These results could be used as the basis for further development of interactive peppergram displays.
|
|
|
2016 |
Lee XS, Yan CP, See ZS, 'Irregular Shaped Building Design Optimization with Building Information Modelling', 4TH INTERNATIONAL BUILDING CONTROL CONFERENCE 2016 (IBCC 2016), Kuala Lumpur, MALAYSIA (2016)
|
|
|
2015 |
See ZS, Billinghurst M, Cheok AD, 'Augmented reality using high fidelity spherical panorama with HDRI-demonstration', SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, SA 2015 (2015)
This demonstration presents an experimental method and apparatus configuration for producing spherical panoramas with high dynamic range imaging (HDRI). Our method is optimized fo... [more]
This demonstration presents an experimental method and apparatus configuration for producing spherical panoramas with high dynamic range imaging (HDRI). Our method is optimized for providing high fidelity augmented reality (AR) image-based environment recognition for mobile devices. We developed HDRI method that requires single acquisition which extends dynamic range from digital negative, this approach is to be used for multiple angles necessary for reconstructing accurately reproduced spherical panorama with sufficient luminance.
|
|
|
2015 |
See ZS, Billinghurst M, Cheok AD, 'Augmented reality using high fidelity spherical panorama with HDRI', SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, SA 2015 (2015)
This paper presents an experimental method and apparatus for producing spherical panoramas with high dynamic range imaging (HDRI). Our method is optimized for providing high fidel... [more]
This paper presents an experimental method and apparatus for producing spherical panoramas with high dynamic range imaging (HDRI). Our method is optimized for providing high fidelity augmented reality (AR) image-based environment recognition for mobile devices. Previous studies have shown that a pre-produced panorama image can be used to make AR tracking possible for mobile AR applications. However, there has been little research on determining the qualities of the source panorama image necessary for creating high fidelity AR experiences. Panorama image production can have various challenges that can result in inaccurate reproduction of images that do not allow correct virtual graphics to be registered in the AR scene. These challenges include using multiple angle photograph images that contain parallax error, nadir angle difficulty and limited dynamic range. For mobile AR, we developed a HDRI method that requires a single acquisition that extends the dynamic range from a digital negative. This approach that needs least acquisition time is to be used for multiple angles necessary for reconstructing accurately reproduced spherical panorama with sufficient luminance.
|
|
|
2014 |
Xia Sheng L, Ching Hua L, Shyn Yi C, Zi Siang S, See Z, 'Architectural Transformation of a Night Market Stall', https://www.researchgate.net/profile/Lee_Sheng2/publication/282570841_Architectural_Transformation_of_a_Night_Market_Stall/links/56123b4308ae4833751bda18.pdf, Universiti Teknologi Mara (2014) |
|
|
2011 |
See Z, 'Non-bias Scientific Imaging Archive for Urban Morphology Research', Universiti Teknologi Malaysia (2011) |
|
|
2011 |
See ZS, Sheng LX, 'Non-bias architectural image archive using High Dynamic Range approach', 2011 International Conference on Research and Innovation in Information Systems, ICRIIS'11 (2011)
The paper examines the imagery information and the qualitative characteristic of archiving non-bias architectural image using High Dynamic Range (HDR) imaging approach. Photograph... [more]
The paper examines the imagery information and the qualitative characteristic of archiving non-bias architectural image using High Dynamic Range (HDR) imaging approach. Photography imaging became possible in the period of 19 century, it was a combination of several different scientific discoveries. Architectural photo imaging began with monochrome recording limitation, and the dynamic range recorded was inadequate even with analog color film. Often it was arguable if the photography image would provide reliable imagery information, either for aesthetic visualization purpose or to record accurate imagery information. The paper aims to analyze the limitations and issues that affect visual accuracy of HDR imaging digital workflow, including the environmental technical obstacles. Due to the situations of very contrast lighting condition, the extended dynamic range may be needed for archiving the real-world scene of architectural subject. The paper also explores the possibility of HDR imaging as an improved approach for non-bias architectural imaging archive. © 2011 IEEE.
|
|
|