Dr Zi Siang See

Dr Zi Siang See

Lecturer

School of Creative Industries

Career Summary

Biography

Dr Zi Siang See has specialised over the past 10 years in the design, use and integration of interactive media, including but not limited to augmented reality (AR) and virtual reality (VR) research-creation. Zi has over 15 years’ experience of working within the field of interaction design and digital media in both industry and within university institutions, nationally and internationally. These include collaborations with multinational corporations such as McDonald’s, Lafarge Cement, Servier, Leo Burnett, DDB and Saatchi & Saatchi Arachnid. As an early career researcher, he has been part of various MOOC projects and been actively involved in scholarly research and international collaborations. His work has contributed to new systems, theory and studies in human-computer-interaction, education technologies and inclusive design. Some of these technical research papers were published at specialised venues such as SIGGRAPH, IEEE Virtual Systems and Multimedia (VSMM), and the Springer’s Virtual Reality. Zi is part of the International Society on Virtual Systems and Multimedia (VSMM) as a Board of Directors committee member, supporting VSMM conferences and as a reviewer, in which role he has co-organised a number of collaborations and research workshops in VSMM. He is also the guest editor and a member of the Editorial Board for Virtual Creativity (Intellect Books), a Scopus-indexed international journal focused on emerging technologies and digital creativity. Zi completed his Ph.D. at the University of Newcastle, he has trained under the guidance of Prof Lizbeth Goodman (SMARTlab), Prof Mark Billinghurst (Emphatic Computing Lab / HIT Lab NZ), and supported by A/Prof Craig Hight (SOCI). As part of the research for his doctoral thesis focused on human-computer interaction aspects of virtual reality titled Creating High Dynamic Range Spherical Panorama Images for High Fidelity 360 Degree Virtual Reality, Zi developed a method and apparatus solution for creating high fidelity virtual reality 360 (VR360) that is free from major imaging errors and obstacles. Currently, Zi is also working on extended reality (XR) research projects in digital heritage, medical and health sciences training. 

On-going Research Projects and Collaborations:

  • XR Interactive Wall: AR VR Technical Development and UX Design
  • Sodeisha VR: Please Touch (in collaboration with Newcastle Art Gallery)
  • This Land AR: A Transmedia Audible Experience (Aboriginal / Torres Strait Islander Context)
  • Inclusive Virtual Reality Museum Gallery (collaboration with the Center for Inclusive Design)
  • Victoria Theatre VR: Technical and Interaction Design Study 
  • Tomb of a Sultan: A Digital Heritage VR Experience
  • Park Bench Sojourn VR: Extended Reality for Good
  • Aerial VR360
  • Virtual Reality 360 Content Preservation for Disaster Relief
  • MOOC for AR VR Training
  • XR Andragogy
  • Co-designed VR and AR solutions for the empowerment of SMARTageing communities
  • Building Information Modeling AR VR
  • Electronic Cultural Atlas Initiative (ECAI)
  • Medical Learning AR VR: Simulation, Contextualisation, and Visualisation

Professional Contribution and Involvement:

More:

Teaching Expertise

  • Interaction and UX Design
  • Extended Reality: Augmented Reality (AR) and Virtual Reality (VR)
  • Multimedia Design and Applications
  • Designing for and Conceptualising Game Play

Qualifications

  • Doctor of Philosophy, University of Newcastle
  • Bachelor of Multimedia, Multimedia University, Malaysia
  • Master of Science, Multimedia University, Malaysia

Keywords

  • Augmented Reality
  • Computational Photography
  • Creative Advertising
  • Creative Technology
  • Digital Media
  • Human Computer Interaction
  • Inclusive Design
  • Interaction Design
  • Multimedia
  • Serious Games
  • User Experience
  • Virtual Reality
  • Visual Programming

Languages

  • English (Working)

Fields of Research

Code Description Percentage
080602 Computer-Human Interaction 20
080111 Virtual Reality and Related Simulation 30
190205 Interactive Media 50
Edit

Publications

For publications that are currently unpublished or in-press, details are shown in italics.

Journal article (8 outputs)

Year Citation Altmetrics Link
2020 Matthews B, See ZS, Day J, 'Crisis and extended realities: remote presence in the time of COVID-19', Media International Australia, 1329878X2096716-1329878X2096716 (2020)
DOI 10.1177/1329878x20967165
Co-authors Ben Matthews
2020 See ZS, Matthews B, Goodman L, Jones D, Hight C, Egglestone P, et al., 'Extended Reality Interactive Wall: User Experience Design Research-Creation', Virtual Creativity, (2020)
Co-authors Paul Egglestone, Donovan Jones, Ben Matthews, Craig Hight
2019 See ZS, Goodman L, Hight C, Sunar MS, Dey A, Yen Kaow N, Billinghurst M, 'Creating High Fidelity 360° Degree Virtual Reality with High Dynamic Range Spherical Panorama Images', Virtual Creativity, 9 73-109 (2019) [C1]
DOI 10.1386/vcr_00006_1
Citations Scopus - 1
Co-authors Craig Hight
2019 Harold T, Delas S, Human E, See ZS, 'A Malaysian Cultural Heritage Digital Compendium', Digital Applications in Archaeology and Cultural Heritage, 15 1-8 (2019) [C1]
DOI 10.1016/j.daach.2019.e00116
Citations Scopus - 2
2018 See ZS, Sunar MS, Kusnayat A, Aziz KA, 'Interactive panorama VR360 for corporate communications: An industrial scenario case study', International Journal of Integrated Engineering, 10 169-177 (2018)
Citations Scopus - 3Web of Science - 1
2018 Santano D, See ZS, Fong CH, Thwaites H, 'Up in the air with vr360', Virtual Creativity, 8 59-73 (2018) [C1]

© 2018 Intellect Ltd Article. Both drones and 360-degree video (VR 360) have been attractive topics for the past decade. 360-degree videos hit Internet fame as soon as YouTube and... [more]

© 2018 Intellect Ltd Article. Both drones and 360-degree video (VR 360) have been attractive topics for the past decade. 360-degree videos hit Internet fame as soon as YouTube and Facebook started to adopt them into their ecosystem, which made users familiar with and intrigued by these techniques. This definitely made the camera industry race to democratize 360-degree cameras, and now we are graced with affordable, out-of-the-box 360 cameras from Samsung, Ricoh, and Garmin, to Nikon. The company DJI has been the leading drone manufacturer since their first quadcopter captivated our imagination and love of playing with remote control toys in our young age. With this same adventurous and imaginative mindset, we embarked on combining the two technologies: 360-degree cameras and aerial drones. In this article we present the development of an approach to an aerial virtual reality 360 video capture technique. We retrofitted a drone with a 360 spherical panorama camera for acquiring source aerial visual content. Our case study, as described in this article, reproduces an experiment using a 360-fly-by video for the intended use of an event launching in which user perception was being observed in terms of practicality and suitability A user study was conducted to gauge the usability of comparing aerial VR360 being experienced on hand-held multimedia tablets and head-mount-devices (HMD). We also describe the proposed configuration and workflow of aerial 360-video and identify its potential capabilities and limitations, a user evaluation study and directions for future work. In the discussion section, we share how this setup can affect the decisions of the producer, director or the director photography in achieving the creative shot that they aim to produce.

DOI 10.1386/vcr.8.1.59_1
2015 See ZS, Cheok AD, 'Virtual reality 360 interactive panorama reproduction obstacles and issues', Virtual Reality, 19 71-81 (2015)
DOI 10.1007/s10055-014-0258-9
Citations Scopus - 8Web of Science - 6
2012 See ZS, Khairul H, Harold T, Xia Sheng L, Wooi Har O, 'Retrieving Extended High Dynamic Range From Digital Negative Image - An Experiment On Architectural Photo Imaging', World Academy of Science, Engineering and Technology, 6 (2012)
Show 5 more journal articles

Conference (27 outputs)

Year Citation Altmetrics Link
2020 Lee XS, See ZS, Chai C, Fan S-L, Essah E, 'Empathy in BIM-based Virtual Reality for Barrier-Free Built Environment', University of Newcastle (2020)
2020 Sansom M, See ZS, 'Translating Experience: from Mediated Performance Art to VR', University of Newcastle (2020)
2020 Manning A, See ZS, Egglestone P, Pati D, '360 Live at The Conservatorium: How do Musicians New To a 360-Performance Geometry Re-Contextualise Their Art?', University of Newcastle (2020)
Co-authors Adam Manning
2019 Matthias P, Billinghurst M, See ZS, 'This Land AR: an Australian Music and Sound XR Installation', The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry on - VRCAI '19, Australia (2019) [E1]
DOI 10.1145/3359997.3365740
Co-authors Philip Matthias
2019 See ZS, Rey U, Neilson F, Cuneo M, Barnes-Keoghan A, O'Donnell L, et al., 'Sodeisha Sculptural Ceramics: Digitalization and VR Interaction', The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry on - VRCAI '19, Australia (2019) [E1]
DOI 10.1145/3359997.3365741
Co-authors Sarah Johnson, Una Rey, Faye Neilson, Donovan Jones
2019 Jones D, See Z, Billinghurst M, Goodman L, Fealy S, 'Extended Reality for Midwifery Learning: MR VR Demonstration', Proceedings of VRCAI '19: The 17th International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI '19), Brisbane, Queensland (2019) [E1]
DOI 10.1145/3359997.3365739
Citations Scopus - 1
Co-authors Donovan Jones, Shanna Fealy
2019 See Z, Santano D, Fong CH, Thwaites H, 'Tomb of a Sultan: A VR Digital Heritage Approach', 2018 3rd Digital Heritage International Congress (DigitalHERITAGE) held jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018), San Francisco (2019) [E1]
DOI 10.1109/DigitalHeritage.2018.8810083.
Citations Scopus - 2
2019 See ZS, 'Exploring Extended Reality Experiences: Recent Research Contribution', University of Newcastle, NSW (2019)
2019 See ZS, Rey U, Neilson F, Cuneo M, Barnes-Keoghan A, O Donnell L, et al., 'Sodeisha Avant-grade Ceramic: High Fidelity Digitization, Virtual Reality, and Interaction Design', Singapore (2019)
Co-authors Faye Neilson, Una Rey, Donovan Jones
2019 Lizbeth G, Tara M, See ZS, Wooi Har O, Craig H, 'Mapping Identity in Real and Virtual Format: AR Map of Me', Sydney (2019)
2019 Lizbeth G, See ZS, Wooi Har O, Craig H, Mark B, 'Co-designed VR and AR solutions for empowerment of SMARTageing communities', Sydney (2019)
2018 Santano D, See ZS, Fong CH, Thwaites H, 'Aerial virtual reality 360 research-creation', Proceedings of the 2017 23rd International Conference on Virtual Systems and Multimedia, VSMM 2017 (2018)

© 2017 IEEE. This paper presents a development of an aerial virtual reality 360 video capture approach. A drone was converted and retrofitted with a 360 spherical panorama camera ... [more]

© 2017 IEEE. This paper presents a development of an aerial virtual reality 360 video capture approach. A drone was converted and retrofitted with a 360 spherical panorama camera for acquiring source aerial visual content. In this case study, an experiment of a 360-fly-by video was reproduced for the intended use of an event launching where user perception was being observed in terms of practicality and suitability. Utilizing a consumer 360 camera the Samsung Gear 360 and the DJI Inspire 1, it allowed the researcher to capture aerial 360-degree video. The paper documented the process of retrofitting the 360-camera onto the drone. Research findings on why certain drones are suitable for the 360-degree camera will be presented. A user study was conducted to gauge the usability for comparing aerial VR360 being experienced on hand-held multimedia tablets and head-mount-devices (HMD). In this paper we describe the proposed configuration and workflow of aerial 360-video and identifying its potential capabilities and limitation, a user evaluation study and directions for future work.

DOI 10.1109/VSMM.2017.8346262
2018 See ZS, Xia Sheng L, Brimo A, Thwaites H, Goodman L, 'MOOC for AR VR Training', 2018 IEEE Games, Entertainment, Media Conference (GEM), Ireland (2018) [E1]
DOI 10.1109/GEM.2018.8516514
Citations Scopus - 2
2018 See ZS, 'MOOC for AR VR Training', University of Newcastle, NSW (2018)
2017 See ZS, Sunar MS, Billinghurst M, Dey A, Santano D, Esmaeili H, Thwaites H, 'Demo: Exhibition approach using an AR and VR pillar', SIGGRAPH Asia 2017 Mobile Graphics and Interactive Applications, SA 2017, Thailand (2017)
DOI 10.1145/3132787.3132810
Citations Scopus - 1Web of Science - 1
2017 See ZS, Blundell D, Thwaites H, 'Virtual Reality 360 Content Preservation for Disaster Relief', Proceedings of the 2017 Pacific Neighborhood Consortium Annual Conference and Joint Meetings: Data Informed Society, PNC 2017, Taiwan (2017)
DOI 10.23919/PNC.2017.8203540
2017 See Z, Billinghurst M, Dey A, Santano D, Esmaeili H, Thwaites H, 'An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective Exploration', https://diglib.eg.org/handle/10.2312/2631902, Adelaide (2017)
DOI 10.2312/egve.20171342
Citations Scopus - 1
2016 See ZS, Rengganaten V, Billinghurst M, Soo S, 'Demo: Mobile audible AR experience for medical learning murmurs simulation', SA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, Kobe, Japan (2016)
DOI 10.1145/2999508.2999513
Citations Scopus - 3
2016 See ZS, Rengganaten V, Billinghurst M, Soo S, 'Medical learning murmurs simulation with mobile audible augmented reality', SA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, Macao (2016)
DOI 10.1145/2999508.2999527
Citations Scopus - 3
2016 Lee XS, Khamidi MF, See ZS, Lees TJ, Chai C, 'Augmented reality for ndimensional building information modelling: Contextualization, Customization and Curation', Proceedings of the 2016 International Conference on Virtual Systems and Multimedia, VSMM 2016, Kuala Lumpur (2016)
DOI 10.1109/VSMM.2016.7863152
Citations Scopus - 2
2016 Fong CH, Billinghurst M, See ZS, Esmaeili H, 'PepperGram with interactive control', Proceedings of the 2016 International Conference on Virtual Systems and Multimedia, VSMM 2016, Kuala Lumpur (2016)
DOI 10.1109/VSMM.2016.7863172
Citations Scopus - 2
2016 Lee XS, Yan CP, See ZS, 'Irregular Shaped Building Design Optimization with Building Information Modelling', MATEC Web of Conferences, Malaysia (2016)
DOI 10.1051/matecconf/20166600027
Citations Scopus - 2Web of Science - 2
2015 See ZS, Billinghurst M, Cheok AD, 'Augmented reality using high fidelity spherical panorama with HDRI', SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, SA 2015, Kobe, Japan (2015)
DOI 10.1145/2818427.2818445
Citations Scopus - 1
2015 See ZS, Billinghurst M, Cheok AD, 'Augmented reality using high fidelity spherical panorama with HDRI-demonstration', SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, SA 2015, Japan (2015)
DOI 10.1145/2818427.2819696
Citations Scopus - 2
2014 Xia Sheng L, Ching Hua L, Shyn Yi C, Zi Siang S, See Z, 'Architectural Transformation of a Night Market Stall', https://www.researchgate.net/profile/Lee_Sheng2/publication/282570841_Architectural_Transformation_of_a_Night_Market_Stall/links/56123b4308ae4833751bda18.pdf, Universiti Teknologi Mara (2014)
2011 See ZS, Sheng LX, 'Non-bias architectural image archive using High Dynamic Range approach', 2011 International Conference on Research and Innovation in Information Systems, ICRIIS'11, Kuala Lumpur (2011)
DOI 10.1109/ICRIIS.2011.6125720
2011 See Z, 'Non-bias Scientific Imaging Archive for Urban Morphology Research', Universiti Teknologi Malaysia (2011)
Show 24 more conferences

Creative Work (13 outputs)

Year Citation Altmetrics Link
2020 Kenke R, Anelli L, Wright R, Minichiello M, Drummond J, O'Donnell L, et al., The House We Build, Newcastle, NSW (2020) [J1]
Co-authors Rewa Wright, Jon Drummond, Jack Mcgrath, Mario Minichiello, Ralph Kenke, Nathan Scott, Paul Egglestone
2019 Rey U, See ZS, Neilson F, Cuneo M, Barnes-Keoghan A, O'Donnell L, et al., Please Touch: a virtual engagement with Sodeisha sculptural ceramics, Newcastle Art Gallery, Australia (2019)
Co-authors Faye Neilson, Una Rey, Donovan Jones
2018 See Z, Thwaites H, Sultan Hussin Shah Tomb: A VR Museum Experience, Digital Heritage 2018 3rd International Congress & Expo, San Francisco (2018)
2017 Matthew S, See Z, Park Bench Sojourn VR, Sunway University (2017)
2017 See Z, Delas S, Aerial 360, iLabs, Kuala Lumpur (2017)
2017 Harold T, See Z, Makam Sultan Hussin Shah (2017)
2017 See Z, Delas S, Human E, Harold T, Virtual Reality Museum, Sunway University, Kuala Lumpur (2017)
2016 See Z, Delas S, Human E, Harold T, AR and VR Pillar: Pangkorboat Builders, International Conference on Visual Systems & Multimedia (VSMM2016) (2016)
2014 See Z, The Beauty of Horizon, Exhibition, Kuala Lumpur (2014)
2013 See Z, Lay Geng L, Zi Ping S, Sri KDU Virtual Reality 360 Digital Tour (2013)
2013 See Z, Lay Geng L, Zi Ping S, Puei Keng O, INTI Virtual Reality 360 (2013)
2003 See Z, Japan International Photo Panel Exhibition, Kuala Lumpur (2003)
2003 See Z, Motion of the Sun - Bon Odori, Japan Foundation, Kuala Lumpur (2003)
Show 10 more creative works

Report (1 outputs)

Year Citation Altmetrics Link
2020 Matthews B, See ZS, Orr N, 'XR and Creativity Symposium Report: Transformative Technologies for Good', School of Creative Industry, 18 (2020)
Co-authors Ben Matthews
Edit

Grants and Funding

Summary

Number of grants 10
Total funding $150,896

Click on a grant title below to expand the full details for that specific grant.

20211 grants / $5,000

2021 Faculty of Education and Arts New Staff Grant$5,000

High-fidelity Nature VR: An Interaction Design and Extended Reality Study

Funding body: Faculty of Education and Arts, University of Newcastle

Funding body Faculty of Education and Arts, University of Newcastle
Scheme New Staff Grant
Role Lead
Funding Start 2021
Funding Finish 2021
GNo
Type Of Funding Internal
Category INTE
UON N

20203 grants / $94,896

Media and Entertainment Research Centre (MERCury) establishment program$70,000

Funding body: Faculty of Education and Arts, University of Newcastle

Funding body Faculty of Education and Arts, University of Newcastle
Project Team

Dr Simon Weaving (Lead); A/Prof Craig Hight; Dr Simone O'Callaghan; Dr Jane Shadbolt; Dr Ben Matthews; Dr Stuart McBratney; Mr Jack McGrath; Dr Zi Siang See; Claire Pasvolsky; Karen Nobes; Prof Richard Vella.
Scheme Research Programs Pilot Scheme
Role Investigator
Funding Start 2020
Funding Finish 2021
GNo
Type Of Funding Internal
Category INTE
UON N

ECR Inclusive Transformative Technology Scrum$14,896

Funding body: Faculty of Education and Arts, University of Newcastle

Funding body Faculty of Education and Arts, University of Newcastle
Project Team

Dr Benjamin Matthews (Lead), Dr Rewa Wright, Mr Zi Siang See, Dr Jamin Day, Ms Shanna Fealy, Dr Donovan Jones and Mr Adam Manning
Scheme Strategic Network and Pilot Project Grants Scheme
Role Investigator
Funding Start 2020
Funding Finish 2020
GNo
Type Of Funding Internal
Category INTE
UON N

RAPID$10,000

This human-computer-interaction (HCI) research will lead to the creation of SafeSpace VR: an assistive technology based virtual reality (VR) simulation that supports VR users and also school-age children to learn new emotion-focused skills based around mindfulness, emotion regulation and compassion in a low-risk environment.

Funding body: School of Creative Industries, Factulty of Education and Arts, University of Newcastle

Funding body School of Creative Industries, Factulty of Education and Arts, University of Newcastle
Project Team

Zi Siang See, Jamin Day, Benjamin Matthews, Jack McGrath
Scheme RAPID
Role Lead
Funding Start 2020
Funding Finish 2021
GNo
Type Of Funding Internal
Category INTE
UON N

20192 grants / $13,000

RAPID$10,000

‘This Land AR’ is a transmedia initiative, comprising an Augmented Reality (AR) Indigenous music, visual and sound installation. It also involves the use of an extended reality (XR) interactive approach to augment audible elements in a public exhibition at the Newcastle Art Gallery. 

Funding body: School of Creative Industries

Funding body School of Creative Industries
Project Team

Philip Matthias, Zi Siang See, Helena Bezzina, Akur Meta, Lauretta Morton, Toby Whaleboat
Scheme RAPID
Role Investigator
Funding Start 2019
Funding Finish 2020
GNo
Type Of Funding Internal
Category INTE
UON N

iLead New Media$3,000

Funding body: UON Global

Funding body UON Global
Project Team

Simon Weaving, Benjamin Matthews, Zi Siang See
Scheme iLead
Role Investigator
Funding Start 2019
Funding Finish 2019
GNo
Type Of Funding Internal
Category INTE
UON N

20182 grants / $12,000

RAPID$10,000

Please Touch: a virtual engagement with Sodeisha sculptural ceramics

An industrial-academic collaboration with School of Creative Industries and Newcastle Art Gallery.

Funding body: School of Creative Industries

Funding body School of Creative Industries
Project Team

Sarah Johnson, Una Rey, Faye Neilson, Zi Siang See, Donovan Jones, Michael Cuneo, Luke O'Donnell, Alexander Barnes-Keoghan
Scheme RAPID
Role Investigator
Funding Start 2018
Funding Finish 2019
GNo
Type Of Funding Internal
Category INTE
UON N

IEEE Games Entertainment and Media Conference, Ireland, 15 - 17 August 2018$2,000

Funding body: Faculty of Education and Arts, University of Newcastle

Funding body Faculty of Education and Arts, University of Newcastle
Scheme FEDUA Conference Travel Grant
Role Lead
Funding Start 2018
Funding Finish 2018
GNo
Type Of Funding Internal
Category INTE
UON N

20132 grants / $26,000

Interactive Virtual Reality 360 Tour$20,000

Interactive Virtual Reality 360 Tour: Technical Development

Funding body: INTI International University (industrial linkage)

Funding body INTI International University (industrial linkage)
Project Team

Lay Geng Lin, Zi Siang See, Puei Keng Ow, Zi Ping See
Scheme INTI International University (industrial linkage)
Role Investigator
Funding Start 2013
Funding Finish 2013
GNo
Type Of Funding External
Category EXTE
UON N

Sri KDU Virtual Reality 360 Digital Tour$6,000

Sri KDU Virtual Reality 360 Digital Tour: Technical Development

Funding body: Sri KDU Schools (industrial linkage)

Funding body Sri KDU Schools (industrial linkage)
Project Team

Zi Siang See, Lay Geng Lin, Zi Ping See
Scheme Sri KDU Schools (industrial linkage)
Role Investigator
Funding Start 2013
Funding Finish 2013
GNo
Type Of Funding External
Category EXTE
UON N
Edit

Dr Zi Siang See

Position

Lecturer
School of Creative Industries
Faculty of Education and Arts

Contact Details

Email zisiang.see@newcastle.edu.au
Mobile 0406940386
Links Personal webpage
Facebook

Office

Room .
Location Level 4, NeW Space

,
Edit