Dr Zi Siang See

Dr Zi Siang See

Lecturer

School of Creative Industries

Career Summary

Biography

Dr Zi Siang See is a full-time interaction design researcher at the School of Creative Industries. His focus has been both in academic research and industrial work - this allows him to disseminate knowledge and to make contributions in the field of media design and creative technologies. Zi has developed numerous creative operations which focused on corporate communications and interactive multimedia specialization. These include collaborations with multinational corporations such as McDonald’s, Lafarge Cement, Servier, Leo Burnett, DDB and Saatchi & Saatchi Arachnid. His research includes innovation management related to virtual reality (VR) and augmented reality (AR). He specialized in conventional creative advertising and front-end interaction design. In fact, producing compelling user experience in creative technology is his main interest. As an early career researcher, he has been part of various MOOC projects and been actively involved in scholarly research and international collaborations. He currently works on new courses design with BCI and MCI with the focus of extended reality (XR). Zi completed his Ph.D. at the University of Newcastle, he has trained under the guidance of Prof Lizbeth Goodman (SMARTlab), Prof Mark Billinghurst (Emphatic Computing Lab / HIT Lab NZ), and supported by A/Prof Craig Hight (SOCI). As part of the research for his doctoral thesis focused on human-computer interaction aspects of virtual reality titled Creating High Dynamic Range Spherical Panorama Images for High Fidelity 360 Degree Virtual Reality, Zi developed a method and apparatus solution for creating high fidelity virtual reality 360 (VR360) that is free from major imaging errors and obstacles. 

On-going Research Projects and Collaborations:

  • XR Interactive Wall: AR VR Technical Development and UX Design
  • Sodeisha VR: Please Touch (in collaboration with Newcastle Art Gallery)
  • This Land AR: A Transmedia Audible Experience (Aboriginal / Torres Strait Islander Context)
  • Inclusive Virtual Reality Museum Gallery (collaboration with the Center for Inclusive Design)
  • Victoria Theatre VR: Technical and Interaction Design Study 
  • Tomb of a Sultan: A Digital Heritage VR Experience
  • Park Bench Sojourn VR: Extended Reality for Good
  • Aerial VR360
  • Virtual Reality 360 Content Preservation for Disaster Relief
  • MOOC for AR VR Training
  • XR Andragogy
  • Co-designed VR and AR solutions for the empowerment of SMARTageing communities
  • Building Information Modeling AR VR
  • Electronic Cultural Atlas Initiative (ECAI)
  • Medical Learning AR VR: Simulation, Contextualisation, and Visualisation

Professional Contribution and Involvement:

More:

Teaching Expertise

  • Interaction and UX Design
  • Extended Reality: Augmented Reality (AR) and Virtual Reality (VR)
  • Multimedia Design and Applications
  • Designing for and Conceptualising Game Play

Qualifications

  • Doctor of Philosophy, University of Newcastle
  • Bachelor of Multimedia, Multimedia University, Malaysia
  • Master of Science, Multimedia University, Malaysia

Keywords

  • Augmented Reality
  • Computational Photography
  • Creative Advertising
  • Creative Technology
  • Digital Media
  • Human Computer Interaction
  • Inclusive Design
  • Interaction Design
  • Multimedia
  • Serious Games
  • User Experience
  • Virtual Reality
  • Visual Programming

Languages

  • English (Working)

Fields of Research

Code Description Percentage
080602 Computer-Human Interaction 20
080111 Virtual Reality and Related Simulation 30
190205 Interactive Media 50
Edit

Publications

For publications that are currently unpublished or in-press, details are shown in italics.

Journal article (6 outputs)

Year Citation Altmetrics Link
2019 See ZS, Goodman L, Hight C, Sunar MS, Dey A, Yen Kaow N, Billinghurst M, 'Creating High Fidelity 360° Degree Virtual Reality with High Dynamic Range Spherical Panorama Images', Virtual Creativity, 9 73-109 (2019) [C1]
DOI 10.1386/vcr_00006_1
Citations Scopus - 1
Co-authors Craig Hight
2019 Harold T, Delas S, Human E, See ZS, 'A Malaysian Cultural Heritage Digital Compendium', Digital Applications in Archaeology and Cultural Heritage, 15 1-8 (2019) [C1]
DOI 10.1016/j.daach.2019.e00116
Citations Scopus - 2
2018 See ZS, Sunar MS, Kusnayat A, Aziz KA, 'Interactive panorama VR360 for corporate communications: An industrial scenario case study', International Journal of Integrated Engineering, 10 169-177 (2018)
Citations Scopus - 3Web of Science - 1
2018 Santano D, See ZS, Fong CH, Thwaites H, 'Up in the air with vr360', Virtual Creativity, 8 59-73 (2018) [C1]

© 2018 Intellect Ltd Article. Both drones and 360-degree video (VR 360) have been attractive topics for the past decade. 360-degree videos hit Internet fame as soon as YouTube and... [more]

© 2018 Intellect Ltd Article. Both drones and 360-degree video (VR 360) have been attractive topics for the past decade. 360-degree videos hit Internet fame as soon as YouTube and Facebook started to adopt them into their ecosystem, which made users familiar with and intrigued by these techniques. This definitely made the camera industry race to democratize 360-degree cameras, and now we are graced with affordable, out-of-the-box 360 cameras from Samsung, Ricoh, and Garmin, to Nikon. The company DJI has been the leading drone manufacturer since their first quadcopter captivated our imagination and love of playing with remote control toys in our young age. With this same adventurous and imaginative mindset, we embarked on combining the two technologies: 360-degree cameras and aerial drones. In this article we present the development of an approach to an aerial virtual reality 360 video capture technique. We retrofitted a drone with a 360 spherical panorama camera for acquiring source aerial visual content. Our case study, as described in this article, reproduces an experiment using a 360-fly-by video for the intended use of an event launching in which user perception was being observed in terms of practicality and suitability A user study was conducted to gauge the usability of comparing aerial VR360 being experienced on hand-held multimedia tablets and head-mount-devices (HMD). We also describe the proposed configuration and workflow of aerial 360-video and identify its potential capabilities and limitations, a user evaluation study and directions for future work. In the discussion section, we share how this setup can affect the decisions of the producer, director or the director photography in achieving the creative shot that they aim to produce.

DOI 10.1386/vcr.8.1.59_1
2015 See ZS, Cheok AD, 'Virtual reality 360 interactive panorama reproduction obstacles and issues', Virtual Reality, 19 71-81 (2015)
DOI 10.1007/s10055-014-0258-9
Citations Scopus - 8Web of Science - 6
2012 See ZS, Khairul H, Harold T, Xia Sheng L, Wooi Har O, 'Retrieving Extended High Dynamic Range From Digital Negative Image - An Experiment On Architectural Photo Imaging', World Academy of Science, Engineering and Technology, 6 (2012)
Show 3 more journal articles

Conference (22 outputs)

Year Citation Altmetrics Link
2019 Matthias P, Billinghurst M, See ZS, 'This Land AR: an Australian Music and Sound XR Installation', The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry on - VRCAI '19, Australia (2019) [E1]
DOI 10.1145/3359997.3365740
Co-authors Philip Matthias
2019 See ZS, Rey U, Neilson F, Cuneo M, Barnes-Keoghan A, O'Donnell L, et al., 'Sodeisha Sculptural Ceramics: Digitalization and VR Interaction', The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry on - VRCAI '19, Australia (2019) [E1]
DOI 10.1145/3359997.3365741
Co-authors Una Rey, Donovan Jones, Sarah Johnson, Faye Neilson
2019 Jones D, See Z, Billinghurst M, Goodman L, Fealy S, 'Extended Reality for Midwifery Learning: MR VR Demonstration', Proceedings of VRCAI '19: The 17th International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI '19), Brisbane, Queensland (2019) [E1]
DOI 10.1145/3359997.3365739
Co-authors Donovan Jones, Shanna Fealy
2019 See Z, Santano D, Fong CH, Thwaites H, 'Tomb of a Sultan: A VR Digital Heritage Approach', 2018 3rd Digital Heritage International Congress (DigitalHERITAGE) held jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018), San Francisco (2019) [E1]
DOI 10.1109/DigitalHeritage.2018.8810083.
Citations Scopus - 2
2019 See ZS, Rey U, Neilson F, Cuneo M, Barnes-Keoghan A, O Donnell L, et al., 'Sodeisha Avant-grade Ceramic: High Fidelity Digitization, Virtual Reality, and Interaction Design', Singapore (2019)
Co-authors Faye Neilson, Una Rey, Donovan Jones
2019 Lizbeth G, Tara M, See ZS, Wooi Har O, Craig H, 'Mapping Identity in Real and Virtual Format: AR Map of Me', Sydney (2019)
2019 Lizbeth G, See ZS, Wooi Har O, Craig H, Mark B, 'Co-designed VR and AR solutions for empowerment of SMARTageing communities', Sydney (2019)
2018 Santano D, See ZS, Fong CH, Thwaites H, 'Aerial virtual reality 360 research-creation', Proceedings of the 2017 23rd International Conference on Virtual Systems and Multimedia, VSMM 2017 (2018)

© 2017 IEEE. This paper presents a development of an aerial virtual reality 360 video capture approach. A drone was converted and retrofitted with a 360 spherical panorama camera ... [more]

© 2017 IEEE. This paper presents a development of an aerial virtual reality 360 video capture approach. A drone was converted and retrofitted with a 360 spherical panorama camera for acquiring source aerial visual content. In this case study, an experiment of a 360-fly-by video was reproduced for the intended use of an event launching where user perception was being observed in terms of practicality and suitability. Utilizing a consumer 360 camera the Samsung Gear 360 and the DJI Inspire 1, it allowed the researcher to capture aerial 360-degree video. The paper documented the process of retrofitting the 360-camera onto the drone. Research findings on why certain drones are suitable for the 360-degree camera will be presented. A user study was conducted to gauge the usability for comparing aerial VR360 being experienced on hand-held multimedia tablets and head-mount-devices (HMD). In this paper we describe the proposed configuration and workflow of aerial 360-video and identifying its potential capabilities and limitation, a user evaluation study and directions for future work.

DOI 10.1109/VSMM.2017.8346262
2018 See ZS, Xia Sheng L, Brimo A, Thwaites H, Goodman L, 'MOOC for AR VR Training', 2018 IEEE Games, Entertainment, Media Conference (GEM), Ireland (2018) [E1]
DOI 10.1109/GEM.2018.8516514
Citations Scopus - 1
2017 See ZS, Sunar MS, Billinghurst M, Dey A, Santano D, Esmaeili H, Thwaites H, 'Demo: Exhibition approach using an AR and VR pillar', SIGGRAPH Asia 2017 Mobile Graphics and Interactive Applications, SA 2017, Thailand (2017)
DOI 10.1145/3132787.3132810
Citations Scopus - 1Web of Science - 1
2017 See ZS, Blundell D, Thwaites H, 'Virtual Reality 360 Content Preservation for Disaster Relief', Proceedings of the 2017 Pacific Neighborhood Consortium Annual Conference and Joint Meetings: Data Informed Society, PNC 2017, Taiwan (2017)
DOI 10.23919/PNC.2017.8203540
2017 See Z, Billinghurst M, Dey A, Santano D, Esmaeili H, Thwaites H, 'An Augmented Reality and Virtual Reality Pillar for Exhibitions: A Subjective Exploration', https://diglib.eg.org/handle/10.2312/2631902, Adelaide (2017)
DOI 10.2312/egve.20171342
Citations Scopus - 1
2016 See ZS, Rengganaten V, Billinghurst M, Soo S, 'Demo: Mobile audible AR experience for medical learning murmurs simulation', SA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, Kobe, Japan (2016)
DOI 10.1145/2999508.2999513
Citations Scopus - 3
2016 See ZS, Rengganaten V, Billinghurst M, Soo S, 'Medical learning murmurs simulation with mobile audible augmented reality', SA 2016 - SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, Macao (2016)
DOI 10.1145/2999508.2999527
Citations Scopus - 2
2016 Lee XS, Khamidi MF, See ZS, Lees TJ, Chai C, 'Augmented reality for ndimensional building information modelling: Contextualization, Customization and Curation', Proceedings of the 2016 International Conference on Virtual Systems and Multimedia, VSMM 2016, Kuala Lumpur (2016)
DOI 10.1109/VSMM.2016.7863152
Citations Scopus - 2
2016 Fong CH, Billinghurst M, See ZS, Esmaeili H, 'PepperGram with interactive control', Proceedings of the 2016 International Conference on Virtual Systems and Multimedia, VSMM 2016, Kuala Lumpur (2016)
DOI 10.1109/VSMM.2016.7863172
Citations Scopus - 1
2016 Lee XS, Yan CP, See ZS, 'Irregular Shaped Building Design Optimization with Building Information Modelling', MATEC Web of Conferences, Malaysia (2016)
DOI 10.1051/matecconf/20166600027
Citations Scopus - 2Web of Science - 2
2015 See ZS, Billinghurst M, Cheok AD, 'Augmented reality using high fidelity spherical panorama with HDRI', SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, SA 2015, Kobe, Japan (2015)
DOI 10.1145/2818427.2818445
Citations Scopus - 1
2015 See ZS, Billinghurst M, Cheok AD, 'Augmented reality using high fidelity spherical panorama with HDRI-demonstration', SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, SA 2015, Japan (2015)
DOI 10.1145/2818427.2819696
Citations Scopus - 2
2014 Xia Sheng L, Ching Hua L, Shyn Yi C, Zi Siang S, See Z, 'Architectural Transformation of a Night Market Stall', https://www.researchgate.net/profile/Lee_Sheng2/publication/282570841_Architectural_Transformation_of_a_Night_Market_Stall/links/56123b4308ae4833751bda18.pdf, Universiti Teknologi Mara (2014)
2011 See ZS, Sheng LX, 'Non-bias architectural image archive using High Dynamic Range approach', 2011 International Conference on Research and Innovation in Information Systems, ICRIIS'11, Kuala Lumpur (2011)
DOI 10.1109/ICRIIS.2011.6125720
2011 See Z, 'Non-bias Scientific Imaging Archive for Urban Morphology Research', Universiti Teknologi Malaysia (2011)
Show 19 more conferences

Creative Work (13 outputs)

Year Citation Altmetrics Link
2020 Kenke R, Anelli L, Wright R, Minichiello M, Drummond J, O'Donnell L, et al., The House We Build, Newcastle, NSW (2020) [J1]
Co-authors Rewa Wright, Mario Minichiello, Jack Mcgrath, Ralph Kenke, Nathan Scott, Paul Egglestone
2019 Rey U, See ZS, Neilson F, Cuneo M, Barnes-Keoghan A, O'Donnell L, et al., Please Touch: a virtual engagement with Sodeisha sculptural ceramics, Newcastle Art Gallery, Australia (2019)
Co-authors Donovan Jones, Una Rey, Faye Neilson
2018 See Z, Thwaites H, Sultan Hussin Shah Tomb: A VR Museum Experience, Digital Heritage 2018 3rd International Congress & Expo, San Francisco (2018)
2017 Matthew S, See Z, Park Bench Sojourn VR, Sunway University (2017)
2017 See Z, Delas S, Aerial 360, iLabs, Kuala Lumpur (2017)
2017 Harold T, See Z, Makam Sultan Hussin Shah (2017)
2017 See Z, Delas S, Human E, Harold T, Virtual Reality Museum, Sunway University, Kuala Lumpur (2017)
2016 See Z, Delas S, Human E, Harold T, AR and VR Pillar: Pangkorboat Builders, International Conference on Visual Systems & Multimedia (VSMM2016) (2016)
2014 See Z, The Beauty of Horizon, Exhibition, Kuala Lumpur (2014)
2013 See Z, Lay Geng L, Zi Ping S, Sri KDU Virtual Reality 360 Digital Tour (2013)
2013 See Z, Lay Geng L, Zi Ping S, Puei Keng O, INTI Virtual Reality 360 (2013)
2003 See Z, Japan International Photo Panel Exhibition, Kuala Lumpur (2003)
2003 See Z, Motion of the Sun - Bon Odori, Japan Foundation, Kuala Lumpur (2003)
Show 10 more creative works
Edit

Grants and Funding

Summary

Number of grants 8
Total funding $135,896

Click on a grant title below to expand the full details for that specific grant.

20202 grants / $84,896

Media and Entertainment Research Centre (MERCury) establishment program$70,000

Funding body: Faculty of Education and Arts, University of Newcastle

Funding body Faculty of Education and Arts, University of Newcastle
Project Team

Dr Simon Weaving (Lead); A/Prof Craig Hight; Dr Simone O'Callaghan; Dr Jane Shadbolt; Dr Ben Matthews; Dr Stuart McBratney; Mr Jack McGrath; Dr Zi Siang See; Claire Pasvolsky; Karen Nobes; Prof Richard Vella.
Scheme Research Programs Pilot Scheme
Role Investigator
Funding Start 2020
Funding Finish 2021
GNo
Type Of Funding Internal
Category INTE
UON N

ECR Inclusive Transformative Technology Scrum$14,896

Funding body: Faculty of Education and Arts, University of Newcastle

Funding body Faculty of Education and Arts, University of Newcastle
Project Team

Dr Benjamin Matthews (Lead), Dr Rewa Wright, Mr Zi Siang See, Dr Jamin Day, Ms Shanna Fealy, Dr Donovan Jones and Mr Adam Manning
Scheme Strategic Network and Pilot Project Grants Scheme
Role Investigator
Funding Start 2020
Funding Finish 2020
GNo
Type Of Funding Internal
Category INTE
UON N

20192 grants / $13,000

RAPID$10,000

‘This Land AR’ is a transmedia initiative, comprising an Augmented Reality (AR) Indigenous music, visual and sound installation. It also involves the use of an extended reality (XR) interactive approach to augment audible elements in a public exhibition at the Newcastle Art Gallery. 

Funding body: School of Creative Industries

Funding body School of Creative Industries
Project Team

Philip Matthias, Zi Siang See, Helena Bezzina, Akur Meta, Lauretta Morton, Toby Whaleboat
Scheme RAPID
Role Investigator
Funding Start 2019
Funding Finish 2020
GNo
Type Of Funding Internal
Category INTE
UON N

iLead New Media$3,000

Funding body: UON Global

Funding body UON Global
Project Team

Simon Weaving, Benjamin Matthews, Zi Siang See
Scheme iLead
Role Investigator
Funding Start 2019
Funding Finish 2019
GNo
Type Of Funding Internal
Category INTE
UON N

20182 grants / $12,000

RAPID$10,000

Please Touch: a virtual engagement with Sodeisha sculptural ceramics

An industrial-academic collaboration with School of Creative Industries and Newcastle Art Gallery.

Funding body: School of Creative Industries

Funding body School of Creative Industries
Project Team

Sarah Johnson, Una Rey, Faye Neilson, Zi Siang See, Donovan Jones, Michael Cuneo, Luke O'Donnell, Alexander Barnes-Keoghan
Scheme RAPID
Role Investigator
Funding Start 2018
Funding Finish 2019
GNo
Type Of Funding Internal
Category INTE
UON N

IEEE Games Entertainment and Media Conference, Ireland, 15 - 17 August 2018$2,000

Funding body: Faculty of Education and Arts, University of Newcastle

Funding body Faculty of Education and Arts, University of Newcastle
Scheme FEDUA Conference Travel Grant
Role Lead
Funding Start 2018
Funding Finish 2018
GNo
Type Of Funding Internal
Category INTE
UON N

20132 grants / $26,000

Interactive Virtual Reality 360 Tour$20,000

Interactive Virtual Reality 360 Tour: Technical Development

Funding body: INTI International University (industrial linkage)

Funding body INTI International University (industrial linkage)
Project Team

Lay Geng Lin, Zi Siang See, Puei Keng Ow, Zi Ping See
Scheme INTI International University (industrial linkage)
Role Investigator
Funding Start 2013
Funding Finish 2013
GNo
Type Of Funding External
Category EXTE
UON N

Sri KDU Virtual Reality 360 Digital Tour$6,000

Sri KDU Virtual Reality 360 Digital Tour: Technical Development

Funding body: Sri KDU Schools (industrial linkage)

Funding body Sri KDU Schools (industrial linkage)
Project Team

Zi Siang See, Lay Geng Lin, Zi Ping See
Scheme Sri KDU Schools (industrial linkage)
Role Investigator
Funding Start 2013
Funding Finish 2013
GNo
Type Of Funding External
Category EXTE
UON N
Edit

Research Supervision

Number of supervisions

Completed0
Current2

Current Supervision

Commenced Level of Study Research Title Program Supervisor Type
2019 PhD SafeSpace VR: An Assistive Technology Based Virtual Reality (VR) Application PhD (Design), Faculty of Education and Arts, The University of Newcastle Co-Supervisor
2019 PhD A Framework for Evaluating Pedagogical Usability of Interactive Mobile Educational Media: Maximizing Positive Engagement and Minimizing the Negative Impact of Interactive Mobile Media Use by Young Children PhD (Design), Faculty of Education and Arts, The University of Newcastle Co-Supervisor
Edit

Dr Zi Siang See

Position

Lecturer
School of Creative Industries
Faculty of Education and Arts

Contact Details

Email zisiang.see@newcastle.edu.au
Mobile 0406940386
Links Personal webpage
Facebook

Office

Room .
Location Level 4, NeW Space

,
Edit