publications

EFRing: Enabling Thumb-to-Index-Finger Microgesture Interaction through Electric Field Sensing using Single Smart Ring.

Chen, T., Li, T., Yang, X., Zhu, K. EFRing: Enabling Thumb-to-Index-Finger Microgesture Interaction through Electric Field Sensing using Single Smart Ring. Accepted by Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT).

PropelWalker: A Leg-based Wearable System with Propeller-based Force Feedback for Walking in Fluids in VR.

Pingchuan Ke, Shaoyu Cai, Haichen Gao, and Kening Zhu (*). PropelWalker: A Leg-based Wearable System with Propeller-based Force Feedback for Walking in Fluids in VR. Accepted by IEEE TVCG.

Understanding B2B Interactions for Circular Smartwatches in Mobile and Encumbered Scenarios.

Bradley Rey, Kening Zhu, Simon Perrault, Sandra Bardot, Ali Neshati, Pourang Irani. Understanding B2B Interactions for Circular Smartwatches in Mobile and Encumbered Scenarios. Accepted by MobileHCI 2022

Deep-learning-based unobtrusive handedness prediction for one-handed smartphone interaction.

Taizhou Chen, Kening ZHU (*) & Mingchieh Yang. Deep-learning-based unobtrusive handedness prediction for one-handed smartphone interaction. Multimed Tools Appl (2022). https://doi.org/10.1007/s11042-021-11844-6

Weighted Walking: Propeller-based On-leg Force Simulation of Walking in Fluid Materials in VR.

Pingchuan Ke, Shaoyu Cai, Lantian Xu, and Kening Zhu (*). 2021. Weighted Walking: Propeller-based On-leg Force Simulation of Walking in Fluid Materials in VR. In SIGGRAPH Asia 2021 Emerging Technologies (SA '21 Emerging Technologies). Association for Computing Machinery, New York, NY, USA, Article 19, 1–2. DOI:https://doi.org/10.1145/3476122.3484842.

GAN-based Image-to-Friction Generation for Tactile Simulation of Fabric Material.

Shaoyu Cai, Lu Zhao, Yuki Ban, Takuji Narumi, Yue Liu (*), Kening Zhu (*). GAN-based Image-to-Friction Generation for Tactile Simulation of Fabric Material. Computers & Graphics. 2021. ISSN 0097-8493. https://doi.org/10.1016/j.cag.2021.09.007.

ThermEarhook: Investigating Spatial Thermal Haptic Feedback on the Auricular Skin Area.

Nasser, Arshad, Kexin Zheng, Kening Zhu (*). "ThermEarhook: Investigating Spatial Thermal Haptic Feedback on the Auricular Skin Area". Accepted by ICMI 2021.

FritzBot: A Data-Driven Conversational Agent for Physical-Computing System Design.

Chen, Taizhou, Lantian Xu, Kening Zhu (*). "FritzBot: A data-driven conversational agent for physical-computing system design." International Journal of Human-Computer Studies 155 (2021): 102699.

Visual-Tactile Cross-Modal Data Generation using Residue-Fusion GAN with Feature-Matching and Perceptual Losses.

Cai, Shaoyu, Kening Zhu (*), Yuki Ban, and Takuji Narumi. "Visual-Tactile Cross-Modal Data Generation using Residue-Fusion GAN with Feature-Matching and Perceptual Losses". in IEEE Robotics and Automation Letters, doi: 10.1109/LRA.2021.3095925.

GestOnHMD: Enabling Gesture-based Interaction on the Surface of Low-cost VR Head-Mounted Display.

Chen, Taizhou, Lantian Xu, Xianshan Xu, and Kening Zhu (*). "GestOnHMD: Enabling Gesture-based Interaction on the Surface of Low-cost VR Head-Mounted Display". IEEE Transactions on Visualization and Computer Graphics, vol. 27, no. 5, pp. 2597-2607, May 2021, doi: 10.1109/TVCG.2021.3067689.

Larger Step Faster Speed: Investigating Gesture-based Locomotion in Place with Different Walking Speed in Virtual Reality.

Ke, Pingchuan, and Kening Zhu (*). "Larger Step Faster Speed: Investigating Gesture-based Locomotion in Place with Different Walking Speed in Virtual Reality". 2021 IEEE Virtual Reality and 3D User Interfaces (VR), 2021, pp. 438-447, doi: 10.1109/VR50410.2021.00067.

FrictGAN: Frictional Signal Generation from Fabric Texture Images using Generative Adversarial Network.

Cai, Shaoyu, Yuki Ban, Takuji Narumi, and Kening Zhu (*). "FrictGAN: Frictional Signal Generation from Fabric Texture Images using Generative Adversarial Network." ICAT-EGVE2020: International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments. The Eurographics Association, 2020. Best Paper Audience Choice Award.

Systems and Methods for Creating Haptic Proxies for Use in Virtual Reality.

Zhu, Kening, Feng Han, CHEN. Taizhou, and Yi-Shiun Wu. "Systems and methods for creating haptic proxies for use in virtual reality." U.S. Patent Application 16/392,142, filed October 29, 2020.

ThermalCane: Exploring Thermotactile Directional Cues on Cane-Grip for Non-Visual Navigation.

Nasser, Arshad, Kai-Ning Keng, and Kening Zhu. "ThermalCane: Exploring Thermotactile Directional Cues on Cane-Grip for Non-Visual Navigation." In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1-12. 2020.

Toward Inclusive Learning: Designing and Evaluating Tangible Programming Blocks for Visually Impaired Students.

Rong, Zhiyi, Ngo Fung Chan, Taizhou Chen, and Kening Zhu. "Toward Inclusive Learning: Designing and Evaluating Tangible Programming Blocks for Visually Impaired Students." In International Conference on Human-Computer Interaction, pp. 326-338. Springer, Cham, 2020.

FingerTalkie: Designing a Low-Cost Finger-Worn Device for Interactive Audio Labeling of Tactile Diagrams.

Nasser, Arshad, Taizhou Chen, Can Liu, Kening Zhu, and P. V. M. Rao. "FingerTalkie: Designing a Low-Cost Finger-Worn Device for Interactive Audio Labeling of Tactile Diagrams." In International Conference on Human-Computer Interaction, pp. 475-496. Springer, Cham, 2020.

CodeRhythm: A Tangible Programming Toolkit for Visually Impaired Students.

Zhiyi Rong, Ngo Fung Chan, Taizhou Chen, Kening Zhu*. "CodeRhythm: A Tangible Programming Toolkit for Visually Impaired Students." In Proceedings of Asian CHI Symposium 2020, ACM CHI 2020. Best Paper Award.

Exploring Eyes-free Bezel-initiated Swipe on Round Smartwatches.

Wong, Pui Chung, Kening Zhu, Xing-Dong Yang, and Hongbo Fu. "Exploring Eyes-free Bezel-initiated Swipe on Round Smartwatches." In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1-11. 2020.

ThermAirGlove: A Pneumatic Glove for Thermal Perception and Material Identification in Virtual Reality.

Cai, Shaoyu, Pingchuan Ke, Takuji Narumi, and Kening Zhu. "ThermAirGlove: A Pneumatic Glove for Thermal Perception and Material Identification in Virtual Reality." In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 248-257. IEEE, 2020.

Demonstration of ThermAirGlove: A Pneumatic Glove for Material Perception in Virtual Reality through Thermal and Force Feedback.

Cai, Shaoyu, Pingchuan Ke, Shanshan Jiang, Takuji Narumi, and Kening Zhu. "Demonstration of ThermAirGlove: A Pneumatic Glove for Material Perception in Virtual Reality through Thermal and Force Feedback." In SIGGRAPH Asia 2019 Emerging Technologies, pp. 11-12. 2019.

Embodied Weather: Promoting Public Understanding of Extreme Weather Through Immersive Multi-Sensory Virtual Reality.

Ke, Pingchuan, Kai-Ning Keng, Shanshan Jiang, Shaoyu Cai, Zhiyi Rong, and Kening Zhu. "Embodied Weather: Promoting Public Understanding of Extreme Weather Through Immersive Multi-Sensory Virtual Reality." In The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry, pp. 1-2. 2019.

Thermo-haptic Earable Display for the Hearing and Visually Impaired.

Nasser, Arshad, Kening Zhu, and Sarah Wiseman. "Thermo-haptic earable display for the hearing and visually impaired." In The 21st International ACM SIGACCESS Conference on Computers and Accessibility, pp. 630-632. 2019.

TipText: Eyes-Free Text Entry on a Fingertip Keyboard.

Xu, Zheer, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu, and Xing-Dong Yang. "TipText: Eyes-Free Text Entry on a Fingertip Keyboard." In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 883-899. 2019. Best Paper Award.

A Sense of Ice and Fire: Exploring Thermal Feedback with Multiple Thermoelectric-cooling Elements on A Smart Ring.

Zhu, Kening, Simon Perrault, Taizhou Chen, Shaoyu Cai, and Roshan Lalintha Peiris. "A sense of ice and fire: Exploring thermal feedback with multiple thermoelectric-cooling elements on a smart ring." International Journal of Human-Computer Studies 130 (2019): 234-247.

DupRobo: Interactive Robotic Autocompletion of Physical Block-based Repetitive Structure.

Chen, Taizhou, Yi-Shiun Wu, and Kening Zhu. "DupRobo: Interactive Robotic Autocompletion of Physical Block-Based Repetitive Structure." In IFIP Conference on Human-Computer Interaction, pp. 475-495. Springer, Cham, 2019.

Additive Voronoi Cursor: Dynamic Effective Areas using Additively Weighted Voronoi Diagrams.

Cheung, Jacky Kit, Oscar Kin-Chung Au, and Kening Zhu. "Additive Voronoi Cursor: Dynamic Effective Areas Using Additively Weighted Voronoi Diagrams." In IFIP Conference on Human-Computer Interaction, pp. 273-292. Springer, Cham, 2019.

Emergency-Response Locomotion of Hexapod Robot with Heuristic Reinforcement Learning using Q-Learning.

Yang, Ming-Chieh, Hooman Samani, and Kening Zhu. "Emergency-response locomotion of hexapod robot with heuristic reinforcement learning using Q-learning." In International Conference on Interactive Collaborative Robotics, pp. 320-329. Springer, Cham, 2019.

HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-cost Twistable Artefacts.

Zhu, Kening, Taizhou Chen, Feng Han, and Yi-Shiun Wu. "HapTwist: creating interactive haptic proxies in virtual reality using low-cost twistable artefacts." In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1-13. 2019.

Design and Development of Interactive Intelligent Medical Agent.

Tsai, Shu-Chiao, Hooman Samani, Yu-Wei Kao, Kening Zhu, and Brian Jalaian. "Design and development of interactive intelligent medical agent." In 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pp. 210-215. IEEE, 2018.

Interface and Experience Design with AI for VR/AR (DAIVAR'18) and AI/ML for Immersive Simulations (AMISIM'18).

Zhu, Kening, Artur Lugmayr, Xiaojuan Ma, Florian Floyd Mueller, Ulrich Engelke, Simeon Simoff, Tomas Trescak, Anton Bogdavych, Juan Rodriguez Aguilar, and Huyen Vu. "Interface and experience design with AI for VR/AR (DAIVAR'18) and AI/ML for immersive simulations (AMISIM'18)." In 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pp. 227-228. IEEE, 2018.

Investigating Different Modalities of Directional Cues for Multi-task Visual-Searching Scenario in Virtual Reality.

Chen, Taizhou, Yi-Shiun Wu, and Kening Zhu. "Investigating different modalities of directional cues for multi-task visual-searching scenario in virtual reality." In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, pp. 1-5. 2018.

Demo - HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-cost Twistable Artefacts.

Kening Zhu, Taizhou Chen, Shaoyu Cai, Feng Han, and Yi-Shiun Wu. 2018. In Proceedings of SA ’18 Virtual and Augmented Reality . ACM, New York, NY, USA, 2 pages.

ColorTact: A Finger Wearable Audio-tactile Device Using Customizable Color Tagging. UbiComp/ISWC 2018.

Nasser, Arshad, Kening Zhu, and P. V. M. Rao. "ColorTact: A Finger Wearable Audio-tactile Device Using Customizable Color Tagging." In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, pp. 178-181. 2018.

WristOrigami: Exploring Foldable Design for Multi-Display Smartwatch.

Zhu, Kening, Morten Fjeld, and Ayça Ünlüer. "WristOrigami: Exploring foldable design for multi-display smartwatch." In Proceedings of the 2018 Designing Interactive Systems Conference, pp. 1207-1218. 2018.

FingerT9: Leveraging Thumb-to-finger Interaction for Same-side-hand Text Entry on Smartwatches.

Wong, Pui Chung, Kening Zhu, and Hongbo Fu. "Fingert9: Leveraging thumb-to-finger interaction for same-side-hand text entry on smartwatches." In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1-10. 2018.

System for printing an object and a method for printing an object.

Zhu, Kening, Alexandru Dancu, and Shengdong Zhao. "System for printing an object and a method for printing an object." U.S. Patent Application 15/233,469, filed February 15, 2018.

Artificial Intelligence Meets Virtual and Augmented Worlds (AIVR), in conjunction with SIGGRAPH Asia.

Lugmayr, Artur, Kening Zhu, and Xiaojuan Ma. "Artificial Intelligence Meets Virtual and Augmented Worlds (AIVR), in conjunction with SIGGRAPH Asia." International SERIES on Information Systems and Management in Creative eMedia (CreMedia) 2017/2 (2018): 1-73.

From Virtual to Physical Problem Solving in Coding: A Comparison on Various Multi-Modal Coding Tools for Children Using the Framework of Problem Solving.

Zhu, Kening. "From Virtual to Physical Problem Solving in Coding: A Comparison on Various Multi-Modal Coding Tools for Children Using the Framework of Problem Solving." In Teaching Computational Thinking in Primary Education, pp. 138-155. IGI Global, 2018.

The Golden Guardian: Multi-sensory Immersive Gaming through Multi-sensory Spatial Cues.

Chen, Taizhou, Junyu Liu, Kening Zhu, and Tamas Waliczky. "The golden guardian: multi-sensory immersive gaming through multi-sensory spatial cues." In SIGGRAPH Asia 2017 VR Showcase, pp. 1-2. 2017.

DupRobo: an interactive robotic platform for phyiscal block-based autocompletion.

Chen, Taizhou, Yi-Shiun Wu, Feng Han, Baochuan Yue, and Kening Zhu. "DupRobo: an interactive robotic platform for phyiscal block-based autocompletion." In SIGGRAPH Asia 2017 Posters, pp. 1-2. 2017.

Artificial intelligence MEETS virtual and augmented realities.

Lugmayr, Artur, Zhu Kening, and Xiaojuan Ma. "Artificial intelligence MEETS virtual and augmented realities." In SIGGRAPH Asia 2017 Workshops, pp. 2a-1. ACM, 2017.

fingerT9: leveraging thumb-to-finger interaction for one-handed text entry on smartwatches.

Wong, Pui Chung, Kening Zhu, and Hongbo Fu. "FingerT9: Leveraging thumb-to-finger interaction for one-handed text entry on smartwatches." In SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, pp. 1-3. 2017.

Mirrortablet: exploring a low-cost mobile system for capturing unmediated hand gestures in remote collaboration.

Le, Khanh-Duy, Kening Zhu, and Morten Fjeld. "Mirrortablet: exploring a low-cost mobile system for capturing unmediated hand gestures in remote collaboration." In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia, pp. 79-89. 2017.

Digital Humanities and Techno-Animism in Wearables: A Case-Study-Based Collaborative Design Framework for Digitally-Ensouled Jewellery.

Polydorou, Doros, Kening Zhu, and Alexis Karkotis. "Digital humanities and techno-animism in wearables: a case-study-based collaborative design framework for digitally-ensouled jewellery." In International Conference of Design, User Experience, and Usability, pp. 719-736. Springer, Cham, 2017.

Teaching and Learning of Chinese History in Minecraft: A Pilot Case-Study in Hong Kong Secondary Schools.

Zhu, Kening, and Man Ho John Heun. "Teaching and learning of Chinese history in minecraft: A pilot case-study in Hong Kong secondary schools." In Proceedings of the 2017 Conference on Interaction Design and Children, pp. 405-410. 2017.

Tripartite effects: exploring users’ mental model of mobile gestures under the influence of operation, handheld posture, and interaction space.

Zhu, Kening, Xiaojuan Ma, Haoyuan Chen, and Miaoyin Liang. "Tripartite effects: exploring users’ mental model of mobile gestures under the influence of operation, handheld posture, and interaction space." International Journal of Human–Computer Interaction 33, no. 6 (2017): 443-459.

FusePrint: A DIY 2.5 D Printing Technique for Good-fit Fabrication with Daily Objects.

Zhu, Kening, Alexandru Dancu, and Shengdong Zhao. "FusePrint: A DIY 2.5 D Printing Technique for Good-fit Fabrication with Daily Objects." In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 413-416. 2017.

Exploring the Design Space of Bezel-Initiated Gestures for Mobile Interaction.

Li, Wing Ho Andy, Kening Zhu, and Hongbo Fu. "Exploring the Design Space of Bezel-Initiated Gestures for Mobile Interaction." International Journal of Mobile Human Computer Interaction (IJMHCI) 9, no. 1 (2017): 16-29.

Back-Mirror: back-of-device one-handed interaction on smartphones.

Wong, Pui Chung, Hongbo Fu, and Kening Zhu. "Back-Mirror: back-of-device one-handed interaction on smartphones." In SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, pp. 1-5. 2016.

Virtual reality and augmented reality for education: panel.

Zhu, Kening. "Virtual reality and augmented reality for education: panel." In SIGGRAPH ASIA 2016 symposium on education: Talks, pp. 1-2. 2016.

Ubitile: A Finger-Worn I/O Device for Tabletop Vibrotactile Pattern Authoring.

Le, Khanh-Duy, Kening Zhu, Tomasz Kosinski, Morten Fjeld, Maryam Azh, and Shengdong Zhao. "Ubitile: A finger-worn i/o device for tabletop vibrotactile pattern authoring." In Proceedings of the 9th Nordic Conference on Human-Computer Interaction, pp. 1-4. 2016.

How different input and output modalities support coding as a problem-solving process for children.

Zhu, Kening, Xiaojuan Ma, Gary Ka Wai Wong, and John Man Ho Huen. "How different input and output modalities support coding as a problem-solving process for children." In Proceedings of the The 15th International Conference on Interaction Design and Children, pp. 238-245. 2016.

FusePrint: a DIY 2.5 D printing technique embracing everyday artifacts.

Zhu, Kening, Alexandru Dancu, and Shengdong Zhao. "FusePrint: a DIY 2.5 D printing technique embracing everyday artifacts." In Proceedings of the 2016 ACM Conference on Designing Interactive Systems, pp. 146-157. 2016.

Red Hot Spinning: Immersive 3D Narrative in Asian Gaming.

ZChung, Peichi, Gina See Yuen Wong, Jing Chiang, and Z. H. U. Kening. "Red Hot Spinning: Immersive 3D Narrative in Asian Gaming." In 22nd International Symposium on Electronic Art (ISEA2016). 2016.

"This is a techno-necklace from my great grandmother" : Animism-Inspired Design Guidelines for Digitally Ensouled Jewellery.

Polydorou, Doros, Kening Zhu, and Antje Illner. "“This is a techno-necklace from my great grandmother”: Animism-Inspired Design Guidelines for Digitally Ensouled Jewellery." In 22nd International Symposium on Electronic Art (ISEA2016). 2016.

The Development of Internationalized Computational Thinking Curriculum in Hong Kong Primary Education.

Wong, Gary KW, Kening Zhu, Xiaojuan Ma, and John Huen. "The Development of Internationalized Computational Thinking Curriculum in Hong Kong Primary Education." In Proceedings of the 47th ACM Technical Symposium on Computing Science Education, pp. 685-685. 2016.

Bezel-initiated cursor for one-handed target acquisition on mobile touch screens.

Li, Wing Ho Andy, Hongbo Fu, and Kening Zhu. "BezelCursor: bezel-initiated cursor for one-handed target acquisition on mobile touch screens." International Journal of Mobile Human Computer Interaction (IJMHCI) 8, no. 1 (2016): 1-22.

Emergent Interfaces: Constructive Assembly of Identical Units.

Dancu, Alexandru, Catherine Hedler, Stig Anton Nielsen, Hanna Frank, Zhu Kening, Axel Pelling, Adviye Ayça Ünlüer, Christian Carlsson, Max Witt, and Morten Fjeld. "Emergent interfaces: Constructive assembly of identical units." In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, pp. 451-460. 2015.

PaperIO: a 3D interface towards the internet of embedded paper-craft.

Zhu, Kening, Rongbo Zhu, Hideaki Nii, Hooman Samani, and Borhan Brian Jalaeian. "PaperIO: a 3D interface towards the internet of embedded paper-craft." IEICE TRANSACTIONS on Information and Systems 97, no. 10 (2014): 2597-2605.

A Hierarchy of Needs for Developing Interactive Artworks, Systems and Products.

Koh, Jeffrey Tzu Kwan Valino, Kening Zhu, Roshan Lalintha Peiris, Mili John Tharakan, and Ryohei Nakatsu. "A Hierarchy of Needs for Developing Interactive Artworks, Systems and Products." In International Conference on Human-Computer Interaction, pp. 268-272. Springer, Berlin, Heidelberg, 2013.

AutoGami: a low-cost rapid prototyping toolkit for automated movable paper craft.

Zhu, Kening, and Shengdong Zhao. "AutoGami: a low-cost rapid prototyping toolkit for automated movable paper craft." In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 661-670. 2013.

Designing interactive paper-craft systems with selective inductive power transmission.

Zhu, Kening, Hideaki Nii, Owen Noel Newton Fernando, Jeffrey Tzu Kwan Valino Koh, Karin Aue, and Adrian David Cheok. "Designing interactive paper-craft systems with selective inductive power transmission." Interacting with Computers 25, no. 2 (2013): 143-153.

Characterizing the analog-like and digital-like attributes of interactive systems.

Valino Koh, Jeffrey Tzu Kwan, Kening Zhu, Kasun Karunanayaka, Doros Polydorou, Roshan Lalintha Peiris, and Ryohei Nakatsu. "Characterizing the analog-like and digital-like attributes of interactive systems." Communication Design Quarterly Review 1, no. 2 (2013): 8-36.