*All video/movie files posted here were made/edited by Ji-Sun Kim using QuickTime or iMovie.


Virtual Reality Work Repository

Overall research skills in HCI and VR

  • Identify research problems (related to human task performance in VR)
  • Propose new user interaction (gestural) techniques to solve research problems
  • Implement the functional prototypes of the new interaction techniques
  • Conduct a full-flow of user study (lab-based controlled experiments with over hundreds subjects)
    • Define hypotheses
    • Identify metrics and Design pre-, in-, post-experiment questionnaires
    • Define experimental tasks
    • Design and Implement the tasks on the server and client sides (e.g., Linux-based CAVE VR system and iOS/Android devices)
    • Analyze the data (performing statistical tests using SPSS and MATLab)
    • Present the results

Since Ph.D. completion

Action-Perception Research in Virtual Reality + Machine Learning

* TOCHI paper published and presentation at CHI2016 (Slides at YouTube!)

* Working on a journal paper related to the effects of FWIP on perception (perception of complex objects for accurate recognition of the size, shape, and distance of the objects)

* Working on development of the monitoring tool of cybersickness (a.k.a. motion sickness) in VR (very early stage)

Fall2006 -
Spring 2013

PhD Dissertation

Title : Action-Inspired Approach to Design of Navigation Techniques for Effective Spatial Learning in 3-D Virtual Environments

Contributions : Provided integrated insights from multidisciplinary theories to understand human (spatial) learning, Proposed a new action-inspired approach to design of navigation techniques for effective spatial learning, and Demonstrated the effectiveness of the proposed approach using newly developed navigation techniques (based on the action-based approach) through several empirical studies; Originalty, Impact, and Significance related to Action, Perception, and Learning

New Interaction Techniques Developed:

    Finger-driven interaction technique (Finger-Walking in Place: FWIP)
    Sensor fusion based walking in place (SF-WIP) technique

Human Subjects Studies : Usability and Comparative (preliminary, formative and summative) studies with over hundreds human subjects using quantitive and qualitative measurements

Technical Skills :

C/C++ (Linux), Java (Android) and iOS (iPhone, iPad) programming simultaneously.

Building virtual spaces in CAVE (immersive virtual environment) using Google SketchUp and Open Scene Graph, Development of 3D user interfaces using mobile devices (e.g., iPhone/iPod Touch, Android-platform mobile devices, Lemur multi-touch MIDI device) and game controller (e.g.Wii BalanceBoard/Remote/MotionPlus), Network programming (Wi-Fi and BlueTooth), etc.

Accomplishments : Theory-based New Design Approach;Development description and demonstration, IP Disclosure, iPhone/iPad based software, Android-based software, Remote system control software for CAVE system, Three paper/poster publications, Two journal papers in preparation


Fall2003 -
Fall2005

Master's Thesis

Title : Tangible User Interface (TUI) for CAVE applications using Augmented Reality technique

Technical Skills : Building virtual spaces in CAVE (immersive virtual environment) using , OpenGL and OpenGL-Performer, Development of 3D user interface, ARToolkit (using Augmented Reality technology) programming

Products : ARBox and ARTable (refer to my theisis), Novel TUIs

Interaction Technique: TUI based object manipulation/selection and navigation in CAVE

User Studies : Usability Study

Accomplishments : One paper publication, one book publication (published by VDM and appeared at Amazon 2009)