Thesis Hand gesture recognition for stroke patient with hand immobility

By Juichi Nishimura

Setup

To use the setup, the two device setup is reccommended as the Leap driver and Unity MetaSDK don't work together currently. Two deveices must be connected in the same local network Modify the IP address to match the network address

To obtain IP address open terminal and run:

ipconfig

and use ipv4 address: 192.168.... Modify the ipaddress in the LeapTCPSender.py, and Unity TCPHandler.

IP address must point to the device running main.py!

On the other device running Unity scene, also run ipconfig Type the IPaddress of the device and modify the address of questListener.py

Drivers

1. Install Ultraleap Gemeni on the Python server machine

2. Install Meta Quest Link on the Unity machine

Dependencies

On Python server machine

1. Install python 3.8
2. Follow https://github.com/ultraleap/leapc-python-bindings
3. cd into /JuichiHandVR
4. pip install -r requirements.txt

Run the app

1. In /JuichiHandVR
2. Run main.py to start server

python3.8 main.py

3. Open another terminal in /JuichiHandVR and run

python3.8 LeapTCPSender.py

Leap client should connect to the python main server.

On Unity machine

4. Open Unity MetaHandSDK and run play button.
5. Unity client should connect with the main server.
6. Put on the headset and hand tracking should start.