Gaze Based Interactions

Single User 


To add  your own, custom events when an object is in view, (such as gaze based interactions, etc.) you can place code inside the following functions. 

onGazeBegin for your event to be triggered as soon as a gazeObject is seen

onGazeEnd to trigger something to happen when a user’s gaze point is no longer intersecting with that object

onGazeTime to trigger something that happens only when an object is being focused on over the set threshold


Note: If you plan on reviewing with the Session Replay you will need both an onGazeBegin and onGazeEnd function for the replay data to be saved properly


This example code is also in the "Examples" folder. You can also add this to a new script that is importing Sightlab. #Gaze interaction objects

chick1 = vizfx.addAvatar('utils/resources/objects/chick.osgb')

chick1.setPosition([0, 0, 2.5])


creature1 = vizfx.addAvatar('utils/resources/objects/Creature.osgb')

creature1.setPosition([1.5, 0.5, 2])

creature1.setEuler(22,0,0); 

creature1.state(5)


sightlab.gazeObjectsDict = {'chick1':chick1, 'creature1':creature1}


def gazeActionEnd(e):

    if e.object == sightlab.gazeObjectsDict['creature1']:

        creature1.state(4)

        print('stopped looking')

        

    if e.object == sightlab.gazeObjectsDict['chick1']:

        chick1.state(0)

        print('stopped looking')


def gazeActionStart(e):

    if e.object == sightlab.gazeObjectsDict['creature1']:

        creature1.state(6)

        print('saw creature')

        

    if e.object == sightlab.gazeObjectsDict['chick1']:

        chick1.state(10)

        print('stopped looking')

    

viz.callback(sightlab.eye_tracker_utils.GAZE_TIME_EVENT2,gazeActionStart)    

viz.callback(sightlab.eye_tracker_utils.GAZE_END_EVENT2,gazeActionEnd)


Multi-User


On SightLabVR_Server.py script: 


In the function onNetworkEvent (for when an object is fixated on) or onFixationEndEvent (when the fixation stops), add the code for whatever you want to have happen (i.e. a print statement) underneath each respective client's id number 


def onNetworkEvent(e): 

    print(f'** Fixation end from: {e.sender}')

    if e.clientNumber=="1":

        print('client 1 interaction')

    elif e.clientNumber=="2":

        print('client 2 interaction')

    elif e.clientNumber=="3":

        print('client 3 interaction')

    elif e.clientNumber=="4":

        print('client 4 interaction')

    elif e.clientNumber=="5":

        print('client 5 interaction')

viz.callback(FIXATION_NETWORK_KEY_EVENT, onNetworkEvent) 


On SightLabVR_Client.py script: 


Add whatever you want to have happen in the functions for onGazeTime (for when an object has been fixated on), onGazeBegin or OnGazeEnd, as well as the code to add another FIXATION_NETWORK_KEY_EVENT


def onGazeEnd(e):

    if e.object == sightlab_client.gazeObjectsDict['creature1']:

        creature1.state(4)

        print('stopped looking')

    viznet.client.sendAll(sightlab_client.FIXATION_STOPPED_NETWORK_KEY_EVENT,clientNumber = sightlab_client.clientChoice,client=viz.net.getName())


def onGazeTime(e):

    if e.object == sightlab_client.gazeObjectsDict['creature1']:

        creature1.state(6)

        print('saw creature')

    viznet.client.sendAll(sightlab_client.FIXATION_NETWORK_KEY_EVENT,clientNumber = sightlab_client.clientChoice,client=viz.net.getName())

    

viz.callback(sightlab_client.eye_tracker_utils.GAZE_TIME_EVENT,onGazeTime)    

viz.callback(sightlab_client.eye_tracker_utils.GAZE_END_EVENT,onGazeEnd)