GenAI User Interaction

Built a Chrome Extension tracking user interactions and analyzing attention.

  • Built a Chrome Extension tracking 12+ user interactions and analyzing attention proportions via LLM
  • Integrated webGazer.js for Eye Gaze tracking with automatic calibration through the device webcam
  • Designed a pipeline to pass multimodal interaction data + HTML elements to Gemini and display results in console