Publications

We make an effort to keep this list up to date; however, all publications can be found on Google Scholar page. For books, book chapters, other publications, patents, etc. visit Dr. Rob Jacob's page.

Skip to Journal Articles
Skip to Other Publications

Refereed Conference Proceedings

2024

  • L. Wang, J. Zhang, J. Liu, D. McKeon, D.G. Brizan, G. Blaney, and R.J.K Jacob, "Empower Real-World BCIs with NIRS-X: An Adaptive Learning Framework that Harnesses Unlabeled Brain Signals," Proc. ACM UIST 2024 Symposium on User Interface Software and Technology (2024). [link]

2021

  • Z. Huang, L. Wang, G. Blaney, C. Slaughter, D.T. McKeon, Z. Zhou, R.J.K Jacob, and M.C. Hughes, "The Tufts fNIRS Mental Workload Dataset and Benchmark for Brain-Computer Interfaces that Generalize," Proc. NeurIPS 2021 Conference on Neural Information Processing Systems, Datasets and Benchmarks Track (2021). [link]
  • L. Wang, Z. Huang, Z. Zhou, D.T. McKeon, G. Blaney, M.C. Hughes, and R.J.K Jacob, "Taming fNIRS-based BCI Input for Better Calibration and Broader Use," Proc. ACM UIST 2021 Symposium on User Interface Software and Technology (2021). [link]
  • A. Kang, L. Wang, Z. Zhou, Z. Huang, and R.J.K Jacob, "Affective Color Fields: Reimagining Rothkoesque Artwork as an Interactive Companion for Artistic Self-Expression," Proc. ACM Multimedia 2021 Conference, Interactive Arts track. [link] [alternate link]

2019

  • T. Shibata, A. Borisenko, A. Hakone, T. August, L. Deligiannidis, C.H. Yu, M. Russell, A. Olwal, and R.J.K. Jacob, "An Implicit Dialogue Injection System for Interruption Management," Proc. Tenth Augmented Human International Conference (2019). [link]
  • B.F. Yuksel, K.B. Oleson, R. Chang, and R.J.K. Jacob, "Detecting and Adapting to Users' Cognitive and Affective State to Develop Intelligent Musical Interfaces," in New Directions in Music and Human-Computer Interaction, ed. by S. Holland, T. Mudd, K. Wilkie-McKenna, A. McPherson, and M. Wanderley, Springer (2019). [link]

2017

  • S.W. Hincks, S. Bratt, S. Poudel, V. Phoha, R.J.K. Jacob, D.C. Dennett, and L.M. Hirshfield, "Entropic Brain-computer Interfaces - Using fNIRS and EEG to Measure Attentional States in a Bayesian Framework," Proc. PhyCS 2017 International Conference on Physiological Computing Systems (2017). [link]
  • S.W. Hincks, M. DeBellis, E.Y. Lee, R. ten Brink, B. Moell, and R.J.K. Jacob, "Towards Bidirectional Brain-computer Interfaces that Use fNIRS and tDCS," Proc. PhyCS 2017 International Conference on Physiological Computing Systems (2017). [link]

2016

  • T. Shibata, D. Afergan, D. Kong, B.F. Yuksel, I.S. MacKenzie, and R.J.K. Jacob, "DriftBoard: A Panning-Based Text Entry Technique for Ultra-Small Touchscreens," Proc. ACM UIST 2016 Symposium on User Interface Software and Technology, ACM Press (2016). [link]
  • B.F. Yuksel, K.B. Oleson, L. Harrison, E.M. Peck, D. Afergan, R. Chang, and R.J.K. Jacob, "Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty based on Brain State," Proc. ACM CHI 2016 Human Factors in Computing Systems Conference, ACM Press (2016) Best Paper Award. [link]
  • T. Shibata, D. Afergan, D. Kong, B.F. Yuksel, I.S. MacKenzie, and R.J.K. Jacob, "Text Entry for Ultra-Small Touchscreens Using a Fixed Cursor and Movable Keyboard," ACM CHI 2016 Human Factors in Computing Systems Conference, ACM Press, Interactivity paper (2016). [link] [alternate link]
  • S.W. Hincks, D. Afergan, and R.J. Jacob, "Using fNIRS for Realtime Cognitive Workload Assessment," HCI International 2016 International Conference on Human-Computer Interaction, Springer (2016). [link]

2015

  • B.F. Yuksel, D. Afergan, E.M. Peck, G. Griffin, L. Harrison, N.W.B. Chen, R. Chang, and R.J.K. Jacob, "BRAAHMS: A Novel Adaptive Musical Interface Based on Users' Cognitive State," Proc. NIME International Conference on New Interfaces for Musical Expression (2015). [link]
  • D. Afergan, S.W. Hincks, T. Shibata, and R.J.K. Jacob, "Phylter: A System for Modulating Notifications in Wearables Using Physiological Sensing," HCI International 2015 International Conference on Human-Computer Interaction (2015) Also published in Foundations of Augmented Cognition, ed. D.D. Schmorrow and C.M. Fidopiastis, Springer, 2015, pp. 167-177. [link]

2014

  • D. Afergan, T. Shibata, S.W. Hincks, E.M. Peck, B.F. Yuksel, R. Chang, and R.J.K. Jacob, "Brain-Based Target Expansion," Proc. ACM UIST 2014 Symposium on User Interface Software and Technology, pp. 583-593, ACM Press (2014). [link]
  • D. Afergan, E.M. Peck, E.T. Solovey, A. Jenkins, S.W. Hincks, E.T. Brown, R. Chang, and R.J.K. Jacob, "Dynamic Difficulty Using Brain Metrics of Workload," Proc. ACM CHI 2014 Human Factors in Computing Systems Conference, ACM Press (2014) Best Paper Honorable Mention Award. [link]

2013

  • E.M. Peck, B.F. Yuksel, A. Ottley, R.J.K. Jacob, and R. Chang, "Using fNIRS Brain Sensing to Evaluate Information Visualization Interfaces," Proc. ACM CHI 2013 Human Factors in Computing Systems Conference, ACM Press (2013). [link]
  • E.M. Peck, D. Afergan, and R.J.K. Jacob, "Investigation of fNIRS Brain Sensing as Input to Information Filtering Systems," Proc. Fourth Augmented Human International Conference (2013). [link]
  • G. Griffin and R. Jacob, "Priming Creativity Through Improvisation on an Adaptive Musical Instrument," Proc. ACM Conference on Creativity and Cognition, pp. 146-155 (2013). [link] [alternate link]

2012

  • E.T. Solovey, P. Schermerhorn, M. Scheutz, A. Sassaroli, S. Fantini, and R.J.K. Jacob, "Brainput: Enhancing Interactive Systems with Streaming fNIRS Brain Input," Proc. ACM CHI 2012 Human Factors in Computing Systems Conference, ACM Press (2012) Best Paper Honorable Mention Award. [link]

2011

  • E.T. Solovey, F. Lalooses, K. Chauncey, D. Weaver, M. Parasi, M. Scheutz, A. Sassaroli, S. Fantini, P. Schermerhorn, A. Girouard, and R.J.K. Jacob, "Sensing Cognitive Multitasking for a Brain-Based Adaptive User Interface," Proc. ACM CHI 2011 Human Factors in Computing Systems Conference, ACM Press (2011). [link]
  • L. Hirshfield, R. Gulotta, S. Hirshfield, S. Hincks, M. Russell, R. Ward, T. Williams, and R. Jacob, "This is Your Brain on Interfaces: Enhancing Usability Testing with Functional Near-Infrared Spectroscopy," Proc. ACM CHI 2011 Human Factors in Computing Systems Conference, ACM Press (2011). [link]
  • G.M. Poor and R.J.K. Jacob, "Introducing Animatronics to HCI: Extending Reality-Based Interaction," HCI International 2011 14th International Conference on Human-Computer Interaction, pp. 593-602, Springer (2011). [link]

2009

  • E.T. Solovey, A. Girouard, K. Chauncey, L.M. Hirshfield, A. Sassaroli, F. Zheng, S. Fantini, and R.J.K. Jacob, "Using fNIRS Brain Sensing in Realistic HCI Settings: Experiments and Guidelines," Proc. ACM UIST 2009 Symposium on User Interface Software and Technology, ACM Press (2009). [link]
  • L.M. Hirshfield, E.T. Solovey, A. Girouard, J. Kebinger, R.J.K. Jacob, A. Sassaroli, and S. Fantini, "Brain Measurement for Usability Testing and Adaptive Interfaces: An Example of Uncovering Syntactic Workload with Functional Near Infrared Spectroscopy," Proc. ACM CHI 2009 Human Factors in Computing Systems Conference, ACM Press (2009). [link]
  • M.S. Horn, E.T. Solovey, R.J. Crouser, and R.J.K. Jacob, "Comparing the Use of Tangible and Graphical Programming Languages for Informal Science Education," Proc. ACM CHI 2009 Human Factors in Computing Systems Conference, ACM Press (2009). [link]
  • A. Girouard, E.T. Solovey, L.M. Hirshfield, K. Chauncey, A. Sassaroli, S. Fantini, and R.J.K. Jacob, "Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements," Proc. INTERACT 2009 Conference (2009). [link]
  • L. Hirshfield, K. Chauncey, R. Gulotta, A. Girouard, E. Solovey, R. Jacob, A. Sassaroli, and S. Fantini, "Combining Electroencephalograph and Near Infrared Spectroscopy to Explore Users' Instantaneous and Continuous Mental Workload States," HCI International 2009 13th International Conference on Human-Computer Interaction, Springer (2009). [link]

2008

  • R.J.K. Jacob, A. Girouard, L.M. Hirshfield, M.S. Horn, O. Shaer, E.T. Solovey, and J. Zigelbaum, "Reality-Based Interaction: A Framework for Post-WIMP Interfaces," Proc. ACM CHI 2008 Human Factors in Computing Systems Conference, pp. 201-210, ACM Press (2008). [link]
  • M.S. Horn, E.T. Solovey, and R.J.K. Jacob, "Tangible Programming and Informal Science Learning: Making TUIs Work for Museums," Proc. IDC 2008 Conference on Interaction Design for Children (2008). [link]
  • A. Bean, S. Siddiqi, A. Chowdhury, B. Whited, O. Shaer, and R.J.K. Jacob, "Marble Track Audio Manipulator: A Tangible User Interface for Music Composition," Proc. TEI 2008 International Conference on Tangible and Embedded Interaction (2008). [link]
  • G. Christou, F.E. Ritter, and R.J.K. Jacob, "Modeling Prehensile Actions for the Evaluation of Tangible User Interfaces," Proc. ITI 2008 30th International Conference on Information Technology Interfaces (2008). [link]

2007

  • A.J. Afram, J. Briedis, D. Fujiwara, R.J.K. Jacob, C.G.L. Cao, and D. Kahle, "Evaluation of Semantic Fisheye Zooming to Provide Focus+Context," Proc. 21st Annual Meeting of the Human Factors and Ergonomics Society, pp. 459-463, Baltimore, Md. (2007). [link]
  • R.J.K. Jacob, A. Girouard, L.M. Hirshfield, M.S. Horn, O. Shaer, E.T. Solovey, and J. Zigelbaum, "Reality-Based Interaction: Unifying the New Generation of Interaction Styles," ACM CHI 2007 Human Factors in Computing Systems Conference, pp. 2465-2470, ACM Press, Work in Progress paper (2007). [link]
  • M. Horn and R.J.K. Jacob, "Tangible Programming in the Classroom with Tern," ACM CHI 2007 Human Factors in Computing Systems Conference, pp. 1965-1970, ACM Press, Interactivity paper (2007). [link]
  • J. Zigelbaum, M. Horn, O. Shaer, and R.J.K. Jacob, "The Tangible Video Editor: Collaborative Video Editing with Active Tokens," Proc. TEI 2007 First International Conference on Tangible and Embedded Interaction, pp. 43-46 (2007). [link]
  • M. Horn and R.J.K. Jacob, "Designing Tangible Programming Languages for Classroom Use," Proc. TEI 2007 First International Conference on Tangible and Embedded Interaction, pp. 159-162 (2007). [link]
  • A. Girouard, E.T. Solovey, L. Hirshfield, S. Ecott, O. Shaer, and R.J.K. Jacob, "Smart Blocks: A Tangible Mathematical Manipulative," Proc. TEI 2007 First International Conference on Tangible and Embedded Interaction, pp. 183-186 (2007). [link]

2006

  • M.S. Horn and R.J.K. Jacob, "Tangible Programming in the Classroom: A Practical Approach," ACM CHI 2006 Human Factors in Computing Systems Conference, pp. 869-874, ACM Press, Work in Progress paper (2006). [link]
  • L. Deligiannidis and R.J.K. Jacob, "The VR Scooter: Wind and Tactile Feedback Improve User Performance," IEEE VR 2006 Symposium on 3D User Interfaces (2006). [link]

2005

  • L. Deligiannidis and R.J.K. Jacob, "An Immersive Environment for the Vase Museum," HCI'05 International Conference on Human-Computer Interaction, 2005 World Congress in Applied Computing (2005). [link]
  • L. Deligiannidis and R.J.K. Jacob, "The London Walkthrough in an Immersive Digital Library Environment," MSV'05 International Conference on Modeling, Simulation and Visualization Methods, 2005 International MultiConference in Computer Science and Computer Engineering (2005). [link]
  • E. Bahna and R.J.K. Jacob, "Augmented Reading: Presenting Additional Information Without Penalty," Proc. ACM CHI 2005 Human Factors in Computing Systems Conference, pp. 1909-1912, ACM Press, Short paper (2005). [link]
  • G. Christou and R.J.K. Jacob, "Identifiability: A Predictive Quantitative Measure for the Comparison of a Task Designed in Different Interaction Styles," HCI International 2005 11th International Conference on Human-Computer Interaction, Lawrence Erlbaum (2005). [link]

2004 and Older

  • H.Y. Shiaw, R.J.K. Jacob, and G.R. Crane, "The 3D Vase Museum: A New Approach to Context in a Digital Library," Proc. JCDL 2004 Joint Conference on Digital Libraries (2004). [link]
  • E.H. Calvillo-Gamez, N. Leland, O. Shaer, and R.J.K. Jacob, "The TAC Paradigm: Unified Conceptual Framework to Represent Tangible User Interfaces," CLIHC 2003 Latin American Conference on Human-Computer Interaction (2003). [link]
  • B. Ullmer, H. Ishii, and R.J.K. Jacob, "Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries," Proc. INTERACT 2003 Conference (2003). [link]
  • L. Deligiannidis, A.L. Couch, and R.J.K. Jacob, "Performance Characterization of Distributed Virtual-Reality Applications: A Case Study," IC'2002 International Conference on Internet Computing, CSREA Press and IEEE Internet Computing Magazine (2002). [link]
  • R.J.K. Jacob, H. Ishii, G. Pangaro, and J. Patten, "A Tangible Interface for Organizing Information Using a Grid," Proc. ACM CHI 2002 Human Factors in Computing Systems Conference, pp. 339-346, ACM Press (2002). [link]
  • A. Chang, S. O'Modhrain, R. Jacob, E. Gunther, and H. Ishii, "ComTouch: Design of a Vibrotactile Communication Device," Proc. ACM DIS 2002 Designing Interactive Systems Conference, ACM Press (2002). [link]
  • L. Deligiannidis and R.J.K. Jacob, "DLoVe: Using Constraints to Allow Parallel Processing in Multi-User Virtual Reality," Proc. IEEE Virtual Reality 2002 Conference, IEEE Computer Society Press (2002). [link]
  • V. Tanriverdi and R.J.K. Jacob, "VRID: A Design Model and Methodology for Developing Virtual Reality Interfaces," Proc. ACM VRST 2001 Symposium on Virtual Reality Software and Technology, ACM Press, Banff, Canada (2001). [link]
  • V. Tanriverdi and R.J.K. Jacob, "Interacting with Eye Movements in Virtual Environments," Proc. ACM CHI 2000 Human Factors in Computing Systems Conference, pp. 265-272, Addison-Wesley/ACM Press (2000). [link]
  • L.E. Sibert and R.J.K. Jacob, "Evaluation of Eye Gaze Interaction," Proc. ACM CHI 2000 Human Factors in Computing Systems Conference, pp. 281-288, Addison-Wesley/ACM Press (2000). [link]
  • R.J.K. Jacob, "A Visual Language for Non-WIMP User Interfaces," Proc. IEEE Symposium on Visual Languages, pp. 231-238, IEEE Computer Society Press (1996). [link]
  • D. Hix, J.N. Templeman, and R.J.K. Jacob, "Pre-Screen Projection: From Concept to Testing of a New Interaction Technique," Proc. ACM CHI'95 Human Factors in Computing Systems Conference, pp. 226-233, Addison-Wesley/ACM Press (1995). [link]
  • R.J.K. Jacob and L.E. Sibert, "The Perceptual Structure of Multidimensional Input Device Selection," Proc. ACM CHI'92 Human Factors in Computing Systems Conference, pp. 211-218, Addison-Wesley/ACM Press (1992). [link]
  • R.J.K. Jacob, "What You Look At is What You Get: Eye Movement-Based Interaction Techniques," Proc. ACM CHI'90 Human Factors in Computing Systems Conference, pp. 11-18, Addison-Wesley/ACM Press (1990). [link]
  • R.J.K. Jacob, "Executable Specifications for a Human-Computer Interface," Proc. ACM CHI'83 Human Factors in Computing Systems Conference, pp. 28-34 (1983). [link]
  • R.J.K. Jacob, "Using Formal Specifications in the Design of a Human-Computer Interface," Proc. ACM Human Factors in Computer Systems Conference, pp. 315-321 (1982). [link]

Journal Articles

2025

  • M. Russell, S. Hincks, L. Wang, A. Babar, Z. Chen, Z. White, and R.J.K Jacob, "Visualization and Workload with Implicit fNIRS-based BCI: Towards a Real-time Memory Prosthesis with fNIRS," Frontiers in Human Neuroscience: Cognitive Neuroergonomics, vol. 6 (2025). [link]
  • J.B. Hollander, L. Naughton, E.L. Miller, and R.J.K Jacob, "The Walkable Neighborhood and Public Art: Using AI to Measure the Impact of Visual Interest on Pedestrian Behavior," Urban Design International (2025). [link]

2021

  • J.B. Hollander, A.P. Lynch, L. Lynch, V. Foster, S. Perlo, R.J.K. Jacob, H.A. Taylor, and T.T. Brunye, "Cognitive Responses to Urban Environments: Behavioral Responses in Lab and Field Conditions," Urban Design International, vol. 26, pp. 256-271 (2021). [link]

2019

  • A. Girouard, O. Shaer, E.T. Solovey, G.M. Poor, and R.J.K. Jacob, "The Reality of Reality-Based Interaction: Understanding the Impact of a Framework as a Research Tool," ACM Transactions on Computer-Human Interaction, vol. 26, no. 5 (2019) article no. 35. [link]
  • A. Bosworth, M. Russell, and R.J.K. Jacob, "Update of fNIRS as an Input to Brain-Computer Interfaces: A Review of Research from the Tufts Human-Computer Interaction Laboratory," Photonics, vol. 6, no. 3 (2019) article no. 90. [link]

2018

  • J.B. Hollander, A. Purdy, A. Wiley, V. Foster, R.J.K. Jacob, H.A. Taylor, and T.T. Brunye, "Seeing the city: Using eye-tracking technology to explore cognitive responses to the built environment," Journal of Urbanism: International Research on Placemaking and Urban Sustainability, vol. 12, no. 2 (2018). [link]

2015

  • E.M. Peck, E. Carlin, and R. Jacob, "Designing Brain-Computer Interfaces for Attention-Aware Systems," IEEE Computer, vol. 48, no. 10, pp. 34-42 (October 2015). [link]
  • E.T. Solovey, D. Afergan, E.M. Peck, S.W. Hincks, and R.J.K. Jacob, "Designing Implicit Interfaces for Physiological Computing: Guidelines and Lessons Learned with fNIRS," ACM Transactions on Computer-Human Interaction, vol. 21, no. 6 (2015) article no. 35. [link]

2013

  • A. Girouard, E.T. Solovey, and R.J.K. Jacob, "Designing a Passive Brain Computer Interface using Real Time Classification of Functional Near-Infrared Spectroscopy," International Journal of Autonomous and Adaptive Communications Systems, vol. 6, no. 1, pp. 26-44 (2013).

2012

  • G. Christou, F.E. Ritter, and R.J.K. Jacob, "CODEIN - A new notation for GOMS to handle evaluations of reality based interaction style interfaces," International Journal of Human-Computer Interaction, vol. 28, no. 3, pp. 189-201 (2012). [link] [alternate link]

2010

  • E.M. Peck, E.T. Solovey, K. Chauncey, A. Sassaroli, S. Fantini, R.J.K. Jacob, A. Girouard, and L.M. Hirshfield, "Your Brain, Your Computer, and You," IEEE Computer, vol. 43, no. 12, pp. 86-89 (December 2010). [link]

2009

  • O. Shaer and R.J.K. Jacob, "A Specification Paradigm for the Design and Implementation of Tangible User Interfaces," ACM Transactions on Computer-Human Interaction, vol. 16, no. 4 (2009). [link]
  • O. Shaer, M.S. Horn, and R.J.K. Jacob, "Tangible User Interface Laboratory: Teaching Tangible Interaction Design in Practice," Journal of Artificial Intelligence for Engineering Design, Analysis and Manufacturing (AIEDAM), vol. 23, no. 3, pp. 251-261 (Spring 2009). [link]

2008

  • A. Sassaroli, F. Zheng, L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, and S. Fantini, "Discrimination of Mental Workload Levels in Human Subjects with Functional Near-Infrared Spectroscopy," Journal of Innovative Optical Health Sciences, vol. 1, no. 2, pp. 227-237 (2008). [link]

2005

  • B. Ullmer, H. Ishii, and R.J.K. Jacob, "Token+Constraint Systems for Tangible Interaction with Digital Information," ACM Transactions on Computer-Human Interaction, vol. 12, no. 1, pp. 81-118 (March 2005). [link]
  • L. Deligiannidis and R.J.K. Jacob, "Improving Performance of Virtual Reality Applications Through Parallel Processing," Journal of Supercomputing, vol. 33, no. 3, pp. 155-173 (September 2005). [link]

2004

  • O. Shaer, N. Leland, E.H. Calvillo-Gamez, and R.J.K. Jacob, "The TAC Paradigm: Specifying Tangible User Interfaces," Personal and Ubiquitous Computing, vol. 8, no. 5, pp. 359-369 (Sept. 2004). [link]

1999 and Earlier

  • R.J.K. Jacob, L. Deligiannidis, and S. Morrison, "A Software Model and Specification Language for Non-WIMP User Interfaces," ACM Transactions on Computer-Human Interaction, vol. 6, no. 1, pp. 1-46 (March 1999). [link]
  • R.J.K. Jacob, "Human-Computer Interaction: Input Devices," ACM Computing Surveys, vol. 28, no. 1, pp. 177-179 (March 1996). [link]
  • R.J.K. Jacob, L.E. Sibert, D.C. McFarlane, and M.P. Mullen, Jr., "Integrality and Separability of Input Devices," ACM Transactions on Computer-Human Interaction, vol. 1, no. 1, pp. 3-26 (March 1994). [link]
  • R.J.K. Jacob, "Eye-gaze Computer Interfaces: What You Look At is What You Get," IEEE Computer, vol. 26, no. 7, pp. 65-67 (July 1993). [link]
  • R.J.K. Jacob, J.J. Leggett, B.A. Myers, and R. Pausch, "Interaction Styles and Input/Output Devices," Behaviour and Information Technology, vol. 12, no. 2, pp. 69-79 (1993). [link]
  • M. Green and R.J.K. Jacob, "Software Architectures and Metaphors for Non-WIMP User Interfaces," Computer Graphics, vol. 25, no. 3, pp. 229-235 (July 1991). [link]
  • R.J.K. Jacob, "The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look At is What You Get," ACM Transactions on Information Systems, vol. 9, no. 3, pp. 152-169 (April 1991) Also reprinted with commentary in Readings in Intelligent User Interfaces, ed. M.T. Maybury and W. Wahlster, Morgan Kaufmann, San Francisco, 1998, pp. 65-83. [link]
  • R.J.K. Jacob and J.N. Froscher, "A Software Engineering Methodology for Rule-based Systems," IEEE Transactions on Knowledge and Data Engineering, vol. 2, no. 2, pp. 173-189 (June 1990). [link]
  • R.J.K. Jacob, "A Specification Language for Direct Manipulation User Interfaces," ACM Transactions on Graphics, vol. 5, no. 4, pp. 283-317 (1986). [link]
  • R.J.K. Jacob, "A State Transition Diagram Language for Visual Programming," IEEE Computer, vol. 18, no. 8, pp. 51-59 (1985). [link]
  • R.J.K. Jacob, "Using Formal Specifications in the Design of a Human-Computer Interface," Communications of the ACM, vol. 26, no. 4, pp. 259-264 (1983) Also reprinted in Software Specification Techniques, ed. N. Gehani and A.D. McGettrick, Addison-Wesley, Reading, Mass., 1986, pp. 209-222. [link]
  • R.J.K. Jacob, H.E. Egeth, and W. Bevan, "The Face as a Data Display," Human Factors, vol. 18, pp. 189-199 (1976). [link]

Other Published Proceedings

2026

  • J. Santaniello, M. Russell, B. Jiang, D. Sassaroli, R.J.K. Jacob, and J. Sinapov, "Towards Reinforcement Learning from Neural Feedback: Mapping fNIRS Signals to Agent Performance," Proc. AAAI-26 40th Annual AAAI Conference on Artificial Intelligence, Main technical track, Poster paper (2026).

2025

  • J. Santaniello, M. Russell, B. Jiang, D. Sassaroli, R.J.K. Jacob, and J. Sinapov, "Mapping Neural Signals to Agent Performance, A Step Towards Reinforcement Learning from Neural Feedback," Sixth Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM) (2025). [link]
  • M. Russell, Q. Zhong, K. Zheng, K. Hu, J. Santaniello, and R.J.K. Jacob, "LLM-Tools' Effects on Users During Complex Decision-Making with FNIRS," Neuroadaptive Technology Conference NAT'25 (2025). [link]
  • M. Russell, G. Blaney, and R.J.K. Jacob, "Very-Low Frequency Oscillations as a Correlate of Neural Activation," Neuroadaptive Technology Conference NAT'25 (2025). [link]
  • M. Russell, W. Xia, S. Youkeles, A. Gu, and R.J.K. Jacob, "Neural Correlates of Move Quality During Chess Games: a Low-Cost EEG Study," Neuroadaptive Technology Conference NAT'25 (2025). [link]

2024

  • M. Russell, S. Hincks, L. Wang, A. Babar, Z. Chen, Z. White, and R.J.K Jacob, "Visualization and Workload with Implicit fNIRS-based BCI," Proc. Fifth International Neuroergonomics Conference (2024).

2022

  • E. Harvey, L. Wang, and R.J.K Jacob, "Improving fNIRS-based BCIs with Convex Optimization for Generalized Classification and Semi-supervised Learning," Neuroadaptive Technology Conference NAT'22 (2022).

2016

  • E.Y.J. Lee, B.F. Yuksel, D. Afergan, S.W. Hincks, T. Shibata, E.T. Solovey, A. Jenkins, K.B. Oleson, L. Harrison, E.M. Peck, R. Chang, and R.J.K. Jacob, "Using brain states to enhance user experience," Fourth Seoul International Conference on Applied Science and Engineering (SICASE 2016), Poster paper (2016).

2015

  • B.F. Yuksel, E.M. Peck, D. Afergan, S.W. Hincks, T. Shibata, J. Kainerstorfer, K. Tgavalekos, A. Sassaroli, S. Fantini, and R.J.K. Jacob, "Functional near-infrared spectroscopy for adaptive human-computer interfaces," Proc. SPIE Conference on Optical Tomography and Spectroscopy of Tissue XI (2015). [link]

2014

  • T. Shibata, E.M. Peck, D. Afergan, S.W. Hincks, B.F. Yuksel, and R.J.K. Jacob, "Building Implicit Interfaces for Wearable Computers with Physiological Inputs: Zero Shutter Camera and Phylter," Proc. ACM UIST 2014 Symposium on User Interface Software and Technology, pp. 89-90, ACM Press, Poster paper (2014). [link]

2011

  • E. Peck, E. Solovey, S. Su, R. Jacob, and R. Chang, "Near to the Brain: Functional Near-Infrared Spectroscopy as a Lightweight Brain Imaging Technique for Visualization," IEEE InfoVis Conference on Information Visualization, Poster presentation (2011) Best Poster Award. [link]

2009

  • A. Sassaroli, F. Zheng, M. Coutts, L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, Y. Tong, B. deB. Frederick, and S. Fantini, "Application of near-infrared spectroscopy for discrimination of mental workloads," Proc. SPIE Conference, vol. 7174, pp. 71741H 1-7 (2009). [link]

2007

  • L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, A. Sassaroli, Y. Tong, and S. Fantini, "Human-Computer Interaction and Brain Measurement Using Functional Near-Infrared Spectroscopy," Proc. ACM UIST 2007 Symposium on User Interface Software and Technology, ACM Press, Poster paper (2007). [link]

2006

  • G. Christou, R.J.K. Jacob, and P.L. Cheng, "Modeling the Task: Leveraging Knowledge-in-the-Head at Design Time," Proc. ICEIS 06 8th International Conference on Enterprise Information Systems, pp. 131-134 (2006).

2004 and Earlier

  • E. Diep and R.J.K. Jacob, "Visualizing E-mail with a Semantically Zoomable Interface," IEEE InfoVis 2004 Symposium on Information Visualization, Poster paper (2004). [link]
  • G. Christou and R.J.K. Jacob, "Evaluating and Comparing Interaction Styles," DSV-IS'03 Eurographics Workshop on Design, Specification, Verification of Interactive Systems, Short paper (2003). [link]
  • R.J.K. Jacob, "Open Syntax: Improving Access for All Users," Proc. WUAUC'01 Workshop on Universal Accessibility of Ubiquitous Computing: Providing for the Elderly, pp. 84-89, ACM Press (2001). [link]
  • R.J.K. Jacob and J.G. Schmolze, "A Human-Computer Interaction Framework for Media-Independent Knowledge," AAAI Workshop on Representations for Multi-Modal Human-Computer Interaction, pp. 26-30, Position paper, Technical Report WS-98-09, AAAI Press, Menlo Park, Calif. (1998). [link]
  • S.A. Morrison and R.J.K. Jacob, "A Specification Paradigm for Design and Implementation of Non-WIMP User Interfaces," ACM CHI'98 Human Factors in Computing Systems Conference, pp. 357-358, Addison-Wesley/ACM Press, Poster paper (1998). [link]
  • M.A. Perez and R.J.K. Jacob, "A UIMS Architecture for Focus Processing in a Graphical User Interface," AAAI Symposium on Intelligent Multi-Media Multi-Modal Systems, pp. 87-92, AAAI, Stanford, Calif. (1994). [link]
  • R.J.K. Jacob, "What You Look At is What You Get: Using Eye Movements as Computer Input," Proc. Virtual Reality Systems'93 Conference, pp. 164-166, SIG Advanced Applications, New York, N.Y. (1993). [link]
  • R.J.K. Jacob and J.N. Froscher, "Software Engineering for Rule-based Systems," Proc. Fall Joint Computer Conference, pp. 185-189, Dallas, Tex. (1986). [link]
  • R.J.K. Jacob, "Direct Manipulation," Proc. IEEE Conference on Systems, Man, and Cybernetics, pp. 384-388, Atlanta, Ga. (1986). [link]
  • J.N. Froscher and R.J.K. Jacob, "Designing Expert Systems for Ease of Change," Proc. IEEE Symposium on Expert Systems in Government, pp. 246-251, Washington, D.C. (1985). [link]
  • R.J.K. Jacob and J.N. Froscher, "Developing a Software Engineering Methodology for Rule-based Systems," Proc. 1985 Conference on Intelligent Systems and Machines, pp. 179-183, Oakland University (1985). [link]
  • M.R. Cornwell and R.J.K. Jacob, "Structure of a Rapid Prototype Secure Military Message System," Seventh DOD/NBS Computer Security Conference, pp. 48-57, Gaithersburg, Md. (1984). [link]
  • R.J.K. Jacob, "User-Level Window Managers for UNIX," Proc. UniForum International Conference on UNIX, pp. 123-133 (1984). [link]
  • R.J.K. Jacob, "Symbols for the Display of Multivariate Data: The Face," Proceedings of the First General Conference on Social Graphics, Leesburg, Va. (1978) Census Bureau Technical Paper No. 49. [link]