OU Profiles homepage Edit my profile User guide Accessibility Statement
Picture  of Paul Mulholland

Dr Paul Mulholland

Senior Research Fellow

Knowledge Media Institute

paul.mulholland@open.ac.uk

Biography

Professional biography

Paul Mulholland's research is concerned with developing computational tools and methods to help people make sense of information, and develop and express their ideas. He has been a Principal Investigator or Co-Investigator on 12 national or European projects delivering outcomes including: technologies for the visitor use of archives and museum collections, mobile applications for formal and informal learning; automated narrative generation tools; and semantic and knowledge technologies for school and work-based learning. He has a first degree in psychology, a Masters degree in computing and PhD in cognitive science. He has published over 100 conference and journal articles. He is Deputy Editor of the International Journal of Human Computer Studies.

As part of the European Union Horizon 2020 SPICE project he is working on tools and methods to support Citizen Curation, in which citizens are supported in developing personal interpretations of cultural artefacts, sharing their own perspective and understanding the perspectives of others. 

Within the European Union Horizon 2020 Polifonia project he is working on the use of visualisation, gesture and haptic interfaces to create novel ways of interacting with musical content.

Research interests

My research falls in the areas of technology enhanced learning, human computer interaction, museum informatics, digital humanities and music computing.

Projects

Organised Crime Group Mapping

The National Crime Agency (NCA) makes use of an Organised Crime Group Mapping (OCGM) process to capture information about active Organised Crime Groups (OCGs) in the UK. A scoring mechanism is then used to translate the set of captured OCG features into a risk of harm assessment score. The risk of harm of each OCG is then use to assist with the prioritization of police activity and strategic reporting. The OCGM was originally developed in 2007. Currently, over 50 police forces and agencies submit information on OCGs on a quarterly basis. The reports describe each OCG according to a number of features. Each feature is broken down into a series of sub-questions. The aggregated data from the contributing forces and agencies is used in a risk of harm calculation process that produces a score for each OCG. The risk score weights a number of factors related to intent, capability and criminality of the OCG. At the request of practitioners, the aim of the current project is to analyse both parts of the process by looking at: 1) The method currently used by OCG contributors to describe the features of the OCGs 2) The method currently used by the NCA to determine risk of harm from the aggregated OCG data. Findings will be used to recommend improvements to how OCGs are described (i.e. how data is captured) and how those descriptions can be used most effectively in order to calculate risk.

Publications

Book

Using Linked Data Effectively (2013)

Music and Human-Computer Interaction (2013)

Book Chapter

Deep Learning to Encourage Citizen Involvement in Local Journalism (2022)

Facade-X: An Opinionated Approach to SPARQL Anything (2021)

Modelling museum narratives to support visitor interpretation (2016)

Weaving location and narrative for mobile guides (2013)

Video analysis for evaluating music interaction: musical tabletops (2013)

Song walker harmony space: embodied interaction design for complex musical skills (2013)

The Haptic Bracelets: learning multi-limb rhythm skills from haptic stimuli while reading (2013)

Towards a participatory approach for interaction design based on conceptual metaphor theory: a case study from music interaction (2013)

Music interaction: understanding music and human-computer interaction (2013)

Scripting personal inquiry (2012)

Whole body interaction in abstract domains (2011)

Pioneers, subcultures and cooperatives: The grassroots augmentation of urban places (2008)

Symbolic modelling (2005)

Cognitive modelling and cognitive architectures (2005)

Ubiquity from the bottom up: Grassroots initiated networked communities (2005)

Community story exchange (2004)

A Critical Analysis of Synthesizer User Interfaces for Timbre (2004)

Scene-Driver: an interactive narrative environment using content from an animated children’s television series (2004)

Supporting the exploration and use of heritage stories (2004)

Knowledge support for virtual modelling and simulation (2003)

Journal Article

Integrating Citizen Experiences in Cultural Heritage Archives with a Linked Non-Open Data Hub (2024)

Co‐creating an equality diversity and inclusion learning analytics dashboard for addressing awarding gaps in higher education (2024)

Democratizing Clinical Movement Analysis: Assessing the Versatility of MoJoXlab with Open-protocol Inertial Sensors (2024)

Path-based and triplification approaches to mapping data into RDF: User behaviours and recommendations (2024)

Knowledge Graph Construction with a façade: a unified method to access heterogeneous data sources on the Web (2023)

Integrating Citizen Experiences in Cultural Heritage Archives: Requirements, State of the Art, and Challenges (2022)

A Comparison of Attribute-Focused and Harm-Focused Methods for Assessing the Risk of Organized Crime Groups: Are They in Agreement? (2021)

Uncomfortable Revelations: can citizen curation widen access to museums? (2021)

Rhythmic Haptic Cueing Using Wearable Devices as Physiotherapy for Huntington Disease: Case Study (2020)

Enabling multiple voices in the museum: Challenges and approaches (2020)

A Nonproprietary Movement Analysis System (MoJoXlab) Based on Wearable Inertial Measurement Units Applicable to Healthy Participants and Those With Anterior Cruciate Ligament Reconstruction Across a Range of Complex Tasks: Validation Study (2020)

The role of nonlinear dynamics in interactions with digital and acoustic musical instruments (2020)

Introduction to the Special Issue on the 50th Anniversary of IJHCS (2019)

Supporting the discoverability of open educational resources (2019)

Nonlinear Dynamical Processes in Musical Interactions: investigating the role of nonlinear dynamics in supporting surprise and exploration in interactions with digital musical instruments (2019)

Improving comprehension of Knowledge Representation languages: a case study with Description Logics (2019)

Detecting Important Life Events on Twitter Using Frequent Semantic and Syntactic Subgraphs (2016)

Personal inquiry: orchestrating science investigations within and beyond the classroom (2015)

Using machine-learning and visualisation to facilitate learner interpretation of source material (2014)

Challenges in personalisation: supporting mobile science inquiry learning across contexts (2013)

nQuire: technological support for personal inquiry learning (2012)

Doing geography: a multimodal analysis of students' situated improvisational interpretation during fieldtrips (2012)

Personal inquiry learning trajectories in geography: technological support across contexts (2011)

How technology resources can be used to represent personal inquiry and support students' understanding of it across contexts (2011)

What can the language of musicians tell us about music interaction design? (2010)

Using netbooks to support mobile learners' investigations across activities and places (2010)

Networking communities from the bottom up: grassroots approaches to overcoming the digital divide (2010)

Personal inquiry: innovations in participatory design and models for inquiry learning (2010)

Pragmatic support for taxonomy-based annotation of structured digital documents (2009)

Using mobile phones to map online community resources to a physical museum space (2009)

Blending coherence and control in the construction of interactive educational narratives from digital resources (2008)

Worlds and transformations: Supporting the sharing and reuse of engineering design knowledge (2007)

Re-using digital narrative content in interactive games (2007)

Combining gameplay and narrative techniques to enhance the user experience of viewing galleries (2007)

Bletchley Park text: using mobile and semantic web technologies to support the post-visit use of online museum resources (2005)

Introduction: contemporary perspectives on learning for work (2005)

Supporting continuous learning in a large organization: the role of group and organizational perspectives (2005)

CIPHER: Enabling Communities of Interest to Promote Heritage of European Regions (2002)

Using digital narratives to support the collaborative learning and exploration of cultural heritage (2002)

A Methodological approach to supporting organisational learning (2001)

Learning by building: A visual modelling language for psychology students (2000)

Integrating working and enrichment approach learning: a document (2000)

Supporting organisational learning: an overview of the ENRICH approach (2000)

Sharing engineering design knowledge in a distributed environment (2000)

An effective web-based software visualization learning environment (1998)

Teaching programming at a distance: the Internet software visualization laboratory (1997)

Fostering debugging communities on the Web (1997)

Presentation / Conference

Prescriptive analytics motivating distance learning student action: A case study of a student-facing dashboard (2025)

Investigating Vividness Bias in Language Models Through Art Interpretations (2024)

Supporting the End-User Curation of Cultural Heritage Knowledge Graphs (2024)

Musical Meetups Knowledge Graph (MMKG): a collection of evidence for historical social network analysis (2024)

CERSEI: Cognitive Effort Based Recommender System for Enhancing Inclusiveness (2023)

The Sound of Paintings: Using Citizen Curation to Explore the Cross-Modal Personalization of Museum Experiences (2023)

Musical Meetups: a Knowledge Graph approach for Historical Social Network Analysis (2023)

SPICE Linked Data Hub - Data infrastructure and tools to support Citizen Curation (2023)

Predictive Learning Analytics and University Teachers: Usage and perceptions three years post implementation (2023)

An agent for creative development in drum kit playing (2023)

Deep Viewpoints: Scripted Support for the Citizen Curation of Museum Artworks (2023)

Edge-labelled graphs and property graphs - to the user, more similar than different (2022)

Edge-labelled graphs and property graphs - to the user, more similar than different (2022)

Introducing empathy into recommender systems as a tool for promoting social cohesion (2021)

Tourist recommendations with a touch of SPICE: A TRS with deep cultural understanding (2021)

A principled approach to the development of drum improvisation skills through interaction with a conversational agent (2020)

Towards Advanced Interfaces for Citizen Curation (2020)

A comparison of the cognitive difficulties posed by SPARQL query constructs (2020)

Gait Rehabilitation for Neurological Conditions using Wearable Devices (2019)

Deriving Personas Based on Attitudes to Interruption and Information Overload (2019)

Choosers: The design and evaluation of a visual algorithmic music composition language for non-programmers (2018)

Patterns of Design (2018)

Wearable Haptic Devices for Long-Term Gait Re-education for Neurological Conditions (2018)

How can rhythmic haptic cueing using wearable haptic devices help gait rehabilitation for stroke survivors: a longitudinal pilot study (2018)

Wearables for Long Term Gait Rehabilitation of Neurological Conditions (2018)

A longitudinal rehabilitation case study for hemiparetic gait using outdoor rhythmic haptic cueing via a wearable device (2018)

Gait rehabilitation by outdoor rhythmic haptic cueing using wearable technology for neurological conditions: a case study (2018)

Using SPARQL – the practitioners’ viewpoint (2018)

Choosers: designing a highly expressive algorithmic music composition system for non-programmers (2017)

Characterizing the Landscape of Musical Data on the Web: State of the Art and Challenges (2017)

Using Insights from Psychology and Language to Improve How People Reason with Description Logics (2017)

Designing a Highly Expressive Algorithmic Music Composition System for Non-Programmers (2016)

Identifying Important Life Events from Twitter Using Semantic and Syntactic Patterns (2016)

Identifying Prominent Life Events on Twitter (2015)

Making sense of description logics (2015)

Navigation strategies in the cityscape/datascape (2015)

Predicting Answering Behaviour in Online Question Answering Communities (2015)

Prototyping a method for the assessment of real-time EEG sonifications (2015)

Investigating the effects of introducing nonlinear dynamical processes into digital musical interfaces (2015)

Modelling Question Selection Behaviour in Online Communities (2015)

Storyscope: Using setting and theme to assist the interpretation and development of museum stories (2015)

Storyscope: Supporting the authoring and reading of museum stories using online data sources (2015)

Automatic Identification of Personal Life Events in Twitter (2015)

Nonlinear Dynamical Systems as Enablers of Exploratory Engagement with Musical Instruments (2014)

Mobile technology to support coherent story telling across freely explored outdoor artworks (2014)

Eliciting Domain Knowledge Using Conceptual Metaphors: A Case Study from Music Interaction (2014)

Dynamical Interactions with Electronic Instruments (2014)

A cognitive dimensions analysis of interaction design for algorithmic composition software (2014)

Dynamical Systems in Interaction Design for Improvisation (2014)

Using event spaces, setting and theme to assist the interpretation and development of museum stories (2014)

Using ontologies: understanding the user experience (2014)

Cultural learning across the smart city (2014)

The usability of description logics: understanding the cognitive difficulties presented by description logics (2014)

Modelling the meaning of museum stories (2013)

Exploring scholarly data with Rexplore. (2013)

An empirical perspective on representing time (2013)

Curation, curation, curation (2013)

Storyscope: using theme and setting to guide story enrichment from external data sources (2013)

Web supported emplotment: using object and event descriptions to facilitate storytelling online and in galleries (2012)

QrAte: historical learning through a curatorial inquiry task using web resources (2012)

Storyspace: a story-driven approach for creating museum narratives (2012)

Curate and storyspace: an ontology and web-based environment for describing curatorial narratives (2012)

We can work it out: towards a participatory approach to designing music interactions (2011)

CHARACTER-EYES: story-driven inquiry from a character’s viewpoint (2011)

An event-based approach to describing and understanding museum narratives (2011)

A novel approach to visualizing and navigating ontologies (2011)

A “laboratory of knowledge-making” for personal inquiry learning (2011)

An information foraging theory based user study of an adaptive user interaction framework for content-based image retrieval (2011)

nQuire: a customizable toolkit for inquiry learning across school, home and field trip locations (2010)

More notspots than hotspots: strategies for undertaking networked learning in the real world (2010)

Personal Inquiry: scripting support for inquiry learning by participatory design (2010)

A novel user interface for musical timbre design (2010)

Applying information foraging theory to understand user interaction with content-based image retrieval (2010)

Being a Geographer: the role of mobile, scripted inquiry in mediating embodied meaning-making during Geography fieldtrips (2010)

Knowledge modelling to support inquiry learning tasks (2010)

Visual summaries of data: a spatial hypertext approach to user feedback (2010)

The challenge of supporting networked personal inquiry learning across contexts (2010)

Analysis of conceptual metaphors to improve music software: the role of prior experience in inclusive music interaction (2009)

Reasoning across multilingual learning resources in human genetics (2009)

Activity guide: an approach to scripted inquiry learning (2009)

Characterising participation trajectories and the negotiation of personalised inquiry learning in the secondary school geography classroom (2009)

Evaluating musical software using conceptual metaphors (2009)

Intelligent support for inquiry learning from images: a learning scenario and tool (2009)

Technological mediation of personal inquiry in UK GCSE geography: opportunities and challenges (2009)

Supporting location-based inquiry learning across school, field and home contexts (2008)

From design to narrative: the development of inquiry-based learning models (2008)

Exploring pathways across stories (2008)

Investigating the Effects of Exploratory Semantic Search on the Use of a Museum Archive (2008)

Investigating personal inquiry: An activity theory approach (2008)

Timbre space as synthesis space: towards a navigation based approach to timbre specification (2008)

Using ICT to support public and private community memories: case studies and lessons learned (2006)

Knowledge support of simulation model development by reuse (2006)

Semantic browsing of digital collections (2005)

Spotlight browsing of resource archives (2005)

Towards a mapping of timbral space (2005)

Grassroots initiated networked communities: A study of hybrid physical/virtual communities (2005)

Scene-driver: a narrative-driven game architecture reusing broadcast animation content (2004)

Story Fountain: Intelligent support for Story Research And Exploration (2004)

Knowledge support of cautious sharing of knowledge for simulation model assembly (2004)

Grassroots initiated networked communities: a viable method of overcoming multiple digital inequalities within communities of locality? (2004)

Scene driver: reusing broadcast animation content for engaging, narratively coherent games (2004)

Supporting the sharing and reuse of modelling and simulation design knowledge (2003)

Knowledge support for story construction, exploration and personalization in Cultural Heritage Forums (2003)

Methodology and tools to support storytelling in cultural heritage forums (2003)

A toolkit and methodology to support the collaborative development and reuse of engineering models (2003)

Framework for Knowledge Support of Simulation in Engineering (2002)

A Cultural Heritage Forum Celebrating Technological Innovation at Station X (2002)

Using genre to support active participation in learning communities (2001)

Using a fine-grained comparative evaluation technique to understand and design software visualization tools (1997)

Report

PVC-Challenges Response: A student facing dashboard for online undergraduate students (2023)

An analysis of algorithmic composition interaction design with reference to Cognitive Dimensions (2014)

Synthesizer user interface design - lessons learned from a heuristic review (2004)

Thesis

A framework for describing and evaluating software visualization systems : a case-study in Prolog. (1995)