PhD Study : Augmented Reality Brain-computer Interface

Summary

Background:

A brain-computer interface (BCI) offers an alternative method of communication and control for those who have suffered neuromuscular damage due to disease or injury. Motor imagery/movement imagination is used by a BCI user to modulate sensorimotor rhythms (SMRs) to relay intent to a computer or machine without movement. Motor imagery is a skill that can be learned by the user to enhance BCI control. Feedback perceived through our senses is critical to learning this control.

The role of feedback in user learning and its relevance for insight into the underlying mechanisms of BCI user-training is critical - this project will investigate and study new forms of feedback for BCI learning. The proposition that feedback is defined by three main characteristics, i.e. its content, its modality of presentation and its timing, will be investigated through a range of state-of-the-art technologies installed at the Intelligent Systems Research Centre’s new Spatial Computing and Neurotechnology Innovation Hub (SCANi-hub). These include the latest augmented reality (AR) and virtual reality (VR) technologies and vibrotactile interfaces. AR is a state-of-the-art method for presentation of vision and audio which allows for the overlay of virtual imagery and sounds onto a real-world environment and has been shown to increase both engagement and learning in new tasks [1]. Using AR to present feedback can provide a more naturalist and intuitive method of feedback of imagined movement akin to how we experience the natural movement of a limb. This coupled with vibrotactile feedback using mechanical/ultrasound vibration can be used to enhance the sensation of the imagined movement of the virtual limb.

Context:

It has been shown that BCI performance is affected when varying the type of feedback presented, whether that is visual, auditory or vibrotactile, and that by combining feedback from multiple sensory channels increases BCI performance [2]. A combination of AR feedback should further increase this performance. There are also several recent studies investigating the combination of BCI and AR, demonstrating an increasing interest in the field. Whereas visual feedback is typically presented using a computer monitor and audio presented in either mono or stereo using loudspeakers or headphones, this project will use video see-through on a head-mounted display in combination with spatialised audio and vibrotactile response.

Impact:

A main field of application for the technology is in robotics and rehabilitation where AR BCI can enhance user experience. The project will involve the development of an AR BCI aimed at providing enhanced engagement and hence increasing performance for both healthy and disabled users. New experimental paradigms will be developed and trialled with human participants. Research questions will address what information should be delivered, and how and when the feedback should be provided.

References:

[1] Dede, C., 2009. Immersive interfaces for engagement and learning. science, 323(5910), pp.66-69.

[2] Hinterberger, Thilo, Nicola Neumann, Mirko Pham, Andrea Kübler, Anke Grether, Nadine Hofmayer, Barbara Wilhelm, Herta Flor, and Niels Birbaumer. "A multimodal brain-based feedback and communication system." Experimental brain research 154, no. 4 (2004): 521-526.

Essential criteria

Applicants should hold, or expect to obtain, a First or Upper Second Class Honours Degree in a subject relevant to the proposed area of study.

We may also consider applications from those who hold equivalent qualifications, for example, a Lower Second Class Honours Degree plus a Master’s Degree with Distinction.

In exceptional circumstances, the University may consider a portfolio of evidence from applicants who have appropriate professional experience which is equivalent to the learning outcomes of an Honours degree in lieu of academic qualifications.

• Research proposal of 1500 words detailing aims, objectives, milestones and methodology of the project
• A demonstrable interest in the research area associated with the studentship

Desirable Criteria

If the University receives a large number of applicants for the project, the following desirable criteria may be applied to shortlist applicants for interview.

• First Class Honours (1st) Degree
• Masters at 70%
• For VCRS Awards, Masters at 75%
• Publications - peer-reviewed
• Experience of presentation of research findings
• Applicants will be shortlisted if they have an average of 75% or greater in a first (honours) degree (or a GPA of 8.75/10). For applicants with a first degree average in the range of 70% to 74% (GPA 3.3): If they are undertaking an Masters, then the average of their first degree marks and their Masters marks will be used for shortlisting.

Funding and eligibility

The University offers the following levels of support:

Vice Chancellors Research Studentship (VCRS)

The following scholarship options are available to applicants worldwide:

• Full Award: (full-time tuition fees + £19,000 (tbc))
• Part Award: (full-time tuition fees + £9,500)
• Fees Only Award: (full-time tuition fees)

These scholarships will cover full-time PhD tuition fees for three years (subject to satisfactory academic performance) and will provide a £900 per annum research training support grant (RTSG) to help support the PhD researcher.

Applicants who already hold a doctoral degree or who have been registered on a programme of research leading to the award of a doctoral degree on a full-time basis for more than one year (or part-time equivalent) are NOT eligible to apply for an award.

Please note: you will automatically be entered into the competition for the Full Award, unless you state otherwise in your application.

Department for the Economy (DFE)

The scholarship will cover tuition fees at the Home rate and a maintenance allowance of £19,000 (tbc) per annum for three years (subject to satisfactory academic performance).

This scholarship also comes with £900 per annum for three years as a research training support grant (RTSG) allocation to help support the PhD researcher.

• Candidates with pre-settled or settled status under the EU Settlement Scheme, who also satisfy a three year residency requirement in the UK prior to the start of the course for which a Studentship is held MAY receive a Studentship covering fees and maintenance.
• Republic of Ireland (ROI) nationals who satisfy three years’ residency in the UK prior to the start of the course MAY receive a Studentship covering fees and maintenance (ROI nationals don’t need to have pre-settled or settled status under the EU Settlement Scheme to qualify).
• Other non-ROI EU applicants are ‘International’ are not eligible for this source of funding.
• Applicants who already hold a doctoral degree or who have been registered on a programme of research leading to the award of a doctoral degree on a full-time basis for more than one year (or part-time equivalent) are NOT eligible to apply for an award.

Due consideration should be given to financing your studies. Further information on cost of living