ML and NLP approaches and the processes surrounding them often focus on finding a single “truth” or gold standard by majority vote and removing any “outliers”. From the curation of data sets (where we use measurements like inter-annotator agreement as a quality attribute) to the presentation of results (where less favorable options are regularly excluded), different perspectives and disagreements are typically excluded in ML. In reality, such a single truth often does not exist. From the legal to the medical domain, experts often have different opinions. Erasing deviating perspectives and disagreement is not only an untruthful representation of reality, but it can also negatively impact the reliability and usefulness of an ML system. In societal and political debates, having and exchanging different opinions is even one of the defining properties of democratic societies.
This PhD project aims to investigate how different opinions of and disagreements between annotators and other sources for “ground truth” can be represented in NLP and leveraged to improve the support that AI systems can provide to their users. The project will consider all steps of the process, from the gathering and annotation of data, the use of the data to train NLP models, to the representation of results.
During the project, the PhD candidate will perform research on some of the following tasks:
As a doctoral student, your key responsibilities will be to manage and carry out your research project within 48 months and write a PhD thesis. You will participate in research and training activities and disseminate research in the scientific community (international conferences) and non-scientific community by outreach and public engagement. Furthermore, you will write articles for scientific peer-reviewed journals and progress reports and prepare results for publication and dissemination via public lectures, presentations, and the web.
You will also be responsible for taking courses per the research education and liaising with the other research staff, students, and partner institutions working in broad areas relevant to the research project. Participation in other department duties, such as meetings, teaching, etc., is expected to cover a maximum scope of 20%.
Your profileWe encourage high responsibility and independence, while collaborating with colleagues, researchers, other university staff and partners. We follow the terms of employment by the Dutch Collective Labour Agreement for Universities (CAO). Our offer contains: a full-time 4-year PhD position with a qualifier in the first year; excellent mentorship in a stimulating research environment with excellent facilities; and a personal development program within the Twente Graduate School. It also includes:
Are you interested in being part of our team? Please submit your application before the 4th of December and include:
Additional information can be acquired via email from [email protected].
Selection Process
A first round of speed interviews (max. 30 min, online) is scheduled to take place between the 18th and 22nd of December, invitations will be sent out approximately one week after the application deadline. The final round of interviews will be conducted online in January. The anticipated starting date is from February 2024 onwards, depending on processing times for Visa and administrative processes.
About the departmentThe HBE department is dedicated to encouraging a supportive and inclusive working culture. Our aim is that all job applicants are given equal opportunities. When we select candidates for employment, it will be on the basis of their competence and ability. To support the workforce diversity, we are open to offer flexible working conditions on an individual basis to support work-life balance, that may include contract of employment, working hours and location, or child care arrangements.
The High Business Entrepreneurship corporate video can be watched via this link.
About the organisationThe Faculty of Behavioral, Management and Social sciences (BMS) aims to play a key role in understanding, jointly developing and evaluating innovations in society. Technological developments are the engine of innovation. As a technical university that puts people first, we tailor them to human needs and behavior and use social engineering to integrate them into society. We also ensure adequate governance at public and private level, and robust, inclusive and fair organizational structures. We do this by developing, sharing and applying high-quality knowledge in Psychology, Business Administration, Public Administration, Communication Sciences, Philosophy, Educational Sciences and Health Sciences. Our research and education in these disciplines revolves around tackling and solving societal challenges. The research programs of BMS are closely linked to the research of the UT institutes Mesa+ Institute for Nanotechnology, TechMed Center and Digital Society Institute.
As an employer, the Faculty of BMS offers work that matters. We equip you to create new possibilities for yourself and for our society. With us, you will become part of a leading technical university with increasing, positive social impact. We offer an open, inclusive and entrepreneurial atmosphere, in which we encourage you to make healthy choices, for example through our flexible, adaptable benefits.
Want to know more? Braun, D. (Daniel)Assistant Professor
Braun, D. (Daniel)Assistant Professor
Do you have questions about this vacancy? Then you can contact Daniel for all substantive questions about this position and the application procedure. For general questions about working for the UT, please refer to the chatbot.
ContactPhone:+31534897792
Email:[email protected]
How to apply Step 1Apply. When you see a vacancy that appeals to you, you can apply online. We ask you to upload a CV and motivation letter and/or list of publications. You will receive a confirmation of receipt by e-mail.
Step 2Selection. The selection committee will review your application and you will receive a response within 2 weeks after the vacancy has been closed.
Step 31st interview. The 1st (online or in person) meeting serves as an introduction where we introduce ourselves to you and you to us. You may be asked to give a short presentation. This will be further explained in the invitation.
Step 42nd interview. In the second interview, we will further discuss the job content, your skills and your talents.
Step 5The offer. If the conversations are positive, you will be made a suitable offer.
Your ColleaguesPersonal page
Personal page
At the UT it's all about people, in line with our university's High Tech Human Touch philosophy. In everything we do, the well-being and future of our students and staff are paramount. From research and teaching to personnel management, campus management and the use of new technologies.
Our university is a public institution that serves society. We are accountable to society for the ways in which we use our academic freedom. We are responsible for ensuring that the power of science and technology is harnessed to achieve the best possible impact in a changing world. We cherish our rich tradition of combining technical and social sciences in our five profiling themes: Improving healthcare by personalized technologies; Creating intelligent manufacturing systems; Shaping our world with smart materials; Engineering our digital society; and Engineering for a resilient world.
We help society meet the challenges of today and tomorrow. But we are also transparent about what science and technology can and cannot do in finding sustainable solutions. And help translate these solutions into everyday life.
We want our communities to flourish and show resilience, so we seize opportunities for innovation. We are knowledgeable and have an eye for what society needs. Our students and staff receive all the guidance they need in their quest for ecological, social and economic sustainability. “The University of Twente is all about people. Our sustainable technologies help to strengthen society.”
Browse all jobs