Postdoc: Knowledge-informed reasoning about the harmfulness of internet memes

Are you passionate about cutting-edge research on reasoning about the harmfulness of internet memes, operating in an international research environment, and co-supervising PhD students? Then keep reading: this Postdoc position may be for you!

Your function

Internet memes have emerged as popular communication packages that enable creative expression but may harm individuals, groups, or whole societies. Given their volume, it is essential to develop robust and explainable AI techniques to assist humans in moderating or studying meme harmfulness. Unfortunately, memes are concise, relatable, fluid, and multimodal, and interpreting them depends on background knowledge and cultural views, making harmfulness detection a grand challenge. To address this challenge, we will build on state-of-the-art techniques in computer vision, natural language processing, and neuro-symbolic AI to develop a comprehensive technology that can detect and summarize a meme's benign or harmful content in terms of situational descriptors: what, why, who is the target and the offender, and an indication of severity. Specifically, we will develop: (i) a novel task and corresponding benchmark that requires transparent and grounded reasoning over harmful memes; (ii) a comprehensive knowledge graph that describes a representative collection of memes with knowledge about relevant events and cultural information, and (iii) a novel reasoning method with higher robustness and explainability.

This position is funded by Huawei within the Dialogues, REAsoning, and Multi-linguality for Search (DREAMS) Lab. The Postdoc will be supervised by Dr. Filip Ilievski and Prof. Frank van Harmelen.

Your duties

  • To show independence in achieving research goals and willingness to collaborate and supervise PhD students working on multimodal reasoning about memes.
  • To design and develop a novel benchmark, knowledge resource, and reasoning method for transparent and grounded reasoning over harmful memes;
  • To evaluate, analyze, and describe the developed techniques in research publications;
  • To present the research results at international conferences, workshops, and journals;
  • To work closely with our project partners from the Huawei Lab;
  • To become an active member of the research community and to collaborate with other researchers, both in Amsterdam and internationally;
  • To contribute to teaching activities, such as lectures, lab courses, or supervising bachelor and master students.

Your profile

  • You possess PhD in Artificial Intelligence, Computer Vision, Natural Language Processing, or a closely related field;
  • You can design, conceptualize, and implement benchmarks, knowledge resources, and reasoning methods and describe these orally and in writing;
  • You have a record of publishing in relevant, high-quality conferences or journals in the above fields;
  • You are eager to tackle the social good challenges of hate speech in internet memes;
  • You can implement and evaluate neuro-symbolic multimodal reasoning methods with foundation models, e.g., using Python deep learning toolkits;
  • You can work well in teams and communicate effectively in written and spoken English.

As a university, we strive for equal opportunities for all, recognising that diversity takes many forms. We believe that diversity in all its complexity is invaluable for the quality of our teaching, research and service. We are always looking for talent with diverse backgrounds and experiences. This also means that we are committed to creating an inclusive community so that we can use diversity as an asset.

We realise that each individual brings a unique set of skills, expertise and mindset. Therefore we are happy to invite anyone who recognises themselves in the profile to apply, even if you do not meet all the requirements.

What do we offer?

A challenging position in a socially engaged organisation. At VU Amsterdam, you contribute to education, research and service for a better world. And that is valuable. So in return for your efforts, we offer you:

  • a salary of minimum € 3.345,00 (Scale 10) and maximum € 5.278,00 (Scale 10) gross per month, on a full-time basis. This is based on UFO profile Researcher 4. The exact salary depends on your education and experience.
  • a position for at least 1 FTE. Your employment contract will initially last 1 year. The appointment will be for three (3) years in total.

We also offer you attractive fringe benefits and regulations. Some examples:

  • A full-time 38-hour working week comes with a holiday leave entitlement of 232 hours per year. If you choose to work 40 hours, you have 96 extra holiday leave hours on an annual basis. For part-timers, this is calculated pro rata.
  • 8% holiday allowance and 8.3% end-of-year bonus
  • solid pension scheme (ABP)
  • contribution to commuting expenses
  • optional model for designing a personalized benefits package

About us

About the department
The VU Department of Computer Science has approximately 200 staff members, including approximately 110 PhD students. Lecturers form a critical and essential basis for the functioning of the department, providing foundational education that helps determine the future of our students.

Our research and our students are diverse, covering disciplines such as Social sciences, Humanities, Economics, and Bioinformatics. Currently, we offer programs in Computer Science, Artificial Intelligence and Information Sciences (BSc and MSc), and Bioinformatics and Systems Biology (MSc), with a total of around 1000 new students each year.

Faculty of Science
Researchers and students at VU Amsterdam’s Faculty of Science tackle fundamental and complex scientific problems to help pave the way for a sustainable and healthy future. From forest fires to big data, from obesity to malnutrition, and from molecules to the moon: we cover the full spectrum of the natural sciences. Our teaching and research have a strong experimentally technical, computational and interdisciplinary nature.

We work on new solutions guided by value-driven, interdisciplinary methodologies. We are committed to research, valorisation and training socially engaged citizens of the world who will make valuable contributions to a sustainable, healthy future.

Are you interested in joining the Faculty of Science? You will join undergraduate students, PhD candidates and researchers at the biggest sciences faculty in the Netherlands. You will combine a professional focus with a broad view of the world. We are proud of our collegial working climate, characterised by committed staff, a pragmatic attitude and engagement in the larger whole. The faculty is home to over 11,000 students enrolled in 40 study programmes. It employs over 1,600 professionals spread across 10 academic departments.

Vrije Universiteit Amsterdam
Vrije Universiteit Amsterdam stands for values-driven education and research. We are open-minded experts with the ability to think freely - a broader mind. Maintaining an entrepreneurial perspective and concentrating on diversity, significance and humanity, we work on sustainable solutions with social impact. By joining forces, across the boundaries of disciplines, we work towards a better world for people and planet. Together we create a safe and respectful working and study climate, and an inspiring environment for education and research. Learn more about our codes of conduct

We are located on one physical campus, in the heart of Amsterdam's Zuidas business district, with excellent location and accessibility.  Over 6,150 staff work at the VU and over 31,000 students attend academic education.

Diversity
Diversity is the driving force of VU Amsterdam. VU wants to be accessible and receptive to diversity in disciplines, cultures, ideas, nationalities, beliefs, preferences and worldviews. We believe that trust, respect, interest and differences lead to new insights and innovation, to sharpness and clarity, to excellence and a broader understanding.

We stand for an inclusive community and believe that diversity and internationalisation contribute to the quality of education, research and our services.

Therefore, we are always searching for people whose backgrounds and experience contribute to the diversity of the VU community.

Interested

Are you interested in this position and do you believe that your experience will contribute to the further development of our university? In that case, we encourage you to submit your application by applying via the application button and upload your curriculum vitae and cover letter until 15/01/2025.

We strongly encourage women to apply. If two candidates are equally qualified, we will select a female candidate.

Relocation support
For information regarding moving to Amsterdam, and working at VU Amsterdam, please check: Relocation support - Vrije Universiteit Amsterdam (vu.nl)

Applications received by e-mail will not be considered.

Acquisition in response to this advertisement is not appreciated.

Your function

Internet memes have emerged as popular communication packages that enable creative expression but may harm individuals, groups, or whole societies. Given their volume, it is essential to develop robust and explainable AI techniques to assist humans in moderating or studying meme harmfulness. Unfortunately, memes are concise, relatable, fluid, and multimodal, and interpreting them depends on background knowledge and cultural views, making harmfulness detection a grand challenge. To address this challenge, we will build on state-of-the-art techniques in computer vision, natural language processing, and neuro-symbolic AI to develop a comprehensive technology that can detect and summarize a meme's benign or harmful content in terms of situational descriptors: what, why, who is the target and the offender, and an indication of severity. Specifically, we will develop: (i) a novel task and corresponding benchmark that requires transparent and grounded reasoning over harmful memes; (ii) a comprehensive knowledge graph that describes a representative collection of memes with knowledge about relevant events and cultural information, and (iii) a novel reasoning method with higher robustness and explainability.

This position is funded by Huawei within the Dialogues, REAsoning, and Multi-linguality for Search (DREAMS) Lab. The Postdoc will be supervised by Dr. Filip Ilievski and Prof. Frank van Harmelen.

Your duties

  • To show independence in achieving research goals and willingness to collaborate and supervise PhD students working on multimodal reasoning about memes.
  • To design and develop a novel benchmark, knowledge resource, and reasoning method for transparent and grounded reasoning over harmful memes;
  • To evaluate, analyze, and describe the developed techniques in research publications;
  • To present the research results at international conferences, workshops, and journals;
  • To work closely with our project partners from the Huawei Lab;
  • To become an active member of the research community and to collaborate with other researchers, both in Amsterdam and internationally;
  • To contribute to teaching activities, such as lectures, lab courses, or supervising bachelor and master students.

Your profile

  • You possess PhD in Artificial Intelligence, Computer Vision, Natural Language Processing, or a closely related field;
  • You can design, conceptualize, and implement benchmarks, knowledge resources, and reasoning methods and describe these orally and in writing;
  • You have a record of publishing in relevant, high-quality conferences or journals in the above fields;
  • You are eager to tackle the social good challenges of hate speech in internet memes;
  • You can implement and evaluate neuro-symbolic multimodal reasoning methods with foundation models, e.g., using Python deep learning toolkits;
  • You can work well in teams and communicate effectively in written and spoken English.

As a university, we strive for equal opportunities for all, recognising that diversity takes many forms. We believe that diversity in all its complexity is invaluable for the quality of our teaching, research and service. We are always looking for talent with diverse backgrounds and experiences. This also means that we are committed to creating an inclusive community so that we can use diversity as an asset.

We realise that each individual brings a unique set of skills, expertise and mindset. Therefore we are happy to invite anyone who recognises themselves in the profile to apply, even if you do not meet all the requirements.

What do we offer?

A challenging position in a socially engaged organisation. At VU Amsterdam, you contribute to education, research and service for a better world. And that is valuable. So in return for your efforts, we offer you:

  • a salary of minimum € 3.345,00 (Scale 10) and maximum € 5.278,00 (Scale 10) gross per month, on a full-time basis. This is based on UFO profile Researcher 4. The exact salary depends on your education and experience.
  • a position for at least 1 FTE. Your employment contract will initially last 1 year. The appointment will be for three (3) years in total.

We also offer you attractive fringe benefits and regulations. Some examples:

  • A full-time 38-hour working week comes with a holiday leave entitlement of 232 hours per year. If you choose to work 40 hours, you have 96 extra holiday leave hours on an annual basis. For part-timers, this is calculated pro rata.
  • 8% holiday allowance and 8.3% end-of-year bonus
  • solid pension scheme (ABP)
  • contribution to commuting expenses
  • optional model for designing a personalized benefits package

About us

About the department
The VU Department of Computer Science has approximately 200 staff members, including approximately 110 PhD students. Lecturers form a critical and essential basis for the functioning of the department, providing foundational education that helps determine the future of our students.

Our research and our students are diverse, covering disciplines such as Social sciences, Humanities, Economics, and Bioinformatics. Currently, we offer programs in Computer Science, Artificial Intelligence and Information Sciences (BSc and MSc), and Bioinformatics and Systems Biology (MSc), with a total of around 1000 new students each year.

Faculty of Science
Researchers and students at VU Amsterdam’s Faculty of Science tackle fundamental and complex scientific problems to help pave the way for a sustainable and healthy future. From forest fires to big data, from obesity to malnutrition, and from molecules to the moon: we cover the full spectrum of the natural sciences. Our teaching and research have a strong experimentally technical, computational and interdisciplinary nature.

We work on new solutions guided by value-driven, interdisciplinary methodologies. We are committed to research, valorisation and training socially engaged citizens of the world who will make valuable contributions to a sustainable, healthy future.

Are you interested in joining the Faculty of Science? You will join undergraduate students, PhD candidates and researchers at the biggest sciences faculty in the Netherlands. You will combine a professional focus with a broad view of the world. We are proud of our collegial working climate, characterised by committed staff, a pragmatic attitude and engagement in the larger whole. The faculty is home to over 11,000 students enrolled in 40 study programmes. It employs over 1,600 professionals spread across 10 academic departments.

Vrije Universiteit Amsterdam
Vrije Universiteit Amsterdam stands for values-driven education and research. We are open-minded experts with the ability to think freely - a broader mind. Maintaining an entrepreneurial perspective and concentrating on diversity, significance and humanity, we work on sustainable solutions with social impact. By joining forces, across the boundaries of disciplines, we work towards a better world for people and planet. Together we create a safe and respectful working and study climate, and an inspiring environment for education and research. Learn more about our codes of conduct

We are located on one physical campus, in the heart of Amsterdam's Zuidas business district, with excellent location and accessibility.  Over 6,150 staff work at the VU and over 31,000 students attend academic education.

Diversity
Diversity is the driving force of VU Amsterdam. VU wants to be accessible and receptive to diversity in disciplines, cultures, ideas, nationalities, beliefs, preferences and worldviews. We believe that trust, respect, interest and differences lead to new insights and innovation, to sharpness and clarity, to excellence and a broader understanding.

We stand for an inclusive community and believe that diversity and internationalisation contribute to the quality of education, research and our services.

Therefore, we are always searching for people whose backgrounds and experience contribute to the diversity of the VU community.

Questions about the vacancy?

Please contact

Filip Ilievski

Assistant Professor

Interested

Are you interested in this position and do you believe that your experience will contribute to the further development of our university? In that case, we encourage you to submit your application by applying via the application button and upload your curriculum vitae and cover letter until 15/01/2025.

We strongly encourage women to apply. If two candidates are equally qualified, we will select a female candidate.

Relocation support
For information regarding moving to Amsterdam, and working at VU Amsterdam, please check: Relocation support - Vrije Universiteit Amsterdam (vu.nl)

Applications received by e-mail will not be considered.

Acquisition in response to this advertisement is not appreciated.

Questions about the vacancy?

Please contact

Filip Ilievski

Assistant Professor

Application procedure

Don't miss out on your dream job at VU Amsterdam