On February 7 2017 Jeroen Donkers (Maastricht University), Denise Janssen (Mateum) and Geraldine Clarebout (Maastricth University) held a lunch meeting at Maastricht University to present the results of the WATCHME project. We had a diverse public of researchers, educational advisers, teachers and program directors (around 55 people in total), mainly from Maastricht, but also people from other places in the Netherlands and Belgium joined in. Positive reactions were given to the developments that were done in the WATCHME project and some interesting questions were raised, such as whether the system is also applicable outside workplace education. We continued the session with two workshops. In the first one, led by Jeroen, participants learned to make a student model. In the second one, led by Denise and Geraldine from Maastricht University, a brainstorm was held on the benefits of learning analytics. We closed the day with a reception and further discussion. In short, an interesting and fruitful afternoon! The presentations and the demonstration of the Learning Analytics were videotaped and are made available on the WATCHME website (http://www.project-watchme.eu/demonstrations/).
On December 16th 2016 Maastricht University had the visit of four members from the department of Medical Education, Jagiellonian University Medical College of Krakow (Poland). Two nurses and two doctors involved in education, were interested in the WATCHME project. The EPASS-system was presented with a focus on the visualization and the just-in-time feedback module by Geraldine Clarebout. Jeroen Donkers provided more insight into the pedagogical student model. The immediate benefits for their education of the e-portfolio and the added value of the student model was immediately clear. Challenges that were addressed are how the student should be ‘modeled’ in their situations.
WATCHME formative evaluation results introduced during the International Study Association on Teachers and Teaching
Äli Leijen, Pihel Hunt and Liina Malva from the University of Tartu participated on the 4th and 5th of December in the University of Haifa, Israel in the ISATT (International Study Association on Teachers and Teaching) Regional Conference: Promising Pedagogies in International Teacher Education. The conference focused on presenting international research on pedagogies of teacher selection, reflection, narrative ways of knowing, identity, mentoring, teacher leadership, diversity, parents and family, social justice and technology. Altogether 36 teacher education researchers presented studies on how studied pedagogies work in practice in different conditions; and how these might be transferable to other action settings elsewhere in the world. The conference aimed at increasing knowledge exchange and mobilization by unearthing the conditions underlying successful borrowing and seeding of pedagogies. Pihel Hunt introduced the WATCHME results from the formative evaluation of the visualisation and the automated feedback module in Tartu context. More information: http://isatt-2016.edu.haifa.ac.il/
Jeroen Donkers of Maastricht University provided workshop about developing student models in the Gala conference
Jeroen Donkers of Maastricht University provided a halfday workshop about developing student models in the Games And Learning Alliance (GALA) conference: https://conf.seriousgamessociety.org/2016/. The audience included ten scientists and directors of technical and educational institutes from several countries in Europe (e.g. Belgium, Italy, Sweden, Swiss, The Netherlands) and China . After an introduction of the WatchMe project he explained the development of student models with Multi Entity Bayesian Networks (MEBNs). Next, there was a demo on the student models as used in the WatchMe project. The participant discussed student models, regarding domain, learning environment, goal of the model, variables and mechanisms involved. Then, Jeroen held a demo of building a student model and the participants practices in building models themselves. The workshop was round-off with a final discussion regarding student models.
Öredev is a conference for IT and software professionals held annually in Malmø, Sweden, - 8-11 November 2016 . The conference was founded by Jayway and now operates as an independent organisation. In 2016, the theme of the conference was: Computer Power. The interaction between society and technology has generated revolutionary inventions! Our early ancestors created rock painting tools to send messages that last 10000 years, and with today's technology we can send 140 character tweets and snappy chats that disappear within hours. Even if most of us are developing banking systems, shopping carts, the next Facebook or Uber, we developers play a role in changing the world, digitizing it bit by bit. The software we write affects not just personal lives, but also economic and political institutions worldwide, in both industrialized and developing countries. In the hands of reformers and activists, even a single individual can create the tools that turns it all around, and overcome the powers of society. They can give voice to passive resistance and non-violence. They - we - have the power. The power to give the power to the people. (from Öredev website) For the duration of the conference, Jayway had a booth in the main area of the conference hall, where Jayway projects and technology were showcased. A presentation about the WATCHME project was shown on a screen in the booth and Jayway staff spoke to visitors about the experiences and learnings from the WATCHME project.
Thursday the 17th of November , the NVMO conference took place in Egmond aan Zee – Netherlands. This conference was attended by medical teachers, education specialists and policymakers, about 900 peoples in total. This conference contributes in the discussion on research results, evaluations and developments according to medical education and training. On behalf of WATCHME Indra Posthumus did a poster presentation. Jeroen Donkers, Annemarie Camp,Chantal Duijn, Marco Tiemann, Pihel Hunt, Äli Leijen did a Poster presentation too and Mateum was there with a booth. http://www.nvmo.nl/nvmo_congres/nvmo_congres_2016
POLICIES for Using Big DATA to Catalyze the Design of Effective Teaching, Learning, and Assessment at Scale.
The aim of the policy workshop was to raise awareness on the potential of analysis of data produced by learning technologies to catalyze the effective design of adaptive teaching, learning and assessment at scale. Our aim is to bring together quadruple helix representatives interested in exploring the state-of-the-art of learning analytics, as well as to be informed about opportunities and barriers for adoption. On behalf of project WATCHME Geraldine Clarebout and Marieke van der Schaaf were at the Pelars Conference: POLICIES for Using Big DATA to Catalyze the Design of Effective Teaching, Learning, and Assessment at Scale. This event took place on the 9th of November in Brussels. In the morning they gave a presentation about the project and in the afternoon a demonstration of the WATCHME E-portfolio system. In between the attending Policy-makers, government representatives, researchers, innovators and other interested stakeholders, could approach them for policy recommendations. Through live streaming this event was shared for the public. .
On November 8 Marieke van der Schaaf presented a Keynote at a conference about Technology Enhanced Assessment at Fontys University in Tilburg, The Netherlands. The subject of the presentation regarded starting professionals, like teachers and doctors, who learn a lot from feedback and assessment on the job. Crucial questions for their supervisors are: (1) to which extend is the (starting) professional capable to perform tasks with or without supervision? (2) How can I provide quality feedback and assessment in an efficient manner? E-assessment enhanced with learning analytics offer opportunities to provide in these demands. The aim of the keynote was to demonstrate how (starting) professionals can learn and improve their skills, to demonstrate how the project WATCHME indicates feedback and assessment by means of an e-portfolio enhanced with learning analytics.
Äli Leijen, Pihel Hunt and Liina Malva (University of Tartu) introduced the WatchMe project at a seminar “Are You a Classical or a Future Person?” on the 19th–20th of October in Nelijärve, Estonia. The seminar drew together a broad spectrum of stakeholders of teacher education – e.g. researchers, practicians, public servants. Äli Leijen gave an overview of the WATCHME project with a special focus on the development of the assessment matrix. Pihel Hunt introduced the EPASS system, just-in-time feedback module and visualization module. And finally, Liina Malva demonstrated the process of asking feedback in the EPASS system. More information: http://www.pedagogicum.ut.ee/et/uudised/oled-klassik-voi-tulevikuinimene.
On October 14 2016 Annemarie Camp and Geraldine Clarebout (UM) gave a presentation on the WATCHME project at a conference on Assessment: the EBMA Academic Conference: Crossing Boundaries in Exeter (UK) (http://medicine.exeter.ac.uk/assessmentmeded/). A group of 50 participants (researchers, assessment responsibles, physicians,…) choose to participate in this session. Questions were asked on how the scores were visualized, what the student model used as data input and whether this could be transferred to other institutions. Participants were also very much interested in the pedagogical student model and saw its potential!
Äli Leijen from the University of Tartu participated in the 7th International Conference on Education and Educational Psychology (ICEEPSY) on the 11th - 15th October 2016, in Rhodes, Greece. Äli introduced the Watchme project and presented the results from the formative evaluation phase in pre-service teacher education in Estonia. Her presentation specifically focused on supervisors’ experiences with EPASS. The session was attended by 15 participants, including researchers, practitioners and psychologists. More information: http://www.futureacademy.org.uk/conference/ICEEPSY
Pihel Hunt and Gerli Silm (University of Tartu) participated in the International Technology Enhanced Assessment Conference (TEA 2016) which took place on 5-6 October 2016 in Tallinn, Estonia. The International TEA is a two-day research-led conference organised by The Open University of the Netherlands, the University of Tallinn and the Luxembourg Institute of Science and Technology. The key themes in the conference were e-assessment quality and technologies for assessment. Pihel Hunt presented on behalf of WATCHME, the results from the formative evaluation of the just-in-time feedback module in the Estonian context. More information: http://www.teaconference.org/