Possibilities and limitations of formative assessment in Projects Oriented Learning
Posibilidades y limitaciones de la evaluación formativa en los Proyectos de Aprendizaje Tutorados
Carolina Nieva Boza, Lurdes Martínez-Mínguez, Laura Moya Prados
Possibilities and limitations of formative assessment in Projects Oriented Learning
Cultura, Ciencia y Deporte, vol. 18, no. 55, 2023
Universidad Católica San Antonio de Murcia
Received: 15 june 2022
Accepted: 18 december 2022
Abstract: As Formative and Shared Assessment (F&SA) and significant learning are given scant attention in physical education (PE) subjects in the Primary School Education Degree course, there is a need to analyse the students’ perception of the possibilities and limitations of F&SA in the context of an educational proposal based on Project Oriented Learning (POL). A methodological approach was used for the study, carried out by means of a Likert scale questionnaire, which was quantitative while the scope was descriptive. The study was carried out on a sample of 651 students between 2014 and 2020. The results show that the students considered the F&SA approach useful for improving their acquisition of professional skills and the development of functional and meaningful learning. They also thought it was necessary to strengthen the negotiation of this assessment at the beginning of the subject and that a stable and experienced teaching staff was required to carry out this type of project. From the results we concluded that students should be given a voice in these possibilities and limitations to improve their own teaching practice in the area of PE in the Early Childhood Education Degree course, as it would help them to feel qualified to teach this discipline in their future professional careers.
Keywords: Higher Education, feedback, experiential learning, teacher education.
Resumen: La Evaluación Formativa y Compartida (EFyC) y los aprendizajes significativos son deficitarios en asignaturas de educación física (EF) en el Grado en Educación Infantil, por lo que es necesario analizar la percepción del estudiantado sobre las posibilidades y limitaciones de la EFyC llevada a cabo en una propuesta educativa, a partir de un Proyecto de Aprendizaje Tutorado (PAT). El enfoque metodológico es cuantitativo y el alcance descriptivo, utilizando como instrumento un cuestionario tipo Likert. La muestra es de 651 estudiantes, desde 2014 hasta 2020. Los resultados reportan que los y las estudiantes consideran muy favorable este sistema de evaluación para la mejora de la adquisición de competencias profesionales y el desarrollo de aprendizajes funcionales y significativos; pero es necesario fortalecer la negociación de evaluación al inicio de la asignatura y se requiere de un profesorado estable y con experiencia para llevar a cabo esta tipología de proyectos. Como conclusiones, es necesario dar voz al estudiantado sobre estas posibilidades y limitaciones para mejorar la propia práctica docente en el área de EF en el Grado de Educación Infantil, favoreciendo la sensación de sentirse capacitados para impartir esta disciplina en un futuro profesional próximo.
Palabras clave: enseñanza superior, retroacción, aprendizaje por experiencia, formación de profesores.
Introduction
Higher Education in Spain has been influenced for the last twenty years by documents such as the Bologna Declaration, The Berlin Communication (European Higher Education Area, 1999 and 2003) and the Framework Document “Integration of the Spanish University System in the European Higher Education Area” (MEC, 2003), all of which have impelled educational study plans towards a curriculum of competences and improved both the teachers and students’ roles in the teaching-learning process and evaluations (OECD, 2002; Perrenoud, 2004). However, it must be said that university teachers in general have a pessimistic perception of the impact of the competences approach and of its improvements to their educational practices. In addition, the efforts made have not always brought about the expected structural changes (López-López et al., 2018; Solá, 2020). In the opinion of Barba-Martín et al. (2020), teachers consider that the Bologna Plan has not achieved all the intended changes and blame this on the large student numbers and on the deficient teachers’ permanent training, which points to a requirement for a study of the possibilities and limitations of developing this approach in Spanish teachers’ initial training.
Early Childhood Education is organised into three areas, in which Area 1 refers to “Knowing oneself and personal autonomy” (Orden ECI/3960/2007). According to this document, teachers should program and propose both everyday activities and didactic proposals at specific times in the PE areas in early childhood education. These initiatives include those that encourage learning through the body and movements from a universal and transversal perspective (Martínez-Mínguez et al., 2017). However, the reality in educational centres shows that early childhood teachers do not feel they are sufficiently well trained in practice to give these classes and so other profiles are sought to carry them out. This situation leads us to reflect on the right type of initial training to make them feel better trained in the PE area. Some of the possible causes could have to do with the type of contents, competences, methods and evaluations used in subjects related to PE in early childhood schools.
According to Zabalza (2002), one of the reasons for not obtaining the expected results in Higher Education is related to evaluations, as they have a strong influence on the students’ learning process. Evaluations should be used as a strategy to improve and encourage the educational experience from the beginning to the end of the training process (Romero-Martín et al., 2014). Evaluations are thus one of the aspects that should impel students to learn and imbue them with a desire to improve, while keeping them continually up to date with their progress, not only at the end of the process (López-Pastor, 2009; Zabalza 2002). This involves changing from an “evaluation of learning” to an “evaluation to learn” (López-Pastor, 2009), and even an “evaluation as learning” (Torrance, 2007), as a good evaluation may be the best educational activity. For Álvarez (2008), learning-oriented evaluations should be based on three fundamental aspects: they should present evaluations as learning tasks, involve the students in the evaluation and offer the results as a type of feedback.
For Hortigüela et al. (2016), using open participatory methods gives the students a greater role in their own learning process and helps them to acquire a more positive perception of its transfer. Gallardo-Fuentes et al. (2018) also report increased student self-perception of the improvement of their professional competences by means of formative and shared evaluations (F&SE). Along the same lines, some authors consider that active methods and formative evaluations have a positive incidence on increasing the students’ learning levels (Barrientos et al., 2019; Brown & Glasner, 2000; Colomer et al., 2018) and empowering authentic and significant learning (Martínez-Mínguez & Flores, 2014). López-Pastor (2009) considers formative evaluations to be the same as any evaluation whose principal aim is to improve the teaching-learning processes in which it is contained. An increasing number of authors indicate the importance of applying a formative character to evaluations (Galván & Farías, 2018; Valvanuz & Salcines, 2018) against the traditional view of them as summative and finalist (Brown & Glasner, 2000; López-Pastor, 2009; Zabalza 2002). The specialised literature contains many examples of successful applications of F&SE in the initial teacher training phase (Barba-Martín et al., 2010; Barba-Martín & López-Pastor, 2017; López-Pastor & Pérez-Pueyo, 2017; Gallardo & Carter, 2016; Knight, 2005; López-Pastor, 2008, 2009, 2012; Martínez-Mínguez, et al., 2019; Romero-Martín et al., 2017). Other studies deal with the transfer between using F&SE in initial teacher training and when the students start out on their professional careers as teachers (Hamodi et al., 2017; Molina & López-Pastor, 2017, 2019). Barrientos et al. (2019) point out that applying F&SE and/or Evaluation to learn systems makes students take PE more seriously and teachers better organize their teaching processes.
Some researchers consider it is becoming increasingly necessary to apply formative, varied and continuous evaluation systems (Gómez & Quesada, 2017; Hortigüela et al., 2019), which can be understood as a new evaluation culture (Rust, 2007), a culture that integrates evaluations as part of the formative process giving students an active and autonomous role as a guarantee of empowering learning (Maureira-Cabrera et al., 2020).
Diverse authors recommend giving participation to all the agents involved in the evaluation process and making use of self-evaluations and co-evaluations (Lin & Lai, 2013; Medina-Rivilla et al., 2013; Rodríguez et al., 2011) in the compilation, application and evaluation of instruments and results to achieve more intense teaching throughout the entire formative process. Formative assessments require diverse activities and comprehensive data-collecting systems of students’ progress that allow fair, correct and precise value judgements to be made (López-Ruiz, 2011). According to García-Sanz (2014) these instruments should satisfy the principles of instrumental and multi-varied triangulation.
The choice of alternative types of evaluation (continuous, final or mixed, and self-assessment, co-assessment and dialogued assessment) creates a link between formative evaluations and responsibility, implication, participation and control of the students’ learning (Aparicio-Hergueras, et al., 2021; Falchikov, 2005; López-Pastor, 2009; Molina et al., 2020; Vallés et al., 2011). In this regard, Cano (2012, 16) considers that “It is interesting to diversify the agents involved in the evaluation so that the students can participate and put possible strategies for self-evaluation and evaluation between equals into action.” If the aim is to find out the results of applying the competence approach in Spanish Education we must give students a voice and analyse their perceptions.
When different agents intervene in the evaluation process they are obliged to understand, know and coordinate with each other (Martínez-Mínguez et al., 2019). Panadero et al. (2019), in a study that explored evaluations in the current Spanish Higher Education, concluded that evaluations between equals and self-evaluations were not normally used. For Martínez-Mínguez et al. (2019) this situation would improve if teachers and students were to be given better training for their reflective and critical capacities, with the support of the Administration (Zapatero et al. 2018).
Another key factor that can influence the possibilities and limitations in the expected structural changes through the new curriculums for competences is the methodology used. This is a key factor for developing effective, systematic, functional and significant learning activities, while giving students relevant competences for their future professional careers (Peñarrubia-Lozano, et al., 2021) and favouring a transforming learning model.
Diverse active methodologies have been used in Higher Education, such as Learning-Service, designed to improve the quality of the learning process in the educational community (Martín et al., 2018) and Project Oriented Learning (POL), which were given in the primary PE area and in the opinion of López & Vicente (2015), López-Pastor et al. (2020) and Martínez-Mínguez et al. (2020) are good practice as a methodological activity. For Álvarez (2008), the POL have three characteristics: i) they allow the students to learn autonomously in different scenarios supervised by a teacher, ii) their learning principle is based on “how to do” and develops professional skills and competences, and iii) the students are responsible for their own learning, although the teacher can be called on if required. The POL are based on cooperative learning to promote the acquisition of generic professional competences, leadership, self-sufficiency, a critical capacity and communicative skills (Barba et al., 2012), also values like fairness, solidarity, responsibility and cooperation (Guilarte et al., 2008). Current research on the POL in the Teachers’ initial training reports that students perceive an improvement in their professional competences (Barba-Martín, 2017; López-Pastor, et al., 2020; Molina et al., 2022; Martínez-Mínguez et al., (2022) and also have greater satisfaction, since they consider these to be effective experiences that can be transferred to their professional careers (Molina et al. 2022). According to Manrique (2017), their learning autonomy is also improved, as are their strategies for programming and searching for information.
The POL are based on a formative assessment whose principal aim is to improve the learning-teaching processes in which they are contained (López-Pastor, 2009) while promoting authentic learning (Barba-Martín et al., 2010). The assessment should be part of the training process with continuous feedback to inform students of the point of the learning and competence acquisition process they have reached (Cañadas, et al. 2018; Martínez-Mínguez & Flores, 2014). Some studies report students’ satisfaction with POL co-assessment through the feedback received (Martínez-Mínguez et al., 2019), or in general (Galván & Farías, 2018; Gómez & Quesada 2017; Valvanuz & Salcines, 2018).
In the study by Martínez-Mínguez et al. (2020) the students reported that the POL require intense and constant attention although they are well balanced as regards theory and practice. They also considered the formative assessment and the feedback received in this type of project to be good for acquiring professional competences. Authors such as Nieva et al. (2020) state that the students consider that the greatest benefit to their learning comes from the feedback received, as it makes them reflect, learn from their mistakes and be more aware of the quality of their learning.
Some studies on university teachers who teach from the perspective of the formative shared assessment, for learning and as learning, have a positive opinion in general, even though it involves much dedication and effort, but these are balanced by the results obtained (Colomer et al., 2018; Hortigüela et al., 2019; Nieva et al. 2020; Romero-Martín et al., 2014). It is thus of interest to study the possibilities and limitations of this type of assessment and its effects on the competences acquired by students in early childhood PE subjects to make them feel sufficiently well prepared to give classes in Area 1 of the curriculum through practical sessions.
The aim of the present study was thus to analyse the students’ perception of the possibilities and limitations of formative shared assessments in improving the learning process by means of an active participative methodology in the area of early childhood school PE.
Methodology
The study was carried out within a positivist paradigm, giving a scientific character to education by measuring real observable things or data in the social sciences and discovering the relationships between the facts (Bisquerra, 2014; Latorre et al., 2003).
The methodological focus was quantitative, using the support of small qualitative notes through a design embedded in a dominant quantitative model (Hernández et al., 2014).
Creswell (2009, 188) states that “… more information can be obtained from a combined quantitative and qualitative study than from either form alone”, since it provides a greater understanding of the reality studied.
The scope of the study was descriptive and was based on a review of the literature from the perspective of its objectives. The aim was to specify the important properties and characteristics of the subject analysed by specifying the characteristics of the groups, processes, objectives or phenomena analysed (Hernández et al., 2014).
Contextualisation
The study involved a subject included in the area of PE entitled “Corporal and Psychomotor Education”, a compulsory subject in the fourth year of the Degree in Early Childhood Education at the Educational Science Faculty of the Autonomous University of Barcelona (AUB). The results were obtained during the period between the 2014-15 and 2019-20 academic years, with the exception of 2017-18, which was omitted due to a lack of data because the subject participated in a research project in which the POLs were not analysed.
The EF&C activity is carried out during this subject through a POL known as the Co-Tutored Pyschomotor Learning Project in which groups of five students must design and carry out a psychomotor session first with their classmates and then with pupils in a school. The evaluation is by means of hetero-assessment, co-assessment and self-assessment.
Table 1 gives the details of the F&SA instruments in the order in which they were used in the project.
Sample
The sample was homogeneous (Hernández et al., 2014) as all the 650 participants were students of the subject analysed in the five academic years between 2014 and 2020 except 2017-18 for reasons beyond our control (see Table 2). This allowed us to “focus on the subject under study or highlight situations, processes or episodes in a social group” (Hernández et al., 2014, 388).
Instrument
A single data collection instrument was used in the study which was applied in five consecutive years entitled “A questionnaire on POLs as a Good Practice experience” (QTLPGPE). This was developed from the “Questionnaire on the methodology and evaluation in Primary Education PE” designed by the Formative and Shared Assessment Network in University Teaching and validated by Castejón et al. (2015).
The questionnaire containing 16 questions was answered after finishing the degree course. Two questions were selected that analysed the 11 items considered to be the most important to respond to the study’s aim.
Say whether you agree with the following statements in relation to the subject’s assessment system:
a) There is a previous, negotiated agreement of the assessment system.
b) It focuses on the project, on the importance of daily work.
c) The student is more motivated and the learning process is more motivating.
d) The marking system is fair.
e) It allows functional and significant learning.
f) The theory and practice are interrelated.
g) There is feedback and the possibility of correcting errors in documents and activities.
Indicate whether you agree with the following statements regarding the subject’s method of assessment.
h) The work dynamics are not well known, they lack habit.
i) It needs to be previously understood.
j) The work/credit ratio is out of proportion.
k) It demands to participate in my own assessment (self-assessment).
Both questions were answered on a Likert scale of between 1 and 4 points (1= 0, 2= Little, 3= Quite a lot, 4 = Perfectly). “Don’t know” or “Can’t answer” were also possible.
For the qualitative data, an open question was analysed on the good practice learned from the TPL included in the subject.
Data analysis
The mean of the points (M) was used for the qualitative analysis of the two QTLPGPE questions, as it was the arithmetic average of a distribution (Hernández et al. 2014), the standard deviation (SD) and the average deviation of the points with respect to the average (Jarman, 2013). The averages and SD of the student sub-groups were also compared.
The quantitative analysis was carried out on the IBM Statistical Package for the Social Sciences (SPSS) Version 20, while the qualitative analysis of the open question was done on the Nudist N-Vivo 11R program. The qualitative responses were in the form of codified textual citations, indicating the participant’s academic year.
The participants were previously informed of the study’s aims and characteristics in accordance with the AUB’s recommendations as regards their consent, the anonymity and confidentiality of the answers and the diffusion of the data.
Results
Table 3 gives the quantitative results of both questions and their 11 items. Most of the statements are seen to have elicited favourable responses and have an arithmetic mean of more than 3 out of four, except for three questions with less than 2.5, which coincided with the three highest SDs. The arithmetic means of the different statements show some differences in the different years, although the overall mean and SD are very similar (higher than 3 and 0.8, respectively) and that the 2018-19 year had the highest mean (M= 3.28).
The data in Table 3 are then analysed according to the variables given in Table 4, which were divided by a deductive-inductive categorization process (Gibbs, 2012) into five groups: participation, learning process, motivation, creating instruments and time dedicated.
The relationship between the quantitative data obtained and the variables created is then described and complemented by qualitative contributions from the responses to the open question in the questionnaire.
Variable 1: student participation in the assessment
The statements related to this variable in both questions were: k) It demands to participate in my own assessment (self-assessment), and i) It needs to be previously understood. In both, the answers have a mean greater than 3 out of 4 (M = 3.48 y M = 3.17, respectively), and confirm that self-evaluations are used in the POL and that there is a need to know the methodological and assessment process of the proposed experience from the beginning pf the subject.
Some of the students’ opinions that corroborate their perception of this variable are also given in relation to the POL assessment process. They also consider that the self-assessment allows them to reflect on what they have learned and what needs to be improved.
I would recommend it, since I consider that putting the documentations into practice is very effective for the self-assessment, for learning from one’s mistakes, for realizing what you got right and for developing as an educator (student in 2016-17).
I think that at the beginning the activity was not very clear since we did not know much about the subject, even though everything was explained in the teaching guide. After doing it you realise that the activities are about self-criticism, self-assessment and a revision of everything you have done in the subject. I have no doubt that it is work, but work that involves you, it is whatever you want to put into it at whatever level of awareness and self-assessment you want (student 2018-19).
As this student has pointed out, the POL consists of a set of diverse activities presented at the start of the year and could give a sensation of puzzlement and misunderstanding. However, Item i) confirms that the students were able to understand the POL as a whole and one of the reasons for this perception could be that the subject is well organised and supported by the teachers.
I find the subject to be well structured and planned. The POL is a different type of activity but is very useful for practical and effective learning. It may be a lot of work at the beginning, but the guides, indications and tutorials with the teachers are a great help (student 2019-20).
It is a long activity that includes different areas that lead to a final objective. Also, as it consists of sub-activities it allows a learning process in which you gradually acquire the concepts and this is enriching, since in my case I could clearly see improvement and evolution (student 2019-2020).
Variable 2: systematic, functional and significant learning process
All the statements referring to the formative and shared assessment of the learning process all are considered to be higher than 3.
Those considered best were e) It allows functional and significant learning (M = 3.75) and f) It allows functional and significant learning (M = 3.72). The third best evaluated was b) It focuses on the project and on the importance of daily work (M = 3.49), while the fourth was g) There is feedback and the possibility of correcting errors in documents and activities (M = 3.37).
The qualitative data confirmed that the POL and F&SA promote the acquisition of useful, necessary and lasting learning.
This is one of the subjects in the course in which I learned most and will be most useful to me in the future as a teacher. The type of subject involving a great deal of practice is really appreciated as much more is learned and more experience is gained (student 2018-2019).
This was the most significant activity that I have done throughout the course. I think that all the subjects should include activities of this type as they give us the opportunity to program things and put them into practice in a real group, seeing in a critical way what we have done best, what needs to be improved and what we must do to improve etc. (student 2014-2015)
In the opinion of the latter student, in Item f) the importance of knowing a real school context in which the theoretical and practical knowledge can be put into practice is highlighted:
It has made me see the reality of a centre of education, what psychomotor sessions are like, how to plan them and put them into practice at first hand (…) it allows you to see and hear in a real experience all that you have learned in the subject (student 2015-2016).
I think that this activity is highly positive as it involves going to a school and putting a proposal made in the university into practice; very often, we don’t know whether all we propose will work in a real context (student 2014-2015).
Finally, the students describe the importance of Item g) in the POL and F&SA. They considered it to be an experience with the significant help of their teachers that allows them to see the point they have reached in the learning process and what they must do to improve:
In the POL I saw the connection between the university and the school as really positive. The help from the teacher has been a great help and we got the sensation that it was one of the subjects in which we learned most, since we were actually involved in it (…) the help from the psychomotor educator was impeccable. The experience has made us reflect on many attitudes, both positive and negative, and even on attitudes we were not even aware of (student 2018-2019).
This is a very recommendable activity in which you can see your weak points as a teacher, also your limitations and what you need to improve. At the same time it helps you to see what a session is actually like and it makes you adapt all the session to the children’s needs at all times (student 2014-2015)
Variable 3: students’ motivation
The results of Item c) The student is more motivated, the learning process is more motivating describes the students as involved in the development of the experience, as it has a mean of 3.38, while the results of h) The work dynamics are not well known, they lack habit obtained a score of less than 2 out of 4 (M = 1.95). Item h) may therefore indicate that using similar experiences to those in this subject is still not common in higher education.
The opinions found in these academic years describe the students as claiming more learning experiences like the POL, in which their personal involvement plays a relevant role:
I think that if more core subjects of this type were to be included in the course we would learn more and finish the degree course better prepared. Personally, I greatly enjoyed the POL (student 2019-2020).
Few subjects are so enjoyable and make you feel you have evolved and learned so much in such a short time (student 2018-2019).
I consider it a highly motivating activity as it is different to what we are used to (student 2019-2020).
Variable 4: student participation in creating the instruments
The items referring to this variable were a) There is a previous, negotiated agreement of the assessment system and d) The marking system is fair. A value of 2 out of 4 was obtained for a), showing a low perception of this previous agreement in the subject (M = 2.13), since the teaching-learning activities and assessment were only designed by the teachers. However, in spite of this perception of a low consensus the students consider the mark to be fair with an M = 3.12 (Item d).
The results of Item a) indicate one of the experience’s limitations and the opinions expressed corroborate this perception:
I consider that the assessment rubrics should be designed jointly by teachers and students, possibly starting from an item compiled by the teacher, but allowing the students to select the items they consider to be the most important. (student 2019-2020).
The only aspect I would change is the assessment, since what is done in the session with adults is given a higher score than the one with children, and I personally performed much better in the school than at the university (student 2016-2017).
In spite of this obstacle, it can be seen from Item d) that the students were in general satisfied with the POL and F&SA as described in the following evaluations:
For me this was a completely new activity. In all my years as a student I had never been in this situation. At the beginning I was a bit lost, I didn’t know where to start but in the end the members of the group gradually made their contributions and together we moved forward in the activity and at the end I was very satisfied with the result. I think it was one of the few activities I have done in the university that seemed to be really useful for my future career as a teacher (student 2018-19).
You need to give it a lot of time for everything to turn out well and you have to be meticulous about not leaving out any of the details and always keep the basic theory in mind. In spite of that, it was one of the most enriching projects I have taken part in during the course and I am happy with the result obtained both personally and as regards my training (student 2019-20).
Variable 5: time devoted to the subject
Regarding the last variable j) The work/credit ratio is out of proportion, the participants said they found that the subject’s credits and the time required to carry out the different exercises were not in proportion (M = 2.4) and its SD is the highest of all the items (SD = 1.318). These results could indicate that the students have an asymmetric perception of an excessive amount of work and time they need to devote to the POL.
In spite of being one of the activities that gave me most work during the course, it was also one of those I enjoyed most and I can say with certainty that we learned everything down to the last detail.(student 2019-20).
I think that it demands a lot of you. You have to devote many hours of working on your own but the final result is very useful and significant (student 2017-2018).
In these qualitative aspects, the need to change the subject from six-monthly to annual is considered, corroborating the perception of a high workload in the subject and that more time is needed to carry out the POL:
The only thing I would change is to extend this subject to an entire year because you have to do a lot of work in a short time (student 2015-16).
I think it is very useful and you learn a lot. I also think there is a lot of work to do for the number of credits in the subject. I think this amount of work deserves more credits (student 2018-19).
Discussion
The results agree with those reached by Álvarez (2008) in that the formative assessment helps to acquire professional competences (M = 3.48), promotes functional and significant learning (M = 3.72) and strengthens the relationship between theory and practice (M =3.75), showing the highest means. They also agree with those made by Meyer (2002) in that the POL and its assessment provide the students with the right tools to solve the problems they will find related to the area of early childhood PE in their professional careers. These data are related to those given by Barba et al (2012), who associated the POL with teachers’ work through generic and professional competences.
Regarding the variable participation of the students in the assessment, the results indicate that it helps to increase the critical and communicative capacity, as the students are required to participate in their own assessment (M = 3.48), as Barba et al. (2012) pointed out when they refer to the generic competences such as leadership, self-sufficiency, critical and communicative capacity and their assessment by the POL.
The students reported satisfaction with the feedback received and the possibility of correcting mistakes (M = 3.37), as in the studies by Gómez & Quesada (2017) and Valvanuz & Salcines (2018). This confirms that the F&SA improves the teaching-learning process with continuous feedback to inform the students about what point of the learning process and they have reached and the competences they have acquired (López-Pastor, 2009; Martínez-Mínguez & Flores, 2014). In agreement with Panadero & Lipnevich (2022), it is important that the information contained in the feedback is of good quality, adapted to the students’ characteristics and can be useful to the learning process.
Romero-Martín et al. (2014) consider that the assessment should not be used only in the learning process but also as a strategy for the students’ improvement and assistance during the entire formation process. In the present study, the students also considered that the POL focused on the process and gave a great deal of importance to daily work (M = 3.39).
As regards limitations, in general few negative aspects were found, in agreement with the study by Gallardo-Fuentes et al. (2018). One of the aspects that could be reviewed in our study is the aspect of the previous negotiation of the assessment process, which should be improved as it is closely related to the concept of the F&SA (Atienza et al, 2016).
Another limitation we found is related to the perceived imbalance between the credits awarded and the hours devoted to the subject. This is something that should be borne in mind in the future to improve the formative assessment of the POL. However, the studies by Gallardo-Fuentes et al. (2020) and Souto et al. (2020) consider that this imbalance is due to comparing competence subjects with others that have a traditional assessment system, since it has been shown that the actual hours spent by the students are in proportion to the subject’s official credits.
Finally, with regard to the limitations, the tendency of the overall arithmetic means can be seen to rise gradually until the 2018-19 academic year and then fell in the final year, although it was still higher than the previous years. This could have been due to a change in the teaching staff in the final year analysed. In complex subjects such as the F&SA and POL stability and experience are required in the teachers to understand the different phases in this learning and assessment process.
Conclusions
In conclusion, this study responded to its main objective of analysing the possibilities and limitations of the F&SA to improve the significant and functional learning process of PE in the Early Childhood Education PE degree course.
The helpful aspects perceived by the students in the F&SA are as follows: it increases their participation in the evaluation process (by self-evaluation and co-evaluation) and their awareness and understanding of the assessment process required in their learning; it closely resembles a school’s educational reality by means of the POL; it increases their motivation and involvement in their PE formative process; and makes them aware of the positive effects of a constant and continuous work effort throughout the subject.
As regards its limitations, there was no previous negotiation of the subject’s assessment system, although the students consider it to be fair and are aware of the point they have reached in the learning process at all times in the POL. In this perception, the feedback they received from the teachers and the quality of the different instruments played key roles throughout the duration of the subject.
The results indicate that the F&SA provides the students with the basic competence tools in early childhood school PE. They also consider themselves to be qualified to confidently give practical corporal classes in their future professional careers.
Based on the significance of the analysed experience, it could be repeated in a future line of study or adapted to other higher education courses in which the relationship between theory and practice is a relevant aspect of the learning process.
Missing out the 2017-18 academic year during the study period (2014-20) and changing the teachers of the subject in the different years were seen to be limiting aspects.
Finally, this study allowed the teachers of the subject to determine the methodological and assessment aspects that need to be improved, also those that should be maintained for the acquisition of the necessary professional competences in PE required by early childhood school teachers. As one of the students remarked:
I think that filling in this questionnaire is a good tool for knowing the pupils’ opinion so as to be able to make changes to certain aspects to improve the experience in the subject. Not many subjects take the pupils opinions into account (student 2016-17).
Funding
This experience was part of the competitively funded research project Students self-assessment competences and teachers’ professional development. Improving teachers’ practice and innovation working for psychomotor learning projects co-tutored by universities and schools. Call of the AGAUR-Cataluña for research funding for the improvement of teachers’ initial training, Reference Nº 2017-ARMIF-00013.
Bibliography
Álvarez, I. (2008). Evaluación del aprendizaje: Una mirada retrospectiva y prospectiva desde la divulgación científica. Revista Electrónica de Investigación Psicoeducativa, 14 (1), 235-272. https://doi.org/10.25115/ejrep.v6i14.1270
Aparicio Herguedas, J. L., Velázquez Callado, C., & Fraile Aranda, A. (2021). El trabajo en equipo en la formación inicial del profesorado. Cultura, Ciencia Y Deporte, 16(49), 455-464. https://doi.org/10.12800/ccd.v16i49.1548
Atienza, R., Valencia-Peris, A., Martos-García, D., López-Pastor, V. M., & Devís-Devís, J. (2016). La percepción del alumnado universitario de Educación Física sobre la evaluación formativa: Ventajas, dificultades y satisfacción. Movimento, 22(4), 1033-1048. https://doi.org/10.22456/1982-8918.59732
Barba-Martín, R., Hernando-Garijo, A., Hortigüela-Alcalá, D., & González-Calvo, G. (2020). Tras casi una década de Bolonia, ¿realmente hemos mejorado la calidad de la enseñanza? Espiral. Cuadernos del Profesorado. Multidisciplinary Journal of Education, 27(13), 97-108. http://dx.doi.org/10.25115/ecp.v13i27.31
Barba-Martín, R., & López-Pastor, V. (2017). Evaluación formativa y compartida en los proyectos de trabajo tutorado, un ejemplo de buena práctica. Revista Infancia, Educación y Aprendizaje, 3(2), 66-70. https://doi.org/10.22370/ieya.2017.3.2.701
Barba-Martín, J., López-Pastor, V., Manrique-Arribas, J., Gea-Fernández, J., & Monjas-Aguado, R. (2010). Garantir l’èxit en la formació inicial del professorat d’educació física: els projectes d’aprenentatge tutelats. Temps d´educació, 39, 187-206. https://www.raco.cat/index.php/TempsEducacio/article/view/245016/328172
Barba, J.J., Martínez, S., & Torrego, L. (2012). El proyecto de aprendizaje tutorado cooperativo. Una experiencia en el grado de maestra de Educación Infantil. Revista de Docencia Universitaria. REDU, 10(1), 123-144. https://doi.org/10.4995/redu.2012.6125
Barrientos, E., López-Pastor, V. M., & Pérez-Brunicardi, D. (2019). ¿Por qué hago evaluación formativa y compartida y/o evaluación para el aprendizaje en EF? La influencia de la formación inicial y permanente del Profesorado. Retos, 36, 37-43. https://doi.org/10.47197/retos.v36i36.66478
Bisquerra, R. (2014). Metodología de la Investigación Educativa. La Muralla.
Brown, S., & Glasner, A. (2000). Assessment matters in higher education: choosing and using diverse approaches. Society for Research into Higher Education.
Cano, E. (ed.) (2012). Aprobar o aprender. Estrategias de evaluación en la sociedad red. Laboratori de Mitjans Interactius, Universitat de Barcelona.
Cañadas, L., Santos-Pastor, Mª L., & Castejón, F.J. (2018). Desarrollo de competencias docentes en la formación inicial del profesorado de educación física. Relación con los instrumentos de evaluación. Estudios Pedagógicos, 44, (2), 111-126. https://doi.org/10.4067/S0718-07052018000200111
Castejón, F. J., Santos, M. L., & Palacios, A. (2015). Cuestionario sobre metodología y evaluación en formación inicial en educación física. Revista Internacional de Medicina y Ciencias de la Actividad Física y el Deporte, 15, (58), 245-267. http://dx.doi.org/10.15366/rimcafd2015.58.004
Colomer, J., Serra, L., Cañabate, D., & Serra, T. (2018). Evaluating knowledge and assessment-centered reflective-based learning approaches. Sustainability, 10 (9), 3122. https://doi.org/10.3390/su10093122
Creswell, J.W. (2009). Research design: Qualitative, quantitative and mixed approaches. Sage.
Espacio Europeo de Enseñanza Superior (1999). Declaración conjunta de los ministros europeos de enseñanza. Bolonia, 19 de junio de 1999.
Espacio Europeo de Enseñanza Superior (2003). Conferencia de Ministros responsables de la Educación Superior. Berlín, 19 de septiembre de 2003.
Falchikov, N. (2005). Improving assessment through student involvement. Practical solutions for aiding learning in higher and further education. Routledge.
Galván, J. O., & Farías, G. M. (2018). Características personales y práctica docente de profesores universitarios y su relación con la evaluación del desempeño. Revista Iberoamericana de Evaluación Educativa, 11 (2), 9-33. https://doi.org/10.15366/riee2018.11.2.001
Gallardo, F., & Carter, B. (2016). La evaluación formativa y compartida durante el prácticum en la formación inicial del profesorado: Análisis de un caso en Chile. Retos, 29, 258-263. https://doi.org/10.47197/retos.v0i29.43550
Gallardo-Fuentes, F., López Pastor, V. M., & Carter Tuhillier, B. (2018). Efectos de la aplicación de un sistema de evaluación formativa en la autopercepción de competencias adquiridas en formación inicial del profesorado. Estudios Pedagógicos, 44(2), 55-77. https://dx.doi.org/10.4067/S0718-07052018000200055
Gallardo-Fuentes, F., López-Pastor, V.M., & Carter-Thuillier, B.I. (2020). Ventajas e inconvenientes de la evaluación formativa, y su influencia en la autopercepción de competencias en alumnado de formación inicial del profesorado en educación física. Retos, 38, 417-424. https://doi.org/10.47197/retos.v38i38.75540
García-Sanz, M. P. (2014). La evaluación de competencias en Educación Superior mediante rúbricas: un acaso práctico. Revista Electrónica Interuniversitaria de Formación del Profesorado, 17 (1), 87-106. http://dx.doi.org/10.6018/reifop.17.1.198861
Gibbs, G. (2012). El análisis de datos cualitativos en investigación cualitativa. Morata.
Gómez, M. A., & Quesada, V. (2017). Coevaluación o evaluación compartida en el contexto universitario: la percepción del alumnado de primer curso. Revista Iberoamericana de Evaluación Educativa, 10(2), 9-30. https://doi.org/10.15366/riee2017.10.2.001
Guilarte, C., Marbán, C., & Miranda, J.M. (Coords.) (2008). Principios básicos para el diseño de guías docentes de asignaturas en el marco del EEES. Universidad de Valladolid.
Hamodi, C., López-Pastor, V., & López, A. (2017). If I experience formative assessment whilst at University will I put it into practice later as a teacher? Formative and shared assessment in Initial Teacher Education (ITE). European Journal of Teacher Education, 40(2), 171-190. https://doi.org/10.1080/02619768.2017.1281909
Hernández, R., Fernández, C., & Baptista, P. (2014). Metodología de la investigación. McGraw-Hill.
Hortigüela, D., Pérez-Pueyo, A., & Fernández-Río, J. (2016). Influencia de las experiencias vivenciadas por el alumnado en el desempeño de futuras competencias docentes. Contextos Educativos, 19, 17-43. http://dx.doi.org/10.18172/con.2742
Hortigüela-Alcalá, D., Pérez-Pueyo, A., & González Calvo, G. (2019). Pero… ¿a qué nos referimos realmente con la Evaluación Formativa y Compartida?: confusiones habituales y reflexiones prácticas. Revista Iberoamericana de Evaluación Educativa, 12,1, 13-27. https://doi.org/10.15366/riee2019.12.1.001
Jarman, K. H. (2013). The art of data analysis: How to answer almost any question using basic statistics. Hoboken, NJ.
Knight, P. (2005). El profesorado de Educación Superior. Formación para la excelencia. Narcea.
Latorre, A., Del Rincón, D., & Arnal, J. (2003). Bases metodológicas de la investigación educativa. Experiencia.
Lin, J., & Lai, Y. (2013). Harnessing. Collaborative annotations on online formative Assessments. Educational Technology & Society, 16(1), 263-274.
López-López, M.C., León-Guerrero, M.J., & Pérez-García, P. (2018). El enfoque por competencias en el contexto universitario español. La visión del profesorado. Revista de Investigación Educativa, 36(2), 529-545. https://doi.org/10.6018/rie.36.2.314351
López Ruiz, J. I. (2011). Un giro copernicano en la enseñanza universitaria: Formación por competencias. Revista de Educación, 356, 279-301.
López-Pastor, V. (2008). Desarrollando sistemas de evaluación formativa y compartida en la docencia universitaria. Análisis de resultados de su puesta en práctica en la formación inicial del profesorado. European Journal of Teacher Education, 31(3), 293-311. https://doi.org/10.1080/02619760802208452
López-Pastor, V. (2009). Evaluación formativa y compartida en Educación Superior. Narcea.
López-Pastor, V. (2012). Evaluación Formativa y Compartida en la Universidad: clarificación de conceptos y propuestas de intervención desde la Red Interuniversitaria de Evaluación Formativa. Psychology, Society & Educatión, 4(1), 117-130. https://doi.org/10.21071/psye.v4i1.13766
López-Pastor, V., Molina, M., Pascual, C., & Manrique, J.C. (2020). La importancia de utilizar la evaluación formativa y compartida en la formación inicial del profesorado de educación física: los proyectos de aprendizaje tutorado como ejemplo de buena práctica. Retos, 37, 680-687. https://doi.org/10.47197/retos.v37i37.74193
López-Pastor, V. & Pérez-Pueyo, A. (2017). Buenas prácticas docentes. Evaluación formativa y compartida en educación: experiencias de éxito en todas las etapas educativas (e-book). Universidad de León. http://hdl.handle.net/10612/5999
López, Mª A., & Vicente, F. (2015). Proyecto de aprendizaje tutorado en la formación científica inicial de las estudiantes del Grado Educación Infantil. En N. González, I. Salcines & E. García. Tendencias emergentes en evaluación formativa y compartida en docencia. El papel de las nuevas tecnologías. Actas IX Congreso Internacional de Evaluación Formativa y Compartida en Docencia Infantil, Primaria, Secundaria y Universitaria (pp. 959-978). Universidad Cantabria.
Manrique Arribas, J. C. (2017). El potencial de los proyectos de aprendizaje tutorados en la formación inicial del profesorado. Revista Infancia, Educación Y Aprendizaje, 3(2), 36–41. https://doi.org/10.22370/ieya.2017.3.2.696
Martín, X., Puig, J.M., Palòs, J., & Rubio, L. (2018). Enhancing the quality of service-learning practices. Enseñanza & Teaching: Revista interuniversitaria de didáctica, 36, (1), 111-128. https://doi.org/10.14201/et201836111128
Martínez-Mínguez, L., & Flores Aguilar, G. (2014). Profesorado y egresados ante los sistemas de evaluación del alumnado en la formación inicial del maestro de educación infantil. RIDU. Revista Digital de Investigación en Docencia Universitaria, 8 (1), 29-50. https://doi.org/10.19083/ridu.8.371
Martínez-Mínguez, L., Rota, J., & Anton, M. (2017). Psicomotricitat, currículum i escola. Octaedro.
Martínez-Mínguez, L., Moya Prados, L., Nieva Boza, C., & Cañabate Ortiz, D. (2019). Percepciones de estudiantes y docentes: Evaluación formativa en Proyectos de Aprendizaje Tutorados. Revista Iberoamericana de Evaluación Educativa, 12(1), 59-84. https://doi.org/10.15366/riee2019.12.1.004
Martínez-Mínguez, L., Nieva Boza, C., & Moya Prados, L. (2020). Conectar la escuela con la universidad a través de la educación psicomotriz. Tándem. Didáctica de la Educación Física, 69, 39-44.
Martínez-Mínguez, L., Moya Prados, L. & Arnau-Sabatés, L. (2022). Escala ECPP-FIM para evaluar las competencias profesionales psicomotrices en la formación inicial de maestros: evidencias de validez. ECPP-FIM an assessment tool for evaluating the professional psychomotor skills within the initial teacher trainin: validity evidences. Retos, 43, 510-520. https://doi.org/10.47197/retos.v43i0.88683
Maureira-Cabrera, O.,Vásquez-Astudillo, M., Garrido-Valdenegro, F., & Olivares-Silva, M.J. (2020). Evaluación y coevaluación de aprendizajes en blended learning en educación Superior. Alteridad. Revista de Educación, 15(2), 190-203. https://doi.org/10.17163/alt.v15n2.2020.04
MEC (2003). La integración del sistema universitario español en el Espacio Europeo de Enseñanza Superior. http://www.eees.es/pdf/Documento-Marco_10_Febrero.pdf
Medina Rivilla, A., Domínguez Garrido, M.C. & Sánchez Romero, C. (2013). Evaluación de las competencias de los estudiantes: modelos y técnicas para la valoración. Revista de Investigación Educativa 31 (1), 239-255. https://doi.org/10.6018/rie.31.1.157601
Meyer, V. (2002). Project oriented learning (POL) as a communication tool of environmental sciences in the community of Sohanguve. A case study. Paper presented at the International Conference on Sustainability of Water Resources, Murdoch University, Western Australia. Recuperado de http://www.saasta.ac.za/scicom/pcst7/meyer_v.pdf
Molina, M., & López-Pastor, V. M. (2019). ¿Evalúo cómo me evaluaron en la facultad? Transferencia de la evaluación vivida durante la formación inicial del profesorado a la evaluación practicada como docente. Revista Iberoamericana de Evaluación Educativa, 12(1), 85–101. https://doi.org/10.15366/10.15366/riee2019.12.1.005
Molina, M., & López-Pastor, V. (2017). La transferencia de la evaluación formativa y/o Compartida desde la formación inicial del profesorado de Educación física a la práctica real en educación primaria. Infancia, Educación y Aprendizaje (IEYA), 3(2), 626-631. https://doi.org/10.22370/ieya.2017.3.2.791
Molina, M., Pascual-Arias, C., & López-Pastor, V.M. (2020). El rendimiento académico y la evaluación formativa y compartida en formación del profesorado. Alteridad. Revista de Educación, 15(2), 204-2015. https://doi.org/10.17163/alt.v15n2.2020.05
Molina, M., Pascual-Arias, C. y López-Pastor, V. M. (2022). Los proyectos de aprendizaje tutorado y la evaluación formativa y compartida en la docencia universitaria española. Perfiles Educativos, 44(177), 96-112. https://doi.org/10.22201/iisue.24486167e.2022.177.60222
Nieva Boza, C., Martínez-Mínguez, L., & Moya Prados, L. (2020). Formative assessment in Project of Co-Oriented Psychomotor Learning (PCo-OPL): student perceptions on acquisition of professional skills. Sportis. Scientific Technical Journal of School Sport, Physical Education and Psychomotricity, 6(2), 327-346. https://doi.org/10.17979/sportis.2020.6.2.6109
OCDE (2002). DeSeCo (Definition and Selection of Competences). http://www.oecd.org/education/skills-beyond-school/41529556.pdf
Orden ECI/3960/2007, de 19 de diciembre, por la que se establece el currículo y se regula la ordenación de la educación infantil. Boletín Oficial del Estado (5 enero 2008), núm. 5, 1016-1036.
Panadero, E., Fraile, J., Fernández, J., Castilla-Estévez, D., & Ruiz, M. A. (2019). Spanish university assessment practices: examination tradition with diversity by faculty. Assessment & Evaluation in Higher Education, 44(3), 1-19. https://doi.org/10.1080/02602938.2018.1512553
Panadero, E., & Lipnevich, A. A. (2022). A review of feedback typologies and models: Towards an integrative model of feedback elements. Educational Research Review, 35, 100416. https://doi.org/10.1016/j.edurev.2021.100416
Peñarrubia-Lozano, C., Lizalde-Gil, M., Rapún-López, M., & Falcón-Miguel, D. (2021). Teacher training students’ perception of outdoor activities and their applicability in school centers. Cultura, Ciencia Y Deporte, 16(49), 17-28. https://doi.org/10.12800/ccd.v16i49.1540
Perrenoud, P. (2004). Diez nuevas competencias para enseñar. Graó.
Rodríguez, G., Ibarra, M. S., & Gómez, M. A. (2011). e-Autoevaluación en la universidad: un reto para profesores y estudiantes. Revista de Educación, 356, 401-430.
Romero-Martín, R., Castejón-Oliva, F., López-Pastor, V., & Fraile-Aranda, A. (2017). Evaluación formativa, competencias comunicativas y TIC en la formación del profesorado. Comunicar: Revista Científica de Comunicación y Educación, 52, 73-82. https://doi.org/10.3916/C52-2017-07
Romero-Martín, R., Fraile Aranda, A., López Pastor, V. M., & Castejón Oliva, F. J. (2014). The relationship between formative assessment systems, academic performance and teacher and student workloads in higher education. Infancia y Aprendizaje: Journal for the Study of Education and Development, 37 (2). https://doi.org/10.1080/02103702.2014.918818
Rust, C. (2007). Towards a scholarship of assessment. Assessment and Evaluation in Higher Education, 32(2), 229-237. https://doi.org/10.1080/02602930600805192
Solà Santesmases, J. (2020). Estudio de la transversalidad de los contenidos en Educación Física a través de los currículos competenciales. Retos, 40, 419-429. https://doi.org/10.47197/retos.v0i40.81783
Souto Suárez, R., Jiménez Jiménez, F., & Navarro Adelantado, V. (2020). La Percepción de los Estudiantes sobre los Sistemas de Evaluación Formativa Aplicados en la Educación Superior. Revista Iberoamericana De Evaluación Educativa, 13(1), 11–39. https://doi.org/10.15366/riee2020.13.1.001
Torrance, H. (2007). Assessment as Learning? How the use of explicit learning objectives, assessment criteria and feedback in post-secondary education and training can come to dominate learning. Assessment in Education: Principles, Policy & Practice, 14 (3), 281-94. https://doi.org/10.1080/09695940701591867
Vallés, C., Ureña, N., & Ruiz, E. (2011). La evaluación formativa en docencia universitaria. Resultados globales de 41 estudios de caso. REDU, 9(1), 135-158.
Valvanuz, V., & Salcines, I. (2018). Estudio sobre la Implementación de la Evaluación Formativa y Compartida en un Ciclo Formativo de Grado Superior. Revista Iberoamericana de Evaluación Educativa, 11(2), 91-112. https://doi.org/10.15366/riee2018.11.2.005
Zabalza, M. A. (2002). Diseño curricular en la universidad. Competencias del docente universitario. Narcea.
Zapatero Ayuso, J.A., González Rivero, M. D., & Campos Izquierdo, A. (2018). El modelo competencial en Educación Física: contribución, evaluación y vinculación con sus contenidos. (Teaching based on competencies in Physical Education: contribution, assessment and relation with educational content). Cultura, Ciencia Y Deporte, 13(37), 17-30. https://doi.org/10.12800/ccd.v13i37.1035
Author notes
* Correspondence: Carolina Nieva Boza, carolina.nieva@uab.cat
Additional information
How to cite this article: Nieva, C., Martínez-Mínguez, L., & Moya, L. (2023). Possibilities and limitations of formative assessment in Projects Oriented Learning. Cultura, Ciencia y Deporte, 18(55). https://doi.org/10.12800/ccd.v18i55.1939