Skip to main content
Fazilat Siddiq
  • 004792440588
A large body of literature suggests that attitudes toward technology and its educational use are important determinants of technology acceptance and integration in classrooms. At the same time, teachers' Technological, Pedagogical, and... more
A large body of literature suggests that attitudes toward technology and its educational use are important determinants of technology acceptance and integration in classrooms. At the same time, teachers' Technological, Pedagogical, and Content Knowledge (TPACK) facilitates the meaningful use of technology for educational purposes. Overall, attitudes toward technology and TPACK play a critical role for technology integration and have been in the focus of many empirical studies. Albeit the attention that has been paid to these two concepts, their relation has not been fully understood. The present study contributes to the advancement of this understanding by examining the relations between three core technology attitudes (i.e., general attitudes towards ICT, attitudes towards ICT in education, and ease of use) and TPACK self-efficacy beliefs, based on a sample of N = 688 Flemish pre-service teachers in 18 teacher-training institutions. Using a variety of structural equation modeling approaches, we describe the TPACK-attitudes relations from multiple perspectives and present a substantive-methodological synergism. The analyses revealed that the attitudes toward technology and TPACK self-beliefs were positively related; yet, differences across the attitudes and TPACK dimensions existed, pointing to the delineation of general and educational perspectives on the use of ICT.
Research Interests:
Keywords: Assessment and teaching of 21st century skills (ATC21S) Collaborative problem solving Computer-based assessment Educational technology Think-aloud protocol a b s t r a c t Collaborative problem solving (ColPS) skills are... more
Keywords: Assessment and teaching of 21st century skills (ATC21S) Collaborative problem solving Computer-based assessment Educational technology Think-aloud protocol a b s t r a c t Collaborative problem solving (ColPS) skills are considered crucial to succeed in work, education, and life in a knowledge-rich society. Nevertheless, research on the assessment of ColPS is at its initial stage; specifically, assessments of synchronous student-student ColPS in digital environments have been scarcely investigated, and there is an ample need for valid and reliable assessments to measure ColPS. The present study attempts to fill this gap by proposing a novel ColPS task and investigating students' ColPS skills with the help of think-aloud protocols while they were taking an online performance-based test. The task was developed on the basis of a ColPS framework, and principles emphasized in the research literature on students' interaction, collaboration, and problem solving were implemented. A real-world problem mimicking a common teaching and learning situation formed the context of this task. The empirical evidence obtained from the think-aloud protocols of eleven Norwegian students displayed the strengths and weaknesses of the task, and strengthened the feasibility to assess ColPS. Implications for the future design of ColPS tasks are discussed.
Research Interests:
This study aims to identify profiles of pre-service teachers in order to explore their readiness to integrate technology in education. The assumption is that pre-service teacher characteristics such as technological pedagogical content... more
This study aims to identify profiles of pre-service teachers in order to explore their readiness to integrate technology in education. The assumption is that pre-service teacher characteristics such as technological pedagogical content knowledge (TPACK), go together with the influence of their teacher training. Specifically, this study examines whether pre-service teachers can be clustered on the basis of their TPACK, a typical set of ICT-related characteristics (e.g., general ICT attitudes, attitudes towards ICT in education, ease of use, ICT self-efficacy), and the perceived support at their training institution to adequately integrate ICT in education. Data were collected from a sample of 688 last-year pre-service teachers in 18 teacher training institutions in Flanders (the Dutch-speaking part of Belgium). Using correlational and latent profile analysis, the results suggest that: (1) two profiles can be distinguished, (2) TPACK and other individual ICT-related characteristics are positively correlated, and (3) pre-service teachers in a profile with strong TPACK, attitudes, and self-efficacy scores also report high scores on the support they perceive at their teacher training institution. Implications for the role of teacher training institutions are discussed with a specific focus on how to close the gap between the two identified profiles.
Research Interests:
The Technological, Pedagogical, and Content Knowledge (TPACK) framework – a framework which proposes a set of knowledge domains that are essential for effective teaching with technology – has gained considerable attention in the domain of... more
The Technological, Pedagogical, and Content Knowledge (TPACK) framework – a framework which proposes a set of knowledge domains that are essential for effective teaching with technology – has gained considerable attention in the domain of education and technology. With the efforts to conceptualize these knowledge domains comes the question to what extent they can be distinguished empirically. Hence, the present study examines a measure that assesses pre-service teachers' self-efficacy in the technology-related TPACK dimensions (“T-dimensions”). In pursuit of crafting a validity argument, we investigated its factor structure and tested it for measurement invariance across gender and educational tracks, two subgroups that may indicate considerable differences. By means of multi-group confirmatory factor analysis, the data of N = 665 pre-service teachers in 18 teacher training institutions in Flanders (Belgium) revealed a nested factor structure of the TPACK measure, which comprised a general factor and a specific factor of pre-service teachers’ technological knowledge. This factor structure was fully invariant across gender and educational tracks. Mean differences between educational tracks did not occur; yet, substantial differences were found across gender in favor of male pre-service teachers. This study sheds light on critical aspects of crafting a validity argument for the measurement of the T-dimensions in the TPACK framework and reports relevant subgroup differences.
For 50 days of free download (until 14 April 2017), access the paper here: https://authors.elsevier.com/a/1UcBf1HucdAJto The present investigation aims to fill some of the gaps revealed in the literature regarding the limited access to... more
For 50 days of free download (until 14 April 2017), access the paper here: https://authors.elsevier.com/a/1UcBf1HucdAJto The present investigation aims to fill some of the gaps revealed in the literature regarding the limited access to more advanced and novel assessment instruments for measuring students' ICT literacy. In particular, this study outlines the adaption, further development, and validation of the Learning in Digital Networks—ICT literacy (LDN-ICT) test. The LDN-ICT test comprises an online performance-based assessment in which real-time student-student collaboration is facilitated through two different platforms (i.e., GoogleDocs and chat). The test attempts to measure students’ ability in handling digital information, to communicate and collaborate during problem solving. The data are derived from 144 students in grade 9 analyzed using item response theory models (unidimensional and multidimensional Rasch models). The appropriateness of the models was evaluated by examining the item fit statistics. To gather validity evidence for the test, we investigated the differential item functioning of the individual items and correlations with other constructs (e.g., self-efficacy, collective efficacy, perceived usefulness and academic aspirations). Our results supported the hypothesized structure of LDN-ICT as comprising four dimensions. No significant differences across gender groups were identified. In support of existing research, we found positive relations to self-efficacy, academic aspirations, and socio-economic background. In sum, our results provide evidence for the reliability and validity of the test. Further refinements and the future use of the test are discussed.
Research Interests:
Teachers’ integration of information and communication technology (ICT) has been widely studied, given that digital competence is considered to be a crucial outcome of twenty first century education. In this context, research highlighted... more
Teachers’ integration of information and communication technology (ICT) has been widely studied, given that digital competence is considered to be a crucial outcome of twenty first century education. In this context, research highlighted teachers’ computer self-efficacy (CSE) as one of the most important determinants of their ICT integration into teaching practices. Whereas previous research mainly focused on the relation between CSE and ICT integration from a frequency-based point of view, recent research suggests to investigate this relation using more qualitative measures of ICT integration such as the degree to which teachers emphasize developing students’ digital information and communication skills (TEDDICS). Consequently, the present study investigates the relations between these two constructs: teachers’ emphasis on developing students’ digital skills and their computer self-efficacy, taking into account the moderating roles of age and gender. We used a representative sample of 1071 Norwegian secondary school teachers who participated in the international computer and information literacy study (ICILS) in 2013. Our results provide evidence on the positive relation between CSE and TEDDICS. Furthermore, age positively moderated this relation between some factors of the two constructs, indicating that computer self-efficacy plays an even more important role for teachers of higher age in the context of emphasizing ICT skills in classrooms. The unique effect of gender was present for one correlation between CSE and TEDDICS, indicating that moderation by gender was apparent to a limited extent, and related to use of computers for instructional purposes. The interaction between age and gender did not reveal significant moderation effects. We discuss these results in light of the potential consequences for teacher training.
Research Interests:
This study systematically reviews literature on assessment instruments of primary and secondary school students’ ICT literacy. It has three objectives: (1) Describe the development and characteristics of the assessments; (2) Present a... more
This study systematically reviews literature on assessment instruments of primary and secondary school students’ ICT literacy. It has three objectives: (1) Describe the development and characteristics of the assessments; (2) Present a synthesis of the facets of ICT literacy measured; and (3) Investigate to what extent information about the reliability and validity is provided. A total of 38 tests reported in 66 studies were included. The results indicate that most of the tests target lower secondary students, comprise multiple-choice item designs, and are evaluated by quantitative methodology. The majority of the tests measure facets such as searching, retrieving, and evaluating digital information, and technical skills. In particular, the access to tests measuring digital communication, collaboration, safety, and problem solving is limited. This review demonstrates that an adequate norm for documenting and reporting test quality is lacking. Our findings point to potential future directions in developing and reporting assessments of ICT literacy.
http://www.sciencedirect.com/science/article/pii/S1747938X16300252
The main objective of this study is to develop a self-report instrument to measure pre-service teachers’ perceptions of the extent to which they experience the necessary support and training in order to integrate technology into classroom... more
The main objective of this study is to develop a self-report instrument to measure pre-service teachers’ perceptions of the extent to which they experience the necessary support and training in order to integrate technology into classroom activities. The questionnaire items of this instrument were drawn up on the basis of a synthesis of 19 qualitative studies (Authors et al., 2012) and were reviewed by experts in the field. In order to study its reliability and aspects of validity, data were collected and analysed consisting of a sample of 688 pre-service teachers in Flanders (Belgium). The resulting scale showed highly satisfactory psychometric properties. Item response theory revealed a good fit of the measurement to a Rating Scale Model for 22 out of 24 items. The results also indicate that the items differ in their degree of difficulty. It seems that helping pre-service teachers to design ICT-rich lessons and providing adequate feedback can be considered more challenging for teacher training institutions. Recommendations are given regarding how the new scale can be useful for both teacher training institutions and schools in developing approaches to equip pre-service teachers with the competencies needed to integrate technology in teaching and learning processes.
The main aim of this study is to validate an instrument to measure teachers' emphasis on the development of students' digital information and communication skills (TEDDICS), a construct that describes a qualitative aspect of ICT use... more
The main aim of this study is to validate an instrument to measure teachers' emphasis on the development of students' digital information and communication skills (TEDDICS), a construct that describes a qualitative aspect of ICT use beyond mere frequency reports. TEDDICS was conceptualized by focusing on digital skills such as accessing, evaluating, and sharing and communicating digital information. We validated TEDDICS with respect to its factorial structure, relations to further teacher-related variables (e.g., ICT self-efficacy), background characteristics (age and gender), and main subject differences. The Norwegian International Computer and Information Literacy Study (ICILS) 2013 teacher sample (N = 1072) showed that TEDDICS: (a comprises three factors which can be identified by exploratory structural equation modeling (ESEM); (b) is positively related to ICT selfefficacy, the frequency of ICT use, and perceived usefulness of ICT; (c) differs across main subjects but not across gender groups. In addressing our research aims, we show that ESEM represents TEDDICS more appropriately than confirmatory factor analysis. Our results provide strong evidence on the construct validity and point out to the importance of looking at the degree to which Teachers emphasize digital skills in classrooms beyond the frequency of using ICT.
Research Interests:
Studies on teachers' acceptance and use of information and communication technology (ICT) have revealed perceived usefulness to be a crucial determinant for integrating ICT in classrooms. In consequence, the present study focuses on... more
Studies on teachers' acceptance and use of information and communication technology (ICT) have revealed perceived usefulness to be a crucial determinant for integrating ICT in classrooms. In consequence, the present study focuses on teachers' perceived usefulness of ICT for teaching and learning and is aimed at describing its structure and relations to self-efficacy, ICT use, and teachers' age. By means of Bayesian analysis, we specified confirmatory factor-analytic and structural equation models to a large-scale data set of N = 1190 Norwegian teachers. Our results supported the hypothesized four-factor structure of teachers' perceived usefulness of ICT, signifying different facets of ICT-related teaching goals in classrooms. Moreover, it was possible to disentangle general and specific components of the construct in nested factor models. In support of existing research, we found positive relations to selfefficacy and ICT use, but a negative relation to teachers' age. Our study provides evidence on a multidimensional conceptualization of teachers' perceived usefulness of ICT for teaching and learning, and verifies the relations to teacher-related characteristics. Implications for the measurement and modeling of the construct, and future research directions are discussed.
Gender differences in computer-related constructs have been identified for teachers and students. The present study investigated such differences by focusing on teachers’ computer self-efficacy (CSE), which is conceptualized as their... more
Gender differences in computer-related constructs have been identified for teachers and students. The present study investigated such differences by focusing on teachers’ computer self-efficacy (CSE), which is conceptualized as their confidence in performing basic and advanced skills in using computers, along with the use of computers for instructional purposes. Analyzing the data from 1208 Norwegian secondary school teachers who participated in the International Computer and Information Literacy Study (ICILS) 2013 by means of multi-group confirmatory factor analysis, we found that: (a) CSE can be described by three factors (self-efficacy in basic operational skills, advanced operational and collaborative skills, and in using computers for instructional purposes) which remain invariant across gender; (b) male teachers had higher CSE in basic (d = 1.03) and advanced operational skills (d = 0.49); (c) no significant gender differences for CSE in using computers for instructional purposes existed; (d) teachers’ CSE was differentially related to their participation in professional development courses for females and males.
The differentiation into three factors of CSE provides a more detailed view on teachers’ CSE than unidimensional approaches. We discuss our findings in light of gender differences and teachers’ professional development in using information and communication technology.
In large-scale assessments such as the PISA study, there is a current shift from traditional paper-and pencil towards computer-based assessments of students' literacy in reading, math, and science. Thus, research has focused on examining... more
In large-scale assessments such as the PISA study, there is a current shift from traditional paper-and pencil towards computer-based assessments of students' literacy in reading, math, and science. Thus, research has focused on examining the comparability of test scores and motivational factors across the different assessment types. However, it is currently unclear whether the negative effect of school average ability on students' individual self-concept (i.e., the Big-FisheLittle-Pond Effect, BFLPE) is also robust against the shift in assessments. In the present investigation, we consequently evaluate the relations between math self-concept, school-average ability, and the type of assessment. Based on the Norwegian PISA 2012 data set (N = 4686), we employed multilevel structural equation modeling and found that (a) the BFLPE existed for both assessments with a slightly higher effect size for the computer based assessment; (b) math anxiety moderated the BFLPE, whereas self-efficacy, the availability and use of information and communication technology (ICT) did not. Our results support the robustness of the BFLPE across the different assessments of mathematical literacy and point out that computer-based assessments involve similar social comparisons as traditional paper-and-pencil tests.
Preparing future teachers to integrate ICT in their educational practice is a challenge that teacher training institutions (TTI) are increasingly confronted with (Liu, 2016). To train pre-service teachers, TTIs need to help them bridge... more
Preparing future teachers to integrate ICT in their educational practice is a challenge that teacher training institutions (TTI) are increasingly confronted with (Liu, 2016). To train pre-service teachers, TTIs need to help them bridge the gap between technology, pedagogy, and content knowledge (TPACK). Mishra and Koehler (2009) argue that for ICT integration to occur in education, teachers must be competent in these three forms of knowledge, but more importantly, they must be able to integrate all three types of knowledge (Schmidt et al. 2009).

The need to better align preservice teachers’ preparation in the integration of technology including pedagogical efforts and curriculum (TPACK) has been noted by many researchers recently (e.g., Sang et al., 2010). But preparing student teachers for TPACK is a complex process (Authors, 2015). Some pre-service teachers are intrinsically motivated to use ICT in educational practice, while others do not share this affinity. For this reason, many researchers have focused on critical individual characteristics associated with TPACK, such as pre-service teachers’ attitudes (e.g. Holland & Piper, 2016), ease of use (Teo, 2010), and self-efficacy (e.g., Authors 2016).

However, a mere focus on pre-service teacher characteristics could lead to “individual blame” rather than “system blame”. Therefore, research should also stress the role of pre-service training, especially with respect to the different strategies for the content and delivery methods to prepare pre-service teachers for technology use (e.g., Mouza et al., 2014). Still, the question remains how TTIs can get a comprehensive overview of effective strategies. In this respect, Authors (2012) reviewed 19 qualitative studies in order to develop an SQD-model (Synthesis of Qualitative Evidence) focusing on which content and delivery methods best prepare pre-service teachers to integrate technology into their future classrooms.

According to the findings of this review, six key themes at the micro level need to be in place. These involve providing pre-service teachers opportunities to: discuss and reflect upon successful uses of technology; learn about ICT integration by designing and/or re-designing curriculum materials; design technology-related curriculum materials in teams or other collaborative initiatives; scaffold authentic technology experiences; receive on-going feedback; and experience teacher educators as role models (for more detailed information about each theme, please see Authors., 2012).

In the current study, we aim at delineating profiles based on pre-service teachers’ ICT-related attitudes, their TPACK, and the support they perceive provided by their institution (SQD). This study aims to determine which pre-service teacher characteristics are connected to their perceived support from their TTIs to prepare them for educational ICT use. Specifically, the study examines whether pre-service teacher profiles exist on the basis of a typical set of (1) individual characteristics such as TPACK, their attitudes towards ICT (in education), their self-efficacy, ease of use, and (2) the support pre-service teachers perceive from their TTIs with respect to technology integration in education.





Method
A survey was developed to explore pre-service teachers’ characteristics and the perceived support pre-service teachers receive in their TTI. The survey was conducted among N=688 pre-service teachers from 18 teacher training institutions in Flanders (Belgium) in their final year of education. All respondents received an email invitation to fill in the survey; participation was completely voluntary. About 73.8% of the respondents were females; this gender distribution is representative of the pre-service teachers in Flanders (Authors, 2016). The average age was 25.1 years (SD=7.7 years).

(1) TPACK
The measurement of the TPACK technology-dimensions was based on the adapted Dutch version of Schmidt et al.’s (2009) TPACK self-report scale (Authors, 2013). Teacher students were asked to indicate the extent to which they agreed with a number of statements that referred to the technology-dimensions (0 = I completely agree, 4 = I completely agree). This new instrument (Authors, 2016) revealed a general TPACK (TPCK, TPK, and TCK) and a specific TK factor. The general TPACK factor was measured by 14 items that tapped TPCK, TPK, and TCK (Cronbach’s α = .94), whereas the TK scale was measured by 7 items (Cronbach’s α =.89).

(2) Attitudes towards ICT (in education)
The first instrument employed to measure pre-service teachers’ attitudes was the “General Attitudes toward ICT Scale” (Cronbach’s α=.82), a five-item scale developed by Evers et al. (2009). It includes items related to interest (e.g., “I want to know more about computers”), pleasure (e.g., “I like to talk about computers to others”), and usefulness (e.g., “The use of a computer is useful to me”).  The Ease of Use Scale (Cronbach’s α=.89) contains three items (e.g., “I feel comfortable when I use computers”). The Attitudes toward ICT in Education Scale (Evers et al., 2009) measures students’ attitudes toward the effects of adopting computers in education including the same spectrum of dimensions: “interest”, “ease of use”, “pleasure”, and “usefulness”. The eight items on pre-service teachers’ self-efficacy (Cronbach’s α=.89) measure the degree to which pre-service teachers feel competent to use ICT as a supportive tool to strengthen their instructional practice (Authors, 2016), for example, “select ICT-applications in view of a specific educational setting” or “design a learning environment with the available infrastructure”.

(3) SQD-scale
The SQD-scale used in this study was constructed around the six significant domains of the inner circle (i.e., the micro-level) of the SQD-model (Authors, 2016): (1) using teacher educators as role models, (2) reflecting on the role of technology in education, (3) learning how to use technology by design, (4) collaboration with peers, (5) scaffolding authentic technology experiences, and (6) providing continuous feedback (22 items, Cronbach’s α=.97).

In order to identify profiles of pre-service teachers, we conducted latent profile analyses (LPA) to our cross-sectional data set. The LPA were based on robust maximum likelihood estimation, an estimation procedure that corrects for potential deviations from the normality of variables. In the current data set, 3.3% of the variables were missing due to participants’ non-responses, and we used the full-information-maximum-likelihood procedure in order to handle them under the assumption that they occurred randomly.

Results
On the basis of the LPA, the respondents were distributed among two profiles as follows: 241 were classified as Profile 1 members (35% of the 688 respondents) and 447 were grouped in Profile 2 (65%). The differences between the mean scores of the two profiles were statistically significant for all scale scores. Pre-service teachers in Profile 2 reflect higher scores on all the different scales compared to pre-service teachers in Profile 1. The latter profile is therefore labelled as ‘‘Low ICT Profile” (L-ICT). In contrast, Profile 2 is labelled as ‘‘High ICT Profile” (H-ICT).

This finding is in line with previous research that suggests that general and domain specific attitudes toward the use of ICT in education are closely related (cf. Agyei, & Voogt, 2015). Another general finding is that (pre-service) teachers adopting more positive ICT attitudes were more likely to report positive attitudes toward ICT in education (see also Authors, 2016). Interestingly, pre-service teachers’ ICT self-efficacy, ease of use, and their TPACK go together within both profiles.

In light of the two profiles, it is clear that some pre-service teachers are intrinsically motivated to use ICT in their educational practice, while others do not share this affinity (e.g., Teo & Milutinovic, 2015). For this reason, many researchers placed the individual teacher at the centre of educational change processes (Stoll, 1999). The results of this study indicate a positive association between TPACK and SQD.  Pre-service teachers in a profile with relatively positive attitudes, self-efficacy, and TPACK also report higher scores on the perceived support provided by their teacher training institution. As a consequence, understanding pre-service teachers’ TPACK profiles is a crucial factor in supporting pre-service teachers for ICT integration in education.

References (max. 400 words)


Key words
Profile analysis; ICT integration; teacher training or pre-service teachers, TPACK
Research Interests:
The present study builds on the assumption that both pre-service teachers’ ICT-related background characteristics (e.g., ICT-attitudes) and perceived support from their teacher training institution (TTI) affect their Technological... more
The present study builds on the assumption that both pre-service teachers’ ICT-related background characteristics (e.g., ICT-attitudes) and perceived support from their teacher training institution (TTI) affect their Technological Pedagogical Content Knowledge (TPACK). While previous research documented similar determinants, this paper studied the relationship between profiles of pre-service teachers and TPACK. Survey data were collected from 688 pre-service teachers in 21 TTIs in Flanders. The study first examined whether profiles of pre-service teachers can be developed. A next step was to examine how pre-service teachers with different profiles perceived the support they received from their TTI. Finally, the relationship between pre-service teachers’ profiles and their TPACK was examined. The analyses showed distinct pre-service teacher profiles that varied along ICT-background dimensions. The different ICT-profiles and their relation to TPACK can inform TTIs about how to prepare pre-service teachers’ to integrate ICT in their practice.
Research Interests:
This paper has been awarded the prize of best paper at the Educational Technology World Conference (ETWC) 2016. The main aim of this study was to measure the impact of the support pre-service teachers receive on their knowledge for... more
This paper has been awarded the prize of best paper at the Educational Technology World Conference (ETWC) 2016. The main aim of this study was to measure the impact of the support pre-service teachers receive on their knowledge for effective technology integration, namely technological pedagogical content knowledge (TPACK). Specifically, we focused on the strategies included in the SQD (Synthesis of Qualitative Evidence) model: 1) using teacher educators as role models, 2) reflecting on the role of technology in education, 3) learning how to use technology by design, 4) collaboration with peers, 5) scaffolding authentic technology experiences, and 6) providing continuous feedback. In order to explore the relation between the perceived occurrences of the SQD-strategies and TPACK, survey data were collected from a sample of 688 final-year pre-service teachers in Belgium. In addition, a multiple case study was conducted in three teacher training institutions, including three focus group discussions with 19 pre-service teachers. The first results are included in the presentation.
Research Interests:
Assessments of 21st century skills have undergone a shift from traditional paper-and-pencil (PPA) to computer-based assessments (CBA). Since computer-based tests require more complex skills than PPAs such as generating knowledge and... more
Assessments of 21st century skills have undergone a shift from traditional paper-and-pencil (PPA) to computer-based assessments (CBA). Since computer-based tests require more complex skills than PPAs such as generating knowledge and evaluating information from multiple sources, research has focused on the comparability of scores obtained from PPAs and CBAs. However, CBAs provide relatively new assessment situations, in which students could become uncertain about their abilities, affecting their self-concept and the way they perceive themselves. In particular, changing the demands of tasks by shifting towards CBAs might lead to a change in the contextual and negative effect of school-average ability on students’ individual self-concept, which is referred to as the Big-Fish-Little-Pond Effect (BFLPE). Extensive research on this effect shows its robustness across cultures and domains. However, social comparisons in CBA situations might not only be related to school-average ability as a source of social comparisons but also to factors of personality, ICT use and availability. To conclude, it is currently unclear whether the BFLPE is present in 21st century assessments.
The aim of the present study was to examine (a) whether the PISA 2012 paper-and-pencil and computer-based assessments in math measure the same construct; (b) the existence of the BFLPE for the PPA and CBA; and (c) the moderating role of personality (self-efficacy, anxiety) and ICT-related constructs (ICT availability and use) towards the BFLPE.
In present investigation, we used the Norwegian data set of the PISA 2012 study, which consisted of 4,686 students (mean age: 15.3 years, 48.9% female) from 197 randomly sampled schools. Models of item response theory were specified to investigate the comparability of the PPA and CBA. Multilevel structural equation modeling with schools as clusters was subsequently employed to estimate the BFLPE and the moderation effects.
The results of the present study demonstrated that the two math assessments were highly correlated and related to a general factor of math literacy. Furthermore, the BFLPE existed for both assessments with a slightly higher effect size for the CBA. Math anxiety and self-efficacy moderated the BFLPE, whereas ICT availability and use did not.
Our results support the convergent validity of the two math assessments, gauging math literacy. Moreover, they reveal the robustness of the BFLPE across the assessments and point out the similarity of social comparisons that are present in CBA and PPA situations. In support of previous research, students’ personality traits intensify the BFLPE. However, ICT-related constructs cannot be regarded as further sources of social comparisons in CBAs. The present study extends existing research on the BFLPE by showing its existence in 21st century assessments. It also addresses issues of comparability of PPAs and CBAs with motivational factors.
Research Interests:
Teachers’ integration of information and communication technology (ICT) has been widely studied, given that digital competence has become crucial in 21st century education. In this context, teachers’ ICT integration is mostly represented... more
Teachers’ integration of information and communication technology (ICT) has been widely studied, given that digital competence has become crucial in 21st century education. In this context, teachers’ ICT integration is mostly represented by quantitative measures describing the frequency of ICT use in classrooms without examining the degree to which digital information and communication skills are emphasized. Consequently, the present study investigates teachers’ emphasis on developing students’ digital skills, focusing on accessing, evaluating, sharing & communicating digital information. The aim of our study is to validate an assessment of the construct with respect to its factor structure, relations to other constructs (e.g., teachers’ ICT self-efficacy, ICT use), and the differences between gender and main subject groups. We used a representative sample of 1,072 Norwegian teachers that participated in the International Computer and Information Literacy Study (ICILS) in 2013. We show that teachers’ emphasis: (a) comprises three correlated factors which are identified by exploratory structural equation modeling; (b) is positively related to teachers’ ICT self-efficacy and the frequency of ICT use; (c) differs across teachers’ main subject but not across gender groups. Our results provide strong evidence on the construct validity and point out the importance of teachers’ emphasis on fostering students’ digital skills in 21st century classrooms.
Research Interests:
Studies on teachers' acceptance and use of information and communication technology (ICT) have revealed perceived usefulness to be a crucial determinant for integrating ICT in classrooms. In consequence, the present study focuses on... more
Studies on teachers' acceptance and use of information and communication technology (ICT) have revealed perceived usefulness to be a crucial determinant for integrating ICT in classrooms. In consequence, the present study focuses on teachers' perceived usefulness of ICT for teaching and learning and is aimed at describing its structure and relations to self-efficacy, ICT use, and teachers' age. By means of Bayesian analysis, we specified confirmatory factor-analytic and structural equation models to a largescale data set of N = 1190 Norwegian teachers. Our results supported the hypothesized four-factor structure of teachers' perceived usefulness of ICT, signifying different facets of ICT-related teaching goals in classrooms. In support of existing research, we found positive relations to self-efficacy and ICT use, but a negative relation to teachers' age. Our study provides evidence on a multidimensional conceptualization of teachers' perceived usefulness of ICT for teaching and learning, and verifies the relations to teacher-related characteristics.
Research Interests:
The role and use of information and communication technology (ICT) in education has changed profoundly over the last decade. As a consequence the concept Digital divide has become a core issue on the educational- research and policy... more
The role and use of information and communication technology (ICT) in education has changed profoundly over the last decade. As a consequence the concept Digital divide has become a core issue on the educational- research and policy agenda. Digital divide has traditionally been defined as the gap between those who have and do not have access to computers and the Internet (Selwyn, 2004). However, research has revealed that the inequality addressed by the digital divide has shifted from physical access towards ICT literacy and usage (van Dijk, 2006). Consequently, we need good tools to assess students’ ICT literacy. Several national and international research projects focusing on assessing students’ ICT literacy have been initiated. However, to our knowledge, no synthesis of the research on these assessments has been published.
This study aims to address this gap by systematically reviewing the literature on the assessment of ICT literacy (for students in the age-group 6-18). The study has three main objectives; (1) identify the variety of ICT literacy test instruments, (2) present a synthesis of the available empirical evidence of to what extent the tests measure ICT literacy according to the DigComp framework (Ferrari, 2013) , (3) evaluate the validity and reliability of the tests and (4) on the basis of the knowledge gained, provide suggestions for future research.
A total of 36 studies were finally included in the review. For each article, we thoroughly analyzed the purpose of the study, the underlying framework and conceptualization of it, and a comparison to the DigComp framework was made. This framework identifies five competence areas; Information, Communication, Content creation, Safety and Problem solving (each of these areas are further divided into specific competences). In addition, we considered the sample characteristics (e.g., sample size, age, gender, school level, urban/rural schools, socio-economic background), the results of the study (e.g., level of digital competence, correlations between background variables, self-reported attitudes or self-efficacy and ICT literacy score) and the reported psychometric properties (e.g., reliability, validity and item descriptions). Our results indicate that most of the existing tests only measure a few facets of ICT literacy. Moreover, an overwhelming amount of the tests assess students’ technical skills and their digital information- search and retrieval skills. Only a scarce amount of the tests measured aspects of ICT literacy such as digital communication, collaboration and problem solving skills. Furthermore, there is a lack of an adequate norm for reporting ICT literacy instruments, especially criteria for reporting validity and reliability of the tests are missing. It also seems that most tests are knowledge based, but there are some examples of testing students’ actual use and performance with ICT. In sum, our findings point to the need for instruments measuring several digital skills (e.g., digital communication, collaboration, content development and netiquette), and give directions for the reporting of research on ICT literacy tests. We believe an improvement of ICT competence measurement tools can be valuable by providing a basis for new strategies in decreasing the digital divide between students.
Research Interests:
The fast development of information and communication technology (ICT) has brought about profound changes in the way we live and work. These changes clearly offer further opportunities, but also a number of risks. Many people do not have... more
The fast development of information and communication technology (ICT) has brought about profound changes in the way we live and work. These changes clearly offer further opportunities, but also a number of risks. Many people do not have ICT-competencies, resulting in a new form of exclusion often thought of as the ‘digital divide’. This brings us to the role of education and teacher training institutions (TTI). TTIs are expected to prepare pre-service teachers to integrate technology into their educational practice. Therefore, TTIs around the world have engaged in various efforts to re-shape their curriculum (Ottenbreit-Leftwich et al., 2010). More specifically, it is suggested that technology should be infused into the entire curriculum so that pre-service teachers have the opportunity to understand and experience the educational benefits of using technology as a tool to support teaching and learning across different subject domains (Tondeur et al., 2012). In this respect, research has identified a number of approaches that can successfully contribute to developing the competences future teachers need in order to integrate technology in teaching and learning processes (Chien, et al., 2012). However, the adoption of integrated cross-curricular approaches to promote pre-service teachers’ competencies for educational technology use is a complex process that requires various strategies (Polly et al., 2010).
Given the lack of a review about these strategies, Tondeur et al. (2012) has synthesised six effective strategies for contemporary technology integration in pre-service teacher education programmes: 1) using teacher educators as role models, 2) reflecting on the role of ICT in education, 3) learning technology by design, 4) scaffolding authentic technology experiences, 5) collaboration with peers, and 6) providing continuous feedback. As a result, the overarching SQD-model (Synthesis of Qualitative Evidence) was developed to present how these necessary strategies relate to each other. After the introduction of this model, there was the need of a comprehensive instrument to measure to what degree TTIs are integrating these strategies. This study intends to address this gap in the existing literature by providing an instrument that can be used to measure the adoption of effective strategies to prepare pre-service teachers for technology use in education.
The questionnaire items of the self-report instrument are developed on the basis of the qualitative review and were reviewed by experts in the field. In order to study the reliability and internal validity of the newly developed instrument, data were collected from a sample of 688 final-year pre-service teachers in Flanders (Belgium). Item response theory revealed a good fit of the measurement to a polytomous Rasch model for twenty-two out of twenty-four items. The resulting scale showed excellent psychometric properties in terms of reliability and different forms of validity. In this regard, there was evidence that the assumptions of unidimensionality and local independence were met for the SQD scale. Moreover, differential item functioning between female and male pre-service teachers did not occur, pointing to the fairness of the scale across gender. The newly developed test instrument can therefore be regarded as a suitable tool for measuring SQD. Researchers and practitioners can make use of this scale in order to assess adoption of effective strategies to prepare pre-service teachers for technology use in education.

References

Chien, Y., Chang, C., Yeh, T., & Chang, K. (2012). Engaging pre-service science teachers to
act as active designers of technology integration: A MAGDAIRE framework. Teaching and
Teacher Education, 28, 578–588.

Tondeur, J., van Braak, J., Sang, G., Voogt, J., Fisser, P., & Ottenbreit-Leftwich, A. (2012). Preparing pre-service teachers to integrate technology in education: A synthesis of qualitative evidence. Computers & Education, 59(1), 134-144.

Ottenbreit-Leftwich, A., Glazewski, K., Newby, T., & Ertmer, P. (2010). Teacher value
beliefs associated with using technology: Addressing professional and student needs.
Computers & Education, 55, 1321–1335.

Polly, D., Mims, C., Shepherd, C. E., & Inan, F. (2010). Evidence of impact: transforming teacher education with preparing tomorrow’s teachers to teach with technology (PT3)grants. Teaching and Teacher Education, 26, 863–870
Research Interests:
The present meta-analysis investigates the gender differences and the effect of SES on students’ ICT literacy (i.e., performance based assessments). To our knowledge, a synthesis of this kind is still lacking in the existing body of... more
The present meta-analysis investigates the gender differences and the effect of SES on students’ ICT literacy (i.e., performance based assessments). To our knowledge, a synthesis of this kind is still lacking in the existing body of research, and could provide more detailed insights into relevant issues related to the digital divide, that otherwise would not be readily available or obvious from individual studies (Fan & Chen, 2001). In particular, the study addresses the following research questions: RQ1. Are there gender differences in students’ ICT literacy achievement reported in previous empirical studies? RQ2. Are there differences based on students’ SES on their ICT literacy achievement? RQ3. What are the study features (mode of test, region, age group) that may explain the findings?
Research Interests:
Research Interests: