Fazilat Siddiq
University of Oslo, Dept. of Teacher Education and School Research, Graduate Student
-
ICT literacy, Digital competence, Assessment, Teacher Education, Psychometrics, Education, and 8 moreStudents Attitudes, Assessment and Measurement, Psychological and Educational Testing, Cognitive Psychology, Educational Technology, Educational Research, ICT in Education, and Teachers' professional development edit
-
My primary research interest is in measurement of students digital competence/ICT literacy. Secondly I am interested ... moreMy primary research interest is in measurement of students digital competence/ICT literacy. Secondly I am interested in teachers digital competence and use of ICT in school. As digital competence being closely related to 21st century skills, I am also interested in aspects of that concerning students and teachers. More spesifically Collaborative problem solving and digital communication.
I am currently working on a systematic review of test instruments that aim to measure students digital competence (ICT literacy).
In addition I am translating and adapting a test into Norwegian for measuring Collaborative problem-solving and Communication between students. The pilot study will be conducted early spring 2015. edit
Keywords: Assessment and teaching of 21st century skills (ATC21S) Collaborative problem solving Computer-based assessment Educational technology Think-aloud protocol a b s t r a c t Collaborative problem solving (ColPS) skills are... more
Keywords: Assessment and teaching of 21st century skills (ATC21S) Collaborative problem solving Computer-based assessment Educational technology Think-aloud protocol a b s t r a c t Collaborative problem solving (ColPS) skills are considered crucial to succeed in work, education, and life in a knowledge-rich society. Nevertheless, research on the assessment of ColPS is at its initial stage; specifically, assessments of synchronous student-student ColPS in digital environments have been scarcely investigated, and there is an ample need for valid and reliable assessments to measure ColPS. The present study attempts to fill this gap by proposing a novel ColPS task and investigating students' ColPS skills with the help of think-aloud protocols while they were taking an online performance-based test. The task was developed on the basis of a ColPS framework, and principles emphasized in the research literature on students' interaction, collaboration, and problem solving were implemented. A real-world problem mimicking a common teaching and learning situation formed the context of this task. The empirical evidence obtained from the think-aloud protocols of eleven Norwegian students displayed the strengths and weaknesses of the task, and strengthened the feasibility to assess ColPS. Implications for the future design of ColPS tasks are discussed.
Research Interests:
For 50 days of free download (until 14 April 2017), access the paper here: https://authors.elsevier.com/a/1UcBf1HucdAJto The present investigation aims to fill some of the gaps revealed in the literature regarding the limited access to... more
For 50 days of free download (until 14 April 2017), access the paper here: https://authors.elsevier.com/a/1UcBf1HucdAJto The present investigation aims to fill some of the gaps revealed in the literature regarding the limited access to more advanced and novel assessment instruments for measuring students' ICT literacy. In particular, this study outlines the adaption, further development, and validation of the Learning in Digital Networks—ICT literacy (LDN-ICT) test. The LDN-ICT test comprises an online performance-based assessment in which real-time student-student collaboration is facilitated through two different platforms (i.e., GoogleDocs and chat). The test attempts to measure students’ ability in handling digital information, to communicate and collaborate during problem solving. The data are derived from 144 students in grade 9 analyzed using item response theory models (unidimensional and multidimensional Rasch models). The appropriateness of the models was evaluated by examining the item fit statistics. To gather validity evidence for the test, we investigated the differential item functioning of the individual items and correlations with other constructs (e.g., self-efficacy, collective efficacy, perceived usefulness and academic aspirations). Our results supported the hypothesized structure of LDN-ICT as comprising four dimensions. No significant differences across gender groups were identified. In support of existing research, we found positive relations to self-efficacy, academic aspirations, and socio-economic background. In sum, our results provide evidence for the reliability and validity of the test. Further refinements and the future use of the test are discussed.
Research Interests:
Teachers’ integration of information and communication technology (ICT) has been widely studied, given that digital competence is considered to be a crucial outcome of twenty first century education. In this context, research highlighted... more
Teachers’ integration of information and communication technology (ICT) has been widely studied, given that digital competence is considered to be a crucial outcome of twenty first century education. In this context, research highlighted teachers’ computer self-efficacy (CSE) as one of the most important determinants of their ICT integration into teaching practices. Whereas previous research mainly focused on the relation between CSE and ICT integration from a frequency-based point of view, recent research suggests to investigate this relation using more qualitative measures of ICT integration such as the degree to which teachers emphasize developing students’ digital information and communication skills (TEDDICS). Consequently, the present study investigates the relations between these two constructs: teachers’ emphasis on developing students’ digital skills and their computer self-efficacy, taking into account the moderating roles of age and gender. We used a representative sample of 1071 Norwegian secondary school teachers who participated in the international computer and information literacy study (ICILS) in 2013. Our results provide evidence on the positive relation between CSE and TEDDICS. Furthermore, age positively moderated this relation between some factors of the two constructs, indicating that computer self-efficacy plays an even more important role for teachers of higher age in the context of emphasizing ICT skills in classrooms. The unique effect of gender was present for one correlation between CSE and TEDDICS, indicating that moderation by gender was apparent to a limited extent, and related to use of computers for instructional purposes. The interaction between age and gender did not reveal significant moderation effects. We discuss these results in light of the potential consequences for teacher training.
Research Interests:
This study systematically reviews literature on assessment instruments of primary and secondary school students’ ICT literacy. It has three objectives: (1) Describe the development and characteristics of the assessments; (2) Present a... more
This study systematically reviews literature on assessment instruments of primary and secondary school students’ ICT literacy. It has three objectives: (1) Describe the development and characteristics of the assessments; (2) Present a synthesis of the facets of ICT literacy measured; and (3) Investigate to what extent information about the reliability and validity is provided. A total of 38 tests reported in 66 studies were included. The results indicate that most of the tests target lower secondary students, comprise multiple-choice item designs, and are evaluated by quantitative methodology. The majority of the tests measure facets such as searching, retrieving, and evaluating digital information, and technical skills. In particular, the access to tests measuring digital communication, collaboration, safety, and problem solving is limited. This review demonstrates that an adequate norm for documenting and reporting test quality is lacking. Our findings point to potential future directions in developing and reporting assessments of ICT literacy.
http://www.sciencedirect.com/science/article/pii/S1747938X16300252
http://www.sciencedirect.com/science/article/pii/S1747938X16300252
Research Interests:
Studies on teachers' acceptance and use of information and communication technology (ICT) have revealed perceived usefulness to be a crucial determinant for integrating ICT in classrooms. In consequence, the present study focuses on... more
Studies on teachers' acceptance and use of information and communication technology (ICT) have revealed perceived usefulness to be a crucial determinant for integrating ICT in classrooms. In consequence, the present study focuses on teachers' perceived usefulness of ICT for teaching and learning and is aimed at describing its structure and relations to self-efficacy, ICT use, and teachers' age. By means of Bayesian analysis, we specified confirmatory factor-analytic and structural equation models to a large-scale data set of N = 1190 Norwegian teachers. Our results supported the hypothesized four-factor structure of teachers' perceived usefulness of ICT, signifying different facets of ICT-related teaching goals in classrooms. Moreover, it was possible to disentangle general and specific components of the construct in nested factor models. In support of existing research, we found positive relations to selfefficacy and ICT use, but a negative relation to teachers' age. Our study provides evidence on a multidimensional conceptualization of teachers' perceived usefulness of ICT for teaching and learning, and verifies the relations to teacher-related characteristics. Implications for the measurement and modeling of the construct, and future research directions are discussed.
Research Interests:
Gender differences in computer-related constructs have been identified for teachers and students. The present study investigated such differences by focusing on teachers’ computer self-efficacy (CSE), which is conceptualized as their... more
Gender differences in computer-related constructs have been identified for teachers and students. The present study investigated such differences by focusing on teachers’ computer self-efficacy (CSE), which is conceptualized as their confidence in performing basic and advanced skills in using computers, along with the use of computers for instructional purposes. Analyzing the data from 1208 Norwegian secondary school teachers who participated in the International Computer and Information Literacy Study (ICILS) 2013 by means of multi-group confirmatory factor analysis, we found that: (a) CSE can be described by three factors (self-efficacy in basic operational skills, advanced operational and collaborative skills, and in using computers for instructional purposes) which remain invariant across gender; (b) male teachers had higher CSE in basic (d = 1.03) and advanced operational skills (d = 0.49); (c) no significant gender differences for CSE in using computers for instructional purposes existed; (d) teachers’ CSE was differentially related to their participation in professional development courses for females and males.
The differentiation into three factors of CSE provides a more detailed view on teachers’ CSE than unidimensional approaches. We discuss our findings in light of gender differences and teachers’ professional development in using information and communication technology.
The differentiation into three factors of CSE provides a more detailed view on teachers’ CSE than unidimensional approaches. We discuss our findings in light of gender differences and teachers’ professional development in using information and communication technology.
Research Interests:
In large-scale assessments such as the PISA study, there is a current shift from traditional paper-and pencil towards computer-based assessments of students' literacy in reading, math, and science. Thus, research has focused on examining... more
In large-scale assessments such as the PISA study, there is a current shift from traditional paper-and pencil towards computer-based assessments of students' literacy in reading, math, and science. Thus, research has focused on examining the comparability of test scores and motivational factors across the different assessment types. However, it is currently unclear whether the negative effect of school average ability on students' individual self-concept (i.e., the Big-FisheLittle-Pond Effect, BFLPE) is also robust against the shift in assessments. In the present investigation, we consequently evaluate the relations between math self-concept, school-average ability, and the type of assessment. Based on the Norwegian PISA 2012 data set (N = 4686), we employed multilevel structural equation modeling and found that (a) the BFLPE existed for both assessments with a slightly higher effect size for the computer based assessment; (b) math anxiety moderated the BFLPE, whereas self-efficacy, the availability and use of information and communication technology (ICT) did not. Our results support the robustness of the BFLPE across the different assessments of mathematical literacy and point out that computer-based assessments involve similar social comparisons as traditional paper-and-pencil tests.
Research Interests:
Assessments of 21st century skills have undergone a shift from traditional paper-and-pencil (PPA) to computer-based assessments (CBA). Since computer-based tests require more complex skills than PPAs such as generating knowledge and... more
Assessments of 21st century skills have undergone a shift from traditional paper-and-pencil (PPA) to computer-based assessments (CBA). Since computer-based tests require more complex skills than PPAs such as generating knowledge and evaluating information from multiple sources, research has focused on the comparability of scores obtained from PPAs and CBAs. However, CBAs provide relatively new assessment situations, in which students could become uncertain about their abilities, affecting their self-concept and the way they perceive themselves. In particular, changing the demands of tasks by shifting towards CBAs might lead to a change in the contextual and negative effect of school-average ability on students’ individual self-concept, which is referred to as the Big-Fish-Little-Pond Effect (BFLPE). Extensive research on this effect shows its robustness across cultures and domains. However, social comparisons in CBA situations might not only be related to school-average ability as a source of social comparisons but also to factors of personality, ICT use and availability. To conclude, it is currently unclear whether the BFLPE is present in 21st century assessments.
The aim of the present study was to examine (a) whether the PISA 2012 paper-and-pencil and computer-based assessments in math measure the same construct; (b) the existence of the BFLPE for the PPA and CBA; and (c) the moderating role of personality (self-efficacy, anxiety) and ICT-related constructs (ICT availability and use) towards the BFLPE.
In present investigation, we used the Norwegian data set of the PISA 2012 study, which consisted of 4,686 students (mean age: 15.3 years, 48.9% female) from 197 randomly sampled schools. Models of item response theory were specified to investigate the comparability of the PPA and CBA. Multilevel structural equation modeling with schools as clusters was subsequently employed to estimate the BFLPE and the moderation effects.
The results of the present study demonstrated that the two math assessments were highly correlated and related to a general factor of math literacy. Furthermore, the BFLPE existed for both assessments with a slightly higher effect size for the CBA. Math anxiety and self-efficacy moderated the BFLPE, whereas ICT availability and use did not.
Our results support the convergent validity of the two math assessments, gauging math literacy. Moreover, they reveal the robustness of the BFLPE across the assessments and point out the similarity of social comparisons that are present in CBA and PPA situations. In support of previous research, students’ personality traits intensify the BFLPE. However, ICT-related constructs cannot be regarded as further sources of social comparisons in CBAs. The present study extends existing research on the BFLPE by showing its existence in 21st century assessments. It also addresses issues of comparability of PPAs and CBAs with motivational factors.
The aim of the present study was to examine (a) whether the PISA 2012 paper-and-pencil and computer-based assessments in math measure the same construct; (b) the existence of the BFLPE for the PPA and CBA; and (c) the moderating role of personality (self-efficacy, anxiety) and ICT-related constructs (ICT availability and use) towards the BFLPE.
In present investigation, we used the Norwegian data set of the PISA 2012 study, which consisted of 4,686 students (mean age: 15.3 years, 48.9% female) from 197 randomly sampled schools. Models of item response theory were specified to investigate the comparability of the PPA and CBA. Multilevel structural equation modeling with schools as clusters was subsequently employed to estimate the BFLPE and the moderation effects.
The results of the present study demonstrated that the two math assessments were highly correlated and related to a general factor of math literacy. Furthermore, the BFLPE existed for both assessments with a slightly higher effect size for the CBA. Math anxiety and self-efficacy moderated the BFLPE, whereas ICT availability and use did not.
Our results support the convergent validity of the two math assessments, gauging math literacy. Moreover, they reveal the robustness of the BFLPE across the assessments and point out the similarity of social comparisons that are present in CBA and PPA situations. In support of previous research, students’ personality traits intensify the BFLPE. However, ICT-related constructs cannot be regarded as further sources of social comparisons in CBAs. The present study extends existing research on the BFLPE by showing its existence in 21st century assessments. It also addresses issues of comparability of PPAs and CBAs with motivational factors.
Research Interests:
Studies on teachers' acceptance and use of information and communication technology (ICT) have revealed perceived usefulness to be a crucial determinant for integrating ICT in classrooms. In consequence, the present study focuses on... more
Studies on teachers' acceptance and use of information and communication technology (ICT) have revealed perceived usefulness to be a crucial determinant for integrating ICT in classrooms. In consequence, the present study focuses on teachers' perceived usefulness of ICT for teaching and learning and is aimed at describing its structure and relations to self-efficacy, ICT use, and teachers' age. By means of Bayesian analysis, we specified confirmatory factor-analytic and structural equation models to a largescale data set of N = 1190 Norwegian teachers. Our results supported the hypothesized four-factor structure of teachers' perceived usefulness of ICT, signifying different facets of ICT-related teaching goals in classrooms. In support of existing research, we found positive relations to self-efficacy and ICT use, but a negative relation to teachers' age. Our study provides evidence on a multidimensional conceptualization of teachers' perceived usefulness of ICT for teaching and learning, and verifies the relations to teacher-related characteristics.
Research Interests:
The role and use of information and communication technology (ICT) in education has changed profoundly over the last decade. As a consequence the concept Digital divide has become a core issue on the educational- research and policy... more
The role and use of information and communication technology (ICT) in education has changed profoundly over the last decade. As a consequence the concept Digital divide has become a core issue on the educational- research and policy agenda. Digital divide has traditionally been defined as the gap between those who have and do not have access to computers and the Internet (Selwyn, 2004). However, research has revealed that the inequality addressed by the digital divide has shifted from physical access towards ICT literacy and usage (van Dijk, 2006). Consequently, we need good tools to assess students’ ICT literacy. Several national and international research projects focusing on assessing students’ ICT literacy have been initiated. However, to our knowledge, no synthesis of the research on these assessments has been published.
This study aims to address this gap by systematically reviewing the literature on the assessment of ICT literacy (for students in the age-group 6-18). The study has three main objectives; (1) identify the variety of ICT literacy test instruments, (2) present a synthesis of the available empirical evidence of to what extent the tests measure ICT literacy according to the DigComp framework (Ferrari, 2013) , (3) evaluate the validity and reliability of the tests and (4) on the basis of the knowledge gained, provide suggestions for future research.
A total of 36 studies were finally included in the review. For each article, we thoroughly analyzed the purpose of the study, the underlying framework and conceptualization of it, and a comparison to the DigComp framework was made. This framework identifies five competence areas; Information, Communication, Content creation, Safety and Problem solving (each of these areas are further divided into specific competences). In addition, we considered the sample characteristics (e.g., sample size, age, gender, school level, urban/rural schools, socio-economic background), the results of the study (e.g., level of digital competence, correlations between background variables, self-reported attitudes or self-efficacy and ICT literacy score) and the reported psychometric properties (e.g., reliability, validity and item descriptions). Our results indicate that most of the existing tests only measure a few facets of ICT literacy. Moreover, an overwhelming amount of the tests assess students’ technical skills and their digital information- search and retrieval skills. Only a scarce amount of the tests measured aspects of ICT literacy such as digital communication, collaboration and problem solving skills. Furthermore, there is a lack of an adequate norm for reporting ICT literacy instruments, especially criteria for reporting validity and reliability of the tests are missing. It also seems that most tests are knowledge based, but there are some examples of testing students’ actual use and performance with ICT. In sum, our findings point to the need for instruments measuring several digital skills (e.g., digital communication, collaboration, content development and netiquette), and give directions for the reporting of research on ICT literacy tests. We believe an improvement of ICT competence measurement tools can be valuable by providing a basis for new strategies in decreasing the digital divide between students.
This study aims to address this gap by systematically reviewing the literature on the assessment of ICT literacy (for students in the age-group 6-18). The study has three main objectives; (1) identify the variety of ICT literacy test instruments, (2) present a synthesis of the available empirical evidence of to what extent the tests measure ICT literacy according to the DigComp framework (Ferrari, 2013) , (3) evaluate the validity and reliability of the tests and (4) on the basis of the knowledge gained, provide suggestions for future research.
A total of 36 studies were finally included in the review. For each article, we thoroughly analyzed the purpose of the study, the underlying framework and conceptualization of it, and a comparison to the DigComp framework was made. This framework identifies five competence areas; Information, Communication, Content creation, Safety and Problem solving (each of these areas are further divided into specific competences). In addition, we considered the sample characteristics (e.g., sample size, age, gender, school level, urban/rural schools, socio-economic background), the results of the study (e.g., level of digital competence, correlations between background variables, self-reported attitudes or self-efficacy and ICT literacy score) and the reported psychometric properties (e.g., reliability, validity and item descriptions). Our results indicate that most of the existing tests only measure a few facets of ICT literacy. Moreover, an overwhelming amount of the tests assess students’ technical skills and their digital information- search and retrieval skills. Only a scarce amount of the tests measured aspects of ICT literacy such as digital communication, collaboration and problem solving skills. Furthermore, there is a lack of an adequate norm for reporting ICT literacy instruments, especially criteria for reporting validity and reliability of the tests are missing. It also seems that most tests are knowledge based, but there are some examples of testing students’ actual use and performance with ICT. In sum, our findings point to the need for instruments measuring several digital skills (e.g., digital communication, collaboration, content development and netiquette), and give directions for the reporting of research on ICT literacy tests. We believe an improvement of ICT competence measurement tools can be valuable by providing a basis for new strategies in decreasing the digital divide between students.
Research Interests:
The present meta-analysis investigates the gender differences and the effect of SES on students’ ICT literacy (i.e., performance based assessments). To our knowledge, a synthesis of this kind is still lacking in the existing body of... more
The present meta-analysis investigates the gender differences and the effect of SES on students’ ICT literacy (i.e., performance based assessments). To our knowledge, a synthesis of this kind is still lacking in the existing body of research, and could provide more detailed insights into relevant issues related to the digital divide, that otherwise would not be readily available or obvious from individual studies (Fan & Chen, 2001). In particular, the study addresses the following research questions: RQ1. Are there gender differences in students’ ICT literacy achievement reported in previous empirical studies? RQ2. Are there differences based on students’ SES on their ICT literacy achievement? RQ3. What are the study features (mode of test, region, age group) that may explain the findings?