Biography
I am Head of Propositions Research in the English Research Group of Cambridge University Press & Assessment. Before joining Cambridge in 2015, I had worked as a Research and Teaching Assistant for the Oral English Certification Test at Iowa State University and as a summer research intern at Educational Testing Service (ETS), USA. I received my Ph.D. in Applied Linguistics and Technology from Iowa State University, where I studied language assessment, statistics, and quantitative psychology. I also hold an M.A. in English from the University of Toledo, with a focus on computer-assisted language learning. I currently serve as the Co-Chair for the International Language Testing Association’s Automated Language Assessment SIG. I love playing basketball in my leisure time and am the Treasurer of the Cambourne Raptors Basketball Club.
Research
My current research focuses on the development and validation of technology-enhanced language assessments such as Linguaskill, an AI-powered online English proficiency test. My research interests include second language assessment, automated scoring and feedback, computer-assisted language learning, validity theory, and second language acquisition. Below are some of my recent presentations at academic conferences in Applied Linguistics.
Jones, E., Breakspear, T. & Xu, J. (2024, June). Evaluating score accuracy for an automated scoring system in a high-stakes writing test. Paper presented at the 45th Language Testing Research Colloquium (LTRC), Innsbruck, Austria.
Karatay, Y. & Xu, J. (2024, June). Exploring the potential of conversational AI for assessing second language oral proficiency. Paper presented at the 45th Language Testing Research Colloquium (LTRC), Innsbruck, Austria.
Xu, J. (2023, June). Automated scoring of learner speech: Current practices and issues. Paper presented at the 44th Language Testing Research Colloquium (LTRC), New York.
Xu, J. (2022, June). Some issues in automated scoring of language performance tests: Methodologies, practices, and ethics. Keynote speech for the BAAL TEASIG 2022 conference, London, UK.
Xu, J., Jones, E., Laxton, V., & Galaczi, E. (2022, March). Assessing L2 English speaking using automated scoring technology: Examining automarker reliability. Paper presented at the 43rd Language Testing Research Colloquium (LTRC), Tokyo, Japan.
Xu, J., Jones, E., Laxton, V., & Galaczi, E. (2021, November). Investigating automarker reliability in the assessment of L2 English speaking. Paper presented at the Language Testing Forum (LTF) 2021.
Xu., J. (2021, August). Exploring the order of acquisition of lexical collocations among Chinese learners of English. Paper presented at the Association of Applied Linguistics (AILA) 2021 Virtual Conference.
Xu, J., & Pinnington, A. (2021, June). Assessing mediation skills using computer-based speaking tasks. Paper presented at the European Association for Language Testing and Assessment (EALTA) 2021 Virtual Conference.
Xu, J., & Pinnington, A. (2021, April). Integrating mediation skills into a computer-based speaking test. Paper presented at the Association of Language Testers in Europe (ALTE) International Digital Symposium.
Publications
Yu, G. & Xu, J. (Eds.). (2024). Language test validation in a digital age. Cambridge University Press.
Gao, S., Gales, M., & Xu, J. (2024). Detecting aberrant responses in automated L2 spoken English assessment. In C. Chapelle, G. H. Beckett, & J. Ranalli (Eds.), Exploring artificial intelligence in applied linguistics (pp. 96-117). Iowa State University Digital Press. https://doi.org/10.31274/isudp.2024.154.07
Xu, J., Jones, E., Laxton, V., & Galaczi, E. (2021). Assessing L2 English speaking using automated scoring technology: examining automarker reliability. Assessment in Education: Principles, Policy & Practice, 28(4), 411-436. https://doi.org/10.1080/0969594X.2021.1979467
Khabbazbashi, N., Xu, J., & Galaczi, E. (2021). Opening the black box: Exploring automated speaking assessment. In Lanteigne, B., Coombe, C. & Brown, J. D. (Eds), Challenges in language testing around the world (pp. 333-343). Springer. https://doi.org/10.1007/978-981-33-4232-3_25
Xu, J. (2018). Measuring ‘Spoken Collocational Competence’ in communicative speaking assessment. Language Assessment Quarterly, 15(3), 255-272. https://doi.org/10.1080/15434303.2018.1482900
Xu, J. (2015). Predicting ESL learners’ oral proficiency by measuring the collocations in their spontaneous speech [Doctoral dissertation, Iowa State University]. Iowa State University Digital Repository. https://doi.org/10.31274/etd-180810-4474
Xu, J. (2010). Using multimedia vocabulary annotations in L2 reading and listening activities. CALICO Journal, 27(2), 311-327. https://www.jstor.org/stable/calicojournal.27.2.311
Chapelle, C. A., Chung, Y.-R., Hegelheimer, V., Pendar, N., & Xu, J. (2010). Towards a computer-delivered test of productive grammatical ability. Language Testing, 27(4), 443-469. https://doi.org/10.1177/0265532210367633
Xu, J. & Knill, K. (forthcoming). Computer scoring of spoken responses. In Chapelle, C. A. Encyclopedia of Applied Linguistics (2nd Edition). Wiley-Blackwell.
Xu, J. (forthcoming). Comparing two independent groups. In Chapelle, C. A. Encyclopedia of Applied Linguistics (2nd Edition). Wiley-Blackwell.
Xu, J., Brenchley, M., Jones, E., Pinnington, A., Benjamin, T., Knill, K., Seal-Coon, G., Robinson, M., & Geranpayeh, A. (2020). Linguaskill: Building a validity argument for the speaking test. Cambridge Assessment English. https://www.cambridgeenglish.org/Images/589637-linguaskill-building-a-validity-argument-for-the-speaking-test.pdf
Xu, J. (2015). Annotating abstract vocabulary using multimedia. In V. Turel (Ed.), Intelligent design of interactive multimedia listening software (pp. 27-46). IGI Global. https://doi.org/10.4018/978-1-4666-8499-7.ch002
Xu, J. (2011). Measurement, evaluation, and assessment (contributor). In J. Collins & N. O'Brien (Eds.), Greenwood Dictionary of Education (2nd edition). ABC-CLIO. http://publisher.abc-clio.com/9780313379314
Chapelle, C. A., Chung, Y.-R., & Xu, J. (Eds.). (2008). Towards adaptive CALL: Natural language processing for diagnostic language assessment. Iowa State University. https://apling.engl.iastate.edu/wp-content/uploads/sites/221/2015/05/5thTSLL2007_proceedings.pdf
Mislevy, R., Chapelle, C. A., Chung, Y.-R., & Xu, J. (2008). Options for adaptivity in computer-assisted language learning and assessment. In C. A. Chapelle, Y.-R. Chung, & J. Xu (Eds.), Towards adaptive CALL: Natural language processing for diagnostic language assessment (pp. 9-24). Iowa State University. https://apling.engl.iastate.edu/wp-content/uploads/sites/221/2015/05/5thTSLL2007_proceedings.pdf
Teaching and Supervisions
- Guest lecturer, MSt in English Language Assessment, University of Cambridge
- Guest lecturer, ALTE summer language testing course on ‘Assessing writing in the digital age’ (with Dr Sathena Chan)
- Guest lecturer, ALTE summer language testing course on ‘Technology in language test production and validation’ (invited by Professor Stephen Bax)
