Biography
I am Head of Propositions Research in the English Research Group at Cambridge University Press & Assessment. Before joining Cambridge in 2015, I had worked as a research/teaching assistant for the Oral English Certification Test at Iowa State University, a summer research intern at Educational Testing Service, a graduate teaching assistant at the University of Toledo and an English teacher in China.
I received my Ph.D. in Applied Linguistics and Technology from Iowa State University, where I studied language assessment, statistics and quantitative psychology. I also hold an M.A. in Teaching English as a Second Language from the University of Toledo, with a focus on computer-assisted language learning, and a B.A. in English from Shanghai Jiao Tong University. I currently serve as the Co-Chair for the International Language Testing Association’s Automated Language Assessment SIG and a Subject Matter Lead for the Cambridge University Institute for Automated Language Teaching and Assessment (ALTA). I love playing basketball in my leisure time and am the Treasurer of the Cambourne Raptors Basketball Club.
Research
My current research focuses on the development and validation of technology-enhanced language assessments such as Linguaskill, an AI-powered online English proficiency test. My research interests include second language assessment, automated scoring and feedback, computer-assisted language learning, validity theory, and second language acquisition. Below are some of my recent presentations at academic conferences. My publications can be found on my Google Scholar page.
Karatay, Y., Xu, J., & Karatay, L. (2025, June). Exploring cultural and pragmatic challenges in AI-mediated speaking assessments. Paper to be presented at the 46th Language Testing Research Colloquium (LTRC), Bangkok.
Jones, E., Breakspear, T. & Xu, J. (under review). Comparing score distributions in the evaluation of an automated scoring system. BEA Workshop 2025.
Xu, J. (2025, March). Automarking in language assessment: Key considerations for best practice. Plenary speech presented at the European Association for Language Testing and Assessment (EALTA) AI SIG Meeting. (Recording can be found here.)
Karatay, Y. & Xu, J. (2024, November). Eliciting conversational speech using conversational AI: What do markers think? Paper presented at the 44th Language Testing Forum (LTF), Bedford, UK.
Jones, E., Breakspear, T. & Xu, J. (2024, June). Evaluating score accuracy for an automated scoring system in a high-stakes writing test. Paper presented at the 45th Language Testing Research Colloquium (LTRC), Innsbruck, Austria.
Karatay, Y. & Xu, J. (2024, June). Exploring the potential of conversational AI for assessing second language oral proficiency. Paper presented at the 45th Language Testing Research Colloquium (LTRC), Innsbruck, Austria.
Xu, J. (2023, June). Automated scoring of learner speech: Current practices and issues. Paper presented at the 44th Language Testing Research Colloquium (LTRC), New York.
Xu, J. (2022, June). Some issues in automated scoring of language performance tests: Methodologies, practices, and ethics. Keynote speech given at the BAAL TEASIG 2022 conference, London, UK.
Xu, J., Jones, E., Laxton, V., & Galaczi, E. (2022, March). Assessing L2 English speaking using automated scoring technology: Examining automarker reliability. Paper presented at the 43rd Language Testing Research Colloquium (LTRC), Tokyo, Japan.
Publications
Karatay, Y., & Xu, J. (in press). Exploring the potential of conversational AI for assessing second language oral proficiency. TESOL Quarterly.
Xu, J. & Knill, K. (in press). Computer scoring of spoken responses. In C. A. Chapelle (Ed.), Encyclopedia of Applied Linguistics (2nd Edition). Wiley.
Yu, G. & Xu, J. (Eds.). (2024). Language test validation in a digital age. Cambridge University Press & Assessment. https://isbnsearch.org/isbn/9781108931908
Xu, J., Schmidt, E., Galaczi, E., & Somers, A. (2024). Automarking in language assessment: Key considerations for best practice (Cambridge Papers in English Language Education). Cambridge University Press & Assessment. https://doi.org/10.17863/CAM.117098
Gao, S., Gales, M., & Xu, J. (2024). Detecting aberrant responses in automated L2 spoken English assessment. In C. Chapelle, G. H. Beckett, & J. Ranalli (Eds.), Exploring artificial intelligence in applied linguistics (pp. 96-117). Iowa State University Digital Press. https://doi.org/10.31274/isudp.2024.154.07
Xu, J., Jones, E., Laxton, V., & Galaczi, E. (2021). Assessing L2 English speaking using automated scoring technology: examining automarker reliability. Assessment in Education: Principles, Policy & Practice, 28(4), 411-436. https://doi.org/10.1080/0969594X.2021.1979467
Khabbazbashi, N., Xu, J., & Galaczi, E. (2021). Opening the black box: Exploring automated speaking assessment. In Lanteigne, B., Coombe, C. & Brown, J. D. (Eds), Challenges in language testing around the world (pp. 333-343). Springer. https://doi.org/10.1007/978-981-33-4232-3_25
Xu, J. (2018). Measuring ‘Spoken Collocational Competence’ in communicative speaking assessment. Language Assessment Quarterly, 15(3), 255-272. https://doi.org/10.1080/15434303.2018.1482900
Xu, J. (2015). Predicting ESL learners’ oral proficiency by measuring the collocations in their spontaneous speech [Doctoral dissertation, Iowa State University]. Iowa State University Digital Repository. https://doi.org/10.31274/etd-180810-4474
Xu, J. (2010). Using multimedia vocabulary annotations in L2 reading and listening activities. CALICO Journal, 27(2), 311-327. https://www.jstor.org/stable/calicojournal.27.2.311
Chapelle, C. A., Chung, Y.-R., Hegelheimer, V., Pendar, N., & Xu, J. (2010). Towards a computer-delivered test of productive grammatical ability. Language Testing, 27(4), 443-469. https://doi.org/10.1177/0265532210367633
Chapelle, C. A., Chung, Y.-R., & Xu, J. (Eds.). (2008). Towards adaptive CALL: Natural language processing for diagnostic language assessment. Iowa State University. https://apling.engl.iastate.edu/wp-content/uploads/sites/221/2015/05/5thTSLL2007_proceedings.pdf
Xu, J., Lee, H.-W., Karatay, Y., & Karatay, L. (in press). Reflections on Carol A.Chapelle’s contributions to applied linguistics: Perspectives from her students. Language Teaching Research Quarterly. http://dx.doi.org/10.13140/RG.2.2.34735.04000
Xu, J., Brenchley, M., Jones, E., Pinnington, A., Benjamin, T., Knill, K., Seal-Coon, G., Robinson, M., & Geranpayeh, A. (2020). Linguaskill: Building a validity argument for the speaking test. Cambridge Assessment English. https://www.cambridgeenglish.org/Images/589637-linguaskill-building-a-validity-argument-for-the-speaking-test.pdf
Cheung, K., Xu, J., & Lim, G. (2017). Linguaskill Writing trial report. Cambridge Assessment English. https://www.cambridgeenglish.org/Images/466042-linguaskill-writing-trial-report.pdf
Xu, J. & Benjamin, T. (2016). Linguaskill Listening and Reading trial report. Cambridge Assessment English. https://www.cambridgeenglish.org/Images/429191-linguaskill-listening-and-reading-trial-report.pdf
Xu, J. (2015). Annotating abstract vocabulary using multimedia. In V. Turel (Ed.), Intelligent design of interactive multimedia listening software (pp. 27-46). IGI Global. https://doi.org/10.4018/978-1-4666-8499-7.ch002
Xu, J. (2011). Measurement, evaluation, and assessment (contributor). In J. Collins & N. O'Brien (Eds.), Greenwood Dictionary of Education (2nd edition). ABC-CLIO. http://publisher.abc-clio.com/9780313379314
Mislevy, R., Chapelle, C. A., Chung, Y.-R., & Xu, J. (2008). Options for adaptivity in computer-assisted language learning and assessment. In C. A. Chapelle, Y.-R. Chung, & J. Xu (Eds.), Towards adaptive CALL: Natural language processing for diagnostic language assessment (pp. 9-24). Iowa State University. https://apling.engl.iastate.edu/wp-content/uploads/sites/221/2015/05/5thTSLL2007_proceedings.pdf
Teaching and Supervisions
- Guest lecturer, MSt in English Language Assessment, University of Cambridge
- Guest lecturer, ALTE summer language testing course on ‘Assessing writing in the digital age’ (with Dr Sathena Chan)
- Guest lecturer, ALTE summer language testing course on ‘Technology in language test production and validation’ (invited by Professor Stephen Bax)
Other Professional Activities
- Reviewer, Language Assessment Quarterly journal (2020-present)
- Reviewer, Language Testing journal (2020-present)
- Abstract reviewer, Language Testing Research Colloquium (2023-present)
- Co-chair, Automated Language Assessment SIG, International Language Testing Association (January 2023-present)
- Editorial Advisory Board member, Language Assessment Quarterly journal (January 2020-January 2023)
- Treasurer, BAAL TEASIG (2018-2020)
- Nomination and membership committee member, UKALTA (January 2019-December 2019)
- Abstract reviewer, British Association of Applied Linguistics (BAAL) 2019 conference
- Chapter reviewer, Link, S., & Li, J. (Eds.). (2018). Assessment across online language education. Equinox.
- Chapter reviewer, Swanson, P., & Li, S. (Eds.). (2015). Engaging language learners through technology integration: Theory, applications, and outcomes. IGI Global.
- Chapter reviewer, Turel, V. (Ed.). (2015). Intelligent design of interactive multimedia listening software. IGI Global.
- Abstract reviewer, TESOL 2013 International Convention & English Language Expo, Dallas, Texas
- Abstract reviewer, the 30th Second Language Research Forum (SLRF), Ames, IA (2011)
- Organising committee member, the 13th Midwest Association of Language Testers (MwALT) Conference, Ames, IA (2011)
- Organising committee member, the 5th Technology for Second Language Learning (TSLL) Conference, Ames, IA (2007)
