skip to content

Cambridge Language Sciences

Interdisciplinary Research Centre
 

Biography

I am Head of Propositions Research in the English Research Group at Cambridge University Press & Assessment. Before joining Cambridge in 2015, I had worked as a research/teaching assistant for the Oral English Certification Test at Iowa State University, a summer research intern at Educational Testing Service, a graduate teaching assistant at the University of Toledo and an English teacher in China.

I received my Ph.D. in Applied Linguistics and Technology from Iowa State University, where I studied language assessment, statistics and quantitative psychology. I also hold an M.A. in Teaching English as a Second Language from the University of Toledo, with a focus on computer-assisted language learning, and a B.A. in English from Shanghai Jiao Tong University. I currently serve as the Co-Chair for the International Language Testing Association’s Automated Language Assessment SIG and a Subject Matter Lead for the Cambridge University Institute for Automated Language Teaching and Assessment (ALTA)I love playing basketball in my leisure time and am the Treasurer of the Cambourne Raptors Basketball Club.

Research

My current research focuses on the development and validation of technology-enhanced language assessments such as Linguaskill, an AI-powered online English proficiency test. My research interests include second language assessment, automated scoring and feedback, computer-assisted language learning, validity theory, and second language acquisition. Below are some of my recent presentations at academic conferences. My publications can be found on my Google Scholar page. 

Xu, J. (2025, March). Automarking in language assessment: Key considerations for best practice. Plenary speech presented at the European Association for Language Testing and Assessment (EALTA) AI SIG Meeting. (Recording can be found here.) 

Karatay, Y. & Xu, J. (2024, November). Eliciting conversational speech using conversational AI: What do markers think? Paper presented at the 44th Language Testing Forum (LTF), Bedford, UK.

Jones, E., Breakspear, T. & Xu, J. (2024, June). Evaluating score accuracy for an automated scoring system in a high-stakes writing test. Paper presented at the 45th Language Testing Research Colloquium (LTRC), Innsbruck, Austria.

Karatay, Y. & Xu, J. (2024, June). Exploring the potential of conversational AI for assessing second language oral proficiency. Paper presented at the 45th Language Testing Research Colloquium (LTRC), Innsbruck, Austria.

Xu, J. (2023, June). Automated scoring of learner speech: Current practices and issues. Paper presented at the 44th Language Testing Research Colloquium (LTRC), New York.

Xu, J. (2022, June). Some issues in automated scoring of language performance tests: Methodologies, practices, and ethics. Keynote speech given at the BAAL TEASIG 2022 conference, London, UK.

Xu, J., Jones, E., Laxton, V., & Galaczi, E. (2022, March). Assessing L2 English speaking using automated scoring technology: Examining automarker reliability. Paper presented at the 43rd Language Testing Research Colloquium (LTRC), Tokyo, Japan.

Publications

Key publications: 

Karatay, Y., & Xu, J. (in press). Exploring the potential of conversational AI for assessing second language oral proficiency. TESOL Quarterly.

Xu, J. & Knill, K. (in press). Computer scoring of spoken responses. In C. A. Chapelle (Ed.), Encyclopedia of Applied Linguistics (2nd Edition). Wiley.

Xu, J., Lee, H.-W., Karatay, Y., & Karatay, L. (in press). Reflections on Carol A. Chapelle’s contributions to applied linguistics: Perspectives from her students. Language Teaching Research Quarterly.

Yu, G. & Xu, J. (Eds.). (2024). Language test validation in a digital age. Cambridge University Press & Assessment.

Xu, J., Schmidt, E., Galaczi, E., & Somers, A. (2024). Automarking in language assessment: Key considerations for best practice (Cambridge Papers in English Language Education). Cambridge University Press & Assessment. https://doi.org/10.17863/CAM.117098

Xu, J., Jones, E., Laxton, V., & Galaczi, E. (2021). Assessing L2 English speaking using automated scoring technology: examining automarker reliability. Assessment in Education: Principles, Policy & Practice, 28(4), 411-436. https://doi.org/10.1080/0969594X.2021.1979467

Khabbazbashi, N., Xu, J., & Galaczi, E. (2021). Opening the black box: Exploring automated speaking assessment. In Lanteigne, B., Coombe, C. & Brown, J. D. (Eds), Challenges in language testing around the world (pp. 333-343). Springer. https://doi.org/10.1007/978-981-33-4232-3_25

Xu, J. (2018). Measuring ‘Spoken Collocational Competence’ in communicative speaking assessment. Language Assessment Quarterly, 15(3), 255-272. https://doi.org/10.1080/15434303.2018.1482900

Xu, J. (2015). Predicting ESL learners’ oral proficiency by measuring the collocations in their spontaneous speech [Doctoral dissertation, Iowa State University]. Iowa State University Digital Repository. https://doi.org/10.31274/etd-180810-4474

Xu, J. (2010). Using multimedia vocabulary annotations in L2 reading and listening activities. CALICO Journal, 27(2), 311-327. https://www.jstor.org/stable/calicojournal.27.2.311

Chapelle, C. A., Chung, Y.-R., Hegelheimer, V., Pendar, N., & Xu, J. (2010). Towards a computer-delivered test of productive grammatical ability. Language Testing, 27(4), 443-469. https://doi.org/10.1177/0265532210367633

Chapelle, C. A., Chung, Y.-R., & Xu, J. (Eds.). (2008). Towards adaptive CALL: Natural language processing for diagnostic language assessment. Iowa State University. https://apling.engl.iastate.edu/wp-content/uploads/sites/221/2015/05/5thTSLL2007_proceedings.pdf

Other publications: 

Xu, J., Lee, H.-W., Karatay, Y., & Karatay, L. (in press). Reflections on Carol A.Chapelle’s contributions to applied linguistics: Perspectives from her students. Language Teaching Research Quarterlyhttp://dx.doi.org/10.13140/RG.2.2.34735.04000

Gao, S., Gales, M., & Xu, J. (2024). Detecting aberrant responses in automated L2 spoken English assessment. In C. Chapelle, G. H. Beckett, & J. Ranalli (Eds.), Exploring artificial intelligence in applied linguistics (pp. 96-117). Iowa State University Digital Press. https://doi.org/10.31274/isudp.2024.154.07

Xu, J., Brenchley, M., Jones, E., Pinnington, A., Benjamin, T., Knill, K., Seal-Coon, G., Robinson, M., & Geranpayeh, A. (2020). Linguaskill: Building a validity argument for the speaking test. Cambridge Assessment English. https://www.cambridgeenglish.org/Images/589637-linguaskill-building-a-validity-argument-for-the-speaking-test.pdf

Cheung, K., Xu, J., & Lim, G. (2017). Linguaskill Writing trial report. Cambridge Assessment English. https://www.cambridgeenglish.org/Images/466042-linguaskill-writing-trial-report.pdf

Xu, J. & Benjamin, T. (2016). Linguaskill Listening and Reading trial report. Cambridge Assessment English. https://www.cambridgeenglish.org/Images/429191-linguaskill-listening-and-reading-trial-report.pdf

Xu, J. (2015). Annotating abstract vocabulary using multimedia. In V. Turel (Ed.), Intelligent design of interactive multimedia listening software (pp. 27-46). IGI Global. https://doi.org/10.4018/978-1-4666-8499-7.ch002

Xu, J. (2011). Measurement, evaluation, and assessment (contributor). In J. Collins & N. O'Brien (Eds.), Greenwood Dictionary of Education (2nd edition). ABC-CLIO. http://publisher.abc-clio.com/9780313379314

Mislevy, R., Chapelle, C. A., Chung, Y.-R., & Xu, J. (2008). Options for adaptivity in computer-assisted language learning and assessment. In C. A. Chapelle, Y.-R. Chung, & J. Xu (Eds.), Towards adaptive CALL: Natural language processing for diagnostic language assessment (pp. 9-24). Iowa State University. https://apling.engl.iastate.edu/wp-content/uploads/sites/221/2015/05/5thTSLL2007_proceedings.pdf

Teaching and Supervisions

Teaching: 
  • Guest lecturer, MSt in English Language Assessment, University of Cambridge
  • Guest lecturer, ALTE summer language testing course on ‘Assessing writing in the digital age’ (with Dr Sathena Chan)
  • Guest lecturer, ALTE summer language testing course on ‘Technology in language test production and validation’ (invited by Professor Stephen Bax)

Other Professional Activities

  • Reviewer, Language Assessment Quarterly journal (2020-present)
  • Reviewer, Language Testing journal (2020-present)
  • Abstract reviewer, Language Testing Research Colloquium (2023-present)
  • Co-chair, Automated Language Assessment SIG, International Language Testing Association (January 2023-present)
  • Editorial Advisory Board member, Language Assessment Quarterly journal (January 2020-January 2023)
  • Treasurer, BAAL TEASIG (2018-2020)
  • Nomination and membership committee member, UKALTA (January 2019-December 2019)
  • Abstract reviewer, British Association of Applied Linguistics (BAAL) 2019 conference
  • Chapter reviewer, Link, S., & Li, J. (Eds.). (2018). Assessment across online language education. Equinox.
  • Chapter reviewer, Swanson, P., & Li, S. (Eds.). (2015). Engaging language learners through technology integration: Theory, applications, and outcomes. IGI Global.
  • Chapter reviewer, Turel, V. (Ed.). (2015). Intelligent design of interactive multimedia listening software. IGI Global.
  • Abstract reviewer, TESOL 2013 International Convention & English Language Expo, Dallas, Texas
  • Abstract reviewer, the 30th Second Language Research Forum (SLRF), Ames, IA (2011)
  • Organising committee member, the 13th Midwest Association of Language Testers (MwALT) Conference, Ames, IA (2011)
  • Organising committee member, the 5th Technology for Second Language Learning (TSLL) Conference, Ames, IA (2007)
Head of Propositions Research
Cambridge University Press & Assessment
Departments and institutes: 

Contact Details

The Triangle Building, Shaftesbury Road
Cambridge, UK
CB2 8EA
Email address: 

Affiliations

Classifications: 

What we do

Cambridge Language Sciences is an Interdisciplinary Research Centre at the University of Cambridge. Our virtual network connects researchers from five schools across the university as well as other world-leading research institutions. Our aim is to strengthen research collaborations and knowledge transfer across disciplines in order to address large-scale multi-disciplinary research challenges relating to language research.

JOIN OUR NETWORK

JOIN OUR MAILING LIST

CONTACT US