Every OxRML paper, benchmark, and dataset. Search by title, author, venue, or theme — click through and you're on arXiv or OpenReview, not a request form.
A benchmark that tells real navigation apart from stochastic search when agents work over document collections.
Ł Borchmann, J Van Landeghem, M Turski, S Padarha, RO Kearns, A Mahdi, et al.
LLM self-explanations are usually dismissed as unreliable. Measured the right way, they predict model behavior.
H Mayne, JS Kang, D Gould, K Ramchandran, A Mahdi, NY Siegel
A benchmark for whether web agents can be socially engineered into abandoning the user's task. Today's agents fall for it.
K Korgul, Y Yang, A Drohomirecki, P Błaszczyk, W Howard, L Aichberger, C Russell, P H S Torr, A Mahdi, A Bibi
A preregistered randomized study in Nature Medicine on how reliably LLMs serve as medical assistants for the general public.
AM Bean, RE Payne, G Parsons, HR Kirk, J Ciro, R Mosquera-Gómez, S Hincapié, AS Ekanayaka, L Tarassenko, L Rocher, A Mahdi
A construct-validity audit of widely-used LLM benchmarks: what they claim to measure versus what they capture.
AM Bean, RO Kearns, A Romanou, FS Hafner, H Mayne, J Batzner, et al.
How LLM judges degrade across languages, modalities, and domains, and where the failure modes sit.
S Padarha, E Semenova, B Vidgen, A Mahdi, S A Hale
Direct Preference Optimization reduces toxicity. We trace where it acts, neuron by neuron.
Y Yang, F Sondej, H Mayne, A Lee, A Mahdi
Ask an LLM "what would change your answer?" and it looks like introspection. It is often confabulation.
H Mayne, RO Kearns, Y Yang, AM Bean, E Delaney, C Russell, A Mahdi
A survey of multimodal ML in clinical practice, from data-fusion strategies through to deployment.
F Krones, U Marikkar, G Parsons, A Szmul, A Mahdi
A benchmark that obfuscates orthography to strip memorised knowledge out of reasoning problems, showing how much "reasoning" was recall.
J Khouja, K Korgul, S Hellsten, L Yang, V Neacsu, H Mayne, RO Kearns, A Bean, A Mahdi