How Image Tokens Learn the Language of Radiology
We read the image tokens of our report-drafting model through its own clinical vocabulary and with linear probes. Deeper in the language model, they come to point at the right findings, with no direct supervision on the image tokens.











