G4E
How a computer vision model processes a head CT

How a computer vision model processes a head CT

When someone arrives with signs of a stroke, a CT scan of the head is usually one of the first images taken, partly to check for bleeding in the brain. To a trained reader that scan carries clinical meaning. A computer vision model receives numbers. This page follows the path from stored values to displayed image to model output, using a synthetic image you can zoom into, change, and test.

No math required. The image and the scoring system here are both invented for teaching, and no real patient is involved.

What you will be able to explain

  • How a displayed image becomes numerical input for a computer vision model.
  • How classification, detection, segmentation, and response maps differ.
  • Why a model score, a probability, and a clinical diagnosis have different meanings.
  • Which evidence and monitoring questions belong in a real clinical AI review.

Choose the depth you need

Essentials, about 12 minutes. Follow the five links below, then complete the quick check.

Full walkthrough, about 20 minutes. Work through every section and try each control.

What a person sees

A trained reader looks at this and sees anatomy: skull, brain, the fluid-filled spaces in the middle, and possibly something that stands out from its surroundings. Meaning arrives all at once.

Synthetic teaching image · not a real CT scan

Drawn by code from a fixed random seed. Every learner sees exactly the same image.

Two different acts of seeing

A person sees a brain, and inside it maybe a bleed. Those are human concepts, built from years of training and from knowing what a body is. A reader also knows the convention: the patient's right side appears on the left of the image, as if you stood at the patient's feet looking toward their head.

A model receives numerical inputs. During training, it can learn internal patterns associated with labels such as "brain" or "hemorrhage." Those learned associations differ from human clinical understanding and can fail when a new image differs from the training data.

On this page, the input is a rectangle of numbers describing the brightness of each tiny square.

Takeaway. The displayed picture is rendered from a numerical array. Training gives a model weights that respond to patterns in arrays like this one.
How this differs from a real scan
  • A head CT is a stack of thin slices, from the base of the skull to the top of the head. Readers scroll through all of them, often in more than one display window. This page shows one slice.
  • Stroke imaging often adds CT angiography, which uses contrast dye to show the arteries. Some of the best-known stroke AI tools analyze those images for a blocked large artery and alert a specialist.
  • Most strokes come from a blocked artery. In the first hours, that kind of stroke can look normal or nearly normal on a plain CT. This page draws a bleed because blood shows up as a bright spot you can find at the pixel level.
  • This page uses one simplified synthetic slice so that the pixel-level journey stays visible. Treat it as a diagram.

Zoom in far enough and the picture disappears

A CT scanner stores a number for every tiny square that converts to a density measure called the Hounsfield unit (HU). A display window picks which range of those numbers fills the scale from black to white. Zoom in, or click the image, and a teal box marks the area being magnified. At full magnification each square of brightness is a single number. Whichever window you choose here, the simulation always receives the brain window.

Click or tap the image to move the box. With the box focused, use the arrow keys; hold Shift for larger steps.

Whole image · 256 × 256

Three steps: whole image, a 32 by 32 patch, then an 8 by 8 patch with the numbers shown.

Display window

0 to 80 HU spread from black to white. Brain, fluid, and blood separate clearly. Bone is pure white.

Magnified region

selected pixel …

Stored value, displayed brightness, and model input

Typical Hounsfield unit (HU) values: air sits near -1,000, water at 0, brain between about 20 and 45, a fresh brain bleed around 50 to 65, and bone in the hundreds or more. No screen can show that whole range as useful shades of gray at once.

So the reader chooses a window. A brain window spreads 0 to 80 HU from black to white; anything denser shows as pure white. A bone window spreads a far wider range, which reveals the skull and flattens the brain. Switch between them above: the stored numbers stay the same while the picture changes.

This page simplifies two things:

  • The simulation receives one brain-windowed image with 256 shades. Real pipelines choose their own windows and value ranges.
  • Model pipelines commonly preprocess images by cropping, resizing, rescaling, or filtering them. The order and exact steps vary by system.

From picture to array

Here is the patch you selected, written out as numbers. These numbers always come from the brain window, the version the simulation receives, whatever window you chose above. In this simulation, a grid like this repeated across the whole image is the complete input. Real systems may also use every slice of the scan, prior scans, or metadata.

The stored values, converted to Hounsfield units.

The whole journey, in four steps

Hounsfield unitsOne density number per tiny square
Brain window0 to 80 HU mapped onto 0 to 255
Rescaled and standardized arrayResized to 64 by 64, then put on a common scale
This visual simulationReceives one numerical array

Resizing in this simulation

Full image
256 × 256

Model input
64 × 64 = 4,096 numbers

The simulation on this page shrinks the image to 64 by 64 before analyzing it, which is why the version on the right is the one that gets scored. Real systems use larger inputs, and choosing that size is a design trade-off between fine detail and computation.

Takeaway. This chain begins with numbers. Learned weights or fixed rules determine which numerical patterns affect the output.

How this teaching simulation builds a score

This page applies fixed comparisons written by its author. The sequence offers simplified intuition for one convolution-style workflow: local differences become edges, focal responses, coarse regions, and finally a score. Before any of that, it strips away the skull. Bone stores far higher values than brain or blood, so this simulation treats the brightest pixels as bone and keeps only the brain. On screen, a brain window shows everything above 80 HU as pure white, so very dense blood can look as white as bone, and a bleed pressed against the skull can blend into it. Some published and FDA-authorized head CT pipelines include a skull-stripping step, and a real pipeline needs checking for bleeds lost at the brain's edge. Step through the teaching simulation below.

Step 0 of 5 · nothing computed yet

Simulation step 1

Pixel differences

Is this number bigger or smaller than its neighbor? Nothing more.

Simulation step 2

Edges and textures

Differences that line up become boundaries and grain.

Simulation step 3

Shapes and densities

Compact areas that stand out from what surrounds them.

Simulation step 4

Coarse regions of response

The strongest response in each region is recorded for this display.

Simulation step 5 · a single number comes out

The simulation combines four measured features: the strongest focal response, how concentrated that response is, how sharp it is, and how much grain is present. Fixed rule-based calculations turn those measurements into one output. A trained model learns its weights from examples, which is the subject of the next lesson.

Pixel differences
Edges and simple textures
Shapes, densities and focal differences
Strongest focal response, concentration, sharpness and grain
Suspicion score

Classification, detection, segmentation

Classification, detection, and segmentation answer different technical questions. The fourth tab shows the internal filter response from this teaching simulation. A predictive localization map, an internal response map, and a post hoc attribution map each represent a different quantity.

Simulated output · synthetic image

Classification

Each output has a different meaning. Clinical intended use and diagnosis sit at a separate level.
ConceptMeaningWhat comes out
Image classificationAssigns categories or scores to a defined unit, such as a slice or a whole scanOne or more labels or scores
Object detectionIdentifies candidate locations of possible findingsZero or more boxes, points, or markers, often with per-candidate scores
SegmentationEstimates the boundaries of a findingPer-pixel scores that are commonly converted into an outline or mask
Predictive localization mapProduces location-specific scores as a trained model outputA map of location-specific or per-pixel scores
Internal response mapShows a defined internal quantity, such as this simulation's filter responseA shaded overlay tied to a specific calculation
Attribution or saliency mapEstimates which parts of an input influenced a particular outputAn explanatory overlay that requires method-specific validation
Keep the levels straight. The technical task describes what the model computes. The intended clinical use describes how people may use that output, such as triage, worklist ordering, or diagnostic support. A diagnosis is a clinical conclusion reached through the appropriate evaluation.

A score, a probability, and a diagnosis have different meanings

Everything so far produces one number. The model's documentation and validation determine what that number means.

Dial showing the simulated suspicion score

Simulated suspicion score

…

…

0.50

A threshold turns a continuous score into a yes or no. Move it and watch the same score cross the flagging threshold. In the FDA-authorized triage device cited below, the manufacturer set and tested a fixed threshold.

What this number is

  • The output of this simulation on this synthetic image, produced by fixed filters written for teaching.
  • A relative measure. Higher means the image contains more of what these filters respond to.
  • A quantity that a threshold can convert into an action, such as moving a scan up the reading list or alerting a specialist or the stroke team.

Limits of this number

  • A bleed can be present after a low score and absent after a high score.
  • A score of 0.72 remains a unitless score. It represents a 72% estimated probability only when the model has been designed, evaluated, and shown to support that interpretation in the intended population.
  • The radiologist and the surrounding clinical workflow determine what happens next.
Four terms that make threshold trade-offs precise
  • Sensitivity is the share of cases with the condition that the system flags.
  • Specificity is the share of cases without the condition that the system leaves unflagged.
  • Positive predictive value is the share of flagged cases that have the condition.
  • Negative predictive value is the share of unflagged cases that do not have the condition.

The threshold changes sensitivity and specificity. Predictive values also depend on how common the condition is in the population being scanned. Every metric needs a defined population, reference standard, threshold, and measure of uncertainty.

Watch one threshold affect a group

This teaching cohort contains 100 invented scans: 20 where a bleed is present and 80 where it is absent. The scores demonstrate the math and represent no clinical system, real rate of bleeding, or expected performance.

Results in the fixed teaching cohort at a score threshold of 0.50
Reference standardFlaggedBelow thresholdTotal
Condition present… true positives… false negatives20
Condition absent… false positives… true negatives80

Calibration asks a different question. Among many scans assigned a predicted probability of 0.70, about 70% should turn out to have the condition if the probabilities are well calibrated in that population. This simulation produces unitless scores, so its 0.70 value carries no probability interpretation.

Image conditions change what the model receives

The first five controls change the image conditions while the drawn finding stays fixed. The final control changes how clearly that finding appears against its surroundings. Some changes barely move the score. Others move it a lot. That gap is one of the most important things to understand about computer vision.

Teaching simulation · not a validated model

Score now

…

Change from baseline

…

Adjustments

0

A schematic global shift, similar to moving the window level. Real scanner and protocol differences affect images in more complex ways.

1.00×
0

A schematic grain control. Real CT noise depends on radiation dose, patient size, reconstruction settings, and the scanner.

0°

A schematic proxy. A tilted head on a real scanner changes which structures each slice cuts through.

0%

Stands in for a streak artifact or an area the scan did not capture. The band covers from the right edge.

100%

Changes how dense the drawn bleed is compared with the brain around it. This control is included for comparison with the image-condition changes above.

Why this matters outside a teaching page

A model is fitted to the images it was shown. When the images it meets later differ, performance can differ too, even when the anatomy is identical. Common sources of that difference include:

  • Different scanner makes and models
  • Image quality and dose
  • Head position and tilt
  • Preprocessing choices
  • Motion, metal, and other artifacts
  • Missing slices or incomplete coverage
  • Differences between hospitals and populations
  • Shortcuts tied to labels, markers, borders, scanners, sites, or processing

Watching this over time, deciding when a difference matters, and knowing what to do about it are their own subjects. Later lessons cover monitoring and drift.

The seven things worth carrying away

  • Triage, diagnosis, and treatment serve different purposes. Triage software flags a scan so it is read sooner or sends an alert to a specialist. The radiologist still reads every scan. Treatment decisions draw on that read, the patient's examination, and the wider clinical picture.
  • A flag does not mean a bleed is present. Every threshold trades missed cases against false alarms, and each false alarm costs a team time and attention.
  • An unflagged scan does not rule out a bleed or a stroke. Findings can be missed, by people and by models. About 87% of strokes come from a blocked artery, and those can be hard to see on a plain CT in the first hours. Some tools also skip scans they cannot process, such as incomplete studies or scans with metal clips. A skipped scan gets no flag, so check how the tool reports the scans it did not analyze.
  • A response map needs a precise name and evidence. Saliency, activation, attention, lesion-likelihood, and filter-response maps represent different quantities. A convincing overlay can still give a poor account of model behavior.
  • The score on this page is illustrative. It came from rule-based filters over a drawn image.
  • Evidence must match the intended use. Look for representative data, independent and multisite testing, relevant subgroup results, local workflow evaluation, prospective evaluation when feasible, applicable regulatory review, planned human-device interaction, and ongoing monitoring.
  • Nothing here supports a medical decision. If you think someone is having a stroke, call 911 or your local emergency number right away.

Evidence before use

  • What is the intended use, input, output, user, and place in the workflow?
  • How was the reference standard, the method used to determine the correct answer, established? Who assigned labels, what follow-up was available, and how were uncertain or disputed cases handled?
  • Were training, tuning, and test partitions separate at the patient level or higher? What controls kept information from test cases out of model development, a problem called data leakage?
  • Was the completed model tested on external or otherwise development-independent data spanning representative sites, scanners, protocols, populations, and subgroups relevant to the planned use?
  • Are statistical uncertainty and subgroup results reported alongside overall performance? When outputs are interpreted as probabilities, is calibration reported?
  • How does the human-AI team perform compared with the current clinical workflow?

Controls after launch

  • Who verifies inputs and outputs, who can override the system, and where are disagreements or unexpected results reported?
  • Who owns monitoring, which metrics and subgroups are reviewed, and how often does review occur?
  • How will changes in equipment, software, workflow, or patient population trigger reassessment?
  • What thresholds trigger investigation, temporary pause, revalidation, or retirement, and who has authority to act?

Regulatory note. As of September 29, 2026, the FDA lifecycle source linked below is still the January 2025 draft guidance. FDA labels it "Not for Implementation" and states that it contains nonbinding recommendations.

Keep the reader's own skill sharp

A stroke team that trusts a triage alert still needs radiologists who can spot a bleed on their own, including on the night the software is down. When a tool flags findings every day, people can start to lean on it, and a skill that goes unused can fade. This is called deskilling.

The clearest early signal comes from colonoscopy. In one multicenter observational study at four centers in Poland, 19 experienced endoscopists found precancerous growths (adenomas) in 28.4% of the colonoscopies they did without AI in the three months before AI came into routine use, and in 22.4% in the three months after. A larger single-center study found that detection without AI held steady. Both studies are observational, so the question is still open, and the risk is worth planning for.

No method has yet been proven to prevent AI-related deskilling. Evidence from related settings points to two habits:

  • Practice without the tool on purpose. Use training cases or simulation where readers commit to their own call before they see the AI's, then get feedback. In a randomized trial, residents retained more after repeated testing with feedback than after restudying the same material. In a nonclinical experiment, designs that made people answer first, wait for the AI's advice, or ask for it reduced overreliance on the AI, and people rated the designs that helped most the least favorably. In patient care, follow the approved workflow.
  • Measure detection without the tool over time. Both colonoscopy studies measured detection in procedures done without AI after AI arrived. A team can track the same thing for its own readers, so a decline shows up early.

A vendor shows a score and a heatmap

A vendor says one head CT received a score of 0.78 and the heatmap shows where the bleed is. Which response best applies the ideas from this lesson?

Choose a response to see feedback.

Sources and technical notes