You hand a webcam and a projector over it, run image detection, link by physical adjacency.

I was adjacent to a BigTech project working on a variant of this about 15 years ago - had the projector and camera both embedded in a smart lightbulb. Unfortunately never saw the light of day