We investigate the structure of relations in large language models, and compress linear relation decoding operators with tensor networks