1 Comment
User's avatar
Jaime Schwarz's avatar

It's a giant mystery though. As opposed to the input/output of algorithms, we can see the work being done to get from the start of a path to the end of a path. Neural networks, like the brain, are a giant mystery. I think I was most enlightened to the dept of this by two things.

One when dall-e first hit the scene with LOAB, the face of a mysteriously scary woman who existed in the dark spaces of the network where no dots or lines existed. The second was the study anthropic did on focusing their neural network on the golden gate bridge and what that did to the perspective of the LLM. Both painted very different lights on just how much opacity comes with this kind of tool.

Expand full comment