Interesting. Seems mostly about right @ben Like the thinking!
I’d argue that UI/UX layer is fairly easy to change, but the evaluation loop isn’t like traditional user feedback, since the integration of the user ideas is not at the UI/UX layer, but affects all the blocks.
How about something like this, where the X and Y axes are really about how fast you can improve AI.
I reframed this chart around the evaluation loop because every layer, from prompts to models, depends on how feedback is gathered, interpreted, and applied.
It’s not just about iteration speed or system depth anymore. Teams have to think about how well each layer learns from its own outcomes and feeds that learning back into the next cycle. This can be a bit maddening based on our experience.
Wondering if there’s a way to summarize each quadrant?
- Prompts
- Experiences
- Context
- Architexture