Exactly, with the additional point that we have no clue about which pattern is better from the start. Also, varying from one model to another, the best pattern may change.

This is IMO a perfect problem for designing a ML solution.