As someone who is still hodling the vast majority of own my net worth in bitcoin, I want to do everything I can to make sure that Bitcoin is a world wide success. Artificially restricting the amount of block space we produce is just as insane as Starbucks artificially restricting the amount of coffee they produce.
The difference is that Starbucks is selling the coffee. The blockchain would be offering tx capacity (or storage capacity) for free.
Right now even with what you would consider the "constricted" 1mb size, 47.000 txs went through in the last 24hrs at fees from 0-20 satoshi/byte. If there was a real congestion this wouldn't be happening.
Now if we go to 4mb, you'll have something like 3.2 mb extra capacity to spam at near zero cost. And since it is at near zero cost it would be spammed for the lolz by malicious entities.
If I were the big banks and bitcoin was my enemy, I'd like bitcoin to have as big blocks as it gets. Then I'd spam the hell out of it to bloat it on purpose (and doing it cheap too!) rendering it unusable for the average PC, making it more centralized in terms of nodes that can afford it and also making it more vulnerable to attacks. It's a good attack vector.
Core devs know what they are doing.