Try 3.6Ghz with just 1.2 V
mine was running (although not all cores since I made a gaming profile for that) at 1.18125V after I read others doing fine with that on 8 cores.
1.36V is definitely too high.
Also try using the middle fan speed of 60% stock fan+settings. It keeps mine at 60°C without GPU running.
My 1700 also does the 3.2 @ 1.06875V (mainboard automated power saver settings)
I tried putting an offset of -0.1000V so the voltage was in the 1.2x range, but the machine wouldn't boot. Also, the fans are all running at 100%. From what I've read, the CPU can go up to 1.4V without issues.
I didn't use any offset (it may well be yours are too low for the minimum speed to start), just the Ryzen Master setting.