My shot recovery time is currently 3 minutes.
Not enough info.
Is it a single (1oz), double (2oz) or triple (3oz)?
Do you pre-flush or draw from the boiler in any other fashion?
For example, is your "warming up my shot glass" part of this routine? On a small SB machine, that IS a big deal. If you must warm cups, I suggest using other means, such as your kitchen faucet, a kettle, microwave or the top surface of the Silvia (weak as that is). Or run boiler water into your cup, then wait for recovery, then pull your shot.
For what its worth I can get up to 220F very quickly (in seconds) when I flip the steam switch..
Sure you can, but not without overshoot; that's why we fork over the $$ for PID. To appreciate the magnitude of the overshoot, try this, but turn off the steam switch at 220F and watch how far it rises before peaking. On the plus side, this suggests your element is good and not scaled.
Simply warming up my shot glass with 1oz of water results in a 1 minute recovery.
This would be more meaningful if we knew the size of the excursion, but it sounds in the ball park to me. Strictly from memory, I had a 2-minute recovery for a double (2oz), which I ran without any sort of pre-flush, which would defeat the whole purpose of the PID. With a reasonable set point and a fully warmed group (including PF), you are good to go as soon as recovery is indicated.