Exactly. You afforded to quit because you were in a place where your 9–5 paycheck was covered by investments streams. So the time you took to quit was actually to point you reached your “safety net” which I guess for you it was the 9–5 income.
If others can do it faster, then it makes sense they can move away from a 9–5 job ealier than you did.