The bottom line is that if your site is slow it would be better if it was faster but the speed issue is only one of many ranking factors. All things being equal (which they never are) if 2 sites have the same content links etc. and one was slower than the other then the other then the slower site may rank lower.