It all takes time and a lot of patience. You are not doing anything wrong.
Make sure you use your targeted keywords as anchor text for your links. Eventually, it'll pay off. It's a slow and painful process but at the end, you'll see the results!