How do you use teleport in Pokemon Silver ?

Ok , so I went to that place in Goldenrod where you play the Voltorb block thingy , and I got 200 pts so I got an Abra . This Abra had to move teleport so I wanted to use it , and it said ' Can't use that here " so I waited till I defeated the 4th gym , and still . Then it evolved into kadabra , and it STILL won't work . What do I do to get it to work ???