It houses the SA National Blood Service, Nedbank and other companies.
Ambulances were seen rushing down Jan Smuts Avenue to the scene.
City of Joburg emergency management services spokesperson Synock Matobako said staff in both that building and adjacent properties have been evacuated.