This is a little bit of a round about way to do this but there is a free twitter web part available here:
(I've used this on the site of the company I work for - its legit. I can post the link to that site that its on if you like).
The main purpose of this webpart is to display tweets from a user, or from a hashtag, but it will display users on a list. So, if your twitter ID is @sharepointuser then you can make a list called "myfollowers" and you can put in the search query (appears in the web part properties in the browser) to search @sharepointuser/myfollowers and it will display anyone you add to that list.
That I *know* will work, but it may be time consuming.
I haven't tried, but I'm sure there's a way you can play with your search query (or the webpart files themselves) to allow this. I would think even putting in @sharepointuser/Followers might bring in a list of users. There are also a ridiculous number of comments, so someone might have tried this already. Also, the people at Amrein who designed the part, are great about replying to comments if you have specific questions.
Hope this helps a bit...