PHP fetch all Twitter Followers and compare them to friends

Posted by ArneRie on Stack Overflow See other posts from Stack Overflow or by ArneRie
Published on 2010-04-03T05:54:35Z Indexed on 2010/04/03 6:03 UTC
Read the original article Hit count: 157

Filed under:

Hi,

iam looking for performant way to do the following:

  • User login
  • Fetch all Friends from Twitter
  • Fetch all Followers from Twitter
  • Display all Friends wich aren't Followers

The Problem: How to do this in a performant way? An user can have up to 2 Million Friends or Followers. In the moment im Storing both inside an sqllite table an compare them through an loop. When the user comes back the table is cleared and process starts again.

This works finde on 100 - 1000 Friends.. but will be tricky with 500000 Friends. I cant cache the lists because they can change every moment..

Does someone knows a good way to handle such big amount of data?

© Stack Overflow or respective owner

Related posts about php5