I have an rss reader project, in one table(
feeds) I have the urls. In table
feed_items, I store the items of each feed.
I have set a cron which opens the feeds one by one and parses the XML. Then it checks if they are already in the db or not. If not, they are inserted.
Every thing looks ok, but my server admin blocked my script because firstly it has a long run time and secondly they argue about the I/O which huge number of inserts will make. Th first thing I did is split the cron into 1 per url, but I still have the I/O problem. What are my solutions?