I have an RSS reader project and I need to update my database automatically. I have used cron but I have to set new crons every time I have new links and it also get me stuck because of too many cron jobs must be set. Also I have runtime and I/O problem with each cron.
The second way I found was I added an AJAX in user page so that it runs my serverside script and when it finished it calls the next and on. I dont know what are the real ways?
Meanwhile I have problem with I/O. My server admin argues about the run time and I/O of each URL.
I have a
feed table and
feeds_items (contains RSS items associated with each feed), so when my script opens a link compile it and then check it if they are not already in the database, it will be inserted but because there are too many items and the size of them are so high I have problem. What can I do?