'Limit' RSS Feeds When Set to Run via Cron Job/Manually | CyberSEO Pro | Support Forum

hello admin,

was just wondering if you noticed this post?

Hello Admin,

I understand what you are saying thanks. In my set up the CRON checks every 15 minutes so the next ASAP would be checked, but your point is valid as eventually all feeds would go to ASAP. A much better idea is as follows:

Would it be possible to set a different 'run time' for each feed? In that way it would 'distribute' loads and posts over time having immediate benefits.

So the 10 feed scenario 'staggered' 30min, 60 min, 90 min.. 300 min.. would look like

Feed#      Next Run      Last Run

feed1        asap            30 min

feed2        60 min         60 min

feed3        90 min         120 min

…

feed10      300 min       330 min

The CRON would check every 30 minutes and pick up the ASAP job. I believe this is a valuable option all users would agree has many benefits: evenly distribute load and distribute posts over time.

Hope you will consider.

Regards,
cyber1

Hello Admin,

Of course you know this product, but I don't understand your logic. Even if the 1st Feed gets updated at some point all the others will also. (what is Next Run, ive never seen this?)

As I can see It will be like this, here is a more detailed example showing 4 feeds over 6 iterations. Each feed runs at a different rate frequency(feed1-@30min, Login to see this link

All feeds start together for illustration:

1) First run:

Feed#      Next Run      Last Run

feed1        30 min         0 min

feed2        60 min         0 min

feed3        90 min         0 min

feed4       120 min        0 min

*all feeds are run in this scenario starting out.

2) Second run (after 30 minutes):

Feed#      Next Run       Last Run

feed1       asap             30 min

feed2       30 min          30 min

feed3       60 min         30 min

feed4       90 min         30 min

*feed1 will run next

3) Third run (after another 30 minutes):

Feed#      Next Run      Last Run

feed1        30 min         0 min

feed2        asap            60 min

feed3        30 min         60 min

feed4       60 min          60 min

*feed 1 runs,feed2 is next

4) 4th run (after another 30 minutes):

Feed#      Next Run      Last Run

feed1        asap            30 min

feed2        60 min         0 min

feed3        asap            60 min

feed4        30 min         60 min

*feed2 runs, feeds1/3 are next

5) 5th run (after another 30 minutes):

Feed#      Next Run      Last Run

feed1        30 min          0 min

feed2        30 min         30 min

feed3        90 min         0 min

feed4        asap            90 min

*feed1 and 3 runs, feed4 is next

6) 6th run (after another 30 minutes):

Feed#      Next Run      Last Run

feed1        asap            30 min

feed2        asap            60 min

feed3        60 min         30 min

feed4        120 min       0 min

*feed4 runs, feeds1 and 2 are next.

7) and so on.. repeating the process.

Over the course of 6 iterations at least 1 of the 4 feeds will have run, and having run through all 4 feeds. If the interval of the feeds is spread out further this could avoid/limit running 2 at once.

Note: I'm assuming that when ASAP is reached, the next iteration runs the feed but the effect is the same regardless of what it is called.

Sincerely,

Cyber1

Hello Admin,

Doesn't the code pick up the 'next' item(s) in the list that say's 'asap'? I really I don't understand all the subtleties of how the computer functions as I am not the developer. You'd really need to show me through the 6 iterations for me to fully understand this.

My point here is simply having indepedent run times for each feed to 'stagger' so all don't run/clump up and run at the same time. This would have many benefits not the least of which is minimize server resources for any single execution.

For myself having up to 12 rss feeds i'm finding lots of performance/timing related issues running all the jobs together. Having things 'spread out' so let's say 1 or 2 of the 12 feeds run at a time would be a great difference in usability of  the product.

I'm sure this is a reasonable request as it is just a benefit to running the feeds which everyone would benefit from.

I hope you can consider this.

Sincerely,
cyber1

Hello Admin,

No this is not obvious to me.. why would it be? I am just your customer.. not your developer or programer of the logic of the application.

If as you say it updates when 'ASAP' then we are saying the same thing. My point is to allow different update intervals for each feed, so not all the feeds run at once. I think this is a reasonable request considering the critical importance of server performance, SEO etc.

If you take the time to review my sample above for all 4 feeds I think you'll see i make a valid point.. having different frequency of the feeds will avoid running all the feeds at the same time. No solution is perfect, the CRON interval will always impact this.. but at least this method gives users a way to 'spread out' the run time of the feeds.

"Is there some reason you are opposed to improving the distribution of the feed run times? I'd much rather have a solution than back and forth as to my knowledge of the product which is limited to layman's knowledge.."

The sample you gave needs to show the 4 feeds over 6 iterations.. I think you'll see the feeds are distributed to some extend.. if not please show me a way this can be done, I'm only looking for a solution.. not a test of my intellect.

Sincerely,

cyber1