May 4, 2011 CyberSEO

CyberSEO Overloading Server | CyberSEO Pro | Support Forum

Avatar
sp_LogInOut Log In

Lost password?
sp_Search Search
Advanced Search
Advanced Search

— Forum Scope —




— Match —





— Forum Options —





Minimum search word length is 3 characters - maximum search word length is 84 characters

sp_Search Search
Go to Bottom
No permission to create posts
sp_TopicIcon
CyberSEO Overloading Server
Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 (0 votes) 
July 6, 2022
8:40 pm
Avatar
tshutt
Member
Members
Forum Posts: 23
Member Since:
January 7, 2022
sp_UserOfflineSmall Offline
Go to Top
1sp_Permalink sp_Print
0

Ever since I started using CyberSEO Pro our server is regularly getting overloaded and going offline every few days. I had a system admin take a look and he said something is hijacking the MySQL and causing it to spike. I'll paste his full response below, but he thinks it's CyberSEO, is there anything I can adjust to stop it from spiking the CPU and overloading the server?

What my system admin said:
Every 10 minutes ending in the 3 so 12:53, 1:03, etc..  it loads a set of queries that its scraping something and thats what is making the Mysql go up to >100% via a select query that is grabbing/fetching data that is causing the site to go offline multiple times.
Crawling goes back as far as the 25th of June as of July 6th and runs for about 3 minutes at a time.
While Mysql is being hijacked using 100% CPU if you try to visit the website a few of the queries go through but the other ones are getting hung up as the server is queuing the response

 

 sportsin_neww user is the user and here are the series of queries (list is non-exhaustive but it is variations of this) - they seem to run on a cadence:
SELECT DISTINCT ID FROM fumcy_posts as posts, fumcy_postmeta as postmeta WHERE posts.ID = postmeta.post_id AND (((postmeta.meta_key = 'cyberseo_post_name' AND postmeta.meta_value = 'dodgers-vs-rockies-prediction-computer-picks-odds-pitching-matchup-7-6-2022') OR (posts.post_name = 'dodgers-vs-rockies-prediction-computer-picks-odds-pitching-matchup-7-6-2022')) OR (posts.guid = 'Login to see this link')) AND posts.post_status NOT IN ('trash') AND posts.post_type NOT IN ('attachment', 'revision', 'nav_menu_item')
 
SELECT DISTINCT ID FROM fumcy_posts as posts, fumcy_postmeta as postmeta WHERE posts.ID = postmeta.post_id AND (((postmeta.meta_key = 'cyberseo_post_name' AND postmeta.meta_value = 'braves-vs-reds-prediction-computer-picks-odds-pitching-matchup-7-3-2022') OR (posts.post_name = 'braves-vs-reds-prediction-computer-picks-odds-pitching-matchup-7-3-2022')) OR (posts.guid = 'Login to see this link')) AND posts.post_status NOT IN ('trash') AND posts.post_type NOT IN ('attachment', 'revision', 'nav_menu_item')
 
SELECT DISTINCT ID FROM fumcy_posts as posts, fumcy_postmeta as postmeta WHERE posts.ID = postmeta.post_id AND (((postmeta.meta_key = 'cyberseo_post_name' AND postmeta.meta_value = 'tigers-vs-royals-prediction-computer-picks-odds-pitching-matchup-7-1-2022') OR (posts.post_name = 'tigers-vs-royals-prediction-computer-picks-odds-pitching-matchup-7-1-2022')) OR (posts.guid = 'Login to see this link')) AND posts.post_status NOT IN ('trash') AND posts.post_type NOT IN ('attachment', 'revision', 'nav_menu_item')
 
SELECT DISTINCT ID FROM fumcy_posts as posts, fumcy_postmeta as postmeta WHERE posts.ID = postmeta.post_id AND (((postmeta.meta_key = 'cyberseo_post_name' AND postmeta.meta_value = 'phillies-vs-braves-prediction-computer-picks-odds-pitching-matchup-6-30-2022') OR (posts.post_name = 'phillies-vs-braves-prediction-computer-picks-odds-pitching-matchup-6-30-2022')) OR (posts.guid = 'Login to see this link')) AND posts.post_status NOT IN ('trash') AND posts.post_type NOT IN ('attachment', 'revision', 'nav_menu_item')
 
SELECT DISTINCT ID FROM fumcy_posts as posts, fumcy_postmeta as postmeta WHERE posts.ID = postmeta.post_id AND (((postmeta.meta_key = 'cyberseo_post_name' AND postmeta.meta_value = 'rangers-vs-royals-prediction-computer-picks-odds-pitching-matchup-6-28-2022') OR (posts.post_name = 'rangers-vs-royals-prediction-computer-picks-odds-pitching-matchup-6-28-2022')) OR (posts.guid = 'Login to see this link')) AND posts.post_status NOT IN ('trash') AND posts.post_type NOT IN ('attachment', 'revision', 'nav_menu_item')
 
 
July 6, 2022
9:09 pm
Avatar
CyberSEO
Admin
Forum Posts: 3857
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline
sp_UserWebsite
Go to Top
2sp_Permalink sp_Print
0

I can give you the same answer as here: Login to see this link

In your case your site makes a series of MySQL queries to check every post in the syndicating thread for uniqueness among the others in your database. As you can see above, that's a valid MySQL query and there is no error.

Your MySQL server is just unable to process such amount of quires. If you want to reduce them, try to pull less feeds at once and don't do it very often.

July 6, 2022
10:51 pm
Avatar
tshutt
Member
Members
Forum Posts: 23
Member Since:
January 7, 2022
sp_UserOfflineSmall Offline
Go to Top
3sp_Permalink sp_Print
0

Thanks for the great response! I'm only pulling from one feed, here's that feed: Login to see this link

But I had it set to checking for updates to it every 5 minutes, I just now lowered that to 15 minutes, will see if that helps.

Thank you!

July 7, 2022
12:46 am
Avatar
CyberSEO
Admin
Forum Posts: 3857
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline
sp_UserWebsite
Go to Top
4sp_Permalink sp_Print
0

Your feed contains 150 items (posts). It's 15x times more than a default WordPress feed size. Thus the plugin takes the same amount of your server resources (CPU and memory) as if you pulled 15 standard WordPress feeds at once.

When you pull your feed, the plugin takes the first post and asks the MySQL server check for it in the database. If post exists (no news since the last parse), it takes another and repeat the procedure all 150 times.

This is what happens with your server every time when that feed is being pulled. I would suggest you to find out how often the feed owner publishes a new post there and then set CyberSEO to pull the feed with a roughly same periodicity. I mean there is no need to pull a daily updated feed every single hour.

July 7, 2022
2:30 am
Avatar
tshutt
Member
Members
Forum Posts: 23
Member Since:
January 7, 2022
sp_UserOfflineSmall Offline
Go to Top
5sp_Permalink sp_Print
0

Thanks for the detailed explanation! I think I understand now, thanks a lot for the help!

No permission to create posts
sp_Feed All RSS
Go to top
Forum Timezone: Europe/Amsterdam

Most Users Ever Online: 541

Currently Online:
10 Guest(s)

Currently Browsing this Page:
1 Guest(s)

Top Posters:

ninja321: 84

s.baryshev.aoasp: 68

Freedom: 61

Pandermos: 54

MediFormatica: 49

B8europe: 47

Member Stats:

Guest Posters: 337

Members: 2796

Moderators: 0

Admins: 1

Forum Stats:

Groups: 1

Forums: 5

Topics: 1600

Posts: 8158

Newest Members:

caseydipen8848, paulosos184, nicholashull7, it.mmnl, sameerz, markus.raum-g

Administrators: CyberSEO: 3857