May 4, 2011

Google News rss fetches only one post | CyberSEO Pro | Support Forum

Avatar

Lost password?
Advanced Search

— Forum Scope —




— Match —





— Forum Options —





Minimum search word length is 3 characters - maximum search word length is 84 characters

sp_TopicIcon
Google News rss fetches only one post
Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 Topic Rating: 0 (0 votes) 
October 1, 2024
5:11 am
Avatar
debajyoti.nath
Member
Members
Forum Posts: 10
Member Since:
September 1, 2024
sp_UserOfflineSmall Offline

I have tried this multiple times, but it always stops doing anything after posting the first item.

In feed configuration
Delay -> 2
Maximum number of posts -> 2

I tried changing the number, but no matter what I set (5, 10) the processing stops after fetching the first post.

I tried the same setting with Bing News and it works without issues. It could fetch 2 posts.

October 1, 2024
7:18 am
Avatar
CyberSEO
Admin
Forum Posts: 3926
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline

Google News always fetches the most recent story. When a new one is published, it will be fetched as well.

October 2, 2024
5:06 pm
Avatar
elyarpourakbar
Member
Members
Forum Posts: 26
Member Since:
February 11, 2024
sp_UserOfflineSmall Offline

Login to see the quote

Sometimes it fetches Coockies notification and writes an entire article wasting tokens on Coockies. How to solve this issue? 

October 2, 2024
7:02 pm
Avatar
CyberSEO
Admin
Forum Posts: 3926
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline

The issue you're experiencing is due to GDPR compliance, which is a set of regulations that require websites to display cookie consent notices to users in certain regions, primarily within the EU: Login to see this link

Because the plugin works as a PHP script rather than an actual browser, it doesn't have a stored cookie to indicate consent. As a result, some sites may serve you the cookie notification instead of the actual article content, depending on how their scripts are implemented.

Unfortunately, there's no universal fix for this problem, because these cookie consent scripts vary widely and don't follow a standard method of triggering. Typically, they are activated based on IP addresses from regions covered by GDPR, which causes them to display the notification before the main content is displayed.

To resolve this, you have two main options:

1. You can used a proxy proxy. By enabling a proxy from a non-GDPR region, you can bypass the cookie consent triggers. You can set this up in the plugin's settings under the "General Settings" tab.

2. Another approach is to trick the cookie notification script by setting a user agent string that mimics a search engine crawler, which often bypasses such notices. Find the "User agent" field in the "Expert" tab and put there the following line:

Login to see the quote

October 7, 2024
6:53 am
Avatar
debajyoti.nath
Member
Members
Forum Posts: 10
Member Since:
September 1, 2024
sp_UserOfflineSmall Offline

Why does it fetch only one item, while any other RSS feed can fetch multiple based on the configuration?

Also, it often fails to retrieve the full text, and more often fails to fetch the image.

October 7, 2024
10:32 am
Avatar
CyberSEO
Admin
Forum Posts: 3926
Member Since:
July 2, 2009
sp_UserOfflineSmall Offline

If the Full-Text RSS script with its default configs fails to extract the full articles from some websites, you can configure it manually using this manual posted by a CyberSEO Pro user here: Login to see this link

You should analyze the Syndciator log of CyberSEO Pro and find out exactly which sites are causing problems for Full-Text RSS to import their content. Then you should analyse the HTML structure of the articles on these sites and create the appropriate configs for the Full-Text RSS script.

Forum Timezone: Europe/Amsterdam

Most Users Ever Online: 541

Currently Online:
32 Guest(s)

Currently Browsing this Page:
1 Guest(s)

Top Posters:

ninja321: 84

s.baryshev.aoasp: 68

Freedom: 61

Pandermos: 54

MediFormatica: 49

B8europe: 48

Member Stats:

Guest Posters: 337

Members: 2833

Moderators: 0

Admins: 1

Forum Stats:

Groups: 1

Forums: 5

Topics: 1631

Posts: 8306

Newest Members:

willem7904, limanivaldo, TheRiz, mrsanichols, namyahweh, zemaitis.geektech

Administrators: CyberSEO: 3926