Log In
Home
(0 votes) 12:42 am
September 10, 2014
Offline
I'm adding about 200 galleries separated to post in 5 min intervals. Posts get added but the images aren't scraped from the fhg.
If I go to a post without images and press "Update" in scrapes the fhg just fine.
Any idea what may be going on? Is there a cron with the bulk import and I wait for it to scrape galleries?
Thanks
2:26 am
July 2, 2009
Offline
You just have to open a post in the browser to make the plugin create the gallery.
2:45 am
September 10, 2014
Offline
Login to see the quote
I have to open 200+ posts in my browser to get the script to scrape galleries? That's a bit odd no?
Can you add a cron or some way to fetch the galleries without having to hit every page?
4:51 am
July 2, 2009
Offline
Login to see the quote
I have to open 200+ posts in my browser to get the script to scrape galleries? That's a bit odd no?
Not you. Your visitors, SE crawlers etc. The gallery will be generated and displayed when someone opens the post for a first time (in other words, even your first visitor will not end up with a blank page). And yes, its not odd at all. The gallery scrapping is a very resource and time consuming process. Just imagine what if someone try to scrape say 10000 galleries at once? That's just impossible.
1:40 pm
September 10, 2014
Offline
Login to see the quote
I have to open 200+ posts in my browser to get the script to scrape galleries? That's a bit odd no?
Not you. Your visitors, SE crawlers etc. The gallery will be generated and displayed when someone opens the post for a first time (in other words, even your first visitor will not end up with a blank page). And yes, its not odd at all. The gallery scrapping is a very resource and time consuming process. Just imagine what if someone try to scrape say 10000 galleries at once? That's just impossible.
It isn't working... check here - Login to see this link - no galleries are generated except for the one that I manually generated.
I have a custom WP plugin that can import 2,000 galleries easily. If you want to look at it I can send you a login/pass to test it.
I wanted to try this plugin because my custom one doesn't work on Digital Ocean because of php version issues. At any rate it's very much possible to import tons of galleries.
So again, no background process to scrape the galleries?
Edit: not even a background process. Just have the script scrape the galleries while the plugin page is open in the admin.
1:30 am
July 2, 2009
Offline
Please email me with login/password to your WP control panel. I'll take a look, because it really looks odd.
1:41 am
July 2, 2009
Offline
Looks like something wrong with your theme (Login to see this link filter doesn't work). I've switched to a standard WP theme and everything worked fine. Please consider changing your theme.
2:30 am
September 10, 2014
Offline
Login to see the quote
Ah thanks very much. I fixed it now. Now to find a script that will crawl the pages and build the galleries before users or SE's. There's quite the lag when the page gets hit for the first time.
12:57 am
September 10, 2014
Offline
Just fyi for anyone reading this. If you need to hit all your pages so that the galleries will be scraped use httrack
All RSSMost Users Ever Online: 541
Currently Online:
14 Guest(s)
Currently Browsing this Page:
1 Guest(s)
Top Posters:
ninja321: 84
s.baryshev.aoasp: 68
Freedom: 61
Pandermos: 54
MediFormatica: 49
B8europe: 48
Member Stats:
Guest Posters: 337
Members: 2819
Moderators: 0
Admins: 1
Forum Stats:
Groups: 1
Forums: 5
Topics: 1627
Posts: 8280
Newest Members:
sneakpeachagency, bkc.tessier, igor.buzaev, jeremyboucher, lthompson2709, MACAdministrators: CyberSEO: 3913