RSS Feed Poster

Started by SMFHacks.com Team, January 11, 2007, 07:46:04 PM

Previous topic - Next topic

elyparker

Quote from: vbgamer45 on May 08, 2012, 06:43:03 PM
Depends on the feed and what type of feed

what do you mean?

i want post  this
http://www.comunedicanicattinibagni.it/web/feed/rss.html [nofollow]

but it take and post  only the link and title but not the descrption


another problem is that it feed only ever 6 hours i try to change the minutes option in panel admin but nothing happened

it post feed at 19, 1, 7 , 13

what's happened? but the great problem is blank description

Skyflash

Quote from: elyparker on May 09, 2012, 02:51:38 AM
Quote from: vbgamer45 on May 08, 2012, 06:43:03 PM
Depends on the feed and what type of feed
what's happened? but the great problem is blank description
The bigger problem, that is causing your issue, is that the plugin don't support (ridiculous, imho, in 2k years...) UTF-8 :(

elyparker

Quote from: Skyflash on May 09, 2012, 02:57:54 AM
Quote from: elyparker on May 09, 2012, 02:51:38 AM
Quote from: vbgamer45 on May 08, 2012, 06:43:03 PM
Depends on the feed and what type of feed
what's happened? but the great problem is blank description
The bigger problem, that is causing your issue, is that the plugin don't support (ridiculous, imho, in 2k years...) UTF-8 :(

mmm
exist a workaround?

chada

VB thanks for the excellent mod.
The only issue that I am having is, I have 8 feeds but only 3 actually post.

These feeds are from weather providers and they are beneficial to my area.

Here are the 3 that actually post.

http://rss.wunderground.com/auto/rss_full/FL/Panama_City.xml?units=english
http://rss.wunderground.com/auto/rss_full/FL/Pensacola.xml?units=english
http://rss.wunderground.com/auto/rss_full/FL/Okaloosa_Island.xml?units=english

Here are the five that do not post.

http://www.nhc.noaa.gov/xml/MIMATS.xml
http://www.nhc.noaa.gov/xml/TWDAT.xml
http://rss.wunderground.com/auto/rss_full/tropical/index.xml?basin=at
http://www.nhc.noaa.gov/xml/OFFNT4.xml
http://www.nhc.noaa.gov/index-at.xml

All settings are the same 360 check time and import 25
Feed Enable Checked
Html Enable Checked
Locked Topic Checked

I am stumped as to why the first 3 work and the other 5 don't.
Here is a link to the forum page.
http://www.panhandlepierfishing.com/forum/rss-feeds-(weather-warnings-etc-)/

Thanks for any insight on this.
SMF 2.02

Skyflash

Quote from: elyparker on May 09, 2012, 05:35:51 AM
exist a workaround?

For me has worked this:

Sources/Subs-RSS2.php


// Process the XML
$xml_parser = xml_parser_create("ISO-8859-1");


Replace with

// Process the XML
$xml_parser = xml_parser_create("UTF-8");

chuck23322

#2545
Ok, I think I'm really close on having this working well for me.  (SMF 2.0.2 forum)

1) If I access from a web browser:   http://forumname.com/forum/cronrss.php -- I get back "Feed Poster Configuration" -- and the feeds update.
2) If I use the "fake" cron job inside of SMF -- the feeds update.

WHAT ISN'T working right for me is setting up a REAL cron job.   I've tried both (and variants) of the following:

wget -q http://forumname.com/forum/cronrss.php

php -q /home/username/forumname.com/forum/cronrss.php




What I get then is something very weird -- I get back the html for the main login page to my forum...   (and of course, the RSS feeds don't update)...

Advice welcome...   I really want/need to get this working via a real cron job.   

q) Are there any other ways of "kicking off" the rss pull process?   

q) Why would I be getting the "login" HTML when I wget or php the "cronrss.php" file from within the server itself?

vbgamer45

Community Suite for SMF - Take your forum to the next level built for SMF, Gallery,Store,Classifieds,Downloads,more!

SMFHacks.com -  Paid Modifications for SMF

Mods:
EzPortal - Portal System for SMF
SMF Gallery Pro
SMF Store SMF Classifieds Ad Seller Pro

chuck23322


vbgamer45

Inside the cronrss.php file
Add this after <?php

$ssi_guest_access = true;
Community Suite for SMF - Take your forum to the next level built for SMF, Gallery,Store,Classifieds,Downloads,more!

SMFHacks.com -  Paid Modifications for SMF

Mods:
EzPortal - Portal System for SMF
SMF Gallery Pro
SMF Store SMF Classifieds Ad Seller Pro

chuck23322

Quote from: vbgamer45 on May 12, 2012, 10:53:47 AM
Inside the cronrss.php file
Add this after <?php

$ssi_guest_access = true;


Volia! That works!  -- Huge thanks! --- Now, Both the wget and php versions of a cron (a real cron) work fine with that addition...

I assume (ugh..) that I'm not otherwise compromising security of my site or adding guest access with it -- just that the script/PHP needed to be allowed to use the "guest" access.....




@Others:

For those wanting an RSS feed to "test" with -- that is of reasonable high volume -- here's two that I found -- I worked on getting my RSS stuff to work -- and these feeds provided me with plenty of "regular" updates.

The USGS has a "Earthquakes" in the last hour -- probably about 3-5 items come down each hour or so...

Earthquakes ATOM link -- http://earthquake.usgs.gov/earthquakes/catalogs/1hour-M0.xml

And Wikipedia has a RSS feed of EVERY change made (warning, danger will robinson, danger, danger) -- but it's pretty much guaranteed to have an update every time it's hit....   easily 100 items or more -- so turn it on/off as you need to, or limit the downloads :)

Wikipedia Edits -- http://en.wikipedia.org/w/index.php?title=Special:RecentChanges&feed=atom

vbgamer45

Yes you are ok it i just allowing it for that script.
Community Suite for SMF - Take your forum to the next level built for SMF, Gallery,Store,Classifieds,Downloads,more!

SMFHacks.com -  Paid Modifications for SMF

Mods:
EzPortal - Portal System for SMF
SMF Gallery Pro
SMF Store SMF Classifieds Ad Seller Pro

chuck23322

#2551
Almost there !

Some feeds have items that are "broke/missing" -- here's an example..   The SEC feed for "Apple" --

RSS Feed link:   http://www.sec.gov/cgi-bin/browse-edgar?action=getcompany&CIK=0000320193&type=&dateb=&owner=include&start=0&count=40&output=atom

Looking at the raw feed data -- there is a "link" for each item

But in "RSS Feed Poster 3.0.4" -- as it is posted into the forum, the link doesn't work -- it's there... but it points to just "http:" and stops there...

Example entry: <entry>
<title>4  - Statement of changes in beneficial ownership of securities</title>
<link rel="alternate" type="text/html" href="http://www.sec.gov/Archives/edgar/data/320193/000118143112028878/0001181431-12-028878-index.htm"/>
<summary type="html">
&lt;b&gt;Filed:&lt;/b&gt; 2012-05-09 &lt;b&gt;AccNo:&lt;/b&gt; 0001181431-12-028878 &lt;b&gt;Size:&lt;/b&gt; 23 KB
</summary>
<updated>2012-05-09T19:00:57-04:00</updated>
<category scheme="http://www.sec.gov/" label="form type" term="4"/>
<id>urn:tag:sec.gov,2008:accession-number=0001181431-12-028878</id>
</entry>


But the link for:  "http://www.sec.gov/Archives/edgar/data/320193/000118143112028878/0001181431-12-028878-index.htm" -- is just "http:"  -- in the post from the mod..


OldShaterhan

I using this mod in my forum: hxxp:forum.mikonews.tk/ [nonactive] . Unfortunately I think, than RSS Feed Poster unsupport UTF-8 - I get "?" instead polish characters. Example: hxxp:forum.mikonews.tk/aktualnosci/odbieraj-bezpatnie-ca-ofert-naziemnej-telewizji-cyfrowej!/ [nonactive] ; hxxp:forum.mikonews.tk/aktualnosci/skatowa-swoj-konkubin/ [nonactive]
Can you repair it?

vbgamer45

Check a couple posts back some people did some changes for utf8
Community Suite for SMF - Take your forum to the next level built for SMF, Gallery,Store,Classifieds,Downloads,more!

SMFHacks.com -  Paid Modifications for SMF

Mods:
EzPortal - Portal System for SMF
SMF Gallery Pro
SMF Store SMF Classifieds Ad Seller Pro

OldShaterhan

I don't know SMF very much. How can I check it?
It works til 19 February 2011 11:30( hxxp:forum.mikonews.tk/aktualnosci/60/ [nonactive] )

vbgamer45

I meant check a couple posts back inside this topic some people here posted a possible fix.
Community Suite for SMF - Take your forum to the next level built for SMF, Gallery,Store,Classifieds,Downloads,more!

SMFHacks.com -  Paid Modifications for SMF

Mods:
EzPortal - Portal System for SMF
SMF Gallery Pro
SMF Store SMF Classifieds Ad Seller Pro

OldShaterhan

Thank you very much.
I don't know English very well, but I believe it will be works.

One more thing. Why it add only 1 post despite it's more?

PS Why isn't the parser version choose isn't in configuration?

graaywolf

The mod is working fine except it don't post the latest feed it only posts the second to the last post from the sites... How would i configure it to post the latest post from the other sites?

I'm trying...

-=(GW)=-

chuck23322

#2558
Quote from: graaywolf on June 09, 2012, 12:04:09 PM
The mod is working fine except it don't post the latest feed it only posts the second to the last post from the sites... How would i configure it to post the latest post from the other sites?

{Make sure, first, that you are saying in the feed config, that you want more than 1 post to be pulled each time...  The system will not double-post -- it keeps a MD5 hash in the MySQL table of every post to make sure it doesn't double post -- so even if you say post 10 each time, if 9 of them have been posted before, it will post only the new 1, because there is no MD5 match to previous posts -- all my feeds say pull 15 posts -- I think that's the max}

You're not alone on that one.  I originally figured it was my complexity in scraping feeds, etc.   But it turns out I was wrong -- certain feeds, just as a straight RSS feed into the SMF Mod -- also dropped an item....   the symptom was that the missing item would get posted when the feed got it's "next" item -- but of course, that item was missing until the next one showed up, etc, etc....

I can't give you an exact solution...  and it certainly depends on your personal desire to get into the alternative "hack" (and it is a HUGE hack)...

But I've taken to Yahoo Pipes to do pre-processing of my RSS feeds before giving it to the SMF Mod.

For those feeds that are dropping a post,  the Yahoo Pipes tool lets me do a "reverse" of the feed - therefore what was the TOP of the feed is now the BOTTOM - and the drop no longer is an issue to me -- no, it's not a fix :)

Granted, there's a learning curve for yahoo pipes.   And the other issue is that the RSS SMF Mod doesn't like the & character in a URL link (Yahoo pipes RSS links always have a &) --so you also have to create a Tinyurl.com link to your Yahoo pipe...

so it ends up being...   RSS -> Yahoo Pipe -> TinyURL --- and the TinyURL is what goes in your feed configuration.

Now, of course, I'm hacking a fix to the symptom, instead of finding the original problem and fixing that -- but that's what my skill set is, and Pipes has my intrigue because of all the other stuff I can do with it.   I'm now "scraping" web pages of interest, and converting them to RSS feeds, that the SMF mod can pull in...   So otherwise, I wouldn't "just" be using Yahoo pipes to 'fix' this issue -- but in the case of my feeds, it was easy enough to toss in a pipe operative saying "reverse" -- and volia, the problem of the missing post went away for me.

mageguild

I have enabled this MOD and enabled a feed but it does not seem to be importing all the data in the feed.   

Refer to the attached images.

The first image shows the feed that I have enabled.  It is setup to update every 5 minutes and to import 10 items each update. 
The second image shows that board that the feed is posting to.  From this image, you can see that it is importing 2 items every 6 hours. 

Can anyone suggest what could be causing this?

Advertisement: