News:

Want to get involved in developing SMF, then why not lend a hand on our github!

Main Menu

RSS Feeder

Started by SlammedDime, January 11, 2009, 06:06:42 AM

Previous topic - Next topic

SlammedDime

Quote from: SlammedDime on February 12, 2009, 01:06:45 PM
Could be a software firewall on your computer causing an issue... open the file up on your local pc (you'll need something like 7 zip or Winrar) and make sure the files are there.  I just tested downloading from the mod site then uploading and it worked fine for me.


Guy - Open up ScheduledTasks.php and find the following:

      $rss_data->set_cache_location($cachedir);
      $rss_data->set_cache_duration(60*60*2); // 2 hours

and add this AFTER that.

      $rss_data->enable_cache(false);

SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Guy Verschuere

Oops, guess I haven't seen that post. Sorry.

Doesn't do it. The posts are still not imported right away.
I allready had disabled cache werever I could in Sub-Rss.php and changed times from 3600 to 300 seconds.

Any other ideas?

chifliiiii

I tried with 2 diferent feeds and im getting similar error in both.
Feeds urls are:
http://www.noticiasdot.com/feed/ [nofollow]
http://www.kriptopolis.org/rss [nofollow]
and the errors shown on logs are

Apply Filter: Only show the errors with the same message
RSS Feeder: http://www.noticiasdot.com/feed/ [nofollow] (cURL error 28: connect() timed out!)

Apply Filter: Only show the errors with the same message
RSS Feeder: http://www.kriptopolis.org/rss [nofollow] (cURL error 6: name lookup timed out)

I tried them by running the shedule task and waiting it for running auto. Any clue?
www.foro-ayuda.com [nofollow]

SlammedDime

I can't do anything about those errors chifliiiii - I more or less allowed them to be thrown so users could see what is wrong with the feed.  It has nothing to do with the mod.  I'd suggest doing a google search for those cURL errors for more information on what they mean.  I would only guess that on the first one, the feed took too long to respond, so it timed out.  The second one looks like it couldn't lookup the hostname properly, which would lead to a bad DNS configuration of your host.

Guy - I'm not really sure then why it's not working.  I've never had an issue with a feed not posting every 2 minutes on a scheduled task like it should.  The only thing I can think of is that the script is timing out after 300 seconds and only importing so many, but then you'd see php errors related to that. Sorry, I'm not really sure where to go on that.
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Guy Verschuere

It works! Thanks!

The problem was that I didn't add
Quoteand add this AFTER that.

      $rss_data->enable_cache(false);
because that line was above it.
Since I moved that line under the others it works great!

Maybe it would be a good option to set cache expiry and feed interval in the feed settings.

TheDisturbedOne

SlammedDime, maybe you can help me with this.  How do I add a feed?  I have spent the last 30 minutes trying to find the area :(
Thanks

SlammedDime

You should have automagically been redirected to the admin interface after installing, unless you clicked elsewhere.

It's under Configuration > Modifications > RSS Feeder
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Killer-B

#267
Quote from: SlammedDime on January 13, 2009, 01:13:16 PM
I'm not sure where you came up with those regex's.... For your first one... that has a lot of video feeds... so to extract the text from the video feeds, you'd want to use

~<div id="videoText">.*<\/div>(.*)<\/div>~siU (untested, but should work)

And for the second one

~<p><font class="sb13">(.*)<\/font><\/p>~siU (again, untested, but should work)

Great Mod SlammedDime... Works like a charm straight out of the box on www.f-1chat.com ... using over 20+ RSS Feeds (with specifics) and does a steller job... thanks!

That said, I too am wanting to pull the full article if possible - I've been researching PCRE - and since I'm not the best coder in the world - am truly lost as to proper syntax -

Is there a PCRE guide for dummies out there?? I've searched the SMF boards and google  - and lots and lots of code out there... just nothing that says "do this, to get that" kind of thing -

Sorry to ask such a stupid Q - but am new to this... and trying to wrap my brain around it all (PCRE) - any resources you can point me to?

Thanks -

KB

PS: Well that didn't link to the forum I wanted it to ... so let me offer another example -

This is a RSS Feed with a photo attached http://f-1chat.com/forum/index.php/topic,214.0.html
and as you can see, the article got cut...

So, if I'm looking for the PCRE "code" to be able to show all that bit -- hope that clarifies... TIA
SMF 2.0RC1

DirtRider

Well let me say this is one great mod and well done on this one. Not sure if this would be at all possible to add as a feature but how about the ability for members to ignore post made by the feeder if they want to. Something in their profile like an ignore RSS feeds
http://www.triumphtalk.com

"The real question is not whether machines think but whether men do. "

Killer-B

SMF 2.0RC1

SlammedDime

I'm currently at a meeting with other SMF teamies and only have a 56K connection to work with, so unfortunately I can't do much until I get home Saturday afternoon.
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Killer-B

Quote from: SlammedDime on February 27, 2009, 02:53:55 AM
I'm currently at a meeting with other SMF teamies and only have a 56K connection to work with, so unfortunately I can't do much until I get home Saturday afternoon.

No problemo - just wanted to see if anyone was still at home :P

We'll pick it up SAT if you're free...

Thanks -!

KB
SMF 2.0RC1

nikku

#272
is working. thx. I just dont know how to pull the entire blog feed from blogger.

SlammedDime

Ok... the phrase 'not working', or 'not importing' doesn't give any detail... any errors in your error log?  That feed takes quite a while to load... it may not work with the mod... PHP will only run for so long before timing out, so I have to set a delay that if the feed doesn't return anything fast enough, it times out.

Killer-B - did you see the link in the first post of this topic that links to another post in this same topic on how I came up with, or come up with the regex to use?  Your particular feed might prove difficult because of all of the extra stuff at the top of the article, like the pictures and captions.
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

nikku

I guess is working now. i forgot the schedule  :-X

http://www.ipergames.com/forum/index.php/topic,681.0.html [nofollow]


but... i cannot make links for download to be clickable. i enabled html for posts but seems that i cannot make to click on download.

question please:

anyone know how to pull entire feeds from a blog from blogger ?

http://pes-patch.blogspot.com/feeds/posts/default?alt=rss [nofollow]     

feeds/posts/default?alt=rss      get only the last ones... from the day ?

Killer-B

Quote from: SlammedDime on March 01, 2009, 02:44:02 PM

Killer-B - did you see the link in the first post of this topic that links to another post in this same topic on how I came up with, or come up with the regex to use?  Your particular feed might prove difficult because of all of the extra stuff at the top of the article, like the pictures and captions.

I read the first 4 pages... then honestly skipped to the end, as there was no discussion about it (not on "search" for PCRE) - but will look more... as I do not know about REGEX either...

I'll understand if it doesn't pull all the data per the example I gave - but I'd like to at least learn the proper syntax and give it a try....

Thanks for the response -

KB
SMF 2.0RC1

Killer-B

Quote from: nikku on March 01, 2009, 03:03:31 PM
I guess is working now. i forgot the schedule  :-X

http://www.ipergames.com/forum/index.php/topic,681.0.html


but... i cannot make links for download to be clickable. i enabled html for posts but seems that i cannot make to click on download.

question please:

anyone know how to pull entire feeds from a blog from blogger ?

http://pes-patch.blogspot.com/feeds/posts/default?alt=rss    

feeds/posts/default?alt=rss      get only the last ones... from the day ?

Nikku,

May I ask how you were able to get the designer theme to stretch out so wide? I wanted to use that theme, but was too narrow with the portal.... if I could get it out like 800-900 px - that'd be awesome - Let me know will ya?

Thanks -

KB
SMF 2.0RC1

SlammedDime

Quote from: nikku on March 01, 2009, 03:03:31 PM
I guess is working now. i forgot the schedule  :-X

http://www.ipergames.com/forum/index.php/topic,681.0.html


but... i cannot make links for download to be clickable. i enabled html for posts but seems that i cannot make to click on download.

question please:

anyone know how to pull entire feeds from a blog from blogger ?

http://pes-patch.blogspot.com/feeds/posts/default?alt=rss    

feeds/posts/default?alt=rss      get only the last ones... from the day ?
it won't be possible to make them clickable at this point in time.  I may look at using SMF 2's html_to_bbc function in the next release, depending on how well it will work.
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

nikku

#278
i searched my bookmark for the answer i couldnt find it  now... >:( ... where is the theme. go to forum and browse it. there is the answer or just ask a topic. is very simple to do it. I forgot how  :-\


thank you SlammedDime. hope to do it someday (make clickable)

How to remove - Source: ... ?

Hiver101

Hi,
can i have the SQL create table scrip for RSS Feeder? i'm having problem installing this mod.

Thanks.

Advertisement: