Advertisement:

Author Topic: RSS Feeder  (Read 375330 times)

Offline KahneFan

  • SMF Hero
  • ******
  • Posts: 1,850
  • Gender: Male
    • I Post You Post
Re: RSS Feeder
« Reply #140 on: January 18, 2009, 04:03:57 AM »
I could be wrong, but as long as you reference the original source, shouldn't that be OK... especially if they are OFFERING a feed?

Offline Smoky "Rider" Blue

  • SMF Hero
  • ******
  • Posts: 1,684
  • Gender: Female
  • It's all in your head! :p
    • smoky.blue.01 on Facebook
Re: RSS Feeder
« Reply #141 on: January 18, 2009, 04:12:51 AM »
hmm well he is offereing, if anyone wants him.. but he needs to get his web design figured out..

not sure if you want his stuff or not but hey lmao

info is there.

im just wondering, is it or is it not illegal? hmm

and for him to call me a scraper?? gesh.. little sissy boy.. where is my whip??  >:(

**Take the time to remember friendships and family.. Sometimes it's all we have, and missed very much**

Offline SlammedDime

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 10,276
  • School of Air Ride
    • matt.zuba on Facebook
    • @mattzuba on Twitter
Re: RSS Feeder
« Reply #142 on: January 18, 2009, 05:05:04 AM »
As stupid as it is, they are well within their rights to ask you to remove their content.  I don't understand why they would even want RSS feeds if they didn't want a way to get their info out....

Their loss I suppose.
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Offline Smoky "Rider" Blue

  • SMF Hero
  • ******
  • Posts: 1,684
  • Gender: Female
  • It's all in your head! :p
    • smoky.blue.01 on Facebook
Re: RSS Feeder
« Reply #143 on: January 18, 2009, 05:09:32 AM »
i guess so too slammeddime.. and to be honest, im glad i did remove it..

for someone to be so ignorant of seo, site marketing etc., they should have taken it as a compliment..

least they could have done is drop me a pm or email on it.. the baby boi sent me 5 spams and then had his  lil friend post up a real manly comment too.. hmm..

Smoky strikes again.. lol..  O:)
**Take the time to remember friendships and family.. Sometimes it's all we have, and missed very much**

Offline SlammedDime

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 10,276
  • School of Air Ride
    • matt.zuba on Facebook
    • @mattzuba on Twitter
Re: RSS Feeder
« Reply #144 on: January 18, 2009, 05:21:00 PM »
Those having the character problems, I think I've figured out the problem and why it works manually and why it doesn't normally... I'll have to work on this, as it's slightly complicated and I have to trace existing code and figure it out.

Edit: Okay, for anyone having character set problems, try this...

Open ScheduledTasks.php

Code: (Find) [Select]
// Lets do this....
// First grab all of the enabled feeds...
$request = $smcFunc['db_query']('', '
SELECT f.id_feed, f.id_board, t.id_topic, f.icon, f.feedurl, f.postername, f.id_member, f.keywords, f.getfull, f.regex, f.locked, f.approve, f.singletopic, f.topicprefix, f.footer, f.numbertoimport
FROM {db_prefix}rssfeeds as f
LEFT JOIN {db_prefix}topics as t ON (t.id_topic = f.id_topic)
WHERE enabled = 1',
array()
);

Code: (Add BEFORE) [Select]
loadEssentialThemeData();
$context['character_set'] = empty($modSettings['global_character_set']) ? $txt['lang_character_set'] : $modSettings['global_character_set'];

And see if that fixes the problem when it runs on it's own.
« Last Edit: January 18, 2009, 05:39:52 PM by SlammedDime »
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Offline digger

  • Sr. Member
  • ****
  • Posts: 786
  • Gender: Male
    • realdigger on GitHub
    • SMF Russian Community
Re: RSS Feeder
« Reply #145 on: January 18, 2009, 06:06:55 PM »
And see if that fixes the problem when it runs on it's own.

Yes, it fixes the problem.

What about <br> tag ?

Offline Lamarck

  • Jr. Member
  • **
  • Posts: 127
Re: RSS Feeder
« Reply #146 on: January 18, 2009, 08:30:57 PM »
I have the same problem even with that "patch" >___<.

Offline SlammedDime

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 10,276
  • School of Air Ride
    • matt.zuba on Facebook
    • @mattzuba on Twitter
Re: RSS Feeder
« Reply #147 on: January 18, 2009, 10:25:12 PM »
I'm working on a better way to take care of the <br> issue... I tried just making my own function but I realized there was a bit more to do than what I was trying, so I'm trying to implement an 'end all' solution for any possibilty.

Lamarck - Can you link me to a topic on your board that has the problem??
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Offline bloodfire

  • Semi-Newbie
  • *
  • Posts: 15
Re: RSS Feeder
« Reply #148 on: January 18, 2009, 10:34:30 PM »
i guess so too slammeddime.. and to be honest, im glad i did remove it..

for someone to be so ignorant of seo, site marketing etc., they should have taken it as a compliment..

least they could have done is drop me a pm or email on it.. the baby boi sent me 5 spams and then had his  lil friend post up a real manly comment too.. hmm..

Smoky strikes again.. lol..  O:)

Well, all I can think is unless u just use the normal title, short description and link to them (similar to wat moreover.com is displaying for their free rss feeder), it should be alright and legal but if u're grabbing their full article and post it on your website without their permission regardless you have post a link back to them - they still have the right but debatable.

So, the best solution is ask for their permission for the full article grabbing to your website and post the approval on your website then... no more problem... eheheh this is wat i'll be doing before I launch my website :)
« Last Edit: January 18, 2009, 10:36:14 PM by bloodfire »

Offline Smoky "Rider" Blue

  • SMF Hero
  • ******
  • Posts: 1,684
  • Gender: Female
  • It's all in your head! :p
    • smoky.blue.01 on Facebook
Re: RSS Feeder
« Reply #149 on: January 18, 2009, 10:52:00 PM »
good thinking bloodfire, but that is what i had it set to..

no worries tho, and i hope people do learn from this.. ;)

**Take the time to remember friendships and family.. Sometimes it's all we have, and missed very much**

Offline Lamarck

  • Jr. Member
  • **
  • Posts: 127

Offline SlammedDime

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 10,276
  • School of Air Ride
    • matt.zuba on Facebook
    • @mattzuba on Twitter
Re: RSS Feeder
« Reply #151 on: January 19, 2009, 10:13:56 AM »
Something must be wrong with the Regular expression you're trying to use.  It worked just fine for me.  If you turn off the 'retrieve full article' option, does it work fine?

http://dev.ccwlaws.com/forum/index.php?topic=68.0

The regex I used is: ~<div id="cuerpo_noticia">(.*?)</div>~si
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Offline Lamarck

  • Jr. Member
  • **
  • Posts: 127
Re: RSS Feeder
« Reply #152 on: January 19, 2009, 10:43:46 AM »
Ok,I tested it and without the retrieve full article option,It works.It don't work even with your regex if it's enabled.

Offline Drivin and Cryin

  • Semi-Newbie
  • *
  • Posts: 14
Re: RSS Feeder
« Reply #153 on: January 19, 2009, 12:27:58 PM »
Can you link me to which theme you are using?  This mod doesn't make any theme or template changes except to add information to the modifications.english.php, which only the default theme should have in it's language folder.

Sorry for the delay, i'm pretty sure the error was my fault.  I had 1.1.17 installed, and then i upgraded and in the process i forgot to change themes to one that's 2.0 beta 4 friendly.  The theme name was CleanBlue - http://custom.simplemachines.org/themes/index.php?lemma=874

I do have another question.  Is there a limit to the feed length that you can enter?  I've been testing it with ebay rss feeds with an affiliate id, and it strips them out.  When i go back to edit the feed, i notice that it's not all there and i'm guessing there's a character limit to the feed?  Is there any way around this?  Other than that, it's listing them okay, just without an aff id.

If there's a hard limit to the feed length, i may be able to get around this by using a yahoo pipe.  Not sure though, i'm still learning. 
« Last Edit: January 19, 2009, 12:34:18 PM by Drivin and Cryin »

Offline SlammedDime

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 10,276
  • School of Air Ride
    • matt.zuba on Facebook
    • @mattzuba on Twitter
Re: RSS Feeder
« Reply #154 on: January 19, 2009, 12:32:43 PM »
I think I may have limited it to 255 characters to avoid database bloat, but I'll double check when I get home.  Can you post a sample feed that you're using so I have something to test against?
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Offline Drivin and Cryin

  • Semi-Newbie
  • *
  • Posts: 14
Re: RSS Feeder
« Reply #155 on: January 19, 2009, 01:02:11 PM »
I think I may have limited it to 255 characters to avoid database bloat, but I'll double check when I get home.  Can you post a sample feed that you're using so I have something to test against?

I was editing my post while you were replying.  How's that for customer service eh?  :D

Here's a feed with my aff id removed,  since ebay is touchy about posting this stuff on third party boards.  The feed will be the same except for the affid, and the fact that the returned links are  cgi.ebay.com instead of rover.ebay.com.  Keep in mind though that this feed can be MUCH larger than this sample when doing an advanced search and adding keywords to ignore, add bidding options, location options, buying preferences, bid numbers,  etc, etc, etc. 

For instance, a very basic search for  red corvette -

http://rss.api.ebay.com/ws/rssapi?FeedName=SearchResults&siteId=0&language=en-US&output=RSS20&floc=1&afmp=&sacqy=&sacat=-1&fcl=3&sacqyop=ge&satitle=red+corvette&sacur=0&frpp=50&sabfmts=0&dfsp=32&saprclo=&ftrt=1&ftrv=1&saprchi=&saobfmts=exsif&fss=0&catref=C5&saslc=0&saaff=afepn&from=R6&nojspr=y&saslop=1 [nofollow]

If you'd like try a search yourself, you can do an advanced search on ebay and you'll see the form with a large number of options.  Go through that form,  hit search, and then on the results page, if you scroll to the bottom you'll see a tiny rss icon.  Right click on that then copy link location.  That will be the rss feed i'm using.

I know these long urls work well with simple pie, since i use that on another wordpress site to list some auctions.  And i think you mentioned you were using simple pie.

Offline KahneFan

  • SMF Hero
  • ******
  • Posts: 1,850
  • Gender: Male
    • I Post You Post
Re: RSS Feeder
« Reply #156 on: January 20, 2009, 12:53:23 AM »
I just started getting this error for some reason...

Board structure corrupt: unable to find parent board

Offline Smoky "Rider" Blue

  • SMF Hero
  • ******
  • Posts: 1,684
  • Gender: Female
  • It's all in your head! :p
    • smoky.blue.01 on Facebook
Re: RSS Feeder
« Reply #157 on: January 20, 2009, 02:57:45 AM »
on the forum or in the error log??  :o
**Take the time to remember friendships and family.. Sometimes it's all we have, and missed very much**

Offline KahneFan

  • SMF Hero
  • ******
  • Posts: 1,850
  • Gender: Male
    • I Post You Post
Re: RSS Feeder
« Reply #158 on: January 20, 2009, 03:15:34 AM »
When I run it manually from scheduled tasks it gives me that error, which also shows up in the error log after displayed from the run.

Offline SlammedDime

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 10,276
  • School of Air Ride
    • matt.zuba on Facebook
    • @mattzuba on Twitter
Re: RSS Feeder
« Reply #159 on: January 20, 2009, 05:12:28 AM »
If you run 'Find and Repair errors' on your board, does it return anything having to do with your boards?

The error is not caused by the mod, but rather the update functions after a post is created....
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...