• Welcome to Simple Machines Community Forum. Please login or sign up.
January 19, 2022, 05:08:42 AM

News:

Want to get involved in developing SMF, then why not lend a hand on our github!


RSS Feeder

Started by SlammedDime, January 11, 2009, 06:06:42 AM

Previous topic - Next topic

KahneFan

I could be wrong, but as long as you reference the original source, shouldn't that be OK... especially if they are OFFERING a feed?
#eric_on_twit| (video) Creating Themes for SMF | Reset Your Forum
NOTE: No PM's for support please.

Smoky "Rider" Blue

hmm well he is offereing, if anyone wants him.. but he needs to get his web design figured out..

not sure if you want his stuff or not but hey lmao

info is there.

im just wondering, is it or is it not illegal? hmm

and for him to call me a scraper?? gesh.. little sissy boy.. where is my whip??  >:(

**Take the time to remember friendships and family.. Sometimes it's all we have, and missed very much**

SlammedDime

As stupid as it is, they are well within their rights to ask you to remove their content.  I don't understand why they would even want RSS feeds if they didn't want a way to get their info out....

Their loss I suppose.
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Smoky "Rider" Blue

i guess so too slammeddime.. and to be honest, im glad i did remove it..

for someone to be so ignorant of seo, site marketing etc., they should have taken it as a compliment..

least they could have done is drop me a pm or email on it.. the baby boi sent me 5 spams and then had his  lil friend post up a real manly comment too.. hmm..

Smoky strikes again.. lol..  O:)
**Take the time to remember friendships and family.. Sometimes it's all we have, and missed very much**

SlammedDime

January 18, 2009, 05:21:00 PM #144 Last Edit: January 18, 2009, 05:39:52 PM by SlammedDime
Those having the character problems, I think I've figured out the problem and why it works manually and why it doesn't normally... I'll have to work on this, as it's slightly complicated and I have to trace existing code and figure it out.

Edit: Okay, for anyone having character set problems, try this...

Open ScheduledTasks.php

Code (Find) Select

// Lets do this....
// First grab all of the enabled feeds...
$request = $smcFunc['db_query']('', '
SELECT f.id_feed, f.id_board, t.id_topic, f.icon, f.feedurl, f.postername, f.id_member, f.keywords, f.getfull, f.regex, f.locked, f.approve, f.singletopic, f.topicprefix, f.footer, f.numbertoimport
FROM {db_prefix}rssfeeds as f
LEFT JOIN {db_prefix}topics as t ON (t.id_topic = f.id_topic)
WHERE enabled = 1',
array()
);


Code (Add BEFORE) Select

loadEssentialThemeData();
$context['character_set'] = empty($modSettings['global_character_set']) ? $txt['lang_character_set'] : $modSettings['global_character_set'];


And see if that fixes the problem when it runs on it's own.
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

digger

Quote from: SlammedDime on January 18, 2009, 05:21:00 PM
And see if that fixes the problem when it runs on it's own.

Yes, it fixes the problem.

What about <br> tag ?

Lamarck

I have the same problem even with that "patch" >___<.

SlammedDime

I'm working on a better way to take care of the <br> issue... I tried just making my own function but I realized there was a bit more to do than what I was trying, so I'm trying to implement an 'end all' solution for any possibilty.

Lamarck - Can you link me to a topic on your board that has the problem??
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

bloodfire

January 18, 2009, 10:34:30 PM #148 Last Edit: January 18, 2009, 10:36:14 PM by bloodfire
Quote from: SmokyBlue on January 18, 2009, 05:09:32 AM
i guess so too slammeddime.. and to be honest, im glad i did remove it..

for someone to be so ignorant of seo, site marketing etc., they should have taken it as a compliment..

least they could have done is drop me a pm or email on it.. the baby boi sent me 5 spams and then had his  lil friend post up a real manly comment too.. hmm..

Smoky strikes again.. lol..  O:)

Well, all I can think is unless u just use the normal title, short description and link to them (similar to wat moreover.com [nofollow] is displaying for their free rss feeder), it should be alright and legal but if u're grabbing their full article and post it on your website without their permission regardless you have post a link back to them - they still have the right but debatable.

So, the best solution is ask for their permission for the full article grabbing to your website and post the approval on your website then... no more problem... eheheh this is wat i'll be doing before I launch my website :)

Smoky "Rider" Blue

good thinking bloodfire, but that is what i had it set to..

no worries tho, and i hope people do learn from this.. ;)

**Take the time to remember friendships and family.. Sometimes it's all we have, and missed very much**


SlammedDime

Something must be wrong with the Regular expression you're trying to use.  It worked just fine for me.  If you turn off the 'retrieve full article' option, does it work fine?

http://dev.ccwlaws.com/forum/index.php?topic=68.0

The regex I used is: ~<div id="cuerpo_noticia">(.*?)</div>~si
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Lamarck

Ok,I tested it and without the retrieve full article option,It works.It don't work even with your regex if it's enabled.

Drivin and Cryin

January 19, 2009, 12:27:58 PM #153 Last Edit: January 19, 2009, 12:34:18 PM by Drivin and Cryin
Quote from: SlammedDime on January 16, 2009, 01:14:37 PM
Can you link me to which theme you are using?  This mod doesn't make any theme or template changes except to add information to the modifications.english.php, which only the default theme should have in it's language folder.

Sorry for the delay, i'm pretty sure the error was my fault.  I had 1.1.17 installed, and then i upgraded and in the process i forgot to change themes to one that's 2.0 beta 4 friendly.  The theme name was CleanBlue - http://custom.simplemachines.org/themes/index.php?lemma=874

I do have another question.  Is there a limit to the feed length that you can enter?  I've been testing it with ebay rss feeds with an affiliate id, and it strips them out.  When i go back to edit the feed, i notice that it's not all there and i'm guessing there's a character limit to the feed?  Is there any way around this?  Other than that, it's listing them okay, just without an aff id.

If there's a hard limit to the feed length, i may be able to get around this by using a yahoo pipe.  Not sure though, i'm still learning. 

SlammedDime

I think I may have limited it to 255 characters to avoid database bloat, but I'll double check when I get home.  Can you post a sample feed that you're using so I have something to test against?
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Drivin and Cryin

Quote from: SlammedDime on January 19, 2009, 12:32:43 PM
I think I may have limited it to 255 characters to avoid database bloat, but I'll double check when I get home.  Can you post a sample feed that you're using so I have something to test against?

I was editing my post while you were replying.  How's that for customer service eh?  :D

Here's a feed with my aff id removed,  since ebay is touchy about posting this stuff on third party boards.  The feed will be the same except for the affid, and the fact that the returned links are  cgi.ebay.com [nofollow] instead of rover.ebay.com [nofollow].  Keep in mind though that this feed can be MUCH larger than this sample when doing an advanced search and adding keywords to ignore, add bidding options, location options, buying preferences, bid numbers,  etc, etc, etc. 

For instance, a very basic search for  red corvette -

http://rss.api.ebay.com/ws/rssapi?FeedName=SearchResults&siteId=0&language=en-US&output=RSS20&floc=1&afmp=&sacqy=&sacat=-1&fcl=3&sacqyop=ge&satitle=red+corvette&sacur=0&frpp=50&sabfmts=0&dfsp=32&saprclo=&ftrt=1&ftrv=1&saprchi=&saobfmts=exsif&fss=0&catref=C5&saslc=0&saaff=afepn&from=R6&nojspr=y&saslop=1 [nofollow]

If you'd like try a search yourself, you can do an advanced search on ebay and you'll see the form with a large number of options.  Go through that form,  hit search, and then on the results page, if you scroll to the bottom you'll see a tiny rss icon.  Right click on that then copy link location.  That will be the rss feed i'm using.

I know these long urls work well with simple pie, since i use that on another wordpress site to list some auctions.  And i think you mentioned you were using simple pie.

KahneFan

I just started getting this error for some reason...

Board structure corrupt: unable to find parent board
#eric_on_twit| (video) Creating Themes for SMF | Reset Your Forum
NOTE: No PM's for support please.

Smoky "Rider" Blue

on the forum or in the error log??  :o
**Take the time to remember friendships and family.. Sometimes it's all we have, and missed very much**

KahneFan

When I run it manually from scheduled tasks it gives me that error, which also shows up in the error log after displayed from the run.
#eric_on_twit| (video) Creating Themes for SMF | Reset Your Forum
NOTE: No PM's for support please.

SlammedDime

If you run 'Find and Repair errors' on your board, does it return anything having to do with your boards?

The error is not caused by the mod, but rather the update functions after a post is created....
SlammedDime
Former Lead Customizer
BitBucket Projects
GeekStorage.com Hosting
                      My Mods
SimpleSEF
Ajax Quick Reply
Sitemap
more...
                     

Advertisement: