Comments on: RSS::FeedFinder -> grace-driven or totally permiscious? http://healyourchurchwebsite.com/2003/04/25/rssfeedfinder-grace-driven-or-totally-permiscious/ Teaching, rebuking, correcting & training in righteous web design. Mon, 04 Jan 2010 07:25:04 +0000 http://wordpress.org/?v=2.9 hourly 1 By: Mean Dean http://healyourchurchwebsite.com/2003/04/25/rssfeedfinder-grace-driven-or-totally-permiscious/comment-page-1/#comment-877 Mean Dean Fri, 25 Apr 2003 13:47:13 +0000 http://healyourchurchwebsite.com/2003/04/25/rssfeedfinder-grace-driven-or-totally-permiscious#comment-877 Mark, Excellent suggestions! I won't have time to get to them till early next week, but you're so right about robots.txt. And thanks for the headsup on application/xml -- I get so bleary eyed at 3 am !-) Mark,

Excellent suggestions! I won’t have time to get to them till early next week, but you’re so right about robots.txt.

And thanks for the headsup on application/xml — I get so bleary eyed at 3 am !-)

]]> By: Mark http://healyourchurchwebsite.com/2003/04/25/rssfeedfinder-grace-driven-or-totally-permiscious/comment-page-1/#comment-876 Mark Fri, 25 Apr 2003 12:27:48 +0000 http://healyourchurchwebsite.com/2003/04/25/rssfeedfinder-grace-driven-or-totally-permiscious#comment-876 Actually, the cite is now http://diveintomark.org/archives/2002/08/15/ultraliberal_rss_locator.html And the project you probably want to look at it http://diveintomark.org/projects/rss_finder/ , not rss_parser. Two small things: 1. Set your User-Agent to something specific and obey robots.txt as you're following links. I believe there's a RobotUA module for this purpose. http://search.cpan.org/dist/libwww-perl/lib/LWP/RobotUA.pm 2. Content-type can be application/xml, application/rdf+xml, application/rss+xml. Not just text/... (Hell, I've seen RSS feeds served as text/html, but whatever. Some people are just beyond saving.) Other than that, very cool. I'm all for smart software that works hard for me. Actually, the cite is now http://diveintomark.org/archives/2002/08/15/ultraliberal_rss_locator.html

And the project you probably want to look at it http://diveintomark.org/projects/rss_finder/ , not rss_parser.

Two small things:
1. Set your User-Agent to something specific and obey robots.txt as you’re following links. I believe there’s a RobotUA module for this purpose. http://search.cpan.org/dist/libwww-perl/lib/LWP/RobotUA.pm

2. Content-type can be application/xml, application/rdf+xml, application/rss+xml. Not just text/… (Hell, I’ve seen RSS feeds served as text/html, but whatever. Some people are just beyond saving.)

Other than that, very cool. I’m all for smart software that works hard for me.

]]>