summaryrefslogtreecommitdiff
path: root/data/rbot/plugins/url.rb
AgeCommit message (Collapse)Author
2007-05-11+ (plugins/delicious) automatic url logging to del.icio.us (alpha)Dmitry Kim
+ (plugins/url) logging hook / event
2007-04-24* (plugins/url) don't download (and don't cache) non-text urlsDmitry Kim
2007-04-15HttpUtil: fix gunzipping with partial content; and debug response in url ↵Giuseppe Bilotta
plugin earlier
2007-04-14url plugin: return nil when we return nothingGiuseppe Bilotta
2007-04-12Module\#define_structure method: define a new Struct only if doesn't exist ↵Giuseppe Bilotta
already or if the attribute list changed
2007-04-12url plugin: search for user-provided string in urls info too; and truly ↵Giuseppe Bilotta
update url info when it wasn't present before
2007-04-12url plugin: store info with urls, optionally display it when listing or ↵Giuseppe Bilotta
searching for urls
2007-04-11HttpUtil: decompress gzipped body in partial_body too; whitespace cleanup tooGiuseppe Bilotta
2007-04-11url plugin: revert to block get_response and partial_body to work around ↵Giuseppe Bilotta
sites which return 400 on partial content
2007-04-08url plugin: show value of content-encoding if presentGiuseppe Bilotta
2007-04-07plugins: remove excess requires and Net::HTTP.version setupsGiuseppe Bilotta
2007-04-05url plugin: echo all info on a single line, and use commas to separate ↵Giuseppe Bilotta
thousands when reporting object size
2007-04-05* (url) fix response size reporting for ranged responsesDmitry Kim
2007-04-04imdb plugin: show popular movies acted/directed when finding peopleGiuseppe Bilotta
2007-03-30*** (httputil) major rework, new caching implementation, unified requestDmitry Kim
processing + (httputil) post support, partial request support, other features - (httputil) removed partial_body() and get_cached() [merged into get()] * (plugins/, utils) minimal changes to accomodate for the new http_utils * (utils, ircbot) moved utils initialization into utils.rb * (tube.rb) (partially) accomodate for upstream site layout changes
2007-03-26url plugins: when echoing first par, be more clear on what's being done and ↵Giuseppe Bilotta
don't spam with overlong messages
2007-03-25url plugin: url.first_par option. when enabled, the url plugin will attempt ↵Giuseppe Bilotta
to retrieve the first paragraph of a linked web page
2007-03-25url plugin: customizable max amount of data to retrieve to look for a title. ↵Giuseppe Bilotta
return standard header info if no title found
2007-03-24httputil and url plugin improvements, see ChangeLogGiuseppe Bilotta
2007-03-24url plugin: when reading body chunks, don't discard read materialGiuseppe Bilotta
2007-03-14Added config option: "url.titles_only"Chris Gahan
2006-10-24Whitespace cleanup in url.rbGiuseppe Bilotta
2006-10-24Trap a possible exception when getting URL titles, even though nothing is ↵Giuseppe Bilotta
actually done to handle it
2006-10-14Make use of Utils.decode_html_entitiesGiuseppe Bilotta
2006-10-13Fine tune url pluginGiuseppe Bilotta
2006-07-24Revert the Struct.new-related changes because they don't do what we wantGiuseppe Bilotta
2006-07-24[257] was moot, this is the propert way to prevent Structs from being ↵Giuseppe Bilotta
created twice
2006-07-24Suppress the warnings for Struct redefinition on rescanGiuseppe Bilotta
2006-07-21Whoops, typo. My bad.Alexander Beisig
2006-07-21Disabled sending URL info to the channel by default, as several people Alexander Beisig
found it quite annoying. Can be reenabled with url.display_link_info
2006-07-20Clean up logging from the pluginsGiuseppe Bilotta
2006-02-22Fixed some bugs (should stop showing #<Net::something...> objects, handles ↵Chris Gahan
MovedPermanently which is a different errorcode from a Redirect...)
2006-02-09Stupid lack of a User-Agent was breaking a bunch of servers (403 errors). FIXED.Chris Gahan
2006-02-09Little tweak to fix an edge-case.Chris Gahan
2006-02-09Changed the way the URL grabber gets urls. Instead of using HEAD, it uses ↵Chris Gahan
GET, but only grabs the first 50k of the page to check it for a header.
2006-02-03More translation codes! (this function should go in the httputil module ↵Chris Gahan
eventually)
2006-02-03Since the CGI::unescapeHTML is pretty crappy, I added my own &thing; Chris Gahan
translator (that uses IRC-printable characters).
2006-02-02Searching for text in the URL history is now case-insensitive.Chris Gahan
2006-02-02Set a limit on the number of redirects...Chris Gahan
2006-01-30A fix for the case where a crappy webserver labels a giant file (like a ↵Chris Gahan
.rar) as text/plain and the bot tries to download it.
2006-01-28Whoops! I renamed the config setting in one place and not another...Chris Gahan
2006-01-28opme now says okay BEFORE opping!Chris Gahan
2006-01-27Fixed a bug that cut off the query-part of the url, cleaned up the redirect ↵Chris Gahan
url joining.
2006-01-26Whoops, forgot to ungreedy the <title>-finding regexes.Chris Gahan
2006-01-26Fixed a bunch of bugs:Chris Gahan
* Now uses the @bot.httputil proxy * Broken URLs weren't working because I forgot to rename a variable :P~~ * Left out [Link Info] from the error messages * Surprise bugfix! (i forget what it was :D)
2006-01-26Added some nice new features to the URL-titles extension.Chris Gahan
For example: Doesn't cause rbot to explode when a link to a huge file is pasted, displays filesize information about non-HTML files, converts weird html &stuff; characters to ascii characters, handles multiple <title> tags properly.
2006-01-26TODO - work out why httputil with proxies doesn't like a head then a get onTom Gilbert
the same object.... workaround for now..
2006-01-26reinstate the use of the bot's httputil. As soon as I tried this at work ITom Gilbert
realised we lost proxy support.
2006-01-26From Chris:Tom Gilbert
There was a bit of a glitch in that title grabber extension I wrote to the URL plugin -- namely, that it would just mindlessly download whatever link anybody posted to the channel. Whenever anybody posted a bigass quicktime movie or something, the bot would explode. So, I had to get down and dirty with Net::HTTP to check for mimetypes and redirects and stuff. There is a nice new feature though: 22:37 <@epitron> http://killswitchengage.com/shared/downloads/KillswitchEngage/KsE-RoseOfSharyn_v ideo.mov 22:37 <@pookie> [Link Info] type: video/quicktime, size: 18,244,208 bytes
2006-01-20new submission from ChrisTom Gilbert