Welcome, Guest. Please login or register.
May 16, 2008, 13:30:34 PM
Home Help Search Member Map Calendar Login Register
News: Youve been Beambled!!!!

Sponsored Links


Yesterday at 23:38:50 dogsmum - Night 'Izzy'
Yesterday at 18:28:12 Taf - Hot swirling gases... I could be planet forming...
Yesterday at 18:21:54 Lisa - you always fart
Yesterday at 17:54:47 Taf - Pea soup + Taf = taf
Yesterday at 14:41:12 Taf - Rumbling belly time.... must cook, must eat...
Total Twaddle  |  Idle Chat.  |  Useful Twaddle  |  Totally Computers  |  Topic: Tool for searching a page for a keyword 0 Members and 1 Guest are viewing this topic. « previous next »
Pages: [1] Go Down Print
Author Topic: Tool for searching a page for a keyword  (Read 988 times)
kriskd
Mistress Kris
Gasbag Member
****
United States

Lovability: 21
Offline Offline

Gender: Female
Posts: 8684


Forum Junkie


Awards Stats
« on: August 24, 2007, 09:15:58 AM »

I'm wondering if any of you know of a tool that would do something for me.  I'm thinking Google might have something.

Anyway, look at this page:

http://www.ci.madison.wi.us/police/eastnews/Eastnews.html

I want something that will visit all those date links, do a search for some keywords (in my case it will be street names in my neighborhood) and then somehow inform me of that bit of text so I can post that info on my website.  It would have to do that as new reports were posted.

If anyone has any ideas of how to automate this, I'd appreciate it.  I really have no interest in manually picking through all those reports and looking for the stuff I want.
Logged

(\__/)
(='.'=) This is Bunny. Copy and paste bunny into your
(")_(") signature to help him gain world domination.
Lisa
Salty Goodness
Admin
Resident Twaddler
*******
Wales

Lovability: 476
Offline Offline

Gender: Female
Posts: 80098



WWW Awards Stats

Champion of
    
    
    
    

More>>
« Reply #1 on: August 24, 2007, 13:28:05 PM »

the only way i can think of at the top of my head is to do a search with google/yahoo just on that site.
But thats not automated.
Your other option is RSS, which they don't appear to support.

HMMM

I reckon there must be something automated out there, i'll have a dig around after dinner
Logged

If tears could build a stairway, and memories a lane. I'd walk right up to heaven to bring you home again.
Supreme Ruler of Lissyland
Total Twaddle Desktop Image
Admiral-SirJohn
Restricted
Not Posted

United States

Lovability: 0
Offline Offline

Posts: 0


Awards Stats
« Reply #2 on: August 24, 2007, 13:33:52 PM »

(I can't believe I'm suggesting this...)

What you're looking for is known as a data miner, and is commonly used by spammers.

I don't know of any offhand, but I'm sure if you feed the term into a search engine or two, you'll find something that will work.
Logged
Lisa
Salty Goodness
Admin
Resident Twaddler
*******
Wales

Lovability: 476
Offline Offline

Gender: Female
Posts: 80098



WWW Awards Stats

Champion of
    
    
    
    

More>>
« Reply #3 on: August 24, 2007, 19:51:29 PM »

not found anything yet Undecided
Logged

If tears could build a stairway, and memories a lane. I'd walk right up to heaven to bring you home again.
Supreme Ruler of Lissyland
Total Twaddle Desktop Image
Admiral-SirJohn
Restricted
Not Posted

United States

Lovability: 0
Offline Offline

Posts: 0


Awards Stats
« Reply #4 on: August 24, 2007, 20:04:28 PM »

Dunno if any of these can be automated, but something here might work...

http://www.freedownloadscenter.com/Web_Authoring/Search_Authoring_Tools/
Logged
Lisa
Salty Goodness
Admin
Resident Twaddler
*******
Wales

Lovability: 476
Offline Offline

Gender: Female
Posts: 80098



WWW Awards Stats

Champion of
    
    
    
    

More>>
« Reply #5 on: August 25, 2007, 19:13:10 PM »

http://www.filebuzz.com/files/automatic_search/1.html

the first one looks a possibility.. not sure if you can set it to search on it's own at set times though
Logged

If tears could build a stairway, and memories a lane. I'd walk right up to heaven to bring you home again.
Supreme Ruler of Lissyland
Total Twaddle Desktop Image
kriskd
Mistress Kris
Gasbag Member
****
United States

Lovability: 21
Offline Offline

Gender: Female
Posts: 8684


Forum Junkie


Awards Stats
« Reply #6 on: August 25, 2007, 19:19:07 PM »

Thank you both ASJ and Lisa for doing a little research for me.  Smiley

http://www.filebuzz.com/files/automatic_search/1.html

the first one looks a possibility.. not sure if you can set it to search on it's own at set times though

Some excellent possibilities here!  I'm not really in need of something to search on it's own, but rather something that will get me through the archives of months on this site and then I will return monthly to do the search on the new report.

I'll have to try some of these out!
Logged

(\__/)
(='.'=) This is Bunny. Copy and paste bunny into your
(")_(") signature to help him gain world domination.
Lisa
Salty Goodness
Admin
Resident Twaddler
*******
Wales

Lovability: 476
Offline Offline

Gender: Female
Posts: 80098



WWW Awards Stats

Champion of
    
    
    
    

More>>
« Reply #7 on: August 25, 2007, 19:26:35 PM »

Welcome. Cheesy
Logged

If tears could build a stairway, and memories a lane. I'd walk right up to heaven to bring you home again.
Supreme Ruler of Lissyland
Total Twaddle Desktop Image
kriskd
Mistress Kris
Gasbag Member
****
United States

Lovability: 21
Offline Offline

Gender: Female
Posts: 8684


Forum Junkie


Awards Stats
« Reply #8 on: March 30, 2008, 20:44:55 PM »

Guess what?  I figured this out and here are my results:

http://www.sprechereast.com/view/police-excerpts

Thanks to my PHP class, I was able to write a little script that visits each of these pages and searches for the street in question and then gives back a line of text and the URL that text was on.  I still had to re-visit the page to make sure I got all the appropriate text, but it still worked pretty slick and I was able to put what I've learned in class to use in the "real world"!
Logged

(\__/)
(='.'=) This is Bunny. Copy and paste bunny into your
(")_(") signature to help him gain world domination.
Pages: [1] Go Up Print 
Total Twaddle  |  Idle Chat.  |  Useful Twaddle  |  Totally Computers  |  Topic: Tool for searching a page for a keyword « previous next »
Jump to:  


Login with username, password and session length

Powered by MySQL Powered by PHP Powered by SMF 1.1.5 | SMF © 2006-2008, Simple Machines LLC Valid XHTML 1.0! Valid CSS!


Google visited last this page Today at 00:09:04
Mortgage - Flights - Car Insurance - Credit Cards