Go Back   DevHunters Webmaster Forum > Webmaster / Coding / Web Design Discussion > Scripts, Mods, and Templates > Miscellaneous

Miscellaneous Discuss Directory related items in this board.

An Open Source Web Spider and Search Engine.

This is a discussion on An Open Source Web Spider and Search Engine. within the Miscellaneous forums, part of the Scripts, Mods, and Templates category; OpenWebSpider The OpenWebSpider project was born from the idea that internet is free and all informations must be freely available ...

Reply
 
LinkBack Thread Tools Display Modes
Old 03-30-2008, 03:06 PM   #1
Field Master
 
naziajabeen's Avatar
 
Join Date: Aug 2007
Location: Multan Pakistan
Posts: 276
HB$ Balance: 0
naziajabeen has a spectacular aura aboutnaziajabeen has a spectacular aura aboutnaziajabeen has a spectacular aura about
iTrader: (1)
Send a message via MSN to naziajabeen Send a message via Yahoo to naziajabeen
Lightbulb An Open Source Web Spider and Search Engine.

OpenWebSpider
The OpenWebSpider project was born from the idea that internet is free and all informations must be freely available for all users!
Using all free software and being Open Source, OpenWebSpider would be the base for a new Search engine developed from a community of opensource
developers!


for download and more details Click here
Sorry that I could not attach the script here because files size is 1.3MB but attachment allows only 448Kb for zip files...
You can download it from the above site...
naziajabeen is offline   Reply With Quote
Old 04-02-2008, 09:14 AM   #2
New Hunter
 
bitslinker.com's Avatar
 
Join Date: Mar 2008
Posts: 56
HB$ Balance: 0
bitslinker.com is on a distinguished road
iTrader: (0)
Default

its really nice,
but don't you think so that its hard to run a search engine because there are big fishes in market like and yahoo?
__________________
free web based proxy
http://www.fxan.net
Computer Tips n Tricks Forum
http://www.bitslinker.com
bitslinker.com is offline   Reply With Quote
Old 04-02-2008, 09:17 AM   #3
Field Master
 
karthikeyan's Avatar
 
Join Date: Jun 2007
Posts: 617
HB$ Balance: 509.00
karthikeyan is on a distinguished road
iTrader: (0)
Send a message via MSN to karthikeyan Send a message via Yahoo to karthikeyan
Default

wow thanks a lot naziajabeen nice work !

But i don't know what language the script is written
__________________
--------


The Technology Guide
karthikeyan is offline   Reply With Quote
Old 04-02-2008, 01:11 PM   #4
Field Master
 
naziajabeen's Avatar
 
Join Date: Aug 2007
Location: Multan Pakistan
Posts: 276
HB$ Balance: 0
naziajabeen has a spectacular aura aboutnaziajabeen has a spectacular aura aboutnaziajabeen has a spectacular aura about
iTrader: (1)
Send a message via MSN to naziajabeen Send a message via Yahoo to naziajabeen
Default

Quote:
Originally Posted by karthikeyan View Post
wow thanks a lot naziajabeen nice work !

But i don't know what language the script is written
Lolz I also dont know I just search it on the site and like to share here with you all my sweet friends.. To inform you all that we can also create our search engines like other SE
naziajabeen is offline   Reply With Quote
Old 05-16-2008, 05:55 PM   #5
Field Master
 
john's Avatar
 
Join Date: Sep 2007
Location: Europe - Greece
Posts: 322
HB$ Balance: 18.00
john is a jewel in the roughjohn is a jewel in the roughjohn is a jewel in the roughjohn is a jewel in the rough
iTrader: (1)
Default

hmm and so? any advantages of this one than the other se? i don't think so :) :(
__________________
Photoshop tutorials Free quality collection of Photoshop tutorials. http://photoshoptutorials.eu
Online free dictionary find the word definition

Last edited by john; 05-16-2008 at 05:57 PM.
john is offline   Reply With Quote
Old 05-16-2008, 07:53 PM   #6
Senior Hunter
 
SpOrTsDuDe.Reese's Avatar
 
Join Date: Jan 2008
Location: Whiteford, MD
Posts: 1,128
HB$ Balance: 586.00
SpOrTsDuDe.Reese is a glorious beacon of lightSpOrTsDuDe.Reese is a glorious beacon of lightSpOrTsDuDe.Reese is a glorious beacon of lightSpOrTsDuDe.Reese is a glorious beacon of lightSpOrTsDuDe.Reese is a glorious beacon of lightSpOrTsDuDe.Reese is a glorious beacon of light
iTrader: (1)
Send a message via AIM to SpOrTsDuDe.Reese
Default

Hmm, can't believe I didn't see this thread. Where do I download it?
__________________
Looking for HTML/CSS work. If interested in hiring, please Use my site

/* CSS guru */
SpOrTsDuDe.Reese is offline   Reply With Quote
Old 05-16-2008, 08:00 PM   #7
Senior Designer (Staff)
 
Join Date: Mar 2007
Location: Dhaka, Bangladesh.
Posts: 29
HB$ Balance: 10.00
moinuddin102 is a jewel in the roughmoinuddin102 is a jewel in the roughmoinuddin102 is a jewel in the roughmoinuddin102 is a jewel in the rough
iTrader: (0)
Default

Quote:
Originally Posted by SpOrTsDuDe.Reese View Post
Hmm, can't believe I didn't see this thread. Where do I download it?
download from here: OpenWebSpider - Download


& file written with C.
__________________
TE9 Free Templates
Free templates for PHP Link Directory, Wordpress (more is coming ...)
moinuddin102 is offline   Reply With Quote
Old 07-17-2008, 08:04 AM   #8
New Hunter
 
teampower's Avatar
 
Join Date: Mar 2008
Posts: 33
HB$ Balance: 0
teampower will become famous soon enough
iTrader: (0)
Send a message via Yahoo to teampower
Default

anyone have live demo
teampower is offline   Reply With Quote
Old 12-12-2008, 12:02 AM   #9
New Hunter
 
Join Date: Dec 2008
Posts: 47
HB$ Balance: 0
HunterBennett is on a distinguished road
iTrader: (0)
Default

good project
i`m join
HunterBennett is offline   Reply With Quote
Old 07-07-2009, 07:55 AM   #10
New Hunter
 
Join Date: Jun 2009
Posts: 47
HB$ Balance: 0
zheng0836 is on a distinguished road
iTrader: (0)
Default

i think it is hard to run a search engine ,hehe
zheng0836 is offline   Reply With Quote
Old 07-30-2009, 01:39 PM   #11
New Hunter
 
Join Date: May 2009
Posts: 19
HB$ Balance: 0
udeze is on a distinguished road
iTrader: (0)
Default

yes I agree with you, I think it will be very hard to run a search engine that will compete with big players like Google, going by the facilities they already have on ground, except if the SE will be targeted specifically to a particular Niche, eg - a search engine for businesses in a particular location, or a search engine for a specific industry (eg Oil and Gas) even at that level it's still a bit hard
udeze is offline   Reply With Quote
Old 10-01-2009, 04:44 AM   #12
New Hunter
 
Join Date: Oct 2009
Posts: 3
HB$ Balance: 0
jasmin is on a distinguished road
iTrader: (0)
Default

It's interesting that you should have brought it up. I've been doing some research and what you have mention does work, to a certain extend.
jasmin is offline   Reply With Quote
Old 12-18-2009, 03:05 AM   #13
New Hunter
 
Join Date: Dec 2009
Posts: 16
HB$ Balance: 0
KRAKOSKI is on a distinguished road
iTrader: (0)
Default

Thank you for that wondrous tip Use search engine capabilities to find specific info. robotstxt.org web spider and search engine written in PHP, using MySQL as its back end database and flat files it builds a glossary with words found in indexed static and dynamic pages if you have a meta tag that defines the page, and then no text to match that tag, it will not keep that information due to the lack of relevancy it is a great tool for adding search functionality to your web site or building your custom search engine. Sphider is small, easy to set up and modify, and is used in thousands of websites across the world.
Thanks again naziajabeen! This is great stuff!
__________________
wrapping supplies
KRAKOSKI is offline   Reply With Quote
Old 01-02-2010, 08:11 AM   #14
New Hunter
 
Join Date: Dec 2009
Posts: 25
HB$ Balance: 0
altec is on a distinguished road
iTrader: (0)
Default

thank you for the very good information, but i strongly agree that its very hard to run the search engine
__________________
first home saver account
altec is offline   Reply With Quote
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -5. The time now is 02:59 PM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2010, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.3.2
vBCredits v1.4 Copyright ©2007 - 2008, PixelFX Studios