New Search Engine

Acer2000 · 12-29-2007, 07:53 AM

Hi,

I always check with you guys for advice.

I would like to start a new search engine similar to google or yahoo but without the candies they offer. What does it take? What type of computer do I need? How many computers, hard disk drives, what software, in short: How do I start?

I need you advice. I would like to start a search engine, a powerful one!

I am serious but I lack the IT skills needed to do it. I can create websites, I have the time and money to do it.

Skie · 12-29-2007, 09:35 AM

What you need is someone to do the programming for the searching on your site as well as to create a spider to go out and collect data on all the websites it can find. The size of your hard drive will depend on how much data you'll be storing. Ideally, you'll want a NAS or SAN setup to handle the storage. The number of computers will depend on how much traffic you're getting. It's always best to start small and work your way up as you need to.

However, keep in mind that between Google, Yahoo and MSN, those 3 have around 95% of the search traffic. In order for you to compete with them, you'll need a good product. It may take you several years at least before anyone even knows about you.

Acer2000 · 12-29-2007, 01:34 PM

Thank you very much for your reply.

Ideally, you'll want a NAS or SAN setup

What is NAS or SAN? Please advice me.

When you say small, how many computers do you think will I need at first? HDD are huge these days and are quite affordable. So I can hook up several giant HDD to one computer.

I have a good plan in mind that is why I think I can compete with the giants.

Please tell me more. I need more information. Thank you very much. If you prefer, you can send me a private message.

Skie · 12-29-2007, 06:25 PM

NAS = Network Attached Storage. SAN is similar, but I can't remember what the letters stand for. Basically, you can increase the storage space in the NAS without even touching any of the servers that are using it. And they can make use of the extra storage immediately.

1 server can handle a decent amount of traffic. But that all depends on what kind of content you're providing. Obviously static HTML pages require very little CPU power. Dynamic pages like PHP, CGI, ASP, etc will require more CPU power. Same thing if you're using a database. It also depends on how well optimized your code is. Without knowing all the variables, it's hard to say how many servers you'll need. Start with one and work your way up.

Acer2000 · 12-31-2007, 01:55 PM

Hi,

Thank you very much for your reply. What OS would I use? I know how to install Suse Linux 9.0

I have another question, where can I get the latest version of SUSE LINUX? I know the latest version is version 10.2, I need the exact download link so I can save it to my desktop right away and burn it on a DVD Disc.

Would sooo much appreciate your help. Thank you

Happy New Year

Skie · 01-01-2008, 09:38 AM

What OS you use should be determined by what you know how to use. I personally prefer Linux, but if you don't know how to use it or properly secure it, you're asking to be hacked. You can get SUSE at opensuse.org

Acer2000 · 01-01-2008, 09:58 AM

Hi,

I selected the download method as standard (ftp or http)

The installation medium DVD

And 32 Bit PC

It is downloading right now, and I can see that it placed a zipped file on my desktop, is that ok? Please advice me

Happy New Year to you

Acer2000 · 01-01-2008, 10:26 AM

Ok. Download in progress. Thank you very much.

Acer2000 · 01-01-2008, 10:52 AM

I just have a question, is this OS, Open Suse the right one to use to set up a server that will host a search engine? Please advice me. Thank you

Skie · 01-02-2008, 08:45 AM

They're all about the same. Generally, I prefer CentOS for servers. OpenSUSE is more for desktops/home users. SUSE does have a Server version, but I don't think it's free.

Acer2000 · 01-02-2008, 02:24 PM

Thank you for your reply.

I have downloaded this huge file, it was in zip format and so I had unzipped it now. It shows a huge yellow folder on my desktop, now I read the information on the novel page but they mention an iso image that must be burned on a DVD. Please help me here , I am really helpless.

I have nero express on my PC.

Thank you

Skie · 01-02-2008, 06:55 PM

I'm not sure wha this "yellow folder" is, but right click on it and select properties. It should be an ISO file. If not, I'm not sure what you downloaded. Once you have an ISO file, you need to use the Burn ISO feature within Nero to burn the file to CD or DVD. You can't do it the normal way you burn a disc. I'm not familiar with Nero, so you'll need to ask someone else or search for the instructions on how to burn an ISO.

Acer2000 · 01-02-2008, 07:17 PM

It is not an iso file. It is Gb 4.1 in size.

Please advice

Skie · 01-03-2008, 06:19 AM

Like I said, I don't know what you downloaded unless you can tell me what it is.

bigmikey · 01-10-2008, 10:29 PM

You can get search engine scripts out there.

but if u had some knowledge of php that would u somewhere.

12-29-2007, 07:53 AM	#1 (permalink)
Acer2000 Registered User Join Date: Sep 2006 Posts: 467 OS: XP Home Service Pack 2	New Search Engine Hi, I always check with you guys for advice. I would like to start a new search engine similar to google or yahoo but without the candies they offer. What does it take? What type of computer do I need? How many computers, hard disk drives, what software, in short: How do I start? I need you advice. I would like to start a search engine, a powerful one! I am serious but I lack the IT skills needed to do it. I can create websites, I have the time and money to do it.

12-29-2007, 09:35 AM	#2 (permalink)
Skie Manager, Alternative Comp Join Date: Mar 2003 Location: Chicago burbs Posts: 2,194 OS: Gentoo Linux, CentOS, OS X My System	Re: New Search Engine What you need is someone to do the programming for the searching on your site as well as to create a spider to go out and collect data on all the websites it can find. The size of your hard drive will depend on how much data you'll be storing. Ideally, you'll want a NAS or SAN setup to handle the storage. The number of computers will depend on how much traffic you're getting. It's always best to start small and work your way up as you need to. However, keep in mind that between Google, Yahoo and MSN, those 3 have around 95% of the search traffic. In order for you to compete with them, you'll need a good product. It may take you several years at least before anyone even knows about you. __________________

12-29-2007, 01:34 PM	#3 (permalink)
Acer2000 Registered User Join Date: Sep 2006 Posts: 467 OS: XP Home Service Pack 2	Re: New Search Engine Thank you very much for your reply. Ideally, you'll want a NAS or SAN setup What is NAS or SAN? Please advice me. When you say small, how many computers do you think will I need at first? HDD are huge these days and are quite affordable. So I can hook up several giant HDD to one computer. I have a good plan in mind that is why I think I can compete with the giants. Please tell me more. I need more information. Thank you very much. If you prefer, you can send me a private message.

12-29-2007, 06:25 PM	#4 (permalink)
Skie Manager, Alternative Comp Join Date: Mar 2003 Location: Chicago burbs Posts: 2,194 OS: Gentoo Linux, CentOS, OS X My System	Re: New Search Engine NAS = Network Attached Storage. SAN is similar, but I can't remember what the letters stand for. Basically, you can increase the storage space in the NAS without even touching any of the servers that are using it. And they can make use of the extra storage immediately. 1 server can handle a decent amount of traffic. But that all depends on what kind of content you're providing. Obviously static HTML pages require very little CPU power. Dynamic pages like PHP, CGI, ASP, etc will require more CPU power. Same thing if you're using a database. It also depends on how well optimized your code is. Without knowing all the variables, it's hard to say how many servers you'll need. Start with one and work your way up. __________________

12-31-2007, 01:55 PM	#5 (permalink)
Acer2000 Registered User Join Date: Sep 2006 Posts: 467 OS: XP Home Service Pack 2	Re: New Search Engine Hi, Thank you very much for your reply. What OS would I use? I know how to install Suse Linux 9.0 I have another question, where can I get the latest version of SUSE LINUX? I know the latest version is version 10.2, I need the exact download link so I can save it to my desktop right away and burn it on a DVD Disc. Would sooo much appreciate your help. Thank you Happy New Year

01-01-2008, 09:38 AM	#6 (permalink)
Skie Manager, Alternative Comp Join Date: Mar 2003 Location: Chicago burbs Posts: 2,194 OS: Gentoo Linux, CentOS, OS X My System	Re: New Search Engine What OS you use should be determined by what you know how to use. I personally prefer Linux, but if you don't know how to use it or properly secure it, you're asking to be hacked. You can get SUSE at opensuse.org __________________

01-01-2008, 09:58 AM	#7 (permalink)
Acer2000 Registered User Join Date: Sep 2006 Posts: 467 OS: XP Home Service Pack 2	Re: New Search Engine Hi, I selected the download method as standard (ftp or http) The installation medium DVD And 32 Bit PC It is downloading right now, and I can see that it placed a zipped file on my desktop, is that ok? Please advice me Happy New Year to you

01-01-2008, 10:26 AM	#8 (permalink)
Acer2000 Registered User Join Date: Sep 2006 Posts: 467 OS: XP Home Service Pack 2	Re: New Search Engine Ok. Download in progress. Thank you very much.

01-01-2008, 10:52 AM	#9 (permalink)
Acer2000 Registered User Join Date: Sep 2006 Posts: 467 OS: XP Home Service Pack 2	Re: New Search Engine I just have a question, is this OS, Open Suse the right one to use to set up a server that will host a search engine? Please advice me. Thank you

01-02-2008, 08:45 AM	#10 (permalink)
Skie Manager, Alternative Comp Join Date: Mar 2003 Location: Chicago burbs Posts: 2,194 OS: Gentoo Linux, CentOS, OS X My System	Re: New Search Engine They're all about the same. Generally, I prefer CentOS for servers. OpenSUSE is more for desktops/home users. SUSE does have a Server version, but I don't think it's free. __________________

01-02-2008, 02:24 PM	#11 (permalink)
Acer2000 Registered User Join Date: Sep 2006 Posts: 467 OS: XP Home Service Pack 2	Re: New Search Engine Thank you for your reply. I have downloaded this huge file, it was in zip format and so I had unzipped it now. It shows a huge yellow folder on my desktop, now I read the information on the novel page but they mention an iso image that must be burned on a DVD. Please help me here , I am really helpless. I have nero express on my PC. Thank you

01-02-2008, 06:55 PM	#12 (permalink)
Skie Manager, Alternative Comp Join Date: Mar 2003 Location: Chicago burbs Posts: 2,194 OS: Gentoo Linux, CentOS, OS X My System	Re: New Search Engine I'm not sure wha this "yellow folder" is, but right click on it and select properties. It should be an ISO file. If not, I'm not sure what you downloaded. Once you have an ISO file, you need to use the Burn ISO feature within Nero to burn the file to CD or DVD. You can't do it the normal way you burn a disc. I'm not familiar with Nero, so you'll need to ask someone else or search for the instructions on how to burn an ISO. __________________

01-02-2008, 07:17 PM	#13 (permalink)
Acer2000 Registered User Join Date: Sep 2006 Posts: 467 OS: XP Home Service Pack 2	Re: New Search Engine It is not an iso file. It is Gb 4.1 in size. Please advice

01-03-2008, 06:19 AM	#14 (permalink)
Skie Manager, Alternative Comp Join Date: Mar 2003 Location: Chicago burbs Posts: 2,194 OS: Gentoo Linux, CentOS, OS X My System	Re: New Search Engine Like I said, I don't know what you downloaded unless you can tell me what it is. __________________

01-10-2008, 10:29 PM	#15 (permalink)
bigmikey Registered User Join Date: Dec 2007 Posts: 10 OS: win xp pro 32bit	Re: New Search Engine You can get search engine scripts out there. but if u had some knowledge of php that would u somewhere.