Linux Today: Linux News On Internet Time.
Search Linux Today
search.internet.com
Linux News Sections:  Blog -  Developer -  High Performance -  Infrastructure -  IT Management -  Security -  Storage -
Linux Today Navigation
LT Home
Preferences
Contribute
Link to Us
Search
Linux Jobs

internet.commerce
Be a Commerce Partner

Computer Deals
Promos and Premiums
KVM over IP
Promotional Golf
Phone Cards
Corporate Gifts
Promote Your Website
Calling Cards
Corporate Awards
Compare Prices
Disney World Tickets
Logo Design
Imprinted Promotions
Online Shopping

The Linux Channel at internet.com
Linux Today
Enterprise Linux Today
Apache Today
JustLinux.com
Linux Planet
PHPBuilder
All Linux Devices
Technology Jobs

JustTechJobs.com

LinuxToday Newsletters
Subscribe News
Subscribe PR
Subscribe Security

internet.com
IT
Developer
Internet News
Small Business
Personal Technology
International

Search internet.com
Advertise
Corporate Info
Newsletters
Tech Jobs
E-mail Offers

 
Webcast: Hacking 101--The Top 10 Attacks in Web Applications
Defend your web applications from attack. Learn about the three most common web application attacks, including how they occur and what can be done to prevent them. Well also discuss manual versus automated approaches for scanning and identifying web application vulnerabilities and how IBM Rational AppScan, an automated vulnerability scanner, can help you automate more of what you are doing manually today. View the webcast;
Featured on the DevX Skillbuilding for IBM Developerworks

Featured in the eBook Library for Technology Professionals
Putting the Green into IT
Sponsored by HP
Electricity use in data centers is skyrocketing, sending energy bills through the roof, creating environmental concerns and generating negative publicity. "Going Green" means looking to technologies like virtualization, energy-efficient chips and racks, and implementing policies that extend beyond the data center. Learn more. Click here.

Featured Solutions for Technology Professionals from Internet.com
PDF: Storage Is Changing Fast--Are You Ready?
Sponsored by HP
The storage landscape is headed for dramatic change, thanks to new technologies like Fibre Channel over Ethernet (FCoE), pNFS, object-based storage and SAS that will affect everything from NAS and SANs to disk drives. Get the knowledge you need to make the most of your storage environment, now and in the future. >>

Current Newswire:

Installing Dansguardian With Multi-Group Filtering & Squid With NTLM Auth (Debia

Encrypt The System Manually Upon Installation (Ubuntu 8.04)

Linux - a disruptive technology?

Ruiz Out, Meyer In At AMD

Third Annual Open Source CMS Award Launched

Virtual Hosting With Proftpd And MySQL (Incl. Quota) On Fedora 9

Hosted Zimbra Email Catches On With Managed Service Providers

An Open Source Seeing Eye Dog for Web Surfers

Perl and Bash Versions Of Binary To Decimal Conversion Script

E4X: JavaScript on Steroids

Oracle Database Administrator
Professional Technical Resources
US-OR-Portland

Justtechjobs.com Post A Job | Post A Resume
:Mark Russinovich on Linux Versus Windows NT and Benchmark Reliability
Mark Russinovich on Linux Versus Windows NT and Benchmark Reliability
Apr 30, 1999, 16 :50 UTC (69 Talkback[s]) (29639 reads)

Reprinted by permission from Windows NT Magazine UPDATE - Special Edition

by Mark Russinovich

Hello all,

Linux has received considerable attention from the trade press and major computer companies over the past several months. More and more, you see the word "enterprise" in a headline with Linux. For example, "The Enterprise Comes To Linux," "Enterprise Vendors Line Up Behind New Red Hat Linux Distribution," and "Major Players Bring Linux to Enterprise" are all recent headlines from popular trade rags. Major players in the computer world, such as IBM, HP, and Compaq, have announced formal support for Linux, and have begun selling hardware preinstalled with Linux. The ties between Linux and enterprise computing extend to software vendors who have announced Linux ports for applications common in the enterprise. Oracle has ported its database offering to Linux, IBM has ported DB2, and enterprise resource planning (ERP) solution providers are porting, or considering porting, their applications to Linux.

The promotional momentum behind Linux as an enterprise-ready OS gives the IS community a sense that Linux is a suitable enterprise OS that has passed the scrutiny of enterprise-savvy hardware and software companies. However, no evidence exists that these companies or the trade press has looked at Linux critically with respect to its enterprise-class capabilities. Enterprise-class environments don't widely use Linux--corporate environments have only just put Linux to use as a uniprocessor server OS in the past year or two. To date, not one Linux benchmark submission to the Standard Performance Evaluation Corporation (SPEC) or the Transaction Processing Council (TPC) has shown that Linux offers performance comparable with what commercial versions of UNIX and Windows NT deliver on large workloads. In fact, there are no SPEC or TPC benchmark submissions with Linux as the OS.

The phrase "enterprise computing" means different things to different people. Some see enterprise computing as a client/server environment where many clients, or users, rely on few servers to provide computing services. Thus, an enterprise environment is one that demands hardware resources to handle large workloads that basic PCs just can't support. My interpretation of the phrase defines an enterprise-class OS as one that must deliver high performance in high-load environments, scale well on multiprocessors, provide reliable service, and have high- availability options built-in or that exist as add-ons. Example enterprise environments include running an email server that supports several thousands of users, hosting a Web site that processes hundreds of thousands or millions of requests per day, and maintaining a database that serves as a corporate data repository with thousands or tens of thousands of employees.

A common theme to all these interpretations is that enterprise computing involves a network server application with high compute and I/O demands, and that server reliability and availability are of utmost importance to a company's bottom line. Another common theme is that the necessary hardware typically consists of a multiprocessor system with two to eight processors, 1GB or more of RAM, and dozens of GB of disk space: Uniprocessor departmental servers, small Web sites, and casually used company servers are not the enterprise. What lies beyond these requirements is the high-end of the enterprise (requiring more than eight processors). That space probably accounts for less than a fraction of 1 percent of the computing in the world and is reserved for mainframe OSs such as OS/390 or highly-clustered UNIX solutions.

An enterprise-level OS must meet several requirements. First, the OS must be reliable--it must not crash, even under extreme loads. Second, availability services must be in place to let clients continue to have their processing requests satisfied, even when the OS or hardware fails. This functionality implies redundancy at the hardware level, with OS or application support to redirect client requests from a failed system to one that is functional. Finally, the OS kernel's architecture and implementation must support high performance and scalability. In other words, the kernel must be sufficiently parallel in its operation to take advantage of multiple processors. The kernel must also provide applications with the APIs and infrastructure necessary to build high-performance, scalable applications.

How does Linux measure up to these requirements compared to the current players in the enterprise space (i.e., UNIX and NT)? Linux has a reputation as a reliable OS, and plenty of Web sites rely on it. However, its high-availability support is still virtually non-existent. Its Beowulf clustering, which has been in the trade press recently, is not suitable for providing high availability to network server applications. The only other measure to use to compare Linux to the rest of the field is performance, including multiprocessor scalability.

As I previously mentioned, no industry-accepted benchmark results exist for Linux running network server applications. Preparing for and executing such a benchmark is very costly, both in terms of hardware dollars and technical expertise required to execute a benchmark test that will yield competitive numbers. Thus, the lack of any Linux benchmark results means one of three things. First, no company with an interest in promoting Linux has run benchmarks. Second, it's not in the best interest of any company capable of submitting a benchmark with good Linux numbers to do so. Or third, companies are trying to get good Linux numbers and are failing.

It's not clear which companies capable of generating Linux benchmark results have it in their best interest to do so. Compaq, HP, Sun Microsystems, and IBM have all made pronounced gestures in support of Linux, and so they are all obvious candidates. However, they all have proprietary OSs that will compete with Linux as soon as someone demonstrates that Linux is ready for the enterprise. In fact, each company has its own version of UNIX. So it's not obvious which reason explains the lack of Linux numbers. The best we can do is analyze the Linux kernel to determine whether its design and implementation is capable of delivering good numbers.

Over the past few months, several writers in the technical press have thrown out claims regarding the capabilities of the Linux kernel. However, none of the authors that I've come across back their claims with any technical facts. As someone that specializes in OS internals and network server application design, I decided to examine the Linux kernel to determine whether it incorporates several key features required to implement high-performance network server applications. I discovered that Linux is lacking in several critical areas and that these limitations will hurt Linux's performance when compared to various versions of UNIX and NT. I published my findings in "Linux and the Enterprise," Windows NT Magazine, April 1999. (Windows NT Magazine has decided to post the electronic form of this article to its Web site at this time to help dispel some misplaced Linux hype and to open discourse on this subject. Go to http://www.winntmag.com/Magazine/Article.cfm?ArticleID=5048.) Although my current findings are negative, the intent of revealing them is not. I hope to promote Linux as a competitor in the enterprise area, as competition is good for the industry and good for consumers.

A report by the analyst group D. H. Brown entitled, "Linux: How Good Is It?" includes a study of the Linux kernel that comes to the same conclusion that I did. In fact, much of this group's conclusion related to Linux SMP support is based on my research--my preliminary findings during my study of the Linux kernel were posted, without my knowledge or permission, to the Linux kernel USENET newsgroup in January by a member of the Linux community. Pages 44 and 45, the heart of the SMP analysis, mirror my email almost exactly. The fact is, Linux has a kernel that internally looks very much like the prevalent UNIX kernel of the mid-1980s. All commercial versions of UNIX and NT have evolved 10 to 15 years past where Linux is as far as SMP scalability and network-server application support. And the gains that have been made for these other OSs have been difficult to achieve and expensive.

Despite a prevalent misconception in certain circles to the contrary, NT does classify as an enterprise-class OS. NT's performance on network server applications rivals or beats the performance the various versions of UNIX can provide. Don't take my word for it, go to http://www.specbench.org or http://www.tpc.org and see which OSs own the top three positions on systems varying in size from uniprocessor to 8-way systems. Across the board, NT ranks at the top or near the top when competing against the major UNIX variants, including Tru64 UNIX (formerly Digital UNIX), Solaris, and HP/UX. As far as the belief widely espoused in advocacy USENET newsgroups and Web sites to the contrary, NT is a reliable OS with high-availability options. If it wasn't reliable, no company would use it as an enterprise OS, and companies with no particular allegiance to Microsoft wouldn't use it at all. The number of companies visibly using NT in an enterprise-serving role are plenty: Walt Disney, Dell, Intel, eBay, Barnes and Nobles, United Airlines, Buy.com, and Car Point are just a sampling of some of the world's most demanding Internet sites running NT.

Will Linux gain the capabilities of its cousins and NT? Yes. Can it gain them in the next few years based solely on work done by a band of loose-knit developers scattered around the world? That remains to be seen. The lessons offered by the evolution of the other UNIX variants suggests that Linux requires a sponsor with experience in this area to help both financially and technically. Perhaps we'll see the formation of an industry consortium that will work together to help evolve Linux. However, it will be at least 2 years before the Linux kernel can mature to a competitive level.

As a closing note, I want to provide a warning concerning independent party OS benchmarks. Several publications have recently reported benchmark results comparing Linux to NT. Some have shown NT to outperform Linux, and some have shown the opposite. My advice is to disregard independent tests because they suffer from several flaws. First, by definition, an independent tester has no vested interest in the outcome of a benchmark. Thus, they also have no interest in understanding the hardware, OS, application, or benchmark used in ways required for achieving the best results possible. Only someone with a vested interest in good numbers can do the best job possible to achieve those numbers.

Second, independent tests are almost never performed using industry- accepted benchmarks such as SpecWeb or TPC-C/TPC-D. They are typically run using workload programs developed in-house or by third parties. Only tests that competing members of an industry deem representative of real-world environments can be readily accepted as meaningful.

Finally, no one audits independent tests. Representatives of each member of the benchmark consortium review benchmark results submitted to TPC or SPEC. This review ensures that these organizations will publish only numbers obtained in adherence with benchmark guidelines, and that means the submitter's competitors have critically viewed the numbers.

Thanks,

Mark Russinovich,
Contributing Editor, Windows NT Magazine
Mark@sysinternals.com

Copyright 1999, Windows NT Magazine


Index Mode   |   Flat Mode   |   Thread Mode   |   Thread Flat  
  Talkback(s) Name  and Date
I can't say one way or the other whe ...   enterprise -- does it matter?   
Tim Kelley
Apr 30, 1999, 17:19:12
 
This is from a man who presented a sessi ...   Mark's Linux credentials.   
Jeremy Allison
Apr 30, 1999, 17:24:34
 
"First, by definition, an independent te ...   FUD FUD FUD   
forrest
Apr 30, 1999, 17:26:31
 
This is the guy who told me that NT 4.0  ...   Hmmm..right   
Ben Tilly
Apr 30, 1999, 17:39:44
 
Very interesting.  We should disregard i ...   Disregard independent tests?   
David Stoner
Apr 30, 1999, 17:40:58
 
Many of us linux enthusiasts have used a ...   Come on Mark, the game is up...   
Kinetik
Apr 30, 1999, 17:41:06
 
Without going into specifics, the issue  ...   Credibility   
Passacaglia
Apr 30, 1999, 17:44:08
 
Linux beats NT in network services Hands ...   NT IS DOS   
ozric
Apr 30, 1999, 17:55:49
 
It's funny, but I think Linus and Dr ...   Remember "Linux is Obsolete?"   
Andy MacKay
Apr 30, 1999, 17:56:46
 
". . . upon this OS will I found my apps ...   Fear, Uncertainty and Doo-doo   
Black iMage
Apr 30, 1999, 17:59:58
 
Some of this article is just plain FUD.  ...   Misinformed & Biased!   
Fred Fahnert
Apr 30, 1999, 18:02:57
 
this is quite ridiculous. I have experie ...   win nt reliable?   
Erik Stefffl
Apr 30, 1999, 18:11:27
 
Why wont hotmail use it, they are owned  ...   If NT is such a great performer..   
Brian Tabone
Apr 30, 1999, 18:17:20
 
When people like this start talking abou ...   Nonsense   
Rich
Apr 30, 1999, 18:22:04
 
Thank you for a polite and intelligent a ...   Nice!   
Ian Rowan
Apr 30, 1999, 18:24:32
 
NT 4.0 received C2 clearance today: http ...   Re: Hmmm..right   
Mark Russinovich
Apr 30, 1999, 18:47:44
 
Let the VA Research and IBMs of the worl ...   I care about desktops   
Swaps
Apr 30, 1999, 18:50:06
 
Dear Mark,

The excellence of the many i ...   Enterprise Red Herring   
Matthew Benjamin
Apr 30, 1999, 19:04:47
 
I don't think his factors are very i ...   Let's Get Real.   
Curt Wuollet
Apr 30, 1999, 19:08:36
 
DejaNews runs on Linux.  Slashdot gets m ...   Enterprise Examples.   
Anonymous
Apr 30, 1999, 19:10:44
 
Look... it either crashes or doesn't ...   The obvious benchmark   
Anonymous Coward
Apr 30, 1999, 19:11:38
 
No matter how much you try to sell NT as ...   the emperor has got no clothes...   
hunsolo
Apr 30, 1999, 19:12:28
 
From the article:
---------------------- ...   Ignore independent tests?!   
Derek
Apr 30, 1999, 19:33:31
 
Programming is not my primary job functi ...   I am a simple programmer...   
Roger Irwin
Apr 30, 1999, 19:34:23
 
This if funny.

C2 doesn't mean anyt ...   Re: Re: Hmmm..right - SO?   
Chris
Apr 30, 1999, 19:35:01
 
To me, the battle of OSs is known. Linux ...   A Battle with Known Result   
Jianmang Li
Apr 30, 1999, 19:37:01
 
MIS regualary re-installs NT on several  ...   Sure.. when NT isn't down...   
CodeZ
Apr 30, 1999, 19:51:34
 
I tried looking at the Microsoft web sit ...   NT C2 security???   
David Skoll
Apr 30, 1999, 20:23:02
 
Of couse a real Enterprise computer syst ...   Real Enterprise   
Mark Evans
Apr 30, 1999, 20:30:22
 
Enterprises need stable OSs. No matter h ...   NT is not enterprise ready   
Mario Miyojim
Apr 30, 1999, 20:30:26
 
Jim Ewel, director of the Enterprise Win ...   One Big Lie, whom to believe   
RB
Apr 30, 1999, 21:01:19
 
The link you pointed me to (which crashe ...   Wrong C2   
Ben Tilly
Apr 30, 1999, 21:06:22
 
I too am an IT professional.  I have bee ...   Sinner Repent!   
Kevin Hudson
Apr 30, 1999, 21:08:17
 
First, I'd like to come to Mark' ...   That ol' enterprising enterprise   
dinotrac
Apr 30, 1999, 21:12:52
 
The part I love is when he complains tha ...   Internals   
Noah F. San Tsorbutz
Apr 30, 1999, 21:37:54
 
I had an interesting realization recentl ...   NT doesn't fit...   
Another Mark Evans
Apr 30, 1999, 21:43:18
 
All of Mr. Russinovich's material on ...   theory   
Sam
Apr 30, 1999, 21:53:27
 
Mark has written some good code for peop ...   Slightly Biased   
Ralph
Apr 30, 1999, 21:54:26
 
No one with experience in both UNIX and  ...   NT and Enterprise Computing   
K. S> Victor
Apr 30, 1999, 22:02:38
 
I am from Singapore, and a student, i us ...   NT and Linux crashes?   
Dell Lim
Apr 30, 1999, 22:09:00
 
Seems to me that just a week or so ago,  ...   NT "Enterprise ready"?   
Ken Cormack
Apr 30, 1999, 22:09:57
 
MR>      NT 4.0 received C2 clearance to ...   Subject: Re: Hmmm..right (1999-04-30 18:47:44)   
Sam
Apr 30, 1999, 22:13:22
 
Please, do not take time from the import ...   Kernel developers   
Farli
Apr 30, 1999, 22:16:54
 
To be truly enterprise ready, linux need ...   Linux DOES need to catch up to NT!   
tpkelley
Apr 30, 1999, 22:35:37
 
Windows NT magazine? Must be down the ha ...   Interesting   
David B. Jackson
Apr 30, 1999, 23:29:28
 
I work for an enterprise software develo ...   M.R. is a COMPLICATED guy.   
WORLOK
Apr 30, 1999, 23:41:34
 

I recently had to admin a NT machine.   ...   NT really made me laugh today   
Bryan Brunton
May 1, 1999, 00:01:24
 
NT is garbage foisted upon the masses of ...   NT is trash   
Matthew Alton
May 1, 1999, 00:08:39
 
    It is articles like this that forced ...   A letter I wrote to Mark   
Dan Kuykendall
May 1, 1999, 00:29:22
 
Mark's assesment of SMP and threadin ...   Design vs. Implementation   
Thad Phetteplace
May 1, 1999, 00:38:03
 
I subscribe to Windows NT Magazine (thou ...   Perspective on Russinovich   
Warren Young
May 1, 1999, 03:27:32
 
Well I don't really know what to thi ...   If NT was so reliable why M$ didn't use it in   
Khalid
May 1, 1999, 05:40:54
 
Yes, NT 4 *did* receive a C2 rating... b ...   Re: Re: Hmmm..right   
Dan York
May 1, 1999, 07:36:53
 
The highest availability figure I've ...   Availability figures   
Andrew Morton
May 1, 1999, 08:08:45
 
Russinovich's article is great: I ag ...   Re: If NT was so reliable why M$ didn't use it   
Jeremy Chadwick
May 1, 1999, 08:41:16
 
I have little experience with NT as serv ...   NT Sucks as a server   
Bart Meuris
May 1, 1999, 08:47:01
 
And where is my Blue Screen Of Death and ...   Re: Linux DOES need to catch up to NT!   
Keith Elster
May 1, 1999, 10:09:24
 
Prove Russinovich Wrong.  If you guys qu ...   MY ENEMY IS MY FRIEND   
Linux Developer
May 1, 1999, 10:57:31
 
Mark Russinovich writes:

"My advice is  ...   Russinovich's flawed analysis   
David F. Skoll
May 1, 1999, 11:07:43
 
The Internet is the latest advance in br ...   False statements.   
Mario Miyojim
May 1, 1999, 12:00:07
 
The only security NT have is that, as ea ...   NT security?   
Rildo Pragana
May 1, 1999, 12:01:27
 
I have an idea... Why don't we get M ...   Benching   
bubbalou
May 1, 1999, 12:19:08
 
All I can is that if you're bread an ...   Think about your future now   
Ben Gonzaes
May 1, 1999, 12:28:44
 
Yesterday, at Digitran, a training simul ...   An interesting situation yesterday.   
Mario Miyojim
May 1, 1999, 13:25:15
 
Great letter!  Dan.

I have similar expe ...   Re: A letter I wrote to Mark   
Bo Chen
May 1, 1999, 14:23:11
 

The claims of reliability of Windows NT ...   Windows NT reliability   
Arun Gupta
May 1, 1999, 15:23:27
 
What is the difference between Windows N ...   Difference between Windows Nt & Behaviour   
Shahid
Apr 4, 2000, 23:28:05
 
hello,
     i was doing a study regardi ...   linux   
raghavendra h s
Sep 28, 2000, 09:10:00
 
Real life experience...is this what matt ...   Real Life Experiencee   
eracompute
Oct 10, 2003, 17:04:51
 
  Home | Search Talkbacks | Customize View    Top of Page  



Enter your comments below:

* Your Name:

* Your Email Address:

* Subject:

CC: [will also send this talkback to an E-Mail address]

* Comments:

Tags allowed:<I>,<B> and <U>. See our talkback-policy for more about talkback content.

Fields marked with * are required!


Intel Whitepaper: Wireless Technologies and e-Learning--Bridging the Digital Divide
ESG Lab Report: Enterprise-Class Storage Virtualization for Mission-Critical IT
Silverlight 2 App and Walkthrough: Leverage Silverlight 2 with SQL Server and XML
Webcast: Hacking 101--The Top 10 Attacks in Web Applications
eKit: Web 2.0 Developer

..............................


All times are recorded in UTC.
Linux is a trademark of Linus Torvalds.
Powered by Linux, Apache and PHP

JupiterOnlineMedia

internet.comearthweb.comDevx.commediabistro.comGraphics.com

Search:

Jupitermedia Corporation has two divisions: Jupiterimages and JupiterOnlineMedia

Jupitermedia Corporate Info


Legal Notices, Licensing, Reprints, & Permissions, Privacy Policy.

Advertise | Newsletters | Tech Jobs | Shopping | E-mail Offers