Skip to content

Competitive Benchmarks

open all

Why Trend Micro Outperforms the Competition

Traditionally, benchmark performance tests used a set of known malware files during a closed test. However, this type of testing does not take into account how threats typically propagate.

With new threats being introduced every 1.5 seconds, vendors have to be able to quickly respond to new attacks which they cannot block. Newer test methodologies emulate real-world scenarios to show how quickly a vendor can source, analyse and add protection for unknown threats.

Trend Micro has outperformed the competition in a number of recent tests by NSS Labs, Dennis Technology Labs, and AV-Test.org due to the Smart Protection Network™ infrastructure that powers our products.

This unique cloud-client architecture uses Smart Feedback to source new potential threats, patent-pending correlation to analyse multiple threat vectors in real-time, and in-the-cloud reputation databases to deliver protection wherever our customers connect, all of which allows Trend Micro to respond faster than other vendors.

Our cloud-based protection network is the most evolved and comprehensive network in the industry blocking billions of email, web and file-based threats daily.

Spn Year-to-year-benchmarks

Testing Companies

Logo Avtest AV-Test GmbH is a leading worldwide service provider for IT security testing and consultancy services. Their team has more than 15 years of experience in the area of antivirus research and data security. Every year they perform more than 2,500 product tests of antivirus, antispyware,personal firewalls and related products on behalf of vendors, integrators (OEM), corporate users and magazines.

 

Logo Dennis-tech-labs

Dennis Technology Labs is an independent testing facility that evaluates personal and business technology, including hardware and software. They specialise in security testing and have developed one of the few real-world tests within our industry that gives users a good view of the efficacy of the solutions against today’s threats. Using a world-class anti-malware testing framework, they work with businesses, technology vendors and magazines to provide accurate and realistic test results that are useful to consumers and vendors' internal teams.

 

NSS Labs logoNSS Labs is the leading independent security product testing organisation, and operates the largest security and performance lab in the world. NSS Labs is independent, and does not have a parent company that competes with product vendors or sells advertising. Their test reports are highly regarded by information security professionals for their rigor, depth and integrity, and are used to validate purchasing decisions in global enterprises.

 

Read analyst brief on the need for new testing methods

open all

OfficeScan Beats McAfee, Microsoft, Sophos, Symantec AV-Test.org May 2011

For the twelfth straight month, OfficeScan has outperformed its peer competitive products in overall results, exposure layer results and time to protect results.

Download report

Test Methodology

AV-Test.org’s methodology uses samples of malicious URLs with associated malware files and measures how well the solutions block threats at their source (Exposure Layer), during download (Infection Layer) or on execution (Dynamic Layer).

They also test the ability to source, analyse and protect against any samples that went undetected during the first round by re-testing one hour later.

Cloud-based protection components were enabled for all products if not activated by default. This includes features like Trend Micro's web reputation service.

Results

Avtest Officescan Overall-results

Source: AV-Test.org | Note: Results are based on the T+60 minute results. Test results can vary over time and may vary with other configuration settings.

Avtest Officescan Timetoprotect

Source: AV-Test.org | NOTE: Time-to-protect improvement is the percentage of threats missed at T=0min that are subsequently prevented at T=60min. For example, with Trend Micro OfficeScan: At T=0min, 187 threats were prevented while 13 threats were missed. Of the 13 threat missed at T=0min, 3 were prevented at T=60min (3 of 13 equals 23.1%).

Try OfficeScan free for 30-days

OfficeScan Ranks #1 Against Nine Competitors NSS Labs June 2010

OfficeScan ranked #1 for the second time in NSS Labs independent test of corporate endpoint solutions, providing the best overall ability to keep malicious threats off the network and the machine.

As important, the time to protect against unknown threats was four times faster than the nearest competitor. With the average time to protect of almost two days by all competitors, Trend averaged less than five hours!

Request the Q2 2010 Endpoint Protection Product Group Test Report directly from NSS Labs.

Test Methodology

NSS Labs sourced real socially-engineered malware on the Internet and tested each solution in a real-world online computing environment. They measured whether each solution could block the threat at its source or during download (Caught Initially on Download), or when the threat executed on the machine (Caught Subsequently on Execution).

The labs conducted independent testing on endpoint products from leading security vendors to reveal the highest levels of socially-engineered malware protection. The testing was unsponsored and non-commissioned.

Results

Nss-labs Officescan Overall-results

Source: NSS Labs Q2 2010 Enterprise Endpoint Group Test – Host Intrusion Prevention

Trend Micro Deep Security uses the same technology as that used in OfficeScan’s Intrusion Defense Firewall (IDF) plug-in to ensure corporate servers are protected from exploits.

Try OfficeScan IDF or Deep Security free for 30 days.

Worry-Free Business Security Outperforms Four Market-leading SMB Solutions May 2011

In May 2011, AV-Test.org performed endpoint security benchmark testing on five market-leading SMB endpoint solutions from Symantec, McAfee, Sophos, ESET, Kaspersky, and Trend Micro.

Worry-Free Business Security outperformed its peer competitive products in the overall results and Exposure Layer results.

Download report

Test Methodology

AV.org’s methodology uses samples that are malicious URLs with associated malware files and allows the solutions to block threats at their source (Exposure Layer), during download (Infection Layer) or on execution (Dynamic Layer).

They also test the ability to source, analyse and protect against any samples that went undetected during the first round by re-testing one hour later.

Results

Avtest Worryfree Overall-results

Source: AV-Test.org | Note: Results are based on the T+60 minute results

Avtest Officescan Timetoprotect

Source: AV-Test.org | NOTE: Time-to-protect improvement is the percentage of threats missed at T=0min that are subsequently prevented at T=60min. For example, with Trend Micro Worry-Free Business Security: At T=0min, 190 threats were prevented while 10 threats were missed. Of the 10 threats missed at T=0min, 1 was prevented at T=60min (1 of 10 equals 10%).

Try Worry-Free Business Security free for 30 days.

open all

Titanium Maximum Security Maintains Top Ranking Against Ten Others NSS Labs September 2010

For the second time in NSS Labs’ independent anti-malware tests of consumer endpoint products Trend Micro ranked #1 in overall protection, blocking on download and time to protect.

Logo Nsslabs-recommended
These results reflect the effectiveness of the Trend Micro Smart Protection Network™ which powers all of our endpoint solutions and provides the best protection against Internet-based malware as well as the fastest time to protect against unknown threats.

Dowload the Q3 Consumer Anti-Malware Group Test report directly from NSS Labs

 

Test Methodology

NSS Labs tested live, Internet-based malware over 11 days. Every six hours they tested new threats as well as missed threats to identify how effectively products performed against live threats.

By testing multiple layers of protection, blocking the source (A), blocking on download (B), and blocking upon execution (C), the NSS Labs test mimic’s real-world computing scenarios and provides a better way for consumers to identify the product that offers the best protection.

Results

Nsslabs Titanium Overall-results

Source: NSS Labs Consumer Anti-Malware Group Test, Q3 2010

Nsslabs Titanium Timetoprotect

Source: NSS Labs Consumer Anti-Malware Group Test, Q3 2010

Try Titanium Maximum Security free for 30 days.

Titanium Maximum Security Earns Top Marks Dennis Technology Labs January 2011

In benchmark testing of eleven market-leading consumer endpoint solutions, Titanium Maximum Security performed better than most of its competitors and tied with Symantec in total accuracy.

The popular antivirus programs compared for effectiveness included:

  • Avira Premium Security Suite 2011
  • ESET Smart Security 4
  • G Data TotalCare/InternetSecurity 2011
  • McAfee Total Protection/Internet Security 2011
  • Symantec Norton 360 v5/Internet Security 2011
  • Webroot Internet Security Complete 2011
  • BitDefender Total Security/Internet Security 2011
  • F-Secure Internet Security 2011
  • Kaspersky PURE/Internet Security 2011
  • Panda Global Protection/Internet Security 2011
  • Trend Micro Titanium Maximum Security/Internet Security 2011


Download the PC Total Protection Suites 2011 report, commissioned by Symantec, directly from Dennis Technology Labs

Testing Methodology

Products were exposed to genuine internet threats that real customers could have encountered during the test period. Crucially, this exposure was carried out in a realistic way, reflecting a customer’s experience as closely as possible.

For example, each test system visited genuinely infected websites and downloaded pages, exploits and malicious files exactly as an average user would. DTL also tested how each product handled legitimate applications. These were downloaded from Download.com or the original site as directed by Download.com.

The popularity of each program was taken into account. Products are awarded marks for detecting real threats and providing adequate protection. Points are deducted for failing to protect the system and for falsely condemning legitimate software.

Results

Dennislabs Titanium Tota-accuracy-scores

Source: Dennis Technology Labs — January 2011

Chart: protection details

Source: Dennis Technology Labs — January 2011

Why does Trend Micro consistently perform well in real-world tests?

To overcome the limitations of outdated benchmark practices, Trend Micro has been commissioning AV-Test.org monthly to use a real-world testing methodology in which the samples are malicious URLs with associated malware files.

The tests measure how well the solutions block threats at their source (Exposure Layer), during download (Infection Layer) or upon execution (Dynamic Layer).

They also test the product’s ability to source, analyse and protect against any samples that went undetected during the first round by re-testing one hour later.

Over time, it has become apparent that Trend Micro’s multi-layered approach based on the cloud-based Smart Protection Network consistently blocks real-world threats more effectively than its competitors.

Avtest-historical-results

Source: AV-Test.org | Total percentage of all threats blocked at each layer: Exposure, Infection and Dynamic. Note: Results are based on the T=0 minute results. Test results can vary over time and may vary with other configuration settings.

Consistency in real-world tests may be compromised due to the following:

  1. Vendor is still focused on file-based protection which is difficult to keep updated with the number of new threats being released each hour.
  2. Vendor does not provide blocking of malicious URLs, which is the source of most infections today.
  3. Vendor does not have automated sourcing of unknown threats.
  4. Vendor does not have automatic correlation of new threat data in order to quickly identify unknown threats
  5. Vendor does not have cloud-based protection and still requires signature files to be delivered to each and every endpoint computer, thus delaying the time to protect.


Archive


Connect with us on