The Channel logo


By | John Leyden 10th October 2007 10:47

Security researchers plot revamped anti-virus tests

Behaviour-based testing

Security researchers are close to formulating plans to overhaul anti-virus testing amid growing concerns that current tests can be misleading.

Anti-virus packages are traditionally tested for their effectiveness in detecting a sample of malware packages known to be in circulation. Products that fail to detect a sample get a lower rating. Such tests - which have remained almost unchanged for a decade - essentially test signature detection of malware samples. Products that fail to detect a sample fail to achieve coveted benchmarks, such as the VB 100 endorsement.

But the approach is a poor method for detecting the effectiveness of behavioral detection technology, an approach that is increasingly gaining traction in the marketplace as a means of providing detection for rapidly evolving threats. In the era of targeted Trojan attacks, some based on unpatched vulnerabilities, signature detection alone really fails to provide a complete defence, however highly a product is rated on those terms.

German testing organisation is pooling suggestions for a revamp to current testing regimes, taking ideas from vendors such as Symantec, Trend Micro, Panda Software, Kaspersky Labs and others, IDG reports. The revamped tests are likely to involve presenting malware samples as an email attachment or as malicious code on web pages within a testing environment.

Security packages (either anti-virus or host-based intrusion prevention) put through their paces in the tests are likely to have been put on ice, without signature update, for a few weeks prior to the tests. The approach is designed to put the onus on detecting viral code on behavioural analysis features in security packages. The new tests be carried out alongside traditional tests, though that and the scoring systems for behaviour-based tests still remain open to debate.

Proposals for a new testing regime, which have the support of other influential testers such as Virus Bulletin, are due to presented next month at the Association of AntiVirus Asia Researchers 2007 conference in Seoul, South Korea. ®

comment icon Read 6 comments on this article alert Send corrections


Frank Jennings

What do you do? Use manual typwriters or live in a Scottish croft? Our man advises
A rusty petrol pump at an abandoned gas station. Pic by Silvia B. Jakiello via shutterstock

Trevor Pott

Among other things, Active Directory needs an overhaul
Baby looks taken aback/shocked/affronted. Photo by Shutterstock

Kat Hall

Plans for 2 million FTTP connections in next four years 'not enough'
Microsoft CEO Satya Nadella


League of gentlemen poster - Tubbs and Edward at the local shop. Copyright BBC
One reselling man tells his tale of woe