Comments on: Comparison Testing is Hard to Find http://spotonsecurity.com/2010/01/08/comparison-testing-is-hard-to-find/ A closer look at the future of video surveillance Tue, 06 Jul 2010 00:57:19 +0000 hourly 1 http://wordpress.com/ By: Doug Marman http://spotonsecurity.com/2010/01/08/comparison-testing-is-hard-to-find/#comment-185 Doug Marman Wed, 27 Jan 2010 17:02:16 +0000 http://spotonsecurity.com/?p=172#comment-185 Sagy, Thanks for this comment. Similar to the SPAWAR testing, Sandia National Labs has run tests in the past, but kept the result confidential as well. I know of a few companies who have done some extensive testing, but none have made their results public. The only other testing that I know of that is public is the i-LIDS testing in the UK, which limits what they are looking for and doesn't provide comparisons with results. They also don't say if a company fails to pass. Yes, I hope IOimage continues to support this as well after the changes they are going through, since this is good for the industry. Thanks. Doug. Sagy,

Thanks for this comment.

Similar to the SPAWAR testing, Sandia National Labs has run tests in the past, but kept the result confidential as well.

I know of a few companies who have done some extensive testing, but none have made their results public.

The only other testing that I know of that is public is the i-LIDS testing in the UK, which limits what they are looking for and doesn’t provide comparisons with results. They also don’t say if a company fails to pass.

Yes, I hope IOimage continues to support this as well after the changes they are going through, since this is good for the industry.

Thanks.

Doug.

]]> By: Sagy Amit http://spotonsecurity.com/2010/01/08/comparison-testing-is-hard-to-find/#comment-183 Sagy Amit Mon, 18 Jan 2010 22:20:40 +0000 http://spotonsecurity.com/?p=172#comment-183 Doug, In 2006, SRC, a subcontractor of Spawar conducted a test in Charleston SC. a number of Video Analytics providers (8 or so) took part including ioimage. the majority of those VA companies are no longer with us, god bless their souls (BTW, Object Video refused to participate) Anyways, being a government contractor, Spawar decided to take the "politically correct" way out and not to publish any results. the limited results they did publish did not include company names, so they were worthless. Speaking for ioimage, I always encouraged testing side by side against competitors including testing by customers to help them make an educated decision. I hope that the recent change in ioimage will not change this approach. Sagy Doug,

In 2006, SRC, a subcontractor of Spawar conducted a test in Charleston SC. a number of Video Analytics providers (8 or so) took part including ioimage. the majority of those VA companies are no longer with us, god bless their souls (BTW, Object Video refused to participate)
Anyways, being a government contractor, Spawar decided to take the “politically correct” way out and not to publish any results. the limited results they did publish did not include company names, so they were worthless.
Speaking for ioimage, I always encouraged testing side by side against competitors including testing by customers to help them make an educated decision. I hope that the recent change in ioimage will not change this approach.

Sagy

]]> By: Doug Marman http://spotonsecurity.com/2010/01/08/comparison-testing-is-hard-to-find/#comment-182 Doug Marman Thu, 14 Jan 2010 20:07:13 +0000 http://spotonsecurity.com/?p=172#comment-182 Rosa, perfect timing. Thanks for the added info that you emailed to me. We are interested and will be following up. Thanks for posting this. Doug. Rosa, perfect timing. Thanks for the added info that you emailed to me. We are interested and will be following up. Thanks for posting this.

Doug.

]]> By: Doug Marman http://spotonsecurity.com/2010/01/08/comparison-testing-is-hard-to-find/#comment-181 Doug Marman Thu, 14 Jan 2010 19:48:35 +0000 http://spotonsecurity.com/?p=172#comment-181 John, thanks for the response. Good to hear that you've got more testing planned for this summer. Thanks. Doug. John, thanks for the response. Good to hear that you’ve got more testing planned for this summer.

Thanks.

Doug.

]]> By: Rosa Chen http://spotonsecurity.com/2010/01/08/comparison-testing-is-hard-to-find/#comment-180 Rosa Chen Mon, 11 Jan 2010 10:54:46 +0000 http://spotonsecurity.com/?p=172#comment-180 Dear Doug, Great post! My name is Rosa Chen, a reporter with A&S International. A&S is teaming up with VideoControlRoom, a renowned Australian system integrator, to gather top-notch video analytics solutions and put them to the test. Test criteria will represent real-life problems customers want solved, at a price they are willing to pay. We are, therefore, looking to find out how well, and at what programming and management overhead, vendors’ analytics can achieve current claims. Devices with built-in analytics or software packages are submitted to VideoControlRoom, and testing will commence early February. Are you interested?? From what you've posted above, this opportunity is right up your street :) I attempted to get in touch with VideoIQ's media contact, Donna Murno, early December 2009 but received no response. Please drop me an email when you have a minute, so that I can tell you more about this! Looking forward to hearing from you soon. Cheers, Rosa ******************************************** Rosa Chen Reporter A&S International & Asia Messe Frankfurt New Era Business Media Ltd. (Taiwan Branch) E: rosa.chen@newera.messefrankfurt.com T: +886-2-2659-9080 ext.611 ******************************************** Dear Doug,

Great post! My name is Rosa Chen, a reporter with A&S International. A&S is teaming up with VideoControlRoom, a renowned Australian system integrator, to gather top-notch video analytics solutions and put them to the test. Test criteria will represent real-life problems customers want solved, at a price they are willing to pay. We are, therefore, looking to find out how well, and at what programming and management overhead, vendors’ analytics can achieve current claims.

Devices with built-in analytics or software packages are submitted to VideoControlRoom, and testing will commence early February. Are you interested?? From what you’ve posted above, this opportunity is right up your street :)

I attempted to get in touch with VideoIQ’s media contact, Donna Murno, early December 2009 but received no response. Please drop me an email when you have a minute, so that I can tell you more about this!

Looking forward to hearing from you soon.

Cheers,
Rosa
********************************************
Rosa Chen
Reporter
A&S International & Asia
Messe Frankfurt New Era Business Media Ltd.
(Taiwan Branch)
E: rosa.chen@newera.messefrankfurt.com
T: +886-2-2659-9080 ext.611
********************************************

]]> By: John Honovich http://spotonsecurity.com/2010/01/08/comparison-testing-is-hard-to-find/#comment-179 John Honovich Sat, 09 Jan 2010 09:19:39 +0000 http://spotonsecurity.com/?p=172#comment-179 Doug, Good post. Interesting to hear these details and some of the behind the scenes issues - not surprised about BRS Labs not participating - they have acknowledged that their system takes days or weeks to learn a scene. I wanted to clarify that while some analytics vendors have expressed resistance against testing, the reason for no more analytics tests is our decision to focus more on cameras and VMS (for now). This is because of the broader market use of these 'basics'). We do plan to re-start video analytics in Spring or Summer 2009 and do broad testing then. One interesting approach that I like is Aimetis, which provides a free 60 day trial of their video analytics that can be downloaded instantly off their website by anyone. All this being said, I'd like to see more independent public product testing of video analytics from others. I think it would be helpful for the entire industry. Doug, Good post. Interesting to hear these details and some of the behind the scenes issues – not surprised about BRS Labs not participating – they have acknowledged that their system takes days or weeks to learn a scene.

I wanted to clarify that while some analytics vendors have expressed resistance against testing, the reason for no more analytics tests is our decision to focus more on cameras and VMS (for now). This is because of the broader market use of these ‘basics’).

We do plan to re-start video analytics in Spring or Summer 2009 and do broad testing then. One interesting approach that I like is Aimetis, which provides a free 60 day trial of their video analytics that can be downloaded instantly off their website by anyone.

All this being said, I’d like to see more independent public product testing of video analytics from others. I think it would be helpful for the entire industry.

]]>