Posts Tagged ‘e’

Verification Methodology Poll Results

Wednesday, February 11th, 2009

Last week I initiated a poll of verification methodologies being used for functional verification of ASICs. Unlike other polls or surveys, this one was done in a very “open” fashion using a website that allows everyone to view the raw data. In this way, anyone can analyze the data and draw the conclusions that make sense to them, and those conclusions can be challenged and debated based on the data.

What happened next was interesting. Within 48 hours, the poll had received almost 200 responses from all over the world. It had garnered the attention of the big EDA vendors who solicited their supporters to vote. And, as a result, had became a focal point for shenanigans from over-zealous VMM and OVM fans.  I had several long nights digging through the data and now I am ready to present the results.

As promised, here is the raw data in PDF format and as an Excel workbook. The only change I have made is to remove the names of the individual 249 respondents.

In summary, the results are as follows:

RAW Results from Verification Methodology Poll

(Note: The total is more than the 249 respondents because one respondent could be using more than one methodology.)

Regarding the big 3 vendors, the data shows a remarkable consistency with Gary Smith’s market share data. There are 85 respondents planning to use the Synopsys methodologies (VMM,RVM, or Vera) and there are 150 respondents planning to use the Mentor or Cadence methodologies (OVM, AVM, eRM, e). That represents 36% for Synopsys and 64% for Mentor/Cadence. Gary’s data shows Synopsys with 34% market share, Mentor with 35%, and Cadence with 30%.

Methodology Split

Gary Smith Market Share Data

I’ll share some more insights in upcoming posts. In the meantime, please feel free to offer any insights that you have through your comments. Remember, you too have access to the raw data. This invitation includes the EDA vendors. And feel free to challenge my conclusions … but back it up with data!

harry the ASIC guy

Quick Update On Verification Methodology Poll

Friday, February 6th, 2009

Quick update for everyone…

Regarding the Verification Methodology Poll I started the other day, I was able to go through the log files and identify the obvious malicious activity.  There was a string of deletes and changes of VMM votes to OVM/e votes. Then a string of deletes of OVM votes. I’m going to add back the original entries to make the data whole again.

In the meantime, the obvious malicious activity has subsided, and now there is only a trickle of clearly valid votes coming in. It’s just like listening for the popcorn to stop popping, when I see that the votes slow down to a certain rate, I’ll do my tallies and publish the results.

There have been questions raised regarding my motivations for doing this poll.  Some felt that I had some hidden agenda and some even thought that I was some sort of paid shill for one of the vendors. If you are a regular reader of my blog or if you know me, then you know that’s not true.  If you don’t know me, then ask around.

At the risk of sounding defensive, my goal was purely to conduct an “open” survey of the verification methodologies being used because this has been such a hot topic this past year, because DVCon is coming up and this would be good information, and because one of my readers suggested it and I thought it was a good idea.The idea of using Doodle was in order that everyone can view the raw data, something you rarely or never get to see when vendors and other organizations conduct polls and then release only the results that suit them best. In this way, anyone could analyze the raw data and draw the conclusions that made sense, and those conclusions could be challenged based on the raw data. The mistake I made was not realizing how easily those who, unlike me, actually had an agenda could vandalize the data.

There have also been questions raised regarding the validity of this poll and how “scientific” it is after all that has occurred. I think they are valid concerns and certainly, if I had to do this over again, I’d fix some things to prevent multiple voting and malicious behavior. Still, as I look at the interim results, they are similar to what I had expected. Each vendor lobbied their constituencies, so the playing field is level. It will be interesting to compare this result to DVCon surveys from the vendors, from DVCon itself, and from John Cooley to see if there is consistency.

Finally, to those of you who legitimately voted, I thank you for participating openly and I apologize that the results will always be subject to some doubt. I hope you don’t feel you wasted your time.

harry the ASIC guy