Roundtable Podcast on Testing

As a huge fan, and active practitioner of, testing (A/B and multivariate), I decided it was time to record another podcast about the subject. I invited some of the people who I think have done a lot in this area and are working with continuous improvements online.

Some of the topics discussed in this podcast:

  • Where should someone new to testing begin?
  • Does method matter?
  • Is suboptimization a risk?
  • Can we trust the statistics behind tools?
  • What test result has been the most surprising?

Listen: Podcast

Download the podcast

The panel in this podcast about testing:

Bryan Eisenberg is the co-author of several best-selling books: Call to Action, Waiting For Your Cat to Bark?, and Always Be Testing. He is also the co-founder and chairman emeritus of the Web Analytics Association. Bryan serves as an advisory board member of several venture capital backed startup companies (such as Bazaarvoice, iPerceptions,, and ClickEquations) and is on the board of trustees of the Direct Marketing Education Foundation.

Lance Loveday is the founder and CEO of Closed Loop Marketing. His company has become highly sought after, serving a wide array of clients—from startups to big brands such as Hewlett-Packard, Brocade, and Lockheed Martin. Lance is co-author of the book Web Design for ROI.

Anne Holland is the publisher of WhichTestWon? and president of Anne Holland Ventures Inc, an online business media company. She is the founder and former president of MarketingSherpa, and has for more than 20 years been conducting tests and research into what works best in marketing.

Chris Goward is the CEO of WiderFunnel Marketing Optimization and an expert in website conversion rate optimization. Chris has been optimizing online and offline marketing for companies such as eBay, Epson, SAP, Getty Images,,, Outrigger Hotels, and Google.

Web Design for ROI


Previous podcasts about testing

I made four podcasts about testing back in 2007. Names of tools have changed, but the idea and principle behind testing is still relevant.

If you would like to give my podcasts a listen, try:

Podcast with Bonnie Thomas, Marketing Director of Memetrics
Download podcast (MP3)

Interview with Matt Roche, CEO of Offermatica
Download podcast (MP3)

Wine or Gasoline? A Podcast with Mario Fantoni of TaguchiNow
Download podcast (MP3)

Podcast with Mark Wachen, CEO of Optimost
Download podcast (MP3)

I am currently planning a new round table podcast about testing featuring thought leaders.

Two podcasts about web analytics as well:

Web Analytics in Europe
Download podcast (MP3)
Listen: Podcast

Interview with John Marshall, CEO of ClickTracks
Download podcast (MP3)
Listen: Podcast

All podcasts, all topics