Lean Startup: Validation has no soul

I had this idea that I wanted to develop, but as entrepreneur and Lean Startup practitioner I immediately faced an inner conflict:

If I was to do as I preach, I should on the very first hour begin by exploring the world of potential customers. What I felt like doing, was to start programming. Under excuses like “I’m also doing this to learn a new web framework” and “this is just a hobby project”, I chose the latter. If nothing else, I also decided to pay close attention to my development process and how it evolved. I even promised myself I’d write about it, so here we are.

My customer segment is newbie textbook authors and novelists. I assume they have the following problem: Writing a book is a solitary process. I know this to be true for at least one person in the entire universe.


In other words, like the 37signals guys, I’m solving my own problem. I’m well enough into Lean Startup and entrepreneurial thinking to know I shouldn’t be working like an author – in solitude – so I have a few users in play (and they have already given me valuable feedback).

Apart from learning a new web framework, I’m also realizing something about the Lean Startup: I think I may even have found a silver bullet.

Let me explain.

My project is called Feedbackbook. It is a collaboration tool between authors and their reviewers, and it supports the process of getting feedback:

  1. As a newbie author, I want to manage my reviewers as the valuable resources they are, so that
    1. I don’t burn them all at once (most reviewers read your work meticulously the first time only)
    2. Reviewers may focus on different aspects of my writing (rich feedback from various perspectives is more valuable than repetitive feedback)
    3. Reviewers are regularly reminded until they remember to do as they promised me: Read my work.
  2. As a newbie author, I want to use both experienced writers and target readers as reviewers, so that
    1. I learn faster how to write effectively
    2. I make sure to write something of value to someone
  3. As a reviewer, I want to optimise my time spent on reviewing so that
    1. I have time reviewing (don’t waste it on having to install MS Word, Creating a Google Account, sending the wrong attachment etc)
    2. I increase my reviewing capacity, and get to review more books even share the joy with the author should it become a success (royalties)

A list of assumptions, you might think, and I agree. It truly is. Now, however, the question is not how I experiment with my assumptions. As the world progresses towards more explorative ways of developing products, most entrepreneurs are going to get decent at experiment design and execution. Interview techniques, A/B-testing, landing pages, funnel analytics and so on will all be at our fingertips.

Rather, the question becomes how I came up with these assumptions in the first place.

Assumptions and validation are both crucial

The Argentinian cellist Sol Gabetta says her instrument is a part of her soul. Artists like her put an almost unbelievable amount of work into preparations. A performance it’s not about rendering the music sheets correctly – in order to engage with their audience, they need to pursue their own take on every piece they perform. This creative process is the hard part. Sol Gabetta has an advantage over entrepreneurs: The music she plays has survived for hundreds of years. It’s validated, beyond any trickle of doubt, that it has value to someone. Hence, she may focus on performance alone.

Sol Gabetta Cellist

Live and breathe your product

Entrepreneurs, on the other hand, who need to develop their ideas as well as validating them, risk doing mostly one or the other, simply because switching modes is too demanding. Lukas Fittl writes about this in his post The Ideation Switch. In his view, in addition to the build-measure-learn loop, you should also spend time on Ideation, where activities like Customer Interviews, Business Modelling, Index Cards, Personas, Design Studio, Rapid Prototyping, Customer Journey Maps, and more come into play.

A number of things are going on when musicians study a new piece. They’re rehearsing to build muscle memory for a more confident performance. They’re developing an intuitive understanding of rhythm, phrasing, intonation and a number of other factors that ultimately makes the piece “a part of their soul”. It might sound like an obsession. It probably is.

Get into the building (and out again)

The time an entrepreneur spends speculating inside the building might not be 100% wasteful. While you program, tweak business cases, create wireframes, build mood boards or do whatever maximizes your creativity, you essentially rehearse your idea. You build “muscle memory”, you train rhythm and intonation. This process may take you faster to the assumptions it makes most sense to validate.

Being a newbie author, I know what it feels like to have worked for too long on a text nobody has read. Simply knowing that someone actually read this crap, gives me energy to continue. That’s what the first version of Feedbackbook covered: Reviewer tracking. No login, no ability to comment, no chapter rating. The only feedback an author would get, was how far a reviewer read before he fell off. But my solutions worked. I didn’t fake anything: I programmed a document parser, I had a database, and I even made a simple dashboard for the author. And the fonts and colors were nice (I used a CSS Framework), and a reviewer would get started reviewing by tapping his smart phone once.

Working on this first feature, prototype, MVP or whatever you choose to call it, also helped me understand my vision: Feedbackbook is here to spark writing energy. It’s not really about feedback (although the feedback most likely will be crucial to the author’s success). This insight was a step up on what I call the consistency scale.

Screen Shot 2015-03-03 at 16.55.13

Hence, I miss one thing in the list of ideation activities Lukas Fittl outlines. Idea rehearsal. Programming working software (hello Agile) is my best example of such idea rehearsal – I even believe the ability to program is a competitive edge, as I know few other creative processes that expose the devil in details so fast. (I’m certainly not sure what visionary insights I would get from a series of cheap experiments, although they probably would have given me more feedback.)

There are many types of entrepreneurs. The most extrovert kind is “all over the place”, constantly using human interaction as a source to insight. The most introvert kind also need to be in touch, but will find the actual insights later, when interacting with himself. Both types have the potential of creating something awesome. An entrepreneur only concerned with validation is soul-less, regardless of his kind. He experiments because he just might find something. He has no “take” on the music (and it might even work some times). Creative people need to put their soul into the equation, and dig into the quintessence of their product. (If the word “soul” becomes too unworldly for you, interchange it with “intuitive understanding”. And continue reading.)

When working on behalf of an investor, it gets worse. We constantly have to switch between focusing on how we spend someone else’s money, and nurturing your own creativity. From our rational self, to your soul, and back again. It’s easy to get stuck on either side, making you either too rational (you only care about doing it “right”) or too detached (you work in splendid isolation, and burn your funding on the wrong ideas).

My approach with Feedbackbook has three rules to follow:

  1. I’m solving my own problem (as much as I hate to admit it, there are few other persons in the universe I empathize with more than myself). I solve this problem in collaboration with other people I assume to be like myself.
  2. I’m using programming as a means to reach insights (and I consider the working software in production a by-product). I allow my self to spend days and weeks in solitude, not months. Validated learning is still how I measure progress.
  3. No programming without a business model. I evaluate it frequently, by using feedback from all users including myself. I consider myself in trouble if I for some reason stop using my own product.

I’m still facing the risk of (very effectively) developing a product nobody (but me) wants. I would however face risk with the validation first approach as well. In that case, I believe there’s a risk of superficially validating and invalidating both the wrong and the right assumptions. I might lose direction, I might give up prematurely, I might even find an out-watered product that barely makes it (and call it a success).

In other words: I can’t really tell whether my idea is good or bad before my assumptions reach a consistent level. This consistency level is in itself a collection of assumptions. An epic assumption, if you will.

Validation and learning are not the same

Right now my epic assumption with Feedbackbook says I’m not building a tool for writing: Authors should keep using their favourite word processors. More importantly: The feedback facilitated by Feedbackbook shouldn’t get in the way of the author when they’re writing their way towards consistency. (Keeping their working copy clean from comments, changes and other kinds of feedback).

I might be wrong. Maybe Feedbackbook should be a word processor, but before I reach something consistent that can be tested on authors over time, rapid experimentation will not to tell me either way what’s right. I won’t know if my negatives and positives are false or true. (I could experiment with landing pages or mockups illustrating versions with and without word processing, but wouldn’t know how to design these mockups consistently enough to tell if an experiment actually validates or invalidates them).

Screen Shot 2015-03-03 at 16.50.54

You could argue that any Lean process should have some slack built in (time you spend on anything you want), and that’s how you cover the consistency part. This however, makes consistency a second class citizen, because you’re only “allowed” to work on it on your “spare time”. That in turn makes validation the only first class citizen, which in turn makes validation a silver bullet.

When experimentation becomes a prerequisite

Gut feeling, intuition, luck, creativity and other seemingly “unscientific” qualities may be more important than we think. Actually, I believe all these traits are very scientific (don’t tell me Einstein missed out on any of them).

I believe Eric Ries is right when he says everything an entrepreneur does is an experiment. This however, does not imply you should experiment with everything. You simply don’t have the time.

When the experimental approach transitions from being a competitive advantage to a prerequisite for competing, our soul might get crucial again.

Related posts from Anders:

Anders Haugeto (36) is software engineer, experiment designer and entrepreneur helping the customers of Iterate innovate faster. He shows intrapreneurs how lean thinking helps their mission in life – disrupt yourself from within.


  1. Another great post Anders. Definitely keep writing, and be sure to tell me when your book is available for pre-order 😉

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s