A recent posting of an internal Netflix guide on its Freedom and Responsibility Culture has generated quite a lot of attention. There are many gems in this 128-page document, from a very straightforward take on what to do with “adequate” performers:
…unlike many companies, we practice “adequate performance gets a generous severance package.”
(in other words, move them out now to make room for star performers), to the mature and enviable vacation policy:
We should focus on what people get done, not how many hours or days are worked. Just as we don’t have a 9-5 day policy, we don’t need a vacation policy.
One of the most thought-provoking views in the document is the treatment of Process, which is described as a necessary evil, to be tamed by an increasingly talented staff over time. Netflix states its goal for corporate culture as:
“…to increase employee freedom as we grow, rather than limit it…”
and within that goal, the organization’s view of Process is framed in terms of an ongoing struggle:
- As the organization grows and becomes more complex, chaos emerges
- Process usually emerges to stop the chaos
- However, the Process model drives more talent out – we can’t let this happen
The solution to this challenge is in increasing talent density faster than the complexity grows, with the end-state of:
“With the Right People, Instead of a Culture of Process Adherence; a Culture of Freedom and Responsibility, Innovation and Discipline”
In this model, Process is to be tolerated, and whenever possible, replaced by great performers who know what they are doing and can figure out how to get things done, without arbitrary rules getting in the way (I do not personally know any Netflix employees, so others will need to comment on whether this view of Process is accurate across their organization).
Contrast this model with that found in most IT organizations of any size. Process is not only accepted, it is celebrated. There is a complex process for everything, from the method for getting approval to build a piece of software, to requisitioning a new server, to the detailed accounting for every activity performed during the work day. One might even go further with the observation that in many organizations, processes are stacked over time, one on top of another, with few processes ever being retired.
Note that in this post I am not referring to BPM, the analysis, representation and improvement of an enterprise business processes, or specific software development methodologies such as Agile. Rather, I am referring to the dozens, perhaps hundreds of smaller, non-mission-critical processes that are created over time in an IT organization. These processes may become the de-facto Operating Model over time.
Peeling the Process onion within an organization may reveal layer upon layer, created over many years. An interview of staff might show that they have little idea why they are still performing certain process tasks. A snap judgement that the staff should have been questioning this waste of effort they were engaged in would be a mistake – in most cases you will find that they have been actively questioning the broken processes, and may have been fighting what they deemed to be wasteful efforts for many years, to no avail.
Seth Godin and others are right in the assertion that every employee is responsible for changing the culture and actions of their company, and need to take responsibility for it. That accountability only goes so far. A responsible employee may try once, or a few times to change a broken process. He may come expertly prepared with charts and graphs and make a formal pitch to try to affect change, or he may just send an informal email to a manager. He may try again later on with another leader, or at another level in the hierarchy. But he’s not going to keep pushing the issue forever, not in an economy where many of his friends don’t even have jobs. Better for him to just sit back and do the drill every day, hoping that the wizards in management will eventually come to the same realization he came to some time ago.
So, processes are seldom retired or removed from an organization, but are very easily added to. Why?
- We start with an assumption that a process is good and necessary. Rather than looking to our people to fix a failure of service, we assume that a new process is probably needed. If a process really is required, we may assume that it needs to come from management rather than the staff most affected and expert in the operation under review.
- Each of us has a strong bias toward creation rather than destruction. Every new leader tasked with improving the status-quo thinks first about the processes we could build to improve efficiency or lower costs, rather than what needs to be stopped, or torn down.
- Tearing down or stopping an activity could be viewed as an admission that we were on the wrong track as a department, and becomes an opportunity for blame – the process in question may have been created by an individual still in management, and the politics of that attachment add complexity to the review effort.
- Although a particular process is considered outdated by the staff performing it, there may be process outputs, however trivial, that are now used by individuals downstream – a number for someone in finance, or a data element that is input into yet another system. This downstream dependency may create substantial push-back for any changes to the status-quo, even though effort is being wasted upstream by others.
So large-scale process change efforts are undertaken, meetings are held and PowerPoints are created. In the end, success may be defined as making a few tweaks around the edges, with a new layer of process added on to the existing set. Management may then move on to the next project, while the staff tasked with implementation of these new processes shrugs and goes back to work.
So what comes out of this sausage factory? Two similar software products with similar features and quality levels emerge from two different organizations, but one is burdened by a 50% process overhead “tax”. Is the consumer willing to pay a 50% premium for the same product from your company because of unnecessary processes behind the scenes that added no value? No, the only way this works (temporarily) for the process-laden company is to bring other assets to bear – an established brand, significant advertising dollars or a competitive moat of some sort. Eventually the lean organizations and their products are bought up in the hope that they will be a positive influence for change in the larger, process-heavy enterprises.
Every leader carries around a legend or two about the staff member who was creating reports or dutifully filling out forms, for years, only to find that no one was reading those reports, or the forms were being thrown out with the trash right after completion.
We tell these stories to make the point that every member of our team should be questioning their own activities, and the value they are providing, and that’s certainly true. But what is our culpability in this issue as leaders? Did we create an environment where Process was worshipped, or a tool to be used sparingly, always subject to review, and torn down on occasion? Is our environment one in which questioning the status quo is acceptable and rewarded, or one in which fear rules? Have we decided as an organization, explicitly or not, that it is probably easier to pay less for staff while expecting less of them, with a plan to make up for it with an extra helping of process?
Do you think this view of Process is realistic? Why or why not?
Update: Many insightful comments were submitted for this post – please check them out below.
Your comments are welcome. If this post was helpful, you might like to subscribe to the RSS feed, sign up for weekly updates via email or follow me on Twitter.
{ 28 comments… read them below or add one }
A great read: The Tyranny of Process Worship within IT: http://bit.ly/eWc25
This comment was originally posted on Twitter
IT Process Tyranny, good post by @scottbooher: http://bit.ly/eWc25 I agree with Scott, do you?
This comment was originally posted on Twitter
A good meditation on process for its own sake within I/T. Reminds me of every place I have ever worked: http://bit.ly/U6zrs
This comment was originally posted on Twitter
Scott,
Nice post.
I’ve thought about this subject a lot, as I have worked in environments that were almost entirely without process and in those that have so much process that there is a process for talking about the process. In the end, what I’ve come to believe is two things. I think that in general the less confidence a team has in its ability to execute as a whole, and in the ability of any particular member to execute, the more process it will create over time.
Secondly, process is not always developed with a focus on outcomes and the options available to reach them, but it should be. If an organization does not explicitly define and understand the outcomes it is looking for as well as the options available to reache those outcomes in an ongoing, proactive, and thoughtful manner, process will go wacky and self-replicate. Process is the default approach, but it’s often not the best one.
For example, one outcome you might pursue is to have 100% uptime for a particular service. One way you might think to pursue this outcome would be to institute a strict change management process so that it’s less likely that changing something will break it. Generally speaking, setting up the process is a pretty easy thing to do, and frameworks like ITIL are increasingly delivering shrink-wrapped process solutions for those organizations that prefer this approach.
Another more difficult option to pursue the outcome of 100% uptime would be to design an architecture that is resilient enough to withstand broken changes. Another even more difficult way would be to hire engineers so close to perfect that they never make any mistakes when they make changes, which is obviously the least realistic of all of these options. All three of these options have the potential to succeed, but if you’re not measuring against outcomes, you have no idea whether it’s working or not.
Companies that are either not confident in their ability to solve problems the “hard” way — in this example by designing a resilient architecture or by attracting and retaining brilliant engineers — or are not aware of or do not believe that there are other options available to them, will tend to rely on process to give them a feeling of comfort. Over time, process takes over, and as you pointed out, it can become increasingly difficult for even very talented folks inside and outside of management to change the process. I would also argue that the organization becomes increasingly blind to the reasoning behind the process — the desired outcomes — because the process that is often given the least attention is self-reflection.
Organizations rarely give themselves the opportunity to understand if the process is really working, nor do they ask themselves often enough why they are following the process in the first place. The existence of the process gives a false sense of comfort — things must be going smoothly, we’re following the process. And as you pointed out, there is also a tendency for management to believe in its own creations, not to mention the need for management to make themselves look good to those above them. Getting rid of an institutionalized process is a high visibility thing, and only the most confident managers will take on these kinds of fights.
Meanwhile in a process culture those people that might be able to reach the desire outcomes via other less process intensive means are over time less motivated to work on making the environment more resilient, because they are burdened by process, and may not even be aware of what the management’s desired outcomes are. More often than not, if you ask management what their goal for you is in a process shop, they will respond that their desire is for you to follow the process, rather than to understand or improve it.
So over time, the process becomes perceived as being ever more important as the effect of process takes it toll and mediocrity creeps in. Eventually those people that might have been able to solve problems with less process leave to use their skills elsewhere, or become ossified and lose their talent. Meanwhile, it becomes ever harder to attract outside talent, as the number of talented folks in your organization goes down, the amount of process goes up, and management is unable to articulate their goals in a way that speaks to talent. So process becomes self-sustaining and almost unstoppable.
In the end, I think it all boils down to how good the team is at understanding and communicating desired outcomes and executing against those goals flexibly. I think that the NetFlix culture preso does an incredible job conveying that they understand the power of attracting and retaining talent, and so based upon my feelings about it, their disdain for process follows.
In a situation where you’re trying to operate without having too much process, management and non-management are equally important. Management has to enable their talented folk to do good work, and talented folk have to trust in management to make the right decisions about how much process is needed and keep focus around the right outcomes. Everyone has to understand and share the same goals and work together to reach them. It’s a mutual relationship that only works if both sides are in sync, and requires that management spends time managing “down” in addition to managing “up”. It is exceedingly difficult to do in companies that are top-heavy or tend towards control structures, but sadly those companies are extremely common, in my experience.
When I consider how rare it has been for me to be exposed to even average to good management, especially within IT companies or departments, I’m left unsurprised about the cult of process. It is an alternative to excellence for those companies that haven’t figured out how to do it the hard way, and a smokescreen that insecure and ego-driven managers use to convey competence where there is a lack of it.
For me, it’s one of those dividing lines that really defines our industry — you’re either primarily a process shop or primarily a talent shop. An entire organization can be both things by picking and choosing where to focus on finding and nurturing talent, and where to rely on brute force and process, but this tends to be rare. In general a company tends to pick one way or the other, and the effect of that choice ends up having a profound impact on the development and trajectory of the company. Pity that by the time most organizations realize that they have a problem, it’s already too late. Kudos to NetFlix for not being one of them.
Brian Merritt Technical Architect, Hacker
Brian,
Thanks so much for your comments, I think you nailed it with your two points above (confidence level, and lack of focus on outcomes). The lack of organizational confidence especially, seems to be a driver for over-application of process, and once a team heads down that path, it is hard to pull back. More and more Powerpojnts are created, more ideas are tried, one after another, and more excuses are made for failure, when in many cases an effective application of direct leadership would straighten things out. I’ve seen the frustration with staff that are in this situation, and it leaves an impression – something for us all to be vigilant in if possible…
Scott
“We should focus on what people get done, not how many hours or days are worked. Just as we don’t have a 9-5 day policy, we don’t need a vacation policy.”
While I admire the sentiment, it’s rather anti-family.
This comment was originally posted on Hacker News
Can you elaborate?
This comment was originally posted on Hacker News
That sort of policy encourages people to work very long hours to out-compete their coworkers. And don’t tell me that there is no competition working for a place where adequate work is rewarded with a “generous severance package.”
You pay for that sort of thing long term with burnt out employees and broken families.
Vacation and the 9 to 5 policy encourages people to compete with each other without going overboard and ruining their lives. Whether that’s good or bad for you, their employer, is something that you need to consider.
This comment was originally posted on Hacker News
We have a similar policy where I work. There are certainly people who work harder, or who take less vacation than they would like. But from what I’ve seen, most of these people are either workaholics, or underperformers who probably shouldn’t be working here anyway. I suspect most of these people would be working long hours regardless of the work hours or vacation policy.
For the rest of us, the freedom is tremendously valuable, and we have fantastic work-life balance.
This comment was originally posted on Hacker News
I couldn’t disagree more — what could be more pro-family than being able to come in to the office for face time 10~3, and get shit done on your own schedule?
What could be more pro-family than not having to count vacation days, being able to spend time with your kids instead of reading HN and ‘looking busy’ when you don’t have a pile of work?
This comment was originally posted on Hacker News
I think a distinction needs to be made between actual process and codified process. The former always exists, and the only question is whether it is working or not. The latter is endemic to large organizations with disaffected and mediocre management and employees, which is what Netflix is actively fighting against.
However the tone of this piece and the original Netflix manifesto does not acknowledge this distinction. I think this shows a bias that is driven by product-oriented software engineers and creatives. “If the product is great then who cares how we got there?” Well that’s certainly a valid viewpoint, however it shortchanges great management. Great management is not done by simply hiring the best people and turning them loose on a project. That works in a startup where everyone knows each other and so any two people can notify each other of relevant issues. It doesn’t work in larger organizations where individuals have a much narrower slice of responsibility and thus lower visibility on the whole actual process going on.
I’ve worked with some people who take a process-oriented approach and were very talented at getting the best work out of their employees. For these people it’s no more about rigid codified processes than it is about a relentless focus on product. Instead, the goal is to understand at a high level what all the various stakeholders are doing, where their individual bottlenecks are, and determining a process that maximizes everyone’s productivity. People like this are incredibly valuable, because let’s face it, management is much harder than programming to do well because you are not a domain expert in anything, instead you have to figure out how to help all the different domain experts operate efficiently.
I realize none of this is news to the folks at Netflix, but I think the way the manifesto is written de-emphasizes these facts to the point that the inexperienced or low-level programmer may miss the forest for the trees, which incidentally is exactly what the problem with bad actual process is.
This comment was originally posted on Hacker News
Thanks for the comments. I should have made a better distinction between actual and codified process. My thoughts were toward codified, which, as you state, are endemic in larger organizations, and seem to build on themselves over the years, good and bad, until less and less actual progress toward the ultimate goals of the organization is accomplished. Process is delivered, rather than products…
Although I did not agree with everything in the Netflix deck, I was impressed by the “bias” toward great people rather than great process, which seems to me, to be a fresh take on it. There will always be necessary processes and there are certainly many great process best practices to draw from, but I do think we should all be CONSTANTLY QUESTIONING what is in place, asking ourselves if it is serving us or we serving it, and making changes as needed. It is my experience that this happens rarely in large organizations. There simply isn’t the political will to take it on…
This comment was originally posted on Hacker News
In the corporate world it’s definitely a fresh take, and that alone is worth a lot.
This comment was originally posted on Hacker News
Codified process help to increase efficiency by remembering the best way you solved the same problem before. This is extremely useful when you are repeating problems, but it stands in the way when you keep doing new things. The real question is not process and group productivity vs individual productivity, but how fluid your problems are.
When a random customer calls the help desk ask “Is it plugged in?” aka say “Please unplug it wait 5 seconds and then plug it back in.”
When the head of R&D calls ask “How can I be of assistance?”
This comment was originally posted on Hacker News
Yes they do that. Additionally I think in a codified process it’s probably more important to write down why the process is there and what problem it attempts to mitigate/solve. Then when the problem has been solved in some other way the process should be removed.
(Written) Processes seem to be the same sort of thing as code commenting.
This comment was originally posted on Hacker News
The problem here is that everybody thinks that they’re talented superstars, and they don’t need to have to worry about rolling back a version, or testing, or any of those other dreaded bits of ‘process’. Which is another way of saying, “putting some steps in place to cope when you inevitably screw up.”
This piece sounds like it’s written by some cowboy who wants to move fast, and be all agile and light. These people are also nominally nowhere to be found at 4am when their undocumented change brings down the production server farm, and then I have to get up and fix it… which is all kinds of fun.
The fundamental problem is that most shops are organized with ‘IT’, ‘Operations’, and ‘Development’ all being very separate camps. There’s no mutual respect, and plenty of blame, so massive piles of process get created as a means of defense for the Ops and IT guys, who get screamed at every time there’s a problem that hits the customers.
There’s a really good talk on why this is bad from the Velocity conference, here: http://velocityconference.blip.tv/file/2284377
This comment was originally posted on Hacker News
Thanks for the comment. no, I’m actually not even talking about the process of building software, (as I stated in the post), and am anything but a “cowboy”. I’m talking about all the dozens of other processes that add zero value to the product, that are put in place with the best of intentions, and add all kinds of cost….things like spending 30 minutes a day tracking time for every meeting attended against an activity/project, multiple processes taking weeks for acquiring a server, weeks spent in generating documents that are not even looked at by others, etc… hopefully that makes sense.
This comment was originally posted on Hacker News
Common focus is one thing; changes should be driven by a concrete external goal that is shared by all parties. You don’t push code because it’s Thursday, you push code because it’s got new feature X that matters to client Y.
A culture of humility is also important; Ops/IT people build walls of process when developers chew them out for mistakes, which only gets worse when a chunk of those mistakes (but not all) end up falling on the developers. At most shops, when there’s a problem, this is the general flow of things:
1. The software got updated on the site, and now customers can’t access anything, but everything looks to be running.
2. Sales/Management/CS scream to fix the problem.
3. Ops blames Dev, and Dev blames Ops.
4. After the problem is fixed, Ops adds new process to make sure this problem doesn’t happen again.
When, in my perfect world (and at both places I work, for the most part), it goes like this:
1. The software got updated on the site, and now customers can’t access anything, but everything looks to be running.
2. Sales/Management/CS scream to fix the problem.
3. Dev and Ops both say, “We might have screwed up, let’s dig deeper…”, find the problem and fix it.
4. Whoever found and fixed the problem gets a beer.
This can’t work unless you’ve got a company culture of “fix the problem, reward the fixer”, rather than the prevailing culture of, “nail the responsible party to a tree.”
Finally, getting out of the ivory towers is also really important. Dev people need to realize that their mistakes cause serious grief for the Ops guys, and the Ops people need to realize that making life harder for the developers through over-regulation (not having local admin, etc) causes equal pain. Mutual respect, which comes from working together, is important.
This comment was originally posted on Hacker News
Agree with everything you say here, thanks
This comment was originally posted on Hacker News
There is only one process in IT which I worship:
This comment was originally posted on Hacker News
excellent t-shirt idea
This comment was originally posted on Hacker News
I think we need to create an approval process for processes so that we can slow down the creation of processes.
This comment was originally posted on Hacker News
RT @pmhesse A great read: The Tyranny of Process Worship within IT: http://bit.ly/eWc25 – not just within IT. Process strangles innovation!
This comment was originally posted on Twitter
“The Tyranny of Process Worship Within IT?” Processes R seldom retired or removed from an org but R very easily added. http://bit.ly/yM2uL
This comment was originally posted on Twitter
I had an Internet startup in the dot.com days. We grew very rapidly. We almost suffocated the company by applying too much process. When the crash came in 2000 we lost a big customer and had to cut our staff in half. I was crapping because I didn’t know how all the work would get done with half the people. Turns out though that not only were we able to get the work done but that things actually improved. We were forced to break down processes, if only because we couldn’t afford a person to make checkmarks or play middleman. Eventually we whittled the staff down from 50 to 20, while continuing to grow revenue and dramatically increasing our feature functionality.
What were we thinking when we implemented process after process? I think what drove us to rely on processes is likely the same thing that drives others down this path. It’s the loss of vision and touch. When you’re small you know everything that is going on. You pick it up on the “airwaves” in a small company because you sit in the same room for instance. Decisions come easy because information is at hand. Then when the company grows large enough that you *can’t know everything*, as a manager you feel a loss of control. You are floating untethered. Then you decide: Bam! Let’s put in some processes so I can be assured that I know how things are getting done. Processes which of course we know junk up the system if they don’t actually fail outright.
The philosophical lesson obviously is that you can’t control everything and that (of course) you weren’t really in control to begin with. A company runs on the myriad of microdecisions made by each employee each and every day. At some point you *must* trust the judgement of your people. Use the force.
So what can you do? The lesson I walked away with (after further employment working also for some big companies) is that there are only a few things that a manager can really do to make things go in the direction they want. The first is to hire good people. Duh right? But a lot of the time we hire people who are “good enough” because we’re thinking in terms of roles and not in terms of microdecisions. The second is that the largest influence, perhaps the only influence, that a manager has is in the establishment of “culture”. Companies are social systems. They are tribes (see Paul Graham on this). The leader sets the tone and (most times) creates the culture. Do as I do, not as I say. If you set the right culture then it affects trickles into all of those microdecisions in a way that no process can possibly achieve.
For middle managers this is not a great situation since, unfortunately, the culture of a company is typically set by the senior management. A middle manager cannot really swim against that tide because your job as a middle manager is not to set culture – it is to make sure that what the CEO has proscribed gets done. If as a middle manager you fit snugly into the culture set by the CEO then you’ll probably be happy. If not then you’re likely to be miserable (although possibly too well paid to leave, a trick large companies use to keep the best people employed
This is my take at least and it depends of course on how much autonomy middle managers are given and perhaps the degree to which senior management is enlightened (Google?), or perhaps even pursuing goals other than money (for instance Steve Jobs’ pursuit of elegance and vainglory I think sends Apple off onto an atypical trajectory).
Neat blog post based on recently made public Netflix culture PPT; very good points in here – http://bit.ly/ManTG
This comment was originally posted on Twitter
In my experience, the most process-laden organizations are the least innovative. Truly innovative companies encourage people to think outside the box, be critical thinkers, and tell the emperor he’s buck naked. It also seems to be the case that process worship occurs most in organizations that do not trust their employees and therefore would never contemplate anything as brave as the Netflix manifesto. Finally, process exists where mistakes are not tolerated or considered to be necessary learning opportunities on the path to something better (product, culture, whatever). I can’t recall who said it first (and it doesn’t matter anyway), but somebody once said the key to success (in business as well as in life) is to learn how to fail better. The whole point of process is to reduce if not eliminate mistakes.
I found a lot of value out of this article, thanks for writting it. In reading people’s responses an interesting pattern starts to emerge. In this article you are speaking about process in abstract terms adding some philosphical leasons/points. This forces the reader to rely on his or her own personal experiences to try and internalize your points. However readers have such diverse set of experiences, i.e. process in an 100,1000, 10000 organization differ dramatically. Your big picture point is simply “you should really question if your organization has too much proccess and if it does that will lead to lose of talent.” However people’s natural tendency is to either agree or debate some of the philosphies but that is impossible with out knowing the specifics of that reader’s organization.
I think everyone has been in situations where process adds to the final product and situations where it detracts and it is by no means a new problem. You article is meant to open our eyes to new ways of looking at that age old problem but not to solve it for us.