Tuesday, February 13, 2007

Camping sites not slums!

Thanks Todd for an elaborate response to my earlier post. In the context of city planning analogy for SOA that we are discussing, we agree that

  1. Slums do get developed
  2. Slums are undesirable
  3. Slums need to be contained and eventually removed.
  4. SOA helps containment and removal of slums

Only point of disagreement is about effective governance. Todd argues that effective governance can make sure that slums don’t spring up in first place. Conversely if slums are springing up, governance is in-effective.

My contention is that such a governance mechanism may be difficult to establish in some cases. Todd has rightly pointed out that different governance models need to exist for organizations with different focus (viz. squeezing value v/s growth). However the organization I was working with was in both these modes simultaneously. It is an organization created out of many m&a in very short time frame. It is common (well this is my opinion and I have no data) for these organization to use one part of merged entity to grow another part of merged entity, while squeezing value out of first part. Moreover value creation (growth) is not always driven by normal value chain (viz. design >> build >> sell >> service). In this particular case a clever business person had figured out a financial engineering plan to release some (millions of dollars) value away from the normal value chain and IT support was required to hasten this plan.

In such cases it appears that it is really difficult to have governance mechanisms reconciling both these (growth and squeezing value) situations. What we had was a 'squeezing value' focused governance mechanism. So many IT asset were created (which were really growth focused) outside of normal (squeezing value focused) governance. There was a danger that these assets were then further utilized by normal (squeezing value focused) projects. So we had a slum and danger of creating an ecosystem that would be developed with slum as its center.

We could avert dependency on slum by some governance scheme. But then there were debates about not utilizing this slum that was already there. The projects not using the slums were seen as redeveloping those capabilities 'unnecessarily'. The slums creation got away without governance controls imposed on it, because it was part of 'growth' focused effort and evaded 'squeezing value focused' governance. But later projects not using the slum were caught in a debate because they were under 'squeezing value' focused governance.

The key questions then is how to have a reconciled governance catering for growth and squeezing value, which will then enable transition assets from 'growth' governance model to 'squeezing value' governance model?

My belief is that answer to this question will provide effective governance as suggested by Todd and SOA will be part of that answer. Then instead of developing slums we'll develop temporary camping sites which do provide some capabilities and are governed. These are transient capabilities waiting to be mainstreamed and made permanent, if required.

If it is not too late, I would love to hear Todd touch upon some of these issues in his upcoming webinar.

Monday, February 12, 2007

City planning and slum control

Since we are talking about Enterprise architecture as analogous to city planning, I thought I can bring in my developing world perspective about how slums develop in a city despite having a nice city planning guide, in order to bring out importance of having policies for dealing with slums as part of city planning guide.

In developing world, we are quite used to slums springing up in a city despite having a city planning guide. A slum is a microcosm of a city, but without any planning or vision. It is like a city within city, with its own ad-hoc rules and regulations. It does provide some useful services to rest of the city. No doubt it is sign of broken governance but it is not just that. Slums survive and thrive because they are needed for proper functioning of city and they do provide some value to the city. However slums are not desirable. City planners must contain and eventually get rid of them.

Similar situations arise in enterprise IT world, despite having a nicely laid out enterprise architecture, and strong governance. This article discusses some such cases of deviation, but lays the blame squarely on ineffectiveness of governance. While that may be true in some cases, sometimes circumstances force one to bypass guidelines and governance. So what we also need is a framework to rectify situation, post-facto. In city planning analogy terms, we need a proper slum control and removal policy.

To illustrate, let me give this example.

In a large enterprise, they have a proper enterprise architecture defined, as intended by Annie Shum's paper mentioned in this article. There are guidelines and governance mechanism. Based on this a multi year IT plan is drawn. One of the elements of the plan is to build subject area specific data related services. The build of these services are governed by principles laid out in enterprise architecture viz. Build should be iterative; TCO should be low, resultant services must be maintainable/flexible/performant etc. It is also tied to business benefits and this capability is sponsored by a business facing project which is planning to use it in a year’s time. Now this programme is midway and another business sponsor comes up with a proposal to build a slightly different set of services for same subject area (where attributes are very specific to the problem at hand, their granularity is not generic enough and their currency is very specific to problem). This new business sponsor has a solid business case; he is promising to add millions of dollars to bottom line, if this new set of services are made available within a short span of time. There is a very small window of opportunity from business perspective and it does not matter if underlying capability does not follow any of the enterprise architecture guidelines/principles or governance processes, as long as that window is utilized. The matter reaches highest level of decision making apparatus within enterprise (e.g. CEO) and you know who would win the argument. So this set of services are built which does not fit the plan laid out by enterprise architecture, it may not use technologies suggested by enterprise architecture (procuring them in time for this solution, is an issue), consequently it may not use solution architecture laid out by enterprise architecture guidelines.

In short this is a slum that is getting developed in this nice city (viz. enterprise IT) governed by city-planning guide (viz. Enterprise Architecture). And as an Enterprise Architect if you protest too much, I am sure you would be shown the door. You cannot argue with millions of dollars added to bottom line. So what should an Enterprise Architect do?

1. Do nothing. Which would mean more such slums spring up and then it is just question of time before governance and consequently enterprise architecture breaks down totally. So it does not appear a viable option.

2. Demolish the slums. This is possible if what was built, was one off capability and not required on an ongoing basis. So as soon as the utility of this capability diminishes below a certain threshold, get rid of it, completely. If required, by being very stern.

3. Rehabilitate the slums. This is the only option if what was built is not a one off capability but is required for enterprise on an ongoing basis. The reason it bypassed enterprise architecture guidelines and governance was to catch a business benefit specific window of opportunity. One cannot avoid such incidents. What we now need is to refactor this capability as per the enterprise architecture guidelines and governance processes. We need to bring in this capability in mainstream of the enterprise IT. In short we must rehabilitate the slums (if required by some amount of redevelopment).

There may be hybrid options based on specific situations, but an enterprise architecture plan as city planning guide, must provide for this eventuality as well. I have seen this type of issue cropping up more than once. So it is difficult to dismiss it as statistical outlier, not worthy of a strategic response.

Tuesday, February 13, 2007

Camping sites not slums!

Thanks Todd for an elaborate response to my earlier post. In the context of city planning analogy for SOA that we are discussing, we agree that

  1. Slums do get developed
  2. Slums are undesirable
  3. Slums need to be contained and eventually removed.
  4. SOA helps containment and removal of slums

Only point of disagreement is about effective governance. Todd argues that effective governance can make sure that slums don’t spring up in first place. Conversely if slums are springing up, governance is in-effective.

My contention is that such a governance mechanism may be difficult to establish in some cases. Todd has rightly pointed out that different governance models need to exist for organizations with different focus (viz. squeezing value v/s growth). However the organization I was working with was in both these modes simultaneously. It is an organization created out of many m&a in very short time frame. It is common (well this is my opinion and I have no data) for these organization to use one part of merged entity to grow another part of merged entity, while squeezing value out of first part. Moreover value creation (growth) is not always driven by normal value chain (viz. design >> build >> sell >> service). In this particular case a clever business person had figured out a financial engineering plan to release some (millions of dollars) value away from the normal value chain and IT support was required to hasten this plan.

In such cases it appears that it is really difficult to have governance mechanisms reconciling both these (growth and squeezing value) situations. What we had was a 'squeezing value' focused governance mechanism. So many IT asset were created (which were really growth focused) outside of normal (squeezing value focused) governance. There was a danger that these assets were then further utilized by normal (squeezing value focused) projects. So we had a slum and danger of creating an ecosystem that would be developed with slum as its center.

We could avert dependency on slum by some governance scheme. But then there were debates about not utilizing this slum that was already there. The projects not using the slums were seen as redeveloping those capabilities 'unnecessarily'. The slums creation got away without governance controls imposed on it, because it was part of 'growth' focused effort and evaded 'squeezing value focused' governance. But later projects not using the slum were caught in a debate because they were under 'squeezing value' focused governance.

The key questions then is how to have a reconciled governance catering for growth and squeezing value, which will then enable transition assets from 'growth' governance model to 'squeezing value' governance model?

My belief is that answer to this question will provide effective governance as suggested by Todd and SOA will be part of that answer. Then instead of developing slums we'll develop temporary camping sites which do provide some capabilities and are governed. These are transient capabilities waiting to be mainstreamed and made permanent, if required.

If it is not too late, I would love to hear Todd touch upon some of these issues in his upcoming webinar.

Monday, February 12, 2007

City planning and slum control

Since we are talking about Enterprise architecture as analogous to city planning, I thought I can bring in my developing world perspective about how slums develop in a city despite having a nice city planning guide, in order to bring out importance of having policies for dealing with slums as part of city planning guide.

In developing world, we are quite used to slums springing up in a city despite having a city planning guide. A slum is a microcosm of a city, but without any planning or vision. It is like a city within city, with its own ad-hoc rules and regulations. It does provide some useful services to rest of the city. No doubt it is sign of broken governance but it is not just that. Slums survive and thrive because they are needed for proper functioning of city and they do provide some value to the city. However slums are not desirable. City planners must contain and eventually get rid of them.

Similar situations arise in enterprise IT world, despite having a nicely laid out enterprise architecture, and strong governance. This article discusses some such cases of deviation, but lays the blame squarely on ineffectiveness of governance. While that may be true in some cases, sometimes circumstances force one to bypass guidelines and governance. So what we also need is a framework to rectify situation, post-facto. In city planning analogy terms, we need a proper slum control and removal policy.

To illustrate, let me give this example.

In a large enterprise, they have a proper enterprise architecture defined, as intended by Annie Shum's paper mentioned in this article. There are guidelines and governance mechanism. Based on this a multi year IT plan is drawn. One of the elements of the plan is to build subject area specific data related services. The build of these services are governed by principles laid out in enterprise architecture viz. Build should be iterative; TCO should be low, resultant services must be maintainable/flexible/performant etc. It is also tied to business benefits and this capability is sponsored by a business facing project which is planning to use it in a year’s time. Now this programme is midway and another business sponsor comes up with a proposal to build a slightly different set of services for same subject area (where attributes are very specific to the problem at hand, their granularity is not generic enough and their currency is very specific to problem). This new business sponsor has a solid business case; he is promising to add millions of dollars to bottom line, if this new set of services are made available within a short span of time. There is a very small window of opportunity from business perspective and it does not matter if underlying capability does not follow any of the enterprise architecture guidelines/principles or governance processes, as long as that window is utilized. The matter reaches highest level of decision making apparatus within enterprise (e.g. CEO) and you know who would win the argument. So this set of services are built which does not fit the plan laid out by enterprise architecture, it may not use technologies suggested by enterprise architecture (procuring them in time for this solution, is an issue), consequently it may not use solution architecture laid out by enterprise architecture guidelines.

In short this is a slum that is getting developed in this nice city (viz. enterprise IT) governed by city-planning guide (viz. Enterprise Architecture). And as an Enterprise Architect if you protest too much, I am sure you would be shown the door. You cannot argue with millions of dollars added to bottom line. So what should an Enterprise Architect do?

1. Do nothing. Which would mean more such slums spring up and then it is just question of time before governance and consequently enterprise architecture breaks down totally. So it does not appear a viable option.

2. Demolish the slums. This is possible if what was built, was one off capability and not required on an ongoing basis. So as soon as the utility of this capability diminishes below a certain threshold, get rid of it, completely. If required, by being very stern.

3. Rehabilitate the slums. This is the only option if what was built is not a one off capability but is required for enterprise on an ongoing basis. The reason it bypassed enterprise architecture guidelines and governance was to catch a business benefit specific window of opportunity. One cannot avoid such incidents. What we now need is to refactor this capability as per the enterprise architecture guidelines and governance processes. We need to bring in this capability in mainstream of the enterprise IT. In short we must rehabilitate the slums (if required by some amount of redevelopment).

There may be hybrid options based on specific situations, but an enterprise architecture plan as city planning guide, must provide for this eventuality as well. I have seen this type of issue cropping up more than once. So it is difficult to dismiss it as statistical outlier, not worthy of a strategic response.