SSRN 882088
SSRN 882088
SSRN 882088
INFORMATION Institute of
SYSTEMS Technology
RESEARCH
Sloan School Cambridge
of Management Massachusetts
27 Pages
IT Assets, Organizational Capabilities and Firm
Performance: Do Resource Allocations and Organizational
Differences Explain Performance Variation
Sinan Aral, Phd. Student, MIT Sloan School of Management
Peter Weill, Director, CISR, MIT Sloan School of Management
1. Introduction
For over a decade, research has attempted to untangle the relationship between information
technology (IT), productivity and organizational performance. Early results uncovered a
‘paradox’ in the relationship (Loveman 1994, Strassman 1990) that has subsequently been
explained by both substantive and methodological considerations (Bakos 1991, Dos Santos et al.
1993, Brynjolfsson & Hitt 1996). Recently, more precise measurements have demonstrated a
convincing (albeit varied) positive relationship between IT investments, economic productivity
and business value across distinct measures (Brynjolfsson & Hitt 1996, Dewan & Min 1997,
Bharadwaj, Bharadwaj & Konsynski 1999). While this research provides evidence of a general
relationship between IT and organizational performance, our knowledge of the specific factors
driving these general results remains quite limited. In this paper we address two important
questions that remain unanswered.
First, returns to IT investments exhibit substantial variation across firms. Large sample statistical
evidence demonstrates that nearly half of the productivity benefits originally attributed to IT
capital can be more accurately explained by firm specific factors (e.g. Brynjolfsson & Hitt 1995).
These results imply the existence of a set of organizational characteristics that are simultaneously
positively correlated with IT investment and organizational performance. Some firms simply
derive greater value per IT dollar even when controlling for industry level variation. But, what
types of organizational characteristics explain this variation? To address this question, we open
the black box of the organization to examine what types of organizational factors and
management practices contribute to a firm’s ability to generate business value from IT. Second,
the majority of firm level analysis measures IT in the aggregate. In contrast, we know little about
the relative performance contributions of different types of IT investments, and whether different
IT investments impact different aspects of firm performance. One explanation for why two firms
with the same amount of IT capital perform differently is that they are investing in different
types of technology with different goals. We therefore conceptualize IT as four distinct types of
assets, implemented to achieve different management objectives, and test their relative
performance effects.
We explore these questions using data from 147 firms over 4 years and illustrate the results using
qualitative evidence from a case study of 7-Eleven Japan. We find that investments in a
particular IT asset class deliver higher performance only along dimensions consistent with the
strategic purpose of that asset. For example, investments in transactional IT applications, made to
reduce costs in standard, repetitive processes, are associated with lower costs but not with more
firm-level product innovation. In contrast, investments in strategic IT applications are associated
with more product innovation, but not with lower costs. These results suggest that a monolithic
The authors gratefully acknowledge this research has been generously supported by grants from the CISE/IIS/CSS
Division of the U.S. National Science Foundation (#0085725) and by the MIT Center for Information Systems
Research (CISR). We thank Nils Fonstad, Steve Kahl, George Westerman and seminar participants at Boston
University and MIT for many valuable comments.
© 2007 MIT Sloan—Aral & Weill Page 1
view of IT may obscure the importance of resource allocations within the IT function by
focusing on the performance implications of firms’ total IT capital stock. We also find evidence
for complementarities between IT and a system of organizational IT capabilities (ITC). IT
investments and organizational IT capabilities co-vary significantly in our sample, demonstrating
that firms high in IT intensity develop IT related organizational capabilities and firms with strong
IT capabilities demand more IT. Firms with stronger organizational IT capabilities also derive
greater value per IT dollar. We find that ITC both strengthens intended performance effects, and
broadens the impact of investments in particular IT assets beyond their intended performance
goals. Our findings demonstrate the importance of pursuing more detailed and disaggregated
measures of IT intensity, organizational IT capabilities and firm performance in IS research.
1
The case studies were developed using unstructured and semi-structured interviews with upper level IT management employees, examination of
archival data, historical data from the press and unpublished firm documents, publicly available performance data, and the firms’ web sites.
2
Before constructing measures of the practices and capabilities, we asked managers in research workshops to examine our framework to make
sure our theory reflected their experiences. Based on these discussions and our case data, we identified eighteen indicators of the competencies
and practices. Definitions of the variables and their operationalization appear in Appendix A.
3. Methods
3.1 Data & Metrics
While previous researchers have coded types of IT investments according to language used in
media descriptions (Dos Santos, Peffers and Mauer 1993), we asked senior IT executives to
subdivide their total IT budgets according to descriptions of the asset classes to better understand
the management intention for IT investments in each firm. Descriptions of the asset classes and
examples of IT assets were used to guide managers in categorizing their IT investments. All 147
respondents were from large, publicly traded U.S. firms and Compustat was used to obtain
performance and other relevant data during 1999-2002. Our sample is composed of 58%
manufacturing and 42% services firms, which mirrors the composition of the S&P 500 and the
Fortune 1000. The sample includes 147 firms over 4 years for a panel of 588 firm years between
1999 and 2002, accounting for $448 billion in output in 2001. The survey instrument was
designed and pilot tested as part of the NSF funded MIT SeeIT Project. Using the MIT SeeIT
instrument, data collection was conducted by Harte Hanks via a random sample of companies in
their database, which has been used in previous research (e.g. Brynjolfsson & Hitt 1996). Survey
questions and descriptions of the asset classes and capability metrics appear in Appendix A.
We used confirmatory factor analysis to validate our grouping of the eighteen indicators of ITC
into the six variables described in § 2.5. Following Straub (1989), Boudreau et al. (2001) and
Zhu & Kraemer (2002) we considered the reliability, content validity and construct validity of
our measures. We tested both the internal consistency and the construct reliability of our IT
capability metrics. The average factor loading for indicators used to construct the six capability
variables was 0.70 and all factor loadings were positive, significant and above the cutoff of 0.4
3
As our metrics are designed to measure multiple components or dimensions of a construct rather than multiple measures of the same underlying
construct, Cronbach’s α estimates are less useful in assessing internal consistency. However, α estimates ranged from .44 to .73. The alpha for
Internal IT Use intensity was significantly lower than the rest of our constructs (.44). This may be due to its considerably high mean (4.4) and low
variance (S.D. = 0.8) indicating that Email Intensity was high for most firms in our dataset.
4
External Email Intensity and Internal Email Intensity were more highly correlated with each other than with their respective constructs (Internal
IT Use Intensity and External IT Use Intensity) indicating that internal and external email use are high for most firms in concert.
5
Factors 2 (Management Capability) and 5 (Digital Transaction Intensity) are excluded from Table 4 because they are two item factors to which
these statistics do not readily apply.
6
All respondents reported intimate knowledge of their firms’ IT practices and close proximity to IT investment decisions. If a respondent was
unfamiliar with IT assets and budgeting, the interview was terminated and a replacement respondent was sought. 59% of respondents were the
CIO of the firm, 25% were CTOs, 13% were IT budget analysts or administrators of IT systems, and 3% were CFOs.
7
Not all firms report R&D and advertising expenditures. After filling in data from other available sources, following Bharadwaj, Bharadwaj &
Konsynski (1999) and Montgomery & Wernerfelt (1988), we inputted industry average values for each firm for which data remained missing.
4. Results
Our results demonstrate that different IT assets are associated with different types of
performance benefits for firms that are generally consistent with their strategic goals. For
example, strategic IT investments are associated with product innovation (and not with other
measures of performance), while only transactional investments are associated with lower costs.
8
We also tested a pooled OLS model with panel corrected standard errors, with corrections for both autocorrelation and heteroscedasticity, where
the error term was modeled as an AR1 process with ρ diminishing uniformly over time and robust estimation of standard errors. The results were
qualitatively unchanged.
9
R&D intensity is positively associated with product innovation measured by revenue from modified products, but negatively associated with
revenue from new products. This may indicate that firms in our sample rely more on incremental innovation than discontinuous changes in their
product lines (e.g. Nelson & Winter 1982, Tushman & Anderson 1986).
10
Bharadwaj, Bharadwaj, & Konsynski (1999) also observe the surprising negative association between R&D investment and Tobin’s q. Citing
other studies that found the same result, they conclude that “the results are consistent with the findings of prior empirical efforts that attempted to
estimate a relationship between [controls for R&D expenditures] and q” (Bharadwaj, Bharadwaj, & Konsynski 1999: 1019). As our coefficient
estimates (-.066) are well within the range of previous estimates (.00 to -.15), we are satisfied that our results are consistent with prior evidence
and reflect the true market value of R&D capital.
11
To facilitate more meaningful interpretations, investment intensities and capability metrics were centered and normalized. The results reported
are of regressions on dependent variables measured in 2002, one year lagged from observations of investment and capability measures. All
control variables and other asset classes are included in the analyses, although their coefficients are not reported. As innovation variables are
derived from our survey, we do not have lagged measures of these variables in relation to investments in particular asset classes.
4.3 Discussion
In our data, the average firm experiences performance benefits from investments in different IT
assets along dimensions consistent with the strategic purpose of the asset. However, firms with
greater ITC experience both stronger performance effects along expected dimensions and a
broadening of performance impacts to other measures.
Infrastructure investments produce high up front implementation and restructuring costs, but
support future business value by enabling new applications and reducing long term costs through
integration, creating a pattern of lagged benefits (Duncan 1995, Weill & Broadbent 1998,
Broadbent, Weill & Neo 1999). Infrastructure benefits are lagged because new applications that
leverage new infrastructure take time to deploy, and important organizational factors mediate
their implementation and use. For example, governance structures in most firms separate
decision making on applications from decision making on infrastructure, with the former
remaining under the authority of the business and the later the IT function (Weill & Ross 2004).
This organizational separation makes building effective applications on top of new infrastructure
challenging. However, firms with strong ITC experience short term gains, not losses from
infrastructure investments and broaden their performance benefits to include innovation, profit
and lower costs (see Table 8). These firms develop skills and enact practices that enable
smoother infrastructure implementations and more effective decision making processes that
govern the integration of infrastructure with new applications. Tight relationships between
business units and the IT function (Management Capability), strong cross functional IT and
business skills (Human Resource Capability) and greater digitization of important business
processes such as ordering and sales (Digital Transactions) support integration of infrastructure
12
The derivation of these results are as follows: Y = α + β1X1 + β2X2 + β3(X1*X2) + ε; = α + X1B2 + (β1 + X2β3)X1 + ε. Therefore, the
coefficient on X1 = β1 + X2β2.
4.5 Conclusion
Many researchers have examined the productivity and business value of firm level IT
investments. However, results have varied across performance measures and significant firm
IT Resources
IT Assets: IT Investments Allocated IT Capabilities: Interlocking Systems of
For Particular Strategic Purposes Practices and Competencies that
Complement IT
IT Asset Strategic Purpose
Infrastructure Foundation of shared IT services. Provide
flexible base for future business. Competencies Practices
Transactional Automate processes, cut costs, increase (Skills) (Routines)
volume per unit cost.
IT Skills Culture of IT Use
Informational Provide information for: managing,
accounting, reporting, planning, analysis IT Mgmt Quality Digital Transactions
and data mining. Internet Architecture
Strategic Support entry into a new market,
provide a new service, enable a
new product.