You are on page 1of 29

Carnegie Mellon Software Engineering Institute

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Process Maturity Profile


CMMI For Development SCAMPISM Class A Appraisal Results 2010 Mid-Year Update
September 2010
We could not produce this report without the support of the organizations and lead appraisers who reported their appraisal results to the SEISM. Our many thanks for their continuing cooperation with our data collection and analysis efforts.
CMMI Appraisal Program

The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense and operated by Carnegie Mellon University

CMMI, Capability Maturity Model and Carnegie Mellon are registered in the U.S. Patent and Trademark Office by Carnegie Mellon University SM SCAMPI and SEI are service marks of Carnegie Mellon University

2010 by Carnegie Mellon University


2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 1

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Outline
Introduction Current Status Community Trends Organizational Trends Summary And Terms used in this Briefing How to Report your Appraisal Results to the SEI
This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes. The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead appraisers, team leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a certifying authority of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only. Organizations performing source selection or verification should consider performing an evaluation appraisal. For more information on appraisal methods and for a directory of authorized lead appraisers who can perform them, visit: http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 2

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Introduction: Purpose
Characterize the adoption of CMMI - DEV Describe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPISM) v1.1/v1.2 Class A appraisals using Capability Maturity Model Integration (CMMI-SE/SW/IPPD/SS v1.1 or CMMI - DEV v1.2) * Encourage continued reporting of results

* Organizations previously appraised against CMMI v1.0 and which have not reappraised against v1.1 or
v1.2 are not included in this report Please visit: http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm for additional information or questions you may have about this briefing before contacting the SEI directly

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 3

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Introduction - 2: Briefing Contents


This briefing includes three primary sections: 1. Current Status - Snapshot of the software community based on the most
recent appraisal, since 2002, of reporting organizations

2. Community Trends - Global distribution of appraisals


- Growth in the number of appraisals performed - Shifts in the maturity profile over time

3. Organizational Trends
- Time to move up in maturity based on change in maturity level and time between appraisals

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 4

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Current Status
SCAMPI v1.1/v1.2 Class A appraisals conducted from the SCAMPI V1.1 April 2002 release through June 2010 and reported to the SEI by July 2010

6,126 4909 3,857 957 34,291

75.3%

appraisals organizations participating companies reappraised organizations projects Non-USA organizations

Please refer to: Terms Used in this Report on page 27

Additional charts providing different views and break down of this information will be added to this briefing as more appraisal data is reported to the SEI over time.
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 5

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Process Maturity Profile by All Reporting Organizations


3600 3400 3200

Number Of Organizations

3000 2800 2600 2400 2200 2000 1800 1600 1400 1200 1000 800 600 400 200 0 Not Given Initial Managed Defined Quantitatively Managed Optimizing

55.3%

27.5%

6.5%

7.3%

0.8%

2.5%

Based on most recent appraisal of 4909 organizations


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 6

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Process Maturity Profile (V1.2 Only) by All Reporting Organizations


2800 2600 2400

Number Of Organizations

2200 2000 1800 1600 1400 1200 1000 800 600 400 200 0 Not Given Initial Managed

63.9%

24.5%

4.5% 0.4%
Defined

5.0% 1.7%
Quantitatively Managed Optimizing

Based on most recent appraisal of 3284 organizations


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 7

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Reporting Organization Categories

Commercial/In-house

77.8%

Contractor for Military/Government

18.0%

Military/Government Agency

4.2%

1000

2000

3000

4000

5000

Number of Organizations
Based on 4909 organizations reporting an organization category
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 8

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Process Maturity Profile by Reporting Organization Categories


100% 90%
Commercial/In-house = 3779

% Of Organizations Within Category

80% 70% 60% 50% 40%


31.5%

Contractor for Military/Government = 874 Military/Government Agency = 206

58.1%

49.3% 45.6%

30%
22.3%

25.8%

26.7%

20% 10% 0% Not Given Initial Managed Defined Quantitatively Managed Optimizing
8.0% 5.3% 0.6% 1.4% 1.0% 2.9% 1.0% 1.5% 8.8% 2.9%

7.2%

Based on most recent appraisal of 4859 organizations reporting an organization category


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 9

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Organization Type
Based on Primary Standard Industrial Classification (SIC) Code
Wholesale Trade 0.1% Retail Trade 0.2% Transportation, Communication, Electric, Gas and Sanitary Services 3.4% Finance, Insurance and Real Estate 5.4% Public Administration (Including Defense) 3.1% Fabricated Metal Products 0.1% Primary Metal Industries 0.3% Industrial Machinery And Equipment 0.7%
Manufacturing 15.7%

Business Services 35.7%

Services 72.1%

Electronic & Other Electric Equipment 10.1% Instruments And Related Products 0.9% Transportation Equipment 2.2% Other Manuf acturing Industries 1.3%

Health Services 1.3% Engineering & Management Services 24.2% Other Services 10.9%

Based on 4222 organizations reporting SIC code. For more information visit: http://www.osha.gov/oshstats/sicser.html
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 10

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Organization Size
Based on the total number of employees within the area of the organization that was appraised
1001 to 2000 2.4%

501 to 1000 5.0%

2000+ 1.6%

301 to 500 6.1%


201 to 2000+ 22.6%

25 or fewer 17.3%

201 to 300 7.3%

1 to 100 60.2%

101 to 200 17.3%

26 to 50 22.0%

76 to 100 8.3% 51 to 75 12.6%

Based on 4863 organizations reporting size data


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 11

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Maturity Profile by Organization Size


Based on the total number of employees within the area of the organization that was appraised
100% 90%

% of Organizations by Size

80% 70% 60%


49.4% 43.5%

62.6%

61.2%

61.7%

56.6%

52.4%

54.2%

52.1%

50% 40%

47.3%

48.8% 26.9% 6.3% 1.7% 3.8%

29.5%

26.9%

21.6%

21.3%

22.1%

30% 20%

17.7%

16.7%

12.8%

25.5%

5.3% 10.4% 5.7% 0.3%

4.2% 6.0% 8.3% 1.0%

9.3% 8.1%

5.6% 0.7%

1.0% 1.3% 5.5% 0.8%

2.1% 3.4% 6.5%

5.4%

8.2%

1.7%

0.8%

2.5% 4.2%

3.5%

10% 0%

0.2% 0.6% 5.0% 0.6%

5.3%

12.6%

25 or fewer

26 to 50

51 to 75

76 to 100

101 to 200

201 to 300

301 to 500

501 to 1000 1001 to 2000

2000+

Not Given

Initial

Managed

Defined

Quantitatively Managed

Optimizing

Based on 4863 organizations reporting size data


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 12

1.3%

40.0%

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

USA and Non-USA Reporting Organization Categories


Commercial/Inhouse
425

3354

Contractor for Military/Government

651 223

USA: 100% = 1206 Non-USA: 100% = 3653

Military/Government Agency

130 76

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

% of Organizations
Based on 1206 USA organizations and 3653 Non-USA organizations reporting an organization category
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 13

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Maturity Profile by All Reporting USA Organizations


100% 90% 80% 70% 60% 50%
507

% of Organizations

40% 30% 20%


148

457

10%
13
7

81

0% Not Given Initial Managed Defined Quantitatively Managed Optimizing

Based on 1213 USA organizations


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 14

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Maturity Profile by All Reporting Non-USA Organizations


100% 90% 80% 70%
2207

% of Organizations

60% 50% 40% 30% 20% 10% 0% Not Given Initial Managed Defined Quantitatively Managed Optimizing
279

895

173 25

117

Based on 3696 Non-USA organizations


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 15

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Section 2: Community Trends


Appraisals conducted through June 2010 and reported to the SEI by July 2010 71 Countries reported appraisals
- most of the appraisals are from Asia and North America

5207 Appraisals posted on PARS

- expired appraisals are removed from PARS and replaced with the newest reappraisal result

Please refer to: Terms Used in this Report on page 27

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 16

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Countries where Appraisals have been Performed and Reported to the SEI

Argentina Australia Austria Bahrain Bangladesh Bulgaria Canada Chile China Colombia Dominican Republic Egypt Finland France Germany Hungary India Indonesia Ireland Israel Macedonia Latvia Lithuania Luxembourg Malaysia Nepal Netherlands New Zealand Norway Pakistan Philippines Poland Portugal Romania Russia South Africa Spain Sri Lanka Sweden Switzerland Turkey Ukraine United Arab Emirates United Kingdom United States * Red/Italic country name: New additions with this reporting since March 2010
2010 by Carnegie Mellon University September 2010

Belarus Costa Rica Greece Italy Mauritius Panama Saudi Arabia Taiwan Uruguay

Belgium Czech Republic Guatemala Japan Mexico Paraguay Singapore Thailand Viet Nam

Brazil Denmark Hong Kong Korea, Republic Of Morocco Peru Slovakia Tunisia

Process Maturity Profile - Page 17

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Number of Appraisals Reported to the SEI by Continent


3600 3400 3200 3000 2800
3012

Number of Appraisals

2600 2400 2200 2000 1800 1600 1400 1200 1000 800 600 400 200 0 Africa Asia Australia Europe North America South America
72 42 355 760 1885

Based on 6126 appraisals * North America includes Canada, the USA, and Mexico; South America includes Central America and the Caribbean ; Australia includes New Zealand
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 18

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Number of Appraisals and Maturity Levels Reported to the SEI by Country


Country Argentina Australia Austria Bahrain Bangladesh Belarus Belgium Brazil Bulgaria Canada Chile China Colombia Costa Rica Czech Republic Denmark Dominican Republic Egypt Finland France Germany Greece Guatemala Hong Kong Hungary India Indonesia Ireland Israel Number of Appraisals 79 39 10 or fewer 10 or fewer 10 or fewer 10 or fewer 10 or fewer 167 10 or fewer 62 43 1475 43 10 or fewer 10 or fewer 10 or fewer 10 or fewer 52 10 or fewer 183 80 10 or fewer 10 or fewer 20 10 or fewer 576 10 or fewer 11 21 19 1 Maturity Level 1 Reported 1 Maturity Level 2 Reported 50 10 Maturity Maturity Maturity Level 3 Level 4 Level 5 Reported Reported Reported Country 20 7 2 2 4 4 Malaysia Mauritius Mexico Morocco Nepal Netherlands New Zealand Norway Pakistan Panama Paraguay Peru Philippines Poland Portugal Romania Russia Saudi Arabia Singapore Slovakia South Africa Spain Sri Lanka Sweden Switzerland Taiwan Thailand Tunisia Turkey Number of Appraisals 74 10 or fewer 104 10 or fewer 10 or fewer 15 10 or fewer 10 or fewer 29 10 or fewer 10 or fewer 11 26 10 or fewer 14 10 or fewer 11 10 or fewer 22 10 or fewer 10 or fewer 198 14 10 or fewer 10 or fewer 147 41 10 or fewer 19 Maturity Maturity Level 1 Level 2 Reported Reported 22 43 Maturity Maturity Maturity Level 3 Level 4 Level 5 Reported Reported Reported 46 47 4 6 8

1 1 1

89 17 25 142 14

62 25 15 1213 15

1 5 44 4

11 4 2 51 4

22

5 3 5

6 12 7 3

8 1

3 1

4 4

1 4 9

25 108 40

18 56 15

2 1 1

3 2 1

12

117 2

61 12

4 19 2 3 19 88 59

11 320 4 11 23 146 78 16 19 25

5 197

81 13

58 25 16

2 2 3

4 17 8

Italy 46 Japan 324 Korea, Republic Of 176 Latvia 10 or fewer Lithuania 10 or fewer Luxembourg 10 or fewer Macedonia 10 or fewer

Ukraine 10 or fewer United Arab Emirates10 or fewer United Kingdom 118 United States 1719 Uruguay 10 or fewer Viet Nam 18

3 30

52 611

36 683 13

1 23 2

4 149 3

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 19

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Number of SCAMPI A Appraisals Reported to SEI by Year


1600 1400
TOTAL
1352

1300

Number of Appraisals

1200

POSTED ON PARs
1029
1001

1000
842
943 938

800
600

692

600
437

615
588

400
186
230

425

200
52

0 2002

85

2003

2004

2005

2006

2007

2008

2009

2010

Based on 6126 appraisals


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 20

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Number of SCAMPI A Appraisals Reported to SEI by Year


1600 1400
343

1006

Number of Appraisals

1200

First Appraisal
834

Reappraisal
1000
180 241 1021

598
800
109 733 849 760

437
600
96 504

180

400

186

43 394

435

200

52

23 163

1 51

2002

2003

2004

2005

2006

2007

2008

2009

2010

Based on 6126 appraisals


2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 21

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Trends in the Community Maturity Profile


100% 90% 80% 70%

Year
2002-2005 2006 2007 2008
55.3% 55.3%

Orgs
1112 1845 2694 3454 4,474 4,909

% of Organizations

2009 2010

60% 50% 40% 30% 20% 10% 0% Not Given Initial Managed
9.1% 9.1% 8.9% 7.8% 6.5% 6.5% 48.3% 32.9% 32.0% 32.3% 30.1% 27.5% 27.5% 33.0% 37.2% 41.6%

2.2% 1.5% 1.3% 1.1% 0.8% 0.8%

Defined Quantitatively ManagedOptimizing

Based on a cumulative view of the most recent appraisals of organizations up through the year indicated
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 22

4.4% 4.5% 3.4% 2.8% 2.5% 2.5%

18.3% 15.8% 12.5% 9.8% 7.3% 7.3%

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Maturity Level of First and Latest CMMI Appraisal


100% 90% 80%
First

70%

% of Organizations

Latest

60% 50%
38.1%

40% 30% 20%


9.8% 6.2%

34.8%

56.7%

10.1%

3.9%

0% Not Given Initial Managed Defined Quantitatively Managed Optimizing

Based on 957 reappraised organizations using their first and latest appraisal
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 23

0.1%

2.9%

10%

6.1%

10.3%

20.8%

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Time to Move Up
60

50
Number of months to move to next maturity level

40

30
24 21

28

28 25 23

75th Percentile

Median

20

18

18.5

19

25th Percentile

10

0
Time Period of Initial Appraisal Level Orgs 1 to 2 13 2002 to 2005 2 to 3 3 to 4 3 to 5 118 28 59 2006 to Present 1 to 2 2 to 3 7 184 3 to 4 39 3 to 5 37 All (2002 to Present) 1 to 2 2 to 3 3 to 4 3 to 5 20 302 67 96

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 24

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Summary
6126 appraisals have been reported to the SEI Since 2002 Brazil, Mexico, Chile, Colombia, Egypt, Taiwan reported appraisals are increasing at a rapid rate More than 60% of appraised organizational units have 100 or fewer employees The percentage of appraised organizations with a unit size 100 or fewer employees is increasing steadily The majority of reported appraisals are Maturity level 2 and 3 organizations

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 25

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Summary - 2
For organizations that began their CMMI-based SCAMPI effort in 2002 or later, the median time to move from: maturity level 1 to 2 is 5 months maturity level 2 to 3 is 19 months maturity level 3 to 4 is 25 months maturity level 3 to 5 is 23 months

Note: Since the March 2009 report, the median time to move from maturity level 1 to 2 increased from 4.5 months to 5 months. The median time to move from maturity level 3 to 4 increased from 24 months to 25 months , the median time to move from maturity level 3 to 5 increased from 19 months to 23 months
2010 by Carnegie Mellon University September 2010 Process Maturity Profile - Page 26

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Terms Used in this Report


Company - Parent of the appraised entity A company can be a commercial or non-commercial firm, for-profit or not for-profit business, a research and development unit, a higher education unit, a government agency, or branch of service, etc.

Organization - a.k.a. Appraised entity The organization unit to which the appraisal results apply. An appraised entity can be the entire company, a selected business unit, units supporting a particular product line or service, etc. Non-USA - Appraised entity whose geographic location is not within the United States. The parent of the appraised entity may or may not be based within the United States. - Published Appraisal Results webpage contains CMMI appraisals published at the request of the appraisal sponsor. The link is: http://sas.sei.cmu.edu/pars/

PARS

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 27

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Report your Appraisal Results to the SEI


The briefing is only possible due to the cooperation of organizations and individuals sending in their appraisal results to the SEI In order to provide this information and service in the future, it will depend on this continued cooperation Please visit: http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm for forms, information, and instructions on how to report appraisals to the SEI

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 28

Carnegie Mellon

Software Engineering Institute

CMMI- DEV v1.1/v1.2 SCAMPI v1.1/V1.2 Class A Appraisal Results

Contact Information
Please visit: http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm and review the information provided before contacting: SEI Customer Relations SEI FAX number (412) 268-5800 (412) 268-5758

Internet Address customer-relations@sei.cmu.edu Mailing Address Customer Relations Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213-3890

2010 by Carnegie Mellon University

September 2010

Process Maturity Profile - Page 29

You might also like