Foundations 2025 - INFORMS PubsOnline - Institute for Operations ...

7 downloads 0 Views 981KB Size Report
Dr. Gregory S. Parnell j Maj. Harry W. Conley j Col. Jack A. ... AFIT/ENS, Wright-Patterson Air Force Base, Ohio 45433-7765. Assistant Professor of Mathematical ...
Foundations 2025: A Value Model for Evaluating Future Air and Space Forces * Dr. Gregory S. Parnell j Maj. Harry W. Conley j Col. Jack A. Jackson Lt. Col. Lee J. Lehmkuhl j Col. John M. Andrew Department of Mathematical Sciences, Virginia Commonwealth University, Richmond, Virginia 23284-2014 & Toffler Associates Joint Simulation System Program Office, Orlando, Florida 32826 AFIT/ENS, Wright-Patterson Air Force Base, Ohio 45433-7765 Assistant Professor of Mathematical Sciences, HQ USAFA/DFMS, United States Air Force Academy Colorado 80840-6252 Air Force Agency for Modeling and Simulation, Orlando, Florida 32826-3276

A

ir Force 2025 was a study directed by the Chief of Staff of the United States Air Force to identify key system concepts and technologies for achieving air and space dominance in the year 2025. The study was a large effort in which over 200 military experts participated for more than one year. We developed a Value-Focused Thinking model, which we used to evaluate which futuristic system concepts have the greatest potential to ensure future U.S. air and space dominance. We named the value model Foundations 2025 because it represented a return to the basics of air and space dominance. We used the ‘‘silver standard’’ approach for value hierarchy development. The participants identified key verbs to describe tasks that must be performed in 2025 to ensure air and space dominance. The value hierarchy was developed bottom-up by aggregating these verbs into higher order tasks using affinity diagrams. Using the value hierarchy, we used multiattribute decision analysis techniques to develop an additive value model with 134 attributes. The Foundations 2025 value model was successfully used to score 43 futuristic system concepts and provide insights about the most promising system concepts and technologies. The analysis results directly supported the study director and the senior leadership of the United States Air Force. (Decision Analysis; Value-Focused Thinking; Multiattribute Decision Analysis)

Introduction Air Force Chief of Staff General Ronald R. Fogleman initiated the Air Force 2025 Study (2025) by telling Air University study participants that ‘‘if we [the Air Force] are going to be relevant in the future, we’ve got to somehow break free of the evolutionary nature of the planning process’’ (Fogleman 1994). He challenged study participants * The views expressed in this paper are those of the authors and do not reflect the official policy or position of the United States Government or the Department of Defense.

‘‘to generate ideas and concepts on the capabilities the United States will require to possess the dominant air and space force in the future’’ (Fogleman 1995). We introduce a Value-Focused Thinking (VFT) (Keeney 1992) model, Foundations 2025, that we developed to evaluate which 2025 system concepts have the greatest potential to ensure future U.S. air and space dominance. We describe the 2025 process, the search for a ‘‘Gold Standard’’ value hierarchy framework, the Foundations 2025 value hierarchy developed by the ‘‘Silver Standard’’ approach, the Foundations 2025 additive

0025-1909/98/4410/1336$05.00

1336

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

3b2d 0003 Mp 1336 Monday Oct 26 04:01 PM Man Sci (September) 0003

Copyright q 1998, Institute for Operations Research and the Management Sciences

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

value model, and the results of the analysis of 43 futuristic system concepts.

The 2025 Process General Fogleman directed that ‘‘the final product will be a collection of white papers detailing findings regarding air and space capabilities required for future warfare, new or high-leverage concepts for employing air and space power, and the technologies required to enable the capabilities envisioned’’ (Fogleman 1994). To respond to this tasking, the study team devised a fourphase study process to stimulate creativity, generate ideas, and evaluate system concepts. The study lasted over one year and involved more than 200 participants from military, industrial, and academic organizations. This process is shown in Figure 1. In the Preparation Phase, participants learned a wide variety of creative thinking and problem solving concepts. Included in this phase was a presentation to the study participants that provided an introduction to Value-Focused Thinking (VFT) (Parnell 1995) and a tutorial on how to use VFT to identify system concepts that create value (Parnell 1996). These presentations provided essential VFT information to the study participants and the analysis team. In the Idea Generation Phase, the participants developed ideas about alternate futures, system concepts, and technologies. A worldwide data call produced over 1000 ideas. In the Assimilation Phase, the participants were organized into 40 teams. After identifying the required tasks for future air and space forces, each team identified system concepts and technologies from the idea generation phase that could satisfy these future requirements. The result was a series of white papers that described system concepts designed to satisfy future operational requirements for air and space forces. The study reports can be found on the Internet (Air Force 2025 Final Report Homepage 1996). While each of the first three phases occurred sequentially, the operations analysis (OA) phase was conducted concurrently. The authors were responsible for the OA phase. We developed the Foundations 2025 value model and used the value model to evaluate the system concepts described in the white papers.

2025 Operational Analysis Requirements Our goal was to identify which system concepts offer the greatest potential to provide future air and space dominance. To meet this goal, we identified several analysis requirements. 1. The Chief of Staff’s tasking requested that we identify system concepts for dominant future air and space forces. The methodology had to focus on this objective. 2. The methodology had to be robust enough to evaluate systems across a wide range of possible views about what will be important for future air and space dominance. 3. The evaluation methodology had to be objective and free of institutional bias. 4. The methodology had to be understandable to the study participants and convincing to Air Force senior leadership. 5. The results had to be traceable, since the results would be subject to high-level scrutiny. If a given system scored in the top 10, we had to clearly explain why it scored in the top 10. 6. To meet the study timeline, the OA had to be completed a few weeks after the submission of the white papers that described the new systems. 7. Because the study looked far into future, most of the system descriptions lacked engineering detail. Therefore, we used expert judgment to quantitatively assess the technical feasibility and operational value of the system concepts. We reviewed several potential analysis methodologies. The futuristic system concepts lacked the engineering and cost data required for combat models and resource allocation models. Simple alternative comparison approaches lack credibility with senior defense leaders. VFT had been successfully used for Spacecast 2020, a similar 1993 Air Force study to identify future space system concepts (Burk and Parnell 1997). We selected VFT as the methodology that best satisfied the analysis requirements (Jackson et al. 1996a). Our next step was to develop a value hierarchy that met our analysis requirements. Objective-Driven vs. Alternative-Driven Hierarchies Objectives structuring is a key art of decision analysis. The two standard approaches to value hierarchy

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

3b2d 0003 Mp 1337 Monday Oct 26 04:01 PM Man Sci (September) 0003

1337

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Figure 1

2025 Process

development are objectives-driven and alternativesdriven (Buede 1986 and Kirkwood 1997). Most value hierarchies are developed using the objectives-driven approach, which starts with fundamental objectives and structures the value hierarchy with subobjectives until quantifiable attributes can be developed for the lowest level objectives. The alternative-driven approach starts with the alternatives and identifies quantifiable attributes that differentiate the alternatives. The value hierarchy is then structured by categorizing the attributes into objectives and higher level objectives. Both approaches rely on access to decision-makers and stakeholders to help identify objectives and attributes. The objectives-driven approach is more applicable for strategic decisions. In these situations, the alternatives are usually not specified and the decision-makers need to think clearly about their values and objectives. ValueFocused Thinking is very appropriate technique for these situations. The alternative-driven approach is more appropriate for tactical decisions with clear values and specified alternatives.

Clearly, an objectives-driven approach was more appropriate for 2025—a strategic study with a long time horizon and a creative process designed to generate alternatives. However, without access to Air Force senior decisionmakers and formally designated stakeholders, we decided to search for a ‘‘Gold Standard’’ policy document we could use as a framework for our value hierarchy. This approach was successfully used in the predecessor Air Force study, Spacecast 2020 (Burk and Parnell 1997).

Search for the 2025 Value Hierarchy Framework Based on the Operational Analysis requirements and mathematical requirements of VFT, we established three criteria for evaluating potential value hierarchy frameworks: • Employment of Dominant Air and Space Forces. As stated in the first requirement above, the framework must focus on the employment of dominant air and

1338

3b2d 0003 Mp 1338 Monday Oct 26 04:01 PM Man Sci (September) 0003

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

space forces and not how forces are organized, trained, and equipped. • Visionary. The framework must look 30 years into the future and be free of institutional bias. • Mathematical. The value model objectives and subobjectives must be complete, non-redundant, and independent to ensure that our value model meets the requirements of an additive value model (Kirkwood 1997, p. 16–17). We examined ‘‘Gold Standard’’ documents that identified objectives for future air and space forces. Senior political and military leaders had approved many of these documents. The following sources were investigated: • National Security Strategy • National Military Strategy • Defense Planning Guidance • Common Operational Objectives of the Armed Forces • Global Presence, Global Reach, Global Power • Joint Requirements Oversight Council (JROC)/Joint Warfighting Capabilities Assessment (JWCA) categories Figure 2

• Draft Air Force Doctrine Directive-1 (AFDD-1) • Joint Vision 2010 • Cornerstones of Information Warfare The National Security Strategy represents the views of the President (NSS, 1995). It provides a high-level strategic view of the national defense policy but does not provide detailed objectives for a value hierarchy. The National Military Strategy (NMS), by the Chairman of the Joint Chiefs of Staff (CJCS), also has a grand strategy perspective. The NMS contains a framework, but the objectives are redundant. The Defense Planning Guidance is focused on the biannual budget cycle; therefore, it does not meet the visionary requirement. Another approach, Common Operational Objectives of the Armed Forces, contains a strategy-to-task focus; however, like the Defense Planning Guidance, it focuses on the mid-term planning years (Kent and Simmons 1991). The Secretary of the Air Force published the Global Reach, Global Power, Global Presence series of documents to establish the Air Force vision. But, these documents do not specify air and space employment objectives required to develop a value hierarchy.

Value Hierarchy Based on Cornerstones

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

3b2d 0003 Mp 1339 Monday Oct 26 04:01 PM Man Sci (September) 0003

1339

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

We developed value hierarchies for the next four potential frameworks. Cornerstones of Information Warfare, released by the Chief of Staff and the Secretary of the Air Force (Cornerstones 1995) was written ‘‘to provide a sound and widely accepted basis from which we can adapt Air Force doctrine to the Information Age.’’ As an example, Figure 2 shows the Cornerstones value hierarchy. Although visionary, Cornerstones focused on organizing, training, and equipping versus employing air and space forces. The Joint Staff produced a set of JROC/JWCA categories to support the planning and analysis of the service budgets. While the JROC/JWCA framework was designed to be visionary, it was designed to have redundant mission areas. We next looked at military doctrine publications as a potential source for a value hierarchy. The Air Force doctrine pamphlet, AFDD-1 (1995), focused on organizing, training, and equipping air and space forces versus force employment; was not visionary; and had several overlapping tasks. The final candidate was based on Joint Vision 2010 (1995). Joint Vision 2010 focused on the future 15 years hence, not 30 years, and the framework also had considerable overlap. After reviewing the potential value hierarchy frameworks, we determined that none of the frameworks met all three criteria (Table 1). Therefore, we decided to develop a new value hierarchy designed to meet the requirements of the AF 2025 study.

The Value Hierarchy—The Silver Standard Approach We used the ‘‘Silver Standard’’ approach (named to differentiate it as a valuable alternative to the Gold Standard approach) to value hierarchy development. First, to ensure a complete set of lower level objectives, we requested that the participants identify the tasks (we used the military word task instead of the normal decision analysis term objective) that they believed must be performed to provide air and space dominance in 2025. We intentionally used verbs to avoid the institutional bias associated with nouns (for example, airlift in Figure 2). We then used affinity diagrams to group like verbs. Next, we structured these verbs into subtasks

(subobjectives), tasks (objectives), and finally functions (fundamental objectives). Throughout the value hierarchy development, we were concerned about the size of the value model and the analysis effort required for system concept evaluation. Spacecast 2020, which focused only on space systems, developed a value model with 98 attributes and scored 20 system concepts (Burk and Parnell 1997). Our study had a larger scope (air and space) and we expected a larger number of system concepts to evaluate. Using the silver standard approach, we were able to develop a reasonable sized model.

Identifying the Overarching Objective For a clear statement of the overarching objective, we used General Fogleman’s statement, ‘‘achieve air and space dominance.’’ We named the value model Foundations 2025 because it represented a return to the basics of air and space dominance. Structuring the Value Hierarchy We asked the study participants to identify required tasks the Air Force must perform to dominate air and space in 2025. We met with each of the 40 teams to obtain and discuss their required tasks. The teams held diverse views, but their tasks could be listed as action verbs, e.g., ‘‘communicate’’ or ‘‘destroy.’’ Using action verbs avoided the institutional bias of current nouns, e.g., airlift and electronic warfare. (Note that all terms should be interpreted as verbs, e.g., orbital maneuver is maneuver in orbit.) Figure 3 shows the tasks that resulted from brainstorming sessions with all the teams. The superscript after the task shows the letter designation of the team that submitted the task. The final tally was 109 different tasks. Our next challenge was to aggregate these tasks to form a complete, non-redundant, and independent set. The affinity diagram proved to be an ideal method for task aggregation. Affinity Diagram An affinity diagram is a method designed to allow a team of people to creatively generate a list of ideas and arrange those ideas into natural groupings ‘‘to understand the essence of a problem’’ and help identify creative solutions (Brassard and Ritter 1994). The affinity diagram process uses the following steps (Brassard and Ritter 1994):

1340

3b2d 0003 Mp 1340 Monday Oct 26 04:01 PM Man Sci (September) 0003

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

• Phrase the issue under discussion in a full sentence. • Brainstorm at least 20 ideas or issues. • Without talking, sort the ideas into 5–10 related groupings. • For each group, create summary or header cards using consensus. The affinity diagram ‘‘encourages nontraditional connections among ideas.’’ Identifying these nontraditional connections, thus breaking free from institutional biases, was our aim. In addition, the affinity diagram encourages mutual exclusivity because all similar tasks are grouped together in single aggregated tasks. First Affinity Diagram—Aggregating the Lowest Level Tasks (Subtasks) We used this technique to combine the 109 tasks in Figure 3 into 14 mutually exclusive, collectively exhaustive groups of tasks that represent fundamentally different activities. Next, we assigned a name, usually one of the initial 109 tasks, to each of the 14 groups. The 14 groups are shown in Figure 4. The Foundations 2025 Glossary formally defined each of the specific tasks (Jackson et al 1996a). A glossary was essential because of the scope of the study and the large number of participants. Second Affinity Diagram—Distinguishing Subtasks from Tasks The second affinity grouping, depicted in Figure 5, determined which of the 14 tasks in Figure 4 were tasks, Table 1

and which were lower level subtasks. Six of the 14 tasks were grouped together under a broader task labeled direct, and 2 of the 14 were grouped into a broader task called understand. These subtasks were grouped together because, even though they represented different activities, they were closely related.

Influence of the Medium on Tasks The operational analysis team believed that some tasks in Figure 5 were fundamentally different depending on the medium in which the tasks take place. For example, to engage a target in space is a fundamentally different task than to engage a target on the surface. We had to determine which of the eight tasks were affected by the medium, and divide those tasks into subtasks to ensure mutual exclusivity. The four possible media were defined to be air, space, cyberspace, and surface/subsurface; therefore, under the task detect, there are four subtasks: detect in the air, detect in space, detect in cyberspace, and detect on the surface/subsurface. This same logic applied to the engage, survive, deploy, maintain, and replenish tasks. Note that the medium depends on where the target (the object being detected or engaged) is located, not where the system doing the detecting or engaging is located. Two tasks in Foundations 2025 were not medium specific: understand and direct. To understand a target that has been detected does not depend on where the

Evaluation of Potential Frameworks Criteria

Potential Framework

Employment Objectives

Visionary

Mathematical

N N Y

Y Y N

— — —

Y N N Y N Y

N Y Y N N N

— — Y N N N

National Security Strategy National Military Strategy Defense Planning Guidance Common Operational Objectives of the Armed Forces Global Presence, Global Reach, Global Power Cornerstones of Information Warfare JROC/JWCA Categories Draft Air Force Doctrine Directive-1 (AFDD-1) Joint Vision 2010

(Y Å Met criteria, N Å Did not meet criteria, — Å Not able to evaluate).

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

3b2d 0003 Mp 1341 Monday Oct 26 04:01 PM Man Sci (September) 0003

1341

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Figure 3

2025 Initial Task Compilation

1342

3b2d 0003 Mp 1342 Monday Oct 26 04:01 PM Man Sci (September) 0003

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Figure 4

First Affinity Grouping of Tasks

integrating and identifying occurs. Likewise, the commander’s ability to direct, including assess, plan, and decide, is not fundamentally affected by the medium in which these activities occur.

Adding medium-specific subtasks increased the number of subtasks in the model from 8 to 29. Figure 6 shows the complete list of tasks and subtasks, including medium-specific subtasks. The next step in the

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

3b2d 0003 Mp 1343 Monday Oct 26 04:01 PM Man Sci (September) 0003

1343

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Figure 5

Second Affinity Grouping of Tasks

deploy, maintain, and replenish. Power springs from the ability to engage and survive. Figure 6 shows the final value hierarchy.

Developing the Value Model

development of the value hierarchy was to determine functions (fundamental objectives).

Third Affinity Diagram—Identifying the Functions Functions are the high-level, aggregated tasks that must be accomplished to attain the overarching objective of air and space dominance. Three functions emerged from the third and final affinity grouping: awareness, reach, and power. Awareness is specified by the tasks detect, understand, and direct. To have reach requires the ability to Figure 6

Once the functions were defined, the bottom-up structuring of the subtasks, tasks, and functions in the Foundations 2025 value hierarchy was complete. Next, the value hierarchy had to be expanded into a value model that could be used to quantitatively evaluate the system concepts. We used an additive value model. We developed quantifiable force qualities (attributes), measures of merit (evaluation measures), and scoring functions (single dimensional value function) using standard decision analysis techniques (Keeney 1992 and Kirkwood 1997). Finally, we elicited weights for each level of the value hierarchy for each of the alternate futures. Due to the large number of study participants and the limited analysis time, we obtained the weights from the 40 teams.

Foundations 2025 Value Hierarchy

1344

3b2d 0003 Mp 1344 Monday Oct 26 04:01 PM Man Sci (September) 0003

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Identifying the Force Qualities, Measures of Merit, and Scoring Functions We met with each of the 40 teams to determine force qualities (attributes) and measures of merit (evaluation measures) for each subtask. Force qualities were generally adjectives, since they characterize a system’s ability to accomplish a subtask. This was the most timeconsuming activity of our operational analysis—but it was crucial to developing the value model and achieving acceptance by the 200 participants. For 2 weeks, we met with each of the 40 teams in 2-hour sessions per team. Since the team structure did not map directly to the value hierarchy, the force qualities and measures of merit were continually refined during the meetings. After working with each team, we were able to reduce the list of force qualities from the initial number of about 1400 to the final number of 134 by deleting redundant force qualities, selecting the most important force qualities, and carefully defining the evaluation measures. There are on average five force qualities per subtask; the largest number of subtask force qualities was nine, the fewest were two. Figure 7 shows the force qualities for the power function. Each force quality had a measure of merit to quantify system performance. For example, a force quality of the subtask deploy to air was range, and the corresponding measure of merit was miles. The measures of merit be-

Figure 7

came the domains (horizontal axes) of the scoring functions (single dimensional value function) used to evaluate the capabilities of future systems. These scoring functions were the products of careful consideration by the operational experts. First, we made sure that the evaluation measure was clearly defined. Second, we had the team agree on the shape of the curve (linear, concave, convex or s-curve). Third, we obtained scores for critical points, e.g., the 80% value score for a concave curve. Finally, we fit a smooth curve through the points. Figure 8 illustrates how scoring functions can vary depending on the force quality and measure of merit. The 134 functions quantify operator values and provide useful information for future military planners.

Obtaining the Weights We obtained the weights for our additive value model from the operational experts (Jackson et al. 1996a). The weights were developed bottom-up after the domains of the scoring functions were specified. For sensitivity analysis, we asked the participants to provide different weights for each alternate future. As mentioned in the 2025 process, alternate futures were developed to help the participants develop creative system concepts (Engelbrecht et al. 1996). AF 2025 alternate futures team generated and then analyzed over 100 candidate drivers deemed to be forces acting on the future. They selected the three most important

Power Force Qualities

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

3b2d 0003 Mp 1345 Monday Oct 26 04:01 PM Man Sci (September) 0003

1345

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Figure 8

Example 2025 Scoring Functions

drivers to define a strategic planning space in which alternate futures could be developed (Figure 9). Definitions for each of these three drivers are provided below. American Worldview. This driver is the U.S. perspective of the world, which determines the nation’s willingness and capability to interact with the rest of the world. American Worldview captures the dominant U.S. focus regarding international affairs. The United States can be primarily internally focused, perhaps even isolationist, or the United States can be actively engaged in activities around the world. The poles of American Worldview are domestic and global. D TeK. This driver is the differential in the growth rate, proliferation, leverage, and vitality of scientific knowledge and technical applications and their consequences. D TeK describes the rate of change in both the proliferation and advancement of technology. The two poles of D TeK are Constrained and Exponential. Constrained D TeK implies that technology is advancing at an evolutionary rate and that its availability is limited to a relatively small number of actors. Exponential D TeK occurs when there are revolutionary breakthroughs in technology that are rapidly proliferated throughout the world.

World Power Grid. This driver describes the generation, transmission, distribution, and control of power throughout the world. This power is a combination of economic, political, and information sources of power as well as military strength. The two poles of this driver are Concentrated and Dispersed. A concentrated world power grid exists when few actors have the means or will to influence others. When a myriad of groups or individuals can change the future, the world power grid is dispersed. Six alternate futures were chosen from this planning space to provide a diverse set of future conditions used to evaluate the proposed air and space systems. Four futures are extremes: Gulliver’s Travails, Zaibatsu, Digital Cacophony, and King Khan. The world of Halfs and HalfNaughts was chosen for its centrality. Finally, the 2015 Crossroads future provided a conservative bridge between today and 2025. In Gulliver’s Travails, the United States is overwhelmed with worldwide commitments, counterterrorism and counterproliferation efforts, humanitarian operations, and peacekeeping operations. In Zaibatsu, multinational corporations dominate international affairs, loosely cooperating to create a relatively benign world. Digital Cacophony is the most technologically advanced world,

1346

3b2d 0003 Mp 1346 Monday Oct 26 04:01 PM Man Sci (September) 0003

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Figure 9

AF 2025 Alternate Futures Strategic Planning Space

resulting in great power and independence for the individual, but also creating a world of social isolation, fear, and anxiety. King Khan is a world where U.S. dominance has waned due to domestic problems, an economic depression, and overshadowing by a rising Asian colossus. The world of Halfs and Half-Naughts is dominated by conflict between the ‘‘haves’’ and ‘‘have-nots’’ and by dynamically changing social structures and security conditions. 2015 Crossroads uses programmed forces from 1996–2001 to fight a major conflict; it presents the United States with a strategic challenge in 2015 that could lead to any of other alternate futures by 2025. The six alternate futures were used to assess six sets of weights for the value model. Since the six alternate futures were not collectively exhaustive of all the possible alternate futures, we could not assign probabilities to the alternate futures. Instead, we performed sensitivity analysis to discover how system preferences change with alternate futures. Because of the large number of participants, we used the following process to determine the weights. All 200 participants were briefed on the methods for eliciting weights and the alternate futures. Each of the 40 teams submitted a different set of value hierarchy weights for each of the six alternate futures. The average weights of the 40 teams were used for each alternate future.

Additive Value Model We used an additive value model. The value of a system concept can be calculated by multiplying the score a system concept received for each measure of merit by the corresponding alternate future weight for the scoring function. The value function has the following form: 134

V(x) Å

∑ wmvm (xm ), where

mÅ1

m is the measure of merit (evaluation measure), xm is the level of the mth measure of merit, vm (xm ) is the value of the scoring function (single dimensional value function) at level xm , and wm is the product of the weights for each level up the hierarchy.

Scoring the System Concepts Foundations 2025 was successfully used to score the system concepts and identify the most promising system concepts (Jackson et al. 1996a and 1996b). A scoring team composed of the operational analysis and technology teams scored all 43 systems against each measure of merit. To avoid bias, the team was not provided the shape of the scoring functions. Results The final results of the system scoring are displayed in Figure 10. The vertical axis is the value on a scale of 0

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

3b2d 0003 Mp 1347 Monday Oct 26 04:01 PM Man Sci (September) 0003

1347

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Figure 10

Final System Values

to 100, where a value of 0 equates to no value on any of the 134 scoring functions and 100 equates to the most value possible. Since cost data were unavailable for the system concepts, we used technical challenge as a proxy measure. The horizontal axis is an ordinal ranking for the systems according to the technology team’s assessment of the relative technical challenge required to develop each system. Figure 10 shows system values for all six of the alternate futures. Each system’s value for the various futures is plotted and connected with a line to show the variation of that system’s value across the alternate futures. The curved dashed line provides a notional reference for comparing systems. In the OA team’s estimation, systems above the line may have sufficient value to offset the technical challenge of producing such a system. Thus, systems to the left of the chart need less value to be attractive options than systems to the right of the

chart, because the difficulty of achieving the capability is much less. It is important to note that our value model scores each system concept’s value. If two or more concepts were scored together, they could have less (substitute systems), the same (independent systems), or more (synergistic systems) value than the sum of their individual values. The AF 2025 study produced a number of excellent system concepts for employing air and space power in the future. This analysis strongly suggests that the high ground of improved awareness offers significant potential for achieving future air and space dominance. Typically, top-scoring systems possessed higher degrees of awareness and/or were predominantly space systems. The results were successfully used to directly support the 2025 study directors. Detailed analysis results and major study conclusions can be found in Jackson et al.

1348

3b2d 0003 Mp 1348 Monday Oct 26 04:01 PM Man Sci (September) 0003

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

a wide variety of topics, and forward looking thinkers, including Alvin Toffler, Admiral William Owens, and many others to build a picture of the future. As part of the comprehensive longrange planning effort, the alternate futures discussed in Air Force 2025 will help develop a strategic vision and prepare the United States Air Force for the challenges of the 21st century (Gen Ronald R. Fogleman, Chief of Staff, United States Air Force).

(1996a). The value model met all of the analysis requirements.

Summary Foundations 2025 is a significant value model development in terms of scope, planning horizon, size, and successful use. The scope included all systems that contribute to U.S. air and space dominance, and the model development involved over 200 participants. The planning horizon was 30 years into the future. The model had 5 tiers, consisting of an overarching objective, 3 functions, 8 tasks, 29 subtasks, and 134 force qualities (each with a corresponding measure of merit and scoring function)— and all weighted across 6 alternate futures. The scoring functions, developed with over 200 operational experts, serve as a valuable resource for future military air and space studies. Finally, the value model successfully met the goal of the 2025 operational analysis to objectively assess and identify systems that offer the greatest potential to support future air and space operations. We believe that our silver standard value hierarchy development approach to identifying and structuring objectives was crucial to the success of the study. Using this approach, we developed a complete list of objectives, avoided institutional bias, and developed a visionary framework for air and space dominance. Most importantly, the Foundations 2025 value model and the subsequent analysis were very valuable to the study director and the senior leadership of the Air Force.1 The AF 2025 study was publicly released by General Fogleman and Air Force Secretary Widnall in September 1996 (Air Force 2025 Final Report Homepage 1996). We conclude with two quotes about the study: 2025 is a great piece of work. It gave about 200 of our best officers an opportunity to consciously and deliberately think about the importance to our Air Force of air, space, and information systems and capabilities in the future. Whether or not the country ever builds the systems envisioned by the study, the Air Force will be better off for the critical thinking associated with coming up with the ideas in 2025 (Lt. Gen. Jay W. Kelley, Air University Commander). Air Force 2025 demonstrates to the American people that the nation’s Air Force is thinking creatively and seriously about the future. We brought in a variety of outside advisors, including some of the world’s most highly regarded futurists, experts on

1

The 2025 study benefited from the involvement of many senior-level leaders and the over 200 study participants. The technology team especially provided valuable support to the operational analysis. In addition, Study Chair, Lt Gen Jay Kelley, USAF; Study Director, Col Richard Szafranski, USAF; and the Research Director, Col Joseph ‘‘Jae’’ Engelbrecht Jr., USAF, provided important direction and advice. We also benefited from the very helpful comments we received form the reviewers and the associate editor.

References Air Force 2025 Homepage, http://www.au.af.mil/au/2025/, June 19, 1997. Air Force 2025 Final Report Homepage, http://www.au.af.mil/au/ 2025/#2025, Final Report, November 8, 1996. Air Force Doctrine Document-1: Air Force Basic Doctrine, 15 August 1995, First Draft U.S. Air Force, Washington, DC: 1995. Brassard, M. and D. Ritter, The Memory Jogger II, Goal/QPC, 1994. Buede, D. M., ‘‘Structuring Value Attributes,’’ Interfaces, 16, 2 (1986), 52–62. Burk, R. and G. S. Parnell, ‘‘Evaluating Future Space Systems and Technologies,’’ Interfaces, 27, 3 (1997), 60–73. Clemen, R. T., Making Hard Decisions: An Introduction to Decision Analysis. PWS-Kent, Boston, MA, 1991. U.S. Air Force, Cornerstones of Information Warfare, Washington, DC, 1995. Engelbrecht, J. A., Jr., R. L. Bivins, P. M. Condray, M. D. Fecteau, J. P. II, Geiss, and K. C. Smith, Alternate Futures for 2025: Security Planning to Avoid Surprise, Air University Press, Maxwell Air Force Base, AL, 1996. Fogleman, R. L., Message from General Fogleman to Air University, December 23, 1994. , Video teleconference between General Fogleman and 2025 participants, September 6, 1995. Jackson, J. A., B. L. Jones, L. J. Lehmkuhl, H. W. Conley, and J. M. Andrew, ‘‘An Operational Analysis for 2025: An Application of Value-Focused Thinking to Future Air and Space Capabilities,’’ Air University, Maxwell AFB, AL; 1996a. , , , , and , ‘‘2025 Operational Analysis,’’ Technical Report, Air University, Maxwell AFB, AL, 1996b. , G. S. Parnell, B. L. Jones, L. J. Lehmkuhl, H. W. Conley, and J. M. Andrew, ‘‘Air Force 2025 Operational Analysis,’’ Military Operations Research, 3, 4 (1998). Joint Chiefs of Staff, Joint Vision 2010, America’s Military: Shaping the Future, Draft, Washington, DC 1996.

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998

3b2d 0003 Mp 1349 Monday Oct 26 04:01 PM Man Sci (September) 0003

1349

PARNELL, CONLEY, JACKSON, LEHMKUHL, AND ANDREW Foundations 2025: A Value Model

Keeney, R. L., Value-Focused Thinking: A Path to Creative Decisionmaking, Harvard University Press, Cambridge, MA, 1992. and H. Raiffa, Decision Making with Multiple Objectives: Preferences and Value Tradeoffs, Wiley, NY, 1976. Kelley, J. W., Air University, Study Director, SPACECAST 2020 & Air Force 2025, Personal Communication to authors, April, 1997. Kent, G. A. and W. E. Simons, A Framework for Enhancing Operational Capabilities, R-4034-AF, RAND Corporation, Santa Monica, CA, 1991. Kirkwood, C. W., Strategic Decision Making: Multiobjective Decision Analysis with Spreadsheets, Duxbury Press, Belmont, CA, 1997.

National Military Strategy of the United States of America, US Government Printing Office, Washington, DC, 1995. Parnell, G. S., ‘‘Value Focused Thinking for Identifying and Creating Value,’’ Presentation to Air Force 2025 Team, Air University, Montgomery, AL, December 13, 1995. , ‘‘Using Value Focused Thinking to Generate Alternatives that Create Value,’’ Presentation to Air Force 2025 Team Air University, Montgomery, AL, January 10, 1996. Rayno, B., G. S. Parnell, R. Burk, and B. Woodruff, ‘‘A Methodology to Assess the Utility of Future Space Systems,’’ J. Multi-Criteria Decision Analysis, 6 (1997), 344–54.

Accepted by L. Robin Keller, October 27, 1997. This paper has been with the authors 4 12 months for 2 revisions.

1350

3b2d 0003 Mp 1350 Monday Oct 26 04:01 PM Man Sci (September) 0003

MANAGEMENT SCIENCE/Vol. 44, No. 10, October 1998