Sensor ] ( Sensor - Google

USO0H002208H

(19)

United States

(12) Statutory Invention Registration (10) Reg. No.: Stytz et a1. (54)

(43) Published:

INTELLIGENT AGENT REMOTE TRACKING OF CHEMICAL AND BIOLOGICAL CLOUDS

(US); Sheila B. Banks, Orlando, FL

3/2002 Stoyen LeCompte et a1. ....... .. 348/144 Padmanabhan et a1. ..... .. 702/19 Berry ....................... .. 340/540

Primary ExamineriM. Clement (74) Attorney, Agent, or FirmiGerald B.

United States of America as

Hollins;

AFMCLO/JAZ

represented by the Secretary of the Air Force, Washington, DC (US)

(57)

ABSTRACT

An intelligent agent-accomplished detection and tracking

(21) App1.No.: 10/336,301 Jan. 6, 2003 (22) Filed: (51) Int. Cl. (52) (58)

4/2001 Yalowitz et 31.

6,360,193 B1

Jan. 1, 2008

* cited by examiner

(Us)

G06G 7/48

6,212,649 B1

2002/0041328 A1 * 4/2002 2004/0064260 A1 * 4/2004 2004/0257227 A1 * 12/2004

(75) Inventors: Martin R. Stytz, Beavercreek, OH (73) Assignee:

US H2208 H

system responsive to sensed characteristics in a cloud of chemical or biological Warfare agent(s) dispersed over a

geographic area of the earth. The intelligent agent elements of the invention provide an organized and repeated com

(2006.01)

parison of signal data extracted from overhead dispersed conventional sensors of the chemical or biological agent

US. Cl.

.................................... ..

..

703/12

material and accomplish communication With other agents

Field of Classi?cation Search ................. .. 702/19,

and the outside World using a common ?exible communi

702/22; 703/12 See application ?le for complete search history.

cation language. The intelligent agent elements are disposed

(56)

References Cited

in hierarchical arrays having at least loWer level, mid level and upper level locations and are inclusive of multiple path forward and feedback agent communications.

U.S. PATENT DOCUMENTS 4,737,847 A

4/1988 Araki et a1.

5,091,780 A 5,109,380 A

2/1992 Pomerleau 4/1992 Ogino

5,140,523 A 5,265,031 A 5,648,914 A

22 Claims, 12 Drawing Sheets A statutory invention registration is not a patent. It has

8/1992 Frankel et a1. 11/1993 MalcZeWski *

7/1997

Bauer et a1. ................ .. 702/19

5,724,255 A 5,796,611 A 5,808,916 A

3/1998 Smith et a1. 8/1998 Ochiai et a1. 9/1998 Orr et a1.

6,081,750 A 6,192,364 B1

6/2000 Hof?oerg et a1. 2/2001 Baclawski

the defensive attributes of a patent but does not have the enforceable attributes of a patent. No article or adver tisement or the like may use the term patent, or any term

suggestive of a patent, When referring to a statutory invention registration. For more speci?c information on the rights associated With a statutory invention registra tion see 35 U.S.C. 157.

Analytic Analytic Analytic Analytic Analytic IntelligentAgent lntelligentAgen lntelligentAgent IntelligentAgent lntelligentAgent

K104 Sensor Specific

Intelligent Agent

Sensor Specific

Intelligent Agent

Sensor Specific

Intelligent Agent

Sensor Specific

intelligent Agent

Sensor Specific

intelligent Agent

118

Sensor

L102

1

11 110a

Sensor ] [ Sensor ] ( Sensor ]

U.S. Patent

Jan. 1,2008

Sheet 1 or 12

Analytic

US H2208 H

Analytic

Intelligent Agent

Intelligent Agent J14

Analytic Intelligent Agent

Intelligent Agent

Analytic

V

Analytic Analytic Analytic Analytic l Analytic Intelligent Agent intelligent Agent Intelligent Agent Intelligent Agent Intelligent Agent

K104 Sensor Specific

lntelligentAgent A118

Sensor Specific

lntelligentAgent

Sensor Specific

lntelligentAgent

/a12’0

\

Sensor Specific

lntelligentAgent

Sensor Specific

lntelligentAgent

i

[ Sensor ] [ Sensor ] [ Sensor 1 [ Sensor l ( Sensor l L102

L103

925. 1

U.S. Patent

Jan. 1,2008

Sheet 2 or 12

US H2208 H

Analytic Intelligent Agent

Analytic Intelligent Agent

Analytic

Analytic

Analytic

Analytic

Analytic;

\\ \\

Intelligent Agent Intelligent Agent intelligent Agent Intelligent Agent Intelligent Agent \\ X

Blackboard

Sensor Speci?c

lntelligentAgent

Sens'or Specific

lntelligentAgent

]i

Sensor Specific

lnlelligentAgent

]i

Sensor Specific

lntelligentAgent

if 97151.2

Sensor Specific

lntelligentAgent

L

]

U.S. Patent

Jan. 1, 2008

Sheet 3 0f 12

Cognitive

Knowledge

Component Decision

Base

'\’ 302

304 \

Engine _ _

Decislon Engine

Agent

Knowledge Base

0

1

US H2208 H

Physical

,

Representation

Component

Knowledge Base

N303 Enviromental Database

Agent Interface "\-/301

71;]. 3

_

M'ss'on

U.S. Patent

Jan. 1,2008

Sheet 4 or 12

US H2208 H

402

Environment

Analyst

Other Sensor

' Current World Model

Inputs Analyst

Expected World Model

Feedback Analyst

404

Engine Memory

fig. 4

405

U.S. Patent

Jan. 1, 2008

Sheet 5 0f 12

US H2208 H

Sensor 1 Data

Adjust segmentation thresholds ‘ '

Extract clouds V

For each

cloud,

/_

extract

590

Other sensor

parameters, characteristics, _\ location,and 520 velocity

inputs analyst operation Knowledge base 522

Foreach

cloud,

535

Current world Model

A

correlate features within one cloud .

i

For each cloud, correlate features for

Revise Expected

the cloud between

World Model

all agents

Output description

550

I

of each cloud in XML

Update Engine Memory

%

\,

"

‘

Send to other agents/post to

blackboard

'

1 1g. 5

Feedback Analyst Operation

N

U.S. Patent

Jan. 1, 2008

Sheet 6 0f 12

US H2208 H

600 Sensor 1 Data

610 /

Knowledge base

Segment data, s

-

search for

clouds

other sensor

No

1'

data and

Are one

analysis

or more

601

X620

°'°“ds ? identified

Knowledge base

"Yes Is there a

N0

volume to be

\-/630

examined ? "

-

Yes

Knowledge base

Determine

characteristics N640 of each

volume

Knowledge base

i

Correlate with knQWledge, b_as

characteristics

for each

Knowledge base \IGSO

cloud type

-

T

Knowledge base

666

K

is it a chemical NO

or biological : cloud? \/ "Yes 660 Send data to ‘\-/665 feedback agent

fig. 6%

Currr?gg‘go?d f 670 . is cloud in current world

No

model? Yes

Knowledge base

U.S. Patent

Jan. 1,2008

US H2208 H

Sheet 7 0f 12

/680 Match cloud to data and cloud ID

Update

expected

Make new cloud, x 685 identifier and

parameters

1

x683

world model

‘

Output XML-based p\/ 686 description of cloud to other agents

Update

“\-/684 '

current

world model

Update

engine

memory

\690

fig. 693

U.S. Patent

Jan. 1, 2008

Sheet 8 0f 12

US H2208 H

700

Get environment

analyst output L Make list of

clouds in

F110

environment /

Expected world model a

analyst output and clouds in

705

expected world model

1 Check cloud at —\ environment top of

Knowledge base

V analyst output list

against all clouds in expected world

model list

-

i Found a match

Knowledge base

between lists

No

Yes l}

735 7

730

‘ |s mere a

Add cloud and

its parameters to current world

difference in \/

parameter

745

model

740

Values for a

Yes

Resolve differences,

cloud between

update c|oud

the two lists

parameters in

N0

__>‘

current world model i

Know l edg e ba 3 9

Send cloud

737

information to

en ine memo

y

in

XlaL and remrgve x750

Send cloud and

top cloud from environment

parameters to ‘

Feedback Analyst and

analyst list it Do clouds remain on environment

analyst list’?

‘__.___\l Yes

Expected World Model W760 No ,

9:12g. 7

U.S. Patent

Jan. 1, 2008

Sheet 9 0f 12

/801 Environment

/803

Engine

analyst output 870

1802

US H2208 H

Other sensor

memory

inputs analyst

\LZ

\ Dead reckon size,

position and other clouds, update

Poll for

> parameters for all

>

: engine memory

is there new

N°

\sss

805

l

l‘

Send cloud

\

new data

cloud data?

Yes

information to

feedback agent

Does cloud

‘

data

correspond to

b 830 Update

expected world model

any cloud in

expected world model?

I

‘

No

Yes

Is there a

differencebetween x840 data for new

cloud and data in

expected world model?

N0 J

Yes I

Revise cloud

parameters in expected world model

1 Send cloud differences to

Freeback agent

804 Feedback

analyst

U.S. Patent

Jan. 1, 2008

901

Sheet 10 0f 12

/902

Environment

/903

Engine

analyst output

904

Other sensor

memory

Feedback

inputs analyst

\