Sep 6, 2001 - Of?ce Action for JP App. 2002-525579 mailed Dec. 14, 2010. (Continued) ..... A second family calls upon th
USO0RE42977E
(19) United States (12) Reissued Patent
(10) Patent Number: US RE42,977 E (45) Date of Reissued Patent: Nov. 29, 2011
Maziere et al. (54)
METHOD FOR SEGMENTINGA VIDEO
(56)
References Cited
IMAGE INTO ELEMENTARY OBJECTS U.S. PATENT DOCUMENTS l/l998 Matsugu et a1. 12/1999 Chang et :11.
(75) Inventors: Magali Maziere, Valbonne (FR); Francoise Chassaing, Rennes (FR); Henri Sanson, Acigne (FR)
5,706,419 A 5,999,651 A 6,031,935 A
(Continued)
(73) Assignee: Gula Consulting Limited Liability Company, Dover, DE (U S)
(21) Appl. No.:
12/355,565
(22) PCT Filed:
Sep. 6, 2001
(86)
PCT/FR01/02771
PCT No.:
§ 371 (0)0)’ (2), (4) Date: (87)
FOREIGN PATENT DOCUMENTS EP
OTHER PUBLICATIONS Of?ce Action for JP App. 2002-525579 mailed Dec. 14, 2010.
Mar. 7, 2003
(Continued) Primary Examiner * Tung V0
PCT Pub. Date: Mar. 14, 2002
(74) Attorney, Agent, or Firm * SchWabe, Williamson &
Wyatt, PC.
Related US. Patent Documents
Reissue of:
(30)
(51)
(57)
7,164,718
Issued:
Jan. 16, 2007
Appl. No.:
10/363,795
Filed:
Mar. 7, 2003
Int. Cl. H04B 1/66 H04N 7/26
ABSTRACT
A starting contour is de?ned surrounding around an elemen tary object delimited by a natural contour in a video image. On the basis of the starting contour, an original active contour is de?ned, formed by a set of nodes distributed on this starting
Foreign Application Priority Data Sep. 7, 2000
000959625 A2 * 11/1999
(Continued)
PCT Pub. No.: WO02/21444
(64) Patent No.:
2/2000 Kimmel
contour, each node being formed by a point belonging to this
(FR) .................................... .. 00 11404
(2006.01) (2006.01)
starting contour and by an elastic energy function represen tative of the distance separating this node from a neighbour ing node. With regards to a set of reference values represen tative of the contour of this object, the active contour is subjected to a convergent deformation under a blocking con
dition, by displacing at least one of the nodes of the original
(52)
US. Cl. ................................................ .. 375/240.16
(58)
Field of Classi?cation Search ........... .. 375/240.16,
375/240.1; 348/234, 236, 419.1, 416.1; 382/234,
active contour toWard the natural contour of the elementary object to generate a current active contour iteratively sub
jected to this convergent deformation.
382/236
See application ?le for complete search history.
25 Claims, 10 Drawing Sheets
INITIALIZATION OF 4'2 THE GRADIENTS MAP
STOP DISPLACEMENT FNAL mm: CONTOURE cu
US RE42,977 E Page 2
6,400,831 6,480,615 6,560,281 6,804,394 7,010,567
US. PATENT DOCUMENTS B2* 6/2002 Lee et a1. .................... .. B1 11/2002 Sun et al. B1* 5/2003 Black et al. ................. .. . B1* 10/2004 Hsu ........ .. B1* 3/2006 Mori ........................... ..
FOREIGN PATENT DOCUMENTS EP EP EP
959625 A2 1 014 303 A1 1014303 A
11/1999 6/2000 6/2000
OTHER PUBLICATIONS
382/103
375/240 382/173
709/203
International Search Report for PCT App. PCT/FR01/02771. Kass et al., “Snakes: Active Contour Models,” International Journal
of Computer Vision, 1, pp. 321-331 (1998). Of?ce Action mailed Apr. 4, 2006 for US. Appl. No. 10/363,795. Of?ce Action mailed Apr. 19, 2006 for US. Appl. No. 10/363,795. Notice of Allowance mailed Sep. 26, 2006 for US. Appl. No.
10/363,795. Of?ce Action mailed Aug. 17, 2010 for JP App. 2002-525579. Of?ce Action, issued in Japanese Patent Application No. 2002 525579, mailed May 24, 2011, 3 pages.
* cited by examiner
US. Patent
Nov. 29, 2011
Sheet 1 0f 10
US RE42,977 E
CN: NATURAL
CONTOUR
DEFINITION OF A STARTING
L/A
CONTOUR CD AROUND OBJ
H
i
DEFINITION ON THE BASIS OF CD OF AN ORIGINAL ACTIVE CONTOUR CAO CALCULATION OF E
CONVERGENT DEFORMATION CAO BY DISPLACEMENT IF E A MINIMUM
CALCULATION AE—->? CURRENT ACTIVE CONTOUR CAC
CAOECAC
DISPLACEMENT
AE MINIMAL?
D
/ STOP DISPLACEMENT FINAL ACTIVE CONTOURECN
FIG’IQ.
US. Patent
Nov. 29, 2011
Sheet 2 0f 10
WxnE
US RE42,977 E
sew
‘aliun
68Q6
Q
_
__m
26v3
ax
wQMPwmD
US. Patent
NOV. 29, 2011
US RE42,977 E
Sheet 3 0f 10
lM: OBJ: CN: NATURAL
F1620.
CONTOUR 7
SMOOTHING OF THE IMAGE
I
M
INITIALIZATION OF THE GRADIENTS MAP
“M2
SAMPLING
B11
INTERSECTION
V812
I DISPLACEMENT
WC
ISPLACEMENT.
DISTANCE BETWEEN /F| NODES
F2 ‘
PASSES?
NO STOP DISPLACEMENT FINAL ACTIVE CONTOUR; CN
1F
US. Patent
Nov. 29, 2011
Sheet 4 0f 10
US RE42,977 E
nm
0E
US. Patent
Nov. 29, 2011
Sheet 5 0f 10
US RE42,977 E
US. Patent
Nov. 29, 2011
Sheet 6 0f 10
DATA PREPARATION
US RE42,977 E
G
F
,
i‘
ESTIMATION OF MOTION
APPLIED TO THE ACTIVE CONTOUR
T H
/ 1
1
REFTNTNG OF THE SELECTION
H2
OF THE CONTOUR OF THE
J/
1......
OBJECT
_..____.J
CONTINUE MET HOD
NEXTIMAGE
age Jr
I?’ \
-
/ \
W
caco=caczc
\ \“~CA end = min
\
W21
kH22 Lu?
sac!)
\--—cAiR = can
FIGSb.
#123
U S. Patent
Nov. 29, 2011
Sheet 7 0f 10
US RE42,977 E
MASK
RING
US. Patent
Nov. 29, 2011
Sheet 8 0f 10
US RE42,977 E
FIG.3d
US. Patent
N v. 29, 2011
Sheet 9 0f 10
US RE42,977 E
US. Patent
Nov. 29, 2011
Sheet 10 0f 10
US RE42,977 E
FIGS.
sssmanw‘rom 1cm ..-_.. 9 5E
GAE =~. [{m, Kg] : Le
w4
