Document not found! Please try again

Generation and error characteristics of parallel ... - Computer Science

0 downloads 0 Views 3MB Size Report
each mosaic, and their corresponding 3D point P(X, y, Ζ). It serves ... the match pair has a pre-defined disparity (the distance of the two slit windows) and ... for parallel- perspective stereo mosaics constructed from an image sequence captured.
 

  

                                    

                   ! ! !          



  

                                     

                   !     "        #      $ %  &'(     )  )( *    #   *                +   

   *      ,   *  -. /0    1 0   2$$1 0   2$$3                

                       4                

     

       !"# $





     5                                    /0   6   23       

 /7     81 ) (   2$$$1 0   2$$3 #                    / 0    1 0   2$$1 0   2$$3     

              "       6                                                +                      #          /  )  2$$$3    /0    1 0   2$$3                                     /  )

 )( *   3                   

                     9    :  :          6   

 :    :      2                                 6  /  )  2$$$3 #               ;           9                                                           ;          <        Æ  :    :  ;                 5        2      ;    2           6  /%     =3                   +                  9   "    .                                              #         +   ;       +                + /7     81 )  >1 )( *  7  83                  9                    

    



           "                  ; ?       :    :  ;           /%,#).3/0   2$$3   9     ;        @ 5<  

           #  %,#).   

  9  

     "     9               +                                       ?                        2       + /,     !3             +    

                          5 *  "   

     <          Æ   ?                      #                                      )          

    9+                                        9     



(           /0   2$$3     +

 /3    %,#).  /   9        3   +        /    31  /23    9 :    ; :          +                                    

              <                 (               ,  

                                )                           +      

     

                 /  3        9        



           +                <                     ?           +       + /           3                   

                 /A      =3       6           

    6         #     

                

  "  ;         B 9        *          *  *                                  

    

?                       2 "                  /<  3  : :   /   3            :  :   / 

  3                                     ;  /<  1 0    1 0   2$$3  

C  C   

  C D /  3 2

/3

  /   3 2 C                   +          <              2    /  3  /  3  

             /   3 #    

            4  (       /0   2$$3 +             ;            +    /53

            ?   F   :

   F  :                    



     

3           #         

    ';  2             

    

!

∂Y=(H/F)∂y

Ol

Or

Z1

Z1 ∂Z1

∂Z1

Z2

Z2 ∂Z2=∂Z1 (a) Multiple viewpoints

∂Z2>∂Z1 (b) Two viewpoints

"  #$# "                 

    E )      E      

              (     Æ + /  Æ  3          E C $ Æ 2Æ    #             

                   E    /<  23 Æ

C  Æ C  

/83

#            /<  23              ;     4                                  C /  3             ?    9     ;           C E /@3  E                             

Æ



 C 



/=3

                                  /0  

"

 3         /  )  2$$$3                              ;        #         9  I  

 (                              (     

 )  >2  8 

      

#         Æ                         #    +              ;  Æ                                    A *        Æ     

                          ;  +           /   3     /   3 #                     F   : Æ          J      

            #        /   9 3            

      #                                 #         

           9             

    ;                     4                    /0   2$$1 0   2$$3 

          

          (                *       

           6       /0   2$$3 -                                 "                        ?    (             +    @ 5<                             

    

(a)

#

3D path of the camera: 3D rotation + 3D translation Dominant motion direction Y

Original image frames

(b)

Path of the camera: 3D translation Dominant motion direction Y X

Y Z Rectified image frames

"  ## )  &    *    #  &  + 

/<  1 0   2$$1 0   2$$3       9                                 9

 ;  +                   J

      

4 

           +         /      3    

            /A%) #K)     93 /) (   2$$$3    6   ; /)   !$3                        *                      #                               

    

4 2 6                

        /<  3 #        *                                        *                   

      / 3         +   : 9:  

$



      

                          "  H  *                                           /%,#).3 3              *            /   3    )                             +

            2        9                     /0   2$$3 ? *        +           <  > <   9         / 3                    

    B               / 3      9+    +                 4       /#%3   9+              9+   &  9             #%  9+      /   3          )    /  3                / 3        /  3    /23        / D   D  3 /<  >3 ?                    2    @$  8@        /0 2$$23 )       

 2     (  <  = <  =  =         2                          # <  = 

          2                     #      *               9   /           3 

  

    4 +                  /<  =3   +     

Seams due to misalignment

b

Seamless after local match

c

"  #(#        12        #  

The (parallel-perspective) mosaic (a) is the left mosaic generated from a subsampled "sparse" image sequence (every 10 frames of total 1000 frames) using the proposed 3D mosaicing algorithm. The bottom two zoom sub-images show how 3D mosaicing deals with large motion parallax of a tall building: (b) 2D mosaic result with obvious seams (c) 3D mosaic result without seam.

a

"

O2

O1 H/2 H

2H P1 Q1 P

P2 Q2

"  #)# ,              /    ½ 

          )             '                      

          

       #        # /                                     # #

   # # '      '   &          

   3        

    

# +        

!

"    

  

!   "      



#                  

                 ;                        <                 6                             "   H )        +                                        H      9 ;    J 4                             /<  !3 ,           9+        #                            

    

#

                                  5                        +        

    9+             

*                           *  9+                                       /     

    3  '

"  #$# $      !"       788 

 +    4            

c

b

a

H (number of pixels)

     a

b

! c

"  ## .       

        77            

            #               

 !"  

'

"+   

        <  2  8    +                    ;     ;                           /   4 (                3       * /) (   2$$$3               A%)     #K)     9

              /        "    3           C !8

                               C @$ +               C 2 >@ +            C >@ + /               A%)G#K)G                   3 #       (         =2$/3  >!$/3     

      /            3 &                 =@8 + G           2$ + G                                +       / ) (  83 <  2  <  >     F :

 /        3                           #                        /       3     #  

"

                                              

      <  =   9+    F  :        / C !8

3        <  2  <  >                 E             #                          (                     9+       #                       $ /   3  2>$ /  3 <    <  8                               &                              

            #                    "  

                



   "                              /       3     /<  @3

Suggest Documents