A MULTI-FRAME POST-PROCESSING APPROACH TO IMPROVED ...

A MULTI-FRAME POST-PROCESSING APPROACH TO IMPROVED DECODING OF H.264/AVC VIDEO Xin Huang, Huiying Li, and Søren Forchhammer

COM Department, Technical University of Denmark, Building 343, Lyngby, DK-2800 Email:{xin,hli,sf}@com.dtu.dk ABSTRACT   

         

                                                                                !" #      

 

                $   #  %      &       '()*+,              

            

 Index Terms— "              !" # 1. INTRODUCTION  !" #       

   -  

       %                   "  &   

    

   !" #           .   

   /01         .(23  4        

          &       



 

            !" #     

                                         

 

   %        % &  .(23 /1      !" # /41                        5    $         6   5      

                         7   

     6     

            $                '      ,                 

    7           

                                        

 

      % &                                

              $  % 8  )                69         "        

1-4244-1437-7/07/$20.00 ©2007 IEEE

                  )  4                  )             )  : 2. QUALITY METRIC              $           . & %     $     ';(,      ' (                     %                 "          6            >              6 %   

                         6         6    .)2      $                                     )  / 1           %  ?    

      /1       6     

%  7 0     %       3. MOTION COMPENSATED UPSAMPLING .  #   '.#,                '  ' @ ,         '@ ,       $ ,                 Nf          #  %          .#                  %                  .#  

 % 6   .  2   '.2,   6         % 6        (6

       %          

                   (6

       %          %  6              

IV - 381

Authorized licensed use limited to: Danmarks Tekniske Informationscenter. Downloaded on November 11, 2009 at 09:47 from IEEE Xplore. Restrictions apply.

ICIP 2007

   %       

0) &      6-7

(Δm = 0, Δn =

"    

  %   &            2  & &    )

"  )  &

               9&    

xr

8

xc

       

 2  &         % 

      

5        

 &4

x ˆ = hr xr + hc xc " !    6

+

hr

  ) 

hc





          &    5*  9 4



Fig. 1 M SE  Qstep        

QP

   

%

E{Xr Xr } E{Xc Xr } Xr

E{Xr Xc } E{Xc Xc }

Xc



 h E{XX } r

hc

r

=

E{XXc }

 

      

         &

         

0

X

 



             

     

3.1. Motion Compensated Upsampling         

  



 (

×

(

hr + hc = 1

xr

 

 !

"

               

   

 !     #$

       

)    )        

× #$   % & '  

:           

  0       9&   

hr



hc

hr = 1 − (1 − α)(qc /qr ) hc = 1 − hr

" ) 

 !     %

 

       

   

 &

"

        &          

× ( 

 "&    & (m+Δm, n+Δn) (m, n)      (Δm, Δn)      

   (

" )  )    

%

 ) 

        

"        & )

   

    

 &    

"

a priori %  xr

"   

hr

β



' 3

+

" 

  &

" 

 )  %       9  ;     

xr



xc

α β

 

9  '      &

qc /qr   0  1      &  0 ≤ α ≤ 1 β ≥ 0 qr , qc ≥ 0  0 ≤ hr ≤ 1 <   )

      &    )   

    

 )   * +$',-. /01

 

* % 

          )   

xr  xc

     /+14

              

         

   %    

            %

 

9&  4

          

       

  



            %  

2                   

xr

 

min(a, b) max(a, b) a+b−c

$

3.2. Interpolated Upsampling

      /314

x ˆintra =

qˆ = hr qr + hc qc

%    

-  /+1    

 

c ≥ max(a, b) c ≤ min(a, b)

-    )         #

            %    %  &       

 %  

%

    

a b  c           xc  & 5     

          

%

  

    %   &  &    



 

      2&  

             6-7

"

xr %  6-7   ( × ( 

 %  2  (mr , nr )      

         xr  %              8 (Δm, Δn)             6-7 %  ( × ( 

        xr %          %            (mr − m − Δm)V, (nr − n − Δn)H 

8





                

                 %    9&  #

   

  9 9&             % 

    ' 




 =    

350

  "# $    #&

PSNR improvement for individual picture 0.6 mobcalCIF@622Kbit/s foremanCIF@222Kbit/s 0.5

PSNR Improvement(dB)

7. REFERENCES

300

0.4

0.3

0.2

0.1

0

I B B P B B P B B P B B I B B P B B P B B P B B I Frame Type

Fig. 6  

     

IV - 384 Authorized licensed use limited to: Danmarks Tekniske Informationscenter. Downloaded on November 11, 2009 at 09:47 from IEEE Xplore. Restrictions apply.