Design on general development platform for FPD

0 downloads 0 Views 467KB Size Report
Mar 11, 2011 - FPD devices, and ARM11 S3C6410 is used as the application ... the extended peripheral board, the display driver board, ... board, and the motherboard, while other display and .... vision device, connect it to the camera interface, so that ..... access points, bluez providing tools and system daemons for using ...
J   Shan ghai   Uni v( Engl   Ed) ,2011 ,1 5( 4) :2 97— 30 3   Di gi t al   Obj e c t   I de nt i ie f r ( DOI ) :1 0. 1 00 7/s 1 1 741 — 011 — 07 40— 1  

D esi gn on general  devel opm ent  pl atf orm  f or FPD system s  WANG  Guo— qi n( 王 国钦)  , xu Mei — hua( 徐 美华)  , TENG  Da( 滕

达)  

l_School   of   M ec hatr oni cs  Engi neer i ng and A utom at i on,Shanghai  U ni vers i t y,Shanghai  200072,P.R .C hi na  2.M i cr o- el ectr oni c  R esearch and  D evel opm ent  C ent er,Shanghai   U ni ver si ty,Shanghai  200072,P.R .Chi na 

⑨ Shanghai  Uni ve rs i ty  and Spr i nge r— Verl ag  Ber l i n Hei del ber g  201   1   A bstract  I n  thi s   paper,a  m ul ti —f uncti onal   devel opm ent   pl at or f m f or   lat f   panel   di spl ay f FPD 1   devel opment   i s   proposed.W i th 

t he   pr opos ed   de ve l opme nt   pl at f or ms ,a   va r i e t y   o f   FPD  de vi c e s ,i nc l udi ng  or ga ni c   l i ght — e mi t t i ng   di ode( OLED)s c r e e ns ,l i qui d   cr yst a1  di s pl ay (LCD)scr eens  wi th t ouchscr eens,OLED mi crodi spl ay screens,etc. ,can be di rectl y and i nstantl y connected,   exam i ned and  uti l i zed.A  iel f d—pr ogr am mabl e  gat e arr ay f FPG A1  i s  used i n  the  devel opm ent   system  to  dri ve  di ier f ent  t ypes  of   FPD devi ces  and ARM 1   1  S3C6410 j s  used as  t he appl i cat i on proce ssor  to  pr ovi de vari ous  ser vi ces.The  devel opm ent   syst em 

us es Li nux as  the  sys tem kerne1 .Qt  f or  Embedded Li nux as  the UI  f ramework.vari ous  sys tem l i brari es f or  vi deo and audi o  s ervi ces.and a custom — m ade us er  engi ne f or  f ine— pol i shed appear ance and behavi or. The  devel opm ent  pl at f or m has been  used not  onl y j n t esti ng  and veri icati f on  of  the  FPD devi ces,but  al so i n bui l di ng OLED—power ed handhel d di gi t al  devi ces.  

s hor teni ng the  devel opm ent  cycl e f rom OLED devi ces  t o  m ature  appl i cati on products.  

Keywor ds  f lat   pane l   di s pl ay( FPD) , or gani c   l i ght — e mi t t i ng  di ode( OLED) ,ARM1   1 ,f ie l d— pr o gr a mmabl e   g at e   ar r a y( FPGA)   Li nux,Qt  

Introducti on 

I n thi s paper,both the hardware sys tem  and the  sof tware system  ar e t o be i m pl em ented. The hardware 

I n thi s  paper.a m ul ti — f uncti ona1  devel opm ent  pl at.   f orm  i s  i ntroduced,w hi ch i ncl udes  the appl i cati on pro—  

ce s s or, t he   lat f   pane l   di s pl a y( FPD)dr i vi ng  ci r cui t s,t he   operati on and i nteracti on i nterf ace,etc. ,as wel l  as  the 

sof tware  f ram ework  and a general   user  engi ne.i ntended 

t0 be a  seri es of  suppor ti ng faci l i ti es  used f or  FPD de.   vel opm ent.  

W i th the proposed  devel opm ent  pl at f orm s.a vari et y  of  FPD devi ces.i ncl udi ng organi c  l i ght —em i t ti ng di ode 

( OLED)s c r ee ns ,l i qui d c r ys t al  di s pl ay ( LcD)s cr e ens   wi th  touchscreens,0 LED  mi crodi spl ay  screens,etc. ,can  be di rectl y and i nstantl y connected,exam i ned and uti 一   1 i zed.   In spi te of  the dri vi ng power pr ovi ded by the 

iel f d— pr ogra mmabl e  gat e  ar r ay ( FPGA) ,t he  e xc e l l e nt   m ul t i m edi a  capaci ty  and  versati l i t y  of   A RM 1   l  S3C6410  mi cr oprocessors  m ake i t  possi bl e  o r  f the  FPD screens   to  di spl ay hi gh—def ini ti on,hi gh-f ram e—rate,hi gh— contrast,   col orf ul  m ot i onal   vi deos.whi l e  the  stabi l i l t y and m at u—  

r i t y  of   Li nux,t he   le f xi bi l i t y  and  ar t i s t r y   of   Qt  make  i t   possi bl e  for t he FPD screens  to di spl ay com pl ex 2一 D or  3一 D graphi cs[ 11 .  

system  i s  com posed of   ive boar f ds:the processor  board,   t he  extended  peri pheral  board,the  di spl ay  dri ver  board,   the  keypad  board  and  the  m otherboard.Except  f or  di s 

pl ay  devi ces ,vi de o i nput  devi c e s,audi o  i nput/ out put   devi ces,wi red  and  wi r el ess  net wor k devi ces,storage  de.  

vi ces,etc.are i ncl uded i n the hardware  system .FPGA  i s used to dri ve di f f erent t ypes  of FPD devi ces,whi l e  S3C6410  as  the  appl i cati on proces sor  i s  us ed  to  provi de  varj ot 1 s  servi ces.  

The  sof tware  syst em  contai ns  ive  f l ayers:f i)The  l ow-   est  l ayer  of  devi ce dri vers tal ks  di rectl y wi th the hard_  

wa r e;( i i )The   oper a ti ng   s ys t e m  l a ye r   of   Li nux  pr ovi des   a stabl e system kernel ;fi i i   1  The s ystem l i brary I aver  

pr ovi des  di fe re nt  s uppor t i ng  l i br ar i es ;( i v)The  appl i —   cati on l ayer  provi des  vari ous appl ets  that  com m uni cate 

wi t h t he  use r s ;( V)The  des i gn  di a gr a m l a yer  pr ovi des   a uni ied user f  i nterface f or  ti le  users.The sof twar e sys—   tem i s caref ul l y desi gned t o sari sf v t he devel opm ent  of 

som e O LED .powered handhel d enter tai nm ent system s.   i n order to shorten the devel opm ent  cycl e f rom  O LED  devi ces  to m ature appl i cati on products.  

R ecei ved A pt. 19,2011;R evi sed M ay 30,2011  

Pr oj e c t  s uppor t e d  by  t he  Ke y  Labor a t o r y  of   Advanc e d Di s pl ay  and S ys t e m Appl i c at i on ( Shang ha i  Uni v e r s i t y) ,Mi ni s t r y   of  Educ a t i on,Chi na ( Gr an t  No. P2 00 803) ,and  t he  Pos t gr aduat e  I nnov at i o n Foundat i o n of  Shangha i  Uni ve r s i t y( Gr a nt   No. SHUCX1   1 2 37 2)   Cor resp0ndi ng  author   W ANG Guo- qi n,Ph  D Candi ate,E- m ai l :wangguoqi nl001 ̄gmai l . com 

2 9 8  

J   Shang hai   Uni v( En gl   Ed) ,20 11 ,1 5( 4) :2 97 -30 3  

1  D esi gn of  hardware system  

board,and the m otherboard,whi l e other  di spl ay and  capture peri pheral s  i ncl ude the cam era,the ni ght vi —  

As  i s  s hown  i n  Fi g. 1,the  whol e   hardware  system   con—  

si on devi ce,the O LED screens,the LCD screens,and 

si st s of  f ive boards: the processor  board,the ext ended 

the OLED mi crodi spl ay  screens  can  be attached to  the 

peri pheral  board,t he di spl ay  dri ver  board,the keypad 

system .  

M i cro  di spl ay 

Or i on  h ̄ dwam  di agr am  Ext ended  per ipher al   boar d 

camera  

Di s pl ay  dri ver   boar d 

回回  

VOA( out )  

Cam er a 

OLED  di spl ay a nd  t ouch  scr een 

Ni ght   vi si on  vlSlOn 

RGB(i n)  

M ot her   boar d 

_ 网 《  圈 一   Wi Fl  





Key 

・・ Bl ue t oot h 

圈   Fig.1  Hardware diagram  

1. 1  Peripheral s  1. 1. 1  O LED  di spl ay 

The  0 LED panel  di spl ays  are researched and de—   vel oped  cooperat i vel y  by  Shanghai   Uni versi t y  and  Shanghai  V i deo  and  Audi o  El ectroni cs.The act i ve—  

scr een,whi ch enabl es  the users to operate usi ng thei r   ingers.The  f o ur  f wi res  are  al so  connected  to  the  FPGA  and  si gnal s  are sent  to  the  A RM  process or.  

1.1. 2  0 LE D m icro di spl ay  The OLED m i cro di spl ays  are  res earched  and  devel —  

回圈园 

oped  by  Shanghai   U ni versi t y.640×480  pi xel   m at ri x.256 

matri x OLED f AM OLED1  di spl ays  are dri ven by l ow—  

hi gh gray l evel s  OLED— - on- - Si l i con mi cro di spl ay chi ps 

t empe r at ur e  pol yc r ys t al l i ne  s i l i c on ( LTPS)t hi n f il m 

were produced usi ng 0. 35 gm .18 V hi gh-vol tage tech—  

transi s tors门  FT1 .Current  experi menta1  OLED  di spl ay 

ni que w i th a m axi m um  s canni ng  ̄equency of   30 M Hz.  

i s   i n  s i z e   of   8. 89   cm,QVGA ( 320×240)qua l i t y,2 60  K 

They can be connected usi ng VGA i nterf ace pl aced on 

col ors,and s howed  the  superi ori t y of   hi gh i l l um i nati on,  

the devi ce dri ver  board.  

hi gh cont rast  and f as t reacti on i n the t est s.   I m ages  

and  texts  di spl ayed  on them  can  be  easi l y s een and r ec—   ogni zed even di rectl y expos ed wi th hard sunl i ght,thus  they are ver y sui t abl e f or  outdoor  us e. In f act.the i 1 一   l um i nati on at  i ndoor envi ronm ents  shoul d be  decreased  to  protect  the eyes  of   the users   fr onl  bei ng  hurt  and at   t he  sam e ti m e to  save t he power.   The scanni ng and scal i ng al gor i thm s  have been de—  

vel oped and  program m ed i n  an  FPGA chi p,l ocated on 

the  di spl ay dri ver  board. The FPGA wi l l  tal k t o t he  0 LED  di spl ay.and  present   i tsel f   as  a  nor m al   LCD  i nter+  

f ace to the advanced RISC  m achi ne f ARM 1  processor.   T he 0 LED di spl ay i s   covered  wi th a  f our— wi re  touch 

The 0LED m i cro di spl ays  can be used as hel m et  

mount ed di spl ays  f HM D1[ 2j  or head— mounted di spl ays  f HM D1【 3 J  i n  ai rcr af t  avi ati on  f or  pi l ot s,t acti cal   i nf orma-   ti on di spl ay f o r m i l i tary,pol i ce and f iref ighters,s ter eo—   s copi c vi ews  of  CAD schem ati cs  f or  engi neers  and sci -   enti sts,radi ographi c data di spl ay i n surgeri es  f or s ur-   geons,3-D gam es  and enter tai nm ent appl i cati ons,and 

race data  di spl ay f or  Form ul a One  dri vers.   1. 1. 3  C am eras 

An OV 9650 cam era f rom  Om ni Vi si on i s  used i n  the  s ys tem ,connect ed to the cam era i nterf ace on the ex—   tended  peri pheral   board,dri ven  di rectl y  by  the  i nterf ace 

J   Shangha i   Uni v( Engl   Ed) ,2 01   1 ,1 5( 4) :2 97  30 3   named  cam era  i nterf aee f CAMIF1  i n  S3C6410  processor,   f or  i m age captur e and  vi deo recordi ng.  

Si mi l ar  t o  the  cam era we  wi l l   choose  a  sui tabl e  ni ght  

299   an SPI to connect  to Chi na m obi l e m ul ti m edi a br oad.  

casti ng(CM M B)m odul e,another   UART  or f   data  t rans.   mi ssi on.and spare SPI  and IIC i nterf aces  reser ved f o r 

vi si on  devi ce,connect  i t  to  the cam era i nt erf ace 8 o  that  

seri al  com m uni cati on[ <

users  can see thi ngs,capture i m age  and record vi deo 

1. 2. 5  K eypad board 

even at  ni ght.  

. 

The keypad board contai ns  keY array whi ch i s  m an-  

1. 2  B oards and com ponents 

aged by KEY I F i n S3C6410.  

1. 2. 1  P rocessor board 

key array,al though real  appl i cati ons al ways  contai n a 

Sam sung S3C6410 processor[ 4 1 doubl e data rate 

i m pl em ent ed an 8  x8 

sm al l er key array.  



f   DDR) ,s ynchronous dynami c random access  memory 

f SDRAM )  not   and ( NAND)Fl as h and a  USB 1. 1  i n—  

2  D esi gn of   sof tw are system  

t erf ace are  pl aced on the processor  board. A 6 1 ayer  

’ I’ he  w hol e  sof t w ar e  syst em   can be di vi ded  i nt o  4  l ay—  

PCB or 8 l ayer  PCB i s needed f or  the  processor  board.  

ers:the  desi gn  di agram l ayer   at  the  top,the  appl i cati on 

dependi ng on the s peed of  the processor.S3C6410 can 

l ayer,the  system  l i brari es  l ayer,and t he operati ng  sys—  

run at  553 M Hz 667 M H z  or  800  M Hz,i n whi ch  hi gher 

tem l ayer  at  the bottom ,whi l e the hardw are system 

tequency m eans l f ess  el ectrom agneti c i nterf erence and 

l i es  ri ght  bel ow  the operati ng system l ayer,as  shown  i n 

l ower  di stri buted capaci tance.、  have m ade S3C 6410 

Fi g. 2.  

run at  667 M Hz on a 6-l ayer  PCBI 。J .  

M ost  of  the  advantages of  l ayeri ng have been con・  

Sal nsung S3C6410 i s  an appl i cati on m i cro— processor  

cl uded i n s of tware  engi neeri ng,however  the m ost  si gni  ̄ 

based on ARM  1  l  76JZF— S core[ b_ . Besi des  systenl  pe—  

i cant  ones  m ust  be easi er  i ntegr at i on and veri icati f on.  

ri pheral s,connecti vi ty,m em ory subsystem ,power  m an—  

Besi des  the  avoi dance  of   ker nel   tai nt,l ayeri ng  al so  shows  

agem ent  and TFT LCD control l er  whi ch are f ound 

a  cl ear   vi ew  of  the  exi sti ng  system  l i brari es.better  orga—  

on m ost appl i cati on m i cro— processors. S3C6410 con—  

ni zati on  of   the  appl i cati ons.and  an  overal 1   user   i nterf ace 

tai ns  m ul ti m edi a accel erati ons.i ncl udi ng m ul ti — o rm at f  

desi gn di agram  f or  better user  experi ence.  

codecs.NTSC/PAL TV encoder   JPEG codecs   2一D 

2. 】 

I  jnl 】 x kerne】  

hardware   graphi c  accel erator.and  3一 D  hardw are  graphi c 

The operati ng system  l ayer  i s  com posed by the 

accel erator  wi th OpenGL ES 1. 1/2. 0. W e choose  thi s 

Li nux kernel,whi l e the devi ce  dri vers  i n the kernel  

processor  f or  better  m ul ti m edi a perf or l nance and m ore 

actual l y bel ong to the hardware system . 辨 ,choose 

f ri endl y us er  i nterf ace.  

Li nux becaus e i t  i s  open—source.easy—to—us e and easy—  

The   m ai n  m em or y  i s   bui l t  usi ng  a  1  G i b×32  bi t  DD R 

SD RAM  chi p, and the kernel,f il e system , program s,  

to— port,and there ar e m any l i brari es  and appl i cati ons   to use[ 9J

data are stored on a 2 G i b× 16 bi t  N AN D Fl ash chi p.  

Si nce Sam sung S3C6410 i s a brand new processor.  

. 

The NA ND i s  accessi bl e vi a CFI.  

m any devi ce dri vers  are  st i l 1  under devel opm ent,and 

1. 2. 2  M otherboard 

we al w ays use  the m ost  recent  versi on  of   the Li nux  ker—  

The  m otherboard consi sts  of  Ethernet  W i Fi  and 

ne1. As a resul t,our  m odi icati f ons  have to be i n the 

Bl uetooth network i nterf aces.a JTAG em ul ator  i nter—  

f orm  of  patches,so that  they Cal l  be i m m edi atel y ap-  

f ace.a U SB 2. 0 i nterf ace.a U A RT— over— R ¥232 debug 

pl i ed  once  we  turn to another  versi on  of   the kerne1 .An-  

i nt er f ac e.power   manage me nt   modul e.an  SD/MMC i n—  

other  advantage i s that the  patches can be easi l y read 

t erf ace a power  key.a reset  key.LED s.and sockets  f or 

and used by others  thus  m ore possi bl e  to be accepted 

other  boards.  

by the m ai nl i ne ker nel  

1. 2. 3  D i splay dri ver board 

Li nux 2. 6. 34.  

are currentl y worki ng on 

The  di spl ay  dri ver   board  consi sts  of   an  FP GA  chi p  as 

The bott om  l ayer of  the kernel ,and al s o the m ost  

t he  O LED  dri ver.I IC  i nterf ace  or f  O LED  di spl ay power  

i m portant  part. i s  the  devi ce dri vers.   A1 1  necessary 

cont ro1 .VGA out  connecti ng OLED  mi cro  di s pl ay,and  a spare RG B i n i nterf ace[  1 .  

dri vers  shoul d be put  i n  the  kerne1  80  that  t hey  wi l l   not  

The FPGA chi p i s  program m ed wi th scanni ng and 

som e  i nter faces f o r conveni ent acces s to the hardware,  

scal i ng al gori thm s,so that  i t  can  tal k  to  the  OLED di s—  

l i ke CAM IF f or cam era,K EY I D f or  keypad,M FC f or  

be m ess ed up wi th the appl i cati ons.Sam sung  provi ded 

pl ay.and present  i tsel f as a standard LCD i nterf ace.  

m ul ti —f o rm at  codecs.as  wel l  as  sol ne  2一D and 3一 D hard~  

Vi deo  si gnal s  wi l l   be  converted  and  scal ed  by  t he  FP GA .  

ware graphi c accel erators  f or  hi gh perf orm ance m ul ti —  

and sent  to O LED di spl ay.  

m edi a appl i cati ons. However.these newl y i ntr oduced 

1. 2. 4  E xtended peri pheral  board 

i nt erf aces  have not  been wi del v  used,w i th  a  l ack  of   doc—  

The  extended  peri pheral   board consi s ts  of  a CAM IF  t o connect  to the O V9650 cam era and ni ght  vi si on de—  

vi c e.an  AC97   and  I I S  i nt e r f ac e   or f   audi o   i nput/ out put ,  

um entati ons  as  wel 1  as  c0des.O ther   custom i zed  devi ce8   l i ke the O LED di spl a   v,the O LED m i cr o di sp1 ay,the   ni ght vi si on devi ce al so req1 l i res a l ot  of  codi ng works.  

30 0  

J   Shangha i   Uni v( Eng l   Ed) ,201 1,1 5( 4) :2 97 -3 0 3  

y  D —   H ardw are 

Fi g. 2  Sof t ware  di agram 

Recentl y  we  i m pl em ented  s om e  i m portant   i nt erf aces   and 

2. 2. 1   Qt   f or   em bedded  l i nux  w i t h  t ouch 

dri vers.  

On the t op of  the devi ce dri vers   som e kernel  r o od 

screen su pp ort 

As  one  of the  m ost wi del y used l i brar i es used i n 

ul es  exi s t to standar di ze vari ous  devi ces,so that  appl i —  

e mbe dde d envi r onment . Qt  f or  Embe dde d Li nu x[ 1 0 j  

cat i ons do not  know the  exact m ode1  bef ore they can 

contr ol  them.Here we us e Vi deo4Li nux f V4L1  f or  t he 

s hi ps  wi t h【 1   1 ] :compac t  and ef ic i e nt   wi ndowi ng  s ys —   t em ( QWS)whi c h i s  e as y  t o us e  f or  appl i c at i on  l ay er  

cam era  and the ni ght  vi si on devi ce.A LSA f or  al l  sound 

and desi gn di agram  l ayer program m i ng,vi rtual  f ram e 

events,standard f il e syst em f o r m em ory t echnol ogy de—  

bui f e r  f QVFb)whi ch  c an di r e c t l y  t al k  t o  f ra me   bufer  

vi c e  f M TD1  Fl a sh,SD/MMC and USB  s t or age,f r ame  

i n the kerne1 .advanced GU 1  whi ch provi des a prett y 

buf fer   or f   al l   di spl ay  events.and  st andard  net work  stacks 

ni ce user  i nterf ace. m ul ti m edi a f ram ework f or  audi o 

or f  al l  network com m uni cati ons.  

and vi deo  pl ayback  of   vari ous  m ul ti m edi a  o rm ats.W l f e—  

Above that  i s  the vi rtual  f il e syst em f VFS1.whi ch 

bKi t  i ntegrati on f or network  connecti vi t y,H TM L pars—  

m eans al l  m odul es bel ow that  i n the kernel  present  

i ng and JavaScri pt  i nt egrati on.2- D and 3一D graphi cs  

t hem s el ves  as devi ce f il es,s o that appl i cati ons  can us e 

wi th O penG L ES,m aki ng  good use  of   hardware  aceel —  

si m pl e f il e operati ons  l i ke open,cl ose,read,wri te and 

erati on.X M L readi ng  and  wri ti ng  support.  

i nput/ out put   c ont r ol( i oc t 1 )t o  c ont r o1   t he m.Ho weve r,  

Qt  f or  Embe dded Li nux ha s  be en c r os s — compi l ed 

recentl y  onl y  a  part   of  the  devi ces  can  be  f ul l y  contr ol l ed 

on workstati on and copi ed t o t he t arget  f il e  system ,  

by a  si ngl e devi ce f il e,and ot hers  m ay need som e  addi —  

wi t h  s ome  modi f i c at i ons   done   t o  s uppor t   2一 D/3一 D  ha r d—  

ti ona1  i nterf aces usi ng pr ocf s  or  sysf s.whi ch are part s  of  VFS.Som e even requi r es  di r ect  m em or y proces si ng.  

ware graphi c accel erators  and O penG L  ES i n  S3C6410.   Tsl i bt 12j  has  al so been ported to the target system  f or  

whi ch i s  agai ns t the Li nux desi gn phi l osophy. W e are 

t ouc h s c r e en s uppor t ,and i t  wor ks  gr e at  wi t h Qt  f or  

cur rentl y devel opi ng VFS i nterfaces  f or  the dri vers.  

Em bedded Li nux.  

2. 2  System  l i brari es 

Al 1  the appl i cat i ons  i n  the appl i cati on l ayer wi l l  us e 

A  good  ope n- s our c e   pr oj ec t   s houl d  al wa ys   ma xi mi z e  t he  r eus e  of  t he  c ode s. I n  GNU/ Li nux e nvi r onme nt.  

shown  i n Fi g. 2.so that  they wi l l  l ook  consol i dated and 

there  are  a  l arge  num ber   of   1 i brari es   f or   us  t o  use.m ostl y 

pr ett y.  

l i censed under  G PL  or  LG PL.so t hat   we do not  need  to  devel op that  t wi ce. I n thi s case,we used the f ol l ow i ng 

2. 2. 2  Text  reader  Festi val  s peech synthesi s system [ 13 J  i s  a general  

】 j brari es.  

m ul ti —l i ngual  speech synthesi s  system .and we  use i t  t o 

Qt  f or   Embedde d Li nux  t o  g ener at e  us e r   i nt e r f ac e s,a 8  

J   Sha nghai   Uni v( Eng l   Ed) ,2 011,15( 4) :297 —3 03   read the texts. However,f esti val  recentl y do not  have 

ni ng to ensure that  once one of  the three  connecti ons 

Chi nese  voi ce  packages.and we are  sti l l  worki ng on  i t.  

becom es avai l abl e,the network wi l l  be accessi bl e for 

2. 2. 3  M edi a pl ayer 

users  and al l  the appl i cati ons. W hen m ore than one 

Al t hough Qt  f or  Embedde d Li nux ha s  s uppor t  f or   m ul t i m edi a f ram ework cal l ed Phononl 1 4J i t onl y ofers   .

connecti on becom es  avai l abl e,appl i cati ons wi l l  be abl e  to choose  one or  m ore f ast  connect i ons  f or  networki ng.  

basi c   pl ayback  centrel   and  qui te  l i mi ted  m ul ti m edi a  o r— f  

Basi c  networki ng  tool ki ts  exi st  on m ost  of   the  Li nux 

mat s .I n  f ac t,Qt   f or   Embedded  Li nux us e s   GSt r e ame r  

di stri buti ons,provi di ng  networki ng  program s  l i ke  i pcon—  

as  the  backend,however  they  do  not  cooperate  very  wel l  

ig,route,pi f ng,et c. W hat % ve have to do i s  to cross—  

at  present. W e have to choos e a l i brary t o act  as  the  

com pi l e  these  program s   and  copy  them t o  the  target   il f e 

backend 80 as  f o r  bet ter  control  of   the  behavi our  of   the 

system . O ther  necessary tool s  i ncl ude: i f pl ugd whi ch 

m edi a pl ayer[ 15j

autom ati cal l y conf igure the Ethernet  devi ce once the 



Theref o re、the f ol l owi ng three sol u—  

ti ons  have been taken i nt o our  consi derati on.  

cabl e i s  pl ugged i n, wi rel ess—t ool s wi th program s  l i ke 

fi 1  GStream erl 1 6J  

i wconf ig.i wl i s t.etc. f o r W i Fi  to get  connected t o t he 

G Stream er  i s  a  f ram ewor k  whi ch  uses   m edi a—  

aCCeSS  poi nts,bl uez  provi di ng  tool s   and  system   daem ons 

handl i ng  component s   or f   a udi o/ vi de o  pl a ybac k,s t r eam—  

f or  usi ng Bl uetooth devi ces,i ptabl es  f o r com pl ex f il ter—  

i ng,processi ng,et c. It  i s al so the backend of  Phonon.   However, i t  i s  G tk— nati ve, and uses  G l i b m ai n l oop,  

i ng and redi recti on rul es.  

Som e addi ti onal   program s  m ay be wri tt en  that   peri —  

whi c h c onf li c t s   t o Qt   mai n  e vent   l oop,and  ne eds  s ome  

odi cal l y  scan  the network  connecti ons  t o  deci de  whether 

codi ng work to overcome.Besi des,GStreamer  i s rat her 

the  connecti ons  are  stabl e   and  f ast,and  dynam i cal l y  ad.  

versati l e.abl e to m eet  al m ost al l  the chal l enges i n au—  

j us t   t he   r out i ng   r ul es .  

di e/ vi de o  t as ks   as   l ong  as  t he  medi a- handl i ng  compo—  

2. 2. 5  D ata center 

nents  support  the m edi a f o rm ats  i nvol ved.  

As  t he  syst cni s  of l, el l  s tore l arge  am ounts  of   di ierent  f

( i i 1  M Pl ayer[ 17J  

data to be pr esented f or the users.i t  i s  m uch bett er  i f 

M Pl ayer   i s  a  com pl ete m ovi e  pl ayer  whi ch  i s  capabl e 

we  set   a  data  center.convert  and put  al l   the  data  i n di f -  

of  not  onl y pl a ybac k but  al s o  audi o/vi deo  pr oce s s i ng  ( us i ng MEnc ode r,t he  ot her  pr ogr am i n t he  pr oj ec t ) .  

f erent  standard f orm ats. The w hol e f il e  system woul d 

Unl i ke G Stream er.i t  uses  bi nary  codecs  i nst ead of   i nte—  

wel 1 .  

not  be m essed up,and program s can share  the data as 

grated com ponents.whi ch m eans  cl osed—source  f el rm ats  

T he data center  i s s et  at the  l ayer  of  the sys tem l i .  

provi di ng  onl y  bi nary  codecs   l i ke  Real Vi deo,Real A udi o,  

brari es,so  that   i t   can  di rectl y  access  the  il f e  system ,and 

Qui c kTi me,et c. can be  ac ce s s e d,pr oce s s e d and gen—  

provi de al l  t he appl i cati ons  the  data they need.Stan-  

e r at ed  under   MPl aye r,whi l e   c l os ed— s our ce   vi de o/audi o   i nput /out put   de vi ce s   l i ke   Di r ec t 3D.Di r ec t X  ar e   al s o  ac —  

dam   f orm ats  ar e sti pul at ed,so  that  al l  data  have  to  be 

ces si bl e.However,programm i ng  wi th  M Pl ayer  i s   a  l it tl e 

j nto the dat a cent er whi l e t here be no other m at eri al  

di f l i cul t.because M Pl ayer  i s  not  a mul ti medi a f r&me.  

the appl i cati ons   m ay  get   f rom   the m ai n  il f e  system   other 

work,but a com pl ete m ovi e pl ayer wi thout  a backend 

t han( i )t he   pr ogr ams   t hems e l ve s,( i i )t he   c onf igur a t i on 

provi di ng al m ost  no docum entati ons on pr ogram m i n g 

i nt e r f ace s.To  us e   MPl aye r   wi t hi n  Qt   pr ogr ams ,we   have  

fl i es ,( i i )downl oade d  il f es   f r om  t he  I nt er ne t,( i v)do wn—   l oaded  il f es   f r om  e xt e r nal   s t or age,and( v)da t a  f r om  t he  

to expl i ci tl y cal l  M Pl ayer  program  and m ake i t  a new 

dat a center.  

converted i nto the  standard f or m at s  bef o re t hey  can  get 

process,cont rol   the  pl ayer  and  capture  the  output  usi ng 

It  has  been sti pul ated  that  al l  vi deo data  shoul d be 

i nter— process  com m uni cati ons.whi ch decrease the per—  

recorded and converted  i nto M PEG一4 f o rm at.al l  audi o 

f orm ance,m ake codi ng and debuggi ng m uch  harder.  

data  i nto  M P3 f orm at.al l   i m age  data  i nto  JPEG  f orm at  

f i i i 1  Xi net  J  

and al l   text  data i nto X M L f orl nat.  

Xi ne i s a  m ul ti m edi a pl ayer  wi t h both f rontend and 

O ne  of   the  m os t  si gni icant  f advantages   of   thi s  i s  that  

backend.K DE— nati ve.an al ternati ve  Phonon backend 

the  program s  do  not  have  to  anal yse  the f il es  and  choose 

other  than GStream er, and can al so use the cl osed—  

one proper  decoder  or  parser. However,the part i cul ar  

source bi nary codecs. H owever.i t  i s  f ar  l ess  f lexi bl e 

data f orm ats,l i ke bi t —rate,i m age si ze,text  encodi ng,  

than GStream er.and i s  al so a bi t  l arger thus i t  i s not  

are not  sti pul at ed,so that  di ferent program s can have 

sui tabl e f or  em bedded appl i cat i on.  

di f f erent  desi re f or  vi deo audi o.i m age and t exts.  

W e are  recentl y worki ng  on  al l  three  sol uti ons   to see 

whi ch works  better i n practi ce.   2. 2. 4  N etw ork m anager 

2. 3  A ppli cati ons  Bri ef ly,the  appl i cati ons   we provi de  i ncl ude  cal endar,  

cl ock and m em o w hi ch r ead RTC i nf orm ati on,di spl ay 

Si nce  three  di ierent f  ki nds  of   network have  been  used 

the  cl ock and cal endar,and hel p to take notes;vi deo 

i n  thi s  system .i ncl udi ng  Ethernet,W i Fi  and  Bl uetooth,  

recorder   whi ch  reads   vi deo  f ronl   V 4L,audi o  f rom   ALSA ,  

som e ki nd of   network  m anager  pr ogram s  shoul d be  run—  

encode s  t hem  us i ng  me di a   pl a yer( as   de s cr i bed  above) ,  

3 02  

J  S ha ngha i   Uni v( Eng l   Ed) ,2 01   1,1 5 ( 4 ) :2 97 -3 03  

a nd s t or e s  t he m as  MPEG一 4/ JPEG/ MP3  f il es ;i nf or  

It  can be seen that  one of  Fi gs. 3,4 shows an LCD 

m at i on  and  books  whi ch  provi de  text   m ater i al s  and  can 

scr een attached to the  propos ed devel opm ent  system .  

choose  to  us e  Reader   to  read  out;bri ghtnes s  adi ustment  

W i th the propos ed devel opm ent  system ,the devel op-  

w hi ch  ad1 usts  the i l l um i nat i on of   the O LED di spl ay  or f  

m ent  procedure of  em bedded desktop envi r onm ent,vi -  

comf or ta bl e  vi e w and po wer  s a vi ng;ga mes  us i ng 2D/  

SUal  appl i cati ons  and graphi c user i nterf ace car l  be 

3D hardware graphi c accel erator;CM M B whi ch reads  vi deo i nf or m at i on f rom CM M B.and di spl ay usi ng M e—  

shorten.and  we can  use  the devel opm ent  system   to  em —  



di a  Pl ayer;brows ers,mess engers  and  other  net work  ap-  

ul ate the rea1  consumer el ect roni c devi ces  l i ke mobi l e  phones,tabl et  personal   com put ers,et c.  

pl i cati ons that  connect  to the Internet, wi th W ebKi t  

Fi gur e 4  shows  an  O LED screen  attached  to  the  pro-  

support;power   di spl ay  and m anagem ent  whi ch di spl ays  

pos ed  devel opm ent  s ys tem .W i th the  proposed  devel op—  

and  adj us t s   t he   powe r   s uppl y.  

m ent  system 、we can eval uate di t ierent  O LED screens.  

2. 4  G eneral  user engi ne 

i nv es t i ga t e   and  adj us t   t he  i l l umi nat i on,cont r a s t,col or  

As i s shown i n the  Fi g. 2  t he  appl i cati ons  and l i —  

brari es  do not  actual l y have a user  i nterf ace  however  

pal att et,etc. ,s o  as   to m ake  OLED  screens  usabl e  i n  real   const uer  el ectronj c devj ces.  

t he  general   user  engi ne does.Other  appl i cati ons  and  l i —   brari es  com m uni cate  wi th  the  general  us er  engi ne.send  i ns tructi ons  and m ake  i t  generate the desi r ed graphi cs.  

Qt  f or  Embedded  Li nux  wi l 1   r ec ei ve  al l  da t a  f r om  t he   general  user  engi ne.and pri nt   them   on al l  ki nds   of  FPD  screen s.  

W i th the general  user engi ne.a si ngl e ki nd of  user   i nterf ace appearance and behavi or  can be easi l y  o rnl f u一   1 at ed.caref ul l y desi gned and f ine  pol i shed. Purther.   m ore,t here  i s   a  desi gn  di agram   on  the  t op  of  the  general   user  engi ne,t o di vi de the user i nt erf ace  desi gn  i nto t wo 

parts: the pr ogram mers  taki ng care of  user  behavi or   and pr ogr am  real i zati on,whi l e the UI desi gners  taki ng 

car e   of   t he   appe ar ace -t he   s t yl e   s hee t s   mec ha ni s m  of   Qt   m akes  i t  possi bl e.  

Fi g. 4  OLED s creen at tached t o the  pr opos ed devel op-   m ent system  

The propos ed devel opm ent  s ystem  al so assi s ts u8  

l i ke wi ndow n] anager to organi ze  the appl i cati ons  and 

i n  bul i di ng OLED—power ed  handhel d  entert ai nment   de-   vi ces.W i t h a subset  of   the peri pher al s  of   the devel op-  

a control -panel -l i ke control  center f or the users  to see 

ment  system ,and a sof t ware system si mi l ar  to that of 

and  set  the  param eters  of  the  sys tem .  

the devel opm ent  system .an OLED — powered handhel d 

T he general  user engi ne al so provi des  a desktop—  

enter tai nm ent  devi ce acts  l i ke sm art  cel l phones,m i cro 

3  Concl usi ons 

pal m com puters  and PDAs  can be ea si l y bui l t,a s  an  i m m edi ate i m pl em entati on of   real  0LED appl i cati ons.  

Wi t h t he   pr opos e d  deve l opment   s ys t em ( s e e   Fi g. 3) ,   we  are  abl e  to test   the  FPD devi ces  i nstantl y especi al l y 

R eferences 

the OLED  scr eens  and  the  O LED m i crodi spl ay  scr eens.   FPD devi ces  can be di rectl y connected t o the system .   and used to di spl ay com pl ex 2D or  3D graphi cs,pl ay 

hi gh. def ini ti on vi deos.  

[ 1 】Lm  J, Yu   T.Qt — ba s ed   e mbe dde d  c on t r o l   s ys t e m  de s i gn   [ c] / /Co mput er   Appl i c at i on   a nd  Sys t e m  Mo de l i ng( I C.   CASM) ,2 01 0   I nt e r nat i on  Conf e r e n ce ,Ta i yua n,Chi na.   2010:561  566.  

[ 2】E2A2 J,   BI LCAT, TE CHNOP AT. He l me t   mo unt e d  di s pl a y W i ki pe di a,t he  f r e e  e nc yc l o pe di a【 EB/OL] .   f 20 08 — 06 — 21) [ 201 0 — 05 — 2 6 ] .ht t p: // e n. wi ki pe di a. o r g/ wi ki   / He l me t — — mou nt e d. . di s pl a y .   j 3  J  SMI LEYO123,  

VRGUY,  

3DTECH. Hcad. mount ed 

di s pl a y W i ki pe di a,t he  f r e e  e nc yc l o pedi a[ EB/ OL] .   ( 2 00 4— 1 0— 10 ) [ 20 11 一 O3 — 25 ] :ht t p: / /e n. wi ki pe di a. or g/ wi ki   / He a d— — mo unt e d— — di s pl a ys .  

I 4l  Sams ung  El e c t r o ni c s  I nc ,Us e r ’ s  Ma nual ,s3 C6 41 0X,   r i s c   mi c r opr oc e s s or『 Z1 .Aug.22,2 00 8,REV  1 . 1 0.   Fi g. 3  LCD  s creen attached to the  proposed devel opm ent   system  

1 5l  L1  w F,LI  X T,Luo w J,YANG J  X,xu  K Q.   A ki nd  of   m ul ti f uncti on dat a pr ocess i ng t erm i nal   used 

J   Sha nghai   Uni v( Eng l   Ed) ,2 011 ,1 5( 4) :29 7 —30 3   i n  unde r g r ound  ba s e d  o n  ARM11[ c] //201 0   I nt e r na -   t i onal   Conf er e nce   on   Mul t i me di a   Te c hnol og y( I CMT) ,   Ni ngbo.2010,  

[ 6 ]Sa ms ung  El e c t r o ni c s  I nc ,Pr oduct  Te c hni c al  Br i ef   ¥3 C6 41 0【 z] _Aug.20 07,REV  2. 0.   [ 7 J  ZHANG  H  B,LI   H,w u  D,YUAN A S,SUN  T.YI   P,   HU A C.W ANG B Q.The  des i gn and i mpl ement ati on 

of   a n  e mbe dde d  hi g h  de ini f t i on   pl ay er【 c] //Comput e r   a nd  Aut o mat i o n Engi ne e r i ng ( I CCAE) ,2 010   t he   2nd   Internat i onal  Conf er ence,Si ngapor e.2010:301  304.   Li u W  F ,D AI  Z  L.D es i gn  of   user   i nt erf ace i n  portabl e  

he a l t h moni t or i ng  s ys t e m [ c] / / Bi oi nf or ma t i c s ,and  

[ 201 1 — 03 — 1 5] .ht t p: / /qt . no ki a.c o m/ pr oduc t s / pl at f or m/   qt— f or— em be— dded— l i nux.  

[ 1 2 J  Chr i s   Lar s o n,Ke r go t h’ S   t s l i b   Gi t Hub[ EB/OLJ .( 2 01   1 —   0 3— 11 ] .ht t p: // gi t hub. c o m/ ke r g ot h/ t s l i b.   [ 1 3 ]The   Ce nt r e   f or  Spe e c h  Te c hno l og y   Re s e ar c h.The   f e s —   t i v al  s pe e c h s ynt he s i s  s ys t e m f EB/OL] .f 201 1 — 0 3 — 11 ] .   h t t p: / / www. c s t r .e d. ac . uk/ pr o j e c t s /f es t i va 1 .   a  Cor po r at i o n.Qt   4. 6:Phonon   o ve r vi e w[ EB/ OL] .   1 4 ]  Noki 【 2011 — 0 3 — 16 ] .ht t p: // doe. qt . no ki a. c or n/ 4. 6 /phono n- ov—   er.view . htm 1.  

ied approach f f or  next   【 l 5 】  SAKTHIVEL C,KESAVAN S.Uni gener ati on mul t i medi a ba s ed comm uni cati on com po-  

Bi om edi cal  Engi neeri ng, ICB BE 2009,the 3rd I nter —  

nent s  i nt egrati on wi t h si gnal i ng and m edi a pr ocessi ng 

nati onal  Conf erence,Bei j i ng,Chi na.2009:1-3.  

rame f wo r k[ C] / /I nt e r nat i o na l   Conf e r e nc ea l   Si gna l   Ac —   qui si ti on  and  Process i ng,Bangal or e,Indi a.2010:177一 

[ 9 】ZHANG D Y. PDA de s i g n ba se d  on e mbe dde d   l i nux 【 c] // Comput e r — Ai de d I ndus t r i al  De s i g n and   Conc e pt ua l   De s i gn( CAI DCD) ,201 0   I EEE l l t h   I n t e r —   nati onal  Conf er ence,Yi wu,Chi na.2010:1299 1302.  

】8].  

I 1 6 ]The  Gs t r ea me r  Te a m.Gs t r e a me r :Ope n s our c e  mul -   t i medi a f ra me wor k [ EB/OL] .[ 2 01   1 — 03 — 03 ] .ht t p: //   gstream er. org.  

 K.The   r e s e a r c h  of   Qt / Embe dde d  and   【 10 ]  gANG L,YUE em bedded Li nux appl i cati on i n the i ntel l i gent  nl oni —  

t o r i ng   s ys t em  c o nt r ol【 c] //Adv anc e d   Comput e r   Co n—   t r ol ( i cacc) ,2 01 0 2nd  I nt er nat i ona l  Conf e r enc e ,   Shenyang,Chi na.2010:83 86.  

a Cor porat i on. Embedded Li nux— Qt— A cros s—   【 1 1 】  Noki pl at f or m appl i c at i o n and  UI  f r a me wor k [ EB/OL] .  

【 1 7 ]The  MPl a ye r  Te a m  M P layer  the  m ovie  player  t p: / /www. mpl a ye r hq. hu/de -   [ EB/ OL] _[ 2 01 1 — 03 — 1 6 】  ht s i g nT /i nf o.ht m1 .  

The   Xi ne   Pr o j e c t .The   xi ne   pr oj e c t -Home[ EB/OL】   [ 2 01   1 — 03 — 0 61 .ht t p: // www. xi ne — pr o j e c t . o r g/ home.   ( Edi t o r   CHEN  Hai - qi ng)  

Suggest Documents