Web browser of wireless device having serialization manager for ...

USO0RE43678E

(19) United States (12) Reissued Patent

(10) Patent Number: US RE43,678 E (45) Date of Reissued Patent: *Sep. 18, 2012

Major et a]. (54)

WEB BROWSER OF WIRELESS DEVICE

(56)

HAVING SERIALIZATION MANAGER FOR MAINTAINING REGISTRY OF CONVERTERS THAT CONVERT DATA INTO FORMAT COMPATIBLE WITH USER INTERFACE OF THE DEVICE

References Cited U.S. PATENT DOCUMENTS 4,837,798 A

(75) Inventors: Harry R. Maj or, Waterloo (CA); Michael Knowles, Waterloo (CA)

6/1989 Cohen et al.

5,675,507 A

10/1997 Bobo, II

5,829,022 A *

10/1998

5,978,833 A 6,029,175 A 6,105,028 A

11/1999 Pashley et a1. 2/2000 Chow et al. 8/2000 Sullivan et al.

6,631,512 B1

10/2003 Onyeabor

(73) Assignee: Research In Motion Limited, Waterloo, Ontario (CA)

Watanabe et al. ........... .. 711/118

(Continued) FOREIGN PATENT DOCUMENTS

(*)

Notice:

This patent is subject to a terminal dis claimer.

CA

2432590

(Continued)

(21) Appl. No.: 13/246,896 (22) Filed:

OTHER PUBLICATIONS

Sep. 28, 2011

“Multi-Modal Data Access”, Research Disclosure, Kenneth Mason

Publications, Hampshire, GB, No. 426, Oct. 1999, pp. 1393-1396.

Related US. Patent Documents

Reissue of:

(64)

Patent No.: Issued:

Appl. No.: Filed:

(Continued)

7,596,631 Sep. 29, 2009 12/060,621 Apr. 1,2008

Primary Examiner * Le H Luu

(74) Attorney, Agent, LLP/S.E.N.C.R.L., s.r.l.

U.S. Applications: (63)

Continuation of application No. 10/451,715, ?led as application No. PCT/CA01/01857 on Dec. 21, 2001,

(57)

(51)

Parr

ABSTRACT

of information requests to remote information sources and

Provisional application No. 60/257,428, ?led on Dec. 22, 2000.

Int. Cl. G06F 15/16

Firm *Bereskin &

An information broWser system and method enables sending

noW Pat. No. 7,389,361.

(60)

8/2010

receiving of requested information from the remote sources on a Wireless communication device. Information in any of a

plurality of formats, including WML, HTML and WML Script, is converted into a format in Which the information can

(2006.01)

(52)

US. Cl. ...................................... .. 709/246; 709/216

(58)

Field of Classi?cation Search ................ .. 709/246,

be displayed or otherwise further processed by the device. Information browsing functions may also be integrated With other communication functions on a mobile communication

709/216, 219; 715/760; 711/118; 345/581,

device.

345/700

See application ?le for complete search history.

22 Claims, 15 Drawing Sheets

Page

Cache 114;——‘———l l

Renderer Control

WML

HTML

Page 111248

Page \k124b

l WMLScript

Page \ k124c

l

Format X

Page \ ‘\124d

WML

HTML

WMLScript

FormatX

Renderer

Renderer

Renderer

Renderer

2033 /

20gb J 4‘

2086 J

A

‘I \ 208d

\- 202

WML Converter

Serialization

Manager 1 204

200-/

206a

HTML Converter

20Gb )f

WMLScript Convener

2066 ) T

FormatX Converter

T \ 206d

US RE43,678 E Page 2 Bickmore T. W. et al., “Digestor: Device-independent access to the

US. PATENT DOCUMENTS 6,901,437 B1* 7,050,079 B1*

7,389,361 7,596,631 7,761,603 RE41,786 2002/0015042 2002/0049833 2002/0109706

B2 B2 B2 E A1* A1* A1*

2004/0165007 A1

2010/0281391 A1

5/2005 5/2006

Li ............................... .. 709/219 Estrada et al. .............. .. 715/760

6/2008 9/2009 7/2010 9/2010

Major et al. Major et al. Major et al. Major et al.

2/2002

Robotham et al. .......... .. 345/581

4/2002

Kikinis

........ ..

8/2002 Lincke et al.

7552(97)00026-3, vol. 29, No. 8-13, Sep. 1, 1997, pp. 1075-1082, XP004095305.

“User Manual of the Nokia 9000i Communicator passage EN”, Users

. 709/219

. 345/700

8/2004 Shafron

11/2010 Majoretal.

FOREIGN PATENT DOCUMENTS EP EP EP EP EP EP EP EP GB GB GB GB HK WO

0 911728 0911728 0 987 868 0987868 1638020 1643381 2267619 1428348 2332126 2 332 126 2340001 2340001 1065199 97/35402

A1 A2

A

World Wide Web”, Computer Networks and ISDN Systems, North Holland Publishing. Amsterdam, NL LNKD-DOI: 10.1016/S0169

4/1999 4/1999 3/2000 3/2000 3/2006 4/2006 12/2010 1/2011 6/1999 9/1999 2/2000 9/2000 10/2004 9/1997

Manual of the Nokia 9000i Communicator, Nokia, FI, Jul. 7, 1998, page Complete, XP002409380. DeLespinasse, Alan F., “Rover Mosaic: E-mail Communication for a Full-Function Web Browser”, citeseer copy of Thesis submitted to MIT, Jun. 1995. XP002607844. Retrieved from the Internet [Nov. 1,

2010]:

http://citeseerx.ist.psu.edu/viewdoc/summary?doi:10.1.1.

5 1.9761 .

Bartlett J. F. EdiInstitute of Electrical and Electronics Engineers: “Experience with a Wireless World Wide Web Client”, Digest of

papers of the Computer Society Computer Conference (Spring) Compcon. Technologies for the Information Superhighway. San Francisco, Mar. 5-9, 1995.Vol. Conf. 40, Mar. 5, 1995, pp. 154-157, XP000545425.

SZyperski C:

“Component Software”

1998, ACM Press,

XP002607845, pp. 3-13, 84-87. ISBN: 0-201-17888-5.

Noting of Loss Of Rights (R69 (1) EPC). European Application No.

OTHER PUBLICATIONS

050778034. Dated: Aug. 14, 2008. Communication Pursuant to Article 96(2) EPC. European Applica tion No. 050778026. Dated: Apr. 28, 2006. Communication under Rule 112 EPC. European Application No. 019955277 Dated: Jul. 2,2004. Communication pursuant to Article 96(2) EPC. European Applica

Freytag, et al.: “Resource Adaptive WWW Access for Mobile Appli

tion No. 019955277 Dated: Dec. 22, 2004. Summons to attend oral proceedings pursuant to Rule 71(1) EPC.

cations”, Computers and Graphics, Pergamon Press Ltd., Oxford,

European Application No. 019955277 Dated: Sep. 15, 2005. Brief Communication. European Application No. 019955277

A

GB, vol. 23, No. 6, Dec. 1999, pp. 841-848. Schilit, et al.: “TeleWeb: Loosely Connected Access to the World Wide Web”, Computer Networks and ISDN Systems, North Holland

Publishing, Amsterdam, NL, vol. 28, No. 11, May 1996, pp. 1431 1444.

“Archiving Agent for the World Wide Web”, IBM Technical Disclo sure Bulletin, IBM Corp., New York, United States, vol. 40, No. 6, Jun. 1997, pp. 33-34. European Patent Communciation re: European Patent Application No.01 995 527.7, dated Jan. 19,2006.

Hoff L.: “Netscape Plug-Ins”, On-line Publication, Sep. 1, 1999 URL: http://www.linusjournal.com/article/3088. Bjork S. et al.: “WEST: AWeb Browser for Small Terminals”, Pro ceedings of the Symposium on User Interface Software and Technol

ogy UIST, Nov. 1999, Asheville, USA. European Search Report, Application No. 050778034, dated Dec. 27, 2006. Ball, Steve, “SurfIt! A WWW Browser” Proceedings of the Usenix Fourth Annual TCL/TK Workshop, Jul. 1996 (Jul. 1996), Monterey, USA, Retrieved from the Internet: http//www.usenix.org/publica tions/library/proceedings/tcl96/fullipapers/ball/> [retrieved on Apr.

4, 2008]. Koppen, Eckhart et al., “CineastiAn Extensible Web Browser” Proceedings of the Webnet World Conference on WWW, Internet and

Intranet, Nov. 1997 (Nov. 1997), Toronto, Canada, Retrieved from the Internet: http://nm.wu-wien.ac.at/nm/pages/en/re search> [retrieved on Apr. 4, 2008]. European Examination Report. Application No. 05077803 .4, Dated: Apr. 8, 2008.

Dated: Dec. 6, 2005.

Summons to oral proceedings pursuant to Rule 115(1) EPC. Euro pean Application No. 019955277 Dated: Nov. 2, 2009. Communication of the Technical Board of Appeal 3.5.05 of Feb. 2,

2010. European Application No. 019955277 Dated: Apr. 21, 2010. Communication Under Rule 71(3) EPC. European Application No. 019955277 Dated: Jun. 23, 2010. Notice of Allowance. Canadian Application No. 2,432,590. Dated: Jan. 5, 2010. BJ Thomas: “The World Wide Web for Scientists & Engineers”, Glossary p. 337, SPIE Press, 1998, ISBN 0-8194-2775-6.

European Search Report. European Application No. 050778026. Dated: Apr. 11, 2006. European Partial Search Report. European Application No. 050778026. Dated: Feb. 3, 2006.

European Partial Search Report. European Application No. 050778034. Dated: Feb. 15, 2006. Canadian Of?ce Action Application No. 2,432,590. Dated: Mar. 24, 2005.

Canadian Of?ce Action Application No. 2,432,590. Dated: Nov. 2, 2005.

Summons to attend Oral Proceedings Pursuant to Rule 115(1). Euro pean Application No. 05077803 .4. Dated: Nov. 18, 2010.

Brosius, Felix, “WMLiWAP-Anwendungen programmieren”, Addison-Wesley 2000. Graham, Ian S., “XHTML 1.0 Web Development Sourcebook: Build

ing Better Sites and Applications”, Wiley Computer Publishing 2000. Hougland, Damon et al., “Essential WAP for Web Professionals”, Prentice Hall PTR 2001.

Canadian Of?ce Action Application No. 2,432,590. Dated: Oct. 14,

Hubbell, Arlyn, “Understanding Web Development”, Prentice Hall

2008.

PTR 2000.

Co-pending U.S. Appl. No. 12/ 838,721, “Information Browser Sys

Krutwig, Michael et al., “WML und WMLScript”, dpunkt.verlag

tem and Method for aWireless Communication Device”, ?led Jul. 19,

2001.

2010.

Response. European Application No. 019955277 Dated: Jun. 16,

Decision to refuse a European Patent application. European Appli

2005.

cation No. 05077803 .4. Dated: Mar. 29, 2011.

Response. European Application No. 019955277 Dated: Jul. 14,

Of?ce Action U.S. Appl. No. 12/838,721, Dated: Sep. 28, 2011.

2004.

Extended European Search Report (EESR). European Application

Response. European Application No. 019955277 Dated: Dec. 31,

No. 101812287, Dated: Nov. 18, 2010. Communication Pursuant to 94(3) EPC. European Application No.

Response. European Application No. 019955277 Dated: Nov. 16,

101812287, Dated: Sep. 12,2011.

2005.

2009.

US RE43,678 E Page 3 Decision to refuse a European patent application. European Appli

Response. European Application No. 101812287. Dated: Jan. 13,

cation No. 019955277 Dated: Jan. 19,2006. Minutes of the public oral proceedings before the Technical Board of

2012.

Appeal 3.5.05. EuropeanApplication No. 019955277 Dated: Feb. 2, 2010.

Decision to grant a European patent pursuant to Article 97(1) EPC. European Application No. 019955277 Dated: Dec. 30, 2010. Written Opinion and International Search Report. PCT/CA01/ 01857. Dated: Sep. 24, 2003.

Extended European Search Report. European Application No. 050778034. Dated: May 9, 2006. Decision on further processing under Article 121(3) EPC. European Application No. 05077803 .4. Dated: Nov. 8, 2007. Provision of a copy of the minutes in accordance with Rule 124(4)

EPC. European Application No. 05077803 .4. Dated: Mar. 29, 2011.

Response. European Application No. 05077803 .4. Dated: Sep. 19, 2008.

Written Submissions. European Application No. 05077 803 .4. Dated: Feb. 15, 2011.

Letter regarding Written Submissions. European Application No. 050778034. Dated: Feb. 17, 2011.

Acknowledgement of withdrawal of the European patent application. European Application No. 050778026. Dated: Sep. 25, 2006. Response. European Application No. 101812287. Dated: Jun. 29, 201 1.

European Patent Communication re: European Patent Application No.01995 527.7, dated Jan. 19, 2006.

Hoff L.: “Netscape Plug-Ins”, On-line Publication, Sep. 1, 1999, URL: http://www.linusjournal.com/article/3088. Ball, Steve, “Sur?t! A WWW Browser” Proceedings of the Usenix

Fourth Annual TCL/TK Workshop, Jul. 1996, Monterey, USA, Retrieved from the Internet: http:www.usenix.org/publications/li

brary/proceedings/tcl96/fullipapers/ball/> [retrieved on Apr. 4,

2008]. Koppen, Eckhart et al., “CineastiAn Extensible Web Browser” Proceedings of the Webnet World Conference on WWW, Internet and

Intranet, Nov. 1997, Toronto, Canada, Retrieved from the Internet: http://nm.wu-wein.ac.at/nm/pages/en/re search> [retrieved on Apr.

4, 2008]. European Examination Report Application No. 050778034. Dated: Apr. 8, 2008. Co-pending Reissue of US. Patent No. 7,389,361. US. Appl. No. 12/361,161, “A Web Browser of Wireless Device IIaving Serializa tion Manager for Maintaining Registry of Converters that Convert Data into Format Compatible with User Interface of the Device”, ?led Jan. 28, 2009.

* cited by examiner

US. Patent

Sep. 18, 2012

Sheet 1 0f 15

US RE43,678 E

Dispatch \ Thread

102

100

Browser -\

Application 104 +

q

‘——> History \ 110

Secondary Fetch

4-

ThreadL 123

Bookmarks

Daemon

112

Browser

Browser

(Fig. 2)

Receiver H

Thread

113

\ 108

Render

(-

-

Thread B0

106 L Page {- Cache

y

114

Page (Flg. 4) \

$

Raw Data

Renderer

Cache

agate; 19.

126

__>

_

124

122

FIG. 1

US. Patent

Sep. 18, 2012

US RE43,67 8 E

Sheet 2 0f 15

176 _-+

Browser

Queue Process Converter Thread

Browser Daemon

(Fig. 1)

Request

\174

106

Primary —-->

Fetch Thread

108

1 Raw Data Cache l

(

126

Staok Manager 160

1701' WAP

HTTP Stack

Adapter

Adapter

1 WAP

r HTTP/

162 Stack

lPPP Stack

r Stack ‘166

150

Cookie Cache

FIG. 2

US. Patent

Sep. 18, 2012

Sheet 4 0f 15

US RE43,678 E

240 —\~ Page

\‘

¢

124

I

I

I

I

WML

HTML

WMLScript

Format X

Page \124a

Page \124b

Page \-'124c Renderer

Page \- 124d

‘“\ 208

I

I

I

WML

HTML

WMLScript

Format X

Renderer

Renderer

Renderer

Renderer

L 208a

K 2081:

L

\- zoac

K 208d

Converter 206

I WML Converter \- 206a

I

I

HTML Converter ‘- 206b

FIG. 4

WM LScrIpt Converter k 2066

I Format X Converter k 206d

US. Patent

Sep. 18, 2012

Sheet 6 0f 15

Radio

""'

US RE43,678 E

‘334

362

336 WAP

360

Gateway _\ 338

364

WML

/ HTML

Filter L 342

344 Finer ~+ HTTP \— 346

350 Sewer

\ 352a

L 340

‘ Server

\ 352b

FIG. 6

US. Patent

Sep. 18, 2012

US RE43,67 8 E

Sheet 7 0f 15

Request home page 404

402

r~ 400

Get page from cache N

Convert and render page

i

(Fig. 9)

Generate Error F_' 42

;

0

Page

‘

410

1

2

Request for information 0 r content?

Display 432

page

2° fetch

operations Y

Y

1

Create

,

Background

Retrieve Convert and

kac e

deiiver to

Th1’Bad

431 J

444

Perform

V‘

loczlal

424

Browser

function

User input

T440

(to step 422)

lndicate —>

422

2D Fetch LN

gent:

N

remain?

J

426

428

failure to

\

Browser

442

\ 448

Y

FIG. 7

US. Patent

Sep. 18, 2012

Sheet 8 0f 15

US RE43,67 8 E

500

Display

K "in progress" 504

indication

Identify type

FWAP

of request ‘

\

Send WAP request over wireless link to

HTTP-1 K Send HTTP request

506

512 over wireless link to IP proxy server

508

WAP gateway

I

it r" Receive network 514 response from IP

Receive network response from \ WAP gateway 510

proxy server

Add requested URL/identi?er to

history list

Network Return

FIG. 8

“516

518

US. Patent

Sep. 18, 2012

Sheet 9 0f 15

Store received

600

Uetermlne \

content to raw

data cache

US RE43,678 E

>

content

‘\

606

tvne

602

Suitable non-resident onverter/renderer i

618

registry?

L F 622

v

610

convsfélrt'lrziltderer

Invoke;

renderer

from network "

612

Register and

I

\

Render

lnslall converter!

content to

renqerer

generate page

630

v

614

Add page to page cache 4 r

w

! RETURN I Request

Y

successful?

C- 620 N

{

I

.

ndlcale

: converterlrenderer

unavailable

FIG. 9

616

US. Patent

Sep. 18, 2012

Sheet 10 0f 15

US RE43,678 E

wo1Kk. OE

Em_ w62 20;

02K

EK

5:8.2826$3508

26:3

won

25“$265

wcozmha

96m9

320

wow wowh

US. Patent

Sep. 18, 2012

Email

Sheet 11 0f 15

Voicemail

Application

US RE43,678 E

SMS

Application \

Application

816 ‘____

K820

‘r

it

‘i

Message Store

4

\

Request r. Q ueue

Browser Folder

Browser

‘

176

"\

Browser

812

Daemon

Process

Converter

k

Page

(- Thread

Model

174

Primary 4

f

K106

_

Fetch

;

K‘ Th read

/"

172

108

l

/-

Raw Data

1 26

Cache

l r.

160 r

156

Cookie Cache

Stack Manager v

it

WAP

HTTP

\

Stack

Stack

168

Adapter

Adapter

‘7

‘Y

K 170

800

FT WAP 162 Stack

FIG. 11

HTTP! \ IPPP Stack

164

US. Patent

Sep. 18, 2012

Sheet 13 0f 15

US RE43,678 E

Messages /...__ 954

Tue, Oct 17, 2000 ** 2:43p John Doe Re: Meeti.. -- 12:44p Web Page Title Number 2 -- 10:1521 Web Page Title Number I

K ** 9:44a Mark Samuel

FIG. 13

Meeting T...

US. Patent

Sep. 18, 2012

Sheet 14 0f 15

US RE43,678 E

f 980 954

Messages 1"‘

Hide Menu

Tue , Oct 17

Open Page

\— 21439 John Doe

Reload Page

-- 12:44p Web Pa

Mark Unread

r-—“:-_10:15a Web P89 H I 9.44a Mark 5?"

Save Page

952

Delete Page

Compose Mes... Search Mess.

Options Close

FIG. 14

US. Patent

Sep. 18, 2012

Sheet 15 0f 15

K” Page Title

Hide Menu

Content here:

System Actions

1

Enter URL

News

2 Sports .

.

3 Flnanclal 4 Weather 5 (3001 Links

6 Go To Web

Back

Forward R l d 6 °a

Bookmarks

Add Bookmark Save to MsgList Save to Folder

Page Actions Close

FIG. 15

US RE43,678 E

1000

_

1002

US RE43,678 E 1

2

WEB BROWSER OF WIRELESS DEVICE HAVING SERIALIZATION MANAGER FOR MAINTAINING REGISTRY OF CONVERTERS THAT CONVERT DATA INTO FORMAT COMPATIBLE WITH USER INTERFACE OF THE DEVICE

the Global System for Mobile Communications (GSM), will operate in the 20 kbps to 110 kbps range. As will be apparent to those skilled in the art, this range relates to raw speed. Real

speed is lower when retransmissions of corrupted packets and network congestion are accounted for. So-called third gen eration networks, such as Universal Mobile Telecommunica

tions System (UMTS), are expected to operate in the 384 kbps range or higher, but are not expected to be deployed for at least several years.

Matter enclosed in heavy brackets [ ] appears in the original patent but forms no part of this reissue speci?ca

Most mobile devices also currently have much lower screen resolution and processing power than typical PCs or

tion; matter printed in italics indicates the additions made by reissue.

laptops. For example, known mobile devices tend to have screen resolution on the order of 160>