Apple Inc. v. Samsung Electronics Co. Ltd. et al

Filing 462

Declaration of DEOK KEUN Matthew Ahn IN SUPPORT OF #461 APPLES OPENING CLAIM CONSTRUCTION BRIEF PURSUANT TO PATENT L.R. 4-5 filed by Apple Inc.(a California corporation). (Attachments: #1 Exhibit A, #2 Exhibit B Part 1, #3 Exhibit B Part 2, #4 Exhibit C Part 1, #5 Exhibit C Part 2, #6 Exhibit D Part 1, #7 Exhibit D Part 2, #8 Exhibit D Part 3, #9 Exhibit D Part 4, #10 Exhibit E Part 1, #11 Exhibit E Part 2, #12 Exhibit F, #13 Exhibit G, #14 Exhibit H, #15 Exhibit I, #16 Exhibit J, #17 Exhibit K, #18 Exhibit L, #19 Exhibit M Part 1, #20 Exhibit M Part 2, #21 Exhibit N, #22 Exhibit O, #23 Exhibit P, #24 Exhibit Q)(Jacobs, Michael) (Filed on 12/8/2011) Modified on 12/9/2011 linking entry to document #461 (dhm, COURT STAFF).

Exhibit B

ALL T( WIIt)3I TIIE%E rausSENTS NHALL CO3IE:

om a eD STATES DEPAR · -- NT OF COMMERCE
United States Patent and Trademark Office

April 26, 2011
THIS IS TO CERTIFY THAT ANNEXED HERETO IS A TRUE COPY FROM
THE RECORDS OF THIS OFFICE OF:

U.S.PAxem: 7,469,381
ISSUE DATE: December 23 2008

By Authority of the
Under Secretary of Commerce for In
tual Property
and Director of the United S ates atent ud Trademark Office

P. S A
Certifying Officer

APLNDC00022467

IIIIIIIIIIIIIIIIIIIIIllllllllllllllllllllllllllllllllllllll!
US007469381B2

(12) United States Patent

(10) Patent No.:

Ording

(54) LIST SCROLLING AND DOCUMENT

12/2002 Wong et al. ................. 345/173

6,567,102 B2

5/2003 Kung ......................... 345/660

Bas Ording, San F--i.w, CA (US)
(Continued)

(73) Assignee: Apple Inc., Cupertino, CA (US)
( * ) Notice:

Dec. 23, 2008

6,489,951 B1

ON A TOUCH-SCREEN DISPLAYROTATION
..«-SLATION, SCALING, AND
(75) Inventor:

US 7,469,381 B2

(45) Date of Patent:

Subject to any disclaimer, the term ofthis
patent is extended or adjusted under 35
U.S.C. 154(b) by 0 days.

*-GN PATENT••- •·--•S
EP

0 635 779 Al

1/1995

(21) Appl. No.: 11/956,969
(22) Filed:
(65)

(Continued)

Dec.14, 2007

-- PUBLICATIONS

Prior Publication Data
US 2008/0168404 Al
Jul. 10, 2008

Microsoft Word 2003 Screen Shots.*

Related U.S. Application Data
(60) Provisional application No. 60/937,993, filed on Jun.
29, 2007, provisional application No. 60/946,971,
filed on Jun. 28, 2007, provisional application No.
60/945,858, filed on Jun. 22, 2007, provisional application No. 60/879,469, filed on Jan. 8, 2007, provisional application No. 60/883,801, filed on Jan. 7,
2007, provisional application No. 60/879,253, filed on
Jan. 7, 2007.

(51) Int. CI.
GO6F 3/01
(52) U.S. Cl.

(2006.01)
..... 715/702; 715/764; 715/863;
715/864; 715/769
(58) Field of Classification Search ................. 715/764,
715/769, 702, 863, 864
See application file for complete search history.
(56)

References Cited

U.S.Fa·-· DOCUMENTS
5,495,566
5,844,547
5,867,158
6,034,688

A
A
A
A

2/ 996
12/ 998
2/ 999
3/2000

Kwatinetz ...................
Minakuchi et al. ..........
Murasaki et al. ............
Greenwood et al. .........

395/157
345/173
345/341
345/353

(Continued)
Primary Examiner----Boris Pesin
(74) Attorney, Agent, or Firm-Morgan, Lewis & Bockius

LLP
(57)

ABS - - T

In accordance with some embodiments, a computer-implemented method for use in conjunction with a device with a
touch screen display is disclosed. In the method, a movement
ofan object on ornearthe touch screen display is detected. In
response to detecting the movement, an electronic document
displayed on the touch screen display is translated in a first
direction. If an edge of the electronic do---t is reached
while translatingthe electronic document in the first direction
while the object is still detected on or near the touch screen
display, an area beyondtheedge ofthe document is displayed.
After the object is no longer detected on or near the touch
screen display, the document is translated in a second direction until the area beyond the edge of the document is no
longer displayed.
20 Claims, 38 Drawing Sheets

APLNDC00022468

••• "< e-

• - ONS

US 7,469,381 B2
Page 2

U.S. Pmrusi l = =
6,661,409
6,690,387
6,707,449
6,809,724
6,907,575
6,912,462
6,972,776
6,975,306
7,009,599
7,046,230

B2
B2 *
B2
B1
B2
B2
B2
B2
B2
B2

7,075,512 B1
7, 02,626 B2

7, 54,534
7, 55,048
7, 81,373
7, 84,796
7,240,291
2003/0095135
2003/0095697
2003/0184525
2004/0021676
2004/0027398
2004/0080541
2004/0155888

x

Demartines et al. .........
Zimmerman et al. ........
Hinckley et al. ............
Shiraishi et al.
Duarte
...
Ogaki .........
Davis et al. .................
Hinckley et al. ............
Pihlaja ...
Zadesky et al. .............

345/173
345/684
345/173
345/169
715/784
701/208
345/684
345/ 73
345/ 73
345/ 56

7/2006 Fabre et al. ................. 345/ 56
9/2006 Denny, III ................... 345/ 79

B2 12/2006 Seki et al. .
348/207.1
B2 12/2006 Ohara
382/132
B2
2/2007 Le Cocq et al. ..
703/1
B2
2/2007 Karidis et al
455/566
B2
7/2007 Card et al.
... 715/776
A
5/2003 Kaasila et al. .............. 345/613
A
5/2003 Wood et al. ................. 382/131
A
10/2003 Tsai ..........
345/173
A
2/2004 Chen et al. .................. 345/684
A * 2/2004 Jaeger -... 345/863
A
4/2004 Saiga et al. ................. a<mn<
Al
8/2004 Padgitt et al. ............... 345/619

2004/0263486 A
2005/0012723
2005/0145807
2005/0168488
2005/0198588
2005/0237308
2005/0270269
2005/0275618

12/2003
2/2004
3/2004
10/2004
6/2005
6/2005
12/2005
12/2005
3/2006
5/2006

ni

A
A
A
A
A
A
A

2006/0025218 A

2006/0026521 A
2006/0048073 A
2006/0055669 A

12/2004 Seni ........................... 345/173
1/2005
7/2005
8/2005
9/2005
10/2005
12/2005
12/2005

Pallakoff ....................
Lapstun et al
...
Montague ...................
Lin et al. ....................
Autio et al. ..
Tokkonen ...................
Juh et al.

345/173
250/566
345/659
715/784
345/173
345/156
345/156

2/2006 Hotta .......................... 463/37

2/2006 Hotelling et al. ............ 715/702
3/2006 Jarrett et al. ................ 715/784
3/2006 Das
....... 345/156

2006/0181510
2006/0187215
2006/0197753
2006/0238495
2007/0008066
2007/0024646
2007/0046646
2007/0067745
2007/0 09275
2007/0 20835
2007/0 50826
2007/0 50842
2007/0 52978
2007/0 52979
2007/0 55434
2007/0 56364
2003/0 04544

A
8/2006 Faith ...........
345/ 58
A
8/2006 Rosenberg et al. .......... 345/ 73
A
9/2006 Hotelling .................... 345/ 73
A
10/2006 Davis ......................... 345/ 56
A
1/2007 Fukuda
....... 340/5.52
A
2/2007 Saarinen et al. ............. 345/660
A1
3/2007 Kwon et al.
345/173
AI
3/2007 Choi et al.
715/863
Al
5/2007 Chuang ...................... 345/173
Al
5/2007 Sato ..............
345/173
A1
6/2007 Anzures et al.
715/772
Al
6/2007 Chaudhri et al. ............ 715/863
Al
7/2007 Kocienda et al. ............ 345/ 73
A1
7/2007 Jobs et al.
.. 345/ 73
Al
7/2007 Jobs et al. ................... 455/ 65
A1
7/2007 Rothkopf ......
702/ 17
Al * 5/2008 Collins et al. ............... 715/846

FO*<~•= P= · - DOCUMENTS
EP
EP
WO
WO
WO
WO
WO

0 701 220
0 880 091
WO 02/01338
WO 03/060622
WO 2005/052773
WO 2006/003591
WO 2006/020305

A
A2
A1
A2
A2
A
A2

3/1996
11/1998
1/2002
7/2003
6/2005
1/2006
2/2006

Photo Mesa 3.1.2 2006 Screen Shots.*
International Search Report and Written Opinion for International
Application No. PCT/US2008/050292, mailed Sep. 19, 2008.
IBM, "Scroll Control Box," IBM Technical Disclosure Bulletin, vol.

38, No. 04, Apr. 1993, pp. 399-403.
Tidwell et al., "Magnetism," Designing Interfaces, Nov. 2005, Section 85.
Invitation to Pay Additional Fees for International Application No.

2006/0077544 A
2006/0082549 A

4/2006 Hoshino et al.
Stark .......................... 359/448
4/2006
345/157

2006/0094502 A
2006/0156249 Al

5/2006 Katayarna et al. ............. 463/31
7/2006 Blythe et al. ................ 715/781

PCT/US2008/050292,mailed Jul. 18, 2008.
Miller, D., "Persona1Java Application Environment," Sun
Microsystems,
http://java.sun.corn/products/personaljavaltouchable/, Jun. 8, 1999, 13 pages.

* cited by

2006/0061551 A

3/2006 Fateh ......................... 345/158

CODV DiGVided bv USPTO from the PIRS Imaae Database on 04/25/2011

APLNDC00022469

U.S. Pateilt

Dec. 23, 2008

Sheet 1 of 38

Memory

Portable Multifunction Device

Operating System
Communication Module
Contact/Motion Module
Graphics Module
Text Input Module
GPS Module
Applications
Contacts Module
Telephone Module
Video Conference Module
E-mail Client Module
Instant Messaging Module
Blogging Module
Camera Module
Image Management Module
Video Player Module
Music Player Module
Browsing Module
104
122

US 7,469,381 B2

126 Applications (continued)
128
Calendar Module
130
IWidget Modules
132
'Weather Widget
134
Stocks Widget
135
Calculator Widget
136
.Alarm Clock Widget
137
Dictionary Widget
138
139
140
141
142
143

149
149-1

149-2
149-3
149-4
149-5

149-6
i - User-Created Widget(s)
-d
150
Widget Creator Module
/
i
i
151
Search Module
i
:
•

144
145
146
147

peggy
System ,y 162
/ External \;124
Port
RF Circuitry y 108

-

Controller

103
110

%103
120

-

Peripherals
Interface

103
106

Display

Controller
156 - |

IIO Subsystem
Optical
sensor(s)

Controller

103
Touch-Sensitive

112 A Display System

103

111

Audio
103

Processor(s)

Speaker

103
Circuitry
/ Proximity
Sensor

Microphone

113
166

158
Other Input

\

160

Controller(s) /
103

Optical

Other Input

1§§

Devices

Sensor(s)

Control

116

Figure 1

APLNDC00022470

U.S. Patent

20§

Dec. 23, 2008

Sheet 2 of 38

US 7,469,381 B2

Portable Multifunction Device
100
Speaker 111'

"

Optical

'

Sensor 164

" Proximity '

Sensor 1û

Touch Screen 112

Microphone

Home

Figure 2

sidad hu IIRDTr% fram tha DIDO imana -

-- naterrenze

APLNDC00022471

U.S. Patent

Dec. 23, 2008

Sheet 3 of 38

US 7,469,381 B2

Portable Multifunction Device
100

2D§

Speaker 111
300

Optical
Sensor 1§&

Proximity
Sensor 10.0.

Current Time - aos
310 - Day and Date- a12

Wallpaper image

1L4.

-+
302

Slide to unlock
306

Touch Screen 112

Microphone ' / Home

Figure 3

APLNDC00022472

+ -x÷

U.S. Patent

(, ,:

Dec. 23, 2008

ABC

Sheet 4 of 38

US 7,469,381 B2

Portable Multifunction Device

200.

100

Optical

400

Created

Speaker i

02

Text
141

'

Sensor 1BA

Proximity '

Sensor 1_(§.

Current Time 40

Photos

o aan

Camera

Videos

Blog

144

Calendar

1 .

j_45

75

Weather
149-1

Stocks
Ma-9

g

·-·

j_4g

UserWidget

Calculator

Alarm

Phone

Mail

149-3

149-4

Dictionary
14g

Browser

Widget
140-8

Music

Touch Screen j.12
Microphone ' / Home

Figure 4

Conv nrovided hv un .a from the PIRR Imann Ontahama nn ORIORI9n14

APLNDC00022473

U.S. Patent

Dec. 23, 2008

Sheet 5 of 38

US 7,469,381 B2

502

Detect a movement of an object (e.g., a finger) on or near a touch screen
display of a device.
-504

Scroll a list of items displayed on the touch screen display in a first
direction (e.g., vertical or horizontal).
Scroll the list at a speed corresponding to a speed of movement of
the object.

p 506

Scroll the list in accordance with a simulation of an equation of motion

p 508

having friction.

"
terminusaof the
list reached while scrolling the ""'ss, No
list in the first direction while the object
's

<'

""

is still detected on or near
"

the touch --n
's,
display?

'

512
p--

Complete

'

Yes

-514

Display an area beyond the terminus of the list.

Display the area in white,

O 516

Display the area as visually indistinct from the background of the list.

p 518
--520

After the object is no longer detected on or near the touch --n display,
scroll the list in a second direction opposite the first direction until the area
beyond the terminus of the list is no longer displayed.

Scroll the list using a damped motion.
Make the terminus of the list appear to be elastically attached to an
edge of the touch screen display or to an edge displayed on the touch
screen display.
L_
1

O 522
524

Figure 5

Peanas

ku IERDTF3 I

II

DIDO imana.am ¯

a- AÆluEind%d4

APLNDC00022474

U.S. Patent

Dec. 23, 2008

Sheet 6 of 38

Portable Multifunction Device
100

| 20

Optical

Speaker2

l 102.
.

Sensor i §.

Current Time Q

MailboxeS
3

Proximity '

Sensor 10±

3500A

¯

US 7,469,381 B2

;3502

Inbox

4_Q§
3504

6

2-1Bruce WalkerPO6580Uary 30, 200

Lunch meeting today ""°"
.

3506-3

Kim BrOO É

510-2

anaa

,
3510-3

January 30, 20061

3508-3

Draft agreement
Bob AdamS
Project Orion

January 29, 2006
,r3514

g Darin Adler
fantasy football

January 29, 2006

3512-2

•

Aaron JoneS

January 29, 2006

Fwd: status report
Kim Brook

January 28, 2006

Re: propu-I

maa,

3518

3 2û

-- -

' Microphone

3524

3526

3310

Home

Figure 6A

APLNDC00022475

U.S. Patent

Dec. 23, 2008

| 200. |

US 7,469,381 B2

Portable Multifunction Device
100

Optical
Sensor1¾

Speaker 111
-

3500A

Sheet 7 of 38

/ Proximity '
\ Sensor îûß

Current Time mi

I

.

MailboxeS

yaso2

o m'

i

/'^'\ 3504

Inbox

' 6

I

i

Aaron Jone
Re: Project Orion
3512-1

506-1

3508-1

3§10-1

January 30, 20062
36¾

3506-2

3510-2

Bruce Walker' January 30, 20061
Lunch meeting todayI *
==
.
3506-3 a
Kim BrOO É 3508-3,| January 30, 2006
Draft agreement µ3514

10-3

i

Bob AdamS

January 29, 2006

Project Orion
3 2-2Darin Adler
fantasy football
Aaron JoneS
Fwd: status report

3520

January 29, 2006
January 29, 2006

3522

' Microphone '

2=-

21

Home

Figure 6B

APLNDC00022476

U.S. Patent

Dec. 23, 2008

Sheet 8 of 38

US 7,469,381 B2

Portable Multifunction Device

20

100

Optical

Speaker 111

-

3500A

1 102

Proximity '

Sensor 1§§

Sensor 1B

Current Time 4.0±

Mailboxes

Inbox

o son

(
3538
3536

3506-1

Aaron JoneSr
Re: Project Orion
3

January 30, 2006
asm

3§10-1

2-1Bruce Walker 06-2January 30, 20063 10-2

Lunch meeting todayf36°"¯2
asso
.
506-3 I
3510-3
Kim BrOO (
January 30, 20061
yasoa-a.
Draft agreement
r3514
Bob AdamS
January 29, 2006
Project Orion

3 2-2Darin Adler
fantasy football

January 29, 2006
3518

3520

3522

Microphone '

3526

Sain

Home

Figure 6C

Panu

hu IBRDTf3 fansn the DIRO inanna

an ftalORI fH4

APLNDC00022477

U.S. Patent

Dec. 23, 2008

Sheet 9 of 38

US 7,469,381 B2

Portable Multifunction Device
100

I 206 \

Speaker 111

-

3500A

2

Optical '
Sensor 1§±

" Proximity '
Sensor 16

Current Time auf

Mailboxes '

o eûn

Inbox

3504

Aaron Jones" ° 'January 30, 20063 10-1
;3508-1
Re: Project Orion

asm

3 2-1Bruce Walker 506-2January 30, 20063 10-2

Lunch meeting today/3508-2
.
3ouo-a
3510-3
Kim BrOO É
January 30, 2006I
;3508-3
Draft agreement
Bob AdamS
January 29, 2006
Project Orion
3 2-2Darin Adler
January 29, 2006
fantasy football

i

Aaron JoneS
Fwd: status report

January 29, 2006
i

3518

- Microphone

.

113

Home

204 i
Figure 6D

Conv nravidad hu .mv.v from the DIRR Imana Batahana on tidl95/9fl11

APLNDC00022478

"

U.S. Patent

edge of the

Dec. 23, 2008

712

Sheet 10 of 38

US 7,469,381 B2

702

Detect a movement of an object (e.g., a finger) on or near a touch screen
display.

704

Translate an electronic document displayed on the touch screen display in
a first direction (e.g., vertical, horizontal, or diagonal).

Translate the electronic document at a speed of translation
corresponding to a speed of movement of the object.

706

Translate the electronic document in accordance with a simulation of
an equation of motion having friction.

708

Is an

710

' electronic document reached "s,
while translating the electronic document in", No
the first direction while the object is still
"
detected on or near
, '
'ss,, the touch screen
'

,

Process
Complete

display?

Yes

714

Display an area beyond the edge of the document.
Display the area in black, gray, a solid color, or white.

e716

Display the area as visually distinct from the document.

e718
720

After the object is no longer detected on or near the touch ---n display
translate the document in a second direction (e.g., opposite the first
direction) until the area beyond the edge of the document is no longer
displayed.
Translate the document using a damped motion.
Make the edge of the electronic document appear to be elastically
attached to an edge of the touch screen display or to an edge
displayed on the touch screen display.

722

724

Figure 7

Conv nrovided bv - --- -- - from the PlHS Imaae Database on 04/25/2011

APLNDC00022479

U.S. Patent

Dec. 23, 2008

Sheet 11 of 38

US 7,469,381 B2

Portable Multifunction Device
100

20_û

Speaker 111'

Optical
Sensor i§§

3900A

402

/ Proximity
s Sensor i

Current Time .401

Welcome anna
http://www.company.com/start 39Qg

m. 406'

as

'
âg10

Web page

Block 3
3914-3

Block 1
3914-1

h
3925-'Ás

Block 4

a

3914-4

Block
7
ansa.-,

Block 5
3914-5

Block 2
3914-2

Block
8
3914-8

Block 6
3914-6
3914-9

- Microphone '

o'me

Figure 8A

Conv nrovided bv USPTO from the PIRA imana -

n.. naioxionso

APLNDC00022480

9 4 1

Block 4

U.S. Patent

Dec. 23, 2008

Block 7

Sheet 12 of 38

US 7,469,381 B2

Portable Multifunction Device
100

| 206 |

Optical

3900A

/ Proximity '

Sensor iû

Speaker.111

s Sensor j_ûû .

02

Current Time 4.0.4

,

Welcome agog

e aan

agog

http://www.company.com/start anoa

39

4

3914-7

Block 5
3925 3914-5

Block 2

',

3914-2

Block 8
*a

3914-8

Bloc< 6
3914-6

Web page
3912

Block 9
3914-9

i

a

Microphone

113

Home

204 ,

Figure 8B

imai inas l iMDTD E

il - ""DO immamamm ¯

sa thaluti Add

APLNDC00022481

U.S. Patent

Dec. 23, 2008

Sheet 13 of 38

Portable Multifunction Device
100

2m

Optical
Sensor1§

Speaker 111
-

3900A

----

'

102

Proximity '
Sensor 166

Current Time

-

I

US 7,469,381 B2

o on

Welcome

i

http://www.company.com/start 3914-1

Block 4

Block 7

3914-4

3914-7

Block 5
3914-5
3926

Block 8

i

Block
2
3914-2

3914-8

x

BlocR,g
3914-6

Web page

3912

Block 9
3914 9

3928-1
3930

3928-2

Microphone '

113

-

Home '

204

Figure 8C

Conv nrovided bv USPTO from the PIRE Immaa Databana on Od/DEISoli

APLNDC00022482

39

1

Block 4

U.S. Patent

Dec. 23, 2008

Block 7

Sheet 14 of 38

US 7,469,381 B2

Portable Multifunction Device
100

22û

Speaker 111
3900A

Optical '
SensorifL4

' Proximity
Sensor16.

l 4_02

Urrent Time of

ase2

m. on

Welcome aso4

http://www.company.com/start a
Bloc< 1
3914-7

3914-4

Block 5
3914-5

Block 2
3914-2

Block 8
'

3914-8

Block 6
3914-6

Web page

3912

Block 9
3914-9

' Micophone

113

Home

204

Figure 8D

Conv nrovided bv ·---- - from the PIRE Imana Datshana nn näl9XIondi

APLNDC00022483

U.S. Patent

Dec. 23, 2008

Sheet 15 of 38

US 7,469,381 B2

902

Display an electronic document at a first magnification on a touch screen
display. The electronic document has a document length and a document
width.

904

Detect a gesture (e.g., a pinching gesture) on or near the touch screen
display corresponding to a command to zoom out by a user-specified
amount.
906

In response to detecting the gesture, display the electronic document at a
magnification less than the first magnification.

Is the

document length or
,
document width entirely displayed while "
the gesture is still detected on or near ,7
the touch screen
display?

910

Process
Complete

Yes
912

Display the electronic document at a magnification wherein areas beyond
opposite edges of the electn nic document are displayed.
-914

Upon detecting termination of the gesture, display the electronic
document at a magnification wherein the areas beyond opposite edges of
the electronic document are no longer displayed.

Figure 9

APLNDC00022484

U.S. Patent

Dec. 23, 2008

US 7,469,381 B2

Portable Multifunction Device
100

I 2Q6
E
3900A

Sheet 16 of 38

'

" Optical
. Sensor 1§§

Speaker 13_1-

Proximity '
Sensor j§.û ,

402

Current Time .49

9902

--> 10â~

Welcome 240&

39Q§

http://www.company.com/start 3908
Web page

Block 3
3914-3

Block 1

Block

3914-1.
•-,Block4
s'3951 )

9994.7

.s 3914-4

,·3Ë3 5

BIOck 5

**•'

39¾-5

Block 2
3914-2

Block
8
3914-8

Block 6
3914-6
3914-9

+
Microphone

Home

Figure 10A

F-.... .......i.i...I km. IleDTri fram the DIDA Imana Tamin

Adl9RI9A11

APLNDC00022485

U.S. Patent

Dec. 23, 2008

Sheet 17 of 38

US 7,469,381 B2

Portable Multifunction Device

206 \

100

( Speaker 111
\

"

Optical

'

Sensor 181 .

3900A

' Proximity '

« Sensor 1ûß

Current Time g

o g'

Welcome anos

anos

http://www.company.com/start aana

3955
'

Block 3
398-3

Block 1
3014-1

Web page
3912
Block 7

•••plock
4

3955

3955

391½

a 951s'3914-4

..

**

Block 5
3914-5

439545
Block 2 a.¿*

Block 8

3914-2

3914-8

Block 6
3914-6
3957

Block 9
3914-9

3959

' 3955

Microphone

1î3

ome

204

Figure 10B

i

APLNDC00022486

U.S. Patent

Dec. 23, 2008

3900A

co

US 7,469,381 B2

Portable Multifunction Device

| 2DE |
¯

Sheet 18 of 38

100

Speaker 111
-

-

Optical '
Sensor 1B

Proximity '
Sensor 16

(
I

si

02

Current Time da

aang

m. scâ'

i

Welcome am

http://www.company.com/start I

i

Web page
Block 3

OM If

3914-3

Block 1
3914-1

Block 7
Block 4

3914-7

3914-4

Block 5
3914-5

Block 2

Block 8

3914-2

3914-8

Block 6
3914-g

Block 9
3914-9
i

i

Microphone '

ome

Figure 10C

Conv nrovided bv USPTO from the PIRS Image Database on 04/25/2011

APLNDC00022487

U.S. Patent

Dec. 23, 2008

Sheet 19 of 38

US 7,469,381 B2

1100

1102

Display at least a first portion of an electronic document at a first
magnification on a touch se eer display.

-- 1104

Detect a gesture (e.g., a de-pinching gesture) on or near the touch screen
display corresponding to a command to zoom in by a user-specified

amount.
-- 1106

In response to detecting the gesture, display decreasing portions of the
electronic document at increasing magnifications.

1108
1110

Upon detecting

termination of the gesture, does the
magnification exceed a predefined
magnification?

No

Process
Complete

Yes
1112

Display a respective portion of the electronic document at the predefined
magnification.

Figure 11

Conv nrovided bv USPTO from the PIRS Imaae Database on 04/25/2011

APLNDC00022488

U.S. Patent

Dec. 23, 2008

Optical

Speaker 111

i

US 7,469,381 B2

Portable Multifunction Device
100

2Œi

3900A

Sheet 20 of 38

-*

*

402

'

* Sensor1%

Proximity

Sensor j§§

Current Time 104

i

http://www.company.com/start seca
Web page

Block 3
..

39]

3914-3

Block 1/3931'
-.«
3914-1

Block
7

..

Block 4

e 3933 i

3914-7

3914-4

Bloc< 5
3914-5

Block 2
3914-2

BI

oc
8

k

3914-8

Block 6
3914-6
3914_-

Microphone

.ü

Home

2Q4

Figure 12A

Conv provided bv USPTO from the PIRS Imaae Database on 04/25/2011

APLNDC00022489

-

3900A

U.S. Patent

'

*

*

Dec. 23, 2008

"

Speaker 111

"

Sheet 21 of 38

US 7,469,381 B2

100

'
I

^

Portable Multifunction Device

i 20_6

°l

- *

Optical

'

Sensor it

Proximity

Sensor 1.6û

(

] 102

Current Time 401

-

Welcome anos

m. on
as a

'

http://www.company.com/start 1998
Web page

a 3933 i

Block 1
39½-1.

3914
-4

Microphone '

Home '

Figure 12B

APLNDC00022490

U.S. Patent

Dec. 23, 2008

US 7,469,381 B2

Portable Multifunction Device
100

206

3900A

Sheet 22 of 38

Optical
. Sensor1§4

Speaker 111.

' Proximity
. Sensor îûû

02

Current Time .49

aso:

Welcome aso4

ru saa

as

http:llwww.company.com/start sana
Web page
3912
3914-

3

Block 1
3914-1

39144
-

|

" Microphone

Home

I
Figure 12C

A-.... --..:A-A km. E inOTl% inns. tha DIDO hussen I%eimhnen an AAJORIGA M

APLNDC00022491

Vgg ern6 a

ce
IJ

APLNDC00022492

gg; ean6 a

c

-

ce

APLNDC00022493

GO

T

u

t
c

ce
fn

APLNDC00022494

U.S. Patent

Dec. 23, 2008

Sheet 26 of 38

US 7,469,381 B2

1409

1402

Detect a multifinger twisting gesture on or near a touch screen display.
The multifinger twisting gesture has a corresponding degree of rotation.

1404

Does the
,7 correspondi ig degree of
rotation >xceed a

predefinet degree of

1406

Yes

/*

Execute a 90°
screen rotation
command.

rota lon?

No
1408

Execute a screen rotation command with an acute angle of rotation.

1410

Upon ceasing to detect the multifinger twisting gesture, executing a
screen rotation command with an angle of rotation opposite to the acute
angle.

Figure 14

APLNDC00022495