Apple Inc. v. Samsung Electronics Co. Ltd. et al

Filing 946

EXHIBITS re #943 Declaration in Support,, Exhibits to Arnold Declaration (Ex. 84 (Part 1)) filed bySamsung Electronics America, Inc., Samsung Electronics Co. Ltd., Samsung Telecommunications America, LLC. (Attachments: #1 Ex. 84 (Part 2), #2 Ex. 84 (Part 3), #3 Ex. 84 (Part 4), #4 Ex. 84 (Part 5), #5 Ex. 85 (Part 1), #6 Ex. 85 (Part 2), #7 Ex. 85 (Part 3), #8 Ex. 86 (Part 1), #9 Ex. 86 (Part 2), #10 Ex. 86 (Part 3), #11 Ex. 86 (Part 4))(Related document(s) #943 ) (Maroulis, Victoria) (Filed on 5/18/2012)

U.S. Patent

Jan. 4, 2011

US 7,864,163 B2

Portable Multifunction Device
100

| 206

3900F

Sheet 12 of 29

Speaker ---- '|
111

02

Optical

Proximity

Sensor1$ .

Sensor1§

Current Time of

n 0

,

o

m

·¤
o

-r

¯0
z

Q..
e

o

U

V

o

o
V

V

Microphone '

Home

Accelerometer(s)

113

2_0_4

16

Figure 5F

COpy nrnvirled by USPTO from the PIRS Imane Database on 08/90/2001

APLNDC00027886

U.S. Patent

Jan. 4, 2011

Sheet 13 of 29

US 7,864,163 B2

Portable Multifunction Device
20

-

3900G

100

'

Speaker --- '|
111

E2

Optical
Sensor

Proximity '
Sensor 16

Current Time 4

O 10

o *-

Microphone

Home

Accelerometer(s)

Figure 5G

L

Conv provided by USPTO from the PIRS Imaqe Database on 06/20/2011

APLNDC00027887

U.S. Patent

Jan. 4, 2011

Sheet 14 of 29

US 7,864,163 B2

Portable Multifunction Device
100

| 2_O

Optical
Sensor1§_4

Speaker ---111

3900H

4_0_2

Proximity '
Sensor.166. 2

Current Time

4

--þ g

http://www.company.com/startaana
¯

3920

3910

Web page
3912

Block 3
Block 1

3914-3

3962<

3914-1

Block 7

Block 4

3914-7

3914-4

,•3Ë58

BIOck 5

'••*

3914-5

.'3Ô3's

BIOCk 8

'"'

Block 2

3914-8

3914-2

Block 6
3914-6

3964

3902

3906

Microphone

3918

/ Home \

3922

Accelerometer(s)

Figure 5H

Copy provided by USPTO from the PIRS Imana Database on 06/20/2011

APLNDC00027888

U.S. Patent

Jan. 4, 2011

Sheet 15 of 29

US 7,864,163 B2

Portable Multifunction Device

| 2_œ

100

'
Speaker 111 /

'

39001

] 402

Share

Optical '
Sensor16.

Proxirnity
Sensor j_6

Current Time .40&

3966

M¯þ 06

Start

http:llwww.nyt|

3908

Search

Cancel
3970

aazz

wwwdlyt ulib.gig

QWERTYU

IOP

ASDFGHJKL
zxcv

.?123

/

3980
3976

Microphone

111

Home

2

BNM

.com
3982

<2]

go

Accel--ter(s)'

î6.8

Figure 51

Copy provided by USPTO from the PIRS Imaae Database on 06/20/2011

APLNDC00027889

U.S. Patent

Jan. 4, 2011

Sheet 16 of 29

US 7,864,163 B2

Portable Multifunction Device
100

210g

Optical

Speaker 111
-

3900J

1 102

'|

Proximity '|

Sensor 1û& ,

Sensor 1Bû ,

Current Time ADA

Share

3966

n saa'

Start

Cancel

http://www.company.comlasca
Search

E

3984

QWERTYU

A

S

D

ZX

.?123
' Microphone

F

I

OP

G

H

J

K

CV

B

N

M

space
Home

L
<2]

search
Accelerometer(s) '

Figure 5J

Copy provided by USPTO from the PIRS Imaae Database on 06/20/2011

APLNDC00027890

T

U.S. Patent

Jan. 4, 2011

Sheet 17 of 29

US 7,864,163 B2

Portable Multifunction Device
2_0_6

3900K

100

Optical
Sensor j_6_4

Speaker 11_1_

02

Share

Proximity '
Sensor .1_6

Current Time mi

3966

a-> ma'

Start

( Cancel

httn·llwww enmnanv enml

Email Link

=-as

Email Content

3988

SMS Link

3990

ASDF

GH

J

KL

Cancel
.?123

3992

space
Microphone ' t Home \

113

204 ;

"Accelerometer(s)'

168

Figure 5K

Copy provided by USPTO e-- en- ning sman. natas...an nmowan-i-:

APLNDC00027891

U.S. Patent

Jan. 4, 2011

Sheet 18 of 29

US 7,864,163 B2

Portable Multifunction Device
2Qg

-

3900L

100

Speaker -- '|
111

l E2

Optical '
Sensor 164

Proximity '
Sensor 166

Current Time m

o aos

o

Microphòne
113

o

Home
\

Accelerometer(s)

204

e-

168

Figure 5L

Conv Drovided bv USPTO from the PIRS Image Database on 06/20/2011

APLNDC00027892

U.S. Patent

Jan. 4, 2011

US 7,864,163 B2

Portable Multifunction Device
100

| 206

3900M

Sheet 19 of 29

Optical
Sensor 164

Speaker 111

02

'

' Proximity '
Sensor i .
'

Current Time .4¾

o 4.0.6

L

o
B
o
o

B

I

o

CD

Microphone

Home

Accelerometer(s)

Figure 5M

r

_

Copy provided by USPTO from the PIRS Imaae Database on 06/20/2011

APLNDC00027893

U.S. Patent

Jan. 4, 2011

Sheet 20 of 29

US 7,864,163 B2

¯¯¯¯

6002

6000
r

Determine borders, margins, and/or paddings for a plurality of boxes that
are specified in a structured electronic document (e.g., a web page) (e.g.,
an HTML or XML document).

r
-I Adjust the borders, margins, and/or paddings for the plurality of boxes for
i
display on a touch screen display of a portable electronic device.

6004

6006

Display, on the touch screen display of the portable electronic device, at
least a portion of the structured electronic document comprising the
plurality of boxes of content.

Scale the document width to fit within the touch screen display width
independent of the document length.

6008
6010

Detect a first gesture (e.g., a finger or stylus gesture) (e.g., a tap gesture)

at a location on the displayed portion of the structured electronic
document.
6012

Determine a first box in the plurality of boxes at the location of the first
gesture.
I In a render tree associated with the structured electronic document,
traverse down the render tree to determine a first node that
corresponds to the detected location of the first gesture.

6014

Traverse up the render tree from the first node to a closest parent
node that contains a logical grouping of content.

6016

Identify content......ponding to the closest parent node as the first

6018
6020

Enlarge and substantially center the first box on the touch screen display.
Simultaneously zoom and translate the first box.

6022

Expand the first box so that its width is substantially the same as the
width of the touch screen display.

6024

( A '

Figure 6A

cODV Drovided bv USPTO from the PIRS Imaae Database on 06/20/2011

APLNDC00027894

U.S. Patent

Jan. 4, 2011

Sheet 21 of 29

US 7,864,163 B2

A )

6026

i

Resize text in the enlarged first box or in the structured electronic
document to meet or exceed a predetermined minimum text size on the
touch screen display.
Determine a scale factor.

028

Divide the predetermined minimum text size by the scaling factor to
determine a minimum text size.

030

If a text size is less than the determined minimum text size, increase
the text size to at least the determined minimum text size.

6032
I

6034

^*^^* a second gesture (e.g., a finger or stylus gesture) (e.g., a tap
gesture) on the enlarged first box.
6036

In response to detecting the second gesture, reduce in size the displayed
portion of the structured electronic document.
Return the first box to its size prior to being enlarged

I

038

I

While the first box is enlarged, detect a third gesture (e.g., a finger or

6040

stylus gesture) (e.g., a tap gesture) on a second box other than the first
box.
6042

In response to detecting the third gesture, substantially center the second
box on the touch screen display.

Figure 6B

DV nrovided bv USPTO from the PIRS Immae Databana on 08/90/9011

APLNDC00027895

U.S. Patent

Jan. 4, 2011

Sheet 22 of 29

US 7,864,163 B2

6044

Detect a swipe gesture (e.g., a finger or stylus gesture) on the touch
screen display.
6046

In response to detecting the swipe gesture, translate the displayed portion
of the structured electronic document on the touch screen display.
Move the structured electronic document vertically, horizontally, or
diagonally on the touch screen display.

.l

6048
I

6050

Detect a fifth gesture (e.g., a finger or multifinger gesture) (e.g., a twisting
gesture) on the touch screen display.
6052

In response to detecting the fifth gesture, rotate the displayed portion of
the structured electronic document on the touch screen display by 90 .

.I
r
i

6054

Detect a change in orientation of the device.

6056

In response to detecting the change in orientation of the device, rotate the
displayed portion of the structured electronic document on the touch
screen display by 90°.

rI

-----

Detect a multi-finger de-pinch gesture on the touch -^^n display.

1

I

I

6058
6060

In response to detecting the multi-finger de-pinch gesture, enlarge a
portion of the displayed portion of the structured electronic document on
the touch screen display in accordance with a position of the multi-finger
de-pinch gesture and an amount of finger movement in the multi-finger
de-pinch gesture.

Figure 6C

Conv nrovided bv USPTO from the PIBS1maae Database on 06/20/2011

APLNDC00027896

U.S. Patent

Jan. 4, 2011

Sheet 23 of 29

US 7,864,163 B2

Portable Multifunction Device

| 20

100

4000A

~

Optical '
Sensor îû&

Speaker ---111

4_02

3920 =

' Proximity '
Sensor 16_û

Current Time 4_O

O

http://www.company.com/start

3910

Web page
Inline

3912

Multimedia

Content
4004-1

10||DO

Content
4002-1

Multimedia
Content

%

Inline
Multimedia
Content

4002-3

Content
Content
4004-3

e 4028 *

4004-2

Inline
Multimedia

4¾2_-2

Content

C40004

3902

3906

Microphone

4

3918

Home

3922

Accelerometer(s)

Figure 7A

COD3L Drovided bV USPTO trom the PIHS Imaae Databane on 08/20/2011

APLNDC00027897

U.S. Patent

2ûû

4000B

Jan. 4, 2011

Sheet 24 of 29

US 7,864,163 B2

Portable Multifunction Device
100

Speaker 111
--'

Optical

Sensor101

'

Proximity

Sensori§.

00

Q

C\l

00

Q

C\l

Microphone '

om

Accelerometer(s) '

Figure 7B

Copy provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00027898

U.S. Patent

Jan. 4, 2011

Sheet 25 of 29

US 7,864,163 B2

Portable Multifunction Device
206

4000C

100

Optical
Sensor 1&4

Speaker 111-

Microphone ' / Home
113

\

Proximity 3
Sensor 1§

Accelerometer(s)
îß_8.

Figure 7C

Copy provided by USPTO from the PlHS Imaqe Database on 06/20/2011

APLNDC00027899

U.S. Patent

Jan. 4, 2011

Sheet 26 of 29

US 7,864,163 B2

Portable Multifunction Device
20

100

'
Speaker1ît /
4000D

Optical

Sensor1§_4

'

Proximity '

Sensorì

o-

' Microphone > l' Home

1î3

- \ 204

Accelerometer(s)

1_611

Figure 7D

Copy provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00027900

U.S. Patent

206

4000E

Jan. 4, 2011

Sheet 27 of 29

US 7,864,163 B2

Portable Multifunction Device
100

Speaker 11î

Microphone

Optical
Sensor j§_4.

Home

Proximity
Sensor 1ßß.

Accelerometer(s)

Figure 7E

Copy provided by USPTO from the PIRS Immae Database on 06/20/2011

APLNDC00027901

U.S. Patent

,

Jan. 4, 2011

o

US 7,864,163 B2

Portable Multifunction Device
100

206

Optical '
. Sensor &

Speaker 11î

4000F
col

Sheet 28 of 29

" Proximity '
Sensor 16û ,

<

4

Current Time .40s

Done 0:00
4006

4008

n 06
-1:08

4010

4012

Inline
Multimedia
Content
41)O2-1

4014

' Microphone >

Home '\

'Accelerometer(s)>

Figure 7F

CODV Drovided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00027902