Apple Inc. v. Samsung Electronics Co. Ltd. et al

Filing 563

EXHIBITS re #559 Declaration in Support, filed byApple Inc.. (Attachments: #1 Exhibit 5.02, #2 Exhibit 5.03, #3 Exhibit 5.04, #4 Exhibit 5.05, #5 Exhibit 5.06, #6 Exhibit 5.07, #7 Exhibit 5.08, #8 Exhibit 5.09, #9 Exhibit 5.10, #10 Exhibit 5.11, #11 Exhibit 6.1, #12 Exhibit 6.2, #13 Exhibit 6.3, #14 Exhibit 6.4, #15 Exhibit 6.5)(Related document(s) #559 ) (Jacobs, Michael) (Filed on 12/29/2011)

EXHIBIT 5.10

WO2008/085848

PCT/US2008/000060

5/37

GUI
DISPLAY
408

400

eeooo

e
O
e

INFORMATION
TERMINUS
514

.

WINDOW 410

MENU

FIG. 58

APLNDC00027756

WO 2008/085848

PCT/US2008/000060

6/37

GUI
DISPLAY
408

400

00000

VELOCITY
510-2

INFORMATION
412-1

DISTANCE
512-1

TERMINUS .y
514

WINDOW 410

MENU

FIG. 5C

APLNDC00027757

WO 2008/085848

PCT/US2008/000060

7/37

PORTABLE MULTIFUNCTION DEVICE
100

226

SPtAKER

3500A

OPTICAL

111

SENSOR 1½

,

R2

'

Current Time

Mailboxes

3502

PNUXIMITY '

SENSOR 16]

4

e 4_0fi

Inbox

504

Bruce Walker 3506-2 January 30, 2006 asio-2
Lunch meeting todayl6°6-2
Kim Brook2506-3

January 30, 20062510-3

Draft agreement2"
Bob AdamS
Project Orion

January 29, 2006
3514

Darin Adler
fantasy football

J, January 29, 2006
/

Aaron JoneS

January 29, 2006

Fwd: status report
Kim Brook
Re: proposal

January 28, 2006
3532
3518

3520

3522

3524

"MICROPHONE'
113

3526

3510

HOME
204

FIG. 6A

APLNDC00027758

WO 2008/085848

PCT/US2008/000060

8/37
PORTABLE MULTIFUNCTION DEVICE
100

200]i
3500A

.

ormar-n
111

'
,

4_ol

' OPTICAL
. SENSOR î61

Current Time

Mailboxes

' PROXIMITY '
SENSOR 111

a

o m'

36°2 Inbox

Aaron Jones 3506-1
508-1
Re: Project Orion

504

3510-1

January 30, 2006~
3534

3 2-18tUce Walker2506-2 January 30, 20063510-2
Lunch meeting today16 8-2
3530

Kim Brook 3506-3
Draft agreementasos-a

January 30, 20063510-3
3514

Bob Adams
Project Orion

January 29, 2006
/

3 2-2Darin Adler
fantasy football

January 29, 2006

Aaron Jones
Fwd: status report

January 29, 2006
3518

3520

3522

3524

"MICROPHONE'
113

3526

3510

HOME
204

FIG. 6B

APLNDC00027759

WO 2008/085848

PCT/US2008/000060

9/37
PORTABLE MULTIFUNCTION DEVICE
100

2f0

SPt--AKt-R

OPTICAL

111

SENSOR 1½

3500A

A102

PRUXIMITY '

SENSOR 16

Current Time

Mail boxes

3502

o 10 '

In box

504

Aaron Jones 26°6-1

3510-1
3508-1 January 30, 2006~
Re: Project Orion~
Bruce Walker 3506-2

January 30, 2006 3510-2

Lunch meeting today J'°6¯2

asao

Kim Brook2506-3
January 30, 2006 3510-3
Draft agreementasoa-a¾3514
Bob AdamS
Project Orion

,L January 29, 2006
r

3 2-2Darin Adler
fantasy football

January 29, 2006
3518

3520

3522

3524

MICROPHONE'

3526

3510

HOME

FIG. 6C

APLNDC00027760

WO 2008/085848

PCT/US2008/000060

10/37
PORTABLE MULTIFUNCTION DEVICE
1 00

20]ì

SPEAKER

OPTICAL

111

SENSOR 1½

3500A

A 42

Current Time

Mail boxes

3502

'

" PROXIMITY

SENSOR 1611

á¾

4

In bOX

504

Aaron Jones 3506-1

3510-1

3508-1 January 30, 2006
Re: Project Orion ~
353

Bruce Walkerg506-2

January 30, 2006

Lunch meeting today 3508-2

3530

Kim Brook 3506-3
3508-3

A8nUary 30, 20063510-3

Bob Adams
Project Orion

January 29, 2006

Draft agreement~

3 2-2Darin Adler
fantasy football

January 29, 2006

Aaron Jones
Fwd: status report

January 29, 2006
3518

3520

3522

3524

'MICROPHONE'

3526

3510

HOME

FIG. 6D

APLNDC00027761

WO 2008/085848

PCT/US2008/000060

11/37

700

TRANSFER A DIRECTIONAL SCROLL CALL
TO DETERMINE IF DIRECTIONAL SCROLLING
IS ENABLED
702

TRANSFER A DIRECTIONAL SCROLL ANGLE
CALL TO SET A SCROLL ANGLE FOR LOCKING
THE SCROLLING IN AT LEAST ONE OF A
VERTICAL OR A HORIZONTAL DIRECTION
704

LOCK THE SCROLLING IN THE HORIZONTAL
DIRECTION IF A USER INPUT FORMS AN
ANGLE WITH A HORIZONTAL DIRECTION THAT
IS LESS THAN OR EQUAL TO A FIRST SCROLL
ANGLE

LOCK THE SCROLLING IN THE VERTICAL
DIRECTION IF A USER INPUT FORMS AN
ANGLE WITH A VERTICAL DIRECTION THAT
IS LESS THAN OR EQUAL TO A SECOND
SCROLL ANGLE
708

FIG. 7

APLNDC00027762

WO2008/085848

PCT/US2008/000060

12/37

1

I

\

i

i
i
i

I

8101
I
I
i
i

I
I
I

i

i

i

I

808

--

--- '

806
I
I

I

i

'812

I
I
i

802

i
i

\
%
i

I
I

I

I

4

I

i

804

FIG. 8

APLNDC00027763

WO 2008/085848

PCT/US2008/000060

13/37

900

TRANSFER A DECELERATION SCROLL CALL
TO SET A DECELERATION FACTOR FOR A
DRAG USER INPUT THAT INVOKES A SCROLL

SLOW THE SCROLL TO A STOP BASED
ONTHESPEEDOFTHEDRAGUSERINPUT
904

FIG. 9
1000

TRANSFER A SCROLL HYSTERESIS CALL TO
DETERMINE WHETHER THE USER INPUT
INVOKES A SCROLL

SET THE HYSTERESIS VALUE FOR
DETERMINING WHETHER A USER INPUT
INVOKES A SCROLL

1004

FIG. 10

APLNDC00027764

WO 2008/085848

PCT/US2008/000060

14/37
1100

TRANSFER A SCROLL INDICATOR CALL TO
DETERMINE WHETHER AT LEAST ONE
SCROLL INDICATOR ATTACHES TO A SCROLL
REGION OR A WINDOW EDGE
1102

OPTIONALLY ATTACH SCROLL INDICATORS
TO A SCROLL REGION BASED ON
THE SCROLL INDICATOR CALL
1104

OPTIONALLY ATTACH SCROLL INDICATORS
TO A WINDOW EDGE BASED ON
THE SCROLL INDICATOR CALL
1106

FIG. 11
1200

TRANSFER AN INADVERTENT USER INPUT
CALL TO DETERMINE WHETHER THE USER
INPUT WAS INADVERTENT
1202

IGNORE THE INADVERTENT USER INPUT
BASEDONTHEINADVERTENTUSERINPUT
CALL
1204

FIG. 12

APLNDC00027765

WO 2008/085848

PCT/US2008/000060

15/37
1300

TRANSFER A HANDLE GESTURE EVENT CALL
1302

TRANSFER A GESTURE CHANGE CALL IN
RESPONSE TO THE HANDLE GESTURE
EVENT CALL

1304

FIG. 13
1400

TRANSFER A SCALING TRANSFORM CALL
TO DETERMINE A SCALING TRANSFORM
FOR A VIEW ASSOCIATED WITH A USER
INPUT HAVING A PLURALITY OF INPUT POINTS
1402

TRANSFER A SCALING GESTURE START
CALL
1404

TRANSFER A SCALING GESTURE PROGRESS
CALL
1406

TRANSFER A SCALING GESTURE END
CALL
1408

FIG. 14

APLNDC00027766

WO2008/085848

PCT/US2008/000060

16/37

1502

,-

,

1508

1504

FIG. 15

APLNDC00027767

x

Íl

o
1650

.

1602
I
I

1604

1652

14
1610

06

64

54

1658

I

I

FIG. 16A

FIG. 16B

APLNDC00027768

o

1670

1672
680
676

678
682
674

FIG. 16C

APLNDC00027769

WO 2008/085848

PCT/US2008/000060

19/37

1700

TRANSFER A ROTATION TRANSFORM CALL
TO DETERMINE A ROTATION TRANSFORM
FOR A VIEW ASSOCIATED WITH A USER
INPUT HAVING A PLURALITY OF INPUT POINTS
1702

TRANSFER A START ROTATION GESTURE
CALL
1704

TRANSFER ROTATION GESTURE
PROCESS CALL
1706

TRANSFER A ROTATION GESTURE END
CALL
1708

FIG. 17

APLNDC00027770

WO2008/085848

PCT/US2008/000060

20/37

1800

a

ANY
ANIMATION?
1802

NO

YES

PROGRESS?
1804

YES

t

CALCULATE NEXT
STATE
1806

NO

4

NO

DELEGATE?
1808
YES
NOTIFY
DELEGATE
1810

FIG. 18

APLNDC00027771

WO 2008/085848

PCT/US2008/000060

21/37

1900

START AT LEAST TWO ANIMATIONS
1902

DETERMINE THE PROGRESS OF EACH
ANIMATION
1904

UPDATE EACH OF AT LEAST TWO
ANIMATIONS BASED ON A SINGLE TIMER
1906

FIG. 19

APLNDC00027772

WO 2008/085848

PCT/US2008/000060

22/37

2000

PROVIDE A SINGLE ANIMATION TIMER
2002

ANIMATE A PLURALITY OF ANIMATIONS
WITH THE SINGLE ANIMATION TIMER
2004

FIG. 20

APLNDC00027773

WO 2008/085848

PCT/US2008/000060

23/37

2100

SET ATTRIBUTES OF VIEWS
INDEPENDENTLY WITH EACH VIEW BEING
ASSOCIATED WITH PR· ·· -S
212.

TRANSFER A SYNCHRONIZATION CALL
TO SYNCHRONIZE ANIMATIONS FOR THE
MULTIPLE VIEWS OF THE DISPLAY
2104
TRANSFER A SYNCHRONIZATION
CONFIRMATION MESSAGE WHEN A
SYNCHRONIZATION FLAG IS ENABLED BASED
ON THE LIST OF THE PROCESS BEING
SYNCHRONIZED
2106
UPDATE THE ATTRIBUTES
OF THE VIEWS INDEPENDENTLY
2108

TRANSFER A START ANIMATION CALL TO
DRAW THE REQUESTED ANIMATIONS
2110

FIG. 21

APLNDC00027774

WO2008/085848

PCT/US2008/000060

24/37

2200

2210

2220

FIG. 22A
2200

2210

2220

FIG. 22B

APLNDC00027775

WO 2008/085848

PCT/US2008/000060

25/37
2300

CONSTRUCT A DATA STRUCTURE HAVING
A HIERARCHY OF LAYERS WITH A
LAYER BEING ASSOCIATED WITH A
VIEW AND OWNING THE VIEW
2302

REMOVE THE LAYER FROM THE DATA
STRUCTURE
2304

SWITCH OWNERSHIP OF THE VIEW
FROM THE LAYER TO THE VIEW
2306

FIG. 23

2400

CONSTRUCT A DATA STRUCTURE HAVING
A HIERARCHY OF LAYERS WITH A
LAYER BEING ASSOCIATED WITH A
VIEW
2402
STORE THE DATA STRUCTURE IN MEMORY
2404
MAINTAIN A RETAINED COUNT OF THE
NUMBER OF REFERENCES TO THE VIEW
FROM OTHER OBJECTS
2406

DEALLOCATE THE VIEW FROM MEMORY
IF THE RETAINED COUNT IS ZERO
2408

FIG. 24

APLNDC00027776

WO2008/085848

PCT/US2008/000060

26/37

2502

2532

2504

2506

2508
2512

y
2510

FIG. 25A

2532

2506

2512

2510

I

FIG. 25B

APLNDC00027777

WO 2008/085848

PCT/US2008/000060

27/37

2600

CONSTRUCT A DATA STRUCTURE HAVING
A HIERARCHY OF LAYERS ASSOCIATED
WITH THE USER INTERFACE OF THE
DEVICE
2402
DETERMINE WHETHER EACH LAYER OF THE
DATA STRUCTURE IS ASSOCIATED WITH
MEDIA OR NON-MEDIA CONTENT
2604
DETACH MEDIA CONTENT FROM THE DATA
STRUCTURE
2606

STORE MEDIA CONTENT IN A FIRST
MEMORY LOCATION
2608

STORE NON-MEDIA CONTENT IN A SECOND
MEMORY LOCATION
2610
UUMFUbi It- INE MEDIA AND NON-MEDIA

CONTENT FOR DISPLAY ON THE
DEVICE
2612

FIG. 26

APLNDC00027778

WO2008/085848

PCT/US2008/000060

28/37

2700

2702

2712

2704
I
I

I

2706

2
i

2722

2740
I

2732

I

2742

FIG. 27

APLNDC00027779

WO2008/085848

PCT/US2008/000060

29/37

2838

2832

2800

2834
2836

.--/

2840

.

2844

2842

2846

FIG. 28

APLNDC00027780

WO2008/085848

PCT/US2008/000060

30/37

2950

2960

'

2956

2962

'

2952

2954

2964

2958

FIG. 29

APLNDC00027781

WO2008/085848

PCT/US2008/000060

31/37
3084 3098
3070
3093
3089

3095
3087

3091

3097

FIG. 30A
3070
3092

3084A

3088
3087

3096

3094

3089

\|

3091

FIG. 308

APLNDC00027782

o
DISPLAY DEVICE

'

BACKLIGHT
3108A

ANTENNA
SYSTEM

DIGITAL ANDIOR
ANALOG RF
- TRANSCEIVER

STORAGE
DEVICE

DIGITAL
PROCESSING
SYSTEM
_ 01

AUDIO
TRANSDUCER
3101

MEDIA
PROCESSING

I

I

MICROPHONE
SENSOR(S)

INPUT
DEVICE(S)

BATTERY
MOI

105A

FIG. 31

s,o

APLNDC00027783

WO2008/085848

PCT/US2008/000060

33/37

3200
CACHE
(OPTIONAL)

\ 3208

3202
MICROPROCESSOR

3204
M EMORY
3206

BUS
3210
DISPLAY
CONTROLLER
AND
DISPLAY
DEVICE
(OPTIONAL)

3212

CONTROLLER(S)

3216
3214

llO DEVICE(S)
(E.G., KEYBOARD,
CURSOR CONTROL
DEVICE, NETWORK
INTERFACE)

SENSOR(S)
FOR USER
ACTIVITY

FIG. 32

APLNDC00027784

WO2008/085848

PCT/US2008/000060

34/37

3306
3308

3302

3304

FIG. 33A

APLNDC00027785

WO2008/085848

PCT/US2008/000060

35/37

3358

3356

3352
3354

FIG. 33B

APLNDC00027786

WO2008/085848

PCT/US2008/000060

36/37

3362

3366 .

3360

FIG. 33C

APLNDC00027787

WO 2008/085848

PCT/US2008/000060

37/37

3400

CONSTRUCT A HIERARCHY OF VIEWS
OPERATING ON TOP OF A HIERARCHY OF
LAYERS
3402

PROVIDE A- --S TO THE HIERARCHY OF
VIEWS WITHOUT PROVIDING ACCESS TO THE
HIERARCHY OF LAYERS
3404

FIG. 34

APLNDC00027788

INTERNATIONAL SEARCH REPORT

International application No

PCT/US2008/000060
A. CLASSIFIGATl0N F SUBJECT MATTER

INV.

GO6F3 048

According to International Patent Classification (IPC) or to both national classification and IPC
B. FIELDS SEARCHED

Minimum documentation searched (classification system followed by classification symbols)

8 06F

Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched

Electronic data base consulted during the international search (name of data base and, where practical, search terms used)

EPO-Internal

C. DOCUMENTS CONSIDERED TO BE RELEVANT

Category*

Citation of document, with indication, where appropriate, of the relevant passages

Relevant to claim No.

X

US 6 958 749 B1 (MATSUSHITA NOBUYUKI [JP]
ET AL) 25 October 2005 (2005-10-25)
the whole document

1-33,
35-96

X

US 5 534 893 A (HANSEN JR DANIEL J EUS] ET
AL) 9 July 1996 (1996-07-09)

1-33,
35-96

abstract

column 2, line 33 - line 59
column 5, line 1 - column 9, line 46;
figures 1-4

O Further documents are listed in the continuation of Box C.

* Special categories of cited documents :
"A' document defining the general state of the art which is not
considered to be of particular relevance
'E' earlier document but published on or after the international
filing date
'L' document which may throw doubts on priority claim(s) or
which is cited to establish the publication date of another
citation or other special reason (as specified)
'O' document referring to an oral disclosure, use, exhibition or
other means
"P" document published priorto the international filing date but
later than the priority date claimed

Date of the actual completion of the intemationai search

15 Apri l 2008
Name and mailing address of the ISA/
European Patent Office, P.S. 5818 Patentiaan 2
NL - 2280 HV Rijswijk
Fe
3311 70 3 0-23 ÉTX.31651epon'

See patent family annex.
"T* later document publîshed after the international filing date

or priority date and not in conflict with the application but
cited to understand the principle or theoly underlying the
invention
"X" document of particular relevance; the claimed invention
cannot be considered novel or cannot be considered to
involve an inventive step when the document is taken alone
"Y' document of patticular relevance; the claimed invention
cannot be considered to involve an inventive step when the
document is combined with one or more other such documents, such combînation being obvious to a person skilled
in the art.
'&' document member of the same patent family

Date of malling of the intemational search report

22/04/2008
Authorized officer
Vieira,

Alexandre

otrn PCT/ISA/210 (second sheet) (April 2005)

APLNDC00027789

INTERNATIONAL SEARCH REPORT
Information on patent family members

Patent document

cited in search report

Publication

'

international application No

PCT/US2008/000060
Patent family

date

member(s)

US 6958749

B1

25-10-2005

JP

US 5534893

A

09-07-1996

2001134382 A

Publication
date

18-05-2001

NONE

Form PCT/ISA/210 (patent family annex) (April 2005)

APLNDC00027790

(12)UK Patent Application as GB es2 319 ©1 as,A
(43) Date of A Publication 27.05.1998
(21) Application No 9723838.0

(51) INT CL6
GO6F 3/033 // GO6K 11/18

(22) Date of Filing 13.11.1997
(30) Priority Data
(31) 08752764

(32) 20.11.1996

(33) US

(52) UK CL (Edition P)
F2Y YTA Y104 Y3129 Y3191
U1S S2123
(56) Documents Cited
EP 0725331 A1

(71) Applicant(s)

Alps Electric Co., Ltd.

(58)
(Incorporated in Japan)

1-7 Yukigaya, Otsuka-cho, Ota-Ku, Tokyo 145, Japan

US 5428367 A

US 4550221 A

Field of Search
UK CL (Edition P ) F2Y YTA YTB
INT CL* GO6F 3/033 , GO6K 11/18
Online:EDOC,WPI

(72) inventor(s)
Tademitsu Sato
Tsuyoshi Ogura
Akihisa Itoh
(74) Agent and/or Address for Service
Saunders & Dolleymore
9 Rickmansworth Road, WATFORD, Herts, WD1 7HE,
United Kingdom

(54) Coordinates input apparatus
(57) A coordinates input apparatus, whereby various operations on a screen can be carried out by a
coordinates pointer such as a finger 50 and the number of operations reduced, comprises a detection section
and an operating section. The detection section is provided with an operating surface SF for operation by the
finger, and detects the operating conditions on the operating surface caused by the finger. The operating

section executes screen operations corresponding to the operating condition detected by the detection
section, and in response to tapping of the finger on the operating surface within one of a number of
predetermined regions carries out previously determined processing (e.g. right button emulation) or changes
to a previously determined mode (e.g. for generating a sound at the time of tapping)

FIG.4

6

FIG.5

6

UP
-

16'

16'

NR

DN

50

UP

sF

DN

RB

LB

50

y
NR

W

RB

LB

CO
(11

CO

APLNDC00027791

1

3

-1..

ÕO
>m
rdm

ž
O
o
m

m
z
,
O

9 i

1 4 - C0NMOEDRES\0N

CSO

O -

RAM

FlG.1
5

6

r

8

10

SENSOR
SUBSTRATE

>
'a

O

(n

m

m

12

1

16

O

INSEECR

E-ASNAL

S-COSNVER INON-

O>

ZZ

z
Jil --

Ill

HORIZONTAL
2
SCANNING SECTION

- ....

CONTROL DRIVEU
SECTION
,

II
I
I
I

SECTION
18

I

I

SOUND
19' SOURCE

4

CO-ORDINATE DETECTION DEVICE PD'

i

ROM

-17

I CO-ORDINATE OUTPUT DEVICE PC

L

APLNDC00027792

2/6

FlG.2
PD
. x

OPERATING
SURFACE SF

y

LEFT BUTTON LB

RIGHT BUTTON RB

FlG.3
xxxx

><xxx

xxxx

xxxx

ao
naci
31

32

33

APLNDC00027793

F G.4
-

16
UP

.-16'

DN

50

DN
SF

RB

PD

FIG.5

LB

16

NR

16'
WD
50

NR

SF

W

RB
LB

PD

APLNDC00027794

FIG.6
4_0

43

Easy Launcher

-- XOel
41

41

41

42:APPLICATION 2
42:APPLICATION 1

APLNDC00027795

START i

FIG.7

READ DATA FROM CO-ORDINATE DETECTION DEVICE PD ~Sai

TAPPING ?
YES
RIGHT BUTTON
EMULATION REGION

NO
Sd
Sa3

YES

SOUND
DESIGNATED FOR RIGHT
BUTTON EMULATION ?
Sa5
)

YES

NO

Sa7

EASY X MODE
REGl0N ?

NO

Sa11

SOUND
DESIGNATED FOR
TAPPING ?
YES

NO YES
Sa4

Sa8

SOUND

DESIGNATED FOR
EASY X MODE ?

y
GENERATE SOUND
FOR RIGHT BUTTON
EMULATION
Sa6

Sa9
GENERATE SOUND y
FOR EASY X MODE

EXECUTE RIGHT
BURT
CL CK

EXECUTE VARIOUS Sa10
pERAO EXSS NOG N /

NO

NO

YES

GENERATE SOUND oa12
FOR TAPPING

EXECUTE LEFT
BUTTON CLICK
PROCESSING

Sa13
/

END

APLNDC00027796

START \

FIG.8

READ DATA FROM CO-ORDINATE DETECTION DEVICE PD ~Sbi
Sb2
EASY X MODE ?
YES
Sb6
NO
TAPPING
YES

Sb3
NO
Sb4

TAPPING ?
Sb7

YES

. NO

Sb10

FINGER
SLIDING ON EDGE OF
OPERATING SURFACE

Sb12

NO

FINGER
EASY X MODE
NO
LAUNCHEEAR REGION
SLIDING AT ANGLE FROM
NO
REGION ?
NO
YES
CENTER OF OPERATING
YES
Sb8
YES
Sb9 .,
Sb11
SURFACE ?
EXECUTE EASY CHANGE FROM ^ EXECUTE
YES
LAUNCHER
EASY X MODE EASY SCROLL
PROCESSING
TO NORMAL
PROCESSING .
Sb5
MODE
.
Sbi4

CHANGE FROM
NORMA MODE
TO EASY X MODE

END /

EXECUTE
EASY SIZE
PROCESSING
b13

EXECUTE
CURSOR
MOVEMENT
PROCESSING

CHANGE FROM
EASY X MODE TO
NORMAL MODE
Sbi5

APLNDC00027797

1

2319591

COORDINATES INPUT APPARATUS

The present invention relates to a coordinates input apparatus for
operating such as a cursor or a window on a screen.

Conventionally a mouse or a track ball is used for the pointing device

connected to a computer. Moreover, recently pointing devices such as
pads, touch pads or track pads have also come to be used.
The pad is
used either in an integral form such as with a portable type computer,
or in an externally attached form such as with a desk top type computer.

Since it is not necessary to move the pad, as with a mouse, it has the
feature that it can be operated even in a limited space such as on a
desk-top without obstruction.

In mo- ing a cursor (also referred to as a pointer) on a screen using
such a pad, the finger may simply be placed on and slid over the small
(a few square centimeters) operating surface on the pad. The pad is
provided with left and right buttons as with mouse type devices, and in
addition various operations the same as for left button clicking, such as

selecting and moving an object displayed on the screen can be realized
by lightly tapping the operating surface with the finger. This operation
is in particular referred to as "tap" or "tapping." By means of this
tapping operation, then as well as the above-mentioned clicking
operation, operaticas such as left button double clicking where the left
button is clicked two times in succession (used for example in starting

an application), and drag (where the cursor is aligned with the screen
object and the object moved to a desired location while pressing the left

button) can be carried out with one finger.

APLNDC00027798

2

By operating the operating surface of the pad with the finger above
manner, the pad achieves the same function as the cursor moving and
left button click operations using the mouse.

However, with the

conventional pad, the same function as the mouse right button click
operation cannot be achieved by an operation on the operating surface.

Hence it is necessary to click a right button provided on the pad with
the finger, as with a mouse.

To carry out the right button click

operation, the following operations are required.

First, in the case

where the user wishes to operate the pad continuously using only one
finger, the finger is moved from the operating surface to the right

button location, and the right button then pressed with the finger to
carry out the click operation.

Moreover, in the case where the user

operates the pad with two fingers, the operating surface is operated
with one finger, while the other finger is placed at the right button
location to carry out the click operation.

Therefore, to carry out the

right button click operation, it is necessary to either operate the pad
with two fingers, or to move one finger back and forth between the

operating surface and the right button.
present pad in that

Hence, the advantages of the

it can be operated with only a minimal number of

one finger operations is lessened.
Moreover, with the latest computers wherein operation of a window
(that is to say a plurality of separate screens on the display unit) is a

prerequisite, user operations such as adjusting the size of the window
to suit the work conditions, scrolling the contents displayed in the

window up and down or sideways within the window (the method of

successively displaying the screen contents as a scroll), or closing an
unnecessary window, are frequently carried out.

Here adjustment of the window size is carried out for example by
moving the cursor while clicking on the right hand lower corner of the
window.

Moreover, to scroll in the window, it is necessary to move

the cursor to a so called scroll bar (or slide bar ) provided at the right

APLNDC00027799

3

edge or bottom edge of the window, and then click the scroll bar a
required number of times.

Furthermore, closing the window is carried

out by moving the cursor to a small box, referred to as a close box,
provided for example on the upper right corner of the window, and
clicking on this box.

In carrying out the various window operations in this way, various
combinations of cursor movement and the button clicking are required.

Hence if the right button finger clicking operation is included, then the
above-mentioned advantages of the pad are not fully realized.
Moreover, positioning the cursor on the screen using the pad is not
considered easy, even for a user skilled in pad operation, and hence
considering a normal user these operations are quite complicated, thus
putting a load on the user.

In view of the above, it is an object of the present invention to
provide a coordinates input apparatus whereby various operations on a
screen can be carrad out where practicable with one finger, and the
number of operations reduced, thus giving a marked improvement in

user operability.
Accordingly, the coordinates input apparatus according to the present
invention comprising detection means having an ope-ating surface for
operation by a coordinates pointer, and for detecting an operating
condition on said operating surface caused by said coordinates pointer;
and operating means for executing screen operations corresponding to

said operating condition, wherein said operating means detects tapping
of said coordinates pointer on said operating surface within a

predetermined region, and carries out previously determined processing.
Moreover, the coordinates input apparatus according to the present
invention

comprising detection means having an operating surface for

operation by a coordinates pointer, and for detecting an operating

APLNDC00027800

4

condition on said operating surface caused by said coordinates pointer;
and operating means for executing screen operations corresponding to
said operating condition, wherein said operating means detects tapping
of said coordinates pointer on said operating surface within a

predetermined region, and changes to a previously determined mode.
In this way, with the present invention, it is possible to execute
various processing and to change to a predetermined mode, by merely

tapping a region on the operating surface with the coordinates pointer.
Therefore, as well as negating the requirement as with the conventional

coordinates input apparatus, of the complicated cursor positioning
operation, it is not necessary to move the finger from the operating
surface to the button and click the button.

Hence basically an

extremely simple operation using only one finger can be realized, the
number of operations reduced, and the load on the user considerably

lightened.
Embodiments of the inven"- will now be described, by way of

example only, with reference to the accompanying drawings, in which:

FIG. I is block diagram showing the structure of a coordinates input
apparatus according to an embodiment of the prese

invention;

FIG. 2 is a plan view of a coordinates detection device PD of the
embodiment;

FIG. 3 illustrates an example of a window showing a display section
16;
FIG. 4 is a diagram for explaining an operation in the embodiment

for Easy Scroll;
FIG. 5 is a diagram for explaining an operation in the embodiment
for Easy Size;

FIG. 6 illustrates an example of a dialog box shown on the screen in
the Easy Launcher processing in the embodiment;

FIG. 7 is a flow chart for describing the operation of the coordinates
input apparatus in the embodiment; and

APLNDC00027801

FIG. 8 is a flow chart for describing details of the operation of the
Easy X mode in the coordinates input apparatus of the embodiment.

An embodiment of the present invention will now be described with

reference to the drawings.

FIG. I is block diagram showing the

structure of a coordinates input apparatus according to the embodiment.

As shown in FIG. 1, the coordinates input apparatus is made up
generally from two devices namely; a coordinates detection device PD,
and a coordinates output device PC.

The coordinates detection device

PD is for example the above-mentioned pad, while the coordinates
output device PC is for example a computer connected to the pad.
At first the various structural components of the coordinates
detection device PD will be described, however before this a basic
description of the mechanical structure of the coordinates detection

device PD will be given.
detection device PD.

FIG. 2 shows a plan view of the coordinates

A left button LB and a right button RB

:orrespond respectively to the left and right buttons of a mouse, having
the same functions as those of the respective mouse buttons.

A

rectangular region indicated by a symbol SF indicates an operating

surface operated by a coordinates pointer (not shown in FIG. 2).

The

coordinates pointer mentioned here may for example be the finger of a

user, and hereunder is described as such.
A sensor substrate 1 shown in FIG. I, has a plurality of horizontal
scanning lines (in the X axis direction in FIG. 2) and vertical scanning

lines (in the Y axis direction in FIG. 2) formed into a matrix shape, the
construction being such that touching a finger on the operating surface

SF, causes the value of the current flowing in the respective scanning
lines to change.

To explain in more detail, the coordinates detection

device PD of the present embodiment employs a device referred to as an

electrostatic capacity type tablet.

This device has electrodes provided

APLNDC00027802

6

in matrix form on respective front and rear surfaces of an electrostatic
film, and an electric field is formed by supplying a pulse signals from
one side of the electrostatic film.

Since with this arrangement

touching the electrostatic film with the finger via the operating surface
SF causes a drop in the electrostatic capacity of the touched portion,
then converting the change in electrostatic capacity to a change in

current value enables the position of the portion touched by the finger

to be detected.

That is to say, the coordinates position of the touched

portion is indicated by the intersection of the horizontal scanning lines
and the vertical scanning lines. Furthermore, if the separation of the
finger after touching is detected, then the above-mentioned tapping
operation can be detected.

Moreover, the operation of sliding the

finger on the operating surface SF can be detected by computing the
positional change of the touched portion.
The pad need not be an electrostatic capacity type, but may for
example adopt a pressure sensitive system or the like.
A horizontal scanning section 2 involves a ci-cuit for horizontal

scanning of the sensor substrate I, and has a plurality of signal outputs
connected to the horizontal scanning lines of the sensor substrate 1.

A vertical scanning section 3 involves a circuit for vertical scanning

of the sensor substrate 1.

This circuit has a plurality of signal inputs

connected to the vertical scanning lines of the sensor substrate 1, and

generates a serial detection signal showing the inger operating
condition.

The serial detection signal includes a tap component

produced when the finger is tapped on the sensor substrate 1 via the
operating surface SF, and a slide component produced when the finger
is slid on the operating surface SF.

The tap component includes an

address component indicating the location on the operating surface SF
where the finger contacts, while the slide compo cent includes an

address component indicating the "from and to" location of the finger
sliding on the operating surface SF.

APLNDC00027803

7

A control drive section 4 supplies respective scanning drive signals
to the horizontal scanning section 2 and the vertical scanning section 3,

to thereby drive the horizontal scanning section 2 and the vertical
scanning section 3.
An A/D (analog/digital) conversion section 5 converts the serial

detection signal generated by the vertical scanning section 3 into a
digital signal.
A tap/slide component extraction section 6, extracts the before-

mentioned tap component and slide component from the digital signal
of the converted serial detection signal, and then separates these and

converts them into three dimensional coordinates values, and outputs
these coordinates values together with the tap component and the slide
component.

A data processing section 7 determines whether or not tapping is
being executed, based on the three dimensional coordinates values sent

from the tap/slide component extraction section 6, and also eliminates
noise from the slide component, thereby corrects the change in the

finger position in the two dimensional coordinates (constituted by the
X/Y axes) of the operating surface SF, into a smooth straight line or
curve.
An interface section 8 involves a circuit for carrying out data transfer
with the coordinates output device PC.

Based on the information sent

from the data processing section 7, the interface section 8 appends the
tap

ON/OFF

information and

the respective ON/OFF

information

related to the left button LB and the right button RB, for each of the
corrected absolute coordinates (X, Y) of the two dimensional
coordinates on the operating surface SF, and outputs this together with
the tap component and the slide component, to an output port 9.
The various structural components of the coordinates output device

PC will now be described.

APLNDC00027804

8

An interface section 10 involves a circuit for carrying out data
transfer with the coordinates detection device PD, receiving the abovementioned respective information

via

an input port

1.

If the

coordinates output device PC is a personal computer, then the interface

section 10 corresponds to the well-known serial port or the well-known
mouse port.
A data analysis section 12 receives and analyzes information from the

interface section 10 sent from the coordinates detection device PD.

It

carries out judgment processing such as determining if tapping is being
executed, and if the finger is being slid within a range in a

predetermined region of the operating surface SF.

The judgment

results are then sent to a data conversion section 13.

Based on the judgment results for the presence of tapping or finger
sliding within a predetermined region analyzed by the data analysis

section 12, the data conversion section 13 judges whether or not
predetermined specific processing should be carried out.

This

predetermined processing involves for example, right button emulation
processing and various processing in an Easy X mode.

These

processing will be discussed in detail later.

A mode conversion section 14 stores various set values for the
coordinates input apparatus.

The arrangement is such that the data

conversion section 13 converts the contents of the processing based on

the set values sent from the mode conversion section 14.

As described

hereunder, these set values are for example, the range in a region on the

operating surface SF tapped by the user when carrying out various
processing in the right button emulation mode or the Easy X mode, and
settings for whether or not the user is to be notified by sound that the
various processing are being carried out.

The set values are set for

example by the user in the mode conversion section 14, by known
processing for operating the menu on the computer screen.

APLNDC00027805