U.S. patent application number 14/070011 was filed with the patent office on 2014-04-24 for adapting layout and text font size for viewer distance from tv.
This patent application is currently assigned to SONY CORPORATION. The applicant listed for this patent is SONY CORPORATION. Invention is credited to Brant Candelore.
Application Number | 20140111694 14/070011 |
Document ID | / |
Family ID | 50115096 |
Filed Date | 2014-04-24 |
United States Patent
Application |
20140111694 |
Kind Code |
A1 |
Candelore; Brant |
April 24, 2014 |
ADAPTING LAYOUT AND TEXT FONT SIZE FOR VIEWER DISTANCE FROM TV
Abstract
The size of characters presented on a display of an audio video
display device (AVDD) such as a TV is changed based on a distance
from the AVDD at which a viewer is sensed as being located.
Inventors: |
Candelore; Brant; (San
Diego, CA) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
SONY CORPORATION |
Tokyo |
|
JP |
|
|
Assignee: |
SONY CORPORATION
Tokyo
JP
|
Family ID: |
50115096 |
Appl. No.: |
14/070011 |
Filed: |
November 1, 2013 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
13658272 |
Oct 23, 2012 |
8659703 |
|
|
14070011 |
|
|
|
|
Current U.S.
Class: |
348/581 |
Current CPC
Class: |
G08C 17/02 20130101;
H04N 21/44218 20130101; H04N 21/4312 20130101; H04N 5/2628
20130101; G08C 23/04 20130101; G08C 2201/91 20130101; G08C 2201/30
20130101; H04N 5/44504 20130101 |
Class at
Publication: |
348/581 |
International
Class: |
H04N 5/262 20060101
H04N005/262 |
Claims
1. A device comprising: at least one processor configured to send
images to a display; computer readable storage medium accessible to
the processor and bearing instructions executable by the processor
to configure the processor to: present on the display a user
interface (UI) listing plural discrete distances from which a user
can select a discrete distance on the list; receive a user
selection from the list of a distance between a viewer and the
display; and present content optimized for observance on the
display for the distance.
2. (canceled)
3. The device of claim 1, wherein the processor is configured to
alter a size of at least one icon being presented on the display
responsive to the distance.
4-7. (canceled)
8. The device of claim 1, wherein the device is a TV and the
display is incorporated in the TV.
9. Method comprising: imaging plural viewers of a video display
simultaneously using at least one camera; responsive to a
determination that plural viewers of the display are simultaneously
imaged, selecting a first one of the plural viewers using at least
one selection test; determining a distance from the display at
which the first viewer of the display is located; and based on the
distance, presenting content optimized for observance on the
display at the distance.
10. The method of claim 9, wherein the method is executed by a
processor in the AVD.
11-20. (canceled)
Description
FIELD OF THE INVENTION
[0001] The present application relates generally to adjusting the
layout and text and font sizes of images presented on audio video
display devices (AVDD) such as TVs based on a viewer's distance
from the AVDD.
BACKGROUND OF THE INVENTION
[0002] Large screen audio video display devices (AVDD) such as TVs
are increasingly used to fulfill roles formerly played by personal
computers, foremost among them being to surf the Internet. Unlike
users operating computers, however, whose distance from the
computer screen is predictable to within a few inches thus
facilitating use of standard onscreen font sizes and icon sizes, TV
viewers usually are seated variable and thus unpredictable
distances from the TV. As understood herein, the result is that
Internet-sourced text on TV screens is often too small to read,
creating a user unfriendly experience.
SUMMARY OF THE INVENTION
[0003] Multiple ways are disclosed to determine the distance that
the viewer is away from a TV display, and based on that, to alter
the font and icon size of characters presented on the display. In
one embodiment the TV automatically adjusts the layout and font
size to accommodate incoming web pages. The second approach is for
software executed by the TV to communicate to the server the
following information: the type of client, e.g., TV with 40'' with
HD resolution screen running in full screen mode, and proximity of
the viewer to the screen. The intent of the second approach would
be that the server would adapt the web page for the TV client.
[0004] In one aspect, the distance to the remote control (RC),
which is typically located with the viewer, is used as a surrogate
for viewer distance. In another aspect, a camera on the TV images
the viewer and determines viewer distance from the TV. In either
case, note that adjusting the size of text and icons can
precipitate a change of the layout of web page or the arrangement
of items on screen. Also, the viewing angle up or down and also to
the side is subjective to how much of the "big screen" effect they
want to have. Some viewers will be closer in order to be more
immersed into the programming while others will be further
back.
[0005] Accordingly, a device includes a processor configured to
send demanded images to a display, and a computer readable storage
medium accessible to the processor and bearing instructions
executable by the processor to configure the processor to determine
a distance between a viewer and the display. Responsive to the
distance, the processor alters a size of text being presented on
the display from a first size to a second size different from the
first size.
[0006] If desired, the processor can determine the distance based
on user input or based on a sensor signal, altering the size of
text being presented on the display substantially in real time as
making the determination of the distance. The processor may also be
configured to alter a size of icons being presented on the display
responsive to the distance. The sensor signal may be from, e.g., a
position receiver, a camera, or a sonic transducer. With more
particularity, responsive to the distance, the processor is
configured to alter a first size of text being presented on the
display at a first time at which the viewer is positioned a first
distance from the device, to a second size at a second time at
which the viewer is positioned a second distance from the
device.
[0007] In another aspect, a method includes sensing a distance at
which a viewer of an audio video display device (AVDD) is located,
and changing a size of characters presented on a display of the
AVDD based on the distance from the AVDD at which the viewer is
sensed as being located.
[0008] In another aspect, a system includes a remote control (RC)
including a touch screen, and an audio video display device (AVDD)
receiving signals from the RC and responsive to swipes by a user on
the touch screen, enlarging and reducing font sizes of characters
presented on a display of the AVDD.
[0009] In another aspect a method includes sensing or receiving a
distance at which a viewer of an audio video display device (AVDD)
is located, and communicating the distance information to a web
server. Screen resolution can also be communicated from the AVDD to
the server. The distance information may be communicated as part of
the User Agent field of the HTTP request message for a web page, or
as part of a query string that is part of the URL requesting a web
page.
[0010] The details of the present invention, both as to its
structure and operation, can be best understood in reference to the
accompanying drawings, in which like reference numerals refer to
like parts, and in which:
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] FIG. 1 is a block diagram of a non-limiting example system
in accordance with present principles;
[0012] FIG. 2 is a block diagram of an example remote control
(RC);
[0013] FIG. 3 is a flow chart of example logic according to present
principles; and
[0014] FIG. 4 is a screen shot of an example UI for entering
distance.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
[0015] Referring initially to the non-limiting example embodiment
shown in FIG. 1, a system 10 includes an audio video display device
(AVDD) 12 such as a TV including a TV tuner 16 communicating with a
TV processor 18 accessing a tangible computer readable storage
medium 20 such as disk-based or solid state storage. The AVDD 12
can output audio on one or more speakers 22. The AVDD 12 can
receive streaming video from the Internet using a built-in wired or
wireless modem 24 communicating with the processor 12 which may
execute a software-implemented browser 26. Video is presented under
control of the TV processor 18 on a TV display 28 such as but not
limited to a high definition TV (HDTV) flat panel display, and may
be a touch screen display. The display 28 may be a 40'' or larger
display. User commands to the processor 18 may be wirelessly
received from a remote control (RC) 30 using, e.g., rf or infrared.
Audio-video display devices other than a TV may be used, e.g.,
smart phones, game consoles, personal digital organizers, notebook
computers and other types of computers, etc.
[0016] TV programming from one or more terrestrial TV broadcast
sources 32 as received by a terrestrial broadcast antenna 34 which
communicates with the AVDD 12 may be presented on the display 28
and speakers 22. The terrestrial broadcast programming may conform
to digital ATSC standards and may carry within it a terrestrial
broadcast EPG, although the terrestrial broadcast EPG may be
received from alternate sources, e.g., the Internet via Ethernet,
or cable communication link, or satellite communication link.
[0017] TV programming from a cable TV head end 36 may also be
received at the TV for presentation of TV signals on the display 28
and speakers 22. When basic cable only is desired, the cable from
the wall typically carries TV signals in QAM or NTSC format and is
plugged directly into the "F-type connector" 38 on the TV chassis
in the U.S., although the connector used for this purpose in other
countries may vary. In contrast, when the user has an extended
cable subscription for instance, the signals from the head end 36
are typically sent through a STB 40 which may be separate from or
integrated within the TV chassis but in any case which sends HDMI
baseband signals to the TV. Other types of connections may be used,
e.g., MOCA, USB, 1394 protocols, DLNA.
[0018] Similarly, HDMI baseband signals transmitted from a
satellite source 42 of TV broadcast signals received by an
integrated receiver/decoder (IRD) 44 associated with a home
satellite dish may be input to the AVDD 12 for presentation on the
display 28 and speakers 22. Also, streaming video may be received
from the Internet 46 for presentation on the display 28 and
speakers 22. The streaming video may be received at the computer
modem 24 or it may be received at an in-home modem 48 that is
external to the AVDD 12 and conveyed to the AVDD 12 over a wired or
wireless Ethernet link and received at an RJ45 or 802.11x antenna
on the TV chassis.
[0019] Also, in some embodiments one or more cameras 50, which may
be video cameras integrated in the chassis if desired or mounted
separately and electrically connected thereto, may be connected to
the processor 18 to provide to the processor 18 video images of
viewers looking at the display 28. The one or more cameras 50 may
be positioned on top of the chassis of the AVDD, behind the display
and looking through display, or embedded in the display. Because
the cameras 50 are intended to detect a person they may be infrared
(IR) cameras embedded behind the display.
[0020] Use of two or more cameras 50 can make locating the position
of a viewer by the processor 18 easier. The cameras 50 may be two
dissimilar cameras, e.g., one conventional and one IR camera. Since
the camera locations are known by the processor 18, by training the
size of a viewer of default size (e.g., five feet ten inches tall)
can be learned, hence distance can be easily determined. Yet again,
if three cameras are used, no training would be required as XYZ can
be resolved by triangulation. An alternative option to the use of
cameras 50 is proximity technology to enable repositioning of the
virtual control ICONs. The following patent documents, incorporated
herein by reference, disclose such technology: USPPs 2008/0122798;
2010/0127970; 2010/0127989; 2010/0090948; 2010/0090982.
Furthermore, a microphone 52 may be provided on the chassis or
separate therefrom and can be electrically connected to the
processor 16 to provide viewer-generated voice commands to the
processor 16.
[0021] Now referring to FIG. 2, an example RC 30 is shown. The RC
30 may include a processor 54 accessing a computer readable storage
medium 55 and controlling a display 56 such as a touch screen
display. The processor may receive viewer input from a keypad 58
and send commands in response to the input to the AVDD 12 by means
of a transmitter 60 such as but not limited to an infrared (IR)
transmitter.
[0022] In the embodiment shown, the processor 54 may receive
position information from a position receiver 62 such as a global
positioning satellite (GPS) receiver that is authorized to receive
highly accurate position information. Note that the AVDD 12 may
also include a position receiver. In some embodiments, the RC 30
may include a distancing transceiver 64 such as a sonic
transceiver.
[0023] In other embodiments, a manually entered distance is
measured or estimated by the viewer during configuration. The
distance is input to the TV. From then on the TV will adjust web
pages and other parameters noted herein according to this inputted
distance. The TV might display, on a UI 400 such as that shown in
FIG. 4, a set distances that a customer can choose, e.g., 6 feet, 8
feet, 10 feet, 12 feet, 15 feet, 17 feet or greater, etc. The
distance that is entered or chosen by the user can also be
delivered to websites by the TV. The server at the remote website
can adjust the content for proper rendering on the TV. The distance
information can be delivered as part of Query String that is part
of the web page being requested or as User Agent data that is part
of the HTTP request transaction for the web page.
[0024] FIG. 3 illustrates present logic. Commencing at decision
diamond 66, the AVDD processor 18 determines, using for instance
image recognition techniques applied to images from the camera(s)
50, whether multiple human viewers are located in front of the
display 28. This may be done by comparing the forms of images in
the signals from the camera(s) 50 to prestored forms on the
computer readable storage medium 20. Responsive to a determination
that multiple viewers are present the logic moves to block 68 to
select a viewer. Selection may be effected by any one or more of
heuristic tests. For example, the largest viewer in the camera's
field may be selected, or the smallest. Or, the center-most image
in the camera's field of view may be selected. Yet again, the image
closest to an image matching the pattern of the RC 30 may be
selected on the assumption that he who controls the RC rules the
day.
[0025] From block 68 or from decision diamond 66 when the test
there is negative, the logic proceeds to block 70 to obtain the
distance to the selected viewer. This may be done using multiple
cameras 50 as described above, or by using the above-referenced
proximity technology. Or, recognizing that a viewer typically is
co-located with the RC 30, the RC 30 may send its position as
obtained from the position receiver 62 to the AVDD 12, which then
determines the difference between its own position and that of the
RC 30. Yet again, the RC 30 may, when pointed at the AVDD 12 to
send an IR command signal, for example, also be programmed to
simultaneously emit a sonic pulse from the sonic transceiver 64,
which may be arranged on the RC 30 such that its beam direction
matches that of the IR transceiver 60. The reflected sound wave
from the AVDD 12 is then detected by the RC processor 54 and the
time difference between transmission and reception of the
reflection used to determine the distance between the AVDD 12 and
RC 30 by multiplying the time difference by a nominal speed of
sound in air. The RC processor 54 then sends this distance to the
AVDD 12 via, e.g., the IR transmitter 60, preferably automatically
while the RC 30 is still pointed at the AVDD 12 which is possible
since the sound wave round trip and subsequent distance calculation
occur in near real time while the viewer is still pointing the RC
at the AVDD.
[0026] Yet again, instead of directly measuring the distance to the
RC, the AVDD 12 may determine, based on the size of its image
received from the camera 50, how far it is by, e.g., accessing a
data structure correlating image size to RC distance. This is
feasible because the size of the RC generally is known a priori and
hence its relative sizes based on a various distances are known and
stored in the AVDD memory 20.
[0027] As stated above, the AVDD may simply use the distance input
by the user from the UI 400 of FIG. 4.
[0028] Once the viewer distance is known, the distance is
correlated to a font and/or icon size at block 72. This may done by
accessing a data structure correlating various viewer distances to
font sizes. Or, a linear or other algorithm may be used to
determine font sizes based on distance by, e.g., multiplying the
distance by an empirically determined fraction. Once the font size
is determined, all fonts or some predetermined subset thereof,
and/or all icons or some predetermined subset thereof, are given
that size and then rendered when demanded on the AVDD display 28.
Thus, the size of fonts (and icons if desired) on the AVDD display
changes based on the distance at which the viewer is located from
the AVDD. Note that the distance consequently can be based on a
sensor signal (from the camera or sonic sensor or position
receiver, etc.) and the alteration of the size of text is done
substantially in real time as making the determination of the
distance, i.e., within the computer processing time it takes to
correlate the distance to font size once the distance is
determined.
[0029] In some implementations, the logic may next flow to decision
diamond 74 to determine if the new font size is large enough to
require a wrap-around of text or other presentation artifact that
may be undesired. If not, the logic ends, but if so, the logic may
move to block 76 to select a first alternate layout for, e.g., the
web page sought to be presented without the artifact caused by an
enlarged font size. For example, if the default web page shows
three columns of two rows each of selector elements, thumbnails, or
other object, the first alternate layout may be two columns of
three rows each. Or, the distance onscreen between adjacent objects
may be reduced from the default distance to move the objects closer
together and thereby permit more room for enlarged text. Or, the
total number of objects may be reduced in the first alternate
layout vis-a-vis the default layout and the remaining objects
enlarged.
[0030] If the artifact is determined to be resolved by use of the
first alternate layout at decision diamond 78, the layout is
selected at block 80. Otherwise, it is determined if the alternate
layout is the last available layout at decision diamond 82 and if
not another layout is selected at block 84 for testing at decision
diamond 78. If the last layout has been unsuccessfully tested,
however, the logic presents a default "best" layout at block 86,
which may be the original layout with the artifact.
[0031] In another embodiment, the touch screen 56 of the RC 30 may
be swiped by a user to enlarge and reduce font sizes on the AVDD 12
and/or to control the AVDD 12. The user interface on the AVDD 12
may be sent to the RC 30 (via, e.g., IP connection, IR
transmission, or other means) and as the UI on the RC is
manipulated, the RC sends corresponding signals to the AVDD such
that the UI on the AVDD is manipulated as well. Changes in
resulting UI appearance may be shown only on the AVDD, not the RC
30. Note that the RC 30 may be established by a tablet computer or
smart phone.
[0032] While the particular ADAPTING LAYOUT AND TEXT FONT SIZE FOR
VIEWER DISTANCE FROM TV is herein shown and described in detail, it
is to be understood that the subject matter which is encompassed by
the present invention is limited only by the claims.
* * * * *