CN101944349A - Display control unit and display control method - Google Patents

Display control unit and display control method Download PDF

Info

Publication number
CN101944349A
CN101944349A CN2010102154383A CN201010215438A CN101944349A CN 101944349 A CN101944349 A CN 101944349A CN 2010102154383 A CN2010102154383 A CN 2010102154383A CN 201010215438 A CN201010215438 A CN 201010215438A CN 101944349 A CN101944349 A CN 101944349A
Authority
CN
China
Prior art keywords
display
beholder
control unit
image
thumbnail
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2010102154383A
Other languages
Chinese (zh)
Other versions
CN101944349B (en
Inventor
村上智之
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN101944349A publication Critical patent/CN101944349A/en
Application granted granted Critical
Publication of CN101944349B publication Critical patent/CN101944349B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0261—Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0464—Positioning

Abstract

A kind of display control unit is provided, has comprised: the captured image acquiring unit, it obtains the beholder's who watches display image captured image; Detecting unit, its captured image based on the beholder who is obtained by described captured image acquiring unit detects viewing location and the viewing distance of beholder with respect to display image; And indicative control unit, its viewing distance according to the beholder who is detected by described detecting unit changes the size of display image, and the beholder's that will be detected by described detecting unit viewing location is associated with the display position of display image simultaneously.

Description

Display control unit and display control method
Technical field
The present invention relates to display control unit and display control method, and particularly, relate to according to viewing location and control display control unit and the display control method that display image shows.
Background technology
For many sections (piece) contents are presented on the display screen as tabulation, after downscaled images, show the rest image of represent content usually.Dwindle the rest image that shows represent content by this way and be called as the thumbnail demonstration.Though showing, thumbnail make the beholder can in a screen, confirm many sections contents, existence such as the poor visibility that depends on the viewing distance content and distinguish problem the details difficulty of content.For example, when on giant-screen TV, showing many thumbnails and beholder, exist thumbnail to show too little and can not catch the problem of content detail away from display screen.
Thereby, in order to strengthen the visuality of content, disclose according to environment around the beholder or the distance between display device and the beholder and regulated the technology (for example, Japanese Patent Application Laid-Open No.H7-93089 and Japanese Patent Application Laid-Open No.2008-72561) that picture quality was exported and regulated to audio frequency.For example, according to Japanese Patent Application Laid-Open No.H7-93089, the part of beholder health of identification such as nose, and if the more close display device of nose, then amplify display image, and if nose moves away from display device, then dwindle display image.According to Japanese Patent Application Laid-Open No.2008-72561, regulate picture quality and character boundary according to the distance between display screen and the beholder.
Summary of the invention
Yet, according to Japanese Patent Application Laid-Open No.7-93089 and Japanese Patent Application Laid-Open No.2008-72561, though can amplify/dwindle display image according to the distance between display device and the beholder, there are the following problems: be difficult to show the thumbnail that to distinguish easily from beholder's position by the size and the quantity of appropriately regulating thumbnail image according to beholder's position.
According to above, expect to provide and suitably to carry out the novelty of thumbnail demonstration and display control unit and the display control method that improves according to beholder's distance or position.
According to embodiments of the invention, a kind of display control unit is provided, comprising: the captured image acquiring unit, it obtains the beholder's who watches display image captured image; Detecting unit, its captured image based on the beholder who is obtained by described captured image acquiring unit detects viewing location and the viewing distance of beholder with respect to display image; And indicative control unit, its viewing distance according to the beholder who is detected by described detecting unit changes the size of display image, and the beholder's that will be detected by described detecting unit viewing location is associated with the display position of display image simultaneously.
According to above-mentioned configuration, captured image based on the beholder who watches display image detects viewing location and the viewing distance of beholder with respect to display image, and the size that can change display image according to this viewing distance, the viewing location with the beholder that detected is associated with the display position of display image simultaneously.Thereby, can make display screen appropriately show the display image of thumbnail etc. according to beholder's distance or position.
In addition, indicative control unit can make display screen show a plurality of display images, and the display position of a display image in a plurality of display images is associated with beholder's viewing location so that display screen with other display images be presented at this display image around.
In addition, indicative control unit can be controlled the demonstration quantity of a plurality of display images according to beholder's viewing distance.
In addition, indicative control unit can change the demonstration quantity of a plurality of display images according to beholder's viewing distance, and the display position with a display image in a plurality of display images is associated with beholder's viewing location simultaneously.
In addition, this display image can be just reproduced content.
In addition, this display image can be the display image that shows on the full screen of display screen.
In addition, detecting unit can detect beholder's sight line position based on the beholder's who is obtained by the captured image acquiring unit captured image, and indicative control unit can be selected a display image and demonstration according to the beholder's who is detected by detecting unit sight line position from a plurality of display images.
In addition, if according to this display image of sight line choice of location of beholder and shown the schedule time or poorer, then indicative control unit can make display screen reproduce and this display image associated content.
In addition, detecting unit can detect beholder's face orientation based on the beholder's who is obtained by the captured image acquiring unit captured image, and indicative control unit can roll a plurality of display images that are presented on the display screen according to beholder's face orientation or beholder's sight line position.
In addition, but indicative control unit can make a plurality of display images roll in the horizontal direction after deletion be positioned at display image outside the viewing area of display screen, but and other display images that make display screen will be different from a plurality of display images be presented in the viewing area that does not show a plurality of display images of display screen.
According to another embodiment of the present invention, provide a kind of display control method, comprised the steps: to obtain the beholder's who watches display image captured image; Based on the beholder's who is obtained captured image, detect viewing location and the viewing distance of beholder with respect to described display image; And changing the size of described display image according to the beholder's who is detected viewing distance, the viewing location with the beholder that detected is associated with the display position of described display image simultaneously.
As mentioned above, according to the present invention, can appropriately carry out the thumbnail demonstration according to beholder's distance or position.
Description of drawings
Fig. 1 is the explanatory of illustration according to the hardware configuration of the display control unit of the embodiment of the invention;
Fig. 2 is the block diagram that illustrates according to the functional configuration of the display control unit of embodiment;
Fig. 3 A is that diagram is according to the display position of the display image of embodiment and the explanatory of demonstration quantity;
Fig. 3 B is that diagram is according to the display position of the display image of embodiment and the explanatory of demonstration quantity;
Fig. 4 is that diagram is according to the demonstration quantity of the thumbnail of embodiment and the explanatory of size;
Fig. 5 is that diagram is according to the demonstration quantity of the thumbnail of embodiment and the explanatory of size;
Fig. 6 is that diagram shows the explanatory of thumbnail according to embodiment according to beholder's sight line position;
Fig. 7 is diagram shows thumbnail according to the face orientation according to the beholder of embodiment a explanatory;
Fig. 8 is the process flow diagram according to the image display process of beholder's position that illustrates according to embodiment;
Fig. 9 is the process flow diagram according to the image display process of beholder's sight line that illustrates according to embodiment; And
Figure 10 is the process flow diagram according to the image display process of beholder's face orientation that illustrates according to embodiment.
Embodiment
Hereinafter, with preferred embodiments of the present invention will be described in detail with reference to the annexed drawings.What note is in this instructions and accompanying drawing, to represent to have in fact the structural elements of identical function and structure with identical reference marker, and omit the repeat specification of these structural elements.
To " embodiment " be described with the order shown in following:
[1] purpose of present embodiment
[2] hardware configuration of display control unit
[3] functional configuration of display control unit
[4] details of the image display process in the display control unit
[1] purpose of present embodiment
For many sections contents are presented on the display screen as tabulation, after downscaled images, show the rest image of represent content usually.Dwindle the rest image that shows represent content by this way and be called as the thumbnail demonstration.Though showing, thumbnail make the beholder can in a screen, confirm many sections contents, existence such as the poor visibility that depends on viewing distance, content and distinguish problem the details difficulty of content.For example, when on giant-screen TV, showing many thumbnails and beholder, exist thumbnail to show too little and can not catch the problem of content detail away from display screen.
Thereby,, disclose according to environment around the beholder or the distance between display device and the beholder and regulated the technology that picture quality was exported and regulated to audio frequency in order to strengthen the visuality of content.For example, a kind of technology is disclosed, according to this technology, the part of beholder health of identification such as nose, and if the more close display device of nose, then amplify display image, and if nose moves away from display device, then dwindle display image.And, a kind of technology is disclosed, according to this technology, regulate picture quality and character boundary according to the distance between display screen and the beholder.
Yet, according to above-mentioned technology of the prior art, though can amplify/dwindle display image according to the distance between display device and the beholder, there are the following problems: be difficult to make that by the size and the quantity of appropriately regulating thumbnail image according to beholder's position can distinguish thumbnail easily from beholder's position shows.Pay close attention to above-mentioned situation and cause establishment according to the display control unit 10 of the embodiment of the invention.According to the display control unit in the present embodiment 10, can appropriately carry out the thumbnail demonstration according to beholder's distance or position.
In order when reproducing program that (reproduce) received by the TV machine or recorded content, to check other programs or to watch other recorded content, the content that (in the past) reproducing before needing to interrupt.Under these circumstances, be difficult to when view content, check and perhaps select other content in other.Yet according to the display control unit in the present embodiment 10, if there is the content reproducing, the thumbnail that can make display control unit 10 carry out other content shows and does not interrupt its reproduction.In addition, when the thumbnail that makes display control unit 10 carry out other content shows, become and to regulate the thumbnail position or to dwindle thumbnail according to beholder's position.
Recently, along with the digitizing of TV broadcasting, the TV machine is not only handled the reception and the demonstration of TV broadcasting, also handles a large amount of content of multimedia, for example content, reproduction rest image or music is provided and carries out rabbit from recording medium via network.Therefore, there are the following problems: the operation of TV machine becomes and becomes increasingly complex, and the button quantity of Long-distance Control increases, and causes lower utilization rate.Also there are the following problems: because there are many situations that can not find Long-distance Control in the portability of Long-distance Control, and spend some times and seek (detect) Long-distance Control, need fetch Long-distance Control when perhaps operating Long-distance Control at every turn.
According to present embodiment, as mentioned above, can regulate thumbnail according to beholder's position and show and the inoperation Long-distance Control.Orientation of face by the identification beholder or sight line change position that thumbnail shows or selection and thumbnail associated content and also become possibility.When the beholder moves away from display screen, can show that the visuality of improving thumbnail need not remote control operation by amplifying reduced thumbnail.
[2] hardware configuration of display control unit
Next, the hardware configuration of display control unit 10 will be described with reference to figure 1.Fig. 1 is the explanatory of illustration according to the hardware configuration of the display control unit 10 of present embodiment.
Display control unit 10 comprises: CPU (CPU (central processing unit)) 101, ROM (ROM (read-only memory)) 102, RAM (random access memory) 103, host bus 104, bridge 105, external bus 106, interface 107, input equipment 108, output device 109 and memory device (HDD) 110, driving 111 and communication facilities 112.
CPU 101 serves as operation processing unit and control module, and controls whole operations in the display control unit 10 according to various programs.CPU 101 can be a microprocessor.The program that ROM 102 storages are used by CPU 101, computing parameter etc.The temporary transient storage of RAM 103 be used for the program carried out by CPU 101 and its term of execution appropriate change parameter.Host bus 104 these unit of interconnection of forming by cpu bus etc.
Host bus 104 links to each other with external bus 106 such as PCI (periphery component interconnection/interface) bus via bridge 105.By the way, do not need to form respectively host bus 104, bridge 105 and external bus 106, but can implement these functions by unified bus.
Input equipment 108 is as the input media that is used for user's input information such as mouse, keyboard, touch pad, button, microphone, switch and control lever, input based on the user generates input signal, and is made up of to output to CPU 101 input control circuit etc.The user of display control unit 10 can import various types of data or the processing operational order is provided to display control unit 10 by operation input apparatus 108.
Output device 109 is made up of display device and the audio output apparatus such as loudspeaker and earphone such as CRT (cathode-ray tube (CRT)) display unit, liquid crystal display (LCD) unit, OLED (organic light emitting display) unit and lamp.For example, the content of output device 109 output reproductions.More specifically, display device will be shown as text or image such as the various types of information the video data that reproduces.On the other hand, audio output apparatus is converted to audio frequency with the voice data that reproduces etc. and exports.
Memory device 110 is the equipment that is used for data storage that constitutes as the example according to the storage unit of the display control unit 10 of present embodiment, and can comprise storage medium, with the delete device of the recording unit of data recording in the storage medium, the data that from the readout equipment of storage medium read data and deletion storage medium, write down.For example, memory device 110 is made up of HDD (hard disk drive).Memory device 110 drives hard disk, and storage is by program and various types of data of CPU 101 execution.
Driving 111 is the read write lines that are used for storage medium, and is included in the display control unit 10 or is attached to display control unit 10 from the outside.Drive the information of 111 reading and recording in the movable storage medium 120 such as disk, CD, magneto-optic disk and the semiconductor memory installed, and information is exported to RAM 103.
The communication interface that communication facilities 112 is made up of the communication facilities that for example is used to be connected to communication network 50.Communication facilities 112 can be WLAN (LAN (Local Area Network)) but but compatible communication equipment, Wireless USB compatible communication equipment or the wire communication facility by the circuit executive communication.
[3] functional configuration of display control unit
The hardware configuration of display control unit 10 has been described hereinbefore.Next, the functional configuration of display control unit 10 will be described with reference to figure 2.As shown in Figure 2, display control unit 10 mainly comprises: captured image acquiring unit 152, graphics processing unit 154, detecting unit 158, indicative control unit 160 and video/audio processing unit 162.
Captured image acquiring unit 152 has the function of the captured image that obtains the beholder who watches display image.Beholder's captured image is picked up by imaging device 20, and is provided for captured image acquiring unit 152.In the present embodiment, imaging device 20 is separated with display control unit 10, but the invention is not restricted to such example, but imaging device 20 and display control unit 10 can be configured to integrated device.After by 20 pairs of beholder's imagings of imaging device, the position and the operation that become and can detect the distance between beholder and the display control unit 10 and detect the beholder such as face orientation and sight line.Imaging device 20 may be provided in outside framework (frame) part of display device 30, to detect beholder's operation more accurately.
Captured image acquiring unit 152 can be operated etc. with predetermined space or according to the user and obtain captured image.For example, captured image acquiring unit 152 can obtain captured image with predetermined space after the display device 30 that shows display image is opened by user's operation.Alternately, the captured image that obtains the beholder when user operates can detected.Captured image acquiring unit 152 offers graphics processing unit 154 with beholder's captured image.
Graphics processing unit 154 has the function that beholder's unique point is provided from the beholder's who is provided by captured image acquiring unit 152 captured image.For example, beholder's unique point is beholder's position and distance, face orientation or a sight line.Graphics processing unit 154 comprises: viewing location processing unit 155, sight line position processing unit 156 and face orientation processing unit 157.
Viewing location processing unit 155 has from beholder's captured image and to extract that the position of represent between display device 30 and the beholder concerns or the function of the unique point of distance.Viewing location processing unit 155 uses the outside drawing picture of beholder's healths etc. to extract from beholder's self captured image that the position of represent between display device 30 and the beholder concerns or the unique point of distance.For example, can extract face area with respect to the size of beholder's entire image as unique point with from this unique point computed range.Alternately, the viewing location processing unit 155 position relation that can utilize the range sensor of infrared radiation etc. to extract to represent between display device 30 and the beholder by use or the unique point of distance.
Sight line position processing unit 156 has the function of extracting the unique point of the sight line position of representing the beholder from beholder's captured image.Sight line position processing unit 156 can extract the unique point that for example parts of images conduct of beholder's eyes is used to discern the sight line position.Sight line position processing unit 156 calculates the coordinate of sight line on image from the parts of images of beholder's eyes.Face orientation processing unit 157 has the function of extracting the unique point of the face orientation of representing the beholder from beholder's captured image.For example, the skin color of face area or the profile of its eyes, face etc. are extracted in the position of the face area of face orientation processing unit 157 in can recognition image, as the unique point that is used to discern face orientation.
Graphics processing unit 154 will offer detecting unit 158 by the individual features point that viewing location processing unit 155, sight line position processing unit 156 and face orientation processing unit 157 provide.Detecting unit 158 has from function 154 that provide by graphics processing unit, detect the information relevant with beholder's operation based on the unique point of beholder's captured image.For example, the information relevant with beholder's operation be beholder's positional information or range information, about the information in face orientation or about the information of sight line.
For example, detecting unit 158 from extract by viewing location processing unit 155, face area calculates beholder's positional information or range information with respect to the size of entire image.Detecting unit 158 also calculates the coordinate of sight line position on image from the parts of images of beholder's eyes of being extracted by sight line position processing unit 156.Detecting unit 158 is also discerned beholder's face orientation from the profile of the skin color of the face area that extracted by face orientation processing unit 157 or its eyes, face etc.
Detecting unit 158 can be from coming calculating location information or range information by the information of viewing location processing unit 155 extractions with by the information that sight line position processing unit 156 extracts.Detecting unit 158 can also be from information of being extracted by viewing location processing unit 155 and the face orientation of being calculated the beholder by the information that face orientation processing unit 157 extracts.Detecting unit 158 offers indicative control unit 160 with the information relevant with the beholder's who is detected operation.
Indicative control unit 160 has the function that viewing distance according to the beholder who is detected by detecting unit 158 changes the size of display image, the beholder's that will be detected by detecting unit 158 simultaneously viewing location is associated with the display position of display image.For example, when on display screen, showing a plurality of display image, indicative control unit 160 is associated the display position of a display image in a plurality of display images with beholder's viewing location so that display screen with other display images be presented at this display image around.Indicative control unit 160 also changes the demonstration quantity of a plurality of display images according to beholder's viewing distance.
In addition, indicative control unit 160 has the function that changes the demonstration quantity of a plurality of display images, simultaneously the display position of a display image in a plurality of display images is associated with beholder's viewing location according to beholder's viewing distance.Indicative control unit 160 is also selected according to the beholder's who is detected by detecting unit 158 sight line position and is shown a display image in a plurality of display images.For example, when on display screen, showing a plurality of thumbnail,, then can select and this thumbnail of demonstration on full screen if beholder's sight line position overlaps with one of a plurality of thumbnails.Alternately, can reproduce this thumbnail that overlaps with beholder's sight line position.
If by detecting unit 158 detection beholders' face orientation, then can make a plurality of thumbnails rollings (scroll) that on display screen, show according to beholder's face orientation.For example, if beholder's face orientation is a left direction, a plurality of thumbnails are rolled on left direction.In this case, but the thumbnail that is positioned at outside the viewing area outside the display screen is just wiped, and on the left of making that other thumbnails different with shown thumbnail are presented at successively.
To describe the thumbnail that is undertaken by indicative control unit 160 with reference to figure 3 to 7 shows.At first, will describe the display position of the display image of controlling by indicative control unit 160 and show quantity with reference to figure 3A and 3B.Below, description is dwindled a plurality of display images and it is presented at a thumbnail demonstration in the screen.
Fig. 3 A is diagram beholder's the distance and the explanatory of the relation between the thumbnail demonstration.As shown in Figure 3A, suppose beholder 40 be positioned at the central authorities of display screen 301, and gradually near display screen 301.On display screen 301, reproducing the content that beholder 40 watches.On display screen 301, on full screen, show the content of reproducing.
Along with beholder 40 near display screens 301, it is such that indicative control unit 160 is shown as display screen 302 with display screen 301.Just, just dwindle the size of the content of on display screen 301, reproducing, and other guide is shown (display screen 302) with the content of concern.Just decide the display position of the content of watching by beholder 40 according to the beholder's who detects by detecting unit 158 position.The quantity and the size that decide thumbnail images shown on display screen 302 according to the beholder who detects by detecting unit 158 and the distance between the display device 30.
In Fig. 3 A, beholder 40 is positioned at the central authorities of display screen 301, thereby the content that will watch is arranged in the central authorities of display screen 302 bottoms.In addition, on display screen 302, show three thumbnails.For example, if thumbnail images shown is represented moving image on display screen 302, then after its viewing area is reduced, can not reproduce the content of watching, and other guide is the thumbnail of rest image with changing.
Along with beholder 40 further near display screen 302, just the thumbnail of being watched by beholder 40 is reduced and be disposed in central authorities, and shows nine thumbnails on display screen 303.Along with beholder 40 further near display screen 303, just the thumbnail of being watched by beholder 40 is reduced and be disposed in central authorities, and shows 15 thumbnails on display screen 304.As mentioned above, just decide the display position of the thumbnail of watching by beholder 40 and the demonstration quantity and the size that decide thumbnail according to the distance between beholder 40 and the display device 30 according to beholder's position.
Hypothesis beholder 40 is positioned at the left side of display screen 311 in Fig. 3 B.Equally in this case, just decide the display position of the content of watching by beholder 40 according to the beholder's who detects by detecting unit 158 position.Just, if beholder 40 near display screens 311, be positioned at the left side of display screen 311 simultaneously, then dwindle the demonstration size of the content of just reproducing, and the content of other guide with concern is shown on display screen 311.
As mentioned above, beholder 40 is positioned at the left side of display screen 311, thereby shown in display screen 312, along with beholder's 40 close display screens 311, shows three thumbnails, and the content of watching is disposed in the left side.Along with the further close display screen 312 of beholder 40, just the thumbnail of being watched by beholder 40 is being disposed in the central authorities in left side, and shows nine thumbnails on display screen 313.Along with beholder 40 further near display screen 313, just the thumbnail of being watched by beholder 40 is reduced and be disposed in the central authorities in left side, and shows 15 thumbnails on display screen 314.
The demonstration quantity and the size of thumbnail will be described with reference to Figure 4 and 5.Fig. 4 is the demonstration quantity of diagram thumbnail and the explanatory of size.For example, as shown in Figure 4, be the situation of incremental range from 0 to 100 with 10 with describing one group of distance threshold.As this group distance threshold, for example, be set to h1 with 0 to 9,10 to 19 are set to h2,20 to 29 are set to h3, and 30 to 39 are set to h4, and 40 to 49 are set to h5, and 50 to 59 are set to h6,60 to 69 are set to h7, and 70 to 79 are set to h8, and 80 to 89 are set to h9, and 90 to 99 are set to h10.If by the beholder 40 of detecting unit 158 detections and the distance between the display device 30 is 65, then this range information is compared with threshold information to determine that the threshold information of h7 is applicatory.
As shown in Figure 5, if range information, show that quantity and size are associated, then can according to range information decide will be on display screen the demonstration quantity and the size of thumbnail images shown.Fig. 5 is the demonstration quantity and the explanatory of size with respect to the mapping example of distance of diagram thumbnail.For example, if distance between 60 and 70, then the range information of " h7 " (number) be suitable for, make the demonstration quantity of thumbnail be decided to be five with, and size is 160 * 160.Will be described below the demonstration quantity of decision thumbnail and the method for size.
Next, will with reference to figure 6 describe by indicative control unit 160 controls, according to the demonstration of the thumbnail of beholder's sight line position.As shown in Figure 6, suppose in beholder's sight line 41 and a plurality of thumbnails that on display screen 321, show to coincide by the thumbnail of arrow indication.Then, on display screen 322, the selecteed mode of thumbnail that coincides with indication and beholder's sight line 41 shows this thumbnail.
On display screen 322, two display boxes can be used for selected thumbnail, can arrange that perhaps the color different with the color of other thumbnails is chosen in visually thumbnail and can discerns.Alternately, can wait by arrow and thumbnail is chosen in visually can discern.Then, if beholder's sight line 41 has coincided the schedule time with selected thumbnail, this thumbnail is shown to reproduce content (display screen 324) on full screen.
Next, will with reference to figure 7 describe by indicative control unit 160 controls, according to the demonstration of the thumbnail of beholder's face orientation.As shown in Figure 7, on display screen 311, show as much as possible a plurality of thumbnails that can in display screen, show.Then, if the face orientation 42 that detects the beholder in the left side, shown in display screen 332, thumbnail then rolls on the right direction as the direction opposite with beholder's face orientation 42.Though thumbnail is rolled according to beholder's face orientation, thumbnail is rolled according to beholder's direction of visual lines.Alternately, shown in display screen 333, when having shown all thumbnails that will be shown, can stop to roll.Alternately, when the beholder faces the place ahead, can stop to roll.The demonstration of the thumbnail that is undertaken by indicative control unit 160 has been described hereinbefore.
Return Fig. 2, will continue the description of the functional configuration of display control unit 10.Indicative control unit 160 will offer video/audio processing unit 162 such as the quantity of thumbnail and the display control information size and the thumbnail position.Video/audio processing unit 162 comprises: video/audio receiving element 163, video signal processing unit 164, video memory 165, video sealer (scaler) 166 and audio treatment unit 167.After video/audio receiving element 163 receiver, videos and audio frequency, amplify and detect the signal that received before outputing to video signal processing unit 164 and audio treatment unit 167 respectively, being vision signal and sound signal this Signal Separation.
Video signal processing unit 164 is regulated and is encoded from the vision signal of video/audio receiving element 163 outputs, and the vision signal of being regulated is outputed to video memory 165.The sound signal that audio treatment unit 167 is regulated and coding is exported from video/audio receiving element 163.Be output to again before the display device 30, the vision signal that will output to video memory 165 by video sealer 166 be adjusted to by indicative control unit 160 orders or according to the video size of size of display.
[4] details of the image display process in the display control unit
The functional configuration of display control unit 10 has been described hereinbefore.Next, the details of the image display process in the display control unit 10 will be described with reference to figure 8 to 10.Fig. 8 is the process flow diagram that illustrates according to the image display process of beholder's position.As shown in Figure 8, at first by the face size of viewing location processing unit 155 identifications, and by the distance (S102) between detecting unit 158 measurement beholders and the display device 30 by the beholder of imaging device 20 imagings.Face size based on the beholder in step S102 is come measuring distance, but the invention is not restricted to such example, and can come measuring distance based on the size at other positions that are different from face such as beholder's nose.
Next, the range information that will in step S102, measure of indicative control unit 160 compare with the threshold information of pre-registration (pre-registered) (S104).More specifically, indicative control unit 160 is compared threshold information N with the size of viewing distance.If viewing distance, then increases the value (S106) of threshold value N greater than threshold value N.For example, suppose that calculated distance is 10 in step S104, and the sets of threshold values of pre-registration is an incremental range from 0 to 100 with 10.In this case, at first in step S104 compare threshold 0 and the distance 10.Because at the comparison middle distance 10 of step S104 greater than threshold value 0, so threshold value 0 is added 1.In this case, the processing among the execution in step S108 when threshold value becomes 10.
Then, the viewing distance of measuring among the indicative control unit 160 determining step S102 whether with the viewing distance of measuring last time identical (S108).If viewing distance is identical with the measured value of the viewing distance of measuring last time in step S108, then termination.If indicative control unit 160 determines that in step S108 the measured value of the viewing distance that viewing distance and last time measure is different, demonstration quantity and the size (S110) that decides image according to as shown in Figure 5 threshold value and the mapping between the demonstration quantity then.
Next, indicative control unit 160 determines whether to reproduce content (S112).If indicative control unit 160 is determined reproducing content, then measure beholder's position (S114) in step S112.Right side and the leftward position of beholder with respect to display device 30 measured in position measurement among the step S114.Then, dwindle and show the content of just watching, come mobile content (S116) according to beholder's position then by the beholder.
For example, if the beholder is positioned at the right side with respect to display device 30, then reduced content is moved to the right side.If the beholder is positioned at the left side with respect to display device 30, then reduced content is moved to the left side.Change the ratio that reduces of content among the step S116 according to the image size that determines among the step S110.
According to the demonstration quantity of the image that determines among the step S110 shift position of content is arranged in optimum position.For example, shown in Fig. 3 B, when the beholder is positioned at the left side, be that the content that will reproduce is arranged in the left side according to the optimum position that shows quantity, shown in display screen 312.Increase if show quantity, shown in display screen 313 and 314, then the content that will reproduce is arranged in the central authorities in left side.
Then, with more than the viewing distance that determines in step S110 is threshold value N-1 and demonstration quantity and the size of threshold value N when following show a plurality of thumbnails (S118).If the quantity of content displayed section is the maximum quantity of inclusive segment on display screen in step S118, then the content that can stop to reproduce.This is to become minimum because if show the content of a large amount of sections and the size of every section content on display screen, even if then reproduce content, the details of content may visually also be unrecognizable.
Thereby according to present embodiment, becoming to change the demonstration quantity and the size of thumbnail according to the distance between beholder and the display device 30 or its position, perhaps just reproduced thumbnail can be arranged in the position that the beholder can see easily.
Next, will be with reference to the details of figure 9 descriptions according to the image display process of beholder's sight line.Fig. 9 is the process flow diagram that illustrates according to the image display process of beholder's sight line.As shown in Figure 9, at first determine whether on display screen, to have shown any thumbnail (S202).If determine to have shown thumbnail in step S202, then detecting unit 158 calculates the coordinate (S204) of sight line position on screen according to the parts of images of the eyes that extracted by sight line position processing unit 156.
Then, the sight line position of determining the beholder that in step S204, calculates whether with the position of any thumbnail that is showing coincide (S206).Just be positioned on one of thumbnail images shown if in step S206, determine beholder's sight line position, then determine the sight line position whether with display position last time identical (S210) of pointer (cursor).It is the discernible demonstration of selection that makes thumbnail that pointer among the step S210 shows.Will be discussed in more detail below the situation when the sight line position of determining the beholder in step S206 is not positioned on any thumbnail that is showing.
Then, if determine that in step S210 the sight line position is identical with display position last time of pointer, determine then pointer shows whether continued the set time (S212).If determine that in step S210 the sight line position is different with display position last time of pointer, then carry out pointer demonstration (S208) at thumbnail at the coordinate place of current viewing location.Then, the processing among the repeating step S202 to S210.
Continued the set time if in step S212, determine the pointer demonstration, then selected the content (S214) relevant with the thumbnail that is positioned at pointer demonstration place.In step S214, can show with full screen and reproduce the content relevant with selected thumbnail.Thereby, can make the beholder expect that the content reproduced reproduces automatically and do not use any Long-distance Control.
Do not coincide if in step S206, determine beholder's sight line position and any thumbnail that is showing, then next determine the current pointer demonstration (S216) of whether having carried out.If in step S216, determine the current pointer demonstration of having carried out, then delete relevant pointer and show (S218).When the sight line position of beholder in step S206 and any thumbnail did not coincide, the beholder did not see thumbnail, thereby deletion is used to select the pointer of a thumbnail to show.Show the then processing among the execution in step S220 if in step S216, determine the current pointer that do not carry out.
Then, determine whether to have passed through the set time (S220).If after definite beholder does not watch the content that is shown as thumbnail, in step S220, passed through the set time, the tabulation of then deleting thumbnail shows, and is reproducing current content of watching on the full screen or showing the content (S222) of watching before the thumbnail.If in step S220, do not pass through the set time, then handle and turn back to step S202.
Hereinbefore, describe image display process in detail according to beholder's sight line.Next, will details according to the image display process of beholder's face orientation be described with reference to Figure 10.Figure 10 is the process flow diagram that illustrates according to the image display process of beholder's face orientation.As shown in figure 10, determine whether on full screen, to show thumbnail, just show the thumbnail (S302) of the maximum quantity that can in display screen, show.The situation that shows thumbnail in step S302 in full screen is beholder during near display screen, increases and the situation of the thumbnail of the maximum quantity that last demonstration can show in display screen in thumbnail images shown quantity on the display screen.
If determine to show thumbnail in full screen in step S302, then detecting unit 158 is measured beholder's face orientation (S304).Detecting unit 158 calculates face orientation according to the skin color of the face area in the image that is extracted by face orientation processing unit 157 or the profile of its eyes, face etc. in step S304.Then, the face orientation of measuring among determining step S304 face forward (S306) whether.
If determine that in step S306 face orientation is not a face forward, thumbnail (S308) then rolls on the direction opposite with face orientation.For example, if beholder's face orientation is a right direction in step S308, thumbnail is rolled on left direction.If beholder's face orientation is a left direction, thumbnail is rolled on right direction.
Thumbnail is rolled mean translation (translate) thumbnail, the result, but it is deleted to shift out the thumbnail image of viewing area of display screen, so that new thumbnail is presented in the white space of creating by the translation of thumbnail.Thereby,, still can visually discern new thumbnail continuously and not carry out the remote control operation of trouble even if be difficult to all displayable thumbnails are presented in the display screen.
Hereinbefore, describe image display process in detail according to beholder's face orientation.As mentioned above, according to the display control unit in the present embodiment 10, can detect based on the beholder's who watches display image captured image the beholder viewing location and with the viewing distance of display image, and can change the size of display image according to viewing distance, the viewing location with the beholder that detected is associated with the display position of display image simultaneously.Thereby, can the display image such as thumbnail appropriately be shown according to beholder's distance or position.
If there is the content reproducing, the thumbnail image that can make display screen carry out other guide shows and does not stop its reproduction.In addition, when the thumbnail that makes display screen carry out other guide shows, can regulate the position of thumbnail or can dwindle thumbnail according to beholder's position.
In addition, can regulate thumbnail according to beholder's position and show the remote control operation that need not the beholder.In addition, by identification beholder's face orientation or sight line, becoming to change position or the selection content relevant with thumbnail that thumbnail shows.When the beholder moves away from display screen, can show the visuality of improving thumbnail and need not carry out remote control operation by amplifying reduced thumbnail.
Also become and to change the demonstration quantity or the size of thumbnail or to reproduce content according to beholder's position or its sight line or face orientation.Therefore, can according to beholder's position or its sight line or face orientation come appropriate control chart picture demonstration and without the complex operations of hand or the gesture of exaggeration.
It will be understood by those skilled in the art that and depend on designing requirement and other factors that various modifications, combination, sub-portfolio and alternative can the generation are as long as they are in the scope of claims or its equivalent.
For example,, need not come each step in the processing of processes and displays control device 10 in chronological order here with the described order of process flow diagram.Just, each step in the processing of display control unit 10 can comprise processing (for example, the processing of parallel processing or object) parallel or that carry out separately.
And, can create making the hardware such as CPU, ROM and RAM that is comprised in the display control unit 10 present computer program with the function of the function equivalent of each unit of above-mentioned display control unit 10.Also provide and made the storage medium of storage computation machine program.
The application comprise with the Japanese priority patent application JP 2009-159149 that was filed in Jap.P. office on July 3rd, 2009 in the relevant theme of disclosed theme, its full content is incorporated herein by reference.

Claims (11)

1. display control unit comprises:
The captured image acquiring unit, it obtains the beholder's who watches display image captured image;
Detecting unit, its captured image based on the beholder who is obtained by described captured image acquiring unit detects viewing location and the viewing distance of beholder with respect to display image; And
Indicative control unit, its viewing distance according to the beholder who is detected by described detecting unit changes the size of display image, and the beholder's that will be detected by described detecting unit viewing location is associated with the display position of display image simultaneously.
2. display control unit according to claim 1, wherein said indicative control unit make display screen show a plurality of display images, and
The display position of a display image in described a plurality of display images is associated with beholder's viewing location, so that described display screen is presented at other display images around the described display image.
3. display control unit according to claim 2, wherein said indicative control unit are controlled the demonstration quantity of described a plurality of display images according to beholder's viewing distance.
4. display control unit according to claim 3, wherein said indicative control unit changes the demonstration quantity of described a plurality of display images according to beholder's viewing distance, and the display position with a display image in described a plurality of display images is associated with beholder's viewing location simultaneously.
5. display control unit according to claim 2, a wherein said display image is just reproduced content.
6. display control unit according to claim 2, a wherein said display image is the display image that shows on the full screen of described display screen.
7. the beholder's that display control unit according to claim 2, wherein said detecting unit are obtained based on described captured image acquiring unit captured image detects beholder's sight line position, and
The beholder's that described indicative control unit detects according to described detecting unit sight line position and from described a plurality of display images, select a display image and show.
8. display control unit according to claim 7, if wherein according to the described display image of beholder's sight line choice of location and shown the schedule time or longer, then described indicative control unit reproduces and a described content that display image is relevant described display screen.
9. the beholder's that display control unit according to claim 8, wherein said detecting unit are obtained based on described captured image acquiring unit captured image detects beholder's face orientation, and
Described indicative control unit rolls the described a plurality of display images that are presented on the described display screen according to beholder's face orientation or beholder's sight line position.
10. display control unit according to claim 2, but wherein said indicative control unit make described a plurality of display image roll in the horizontal direction after deletion be positioned at display image outside the viewing area of described display screen, but and other display images that make described display screen will be different from described a plurality of display images be presented in the viewing area that does not show described a plurality of display images of described display screen.
11. a display control method comprises the steps:
Obtain the beholder's who watches display image captured image;
Based on the beholder's who is obtained captured image, detect viewing location and the viewing distance of beholder with respect to described display image; And
Change the size of described display image according to the beholder's who is detected viewing distance, the viewing location with the beholder that detected is associated with the display position of described display image simultaneously.
CN201010215438.3A 2009-07-03 2010-06-24 Display control unit and display control method Active CN101944349B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009159149A JP5423183B2 (en) 2009-07-03 2009-07-03 Display control apparatus and display control method
JP159149/09 2009-07-03

Publications (2)

Publication Number Publication Date
CN101944349A true CN101944349A (en) 2011-01-12
CN101944349B CN101944349B (en) 2015-09-02

Family

ID=42716901

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010215438.3A Active CN101944349B (en) 2009-07-03 2010-06-24 Display control unit and display control method

Country Status (4)

Country Link
US (1) US8963950B2 (en)
EP (1) EP2270772B1 (en)
JP (1) JP5423183B2 (en)
CN (1) CN101944349B (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102158721A (en) * 2011-04-06 2011-08-17 青岛海信电器股份有限公司 Method and device for adjusting three-dimensional image and television
WO2011150889A2 (en) * 2011-06-24 2011-12-08 华为终端有限公司 Automatic screen display adjustment method and device
CN102638689A (en) * 2011-02-09 2012-08-15 扬智科技股份有限公司 Three-dimensional display magnification method
CN102724454A (en) * 2011-03-29 2012-10-10 宏碁股份有限公司 System and method for dynamically configuring service information in pictures
CN102737615A (en) * 2011-03-31 2012-10-17 索尼公司 Display control device, display control method, and program
CN102890925A (en) * 2011-03-24 2013-01-23 柯尼卡美能达商用科技株式会社 Data manipulation transmission apparatus and data manipulation transmission method
CN102970550A (en) * 2011-09-01 2013-03-13 联想移动通信科技有限公司 Open hole visible three-dimensional (3D) display control system and method
CN103295503A (en) * 2012-03-02 2013-09-11 鸿富锦精密工业（深圳）有限公司 Digital bulletin system and digital bulletin method
CN103795913A (en) * 2012-10-30 2014-05-14 三星电子株式会社 Method for controlling camera of device and device thereof
CN103870149A (en) * 2012-12-18 2014-06-18 联想(北京)有限公司 Data processing method and electronic equipment
CN103902179A (en) * 2012-12-28 2014-07-02 华为技术有限公司 Interaction method and device
CN104145233A (en) * 2012-02-23 2014-11-12 英特尔公司 Method and apparatus for controlling screen by tracking head of user through camera module, and computer-readable recording medium therefor
CN105474303A (en) * 2013-09-02 2016-04-06 索尼公司 Information processing device, information processing method, and program
CN107870708A (en) * 2016-09-27 2018-04-03 富士施乐株式会社 Image display device, image processing system and method for displaying image
CN108810627A (en) * 2018-07-05 2018-11-13 京东方科技集团股份有限公司 A kind of display device and its display methods
US10136069B2 (en) 2013-02-26 2018-11-20 Samsung Electronics Co., Ltd. Apparatus and method for positioning image area using image sensor location
CN110162232A (en) * 2018-02-11 2019-08-23 中国移动通信集团终端有限公司 Screen display method, device, equipment and storage medium with display screen
CN110503891A (en) * 2019-07-05 2019-11-26 太仓秦风广告传媒有限公司 A kind of electronic bill-board transform method and its system based on distance change
CN111754827A (en) * 2020-05-20 2020-10-09 四川科华天府科技有限公司 Presentation system based on AR interactive teaching equipment
CN112217950A (en) * 2019-07-12 2021-01-12 富士施乐株式会社 Image display device, image forming apparatus, storage medium, and image display method
CN114816641A (en) * 2022-05-09 2022-07-29 海信视像科技股份有限公司 Display device, multimedia content display method, and storage medium

Families Citing this family (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8326814B2 (en) 2007-12-05 2012-12-04 Box, Inc. Web-based file management system and service
GB2500356A (en) 2011-01-20 2013-09-18 Box Inc Real time notification of activities that occur in a web-based collaboration environment
KR101514170B1 (en) * 2011-04-27 2015-04-21 엔이씨 솔루션 이노베이터 가부시키가이샤 Input device, input method and recording medium
JP2012253440A (en) * 2011-05-31 2012-12-20 Toshiba Corp Display device and display control method
US9015601B2 (en) 2011-06-21 2015-04-21 Box, Inc. Batch uploading of content to a web-based collaboration environment
US9063912B2 (en) 2011-06-22 2015-06-23 Box, Inc. Multimedia content preview rendering in a cloud content management system
EP2729877A4 (en) 2011-07-08 2015-06-17 Box Inc Desktop application for access and interaction with workspaces in a cloud-based content management system and synchronization mechanisms thereof
GB2503625A (en) 2011-07-08 2014-01-01 Box Inc Collaboration sessions in a workspace on cloud-based content management system
US9197718B2 (en) 2011-09-23 2015-11-24 Box, Inc. Central management and control of user-contributed content in a web-based collaboration environment and management console thereof
JP5269166B2 (en) * 2011-09-29 2013-08-21 株式会社東芝 Electronic device and control method thereof
US8515902B2 (en) 2011-10-14 2013-08-20 Box, Inc. Automatic and semi-automatic tagging features of work items in a shared workspace for metadata tracking in a cloud-based content management system with selective or optional user contribution
WO2013062599A1 (en) 2011-10-26 2013-05-02 Box, Inc. Enhanced multimedia content preview rendering in a cloud content management system
US9098474B2 (en) 2011-10-26 2015-08-04 Box, Inc. Preview pre-generation based on heuristics and algorithmic prediction/assessment of predicted user behavior for enhancement of user experience
US8990307B2 (en) 2011-11-16 2015-03-24 Box, Inc. Resource effective incremental updating of a remote client with events which occurred via a cloud-enabled platform
WO2013082320A1 (en) 2011-11-29 2013-06-06 Box, Inc. Mobile platform file and folder selection functionalities for offline access and synchronization
US9019123B2 (en) 2011-12-22 2015-04-28 Box, Inc. Health check services for web-based collaboration environments
US11232481B2 (en) 2012-01-30 2022-01-25 Box, Inc. Extended applications of multimedia content previews in the cloud-based content management system
JP5964603B2 (en) * 2012-02-08 2016-08-03 シャープ株式会社 Data input device and display device
US9965745B2 (en) 2012-02-24 2018-05-08 Box, Inc. System and method for promoting enterprise adoption of a web-based collaboration environment
US9195636B2 (en) 2012-03-07 2015-11-24 Box, Inc. Universal file type preview for mobile devices
JP5994328B2 (en) 2012-03-29 2016-09-21 ソニー株式会社 Information processing apparatus, information processing method, and computer program
US9054919B2 (en) 2012-04-05 2015-06-09 Box, Inc. Device pinning capability for enterprise cloud service and storage accounts
US9575981B2 (en) 2012-04-11 2017-02-21 Box, Inc. Cloud service enabled to handle a set of files depicted to a user as a single file in a native operating system
JP2015121567A (en) * 2012-04-11 2015-07-02 シャープ株式会社 Display controller and display device
US9413587B2 (en) 2012-05-02 2016-08-09 Box, Inc. System and method for a third-party application to access content within a cloud-based platform
GB2505272B (en) 2012-05-04 2014-07-09 Box Inc Repository redundancy implementation of a system which incrementally updates clients with events that occurred via cloud-enabled platform
US9691051B2 (en) 2012-05-21 2017-06-27 Box, Inc. Security enhancement through application access control
US9027108B2 (en) 2012-05-23 2015-05-05 Box, Inc. Systems and methods for secure file portability between mobile applications on a mobile device
US8914900B2 (en) 2012-05-23 2014-12-16 Box, Inc. Methods, architectures and security mechanisms for a third-party application to access content in a cloud-based platform
US9021099B2 (en) 2012-07-03 2015-04-28 Box, Inc. Load balancing secure FTP connections among multiple FTP servers
US9712510B2 (en) 2012-07-06 2017-07-18 Box, Inc. Systems and methods for securely submitting comments among users via external messaging applications in a cloud-based platform
US9792320B2 (en) 2012-07-06 2017-10-17 Box, Inc. System and method for performing shard migration to support functions of a cloud-based service
GB2505072A (en) 2012-07-06 2014-02-19 Box Inc Identifying users and collaborators as search results in a cloud-based system
US9237170B2 (en) 2012-07-19 2016-01-12 Box, Inc. Data loss prevention (DLP) methods and architectures by a cloud service
US8868574B2 (en) 2012-07-30 2014-10-21 Box, Inc. System and method for advanced search and filtering mechanisms for enterprise administrators in a cloud-based environment
US9794256B2 (en) 2012-07-30 2017-10-17 Box, Inc. System and method for advanced control tools for administrators in a cloud-based service
US8745267B2 (en) 2012-08-19 2014-06-03 Box, Inc. Enhancement of upload and/or download performance based on client and/or server feedback information
US9369520B2 (en) 2012-08-19 2016-06-14 Box, Inc. Enhancement of upload and/or download performance based on client and/or server feedback information
GB2513671A (en) 2012-08-27 2014-11-05 Box Inc Server side techniques for reducing database workload in implementing selective subfolder synchronization in a cloud-based environment
US9135462B2 (en) 2012-08-29 2015-09-15 Box, Inc. Upload and download streaming encryption to/from a cloud-based platform
US9195519B2 (en) 2012-09-06 2015-11-24 Box, Inc. Disabling the self-referential appearance of a mobile application in an intent via a background registration
US9117087B2 (en) 2012-09-06 2015-08-25 Box, Inc. System and method for creating a secure channel for inter-application communication based on intents
US9311071B2 (en) 2012-09-06 2016-04-12 Box, Inc. Force upgrade of a mobile application via a server side configuration file
US9292833B2 (en) 2012-09-14 2016-03-22 Box, Inc. Batching notifications of activities that occur in a web-based collaboration environment
US10200256B2 (en) 2012-09-17 2019-02-05 Box, Inc. System and method of a manipulative handle in an interactive mobile user interface
US9553758B2 (en) 2012-09-18 2017-01-24 Box, Inc. Sandboxing individual applications to specific user folders in a cloud-based service
US10915492B2 (en) 2012-09-19 2021-02-09 Box, Inc. Cloud-based platform enabled with media content indexed for text-based searches and/or metadata extraction
US9959420B2 (en) 2012-10-02 2018-05-01 Box, Inc. System and method for enhanced security and management mechanisms for enterprise administrators in a cloud-based environment
US9705967B2 (en) 2012-10-04 2017-07-11 Box, Inc. Corporate user discovery and identification of recommended collaborators in a cloud platform
US9495364B2 (en) 2012-10-04 2016-11-15 Box, Inc. Enhanced quick search features, low-barrier commenting/interactive features in a collaboration platform
US9665349B2 (en) 2012-10-05 2017-05-30 Box, Inc. System and method for generating embeddable widgets which enable access to a cloud-based collaboration platform
US9756022B2 (en) 2014-08-29 2017-09-05 Box, Inc. Enhanced remote key management for an enterprise in a cloud-based environment
US9628268B2 (en) 2012-10-17 2017-04-18 Box, Inc. Remote key management in a cloud-based environment
JP6099948B2 (en) * 2012-11-28 2017-03-22 京セラ株式会社 Electronic device, control program, and display control method
US10235383B2 (en) 2012-12-19 2019-03-19 Box, Inc. Method and apparatus for synchronization of items with read-only permissions in a cloud-based environment
US9396245B2 (en) 2013-01-02 2016-07-19 Box, Inc. Race condition handling in a system which incrementally updates clients with events that occurred in a cloud-based collaboration platform
US9953036B2 (en) 2013-01-09 2018-04-24 Box, Inc. File system monitoring in a system which incrementally updates clients with events that occurred in a cloud-based collaboration platform
EP2755151A3 (en) 2013-01-11 2014-09-24 Box, Inc. Functionalities, features and user interface of a synchronization client to a cloud-based environment
EP2757491A1 (en) 2013-01-17 2014-07-23 Box, Inc. Conflict resolution, retry condition management, and handling of problem files for the synchronization client to a cloud-based platform
JP2014143595A (en) * 2013-01-24 2014-08-07 Nikon Corp Image recorder
US10846074B2 (en) 2013-05-10 2020-11-24 Box, Inc. Identification and handling of items to be ignored for synchronization with a cloud-based platform by a synchronization client
GB2515192B (en) 2013-06-13 2016-12-14 Box Inc Systems and methods for synchronization event building and/or collapsing by a synchronization component of a cloud-based platform
US9805050B2 (en) 2013-06-21 2017-10-31 Box, Inc. Maintaining and updating file system shadows on a local device by a synchronization client of a cloud-based platform
US10229134B2 (en) 2013-06-25 2019-03-12 Box, Inc. Systems and methods for managing upgrades, migration of user data and improving performance of a cloud-based platform
US10110656B2 (en) 2013-06-25 2018-10-23 Box, Inc. Systems and methods for providing shell communication in a cloud-based platform
US9535924B2 (en) 2013-07-30 2017-01-03 Box, Inc. Scalability improvement in a system which incrementally updates clients with events that occurred in a cloud-based collaboration platform
GB2518298A (en) 2013-09-13 2015-03-18 Box Inc High-availability architecture for a cloud-based concurrent-access collaboration platform
US9535909B2 (en) 2013-09-13 2017-01-03 Box, Inc. Configurable event-based automation architecture for cloud-based collaboration platforms
US8892679B1 (en) * 2013-09-13 2014-11-18 Box, Inc. Mobile device, methods and user interfaces thereof in a mobile device platform featuring multifunctional access and engagement in a collaborative environment provided by a cloud-based platform
US10509527B2 (en) 2013-09-13 2019-12-17 Box, Inc. Systems and methods for configuring event-based automation in cloud-based collaboration platforms
US9213684B2 (en) 2013-09-13 2015-12-15 Box, Inc. System and method for rendering document in web browser or mobile device regardless of third-party plug-in software
US9704137B2 (en) 2013-09-13 2017-07-11 Box, Inc. Simultaneous editing/accessing of content by collaborator invitation through a web-based or mobile application to a cloud-based collaboration platform
US10866931B2 (en) 2013-10-22 2020-12-15 Box, Inc. Desktop application for accessing a cloud collaboration platform
JP2015087824A (en) * 2013-10-28 2015-05-07 オムロン株式会社 Screen operation device and screen operation method
CN103634646A (en) * 2013-11-15 2014-03-12 四川长虹电器股份有限公司 Method for reminding viewing distance away from TV
US20150221064A1 (en) * 2014-02-03 2015-08-06 Nvidia Corporation User distance based modification of a resolution of a display unit interfaced with a data processing device and/or a display area size thereon
KR101587177B1 (en) * 2014-03-11 2016-01-20 엘지전자 주식회사 Mobile terminal and method for controlling the same
US10530854B2 (en) 2014-05-30 2020-01-07 Box, Inc. Synchronization of permissioned content in cloud-based environments
US9602514B2 (en) 2014-06-16 2017-03-21 Box, Inc. Enterprise mobility management and verification of a managed application by a content provider
US9894119B2 (en) 2014-08-29 2018-02-13 Box, Inc. Configurable metadata-based automation and content classification architecture for cloud-based collaboration platforms
US10038731B2 (en) 2014-08-29 2018-07-31 Box, Inc. Managing flow-based interactions with cloud-based shared content
US10574442B2 (en) 2014-08-29 2020-02-25 Box, Inc. Enhanced remote key management for an enterprise in a cloud-based environment
JP2016095614A (en) * 2014-11-13 2016-05-26 ソフトバンク株式会社 Display control device and program
JP2016143310A (en) * 2015-02-04 2016-08-08 ソニー株式会社 Information processing device, image processing method, and program
JP6652251B2 (en) * 2015-03-26 2020-02-19 Ｎｅｃディスプレイソリューションズ株式会社 Display device, display method, and display program
US10002449B2 (en) * 2015-04-16 2018-06-19 Sap Se Responsive and adaptive chart controls
JP6157015B2 (en) * 2015-09-29 2017-07-05 シャープ株式会社 Receiving device, control method, and program
WO2017056955A1 (en) * 2015-09-29 2017-04-06 シャープ株式会社 Receiving device, control method and program
US10303341B2 (en) * 2016-05-25 2019-05-28 International Business Machines Corporation Modifying screen content based on gaze tracking and user distance from the screen
EP3489943A4 (en) 2016-07-19 2019-07-24 FUJIFILM Corporation Image display system, head-mounted-display control device, and method and program for actuating same
JP6233471B2 (en) * 2016-08-22 2017-11-22 ソニー株式会社 Information processing apparatus, information processing method, and computer program
JP7081901B2 (en) * 2016-10-21 2022-06-07 株式会社デンソーテン Display control device and display control method
KR101758040B1 (en) * 2017-01-03 2017-07-14 (주)셀텍 Apparatus for controlling television viewing
JP2017080516A (en) * 2017-01-17 2017-05-18 エイディシーテクノロジー株式会社 Display device
WO2020031453A1 (en) 2018-08-10 2020-02-13 ソニー株式会社 Information processing device and information processing method, and video-audio output system
US11614797B2 (en) * 2019-11-05 2023-03-28 Micron Technology, Inc. Rendering enhancement based in part on eye tracking

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020046100A1 (en) * 2000-04-18 2002-04-18 Naoto Kinjo Image display method
EP1426919A1 (en) * 2002-12-02 2004-06-09 Sony International (Europe) GmbH Method for operating a display device
CN1831932A (en) * 2005-03-11 2006-09-13 兄弟工业株式会社 Location-based information
CN101072293A (en) * 2006-05-09 2007-11-14 深圳Tcl新技术有限公司 Device and method for automatically regulating television screen display

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0793089A (en) 1993-09-22 1995-04-07 Hitachi Ltd Image editing device
JPH07181939A (en) * 1993-12-24 1995-07-21 Rohm Co Ltd Display device
US5731805A (en) 1996-06-25 1998-03-24 Sun Microsystems, Inc. Method and apparatus for eyetrack-driven text enlargement
JP2001319217A (en) * 2000-05-09 2001-11-16 Fuji Photo Film Co Ltd Image display method
US6886137B2 (en) * 2001-05-29 2005-04-26 International Business Machines Corporation Eye gaze control of dynamic information presentation
JP2004213486A (en) * 2003-01-07 2004-07-29 Sony Corp Image processor and processing method, storage medium, and program
JP2005050680A (en) * 2003-07-29 2005-02-24 Calsonic Kansei Corp Information display device
JP4495518B2 (en) * 2004-05-21 2010-07-07 日本放送協会 Program selection support apparatus and program selection support program
JP4697953B2 (en) * 2005-09-12 2011-06-08 キヤノン株式会社 Image display device and image display method
JP2008072561A (en) 2006-09-15 2008-03-27 Sharp Corp Television receiver
EP1950957A2 (en) 2007-01-23 2008-07-30 Funai Electric Co., Ltd. Image display system
JP2008181199A (en) 2007-01-23 2008-08-07 Funai Electric Co Ltd Image display system
JP4907483B2 (en) * 2007-09-28 2012-03-28 パナソニック株式会社 Video display device
JP2010004118A (en) * 2008-06-18 2010-01-07 Olympus Corp Digital photograph frame, information processing system, control method, program, and information storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020046100A1 (en) * 2000-04-18 2002-04-18 Naoto Kinjo Image display method
EP1426919A1 (en) * 2002-12-02 2004-06-09 Sony International (Europe) GmbH Method for operating a display device
CN1831932A (en) * 2005-03-11 2006-09-13 兄弟工业株式会社 Location-based information
CN101072293A (en) * 2006-05-09 2007-11-14 深圳Tcl新技术有限公司 Device and method for automatically regulating television screen display

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638689A (en) * 2011-02-09 2012-08-15 扬智科技股份有限公司 Three-dimensional display magnification method
CN102890925B (en) * 2011-03-24 2014-11-26 柯尼卡美能达商用科技株式会社 Data manipulation transmission apparatus and data manipulation transmission method
CN102890925A (en) * 2011-03-24 2013-01-23 柯尼卡美能达商用科技株式会社 Data manipulation transmission apparatus and data manipulation transmission method
CN102724454A (en) * 2011-03-29 2012-10-10 宏碁股份有限公司 System and method for dynamically configuring service information in pictures
CN102737615A (en) * 2011-03-31 2012-10-17 索尼公司 Display control device, display control method, and program
CN102158721B (en) * 2011-04-06 2012-12-05 青岛海信电器股份有限公司 Method and device for adjusting three-dimensional image and television
CN102158721A (en) * 2011-04-06 2011-08-17 青岛海信电器股份有限公司 Method and device for adjusting three-dimensional image and television
WO2011150889A3 (en) * 2011-06-24 2012-05-24 华为终端有限公司 Automatic screen display adjustment method and device
WO2011150889A2 (en) * 2011-06-24 2011-12-08 华为终端有限公司 Automatic screen display adjustment method and device
CN102970550A (en) * 2011-09-01 2013-03-13 联想移动通信科技有限公司 Open hole visible three-dimensional (3D) display control system and method
CN104145233B (en) * 2012-02-23 2017-10-27 英特尔公司 Track the head of user to control the method and apparatus and its computer readable recording medium storing program for performing of screen by camera module
CN104145233A (en) * 2012-02-23 2014-11-12 英特尔公司 Method and apparatus for controlling screen by tracking head of user through camera module, and computer-readable recording medium therefor
CN103295503A (en) * 2012-03-02 2013-09-11 鸿富锦精密工业（深圳）有限公司 Digital bulletin system and digital bulletin method
CN103795913A (en) * 2012-10-30 2014-05-14 三星电子株式会社 Method for controlling camera of device and device thereof
US10805522B2 (en) 2012-10-30 2020-10-13 Samsung Electronics Co., Ltd. Method of controlling camera of device and device thereof
CN103870149A (en) * 2012-12-18 2014-06-18 联想(北京)有限公司 Data processing method and electronic equipment
CN103870149B (en) * 2012-12-18 2017-08-29 联想(北京)有限公司 Data processing method and electronic equipment
CN103902179A (en) * 2012-12-28 2014-07-02 华为技术有限公司 Interaction method and device
US10136069B2 (en) 2013-02-26 2018-11-20 Samsung Electronics Co., Ltd. Apparatus and method for positioning image area using image sensor location
CN105474303B (en) * 2013-09-02 2018-05-18 索尼公司 Information processing unit, information processing method and program
CN105474303A (en) * 2013-09-02 2016-04-06 索尼公司 Information processing device, information processing method, and program
CN107870708A (en) * 2016-09-27 2018-04-03 富士施乐株式会社 Image display device, image processing system and method for displaying image
CN110162232A (en) * 2018-02-11 2019-08-23 中国移动通信集团终端有限公司 Screen display method, device, equipment and storage medium with display screen
US10861423B2 (en) 2018-07-05 2020-12-08 Boe Technology Group Co., Ltd. Display apparatus and display method thereof
CN108810627A (en) * 2018-07-05 2018-11-13 京东方科技集团股份有限公司 A kind of display device and its display methods
CN110503891A (en) * 2019-07-05 2019-11-26 太仓秦风广告传媒有限公司 A kind of electronic bill-board transform method and its system based on distance change
CN112217950A (en) * 2019-07-12 2021-01-12 富士施乐株式会社 Image display device, image forming apparatus, storage medium, and image display method
CN111754827A (en) * 2020-05-20 2020-10-09 四川科华天府科技有限公司 Presentation system based on AR interactive teaching equipment
CN114816641A (en) * 2022-05-09 2022-07-29 海信视像科技股份有限公司 Display device, multimedia content display method, and storage medium

Also Published As

Publication number Publication date
US20110001763A1 (en) 2011-01-06
EP2270772A2 (en) 2011-01-05
JP2011015301A (en) 2011-01-20
EP2270772A3 (en) 2011-06-29
CN101944349B (en) 2015-09-02
JP5423183B2 (en) 2014-02-19
US8963950B2 (en) 2015-02-24
EP2270772B1 (en) 2017-05-10

Similar Documents

Publication Publication Date Title
CN101944349B (en) Display control unit and display control method
US8935169B2 (en) Electronic apparatus and display process
US8166420B2 (en) Electronic apparatus and image display control method of the electronic apparatus
EP2109313B1 (en) Television receiver and method
CN101751907B (en) Variable scaling of image data for aspect ratio conversion
EP3364280A1 (en) Information processing apparatus, information processing method, and program
US8201105B2 (en) Electronic apparatus and image display control method of the electronic apparatus
CN101383141A (en) Image display control apparatus and image display control method
US20140282061A1 (en) Methods and systems for customizing user input interfaces
US8150168B2 (en) Electronic apparatus and image display control method of the electronic apparatus
CN111010610B (en) Video screenshot method and electronic equipment
CN102707830A (en) Display control device, display control method, and program
KR20090076388A (en) Method and apparatus for controlling video display in mobile terminal
US20120301030A1 (en) Image processing apparatus, image processing method and recording medium
US20120069218A1 (en) Virtual video capture device
US20120092374A1 (en) Systems, methods, and computer-readable media for placing a representation of the captured signature in a document
CN104469178A (en) Image display method and electronic device
JP2009194518A (en) Video processing apparatus and video processing method
US11356731B1 (en) Method and electronic device for displaying video
CN111373761B (en) Display device, control system of the display device, and method of controlling the display device
CN113852757A (en) Video processing method, device, equipment and storage medium
KR20180100873A (en) Electronic apparatus for playing substitutional advertisement and method for controlling method thereof
KR20160011158A (en) Screen sharing system and method
EP3568993B1 (en) Display device for recognizing user interface and controlling method thereof
CN109788346B (en) Video file configuration analysis method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant