DE102008002809A1 - Micromechanical device for e.g. binoculars, has image processing units, and imaging element and position, orientation or movement detecting system that are mechanically and fixedly connected with each other at common component - Google Patents

Abstract

The device has imaging elements e.g. micro opto electromechanical systems, for deflecting light beams (2), and systems for detecting position, orientation or movement of the device. Modification of imaging is performed based on data related to the position, the orientation or the movement of the device. One of the elements and one of the systems are mechanically and fixedly connected with each other at a common component. Image processing units are provided for image section selection, image selection, image stabilization and/or image correction.

Description

The The invention relates to a micromechanical device consisting of imaging elements for the deflection of light rays and a System for detecting position, orientation or movement of the Device by moving through the position, orientation or movement an influence on the imaging is achieved. Especially It is the subject of the present invention, an integrated system for image generation, motion detection and fast image stabilization offer.

With Micromechanics is an area of microsystem technology called the design, manufacture and application of the smallest mechanical components from a few to several 100 microns.

Digital "multimedia lozenges" are been on the market again and again for several years.

So far were mostly combined systems with LCD image sources and complex used shaped mirrors that create a virtual screen in front of the Let the viewer appear.

The designed image appears to the viewer virtually as big as a 40 inch flat screen at a few meters distance.

The Video signal is supplied via a cable or wireless. Because the two image sources for the left and right eye in principle separately controllable, can also stereo images / 3D Projections are realized by corresponding left and right stereotypically different images are fed.

In all previous video glasses for the consumer market was and is the image fixed relative to the video glasses, and if the glasses are firmly on the head, also fix based on the head position. D. H. when the user moves his head, the observable moves Picture with.

In more complex video glasses for "Virtual Reality Applications "and / or night vision devices, etc. come In addition, image stabilization methods are used. Use these Sensor signals that are triggered by the movement to to stabilize the image axes. In this way can also be an artificial horizon be created.

Previous Systems include separate sensors, separate imaging systems and separate computer units for calculating the digitally stabilized Images. These are comparatively large in volume and also less efficient in energy.

A another way to image for portable Devices such as video glasses offers the laser technology. In Between the years 2001 and 2003 projected projectors with ultra-bright tri-color laser light sources using holographic Mirrors designed by the "spectacle lens" should project onto the retina of the eye. As deflectors should be used in resonating micromirrors. These, however create a circular or spiral progressing Image construction and this in turn requires a complex conversion conventional orthogonal formatted image data.

alternative since the two-axis oscillating mirrors are known from the projector technology since The 1990s, the areal micro-mirror arrays for image generation, the so-called digital modulation method DLP (Digital Light processing). The mass and size for However, such DLP systems are so high that one use in one Head-mounted imaging system or even a light video glasses does not make sense.

Base Many imaging technologies are, as described above, M (O) EMS Optics, ie micro (opto) electro-mechanical systems. There are various designs, some with very special, sometimes also with very universal applications.

In DE 19523886 and US 6016217 a system is presented to chip with micro mirrors ("micro swivel actuator"). The small mirror strips are deflected by electrical forces and can thus be used for imaging by light deflection.

Another system is in DE 4229507 and US 5408355 described and includes a particularly three-dimensionally movable arrangement of a micromirror, with appropriately executed storage. These systems are not geared to the DLP modulation technique, but to analogue guidance of the beam angles in typically two solid angles and, in addition, direct adaptation of the beam path length and the mirror position.

Since 2000, projection systems have also been researched on the basis of special micromirrors, which should project images directly onto the retina of the eye. They use 2-axis self-resonant M (O) EMS mirrors. Therefore, they generate z. B. circular formatted images. Very weak and thus harmless laser beams are focused on the retina. To make this possible, a real or a holographic virtual reflector is required to reflect the light rays coming from behind the head back to the eye. The computational effort for reformatting The video images required the maximum speed of mobile processors and the viability of mobile systems.

So far, none of the systems described so far had an image stabilization. However, this effort was spent on specific applications, at least in planning and conceptual design:
Out WO 1998/037691 An adaptive camera system which can be used as a night vision device is known, in which the proper movement of the camera unit by head movement sensors is used to stabilize the visual axis.

to Image stabilization gyrometer and accelerometer are used. These are mounted in sensors. Alternatively, the head position also be determined from the outside visually or with other sensors. In addition, the eye position can be derived from reflection measurements on the cornea. This can be done with mathematical methods the required direction and the image detail for the calculate stabilized image generation. In sen modern cases The measurement signals come from MEMS-based sensors (micro electro-mechanical Systems), as they are similar in navigation devices find use in the car, so motion sensors, acceleration sensors and gyrometer etc. These send signals to the separate arithmetic unit, then the image manipulation in the separate imaging element (eg screen).

• – Bilderzeugungssystem
• – Sensorisches System
• – Rechensystem zur Bildmanipulation

In all cases of systems that have appeared so far, the functional units that perform this service together are organized separately:

• - Image generation system
• - Sensory system
• - Computer system for image manipulation

• – die Raum-Bildstabilisierung fehlt
• – oder nicht zufriedenstellend funktioniert
• – insbesondere zu langsam wäre
• – und zu hohen Preisen führen würde
• – und sehr viel Energie verbraucht
• – und viel Platz beansprucht
• – was zu erheblichen Einschränkungen der Mobilität führt

Reason for the so far very poor success of video glasses in the market were in particular that

• - the space-image stabilization is missing
• - or not working satisfactorily
• - especially too slow
• - and lead to high prices
• - and consumes a lot of energy
• - and claimed a lot of space
• - which leads to significant restrictions on mobility

Of the So market is so far only supplied with video glasses, although now cheap and easy, and also reasonable mobility duration Achieve, but for the reasons mentioned above until today to be dispensed with an efficient image stabilization, because this would not be economically feasible.

The User bothers considerably that the virtual image is not standing firmly in the room, or not fast enough the movement of the head follows. The body tries to stabilize the image, which leads to cramps in the neck area. A long-term Use of such video glasses was therefore not advisable, yes even harmful.

The Marketing and the market success of such video glasses has been so far very disabled.

Of the Invention is based on the object, a micromechanical device offering particularly advantageous utility and / or manufacturing properties having.

The Task is solved by the micromechanical device for protection claim 1. Advantageous embodiments of Micromechanical device are in the subclaims 2-9 described.

• – die sensorischen Einheiten (z. B. Bewegungssensoren, MEMS Elemente oder andere) sind in den Baustein integriert
• – die das Bild manipulierenden Einheiten (z. B. Mikrospiegel, MOEMS Elemente oder andere) sind in den Baustein integriert

According to the invention, the micromechanical device, in particular for a video lens with image stabilization, is constructed in such a way:

• - The sensory units (eg motion sensors, MEMS elements or others) are integrated in the device
• - The units manipulating the image (eg micromirrors, MOEMS elements or others) are integrated into the device

• – Die bildberechnenden Einheiten (z. B. Videoprozessoren, CPUs, ASICs oder andere) sind in den Baustein integriert.
• – Die Schnittstelle für Benutzer-Kontrolleinrichtungen des Systems ist in den Baustein integriert.

Advantageous embodiments may include the following features:

• The image-calculating units (eg video processors, CPUs, ASICs or others) are integrated in the module.
• - The interface for user control devices of the system is integrated in the block.

there If a conventional video signal is played, based on the sensory information in the integrated computer unit digitally manipulated so that a picture-stabilized image as desired arises. In the reference frame of the glasses is considered the image section and if necessary also the positions and angles of the imaging changed so that the desired impression is created, especially the impression of a motion - independent stabilized image, which in the Space seems to be fixed or of an artificial horizon, which does not stagger or shake even when moving your head.

In a particularly advantageous embodiment, the superimposed displayed image with real visible images be, for. B. by means of semipermeable lenses. This can be used to show hints in the visible image or to highlight or mitigate certain elements or hide and much more.

characteristic is the integration into a compact and energy efficient as well low-mass system, preferably in a building block, easy and safe on a head-mounted device, such. A video glasses, Can be mounted.

If the light source for the imaging of lasers exists, or from other sources of light, is irrelevant.

For the case that laser or other point light sources are used come, these are to distract the image structure accordingly.

• – Das Bild bewegt sich mit dem Kopf mit, was unnatürlich ist
• – Der Nutzer versucht krampfhaft den Kopf zu stabilisieren, um einen virtuellen Horizont einzustellen
• – Überlagerungen eingespielter Bilder mit echten Sichbildern sind nicht möglich uder führen zu Geisterbildern bei Bewegung, weil das Bild nicht schnell genug nachgeführt werden kann.
• – Die Nutzer leiden unter Orientierungsverlust und so genannter Simulatorenkrankheit
• – Die Nutzer leiden unter Verkrampfungen der Skelettmuskulatur und der Augenmuskeln
• – Die Hersteller müssen die Geräte, Videobrillen mit deutlich sichtbaren Warnungen versehen, dass die Augen und das Sehzentrum bei längerer Nutzung ogne Bildstabilisierung Schaden leiden können (wie z. B. bei Olympus 2001)
• – Die Nutzungsdauer der Videobrillen muss ggfs technisch auf erträgliche Zeiten beschränkt werden (wie z. B. bei Olympus 2001)

Without fast and precise real-time image stabilization, the following disturbing effects occur:

• - The picture moves with the head, which is unnatural
• - The user desperately tries to stabilize the head to set a virtual horizon
• - Overlays of recorded images with real images are not possible or lead to ghosting when moving, because the image can not be tracked fast enough.
• - Users suffer from loss of orientation and so-called simulator disease
• - Users suffer from cramping of the skeletal muscles and the eye muscles
• - The manufacturers must provide the devices, video glasses with clearly visible warnings that the eyes and the visual center may suffer image stabilization during prolonged use (as in the case of Olympus 2001)
• - The useful life of the video glasses must be technically limited to tolerable times (such as in Olympus 2001)

causal is that the separate version of the sensors, imagers and computer units with the intervening interfaces and conduction paths for long calculation times, delayed tracking and high energy consumption.

Especially Previous systems with stabilization of the visual axis are not on fast small image changes adapted as this is due the system architecture (separate modules of the imaging unit, the sensors, the control modules and the power supply) is not guaranteed has been.

The Micromechanical device is based on an embodiment further explained in the drawing figure. It shows

1 a schematic representation of a micromechanical device.

1 describes an integrated system on a chip or a solid integrated component. The light source 1 , z. As one or more lasers, send light rays 2 to the first designed as a deflecting mirror optical elements 3 . 4 . 5 , There is a beam deflection and z. B. image taking place. The exemplary system uses z. B. two preferably orthogonally crossed mirror. You could also use a different combination of multi-axis mirrors. The micromechanical optical elements are controlled 3 and 5 via the integrated interface and signal 7 , starting from the CPU or the ASIC 8th , The result is the generated image 6 ,

In the generated picture 6 To stabilize the image and make it invariable against head movements, the integrated system has corresponding sensory elements 13 to 14 , represented in the example by crossed micromechanical sensor elements.

Preferably, the sensory elements have 13 and 14 on similar or analogous properties of mechanical influenceability as the active optical micromechanical elements 3 and 5 ,

In particular, the mechanical sensory part 13 and 14 into the mechanically optically active parts 3 and 5 be integrated.

The sensory signals of the sensory units 13 and 14 arrive via the integrated interface 11 to the CPU / ASIC 8th and thus enable the very fast compensation of the mechanical movement of the entire system.

The video signal is on the one hand from a z. B. external media source via external interface 12 delivered and the data or multimedia interface 10 , or from equally integrated camera systems (part of 9 ).

Further information z. B. for image selection, brightness, contrast, etc, via the input means in the user control interface 9 ,

Due to the integrated arrangement of active imaging optical elements 3 and 5 on the one hand and the analogue equipped sensory elements 13 and 14 a direct acting and very fast computable digital image compensation becomes possible. In the limiting case, this compensation can even be integrated directly into the control line, so be carried out analogously.

The Execution as combined MEMS / MOEMS module appears ideal.

On the one hand, the images are using MOEMS (Micro-Opto-Electromechanical Systems) projected. As micro-mechanical systems, these MOEMS are subject to the influence of movement, acceleration, vibration, etc.

On the other side becomes the influencing movements detected directly by analogous acting MEMS. These suffer the same Influences in the immediate vicinity. Therefore, the calculation of the necessary image compensation is off least sensible to the sensory signals of these MEMS and to perform fastest with minimal energy.

The Integrated CPU or special ASIC is on the compensation calculation designed and optimized so that these with minimal expenses time and energy can be done. The ASIC takes over the calculation of the required image correction involve any movement of the head and any movement of the projection image to compensate.

In an advanced version, the sensors also the eye position and eye movements and, if necessary, also the pupil width to capture. The adaptation of the image to these sizes can be very useful and will be with this Device energy-optimized and achieved in the shortest possible reaction time.

consequently The picture becomes with every movement of the glasses and thus each actual Displacement of the glasses stabilized relative to the room. Ie. either with head movements relative to the room as well as with glasses movements relative to the head.

• – reduziertes Gewicht
• – reduzierter Materialaufwand
• – reduzierte Kosten
• – reduzierter Energieaufwand
• – schnellere Nachfolgezeit
• – verbesserte Bildstabilisierung
• – längere Laufzeit bei Batterieversorgung
• – erhöhte Mobilität
• – längere zulässige Benutzungsdauer
• – Vermeidung von Schäden am visuellen System

Finally, as a result of the integration of active elements, sensory elements and digital and z. T. also analog compensation in a chip or a compact device an optimized micro (opto) -electromechanical system with the following characteristics:

• - reduced weight
• - reduced material costs
• - reduced costs
• - reduced energy consumption
• - faster succession time
• - improved image stabilization
• - longer battery life
• - increased mobility
• - longer permitted period of use
• - Avoidance of damage to the visual system

complex Embodiments of such glasses are not only easier Image projection, but the representation of so-called augmented reality, where the real images in the eye of the beholder projected through superimposed, supplemented or clarified virtual images become. The projected virtual images can optionally map the environment, with the recording technologies more information can not deploy without technical assistance would.

Important is in particular a mechanically strong rigid connection, so z. As imaging element and system for detecting position, orientation or movement of the device (eg, a MEMS and a MOEMS) move exactly the same. Also important is an electronically high quality fast Connection of (construction) parts with low resistance.

1

light source

2

light rays

3

optical element

4

optical element

5

optical element

6

generated image

7

signal

8th

ASIC

9

User Control Interface

10

Data or multimedia interface

11

integrated interface

12

external interface

13

sensory element

14

sensory element

QUOTES INCLUDE IN THE DESCRIPTION

This list The documents listed by the applicant have been automated generated and is solely for better information recorded by the reader. The list is not part of the German Patent or utility model application. The DPMA takes over no liability for any errors or omissions.

Cited patent literature

• - DE 19523886 [0013]
• US 6016217 [0013]
• - DE 4229507 [0014]
• US 5408355 [0014]
• WO 1998/037691 [0016]

Claims (9)

Micromechanical device consisting of imaging Elements for the deflection of light rays and systems for detection of position, orientation or movement of the device, being dependent data of the position, orientation and / or movement of the device a change in imaging occurs, with at least one of the imaging elements and at least one of the systems for detecting position, orientation or movement of the device mechanically rigidly connected to each other on a common component are. Micromechanical device according to claim 1, wherein the device has integrated devices for active image control contains and / or integrated sensory devices Motion detection and / or integrated image processing equipment for the purpose of image selection and / or image selection and / or the image stabilization or image correction. Micromechanical device according to one of the preceding Claims in which the deflection of the light rays at least partially realized by a MOEMS (Micro Opto Electromechanical System) becomes. Micromechanical device according to one of the preceding Claims in which the sensory detection of the movement, Acceleration and vibration at least partially a MEMS (Micro Electromechanical System) is realized. Micromechanical device according to one of the preceding Claims in which the image influence at least partially digital by means of application specific integrated elements for Image processing is realized, preferably spatially close attached to the active and sensory elements, preferably on a building block. Micromechanical device according to one of the preceding Claims in which image stabilization takes place no external processor is provided for image stabilization is. Micromechanical device according to one of the preceding Claims in which the device is in the form of binoculars, a pair of glasses or a similar-looking viewer is designed. Micromechanical device according to one of the preceding Claims in which the eye movement of the observer detected for the purpose of image selection and / or image selection and / or Image stabilization or image correction. Micromechanical device according to one of the preceding Claims in which the so-called real images in the eye of Observers overlaid by projected virtual images, be supplemented and / or clarified, in particular according to the Principle of Augmented Reality.