US20190118717A1 - Full mirror display utilizing a trailer camera - Google Patents

Images

Classifications

• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
  • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
  • B60R1/002—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
  • B60R1/02—Rear-view mirror arrangements
  • B60R1/04—Rear-view mirror arrangements mounted inside vehicle
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
  • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
  • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
  • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
  • B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
  • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
  • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
  • B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
  • B60R2001/1253—Mirror assemblies combined with other articles, e.g. clocks with cameras, video cameras or video screens
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
  • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
  • B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
  • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
  • B60R2300/8046—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for replacing a rear-view mirror system
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
  • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
  • B60R2300/8066—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring rearward traffic

Definitions

• the present invention relates to interior rearview mirror systems and, more particularly, to an interior rearview mirror system having a display at the interior rearview mirror for viewing by the driver of the vehicle.
• a mirror assembly that is adjustably mounted to an interior portion of a vehicle, such as via a double ball pivot or joint mounting configuration where the mirror casing and reflective element are adjusted relative to the interior portion of a vehicle by pivotal movement about the double ball pivot configuration.
• the mirror casing and reflective element are pivotable about either or both of the ball pivot joints by a user that is adjusting a rearward field of view of the reflective element.
• a display screen at the mirror assembly.
• a variety of interior and exterior mirror assemblies with indicators and/or displays are known in the art, such as U.S. Pat. Nos.
• the present invention provides a vision system for displaying video images of captured images for viewing by the driver of the vehicle.
• a video display screen is disposed in the vehicle cabin and is viewable at the interior rearview mirror assembly.
• the display screen when actuated, displays video images derived from image data captured by a selected one of a vehicle mounted rearward viewing camera that has a field of view rearward of the vehicle, and a trailer mounted rearward viewing camera that has a field of view rearward of a trailer being towed by the vehicle.
• the displayed images comprise video images that correspond to an unobstructed rearward view similar to the field of view provided by the reflective element when in a mirror mode.
• the trailer mounted rearward viewing camera comprises a high definition analog camera having a resolution of at least one million pixels.
• the trailer mounted rearward viewing camera may comprise a high definition analog camera having a resolution of at least two million pixels.
• the vehicle mounted rearward viewing camera may comprise a digital camera.
• the display device may comprise a video display screen that, responsive to determination of the connection of a trailer with the trailer mounted rearward viewing camera, displays video images derived from image data captured by the trailer mounted rearward viewing camera.
• FIG. 1 is a perspective view of an interior rearview mirror assembly suitable for use with the display system of the present invention
• FIGS. 2-4 are views of mirror assemblies with full screen video displays and with optional user inputs
• FIGS. 5 and 6 are plan views showing the mirror in its mirror mode ( FIG. 5 ) and in its display mode ( FIG. 6 );
• FIG. 7 is a schematic showing the mirror display in connection with an NTSC camera
• FIG. 8 is a schematic showing the mirror display in connection with a digital camera
• FIG. 9 is a schematic showing the mirror display in connection with a digital rear backup vehicle camera and an analog trailer camera
• FIG. 10 is a schematic showing the mirror display in connection with a digital rear backup vehicle camera and an HD analog trailer camera;
• FIG. 11 is a schematic showing the mirror display in connection with a digital rear backup vehicle camera and HD analog trailer cameras
• FIGS. 12 and 13 are schematics showing the mirror display in connection with a digital rear backup vehicle camera and wirelessly connected to a trailer camera;
• FIG. 14 is a side elevation of a vehicle and trailer with the camera and display system of the present invention, showing camera views utilized for displaying different views when the vehicle is driving forward and during reverse backup maneuvers;
• FIG. 15 is a schematic showing the regions of the image data captured by the trailer camera that are used for forward towing of the trailer and reversing of the vehicle and trailer.
• an interior rearview mirror assembly 10 for a vehicle includes a casing 12 that houses a reflective element 14 and a display device, which provides a display area 16 visible to the driver of the vehicle through the reflective element 14 ( FIG. 1 ).
• the mirror assembly 10 is configured to be adjustably mounted to an interior portion of a vehicle (such as to an interior or in-cabin surface of a vehicle windshield or a headliner of a vehicle or the like) via a mounting structure or mounting configuration or assembly 18 .
• the casing 12 of the interior rearview mirror assembly 10 may house all or a portion of the components of the interior rearview mirror assembly 10 and may be integrally formed with portions thereof.
• the mirror head is tiltable or pivotable between a mirror mode orientation, where the reflective element is positioned to provide the desired driver's rearward field of view, and a display mode orientation, where the mirror head is tilted upward or downward relative to the mirror mode orientation, such that the display is viewable by the driver while the reflective element reflects light from rearward of the vehicle and incident thereon upward or downward away from the driver's eyes.
• the mirror head includes a full mirror display screen 15 and may be tiltable or pivotable between the mirror mode orientation and the display mode orientation via an actuator that is electrically powered to impart a pivotal movement or flipping of the mirror head about a generally horizontal pivot axis, such as by utilizing aspects of the mirror systems described in U.S. Publication Nos.
• the interior mirror thus can be used as a traditional mirror assembly, but can also be changed to a video monitor, such as through a use of a transflective surface and a high intensity display transposed behind the transflective surface.
• the present invention provides a display system that can display video images across the entire reflective surface or active reflective area (or substantially the entire reflective surface or active reflective area) of an interior rearview mirror assembly.
• the display system includes a display device disposed at an upper region of the vehicle's interior cabin (or other location), such that, when the mirror head is tilted or angled or otherwise mechanically adjusted, the mirror reflective element reflects the displayed image across the entire reflective surface for viewing by the driver of the vehicle.
• the driver can view the rearward field of view provided by the reflective element, but when the mirror head is tilted or adjusted and/or when the display device is actuated (so that the mirror functions in a “display mode”), the displayed video images (such as derived from image data captured by a rearward viewing camera) are viewable by the driver of the vehicle, with the tilting of the mirror head causing the primary reflection off of the reflective element to be out of the driver's eyes (since it would be aimed up toward the headliner or down into the cabin area instead of out the rear window).
• the displayed video images such as derived from image data captured by a rearward viewing camera
• the display screen preferably displays the captured video images at the entire viewable portion of the display screen, in order to provide relatively large displayed images for viewing by the driver of the vehicle while the driver is normally operating the vehicle.
• the user inputs are touch or proximity sensors disposed at a portion of the display screen.
• the video display screen when normally operating to display video images captured by the camera, may display the video images over the entire display portion or active portion of the display screen and, responsive to a user input (such as a user or driver touching a portion of the display screen or touch screen), may display icons or indicia at a portion of the display screen to indicate where the user can touch to actuate or control the display settings or the like.
• the user inputs or touch sensors may comprise any suitable sensors or inputs, and may utilize aspects of the inputs and sensors described in U.S. Pat. Nos. 7,224,324; 7,253,723; 7,255,451 and/or 8,154,418, and/or International Publication Nos. WO 2012/051500; WO 2010/124064; WO 2011/044312; WO 2013/071070 and/or WO 2013/126719, which are hereby incorporated herein by reference in their entireties.
• an interior rearview mirror assembly with a full screen display may not include any user inputs or buttons or sensors, such as shown in FIG. 2 .
• the interior mirror and display assembly may include touch sensors or buttons (such as capacitive touch sensors or buttons) disposed along a lower portion of the mirror bezel, such as shown in FIG. 3 , or along a widened lower portion of the bezel (such as shown in FIG. 4 ).
• touch sensors or buttons such as capacitive touch sensors or buttons
• a single touch sensor or button or user input may be provided at the mirror, and may be customized for the particular vehicle or application or the like.
• the mirror may function in a mirror mode ( FIG. 5 ), where the display is deactivated and the driver views rearward via reflection at the mirror reflector of the reflective element, or the mirror may function in a display mode ( FIG. 6 ), where the display is activated and the driver views the displayed images at the mirror reflective element.
• the changes between mirror mode and display mode may be responsive to a user input, and the mirror head may automatically pivot (via an actuator of the mirror assembly) to the appropriate orientation for the selected mode, such as described above.
• the display system automatically switches to the display mode and displays video images derived from the image data captured by the trailer-mounted rearward viewing camera.
• the switch to the display mode and display of video images may be automatic upon determination of the trailer hitching to the vehicle, or may be further responsive to when the vehicle shifts to a forward or reverse gear or begins to move in a forward or reverse direction (so that the driver sees, in the mirror, the view rearward of the trailer and does not see the trailer itself (as the driver would otherwise see if the system was in the mirror mode).
• the display may display video images derived from image data captured by the trailer-mounted rearward viewing camera at an upper region of the field of view of the trailer-mounted rearward viewing camera.
• the display may display video images derived from image data captured by the trailer-mounted rearward viewing camera at a lower region of the field of view of the trailer-mounted rearward viewing camera.
• the system automatically provides the appropriate video images for viewing by the driver of the vehicle to assist the driver during forward or reversing driving maneuvers.
• the system may be overridden via a user input, so that, even when a trailer (having the trailer-mounted camera) is hitched to the vehicle, the driver can select the mirror mode (such as via actuation of a user input or the like).
• the mirror system may include an electronically operable actuator that is operable to adjust or pivot the mirror head between the mirror mode orientation and the display mode orientation.
• the mirror actuator may move the mirror head to the display mode orientation responsive to a user input or responsive to the driver shifting the vehicle into a reverse gear, whereby a rear backup camera is actuated and the display displays video images derived from image data captured by the rear backup camera.
• the actuator thus performs the rotation of the mirror head like a traditional manual flip-tab/toggle mechanism would.
• the actuator pivots the mirror head of a full-size-video display inside mirror so the mirror head can be used as an interior rearview mirror (mirror mode) or as a full mirror display screen (display mode).
• the actuator tilts the mirror and the digital display turns on. The tilting action gets the primary reflection out of the driver's eyes as it would be aimed up into the headliner or down into the cabin area instead of out the rear window.
• the display device is operable to display video images (such as derived from image data captured by one or more cameras of the vehicle, such as one or more cameras having rearward and/or sideward exterior fields of view and/or one or more cameras having interior fields of view in the cabin of the vehicle) when the mirror head is in its display mode orientation.
• the display device or module may utilize aspects of the modules described in International Publication No. WO 2016/178190 and/or U.S. Publication No. US-2014-0285666, which are all hereby incorporated herein by reference in their entireties.
• the displayed video images are derived from image data or images captured by one or more rearward viewing cameras.
• the rearward viewing camera may comprise an analog or NTSC (National Television System Committee) camera that communicates with the mirror display (such as via a LIN network of the vehicle) and that provides an NTSC output to the mirror display, such as shown in FIG. 7 .
• the rearward viewing camera may comprise a digital camera ( FIG. 8 ), which communicates with the mirror display (such as via an I 2 C control or communication) and which provides an LVDS (Low Voltage Differential Signal) output to the mirror display.
• NTSC National Television System Committee
• the display system may be operable to display video images derived from image data or images captured by a trailer-mounted rearward viewing camera, such that, when a trailer is being towed by the vehicle (and thus when the trailer is obstructing the driver's rearward field of view and the rearward field of view of a vehicle-mounted rearward viewing camera), the trailer-mounted rearward viewing camera (disposed at a rear portion of the trailer and viewing rearward therefrom) may be in communication with the mirror display, such that the mirror display can display video images derived from image data or images captured by the trailer camera to provide a rearward view to the driver of the vehicle.
• the display system may include a digital vehicle camera and an analog trailer camera.
• the trailer camera may be automatically enabled or may be activated or enabled responsive to a user input or may be activated or enabled via a vehicle network or the like.
• the mirror display is operable to receive the digital input from the vehicle camera and the analog input from the trailer camera, and displays the respective video images responsive to the user selection or determination that the trailer camera is connected and/or enabled. For example, when no trailer is connected to the vehicle, the display system displays (when shifted to the display mode, such as via actuation of a user input or the like) video images derived from image data captured by the vehicle camera, but when a trailer is connected to the vehicle, the display system automatically switches to the display mode and to a trailer view and displays video images derived from the analog NTSC signal from the trailer camera.
• the trailer camera comprises a high definition (HD) analog camera that outputs an HD analog signal to the mirror display, such as shown in FIG. 10 .
• the trailer camera may be in communication with the mirror display via a cable or wire harness (such as a shielded twisted pair cable or wire harness).
• the trailer camera may comprise a 1 Megapixel camera or a 1.3 Megapixel camera or a 2 Megapixel camera (or more), and may capture images at a frame rate of 60 frames per second (fps) or 30 fps, respectively.
• the trailer may include two analog cameras that are connected to a wire or cable that connects to a socket or plug at the vehicle (when the trailer is hooked up to the vehicle).
• the socket or plug is electrically connected to the mirror display system, which also receives digital LVDS video signals from a digital vehicle camera.
• the system may automatically switch between which camera provides the image data for display and what type of image data or images is/are provided.
• the two trailer cameras may comprise an analog camera and an HD analog camera. Since both NTSC and Analog-HD signals can use the same wiring (e.g., Shielded Twisted Pair), the mirror circuits working with software can determine which type of signal is being applied to the input terminals. Automatic detection can allow the same mirror to operate with either an NTSC or Analog-HD camera.
• the detection method may include measuring horizontal line timing, measuring vertical frame frequency, measuring signal amplitude, measuring R, G, B values of pixel colors at certain locations, measuring overall brightness or contrast of the captured image data, and/or measuring local areas for brightness or contrast.
• the system may provide an analog HD fail-safe to NTSC configuration.
• the camera could automatically change to an NTSC output, in order to allow the camera-display system to continue to operate at reduced performance.
• Such a configuration would require the mirror to communicate with the camera about the status of the received image data over analog-HD. When the mirror fails to respond to the camera, or confirms that the image data is not received, the camera can then change to its NTSC output format.
• the trailer may include one or more wireless cameras that may wirelessly communicate image data to a head unit of the vehicle for display of trailer camera video images at the mirror display.
• the mirror or head unit may require a more complicated video processor to process the wireless signals from the trailer camera or the digital wired signals from the vehicle camera.
• the display system of the present invention may provide for high definition or enhanced video display from a trailer mounted camera that may be located over 30 feet or over 60 feet or up to or over 90 feet from the display.
• cables or wires of such length would have attenuation in the signal such that the signal may not be suitable for a clear display of images.
• the system thus preferably decreases cable attenuation of the signal so that the desired signal strength can be provided from the trailer camera to the display without use of signal repeater modules (which would add expense and complexity to the system and would require an external power supply and a microprocessor for signal management).
• the system of the present invention provides a high definition (one MP or more) analog camera that outputs an analog NTSC signal to the display, and the display screen displays video images derived from the NTSC signal.
• the system may display different views derived from image data captured by the trailer camera for different driving conditions or maneuvers.
• the trailer camera may have a field of view that is downward and rearward of the trailer.
• the system may display only an upper region of the field of view of the trailer-mounted camera so as to provide a rearward field of view to the driver that would be similar to the rearview mirror view (if the trailer were not attached).
• the system may display a lower region of the field of view of the trailer-mounted camera so as to provide a rearward field of view to the driver that would be similar to a rear backup camera of the vehicle (if the trailer were not attached).
• the system may automatically display the appropriate region, such as responsive to the vehicle being shifted into a forward or drive gear (whereby the upper region is displayed) and responsive to the vehicle being shifted into a reverse gear (whereby the lower region is displayed).
• the system may display the full field of view, such as responsive to a user input or the like.
• the images displayed may be derived from image data captured by the rearward viewing camera of the vehicle, such as a rear backup camera or a trailer mounted camera, and may provide the field of view similar to what is provided by the mirror reflector when the mirror is in its mirror mode (such as by utilizing aspects of the systems described in
• the camera may comprise a rear backup camera or may comprise one or more rearward viewing cameras disposed at an exterior rearview mirror of the vehicle, such as by utilizing aspects of the systems described in U.S. Pat. Nos. 9,676,336 and/or 9,487,142, which are hereby incorporated herein by reference in their entireties.
• the camera may be disposed at the rear of the vehicle, or may be a side-mounted camera (such as at a side exterior rearview mirror assembly) and may be extendable to provide an enhanced rearward field of view, such as by utilizing aspects of the mirrors and cameras described in U.S. Pat. Nos. 9,676,336 and/or 9,487,142, which are hereby incorporated herein by reference in their entireties.
• the display may utilize aspects of the displays of the types disclosed in U.S. Pat. Nos. 5,530,240 and/or 6,329,925, which are hereby incorporated herein by reference in their entireties, and/or of display-on-demand or transflective type displays, such as the types disclosed in U.S. Pat. Nos. 7,855,755; 7,777,611; 7,626,749; 7,581,859; 7,446,924; 7,446,650; 7,370,983; 7,338,177; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 6,690,268; 5,668,663 and/or 5,724,187, and/or in U.S. Publication No. US-2006-0050018, and/or International Publication No. WO 2004/058540, which are all hereby incorporated herein by reference in their entireties.
• the display may be viewable through the reflective element when the display is activated to display information.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Mechanical Engineering (AREA)
• Signal Processing (AREA)
• Closed-Circuit Television Systems (AREA)

Abstract

Description

Claims (20)

Priority Applications (3)

Applications Claiming Priority (3)

Related Child Applications (1)

Publications (1)

Family

ID=66170446

Family Applications (3)

Family Applications After (2)

Country Status (1)

Cited By (33)

Citations (5)

Family Cites Families (63)

• 2018
  • 2018-10-25 US US16/170,075 patent/US20190118717A1/en not_active Abandoned
• 2022
  • 2022-05-06 US US17/662,335 patent/US11958414B2/en active Active
• 2024
  • 2024-04-12 US US18/633,592 patent/US20240253563A1/en active Pending

Patent Citations (5)

Also Published As

Similar Documents

Legal Events