Zum Hauptinhalt springen

Method and system for pseudo 3D mapping in robotic applications

CMOS Sensor, Inc.
2024
Online Patent

Titel:
Method and system for pseudo 3D mapping in robotic applications
Autor/in / Beteiligte Person: CMOS Sensor, Inc.
Link:
Veröffentlichung: 2024
Medientyp: Patent
Sonstiges:
  • Nachgewiesen in: USPTO Patent Grants
  • Sprachen: English
  • Patent Number: 11960,008
  • Publication Date: April 16, 2024
  • Appl. No: 16/950915
  • Application Filed: November 18, 2020
  • Assignees: CMOS Sensor, Inc. (San Jose, CA, US)
  • Claim: 1. A sensing system for pseudo 3D mapping, the sensing system comprising: at least a first linear sensor and a second linear sensor; the first linear sensor, disposed horizontally, provided to measure a distance towards a target, wherein the distance is measured at a predefined height from a ground; and the second linear sensor, disposed vertically, provided to take a video of an environment, wherein the first linear sensor and the second linear sensor are in a predefined rigid relationship, image data from the second linear sensor is incorporated with the distance obtained from the first linear sensor, the sensing system is mounted on a robot moving in the environment, an image of the environment is generated from the second linear sensor synchronized with respective distances obtained from the first linear sensor while the robot is moving in the environment.
  • Claim: 2. The sensing system as recited in claim 1 , wherein the second linear sensor includes a filter to specifically enhance certain colors of objects.
  • Claim: 3. The sensing system as recited in claim 1 , wherein the second linear sensor includes a predefined number of photosensors, a sensor distance between any two of the photosensors is known, the sensor distance is used to determine how far an object is from the robot, wherein the object has a height less than the predefined height from the ground.
  • Claim: 4. The sensing system as recited in claim 3 , wherein the object cannot be detected by the first linear sensor alone.
  • Claim: 5. The sensing system as recited in claim 4 , wherein the object is present in the image data and detectable in accordance with the distance from the first linear sensor.
  • Claim: 6. The sensing system as recited in claim 1 , wherein both of the first and second linear sensors are CMOS based with correlated double sampling (CDS) to avoid a sensing speed being halved.
  • Claim: 7. The sensing system as recited in claim 1 , where the first linear sensor includes: a linear array of pixels, each of the pixels including one photosensor and producing a final signal within a predefined frame, wherein the final signal captures a reflected light without background light interference; a readout circuit including at least a first storage device and a second storage device; and a clock circuit, coupled to the sensor and the readout circuit, causing the readout circuit to store a first charge and a second charge on the first storage device and the second storage, respectively, wherein the first charge or the second charge is proportional to an intensity of an incoming light impinged upon the photosensor, the first charge and the second charge are created successively within the predefined frame, and the final signal is a subtraction between the first charge and the second charge.
  • Claim: 8. The sensing system as recited in claim 7 , wherein the reflected light is produced by reflection from an object impinged upon by an emitted light from a light source, wherein the light source and the first linear sensor are disposed in a known configuration.
  • Claim: 9. The sensing system as recited in claim 8 , wherein the target is positioned in a background with other ambient lights, and the first charge pertains to the incoming light with the light source turned on, and the second charge pertains to the incoming light with the light source turned off.
  • Claim: 10. The sensing system as recited in claim 9 , wherein the readout circuit includes at least a switch to control which one of the first and second storage devices is used to store the first charge or the second charge, none of the first and second charges is from an internal dark or reference output level in the photosensor.
  • Claim: 11. The sensing system as recited in claim 10 , wherein the second charge is generated while the first charge remains in the first storage device.
  • Claim: 12. The sensing system as recited in claim 11 , wherein either one of the first and second storage devices is a capacitor.
  • Claim: 13. The sensing system as recited in claim 1 , wherein the first linear sensor is artificially allocated from a 2D image sensor.
  • Claim: 14. The sensing system as recited in claim 13 , wherein the second linear sensor is artificially allocated from the 2D image sensor.
  • Claim: 15. The sensing system as recited in claim 13 , wherein the second linear sensor is one or more vertical sensors artificially allocated from the 2D image sensor, each of the vertical sensors is coated with a different filter.
  • Claim: 16. A method for pseudo 3D mapping, the method comprising: measuring a distance towards a target by a first linear sensor as part of a lidar system, wherein the distance is measured at a predefined height from a ground; scanning and generating a video of an environment by a second linear sensor, wherein the first linear sensor and the second linear sensor are in a predefined rigid relationship, image data from the second linear sensor is incorporated with the distance obtained from the first linear sensor, both of the first and second linear sensors are mounted on a robot moving in the environment, an image of the environment is generated from the second linear sensor synchronized with respective distances obtained from the first sensor while the robot is moving in the environment.
  • Claim: 17. The method for pseudo 3D mapping as recited in claim 16 , wherein the second linear sensor includes a filter to specifically enhance certain colors of the objects.
  • Claim: 18. The method for pseudo 3D mapping as recited in claim 17 , wherein the second linear sensor includes a predefined number of photosensors, a sensor distance between any two of the photosensors is known, the sensor distance is used to determine how far an object is from the robot, wherein the object has a height less than the predefined height from the ground.
  • Patent References Cited: 9392259 July 2016 Borowski ; 20150002629 January 2015 Wei ; 20150339826 November 2015 Buibas ; 20190323845 October 2019 Agarwal ; 20210089040 March 2021 Ebrahimi Afrouzi ; 20220299650 September 2022 Forsberg
  • Primary Examiner: Ratcliffe, Luke D
  • Attorney, Agent or Firm: Zheng, Joe

Klicken Sie ein Format an und speichern Sie dann die Daten oder geben Sie eine Empfänger-Adresse ein und lassen Sie sich per Email zusenden.

oder
oder

Wählen Sie das für Sie passende Zitationsformat und kopieren Sie es dann in die Zwischenablage, lassen es sich per Mail zusenden oder speichern es als PDF-Datei.

oder
oder

Bitte prüfen Sie, ob die Zitation formal korrekt ist, bevor Sie sie in einer Arbeit verwenden. Benutzen Sie gegebenenfalls den "Exportieren"-Dialog, wenn Sie ein Literaturverwaltungsprogramm verwenden und die Zitat-Angaben selbst formatieren wollen.

xs 0 - 576
sm 576 - 768
md 768 - 992
lg 992 - 1200
xl 1200 - 1366
xxl 1366 -