Zum Hauptinhalt springen

Adaptive coding unit (CU) partitioning based on image statistics

TEXAS INSTRUMENTS, INCORPORATED
2023
Online Patent

Titel:
Adaptive coding unit (CU) partitioning based on image statistics
Autor/in / Beteiligte Person: TEXAS INSTRUMENTS, INCORPORATED
Link:
Veröffentlichung: 2023
Medientyp: Patent
Sonstiges:
  • Nachgewiesen in: USPTO Patent Grants
  • Sprachen: English
  • Patent Number: 11695,939
  • Publication Date: July 04, 2023
  • Appl. No: 17/499301
  • Application Filed: October 12, 2021
  • Assignees: Texas Instruments Incorporated (Dallas, TX, US)
  • Claim: 1. An encoder comprising: a coding component configured to output a largest coding unit (LCU) of an image in a video sequence; and a partitioning component configured to: determine a first statistical measure of the LCU; determine a second statistical measure of the LCU; compare the first statistical measure to a first threshold, wherein the first threshold is based on an expected content of the video sequence; compare the second statistical measure to a second threshold; and responsive to the first statistical measure exceeding the first threshold or the second statistical measure exceeding the second threshold, partition the LCU into a set of child coding units (CUs).
  • Claim: 2. The encoder of claim 1 , wherein: the first statistical measure is a variance; and the second statistical measure is a gradient.
  • Claim: 3. The encoder of claim 1 , wherein: the coding component is further configured to: receive the video sequence; process the video sequence into a plurality of images; and divide each of the plurality of images into respective LCUs; the LCU is one of the respective LCUs; and the image is one of the plurality of images.
  • Claim: 4. The encoder of claim 1 , wherein: the coding component is further configured to: responsive to the first statistical measure not exceeding the first threshold and the second statistical measure not exceeding the second threshold, select the LCU as a partition of the image.
  • Claim: 5. The encoder of claim 1 , wherein: the coding component is further configured to: determine a third statistical measure for a first child CU of the set of child CUs; determine a fourth statistical measure for the first child CU the set of child CUs; compare the third statistical measure to a third threshold; compare the fourth statistical measure to a fourth threshold; and responsive to the third statistical measure exceeding the third threshold or the fourth statistical measure exceeding the fourth threshold, partition the first child CU into a second set of child CUs.
  • Claim: 6. The encoder of claim 5 , wherein: the coding component is further configured to: determine a fifth statistical measure for a second child CU of the set of child CUs; determine a sixth statistical measure for the second child CU the set of child CUs; compare the fifth statistical measure to the third threshold; compare the sixth statistical measure to the fourth threshold; and responsive to the fifth statistical measure exceeding the third threshold or the sixth statistical measure exceeding the fourth threshold, partition the second child CU into a third set of child CUs.
  • Claim: 7. A method comprising: determining, by a processor, a first statistical measure of a largest coding unit (LCU) of an image in a video sequence; determining, by the processor, a second statistical measure of the LCU; comparing, by the processor, the first statistical measure to a first threshold, wherein the first threshold is based on an expected content of the video sequence; comparing, by the processor, the second statistical measure to a second threshold; and responsive to the first statistical measure exceeding the first threshold or the second statistical measure exceeding the second threshold, partitioning, by the processor, the LCU into a set of child coding units (CUs).
  • Claim: 8. The method of claim 7 , wherein: the first statistical measure is a variance; and the second statistical measure is a gradient.
  • Claim: 9. The method of claim 7 , further comprising: receiving, by the processor, the video sequence; processing, by the processor, the video sequence into a plurality of images; and dividing, by the processor, each of the plurality of images into respective LCUs, wherein the LCU is one of the respective LCUs, wherein the image is one of the plurality of images.
  • Claim: 10. The method of claim 7 , further comprising: responsive to the first statistical measure not exceeding the first threshold and the second statistical measure not exceeding the second threshold, selecting, by the processor, the LCU as a partition of the image.
  • Claim: 11. The method of claim 7 , further comprising: determining, by the processor, a third statistical measure for a first child CU of the set of child CUs; determining, by the processor, a fourth statistical measure for the first child CU the set of child CUs; comparing, by the processor, the third statistical measure to a third threshold; comparing, by the processor, the fourth statistical measure to a fourth threshold; and responsive to the third statistical measure exceeding the third threshold or the fourth statistical measure exceeding the fourth threshold, partitioning, by the processor, the first child CU into a second set of child CUs.
  • Claim: 12. The method of claim 11 , further comprising: determining, by the processor, a fifth statistical measure for a second child CU of the set of child CUs; determining, by the processor, a sixth statistical measure for the second child CU the set of child CUs; comparing, by the processor, the fifth statistical measure to the third threshold; comparing, by the processor, the sixth statistical measure to the fourth threshold; and responsive to the fifth statistical measure exceeding the third threshold or the sixth statistical measure exceeding the fourth threshold, partitioning, by the processor, the second child CU into a third set of child CUs.
  • Claim: 13. A non-transitory computer readable medium storing software instructions that, when executed by at least one processor, causes a method for determining coding unit (CU) partitioning of a largest coding unit (LCU) of an image in a video sequence to be performed, the method comprising: determining a first statistical measure of the LCU; determining a second statistical measure of the LCU; comparing the first statistical measure to a first threshold, wherein the first threshold is based on an expected content of the video sequence; comparing the second statistical measure to a second threshold; and responsive to the first statistical measure exceeding the first threshold or the second statistical measure exceeding the second threshold, partitioning the LCU into a set of child CUs.
  • Claim: 14. The non-transitory computer readable medium of claim 13 , wherein: the first statistical measure is a variance; and the second statistical measure is a gradient.
  • Claim: 15. The non-transitory computer readable medium of claim 13 , wherein the method further comprises: receiving the video sequence; processing the video sequence into a plurality of images; and dividing each of the plurality of images into respective LCUs, wherein the LCU is one of the respective LCUs, wherein the image is one of the plurality of images.
  • Claim: 16. The non-transitory computer readable medium of claim 13 , wherein the method further comprises: responsive to the first statistical measure not exceeding the first threshold and the second statistical measure not exceeding the second threshold, selecting, by the processor, the LCU as a partition of the image.
  • Claim: 17. The non-transitory computer readable medium of claim 13 , wherein the method further comprises: determining, by the processor, a third statistical measure for a first child CU of the set of child CUs; determining, by the processor, a fourth statistical measure for the first child CU the set of child CUs; comparing, by the processor, the third statistical measure to a third threshold; comparing, by the processor, the fourth statistical measure to a fourth threshold; and responsive to the third statistical measure exceeding the third threshold or the fourth statistical measure exceeding the fourth threshold, partitioning, by the processor, the first child CU into a second set of child CUs.
  • Claim: 18. The non-transitory computer readable medium of claim 17 , wherein the method further comprises: determining, by the processor, a fifth statistical measure for a second child CU of the set of child CUs; determining, by the processor, a sixth statistical measure for the second child CU the set of child CUs; comparing, by the processor, the fifth statistical measure to the third threshold; comparing, by the processor, the sixth statistical measure to the fourth threshold; and responsive to the fifth statistical measure exceeding the third threshold or the sixth statistical measure exceeding the fourth threshold, partitioning, by the processor, the second child CU into a third set of child CUs.
  • Claim: 19. The encoder of claim 1 , wherein the second threshold is based on the expected content of the video sequence.
  • Claim: 20. The method of claim 7 , wherein the second threshold is based on the expected content of the video sequence.
  • Patent References Cited: 8861615 October 2014 Sjoberg ; 20050128306 June 2005 Porter ; 20080253454 October 2008 Imamura et al. ; 20110274162 November 2011 Zhou ; 20120183080 July 2012 Zhou ; 20130003868 January 2013 Sjoberg et al. ; 20140086314 March 2014 Hebel ; 20140355690 December 2014 Choi ; 20150010056 January 2015 Choi et al. ; 20150131713 May 2015 Kim et al.
  • Other References: Thomas Wiegand et al, “WD3: Working Draft 3 of High-Efficiency Video Coding”, JCTVC-E603, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-215 Mar. 16-23, 2011, Geneva, Switzerland. cited by applicant ; Benjamin Bross et al, “WD4: Working Draft of High-Efficiency Video Coding”, JCTVC-F803_d6, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-217, Jul. 14-22, 2011, Torino, Italy. cited by applicant ; Benjamin Bross et al, “WD5: Working Draft 5 of High-Efficiency Video Coding”, JCTVC-G1103_d9, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-223, Nov. 21-30, 2011, Geneva, Switzerland. cited by applicant ; Benjamin Bross et al, “High Efficiency Video Coding (HEVC) Text Specification Draft 6”, JCTVC-H1003, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-249, Nov. 21-30, 2011, Geneva, Switzerland. cited by applicant ; Il-Koo Kim et al, “HM7: High Efficiency Video Coding (HEVC) Test Model 7 Encoder Description”, JCTVC-I1002, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-50, Apr. 27-May 7, 2012, Geneva, Switzerland. cited by applicant ; Benjamin Bross et al, “High Efficiency Video Coding (HEVC) Text Specification Draft 7”, JCTVC-I1003_d9, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-260, Apr. 27-May 7, 2012, Geneva, Switzerland. cited by applicant ; Benjamin Bross et al, “High Efficiency Video Coding (HEVC) Text Specification Draft 8”, JCTVC-J1003_d7, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-250, Jul. 11-20, 2012, Stockholm, Sweden. cited by applicant ; Benjamin Bross et al, “High Efficiency Video Coding (HEVC) Text Specification Draft 9”, JCTVC-K1003_v12, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-293, Oct. 10-19, 2012, Shanghai, China. cited by applicant ; Benjamin Bross et al, High Efficiency Video Coding (HEVC) Text Specification Draft 10 (for FDIS & Last Call), JCTVC-L1003_v34, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, pp. 1-298, Jan. 14-23, 2013, Geneva, Switzerland. cited by applicant ; “TMS320DM6467 Digital Media System-on-Chip”, SPRS403G, Texas Instruments Incorporated, Dec. 2007, revised Oct. 2010, pp. 1-355. cited by applicant
  • Primary Examiner: Noh, Jae N
  • Attorney, Agent or Firm: Peterson, Carl G. ; Cimino, Frank D.

Klicken Sie ein Format an und speichern Sie dann die Daten oder geben Sie eine Empfänger-Adresse ein und lassen Sie sich per Email zusenden.

oder
oder

Wählen Sie das für Sie passende Zitationsformat und kopieren Sie es dann in die Zwischenablage, lassen es sich per Mail zusenden oder speichern es als PDF-Datei.

oder
oder

Bitte prüfen Sie, ob die Zitation formal korrekt ist, bevor Sie sie in einer Arbeit verwenden. Benutzen Sie gegebenenfalls den "Exportieren"-Dialog, wenn Sie ein Literaturverwaltungsprogramm verwenden und die Zitat-Angaben selbst formatieren wollen.

xs 0 - 576
sm 576 - 768
md 768 - 992
lg 992 - 1200
xl 1200 - 1366
xxl 1366 -