Get Consumer Devices every Monday

One free email with what the biggest companies in Consumer Devices filed, were granted and gave up this week.

The Thicket.
Consumer Devices / Week of Nov 16, 2026Get it every Monday →
All Consumer DevicesIssue 001 / Apple Inc.The filing
Apple Inc.Grant

Apple Inc. secures grant for spatial audio upscaling using machine learning.

The filing

Apple Inc. received a US grant on November 10, 2026 for a system that converts first order Ambisonics (FOA) audio into higher order Ambisonics (HOA) format using a machine learning model to improve spatial fidelity. The granted patent covers a method where the system obtains FOA audio, formats it into frames, processes it through a neural network to generate the higher order output, and transmits a compressed version to a remote device for final upscaling. While the application originally included claims for rendering with binaural or cross-talk cancellation, the examiner withdrew claims covering those specific rendering configurations under 35 U.S.C. 103.

The claims

USPTO 12,795,314 / 3 independent claims of 16

  1. Claim 1Previously presented

    A method comprising: obtaining a first order Ambisonics (FOA) audio that captures an audio scene; formatting each signal of the FOA audio to a stream of a plurality of audio frames, as formatted FOA audio; providing the formatted FOA audio to a machine learning model that is configured to upscale the formatted FOA audio into a desired higher order Ambisonics (HOA) format; obtaining output audio in the desired HOA format from the machine learning model; truncating the output audio to obtain a compressed FOA audio; and transmitting the compressed FOA audio to a remote device, wherein the remote device applies the machine learning model to the compressed FOA audio to obtain the desired HOA format.

  2. Claim 11Currently amended

    An audio system, comprising: a processor configured to: obtain first order Ambisonics (FOA) audio that includes a captured sound scene; rotate the FOA audio based on a user head position to produce a rotated FOA audio; format each signal of the rotated FOA audio to a stream of audio frames, as a formatted rotated FOA audio; provide the formatted rotated FOA audio to a machine learning model that is configured to upscale the formatted rotated FOA audio into a desired higher order Ambisonics (HOA) format; and obtain output audio of the captured sound scene in the desired HOA format from the machine learning model i remove higher order components of the output audio in the desired HOA format, to result in a compressed FOA audio ; and transmit the compressed FOA audio to a remote device, wherein the remote device applies the machine learning model to the compressed FOA audio to obtain the desired HOA format.

  3. Claim 16Previously presented

    A non-transitory machine-readable medium having stored therein instructions that, when executed by a processing device, cause the processing device to: obtain a first order Ambisonics (FOA) audio; format each signal of the FOA audio as time-domain audio frames; provide the time-domain audio frames to a machine learning model that is configured to upscale the FOA audio as a target higher order Ambisonics (HOA) format; and obtain output audio in the target HOA format from the machine learning model; remove higher order components of the output audio in the target HOA format, to result in a compressed FOA audio; and transmit the compressed FOA audio to a remote device, wherein the remote device applies the machine learning model to the compressed FOA audio to obtain the target HOA format.

The 13 dependent claims are in the record. Open the record (opens in a new tab)

Examiner rulings

  • Notice of Allowance, : Claims 11-14 withdrawn
  • Final Rejection, : Claim 12 rejected (35 U.S.C. 103); Claim 14 rejected (35 U.S.C. 103); Claim 15 objected

Expert view

Apple Inc. received a US grant on November 10, 2026 for a system that converts first order Ambisonics (FOA) audio into higher order Ambisonics (HOA) format using a machine learning model to improve spatial fidelity. The technology addresses the limitation of existing audio capture by extracting ambience from stereo inputs and upscaling it to a desired HOA format, which can then be rendered for headphones or surround sound speaker layouts. The granted patent covers a method where the system obtains FOA audio, formats it into frames, processes it through a neural network to generate the higher order output, and transmits a compressed version to a remote device for final upscaling. While the application originally included claims for rendering with binaural or cross-talk cancellation, the examiner withdrew claims covering those specific rendering configurations under 35 U.S.C. 103. The filing is consistent with continued investment in machine learning-based spatial audio processing.

Background

The applicant’s account of the prior art / USPTO 12,795,314

Sound may be understood as energy in the form of a vibration. Acoustic energy may propagate as an acoustic wave through a transmission medium such as a gas, liquid or solid. A microphone may capture acoustic energy in the environment. A microphone may include a transducer that converts the vibrational energy caused by acoustic waves into an electronic signal which may be analog or digital. The electronic signal, which may be referred to as a microphone signal, characterizes and captures sound that is present in the environment. Two or more microphones may form a microphone array that senses sound and spatial characteristics (e.g., direction and/or location) of the sound field in an environment. A processing device, such as a computer, a smart phone, a tablet computer, or a wearable device, can run an application that plays audio to a user or processes audio to convert the audio from one format to another. For example, a computer can launch an audio conversion application, or an audio playback application such as a movie player, a music player, a conferencing application, a phone call, an alarm, a game, a user interface, a web browser, or other application that outputs audio (with captured sound) to a user through speakers. SUMMARY In some aspects of the disclosure here, an audio processing device may be configured to perform operations that upscale or increase spatial resolution (also referred to as super-resolution) first order Ambisonics (FOA) to higher order Ambisonics (HOA). The device may obtain a first order Ambisonics (FOA) audio that captures or represents a sound scene or an audio scene. FOA may be obtained based on audio capture, or it may be obtained through encoding of audio - any object can be encoded to any direction into FOA. For example, a 7.1.4 audio signal can be converted to FOA. The device may format each signal of the FOA audio to a stream of audio frames. The device may provide the formatted FOA audio to a machine learning (ML) model that is configured to upscale the formatted FOA audio into a target or desired HOA format. The output audio is obtained in the desired HOA format from the machine learning model and may then be rendered spatially. Upscaling FOA to HOA provides increased spatial fidelity as well as improved output flexibility. A machine learning model may be utilized to upscale FOA to HOA and provide higher spatial fidelity with reduced power and reduced latency. In another aspect, the audio processing device has an ML model-based subsystem (e.g., a Cov-Tas-Net neural network) that is configured to extract ambience (also referred to here as background sound or diffuse sound content) out of a stereo input file, in the form of FOA. In one use case, the ambience in FOA format (ambience FOA) may then be upscaled to HOA as described above, before being spatially rendered for playback through a desired speaker layout. In one instance, the speaker layout is loudspeakers, and the speaker driver signals are produced by an ambisonics panning method such as All-Round Ambisonics Decoding, AllRAD which can render the ambience FOA to any arbitrary speaker layout. In another instance, the speaker layout is headphones, and the left and right headphone driver signals are produced by for example projecting the ambience FOA to any desired spherical speaker grid such as the T-Design grid. The ambience FOA may be rendered directly, without being up mixed to HOA, along with one or more of left, right and center channels that are also extracted from the stereo input. In all cases, as the ambience in FOA form is derived from the entire sound field, it not only enables creation of a more immersive sound field (giving the illusion of space when the stereo input file is being rendered by the playback system) despite being provided with only a stereo input, but also enables flexibility in how the stereo input file is spatially rendered for playback. The above summary does not include an exhaustive list of all aspects of the present disclosure. It is contemplated that the disclosure includes all systems and methods that can be practiced from all suitable combinations of the various aspects summarized above, as well as those disclosed in the Detailed Description below and particularly pointed out in the Claims section. Such combinations may have particular advantages not specifically recited in the above summary.

Get Consumer Devices every Monday.

© 2026 Fearn AI, Inc. All rights reserved.

Information from the public patent record, not legal advice.

Big Law patents. In plain sight.

The all-in-one patent firm for startups. Former Big Law patent experts and PhDs, on AI that runs on our own GPUs.

Social

Newsletter

Stay updated on the future of intellectual property.

Fearn Legal, LLC is a patent prosecution firm, licensed to file and prosecute patents across the USPTO. The information provided here is for general informational purposes only and does not constitute legal advice. Viewing this information or contacting us through this website does not create an attorney-client or patent agent-client relationship. For personalized legal advice, please reach out to us directly to set up a legal consult or consult directly with a qualified attorney.

Big Law patents. In plain sight.

Social

Newsletter

Stay updated on the future of intellectual property.

Fearn Legal, LLC is a patent prosecution firm, licensed to file and prosecute patents across the USPTO. The information provided here is for general informational purposes only and does not constitute legal advice. Viewing this information or contacting us through this website does not create an attorney-client or patent agent-client relationship. For personalized legal advice, please reach out to us directly to set up a legal consult or consult directly with a qualified attorney.

Big Law patents. In plain sight.

The all-in-one patent firm for startups. Former Big Law patent experts and PhDs, on AI that runs on our own GPUs.

Social

Newsletter

Stay updated on the future of intellectual property.

Fearn Legal, LLC is a patent prosecution firm, licensed to file and prosecute patents across the USPTO. The information provided here is for general informational purposes only and does not constitute legal advice. Viewing this information or contacting us through this website does not create an attorney-client or patent agent-client relationship. For personalized legal advice, please reach out to us directly to set up a legal consult or consult directly with a qualified attorney.