Quantcast
Jump to content


[Interview] AI-Driven Sound Innovation: Redefining the TV Audio Experience


Recommended Posts

It is no secret that Samsung Electronics — the global leader in TV manufacturing for 17 consecutive years — also has a strong presence in the soundbar market, boasting an impressive nine-year reign since 2013. The secret to Samsung’s success lies within a dynamic team of innovative engineers who are pioneering the way people consume content. At the heart of this change is Samsung’s advancement in artificial intelligence (AI) technology and the company’s use of AI to improve sound and picture quality across its screens.

 

Following the first installment of this series about the significance of hardware innovation in achieving premium sound quality, Samsung Newsroom sat down with its engineers once again to take a closer look at Samsung’s remarkable AI features that helped create a state-of-the-art sound experience.

 

 

Embracing AI for Sonic Perfection: Tuning Your Sound to Your Environment

“Ironically, I don’t recall sound engineers being interested in AI in the beginning when we started seeing a boom in the technology,” said Sunmin Kim, Head of the Sound Device Lab, Visual Display Business at Samsung Electronics. But with an intuition that AI could help improve TV sound, the Sound Device Lab decided to get a head start, about six years ago, in exploring AI and its applications to sound technologies.

 

Then, a shift occurred. With the advent of the Neural Processing Unit (NPU) and its application to Samsung’s flagship TVs, the possibilities of applying AI technology to TV audio were unlocked. The team fast-tracked machine learning for its TVs which led to significant early successes. Kim is confident that AI has and will continue to exponentially elevate the viewing experience by enhancing TV sound in numerous and profound ways.

 

Sound-Device-Lab-Interview-2_Main1.jpg

▲ “AI plays a critical role in improving the user experience on our screens,” said Kim.

 

Samsung’s advanced AI applications include a deep learning algorithm that distinguishes and separates the primary voice on the screen from other sounds. Before, an equalizer feature simply adjusted the high-, middle- and low-pitched sounds within humans’ audible frequency range — approximately 20 to 20,000Hz — to improve sound quality. The 2023 TVs and screens go above and beyond, providing deeper and greater details by analyzing content scene by scene and accentuating various audio elements including human voices, background music and sound effects. Additionally, this optimization process happens behind the scenes so that users can enjoy optimal sound effortlessly.

 

 

SpaceFit Sound: Tailoring Audio to Your Space

The listening environment and its acoustic properties must be considered to truly optimize sound from TVs. Samsung’s latest TVs come with the SpaceFit Sound feature that leverages AI technology to assess surrounding environments and ensure sound is appropriately adjusted. The feature utilizes the TV’s built-in microphone to automatically identify various factors present in the room, such as the distance between the TV and the wall as well as the room’s acoustic properties, to measure the reflection of the TV’s sound. AI is used to enhance the sound accordingly.

 

Sound-Device-Lab-Interview-2_Main2.gif

▲ SpaceFit Sound leverages AI to learn the acoustic properties of the environment and calibrates the sound accordingly.

 

“Through continuous research and analysis, we found certain frequency patterns that are more susceptible to change based on a device’s surroundings, potentially impacting the TV’s sound quality,” said Kibeom Kim. “The built-in microphone identifies changes in acoustic properties and sound caused by factors like a carpet or an empty room to optimize sound regardless of the TV’s location.”

 

“Traditionally, TVs use a set of dedicated sounds to check sound through the mic. SpaceFit Sound, on the other hand, utilizes real content to analyze viewing environments and modifies sound accordingly,” Kim explained. “The technology was designed not only for real scenarios but also real-time circumstances as the feature automatically and conveniently adjusts sound.”

 

Sound-Device-Lab-Interview-2_Main3.jpg

▲ Samsung’s SpaceFit Sound has become the industry’s first technology to earn the Spatial Sound Optimization certification from VDE.

 

In recognition of the company’s dedication to innovation and user-centric design, Samsung’s SpaceFit Sound also became the first audio technology to receive the Spatial Sound Optimization certification from Verband Deutscher Elektrotechniker (VDE) in 2021.

 

 

Q-Symphony 3.0: Harnessing Hyperconnectivity for Three-Dimensional Sound

Whether it’s through bigger screens or deeper acoustics, today’s viewers desire more cinematic experiences. Q-Symphony is a proprietary technology from Samsung that orchestrates a harmonious interplay between a TV’s speakers and a connected soundbar, resulting in a richer, more vibrant audio experience. As the name suggests, the feature allows two audio outputs to synchronize, similar to a carefully conducted concerto, creating a unified, immersive soundstage. More specifically, the soundbar plays primary audio channels, while the TV speakers add background and surround sounds to create a dynamic and three-dimensional audio experience.

 

Sound-Device-Lab-Interview-2_Main4.gif

▲ Q-Symphony allows soundbar and TV speakers to work in perfect sync, producing harmonious blends of sound for immersive experiences.

 

Despite the apparent simplicity in concept, Q-Symphony leverages a wide range of AI technologies to produce and sync sounds with such accuracy. Any gaps in sound levels between the TV speakers and soundbar must be precisely synced to prevent unwanted echoes and achieve perfect audio harmony. Over the years, Samsung engineers have tirelessly worked to refine this technology. Q-Symphony 1.0, which originally utilized the TV’s top speakers, evolved into Q-Symphony 2.0, which controls all speakers with improved channel separation technology for a greater sense of depth and immersion.

 

The latest Q-Symphony 3.0 takes sound to the next level by integrating the neural processor and AI-based real-time voice separation technology. This advanced Q-Symphony feature provides three-dimensional sound by distinguishing and optimizing various audio elements including voices, background music and sound effects based on the type of content and users’ volume settings. The resulting sound is a perfect replication of the audio track the creators intended.

 

Samsung’s AI algorithm can also take the input signals and play them through multiple channels, whether it’s the soundbar or all the TV speakers, customizing each channel for powerful and dynamic sounds. In addition to content featuring Dolby Atmos or 5.1-channel audio, content with regular stereo channels can also be processed to create 20 individual channels. This means that any media can be delivered with exceptionally immersive sound quality on Samsung TVs and soundbars.

 

Sound-Device-Lab-Interview-2_Main5.jpg

▲ “Q-Symphony is a revolutionary algorithm by Samsung that can masterfully synchronize audio volume and timing in perfect harmony,” said Kim.

 

“The sound offered through Q-Symphony is so immersive that viewers feel as though they are physically present on set with so many different background sounds coming alive through the feature,” said Kim.

 

 

Unifying Picture and Sound Experiences for Optimal Viewing Experiences

Today, AI sits at the core of Samsung’s audio strategy with its applications extending across numerous products. This widespread adoption of AI has resulted in features like Q-Symphony and SpaceFit Sound that enrich the audio experience, alongside other audio technologies that breathe life into content through dialogue and movement. Additional capabilities include Active Voice Amplifier, which adjusts and improves dialogue clarity with the speaker and surrounding noise in mind, Human Tracking Sound, which dynamically reproduces the sound based on the position of the on-screen speaker, and OTS Pro, which creates a dynamic soundscape based on the movement of objects or the speaker on the screen.

 

These features are the outcome of two symbiotic AI technologies: a content analysis model and a sound separation model. The neural processors work with both auditory and visual cues, among other signals, to create the perfect audio experience that syncs with what is happening on the screen. Despite the complexity of this process, Samsung was able to bring these features to life by forming a cross-departmental team of engineers and pooling resources across picture, sound and other departments.

 

 

The Future of Sound: Reshaping Audio Experiences With Samsung’s Sound Device Lab

Sound-Device-Lab-Interview-2_Main6.jpg

▲ (From left) Seongsu Park, Sunmin Kim and Kibeom Kim at the Sound Device Lab are on a mission to capture audio just as the artists intended.

 

In the Sound Device Lab, there is a clear and unwavering goal that guides every innovation: recreate the original sound as closely as the artists intended, with consumers top of mind. AI is a critical tool that enables Samsung to do this.

 

Sunmin Kim, who heads the Sound Device Lab, believes that sound is just one side of the coin: “The focus on sound quality is a given, but all innovations that made breakthroughs came from user-centric design. Sound settings and features need to be straightforward and user friendly.”

 

Seongsu Park noted that 70% of TV sound comes from the product while the remaining 30% is shaped by the space in which the sound is played: “Our products will continue to leverage the latest measurement systems and AI algorithms to analyze space and sound settings for optimal sound quality.”

 

On a final note, Kibeom Kim also shared the Sound Lab’s ambition in the era of multi-device sound experiences initiated by the Q-Symphony feature: “There is unlimited potential in Q-Symphony to produce audio that works in perfect harmony. We will continue to improve inter-device connectivity and enhance the feature for our users.”

 

Samsung is committed to delivering premium experiences for consumers, prioritizing their needs through innovative products. With a strong track record as a market leader for 17 consecutive years, Samsung will continue to enhance the viewing experience and drive sound innovation.

View the full article

Link to comment
Share on other sites



  • Replies 0
  • Created
  • Last Reply

Top Posters In This Topic

Popular Days

Top Posters In This Topic

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
  • Similar Topics

    • By Samsung Newsroom
      Samsung Electronics today announced a new partnership with FlexIt, a health and wellness solution that makes exercise more convenient and accessible. Starting this month,1 FlexIt will bring personal trainer-based fitness content to Samsung Smart TV users through the new lifestyle hub Samsung Daily+2 on Samsung Tizen OS.
       

       
      “Wellness should be central to our routines, so building healthy habits through Samsung Daily+ makes it convenient to incorporate health and wellness into all different aspects of daily life,” said Demian Hyun, Vice President and Head of the Experience Planning Group of Visual Display Business at Samsung Electronics. “This new partnership underscores Samsung’s commitment as the leader in the global display industry to promoting thoughtful, interconnected health experiences aimed at bettering the lives of consumers.”
       

       
      On the FlexIt app’s online portal, users can find, book and pay for exclusive one-on-one virtual fitness sessions directly on their TVs. With a camera connected — whether it be via a supported webcam3 or a smartphone — virtual health professionals4 provide real-time feedback, adjust workouts and offer form modifications to foster a supportive, safe and effective workout environment.
       

       
      The FlexIt app helps users approach their health in a more holistic way; in addition to workout content, FlexIt offers nutrition training, low-impact wellness activities like meditation and yoga, and physical and occupational therapy. By working virtually with a trainer who understands their personal fitness journey and wellness goals, users craft an attainable routine that suits their needs and lifestyle, all from the comfort of their home or any other location with a connected device.
       

       
      By housing services such as FlexIt, Samsung Daily+ is paving the way for the future of virtual health and wellness experiences through its convenience and accessibility to build productive and convenient daily routines. Samsung Daily+ serves as a new lifestyle hub for Smart TV users, allowing them to conveniently enjoy a wide range of premium lifestyle services and features — such as home fitness, telehealth services, video calls and more — using one single interface.
       
      “Through the innovative FlexIt app for Samsung, we’re furthering our commitment to making fitness more accessible than ever. By delivering personalized, one-on-one immersive training experiences directly to your living room, we’re extending our reach to a broader audience, empowering individuals to achieve their wellness goals with ease and convenience,” said Austin Cohen, FlexIt’s Founder and CEO.
       
      During CES® 2024, Samsung gave consumers an early look at Samsung Daily+ and the FlexIt app on its 2024 Neo QLED 8K. Richard Friedman, FlexIt’s Senior Vice President of Technology, joined the Samsung team in Las Vegas to showcase how the FlexIt app integrates with Samsung TVs. Samsung Daily+ is also a 2024 CES Innovation Awards Honoree, having been recognized as a unique smart home service with an open ecosystem that integrates third-party services.
       
      For more information on health offerings on Samsung’s TV lineup, visit Samsung.com.
       
       
      About FlexIt
      FlexIt has revolutionized the fitness and wellness industry through its innovative, cutting-edge technology, offering a comprehensive approach to holistic well-being for consumers and enterprises. Its core solution centers around live, one-on-one, two-way personal health and wellness sessions with fitness and wellness experts, accessible through both web and app platforms. FlexIt’s platform goes beyond just fitness training, embracing holistic well-being through nutrition coaching (led by registered nutritionists with a focus on weight loss), low-impact wellness activities (yoga, meditation, stretching and dance), health coaching, and physical and occupational therapy (covering preventive, pre/post-natal, senior and recovery), offering 28 health modalities on the platform.
       
      Our comprehensive and innovative approach has earned us recognition within the industry. FlexIt has been selected for the Best Budget-Friendly Coaching App of 2023 by Women’s Health, the Best Personal Trainer Apps of 2023 by Forbes, and the Best Fitness Apps in 2023 by Oprah Daily and has been awarded by Men’s Health, Inc. 5000, US News & World Report, among many others.
       
      For media inquiries, please contact:
      [email protected]
       
       
      1 Availability varies by model and region. The FlexIt app will be available through Samsung Daily+ on all 2024 TV models: Neo QLED 8K, 4K, OLED, UHD (above DU7000) and The Frame. OS upgrade is scheduled to be provided for select 2023 TV models during the second half of 2024. 2022 and 2021 TV model users can download the FlexIt app through the app store.
      2 Starting this year, Samsung Daily+, a hub for lifestyle experiences, provides a wide range of services and features — from personal training and telehealth to video calls and remote PC solutions — in one single interface. With Samsung TVs at the center of the home, users can enjoy the benefits of the latest innovations and seamless connectivity between devices in their day-to-day lives.
      3 Logitech Webcam (C930e, C922 PRO STREAM WEBCAM, C925E, C920s Pro HD Webcam, HD Pro Webcam C920, C920-C, C930c, HD Pro Webcam C920, StreamCam), Samsung (SC-FD100B)
      4 English- and Spanish-speaking FlexIt health professionals and trainers
      View the full article
    • By Samsung Newsroom
      Samsung Electronics, the world’s leading TV manufacturer for 18 consecutive years, has commenced its annual series of Tech Seminars in Frankfurt, Germany. From February 20 to 22, Samsung will showcase its newest display lineup for 2024 that features new, innovative AI technology and smart features on the Neo QLED, OLED and Lifestyle products to professionals in Europe.
       
      Tech Seminar sessions are a longstanding program, having delivered detailed information and exclusive hands-on experiences with new products for the past 13 years. As part of Samsung’s visual display vision — “We look out of the box to inspire new ways of life” — this year the company is displaying select, cutting-edge technologies from its 2024 lineup that offer new lifestyles and new ways of consuming content.
       
      The 2024 European Tech Seminar in Frankfurt sets the stage for similar sessions in major regions worldwide later this year, including Southeast Asia and Latin America. At these events, Samsung will feature new technologies that span across the latest TVs and lifestyle product lineup:
       
      Samsung’s 75-inch Neo QLED 8K QN900D incorporates the new and powerful NQ8 AI Gen3 Processor, which supports features like 8K AI Upscaling Pro and AI Motion Enhancer Pro for the best Neo QLED 8K visuals to date. The 2024 Tizen OS brings content front and center, offering a personalized experience based on different accounts set up on smart TVs. Tizen features services such as Samsung Gaming Hub, an all-in-one game streaming discovery platform, with content recommendations for a convenient and tailored cloud gaming experience. Music Frame is a customizable wireless speaker designed to seamlessly blend into its surroundings. It can operate as a standalone speaker, or it can pair with a Samsung TV and soundbar via Q-Symphony to deliver a more immersive viewing experience with surround sound. New OLED Glare Free technology was specifically designed for Samsung’s 2024 OLED screens and preserves color accuracy and image sharpness while reducing reflections from nearby lighting. The new, specialized hard-coating layer and surface coating pattern overcomes the trade-off between gloss and reflection.  
      ▲ Martin Kim, Picture Quality Solution Lab at Samsung Electronics, explains that the 2024 Neo QLED 8K incorporates the new and powerful NQ8 AI Gen3 Processor, supporting AI-backed features such as 8K AI Upscaling Pro and AI Motion Enhancer Pro.
       
      ▲ Andrew Sohn, Picture Quality Solution Lab at Samsung Electronics, shows off Samsung’s AI engine that can instantly optimize picture and sound quality based on the game or genre being played.
       
      ▲ Haylie Jung, Picture Quality Solution Lab at Samsung Electronics, demonstrates how users can set up their own profiles on the 2024 Tizen OS for Samsung Smart TVs to enjoy a customized experience including personal recommendations.
       
      ▲ Music Frame is a customizable wireless speaker designed to seamlessly blend into its surroundings.
       
      “Kicking off our Tech Seminar series is always something we look forward to,” said Yong-Jae Kim, Executive Vice President of Visual Display Business at Samsung Electronics. “Each year we have the opportunity to meet with local media and professionals, not just to provide in-depth demonstrations and explanations on new technology, but also to discuss the products we are most excited about and hear their feedback.”
       
      For more information on Samsung’s 2024 TV and lifestyle product lineup, visit samsung.com.
      View the full article
    • By Samsung Newsroom
      Samsung Electronics has once again demonstrated its dominance in the global TV market, marking an unprecedented 18-year streak at the forefront of the industry.
       
      Market research firm Omdia reported that Samsung has achieved a 30.1% share of the global TV market in 2023, reinforcing its status as the industry leader since 2006. This success is largely due to the company’s strategic focus on premium and large-screen TV categories, driven by its cutting-edge QLED and OLED models.
       
      Since its launch in 2017, Samsung’s QLED TV lineup, including the latest Neo QLED models, has surpassed cumulative sales of 40 million units. In 2023 alone, the QLED lineup achieved sales of 8.31million units.
       
      ▲ Samsung is ranked No. 1 global TV brand for 18th consecutive year
       
      Samsung asserted notable leadership in the premium TV sector – specifically for TVs over 75 inches and priced above $2,500. The company has recorded an impressive 60.5% market share in terms of sales for TVs priced over $2,500, while also maintaining a lead with 33.9% sales share for TVs over 75 inches. In addition, thanks to robust sales of 98-inch models, TVs over the 90 inches have maintained the lead with a 30.4% market share.
       
      Building on its success in the ultra-large and high-end TV market, Samsung has also made significant strides in the OLED sector. The company’s OLED TV lineup recorded 1.01 million units sold in 2023, capturing a market share of 22.7%. With the expanded OLED lineup in 2024, Samsung’s market share in the OLED sector is projected to surge in 2024.
       
      “We are proud to be recognized as the market leader in the global TV sector for 18 consecutive years, a testament to the enduring trust and loyalty our customers place in Samsung,” stated SW Yong, President and Head of Visual Display Business at Samsung Electronics. “We are deeply committed to advancing the industry, moving beyond exceptional picture quality to offer more meaningful and valuable experiences.”
       
      At CES 2024, Samsung Electronics unveiled the groundbreaking NQ8 AI Gen3 processor, heralding the start of the AI Screen Era. The advancement in state-of-the-art chipsets and capabilities is set to redefine the smart TV domain, integrating sophisticated AI powered by Tizen OS to establish AI screens as center of the smart home innovation.
       
      2024 is shaping up to be another year of significant innovation for Samsung. With advancements in processors and cutting-edge AI features, Samsung is on course to further transform home entertainment and set new benchmarks in the TV industry.
      View the full article
    • By OmeJuup
      An app that I would like to download and use (CAIWAY WebTV) is only supported by Tizen OS 5.0, but my Samsung TV is running on Tizen 4.0, so the app cannot be found. I updated the TV software to the latest version, but this does not update the Tizen OS itself. Is there a way to update the Tizen OS itself?
    • By Mahesh Gadhe
      <article>
              <div><img id="imageTag" src=""></div>
              <div><video id="videoTag" onended="onVideoEnded();" src=""></video></div>
              <!--<div id="YoutubePlayer" width="600" height="400" src="" frameborder="0" sandbox="allow-same-origin allow-scripts allow-popups allow-forms allow-top-navigation" style="z-index: 1;"></div>-->
              <div style="position:fixed; top:50%; left:50%; transform:translate(-50%, -50%); z-index:999;">
              <div id="YoutubePlayer" style="width:600px; height:400px;"></div>
          </div>

          </article>
      As to play the youtube video we need to use the youtube iframe, we are facing challenge here. When the youtube video plays on the TV, we lose control over app and hence next video as per CMS does not play. Same happens vice versa i.e when a video from CMS starts playing we are not able to play youtube video if it is next in the list.





×
×
  • Create New...