Contents

IOT project : Ambilight | Ensimag's project

Introduction

Ambilite is the ideal solution to improve your viewing experience. Thanks to our technology, you can synchronize the LEDs behind your screen with the image displayed the displayed image for a total immersion in your movie or video. Our product is similar to Philips Ambilight technology, but is compatible with all screens, unlike Ambilight which is only available on some TVs or with an HDMI adapter which HDMI adapter which limits functionality and adds latency.
Our main objective is to create an immersive and responsive lighting environment that will enhance your viewing experience.

Problems and proposed solutions

Several problems arise from the initial idea.

  • First of all, how to capture the image of the screen without disturbing the user?
    The solution is to use a wide angle camera to allow filming as close as possible to the screen, while being close to the screen, while being below or above it, and thus without blocking the field of view.
  • Then, how to extract from the image the colors of the screen ?
    For this, Ambilite uses points of interest (4 or 8) distributed at the ends of the screen, and extracts the colors of the screen. the screen, and extracts the colors of these points of interest. Finally, a color gradient is done between them to complete the missing colors.
  • Finally, how to make Ambilite usable on all types of screens and thus of variable size?
    A mobile application has been created to configure the placement of the centers of interest and the number of and the number of leds to light between each point of interest. The application also also allows to turn on or off the device.

Use case

To configure Ambilite, you must use the mobile application created in React Native. When first use, the application will ask you to select the points of interest on the screen. To do so, you will have a visual feedback on the image captured by the camera and you will be able to select the following points: bottom left, top left, top right, bottom right. right, bottom right, middle left, middle top, middle right and middle bottom. bottom middle.
Once you have selected all the points of interest, the application will offer you to configure the length of the leds in relation to each side of the screen. The leds will light up to show you the current settings and you can adjust them according to your preferences.
The data recorded in the application is then sent to a REST API programmed in NodeJS. This API is used to store all the application’s configuration elements on the Raspberry of the application on the Raspberry Pi. This configuration is then used in real time by the the Python application and thus perform the necessary calculations to synchronize the leds with the image displayed on the screen. Thanks to this simple and intuitive configuration, you can easily set up easily configure Ambilite and enjoy an immersive viewing experience.
The screen image is captured by a camera placed on the front of the screen. This wide-angle camera captures the entire image displayed on the screen in real time in real time.
The recovered images are then analyzed and processed using an application realized in Python. Thereafter, various interpolation and filtering techniques are performed to obtain the closest performed to obtain the color as close as possible to the one displayed on the screen despite the constraints of the camera. These techniques make it possible to correct the color errors and ensure that the colors displayed on the screen best match the colors captured by the camera.
Once the colors of the image have been calculated in relation to the points of interest on the screen the application sends this information to a series of leds located behind the screen. These leds are then lit with colors close to those displayed on the screen, which This allows to create an immersive lighting atmosphere that follows the image on the screen. Thanks to this this technology, you can immerse yourself completely in your movie or video and enjoy a enjoy a unique viewing experience

POC