-
An Advert Creation System for 3D Product Placements
Authors:
Ivan Bacher,
Hossein Javidnia,
Soumyabrata Dev,
Rahul Agrahari,
Murhaf Hossari,
Matthew Nicholson,
Clare Conran,
Jian Tang,
Peng Song,
David Corrigan,
François Pitié
Abstract:
Over the past decade, the evolution of video-sharing platforms has attracted a significant amount of investments on contextual advertising. The common contextual advertising platforms utilize the information provided by users to integrate 2D visual ads into videos. The existing platforms face many technical challenges such as ad integration with respect to occluding objects and 3D ad placement. Th…
▽ More
Over the past decade, the evolution of video-sharing platforms has attracted a significant amount of investments on contextual advertising. The common contextual advertising platforms utilize the information provided by users to integrate 2D visual ads into videos. The existing platforms face many technical challenges such as ad integration with respect to occluding objects and 3D ad placement. This paper presents a Video Advertisement Placement & Integration (Adverts) framework, which is capable of perceiving the 3D geometry of the scene and camera motion to blend 3D virtual objects in videos and create the illusion of reality. The proposed framework contains several modules such as monocular depth estimation, object segmentation, background-foreground separation, alpha matting and camera tracking. Our experiments conducted using Adverts framework indicates the significant potential of this system in contextual ad integration, and pushing the limits of advertising industry using mixed reality technologies.
△ Less
Submitted 26 June, 2020;
originally announced June 2020.
-
Identifying Candidate Spaces for Advert Implantation
Authors:
Soumyabrata Dev,
Hossein Javidnia,
Murhaf Hossari,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
Virtual advertising is an important and promising feature in the area of online advertising. It involves integrating adverts onto live or recorded videos for product placements and targeted advertisements. Such integration of adverts is primarily done by video editors in the post-production stage, which is cumbersome and time-consuming. Therefore, it is important to automatically identify candidat…
▽ More
Virtual advertising is an important and promising feature in the area of online advertising. It involves integrating adverts onto live or recorded videos for product placements and targeted advertisements. Such integration of adverts is primarily done by video editors in the post-production stage, which is cumbersome and time-consuming. Therefore, it is important to automatically identify candidate spaces in a video frame, wherein new adverts can be implanted. The candidate space should match the scene perspective, and also have a high quality of experience according to human subjective judgment. In this paper, we propose the use of a bespoke neural net that can assist the video editors in identifying candidate spaces. We benchmark our approach against several deep-learning architectures on a large-scale image dataset of candidate spaces of outdoor scenes. Our work is the first of its kind in this area of multimedia and augmented reality applications, and achieves the best results.
△ Less
Submitted 8 October, 2019;
originally announced October 2019.
-
Localizing Adverts in Outdoor Scenes
Authors:
Soumyabrata Dev,
Murhaf Hossari,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
Online videos have witnessed an unprecedented growth over the last decade, owing to wide range of content creation. This provides the advertisement and marketing agencies plethora of opportunities for targeted advertisements. Such techniques involve replacing an existing advertisement in a video frame, with a new advertisement. However, such post-processing of online videos is mostly done manually…
▽ More
Online videos have witnessed an unprecedented growth over the last decade, owing to wide range of content creation. This provides the advertisement and marketing agencies plethora of opportunities for targeted advertisements. Such techniques involve replacing an existing advertisement in a video frame, with a new advertisement. However, such post-processing of online videos is mostly done manually by video editors. This is cumbersome and time-consuming. In this paper, we propose DeepAds -- a deep neural network, based on the simple encoder-decoder architecture, that can accurately localize the position of an advert in a video frame. Our approach of localizing billboards in outdoor scenes using neural nets, is the first of its kind, and achieves the best performance. We benchmark our proposed method with other semantic segmentation algorithms, on a public dataset of outdoor scenes with manually annotated billboard binary maps.
△ Less
Submitted 6 May, 2019;
originally announced May 2019.
-
The ALOS Dataset for Advert Localization in Outdoor Scenes
Authors:
Soumyabrata Dev,
Murhaf Hossari,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
The rapid increase in the number of online videos provides the marketing and advertising agents ample opportunities to reach out to their audience. One of the most widely used strategies is product placement, or embedded marketing, wherein new advertisements are integrated seamlessly into existing advertisements in videos. Such strategies involve accurately localizing the position of the advert in…
▽ More
The rapid increase in the number of online videos provides the marketing and advertising agents ample opportunities to reach out to their audience. One of the most widely used strategies is product placement, or embedded marketing, wherein new advertisements are integrated seamlessly into existing advertisements in videos. Such strategies involve accurately localizing the position of the advert in the image frame, either manually in the video editing phase, or by using machine learning frameworks. However, these machine learning techniques and deep neural networks need a massive amount of data for training. In this paper, we propose and release the first large-scale dataset of advertisement billboards, captured in outdoor scenes. We also benchmark several state-of-the-art semantic segmentation algorithms on our proposed dataset.
△ Less
Submitted 16 April, 2019;
originally announced April 2019.
-
The CASE Dataset of Candidate Spaces for Advert Implantation
Authors:
Soumyabrata Dev,
Murhaf Hossari,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
With the advent of faster internet services and growth of multimedia content, we observe a massive growth in the number of online videos. The users generate these video contents at an unprecedented rate, owing to the use of smart-phones and other hand-held video capturing devices. This creates immense potential for the advertising and marketing agencies to create personalized content for the users…
▽ More
With the advent of faster internet services and growth of multimedia content, we observe a massive growth in the number of online videos. The users generate these video contents at an unprecedented rate, owing to the use of smart-phones and other hand-held video capturing devices. This creates immense potential for the advertising and marketing agencies to create personalized content for the users. In this paper, we attempt to assist the video editors to generate augmented video content, by proposing candidate spaces in video frames. We propose and release a large-scale dataset of outdoor scenes, along with manually annotated maps for candidate spaces. We also benchmark several deep-learning based semantic segmentation algorithms on this proposed dataset.
△ Less
Submitted 29 April, 2019; v1 submitted 21 March, 2019;
originally announced March 2019.
-
ADNet: A Deep Network for Detecting Adverts
Authors:
Murhaf Hossari,
Soumyabrata Dev,
Matthew Nicholson,
Killian McCabe,
Atul Nautiyal,
Clare Conran,
Jian Tang,
Wei Xu,
François Pitié
Abstract:
Online video advertising gives content providers the ability to deliver compelling content, reach a growing audience, and generate additional revenue from online media. Recently, advertising strategies are designed to look for original advert(s) in a video frame, and replacing them with new adverts. These strategies, popularly known as product placement or embedded marketing, greatly help the mark…
▽ More
Online video advertising gives content providers the ability to deliver compelling content, reach a growing audience, and generate additional revenue from online media. Recently, advertising strategies are designed to look for original advert(s) in a video frame, and replacing them with new adverts. These strategies, popularly known as product placement or embedded marketing, greatly help the marketing agencies to reach out to a wider audience. However, in the existing literature, such detection of candidate frames in a video sequence for the purpose of advert integration, is done manually. In this paper, we propose a deep-learning architecture called ADNet, that automatically detects the presence of advertisements in video frames. Our approach is the first of its kind that automatically detects the presence of adverts in a video frame, and achieves state-of-the-art results on a public dataset.
△ Less
Submitted 9 November, 2018;
originally announced November 2018.
-
An Advert Creation System for Next-Gen Publicity
Authors:
Atul Nautiyal,
Killian McCabe,
Murhaf Hossari,
Soumyabrata Dev,
Matthew Nicholson,
Clare Conran,
Declan McKibben,
Jian Tang,
Xu Wei,
Francois Pitie
Abstract:
With the rapid proliferation of multimedia data in the internet, there has been a fast rise in the creation of videos for the viewers. This enables the viewers to skip the advertisement breaks in the videos, using ad blockers and 'skip ad' buttons -- bringing online marketing and publicity to a stall. In this paper, we demonstrate a system that can effectively integrate a new advertisement into a…
▽ More
With the rapid proliferation of multimedia data in the internet, there has been a fast rise in the creation of videos for the viewers. This enables the viewers to skip the advertisement breaks in the videos, using ad blockers and 'skip ad' buttons -- bringing online marketing and publicity to a stall. In this paper, we demonstrate a system that can effectively integrate a new advertisement into a video sequence. We use state-of-the-art techniques from deep learning and computational photogrammetry, for effective detection of existing adverts, and seamless integration of new adverts into video sequences. This is helpful for targeted advertisement, paving the path for next-gen publicity.
△ Less
Submitted 1 August, 2018;
originally announced August 2018.
