Free Viewpoint Video (FVV)

  • 3D Content Creation for VR/AR Applications

Creative Experiments

  • Jonathan Swift in VR/AR - The Long Room Project

    The Long Room holds a very special place in the hearts of students, staff, alumni of Trinity College Dublin, and the wider Dublin community. There is no substitute for the genuine experience of being immersed in the great space within the Long Room. However, we were inspired to create an anecdotal visitor narrative and concept that would augment the visitor experience. The user is guided through the Long Room by a friendly vologram, a volumetric 3D video representation of the great Jonathan Swift. The Virtual Reality (VR) and Augmented Reality (AR) innovative prototypes we created enabled an interactive narrative whereby a visitor can engage in an augmented tour of the Long Room with the use of this interactive digital media and which highlighted the following distinctive features:

    • The content: Books, rare artefacts, sculptures, etc.
    • The environment: the building itself (UNESCO world heritage site), most breath-taking feature
    • The heritage: the history, the Historical significance, the legacy
    • and the technology: the project would be synergetic, in the sense the we would develop the technology around engaging content.

    The interactive Virtual Reality (VR) prototype visualized The Long Room content and history where a user would be immersed in a world through VR simulation. The user could be located anywhere in the world, and by putting on the Head Mounted Display (HMD), they can enter the magical virtual simulation of the Long Room. The user can explore this on PC (browser), iPad, iPhone or Android Phone/Tablet. The Augmented Reality (AR) version takes place within the actual Library environment via the use of HoloLens or handheld was developed in the second phase and only uses Dynamic content and did not ‘virtually’ reconstruct the internal spaces of the Long Room. This project is an example of our creative experiments, which showcase our original technologies in real creative productions. In this case we demonstrate our novel tools and pipeline for AR/VR content creation.

  • Reinterpreting Samuel Beckett for Virtual Reality

    Since the early years of the twenty-first century, the performing arts have been party to an increasing number of digital media projects that bring renewed attention to questions about, on one hand, new working processes involving capture and distribution techniques, and on the other hand, how particular works—with bespoke hard and software—can exert an efficacy over how work is created by the artist/producer or received by the audience. The evolution of author/audience criteria demand that digital arts practice modify aes- thetic and storytelling strategies, to types that are more appropriate to communicating ideas over interactive digital networks, wherein AR/VR technologies are rapidly becoming the dominant interface. This project explores these redefined criteria through a reimagining of Samuel Becketts Play (1963) for digital culture. This paper offers an account of the working processes, the aesthetic and technical considerations that guide artistic decisions and how we attempt to place the overall work in the state of the art.

  • Leave a Trace (LAT)

    Tracking of People in an indoor environment

    Together with Prof. Tyyne Claudia Pollmann, of the “Kunsthochschule Berlin Weißensee”, we implemented a person tracking project. She had won the call for an exhibit within the new Charité building “Charité Cross Over”. The Team around Ralf Reulke was charged with the development of the system. A 2 Megapixel high quality camera was used with an 4 core computing unit and a very fast graphics card. The tracking software from a former project was adapted, such that heavy image computations were implemented in the graphical processing unit. The results showed a high frame rate processing of 12 to 13 frames per second.

3D Human Recognition

  • Securail (2012)

    Development of a Solution for Online Video surveillance in Civil Railway Transportation Systems

    The aim of the project was to develop an optical system for the realization of monitoring functions based on the analysis of three-dimensional point clouds and derived quantities. The application is the rail-based public transport, the entire passenger compartment is to be recorded and analyzed. There are methods for fusing data to develop for noise removal and pattern recognition. To create it data basis two different camera systems (stereo and RGB-D) are used, stereo camera Hella People Counter and RGB-D Microsoft Kinect. People are considered 3D ellipsoids and their movement patterns analyzed. The multi-camera system using this poses particular challenges of synchronization and stability.


    Michele Adduci, Konstantinos Amplianitis, Martin Misgaiski-Hass, Christian Kaptur,Sourabh Bodas, Silvio Tristram


    Reference Link

Face Recognition

  • Understanding Babies Expressions

Software Development

  • Cassandra (2012)

    OpenCV wrapping for Cassandra Software

    The company Hella Aglaia Mobile Vision GmbH develops and distributes intelligent visual sensor systems. This also includes the software Cassandra, a tool for fast development of (prototypic) image processing algorithms. Cassandra is implemented in C++ and specializes on the automotive area. Cassandra has changed significantly for version 11: improved multi core support, better synchronization of data sources and sinks, realtime requirements can now be applied, since the system won’t be cluttered by too much data and many more features have been implemented. Cassandra will also be released in a community edition. This edition allows academic associates and students to rapidly develop and test their own image processing algorithms. The outstanding feature of Cassandra is the lack of need for programming skills. But still, if you know C++, you can extend Cassandra with your own stations.

    With the freely available third party library OpenCV users have a very powerful image processing tool. This library will be implemented in Cassandra 11. The task of the CV group is to reasonably implement OpenCV functions and classes to Cassandra stations. The problem is the different concept of OpenCV and Cassandra. The latter one makes use of data flow graphs. In contrast, OpenCV requires much more user input and control about parameters and the use of the classes.
    The OpenCV modul core has already been ported to Cassandra by Hella Aglaia. The CV group has implemented the modules calib3d, features2d, video analysis and object detection. With the experience and knowledge of our group, we could add meaningful application scenarios and end user tutorials.