TIB AV-Portal

The transfer of scientific knowledge in the form of videos is becoming increasingly important in society, culture, business and politics. Videos can be easily embedded in websites, shared via social media and incorporated into presentations, giving them a wide reach and visibility.

On April 29, 2024, the TIB AV-Portal celebrated its tenth anniversary. Since its launch in 2014, it has developed into a central platform for scientific videos and has taken on an important role within the academic community. As an open and free platform, it offers numerous services such as permanent citation, long-term archiving and automatic video analysis. It is ad-free and complies with the requirements of the General Data Protection Regulation (GDPR).

The portal currently provides more than 47,000 quality-checked scientific videos (as of October 2024), including conference recordings, instructional videos, experiments, interviews and animations. These videos are archived for the long term, given a Digital Object Identifier (DOI) and indexed using automatic analysis methods such as shot recognition, video OCR, visual concept classification and named entity linking. Since July 2023, newly uploaded videos have been transcribed and translated into English using the Whisper software provided by OpenAI as open source. These processes enable precise searchability of the video content and the targeted retrieval of relevant sections.

The AV portal's Scrum team is currently focusing on video delivery via TIB servers and the implementation of adaptive streaming with MPEG-DASH and HLS. At the same time, the front end is being converted to Nuxt and Vue.js, which enables a seamless user experience and improves search engine optimization, performance and loading times. In addition, the Scrum team is working closely with the Visual Analytics research group at TIB to expand the classification of visual concepts based on an open-clip model.

The service is continuously being developed using the latest technologies, methods and research findings. The Scrum team is currently experimenting with AI models such as LLaMA and OpenCLIP to generate video abstracts based on language transcripts and to restructure the labeling of image concepts. In addition, new media partnerships are constantly being forged in order to expand the service and reach new target groups.

Europeana Aggregator

As an aggregator for scientific films, we supply standardized metadata to EUROPEANA, which publishes them on its portal. We were also involved in EU-funded projects aimed at making EUROPEANA fit for AV media, such as the  Europeana XX and Europeana Media projects.

Third-party funded projects

  • We are participating as a practice partner in the STELLA project, a platform for living lab experiments with ranking and recommendation systems. The Scrum team of the AV-Portal will integrate STELLA into the TIB infrastructure in order to evaluate the recommender system with real user feedback. STELLA enables interleaving experiments to determine the best recommendation algorithm. User feedback helps to develop more precise recommendations, increase the relevance of video recommendations and improve user satisfaction.
  • AV-EFI - Automatisiertes Verbundsystem für audiovisuelle Bestände über einheitliche Filmidentifikatoren (DFG), 2023-2025

  • TIB AV Analytics (DFG), 2021-2024

 

 

 

 

 

 

 

 

Feedback