dlc2action.transformer

Augmentations and feature concatenation

Input data in dlc2action is stored in feature dictionaries right up until being passed to a model. That makes it possible to define universal augmentations and SSL transformations that work on a range of datasets naturally. Those dictionaries are generated by a feature extractor when a dlc2action.data.base_store.InputStore instance is initialised. They are then (optionally) processed by SSL transformations (see dlc2action.ssl) and finally merged into tensors by *transformers*.dlc2action.transformer.base_transformer.Transformer` instances can also perform augmentations before the merging.

View Source

 1#
 2# Copyright 2020-present by A. Mathis Group and contributors. All rights reserved.
 3#
 4# This project and all its files are licensed under GNU AGPLv3 or later version. 
 5# A copy is included in dlc2action/LICENSE.AGPL.
 6#
 7"""
 8## Augmentations and feature concatenation
 9
10Input data in `dlc2action` is stored in feature dictionaries right up until being passed to a model.
11That makes it possible to define universal augmentations and SSL transformations that work on a range of datasets
12naturally. Those dictionaries are generated by a *feature extractor* when a `dlc2action.data.base_store.InputStore`
13instance is initialised. They are
14then (optionally) processed by SSL transformations (see `dlc2action.ssl) and finally merged into tensors by
15*transformers*. `dlc2action.transformer.base_transformer.Transformer` instances
16can also perform augmentations before the merging.
17"""
18
19from dlc2action.transformer.kinematic import KinematicTransformer
20from dlc2action.transformer.heatmap import HeatmapTransformer