Tracking Ensemble Performance on Touch-Screens with Gesture Classification and Transition Matrices. Martin, C.; Gardner, H.; and Swift, B. In Proceedings of the International Conference on New Interfaces for Musical Expression, 2015.
Tracking Ensemble Performance on Touch-Screens with Gesture Classification and Transition Matrices [pdf]Paper  abstract   bibtex   
We present and evaluate a novel interface for tracking ensemble performances on touch-screens. The system uses a Random Forest classifier to extract touch-screen gestures and transition matrix statistics. It analyses the resulting gesture-state sequences across an ensemble of performers. A series of specially designed iPad apps respond to this real-time analysis of free-form gestural performances with calculated modifications to their musical interfaces. We describe our system and evaluate it through cross-validation and profiling as well as concert experience.
@inproceedings{ Martin:2015jk,
  author = {Charles Martin and Henry Gardner and Ben Swift},
  booktitle = {Proceedings of the International Conference on New
                  Interfaces for Musical Expression},
  title = {Tracking Ensemble Performance on Touch-Screens with
                  Gesture Classification and Transition Matrices},
  year = {2015},
  abstract = {We present and evaluate a novel interface for
                  tracking ensemble performances on touch-screens. The
                  system uses a Random Forest classifier to extract
                  touch-screen gestures and transition matrix
                  statistics. It analyses the resulting gesture-state
                  sequences across an ensemble of performers. A series
                  of specially designed iPad apps respond to this
                  real-time analysis of free-form gestural
                  performances with calculated modifications to their
                  musical interfaces. We describe our system and
                  evaluate it through cross-validation and profiling
                  as well as concert experience.},
  url = {https://nime2015.lsu.edu/proceedings/242/0242-paper.pdf}
}
Downloads: 0