motion response
Active Listener: Continuous Generation of Listener's Head Motion Response in Dyadic Interactions
Ghosh, Bishal, Li, Emma, Guha, Tanaya
A key component of dyadic spoken interactions is the contextually relevant non-verbal gestures, such as head movements that reflect a listener's response to the interlocutor's speech. Although significant progress has been made in the context of generating co-speech gestures, generating listener's response has remained a challenge. We introduce the task of generating continuous head motion response of a listener in response to the speaker's speech in real time. To this end, we propose a graph-based end-to-end crossmodal model that takes interlocutor's speech audio as input and directly generates head pose angles (roll, pitch, yaw) of the listener in real time. Different from previous work, our approach is completely data-driven, does not require manual annotations or oversimplify head motion to merely nods and shakes. Extensive evaluation on the dyadic interaction sessions on the IEMOCAP dataset shows that our model produces a low overall error (4.5 degrees) and a high frame rate, thereby indicating its deployability in real-world human-robot interaction systems. Our code is available at - https://github.com/bigzen/Active-Listener
How to choose the best TV for gaming right now
Finding a suitable TV for your PlayStation or Xbox used to require a careful look at spec sheets. But that's not the case these days as the best TVs for gaming are usually the best TVs you can buy, period. While nobody needs a fancy TV to enjoy a good video game, the right set can help you maximize your gaming hardware's potential. If you're unsure of where to start, we've laid out some helpful advice for buying the right model below, along with a few recommendations for the best gaming TVs you can buy today. Whether you use it for gaming or not, all good TVs are built on the same foundations.
Response Component Analysis for Sea State Estimation Using Artificial Neural Networks and Vessel Response Spectral Data
Long, Nathan K., Sgarioto, Daniel, Garratt, Matthew, Sammut, Karl
The use of the `ship as a wave buoy analogy' (SAWB) provides a novel means to estimate sea states, where relationships are established between causal wave properties and vessel motion response information. This study focuses on a model-free machine learning approach to SAWB-based sea state estimation (SSE), using neural networks (NNs) to map vessel response spectral data to statistical wave properties for a small uninhabited surface vessel. Results showed a strong correlation between heave responses and significant wave height estimates, whilst the accuracy of mean wave period and wave heading predictions were observed to improve considerably when data from multiple vessel degrees of freedom (DOFs) was utilized. Overall, 3-DOF (heave, pitch and roll) NNs for SSE were shown to perform well when compared to existing SSE approaches that use similar simulation setups. One advantage of using small vessels for SAWB was shown as SSE accuracy was reasonable even when motion responses were low (in high-frequency, low wave height sea states). Given the information-dense statistical representation of vessel motion responses in spectral form, as well as the ability of NNs to effectively model complex relationships between variables, the designed SSE method shows promise for future adaptation to mobile SSE systems using the SAWB approach.