A Visual Approach to Measure Cloth-Body and Cloth-Cloth Friction - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Pattern Analysis and Machine Intelligence Year : 2022

A Visual Approach to Measure Cloth-Body and Cloth-Cloth Friction


Measuring contact friction in soft-bodies usually requires a specialised physics bench and a tedious acquisition protocol. This makes the prospect of a purely non-invasive, video-based measurement technique particularly attractive. Previous works have shown that such a video-based estimation is feasible for material parameters using deep learning, but this has never been applied to the friction estimation problem which results in even more subtle visual variations. Because acquiring a large dataset for this problem is impractical, generating it from simulation is the obvious alternative. However, this requires the use of a frictional contact simulator whose results are not only visually plausible, but physically-correct enough to match observations made at the macroscopic scale. In this paper, which is an extended version of our former work [31], we propose to our knowledge the first non-invasive measurement network and adjoining synthetic training dataset for estimating cloth friction at contact, for both cloth-hard body and cloth-cloth contacts. To this end we build a protocol for validating and calibrating a state-of-the-art frictional contact simulator, in order to produce a reliable dataset. We furthermore show that without our careful calibration procedure, the training fails to provide accurate estimation results on real data. We present extensive results on a large acquired test set of several hundred real video sequences of cloth in friction, which validates the proposed protocol and its accuracy.
Vignette du fichier
dataset.png (637.35 Ko) Télécharger le fichier
Vignette du fichier
friction.png (176.06 Ko) Télécharger le fichier Fichier principal
Vignette du fichier
PAMI_2020_Revised_Paper.pdf (4.02 Mo) Télécharger le fichier
PAMI_2020_supplemental_video.mp4 (39.51 Mo) Télécharger le fichier
PAMI_2020_supplemental.pdf (20.16 Mo) Télécharger le fichier
Format : Figure, Image
Format : Figure, Image
Origin : Files produced by the author(s)
Format : Video
Licence : CC BY - Attribution
Origin : Files produced by the author(s)

Dates and versions

hal-03285624 , version 1 (13-07-2021)



Abdullah-Haroon Rasheed, Victor Romero, Florence Bertails-Descoubes, Stefanie Wuhrer, Jean-Sébastien Franco, et al.. A Visual Approach to Measure Cloth-Body and Cloth-Cloth Friction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44 (10), pp.6683-6694. ⟨10.1109/TPAMI.2021.3097547⟩. ⟨hal-03285624⟩
226 View
291 Download



Gmail Facebook Twitter LinkedIn More