Provisional – Stochastic signatures of autonomous and naive human learning for training artificial agents.
Scientific Publications for Scalable Science
The biosensors’ revolution of the past couple of decades is facilitating the scaling of our basic research in our labs to broad use at people’s home, schools, sports facilities, and doctors’ clinics. Commercially available technologies like smartphones, smartwatches and smart tablets are now routinely used to passively collect data in our purses, our pockets, and bodies, unobtrusively, as we go about our lives without even noticing all the data that is being registered and underutilized. From spoken language, to video of faces and bodies in motion, to heart, breathing and walking biorhythms, we can now trivially acquire data in the wild. Our lab facilitates the analyses of such data and informs it by clinical criteria, to advance predictive analytics and interpretable digital biomarkers of mental, emotional and physical states.
Sample papers using smart phones and light wearables
Neonatal Diagnostics: Towards Dynamic Growth Charts of Neuromotor Control
Our patented technologies are available for licensing by the Rutgers Office of Innovation Ventures, Technology Transfer and Commercialization. We have undergone training at the national NSF Innovation Corps and identified market fit areas for our technologies.
Licensed technology and collaborative work with SILAS Solutions
We have partnered with Social Interactive Learning Avatar Software (SILAS) Solutions to create a measurement platform that registers dyadic interactions in a naturalistic environment where children create, enact and play back their own brief scripts mediated by avatars of their choice.
The avatars represent the children and are endowed with the children’s voices, motions, and emotions in real time. As the two children interact, they can see the avatars as an extension of themselves and later replay the video of the interaction. They can then comment on it and learn the meaning of emotions in a social context that promotes social agency.
They learn how to pace themselves during a conversation, how to be kind to each other and more generally how to be socially fit. In tandem, our software and analytics provide the educators, parents, and clinicians with an insight into the internal physiological states of the child. We measure the amount of involuntary motions, the levels of motor noise interfering with the child’s physical volition, the heart rate variability and the sympathetic and parasympathetic levels, the voice and facial micro-expressions, the overall social rapport and who leads who and when during the social emotional exchange.
These precise measurements combined with the child’s own perception of the self and the other child in the dyad, help us better understand the social emotional learning needs and progress of each child.
SILAS-Digital, the combination of SILAS and our Interpretable Digital Biometrics, can be used as a screener of SEL and as a tracking tool of learning preferences and learning states. The educator can combine SILAS-D with rubrics of classroom and didactic content to inform of readiness for instruction, attentional windows and levels of nervous systems dysregulation that need time to ensure proper learning.
The clinician can do so with clinical inventories and the parents can bring their unique, intimate knowledge of the child to integrate with these outcome measures of SEL performance and more appropriately guide the child, while enhancing the child’s social agency.
PhysioPrint: We offer a for-fee-service to create a personalized physiological profile from head to toe across time. From neonates to the elderly, we can characterize biorhythms of the person’s nervous system.
These include biophysical measurements of the face, eyes, vestibular system, fine and gross motor movements, muscle tone and bodily micro-motions at the spontaneous and at the intentional levels. We also profile preferred learning modes and motor control in patterns of gait, volitional and involuntary movements at rest.
Whether sports and the performing arts, stress or PTSD, or mental and behavioral issues, we offer a new personalized way to profile your body at rest and in motion, to help regulate your biorhythms and attain higher quality of life.