Personality and Images: PsychoFlickr



One of the main findings of cognitive sciences is that automatic processes of which we are unaware shape, to a significant extent, our perception of the environment. The phenomenon applies not only to the real world, but also to multimedia data we consume every day. Whenever we look at pictures, watch a video or listen to audio recordings,vour conscious attention efforts focus on the observable content, but our cognition spontaneously perceives intentions, beliefs, values, attitudes and other constructs that, while being outside of our conscious awareness, still shape our reactions and behavior. So far, multimedia technologies have neglected such a phenomenon to a large extent. These papers argue that taking into account cognitive effects is possible and it can also improve multimedia approaches. As a supporting proof-of-concept, the papers show not only that there are visual patterns correlated with the personality traits of 300 Flickr users to a statistically significant extent, but also that the personality traits (both self-assessed and attributed by others) of those users can be inferred from the images these latter post as "favourite".

More about this project soon!!!




 

Papers

2016
C. Segalin, D.S. Cheng, M. Cristani
Social profiling through image understanding: Personality inference using convolutional neural networks
Computer Vision and Image Understanding, 2016
pdf
C. Segalin, A. Perina, M. Cristani, A. Vinciarelli
The Pictures we Like are our Image: Continuous Mapping of Favorite Pictures into Self-Assessed and Attributed Personality Traits
IEEE Transactions on Affective Computing, 2016
pdf
2013
M. Cristani, A. Vinciarelli, C. Segalin and A. Perina
Unveiling the multimedia unconscious: Implicit cognitive processes and multimedia content analysis
Proceedings of the 21st ACM international conference on Multimedia, 2013, pp. 213–222.
pdf, slides

Code


A MATLAB implementation of the feature extraction is free available: ACfeatures.zip . You will need Computer Vision Toolbox for some of them. The others toolbox are already included in the package.
Please cite the first paper if you use this feature extraction implementation.


Data


Download the dataset of images here PsychoFlickr_images.rar. The user, assessors personality traits and the matrix of extracted features are available here PsychoFlickr_data.zip.
This dataset includes 60000 images, 200 favorite images for each of the 300 users selected from Flickr that replied to the BFI-Inventory questionnarie we sent them.
Please cite the first paper if you use this dataset.


Video Spotlight


Last Update August 2016