Research & Publications

Research Group, Christmas 2012

The research interests of my group span the fields of Computer Vision and Computer Graphics. Much of our work explores the links that may be inferred between sketches / artistic depictions and real-world images / videos.

Our projects focus on ways to add value to large visual media collections. These include sketch based search of photos and video, new ways to visualise and understand home media collections, and visually searching large dance archives by sketched or photograph pose query. We are also active in 3D graphics for production and Non-photorealistic rendering (NPR) research.

Our research group comprises three Ph.D. students (Tu Bui, Mat Trumble, JD Kim), two post-doctoral researchers (Andrew Gilbert, Yifan Yang), and myself. If you are interested in a Ph.D. aligned to our research interests, informal enquiries or visits are welcome.

Published Papers

      2017 

  1. M Trumble and A Gilbert and C Malleson and A Hilton and J Collomosse. "Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors". Proceedings British Machine Vision Conference (BMVC). September 2017. pdf  bib
  2. M Wilber and C Fang and H Jin and A Hertzmann and J Collomosse and S Belongie. "BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography". Proceedings Intl. Conf. on Computer Vision (ICCV). October 2017. pdf  bib
  3. J Collomosse and T Bui and M Wilber and C Fang and H Jin. "Sketching with Style: Visual Search with Sketches and Aesthetic Context". Proceedings Intl. Conf. on Computer Vision (ICCV). October 2017. pdf  bib
  4. T Bui and L Ribeiro and M Ponti and J Collomosse. "Compact descriptors for sketch-based image retrieval using a triplet loss convolutional neural network". Computer Vision and Image Understanding (CVIU). May 2017. pdf  bib
  5. P Rosin and D Mould and I Berger and J Collomosse and Y-K Lai and C Li and H Li and A Shamir and M Wand and T Wang and H Winnemoeller. "Benchmarking Non-Photorealistic Rendering of Portraits". Proceedings of Intl. Symp. on Non-photorealistic Animation and Rendering (NPAR). Proc. EXPRESSIVE at ACM SIGGRAPH 2017. July 2017. pdf  bib
  6. K Orzech and W Moncur and A Durrant and S James and J Collomosse. "Digital Photographic Practices as Expressions of Personhood and Identity: Variations Across School Leavers and Recent Retirees". Journal of Visual Studies. 2017. pdf  bib

  7.   2016 

  8. T Bui and L Ribeiro and M Ponti and J Collomosse. "Generalisation and Sharing in Triplet Convnets for Sketch based Visual Search". arXiv Preprint arXiv:1611.05201. November 2016. pdf  bib
  9. M Trumble and A Gilbert and A Hilton and J Collomosse. "Deep Convolutional Networks for Marker-less Human Pose Estimation from Multiple Views". Proceedings of Intl. Conf. Visual Media Production (CVMP). ACM. December 2016. pdf  bib
  10. J Collomosse and A Hilton. "Real-time Full Body Motion Control". Chapter B-4 in Handbook of Human Motion.Chapter B-4, Handbook of Human Motion. Springer. ISBN 978-3-319-14418-4.. 2016. pdf  bib
  11. S James and J Collomosse. "Evolutionary Data Purification for Social Media Classification". Proc. Intl. Conf. Pattern Recognition (ICPR). 2016. pdf  bib
  12. M Trumble and A Gilbert and A Hilton and J Collomosse. "Learning Markerless Human Pose Estimation from Multiple Viewpoint Video". Proceedings European Conf. Computer Vision (ECCV). VARVARI Workshop.. 2016. pdf  bib

  13.   2015 

  14. D Casas and C Richardt and J Collomosse and C Theobalt and A Hilton. "4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolation". Computer Graphics Forum (Proc. Pacific Graphics). 2015. pdf  bib
  15. P Huang and M Tejera and J Collomosse and A Hilton. "Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture". ACM Transactions on Graphics (ToG). Accepted, to appear.. ACM. 2015. pdf  bib
  16. J Kim and C Gray and P Asente and J Collomosse. "Comprehensible Video Thumbnails". Computer Graphics Forum (Proc. Eurographics 2015). 2015. pdf  bib
  17. T Bui and J Collomosse. "Font Finder: Visual Recognition of Typeface in Printed Documents". Proceedings of International Conference on Image Processing (ICIP). IEEE. 2015. pdf  bib
  18. C Gray and J Collomosse and J Thorpe and A Turner. "Multi-modal Video Concept Detection for Scalable Logging of Pre-Production Broadcast Content". Proceedings of Conf. on Visual Media Production (CVMP). 2015. pdf  bib
  19. T Bui and J Collomosse. "Scalable Sketch-based Image Retrieval using Color Gradient Features". Proc. ICCV 2015. 2015. pdf  bib

  20.   2014 

  21. J Collomosse and S James and A Durrant and D Trujillo-Pisanty and W Moncur and K Orzech and S Martindale and M Chantler. "Enhancing Digital Literacy by Multi-modal Data Mining of the Digital Lifespan". Proceedings of Digital Economy (DE2014). December 2014. pdf  bib
  22. T Wang and J Collomosse and A Hilton. "Wide Baseline Multi-View Video Matting using a Hybrid Markov Random Field". Proceedings of International Conference on Pattern Recognition (ICPR). IEEE. August 2014. pdf  bib
  23. D Casas and M Volino and J Collomosse and A Hilton. "4D Video Textures for Interactive Character Appearance". Computer Graphics Forum (Proc. Eurographics 2014). Eurographics. April 2014. pdf  bib
  24. T Wang and B Han and J Collomosse. "TouchCut: Fast Image and Video Segmentation using Single-Touch Interaction". Computer Vision and Image Understanding (CVIU). 2014. pdf  bib
  25. S James and M Fonseca and J Collomosse. "ReEnact: Sketch based Choreographic Design from Archival Dance Footage". Proceedings of International Conference on Multimedia Retrieval (ICMR). 2014. pdf  bib
  26. M Volino and D Casas and J Collomosse and A Hilton. "Optimal Representation of Multi-View Video". Proceedings of British Machine Vision Conference (BMVC). 2014. pdf  bib
  27. J Kim and J Collomosse. "Incremental Transfer Learning for Object Recognition in Streaming Video". Proceedings of International Conference on Image Processing (ICIP). 2014. pdf  bib
  28. D Trujillo-Pisanty and A Durrant and S Martindale and S James and J Collomosse. "Admixed Portrait: Reflections on Being Online as a New Parent". Proceedings of ACM Designing Interactive Systems (DIS). 2014. pdf  bib
  29. S James and J Collomosse. "Interactive Video Asset Retrieval using Sketched Queries". Proceedings of Conference on Visual Media Production (CVMP). 2014. pdf  bib

  30.   2013 

  31. J Kim and J Collomosse. "Semi-automated Video Logging by Incremental and Transfer Learning". Proc. Intl. Workshop on Image and Audio Analysis for Multimedia Interactive Services (WIAMIS 2013). July 2013. pdf  bib
  32. R Hu and J Collomosse. "A Performance Evaluation of the Gradient Field HOG Descriptor for Sketch Based Image Retrieval". Computer Vision and Image Understanding (CVIU). 2013. pdf  bib
  33. R Hu and J Collomosse. "Markov Random Fields for Sketch based Video Retrieval". Proceedings of International Conference on Multimedia Retrieval (ICMR). 2013. pdf  bib
  34. T Wang and J Collomosse and D Greig and A Hunter. "Learnable Stroke Models for Example-based Portrait Painting". Proc. British Machine Vision Conference (BMVC). 2013. pdf  bib
  35. C Lord and J Collomosse. "StegoNPR: Information Hiding in Painterly Renderings". Proc. Theory and Practice of Computer Graphics (TPCG) Eurographics UK. 2013. pdf  bib

  36.   2012 

  37. T Wang and J Collomosse. "Progressive Motion Diffusion of Labeling Priors for Coherent Video Segmentation". IEEE Transactions on Multimedia. 2(14) pp. 389-400 April 2012. pdf  bib
  38. C Malleson and J Collomosse. "Virtual Volumetric Graphics on Commodity Displays Using 3D Viewer Tracking". Intl. Journal of Computer Vision (IJCV). Accepted 2012. pdf  bib
  39. R Ren and J Collomosse. "Visual Sentences for Pose Retrieval over Low-resolution Cross-media Dance Collections". IEEE Transactions on Multimedia. Accepted 2012. pdf  bib
  40. J-E Kyprianidis and J Collomosse and T Wang and T Isenberg. "State of the \'Art\': A Taxonomy of Artistic Stylization Techniques for Images and Video". IEEE Transactions on Visualization and Computer Graphics. 2012. pdf  bib
  41. R Hu and S James and J Collomosse. "Annotated Free-hand Sketches for Video Retrieval using Object Semantics and Motion". Proc. ACM MultiMedia Modelling (MMM). Springer LNCS. 2012. pdf  bib
  42. T Wang and B Han and J Collomosse. "Touchcut: Single-touch object segmentation driven by level set methods". Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2012. pdf  bib

  43.   2011 

  44. E Syngelakis and J Collomosse. "A Bag of Features Approach to Ambient Fall Detection for Domestic Elder-care". Proc. Intl. Symp. on Ambient Technologies (AMBIENT 2011). October 2011. pdf  bib
  45. T. Wang and J. Collomosse and R. Hu and D. Slatter and P. Cheatle and D. Greig. "Stylized Ambient Displays of Digital Media Collections". Computers and Graphics. 35(1) pp. 54-66 March 2011. pdf  bib
  46. R. Ren and J. Collomosse and J. Jose. "A BOVW Based Query Generative Model". Proc. ACM MultiMedia Modelling (MMM). January 2011. pdf  bib
  47. R Hu and T Wang and J Collomosse. "A Bag of Regions based approach to Sketch based Image Retrieval". Proc. Intl. Conf. Image Processing (ICIP). 2011. pdf  bib
  48. C Malleson and J Collomosse. "Volumetric 3D Graphics on Commodity Displays using Active Gaze Tracking". Proc. ICCV Workshops. 2011. pdf  bib

  49.   2010 

  50. R Hu and M Barnard and J Collomosse. "Gradient Field Descriptor for Sketch based Retrieval and Localization". In Proceedings of Intl. Conf. on Image Proc. (ICIP). IEEE. September 2010. pdf  bib
  51. T Wang and J Guillemaut and J Collomosse. "Multi-label Propagation for Coherent Video Segmentation and Artistic Stylization". In Proceedings of Intl. Conf. on Image Proc. (ICIP). IEEE. September 2010. pdf  bib
  52. E Oneill and J Collomosse and T Jay and K Yousef and M Reiser and S Jones. "Older User Experience: An Evaluation with a Location-based Mobile Multimedia Service". IEEE Vehicular Technology Magazine. IEEE. 1(5) pp. 31-38 March 2010. pdf  bib
  53. T Wang and J Collomosse and D Slatter and P Cheatle and D Greig. "Video Stylization for Digital Ambient Displays of Home Movies". In In Proceedings ACM 4th Intl. Symposium on Non-photorealistic Animation and Rendering (NPAR). ACM Press. June 2010. pdf  bib
  54. R Hu and J Collomosse. "Motion-sketch based Video Retrieval using a Trellis Levenshtein Distance". In Intl. Conf. on Pattern Recognition (ICPR). August 2010. pdf  bib

  55.   2009 

  56. J Collomosse and G. McNeill and Y. Qian. "Storyboard sketches for content based video retrieval". In Proceedings of Intl. Conf. Computer Vision (ICCV). IEEE. September 2009. pdf  bib
  57. T Wang and A Mansfield and R Hu and J Collomosse. "An Evolutionary Approach to Automatic Video Editing". Proc. 6th European Conf. on Visual Media Production (CVMP). November 2009. pdf  bib
  58. M Brosnan and I Walker and J Collomosse. "The effect of explicitly varying the proportion of same and different responses on sex difference in the Shepard and Metzler mental rotation task". Journal of Cognitive Psychology. pp. 172-189 May 2009. pdf  bib
  59. P Keitler and F Pankratz and B Schwerdtfeger and D Pustka and W Rodiger and G Klinker and C Rauch and A Chathoth and J Collomosse and Y Song. "Mobile Augmented Reality based 3D Snapshots". In Proc. GI-Workshop on VR/AR. 2009. pdf  bib

  60.   2008 

  61. Y Z Song and P M Hall and P L Rosin and J P Collomosse. "Arty Shapes". In Proceedings of Computational Aesthetics. pp. 65-73 June 2008. pdf  bib
  62. J Collomosse and T Kindberg. "Screen Codes: Visual Hyperlinks for Displays". In Proceedings HOTmobile. February 2008. pdf  bib
  63. J P Collomosse and G McNeill and L Watts. "Free-hand sketch grouping for video retrieval". In Intl. Conf on Pattern Recognition (ICPR). 2008. pdf  bib

  64.   2007 

  65. J Collomosse. "Evolutionary search for the artistic rendering of photographs". The Art of Artificial Evolution: A Handbook. Springer-Verlag. Ch. 2 pp. 39-62 November 2007. pdf  bib
  66. P M Hall and J P Collomosse and P Shen and Y Z Song. "RTcams: A New Perspective on Non-Photorealistic Rendering from Photographs". IEEE Transactions on Visualization and Computer Graphics (TVCG). 2007. pdf  bib
  67. J Collomosse and T Kindberg. "Screen Codes: Efficient Data Transfer from Video Displays to Mobile Devices". In Proceedings of 3rd European Conf. on Visual Media Production (CVMP). 2007. pdf  bib
  68. G McNeill and J Collomosse. "Reverse Storyboarding for Video Retrieval". In Proceedings of 3rd European Conf. on Visual Media Production (CVMP). 2007. pdf  bib

  69.   2006 

  70. J P Collomosse and P M Hall. "Video motion analysis for the synthesis of dynamic cues and Futurist art". Graphical Models. Elsevier. 68(5) September 2006. pdf  bib
  71. M Shugrina and M Betke and J Collomosse. "Empathic Painting: Interactive stylization using observed emotional state". In Proceedings ACM 4th Intl. Symposium on Non-photorealistic Animation and Rendering (NPAR). ACM Press. pp. 87-96 June 2006. pdf  bib
  72. J Collomosse and P Hall. "Salience-adaptive Painterly Rendering using Genetic Search". Intl. Journal on Artificial Intelligence Tools (IJAIT). 15(4) pp. 551-576 August 2006. pdf  bib
  73. J Collomosse. "Supervised genetic search for parameter selection in painterly rendering". In Proceedings EvoMUSART (LNCS). Springer. vol. 3907 pp. 599-610 April 2006. pdf  bib
  74. J P Collomosse and K Al Mosawi and E O\'Neill. "Viewpoint Invariant Image Retrieval for Context in Urban Environments". In Proceedings of 2nd European Conf. on Visual Media Production (CVMP). 2006. pdf  bib
  75. J Collomosse. "Real-time Environment Mapping for Stylised Augmented Reality". In Proceedings of 2nd European Conf. on Visual Media Production (CVMP). 2006. pdf  bib

  76.   2005 

  77. J P Collomosse and D Rowntree and P M Hall. "Stroke Surfaces: Temporally Coherent Non-photorealistic Animations from Video". IEEE Transactions on Visualization and Computer Graphics (TVCG). IEEE. 5(11) pp. 540-549 September 2005. pdf  bib
  78. J P Collomosse and D Rowntree and P M Hall. "Rendering cartoon style motion cues in post-production video". Graphical Models. Elsevier. 6(67) pp. 549-564 November 2005. pdf  bib
  79. J Collomosse and P Hall. "Genetic Paint: A Search for Salient Paintings". In Proceedings of EvoMUSART (LNCS). Springer. vol. 3449 pp. 437-447 March 2005. pdf  bib
  80. J Collomosse and P Hall. "Motion analysis in video: dolls, dynamic cues and Modern Art". In Proceedings of Free-hand sketch grouping for video retrieval. Eurographics. pp. 109-116 July 2005. pdf  bib
  81. J P Collomosse and D Rowntree and P M Hall. "Video Paintbox: The Fine Art of Video Painting". Computers & Graphics. Elsevier. 29(6) pp. 862-870 December 2005. pdf  bib

  82.   2004 

  83. J Collomosse and P Hall. "A Mid-level Description of Video, with Application to Non-photorealistic Animation". In Proceedings 15th British Machine Vision Conference (BMVC). vol. 1 pp. 7-16 September 2004. pdf  bib
  84. J Collomosse. "Higher Level Techniques for the Artistic Rendering of Images and Video". PhD thesis. Dept. Computer Science, University of Bath . May 2004. pdf  bib
  85. P M Hall and M J Owen and J P Collomosse. "A Trainable Low-level Feature Detector". In Proceedings Intl. Conference on Pattern Recognition (ICPR). IEEE. vol. 1 pp. 708-711 August 2004. pdf  bib

  86.   2003 

  87. J P Collomosse and D Rowntree and P M Hall. "Video analysis for Cartoon-style Special Effects". In Proceedings 14th British Machine Vision Conference (BMVC). vol. 2 pp. 749-758 September 2003. pdf  bib
  88. J Collomosse and P Hall. "Cubist Style Rendering from Photographs". IEEE Transactions on Visualization and Computer Graphics (TVCG). IEEE. 9(4) pp. 443-453 October 2003. pdf  bib
  89. J P Collomosse and D Rowntree and P M Hall. "Cartoon-style Rendering of Motion from Video". In Proceedings Video, Vision and Graphics (VVG). Eurographics. pp. 117-124 July 2003. pdf  bib

  90.   2002 

  91. J P Collomosse and P M Hall. "Painterly Rendering using Image Salience". In Proceedings 20th Eurographics UK Conference (EGUK). Eurographics. pp. 122-128 June 2002. pdf  bib


Patents Awarded (with HP Labs)

  1. Screen Codes for Data Transfer between Dispalys and Mobile Devices, J. P. Collomosse and T. Kindberg. 2007.
  2. A Spatio-temporal Coding Scheme for Robust Data Transfer in Screen Codes, J. P. Collomosse and T. Kindberg. 2007.
  3. Method for Detecting Noise and Synchronization Conditions when Imaging a Screen Code on a Video Display, J. P. Collomosse and T. Kindberg. 2007.

  4. PhD Thesis (University of Bath, 2004)

    1. Higher Level Techniques for the Artistic Rendering of Images and Video    J. P. Collomosse. 2004.