Research & Publications

Research Group, Christmas 2012

The research interests of my group span the fields of Computer Vision and Computer Graphics. Much of our work explores the links that may be inferred between sketches / artistic depictions and real-world images / videos.

Our projects focus on ways to add value to large visual media collections. These include sketch based search of photos and video, new ways to visualise and understand home media collections, and visually searching large dance archives by sketched or photograph pose query. We are also active in 3D graphics for production and Non-photorealistic rendering (NPR) research.

Our research group comprises four Ph.D. students (Kim, Gray, Bui, Trumble), two post-doctoral researchers (Gilbert, James), and myself. If you are interested in a Ph.D. aligned to our research interests, informal enquiries or visits are welcome.

Published Papers

      2016 

  1. M Trumble and A Gilbert and A Hilton and J Collomosse. "Deep Convolutional Networks for Marker-less Human Pose Estimation from Multiple Views". Proceedings of Intl. Conf. Visual Media Production (CVMP). ACM. December 2016. pdf  bib
  2. J Collomosse and A Hilton. "Real-time Full Body Motion Control". Chapter B-4 in Handbook of Human Motion.Chapter B-4, Handbook of Human Motion. Springer. ISBN 978-3-319-14418-4.. 2016. pdf  bib
  3. S James and J Collomosse. "Evolutionary Data Purification for Social Media Classification". Proc. Intl. Conf. Pattern Recognition (ICPR). 2016. pdf  bib
  4. M Trumble and A Gilbert and A Hilton and J Collomosse. "Learning Markerless Human Pose Estimation from Multiple Viewpoint Video". Proceedings European Conf. Computer Vision (ECCV). VARVARI Workshop.. 2016. pdf  bib

  5.   2015 

  6. D Casas and C Richardt and J Collomosse and C Theobalt and A Hilton. "4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolation". Computer Graphics Forum (Proc. Pacific Graphics). 2015. pdf  bib
  7. P Huang and M Tejera and J Collomosse and A Hilton. "Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture". ACM Transactions on Graphics (ToG). Accepted, to appear.. ACM. 2015. pdf  bib
  8. J Kim and C Gray and P Asente and J Collomosse. "Comprehensible Video Thumbnails". Computer Graphics Forum (Proc. Eurographics 2015). 2015. pdf  bib
  9. T Bui and J Collomosse. "Font Finder: Visual Recognition of Typeface in Printed Documents". Proceedings of International Conference on Image Processing (ICIP). IEEE. 2015. pdf  bib
  10. C Gray and J Collomosse and J Thorpe and A Turner. "Multi-modal Video Concept Detection for Scalable Logging of Pre-Production Broadcast Content". Proceedings of Conf. on Visual Media Production (CVMP). 2015. pdf  bib
  11. T Bui and J Collomosse. "Scalable Sketch-based Image Retrieval using Color Gradient Features". Proc. ICCV 2015. 2015. pdf  bib

  12.   2014 

  13. J Collomosse and S James and A Durrant and D Trujillo-Pisanty and W Moncur and K Orzech and S Martindale and M Chantler. "Enhancing Digital Literacy by Multi-modal Data Mining of the Digital Lifespan". Proceedings of Digital Economy (DE2014). December 2014. pdf  bib
  14. T Wang and J Collomosse and A Hilton. "Wide Baseline Multi-View Video Matting using a Hybrid Markov Random Field". Proceedings of International Conference on Pattern Recognition (ICPR). IEEE. August 2014. pdf  bib
  15. D Casas and M Volino and J Collomosse and A Hilton. "4D Video Textures for Interactive Character Appearance". Computer Graphics Forum (Proc. Eurographics 2014). Eurographics. April 2014. pdf  bib
  16. T Wang and B Han and J Collomosse. "TouchCut: Fast Image and Video Segmentation using Single-Touch Interaction". Computer Vision and Image Understanding (CVIU). 2014. pdf  bib
  17. S James and M Fonseca and J Collomosse. "ReEnact: Sketch based Choreographic Design from Archival Dance Footage". Proceedings of International Conference on Multimedia Retrieval (ICMR). 2014. pdf  bib
  18. M Volino and D Casas and J Collomosse and A Hilton. "Optimal Representation of Multi-View Video". Proceedings of British Machine Vision Conference (BMVC). 2014. pdf  bib
  19. J Kim and J Collomosse. "Incremental Transfer Learning for Object Recognition in Streaming Video". Proceedings of International Conference on Image Processing (ICIP). 2014. pdf  bib
  20. D Trujillo-Pisanty and A Durrant and S Martindale and S James and J Collomosse. "Admixed Portrait: Reflections on Being Online as a New Parent". Proceedings of ACM Designing Interactive Systems (DIS). 2014. pdf  bib
  21. S James and J Collomosse. "Interactive Video Asset Retrieval using Sketched Queries". Proceedings of Conference on Visual Media Production (CVMP). 2014. pdf  bib

  22.   2013 

  23. J Kim and J Collomosse. "Semi-automated Video Logging by Incremental and Transfer Learning". Proc. Intl. Workshop on Image and Audio Analysis for Multimedia Interactive Services (WIAMIS 2013). July 2013. pdf  bib
  24. R Hu and J Collomosse. "A Performance Evaluation of the Gradient Field HOG Descriptor for Sketch Based Image Retrieval". Computer Vision and Image Understanding (CVIU). 2013. pdf  bib
  25. R Hu and J Collomosse. "Markov Random Fields for Sketch based Video Retrieval". Proceedings of International Conference on Multimedia Retrieval (ICMR). 2013. pdf  bib
  26. T Wang and J Collomosse and D Greig and A Hunter. "Learnable Stroke Models for Example-based Portrait Painting". Proc. British Machine Vision Conference (BMVC). 2013. pdf  bib
  27. C Lord and J Collomosse. "StegoNPR: Information Hiding in Painterly Renderings". Proc. Theory and Practice of Computer Graphics (TPCG) Eurographics UK. 2013. pdf  bib

  28.   2012 

  29. T Wang and J Collomosse. "Progressive Motion Diffusion of Labeling Priors for Coherent Video Segmentation". IEEE Transactions on Multimedia. 2(14) pp. 389-400 April 2012. pdf  bib
  30. C Malleson and J Collomosse. "Virtual Volumetric Graphics on Commodity Displays Using 3D Viewer Tracking". Intl. Journal of Computer Vision (IJCV). Accepted 2012. pdf  bib
  31. R Ren and J Collomosse. "Visual Sentences for Pose Retrieval over Low-resolution Cross-media Dance Collections". IEEE Transactions on Multimedia. Accepted 2012. pdf  bib
  32. J-E Kyprianidis and J Collomosse and T Wang and T Isenberg. "State of the \'Art\': A Taxonomy of Artistic Stylization Techniques for Images and Video". IEEE Transactions on Visualization and Computer Graphics. 2012. pdf  bib
  33. R Hu and S James and J Collomosse. "Annotated Free-hand Sketches for Video Retrieval using Object Semantics and Motion". Proc. ACM MultiMedia Modelling (MMM). Springer LNCS. 2012. pdf  bib
  34. T Wang and B Han and J Collomosse. "Touchcut: Single-touch object segmentation driven by level set methods". Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2012. pdf  bib

  35.   2011 

  36. E Syngelakis and J Collomosse. "A Bag of Features Approach to Ambient Fall Detection for Domestic Elder-care". Proc. Intl. Symp. on Ambient Technologies (AMBIENT 2011). October 2011. pdf  bib
  37. T. Wang and J. Collomosse and R. Hu and D. Slatter and P. Cheatle and D. Greig. "Stylized Ambient Displays of Digital Media Collections". Computers and Graphics. 35(1) pp. 54-66 March 2011. pdf  bib
  38. R. Ren and J. Collomosse and J. Jose. "A BOVW Based Query Generative Model". Proc. ACM MultiMedia Modelling (MMM). January 2011. pdf  bib
  39. R Hu and T Wang and J Collomosse. "A Bag of Regions based approach to Sketch based Image Retrieval". Proc. Intl. Conf. Image Processing (ICIP). 2011. pdf  bib
  40. C Malleson and J Collomosse. "Volumetric 3D Graphics on Commodity Displays using Active Gaze Tracking". Proc. ICCV Workshops. 2011. pdf  bib

  41.   2010 

  42. R Hu and M Barnard and J Collomosse. "Gradient Field Descriptor for Sketch based Retrieval and Localization". In Proceedings of Intl. Conf. on Image Proc. (ICIP). IEEE. September 2010. pdf  bib
  43. T Wang and J Guillemaut and J Collomosse. "Multi-label Propagation for Coherent Video Segmentation and Artistic Stylization". In Proceedings of Intl. Conf. on Image Proc. (ICIP). IEEE. September 2010. pdf  bib
  44. E Oneill and J Collomosse and T Jay and K Yousef and M Reiser and S Jones. "Older User Experience: An Evaluation with a Location-based Mobile Multimedia Service". IEEE Vehicular Technology Magazine. IEEE. 1(5) pp. 31-38 March 2010. pdf  bib
  45. T Wang and J Collomosse and D Slatter and P Cheatle and D Greig. "Video Stylization for Digital Ambient Displays of Home Movies". In In Proceedings ACM 4th Intl. Symposium on Non-photorealistic Animation and Rendering (NPAR). ACM Press. June 2010. pdf  bib
  46. R Hu and J Collomosse. "Motion-sketch based Video Retrieval using a Trellis Levenshtein Distance". In Intl. Conf. on Pattern Recognition (ICPR). August 2010. pdf  bib

  47.   2009 

  48. J Collomosse and G. McNeill and Y. Qian. "Storyboard sketches for content based video retrieval". In Proceedings of Intl. Conf. Computer Vision (ICCV). IEEE. September 2009. pdf  bib
  49. T Wang and A Mansfield and R Hu and J Collomosse. "An Evolutionary Approach to Automatic Video Editing". Proc. 6th European Conf. on Visual Media Production (CVMP). November 2009. pdf  bib
  50. M Brosnan and I Walker and J Collomosse. "The effect of explicitly varying the proportion of same and different responses on sex difference in the Shepard and Metzler mental rotation task". Journal of Cognitive Psychology. pp. 172-189 May 2009. pdf  bib
  51. P Keitler and F Pankratz and B Schwerdtfeger and D Pustka and W Rodiger and G Klinker and C Rauch and A Chathoth and J Collomosse and Y Song. "Mobile Augmented Reality based 3D Snapshots". In Proc. GI-Workshop on VR/AR. 2009. pdf  bib

  52.   2008 

  53. Y Z Song and P M Hall and P L Rosin and J P Collomosse. "Arty Shapes". In Proceedings of Computational Aesthetics. pp. 65-73 June 2008. pdf  bib
  54. J Collomosse and T Kindberg. "Screen Codes: Visual Hyperlinks for Displays". In Proceedings HOTmobile. February 2008. pdf  bib
  55. J P Collomosse and G McNeill and L Watts. "Free-hand sketch grouping for video retrieval". In Intl. Conf on Pattern Recognition (ICPR). 2008. pdf  bib

  56.   2007 

  57. J Collomosse. "Evolutionary search for the artistic rendering of photographs". The Art of Artificial Evolution: A Handbook. Springer-Verlag. Ch. 2 pp. 39-62 November 2007. pdf  bib
  58. P M Hall and J P Collomosse and P Shen and Y Z Song. "RTcams: A New Perspective on Non-Photorealistic Rendering from Photographs". IEEE Transactions on Visualization and Computer Graphics (TVCG). 2007. pdf  bib
  59. J Collomosse and T Kindberg. "Screen Codes: Efficient Data Transfer from Video Displays to Mobile Devices". In Proceedings of 3rd European Conf. on Visual Media Production (CVMP). 2007. pdf  bib
  60. G McNeill and J Collomosse. "Reverse Storyboarding for Video Retrieval". In Proceedings of 3rd European Conf. on Visual Media Production (CVMP). 2007. pdf  bib

  61.   2006 

  62. J P Collomosse and P M Hall. "Video motion analysis for the synthesis of dynamic cues and Futurist art". Graphical Models. Elsevier. 68(5) September 2006. pdf  bib
  63. M Shugrina and M Betke and J Collomosse. "Empathic Painting: Interactive stylization using observed emotional state". In Proceedings ACM 4th Intl. Symposium on Non-photorealistic Animation and Rendering (NPAR). ACM Press. pp. 87-96 June 2006. pdf  bib
  64. J Collomosse and P Hall. "Salience-adaptive Painterly Rendering using Genetic Search". Intl. Journal on Artificial Intelligence Tools (IJAIT). 15(4) pp. 551-576 August 2006. pdf  bib
  65. J Collomosse. "Supervised genetic search for parameter selection in painterly rendering". In Proceedings EvoMUSART (LNCS). Springer. vol. 3907 pp. 599-610 April 2006. pdf  bib
  66. J P Collomosse and K Al Mosawi and E O\'Neill. "Viewpoint Invariant Image Retrieval for Context in Urban Environments". In Proceedings of 2nd European Conf. on Visual Media Production (CVMP). 2006. pdf  bib
  67. J Collomosse. "Real-time Environment Mapping for Stylised Augmented Reality". In Proceedings of 2nd European Conf. on Visual Media Production (CVMP). 2006. pdf  bib

  68.   2005 

  69. J P Collomosse and D Rowntree and P M Hall. "Stroke Surfaces: Temporally Coherent Non-photorealistic Animations from Video". IEEE Transactions on Visualization and Computer Graphics (TVCG). IEEE. 5(11) pp. 540-549 September 2005. pdf  bib
  70. J P Collomosse and D Rowntree and P M Hall. "Rendering cartoon style motion cues in post-production video". Graphical Models. Elsevier. 6(67) pp. 549-564 November 2005. pdf  bib
  71. J Collomosse and P Hall. "Genetic Paint: A Search for Salient Paintings". In Proceedings of EvoMUSART (LNCS). Springer. vol. 3449 pp. 437-447 March 2005. pdf  bib
  72. J Collomosse and P Hall. "Motion analysis in video: dolls, dynamic cues and Modern Art". In Proceedings of Free-hand sketch grouping for video retrieval. Eurographics. pp. 109-116 July 2005. pdf  bib
  73. J P Collomosse and D Rowntree and P M Hall. "Video Paintbox: The Fine Art of Video Painting". Computers & Graphics. Elsevier. 29(6) pp. 862-870 December 2005. pdf  bib

  74.   2004 

  75. J Collomosse and P Hall. "A Mid-level Description of Video, with Application to Non-photorealistic Animation". In Proceedings 15th British Machine Vision Conference (BMVC). vol. 1 pp. 7-16 September 2004. pdf  bib
  76. J Collomosse. "Higher Level Techniques for the Artistic Rendering of Images and Video". PhD thesis. Dept. Computer Science, University of Bath . May 2004. pdf  bib
  77. P M Hall and M J Owen and J P Collomosse. "A Trainable Low-level Feature Detector". In Proceedings Intl. Conference on Pattern Recognition (ICPR). IEEE. vol. 1 pp. 708-711 August 2004. pdf  bib

  78.   2003 

  79. J P Collomosse and D Rowntree and P M Hall. "Video analysis for Cartoon-style Special Effects". In Proceedings 14th British Machine Vision Conference (BMVC). vol. 2 pp. 749-758 September 2003. pdf  bib
  80. J Collomosse and P Hall. "Cubist Style Rendering from Photographs". IEEE Transactions on Visualization and Computer Graphics (TVCG). IEEE. 9(4) pp. 443-453 October 2003. pdf  bib
  81. J P Collomosse and D Rowntree and P M Hall. "Cartoon-style Rendering of Motion from Video". In Proceedings Video, Vision and Graphics (VVG). Eurographics. pp. 117-124 July 2003. pdf  bib

  82.   2002 

  83. J P Collomosse and P M Hall. "Painterly Rendering using Image Salience". In Proceedings 20th Eurographics UK Conference (EGUK). Eurographics. pp. 122-128 June 2002. pdf  bib


Patents Awarded (with HP Labs)

  1. Screen Codes for Data Transfer between Dispalys and Mobile Devices, J. P. Collomosse and T. Kindberg. 2007.
  2. A Spatio-temporal Coding Scheme for Robust Data Transfer in Screen Codes, J. P. Collomosse and T. Kindberg. 2007.
  3. Method for Detecting Noise and Synchronization Conditions when Imaging a Screen Code on a Video Display, J. P. Collomosse and T. Kindberg. 2007.

  4. PhD Thesis (University of Bath, 2004)

    1. Higher Level Techniques for the Artistic Rendering of Images and Video    J. P. Collomosse. 2004.