Research & Publications

Research Group, Christmas 2012

I lead the Digital Creativity Lab at CVSSP, working at the intersection of Computer Vision, Graphics and AI. Our group co-creates new AI algorithms and tools with the creative industries with the goal of enhancing visual content production and creativity.

Current projects focus on volumetric performance capture for AR/VR, image/video in-painting, visual asset management (e.g. visual search using natural interfaces such as sketch), and the fusion of AI and Distributed Ledger Technology for visual asset provenance and other applications.

Our research group comprises three Ph.D. students (Kary Ho, Mat Trumble, Tommy Gittings), four post-doctoral research scientists (Andrew Gilbert, Tu Bui, Yifan Yang, Louise Coutts), one research engineer (Dan Cooper) and myself. We also work closely with several researchers and interns at Adobe Research. If you are interested in a Ph.D. aligned to our research interests, informal enquiries or visits are welcome. Our work is best summarised via the papers below:

Published Papers

      2019 

  1. A. Gilbert and M. Trumble and A. Hilton and J. Collomosse. "In-painting of Wide-baseline Multiple Viewpoint Video". IEEE Transactions on Visualization and Computer Graphics (TVCG). 2019. pdf  bib
  2. A. Gilbert and M. Trumble and C. Malleson and A. Hilton and J. Collomosse. "Fusing Visual and Inertial Sensors with Semantics for 3D Human Pose Estimation". Intl. Journal of Computer Vision (IJCV). 2019. pdf  bib

  3.   2018 

  4. Y. Yang and J. Collomosse and A. Manohar and J. Briggs and J. Steane. "TAPESTRY: Visualizing Interwoven Identities for Trust Provenance". In Proc. IEEE Symposium on Visualization for Cyber Security (VizSec). Oct 2018. pdf  bib
  5. T Bui and L Ribeiro and M Ponti and J Collomosse. "Sketching out the Details: Sketch-based Image Retrieval using Convolutional Neural Networks with Multi-stage Regression". Computers and Graphics (Elsevier). 2018. pdf  bib
  6. A. Gilbert and J. Collomosse and H. Jin and B. Price. "Disentangling Structure and Aesthetics for Content-aware Image Completion". In Proc. Computer Vision Pattern Recognition (CVPR). 2018. pdf  bib
  7. J. Collomosse and T. Bui and A. Brown and J. Sheridan and A. Green and M. Bell and J. Fawcett and J. Higgins and O. Thereaux. "ARCHANGEL: Trusted Archives of Digital Public Documents". In Proc. ACM Doc.Eng.. 2018. pdf  bib
  8. M. Trumble and A. Gilbert and A. Hilton and J. Collomosse. "Deep Autoencoder for Combined Human Pose Estimation and Body Model Upscaling". In Proc. ECCV. 2018. pdf  bib
  9. A. Gilbert and M. Volino and A. Hilton and J. Collomosse. "Volumetric performance capture from minimal camera viewpoints". In Proc. ECCV. 2018. pdf  bib
  10. T.Bui and L. Ribeiro and M. Ponti and J. Collomosse. "Deep Manifold Alignment for Mid-grain Sketch based Image Retrieval". In Proc. ACCV. 2018. pdf  bib

  11.   2017 

  12. M Trumble and A Gilbert and C Malleson and A Hilton and J Collomosse. "Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors". Proceedings British Machine Vision Conference (BMVC). September 2017. pdf  bib
  13. M Wilber and C Fang and H Jin and A Hertzmann and J Collomosse and S Belongie. "BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography". Proceedings Intl. Conf. on Computer Vision (ICCV). October 2017. pdf  bib
  14. J Collomosse and T Bui and M Wilber and C Fang and H Jin. "Sketching with Style: Visual Search with Sketches and Aesthetic Context". Proceedings Intl. Conf. on Computer Vision (ICCV). October 2017. pdf  bib
  15. T Bui and L Ribeiro and M Ponti and J Collomosse. "Compact descriptors for sketch-based image retrieval using a triplet loss convolutional neural network". Computer Vision and Image Understanding (CVIU). May 2017. pdf  bib
  16. P Rosin and D Mould and I Berger and J Collomosse and Y-K Lai and C Li and H Li and A Shamir and M Wand and T Wang and H Winnemoeller. "Benchmarking Non-Photorealistic Rendering of Portraits". Proceedings of Intl. Symp. on Non-photorealistic Animation and Rendering (NPAR). Proc. EXPRESSIVE at ACM SIGGRAPH 2017. July 2017. pdf  bib
  17. K Orzech and W Moncur and A Durrant and S James and J Collomosse. "Digital Photographic Practices as Expressions of Personhood and Identity: Variations Across School Leavers and Recent Retirees". Journal of Visual Studies. 2017. pdf  bib
  18. C. Malleson and A. Gilbert and M. Trumble and J. Collomosse and A. Hilton. "Real-time Full-Body Motion Capture from Video and IMUs". In Proc. 3DV. 2017. pdf  bib
  19. M. Ponti and L. Ribeiro and T. Nazare and T. Bui and J. Collomosse. "Everything you wanted to know about deep learning for computer vision but were afraid to ask". In Proc. SIBGRAPI-T (Tutorial). 2017. pdf  bib

  20.   2016 

  21. T Bui and L Ribeiro and M Ponti and J Collomosse. "Generalisation and Sharing in Triplet Convnets for Sketch based Visual Search". arXiv Preprint arXiv:1611.05201. November 2016. pdf  bib
  22. M Trumble and A Gilbert and A Hilton and J Collomosse. "Deep Convolutional Networks for Marker-less Human Pose Estimation from Multiple Views". Proceedings of Intl. Conf. Visual Media Production (CVMP). ACM. December 2016. pdf  bib
  23. J Collomosse and A Hilton. "Real-time Full Body Motion Control". Chapter B-4 in Handbook of Human Motion.Chapter B-4, Handbook of Human Motion. Springer. ISBN 978-3-319-14418-4.. 2016. pdf  bib
  24. S James and J Collomosse. "Evolutionary Data Purification for Social Media Classification". Proc. Intl. Conf. Pattern Recognition (ICPR). 2016. pdf  bib
  25. M Trumble and A Gilbert and A Hilton and J Collomosse. "Learning Markerless Human Pose Estimation from Multiple Viewpoint Video". Proceedings European Conf. Computer Vision (ECCV). VARVARI Workshop.. 2016. pdf  bib

  26.   2015 

  27. D Casas and C Richardt and J Collomosse and C Theobalt and A Hilton. "4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolation". Computer Graphics Forum (Proc. Pacific Graphics). 2015. pdf  bib
  28. P Huang and M Tejera and J Collomosse and A Hilton. "Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture". ACM Transactions on Graphics (ToG). Accepted, to appear.. ACM. 2015. pdf  bib
  29. J Kim and C Gray and P Asente and J Collomosse. "Comprehensible Video Thumbnails". Computer Graphics Forum (Proc. Eurographics 2015). 2015. pdf  bib
  30. T Bui and J Collomosse. "Font Finder: Visual Recognition of Typeface in Printed Documents". Proceedings of International Conference on Image Processing (ICIP). IEEE. 2015. pdf  bib
  31. C Gray and J Collomosse and J Thorpe and A Turner. "Multi-modal Video Concept Detection for Scalable Logging of Pre-Production Broadcast Content". Proceedings of Conf. on Visual Media Production (CVMP). 2015. pdf  bib
  32. T Bui and J Collomosse. "Scalable Sketch-based Image Retrieval using Color Gradient Features". Proc. ICCV 2015. 2015. pdf  bib

  33.   2014 

  34. J Collomosse and S James and A Durrant and D Trujillo-Pisanty and W Moncur and K Orzech and S Martindale and M Chantler. "Enhancing Digital Literacy by Multi-modal Data Mining of the Digital Lifespan". Proceedings of Digital Economy (DE2014). December 2014. pdf  bib
  35. T Wang and J Collomosse and A Hilton. "Wide Baseline Multi-View Video Matting using a Hybrid Markov Random Field". Proceedings of International Conference on Pattern Recognition (ICPR). IEEE. August 2014. pdf  bib
  36. D Casas and M Volino and J Collomosse and A Hilton. "4D Video Textures for Interactive Character Appearance". Computer Graphics Forum (Proc. Eurographics 2014). Eurographics. April 2014. pdf  bib
  37. T Wang and B Han and J Collomosse. "TouchCut: Fast Image and Video Segmentation using Single-Touch Interaction". Computer Vision and Image Understanding (CVIU). 2014. pdf  bib
  38. S James and M Fonseca and J Collomosse. "ReEnact: Sketch based Choreographic Design from Archival Dance Footage". Proceedings of International Conference on Multimedia Retrieval (ICMR). 2014. pdf  bib
  39. M Volino and D Casas and J Collomosse and A Hilton. "Optimal Representation of Multi-View Video". Proceedings of British Machine Vision Conference (BMVC). 2014. pdf  bib
  40. J Kim and J Collomosse. "Incremental Transfer Learning for Object Recognition in Streaming Video". Proceedings of International Conference on Image Processing (ICIP). 2014. pdf  bib
  41. D Trujillo-Pisanty and A Durrant and S Martindale and S James and J Collomosse. "Admixed Portrait: Reflections on Being Online as a New Parent". Proceedings of ACM Designing Interactive Systems (DIS). 2014. pdf  bib
  42. S James and J Collomosse. "Interactive Video Asset Retrieval using Sketched Queries". Proceedings of Conference on Visual Media Production (CVMP). 2014. pdf  bib

  43.   2013 

  44. J Kim and J Collomosse. "Semi-automated Video Logging by Incremental and Transfer Learning". Proc. Intl. Workshop on Image and Audio Analysis for Multimedia Interactive Services (WIAMIS 2013). July 2013. pdf  bib
  45. R Hu and J Collomosse. "A Performance Evaluation of the Gradient Field HOG Descriptor for Sketch Based Image Retrieval". Computer Vision and Image Understanding (CVIU). 2013. pdf  bib
  46. R Hu and J Collomosse. "Markov Random Fields for Sketch based Video Retrieval". Proceedings of International Conference on Multimedia Retrieval (ICMR). 2013. pdf  bib
  47. T Wang and J Collomosse and D Greig and A Hunter. "Learnable Stroke Models for Example-based Portrait Painting". Proc. British Machine Vision Conference (BMVC). 2013. pdf  bib
  48. C Lord and J Collomosse. "StegoNPR: Information Hiding in Painterly Renderings". Proc. Theory and Practice of Computer Graphics (TPCG) Eurographics UK. 2013. pdf  bib

  49.   2012 

  50. T Wang and J Collomosse. "Progressive Motion Diffusion of Labeling Priors for Coherent Video Segmentation". IEEE Transactions on Multimedia. 2(14) pp. 389-400 April 2012. pdf  bib
  51. C Malleson and J Collomosse. "Virtual Volumetric Graphics on Commodity Displays Using 3D Viewer Tracking". Intl. Journal of Computer Vision (IJCV). Accepted 2012. pdf  bib
  52. R Ren and J Collomosse. "Visual Sentences for Pose Retrieval over Low-resolution Cross-media Dance Collections". IEEE Transactions on Multimedia. Accepted 2012. pdf  bib
  53. J-E Kyprianidis and J Collomosse and T Wang and T Isenberg. "State of the \'Art\': A Taxonomy of Artistic Stylization Techniques for Images and Video". IEEE Transactions on Visualization and Computer Graphics. 2012. pdf  bib
  54. R Hu and S James and J Collomosse. "Annotated Free-hand Sketches for Video Retrieval using Object Semantics and Motion". Proc. ACM MultiMedia Modelling (MMM). Springer LNCS. 2012. pdf  bib
  55. T Wang and B Han and J Collomosse. "Touchcut: Single-touch object segmentation driven by level set methods". Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2012. pdf  bib

  56.   2011 

  57. E Syngelakis and J Collomosse. "A Bag of Features Approach to Ambient Fall Detection for Domestic Elder-care". Proc. Intl. Symp. on Ambient Technologies (AMBIENT 2011). October 2011. pdf  bib
  58. T. Wang and J. Collomosse and R. Hu and D. Slatter and P. Cheatle and D. Greig. "Stylized Ambient Displays of Digital Media Collections". Computers and Graphics. 35(1) pp. 54-66 March 2011. pdf  bib
  59. R. Ren and J. Collomosse and J. Jose. "A BOVW Based Query Generative Model". Proc. ACM MultiMedia Modelling (MMM). January 2011. pdf  bib
  60. R Hu and T Wang and J Collomosse. "A Bag of Regions based approach to Sketch based Image Retrieval". Proc. Intl. Conf. Image Processing (ICIP). 2011. pdf  bib
  61. C Malleson and J Collomosse. "Volumetric 3D Graphics on Commodity Displays using Active Gaze Tracking". Proc. ICCV Workshops. 2011. pdf  bib

  62.   2010 

  63. R Hu and M Barnard and J Collomosse. "Gradient Field Descriptor for Sketch based Retrieval and Localization". In Proceedings of Intl. Conf. on Image Proc. (ICIP). IEEE. September 2010. pdf  bib
  64. T Wang and J Guillemaut and J Collomosse. "Multi-label Propagation for Coherent Video Segmentation and Artistic Stylization". In Proceedings of Intl. Conf. on Image Proc. (ICIP). IEEE. September 2010. pdf  bib
  65. E Oneill and J Collomosse and T Jay and K Yousef and M Reiser and S Jones. "Older User Experience: An Evaluation with a Location-based Mobile Multimedia Service". IEEE Vehicular Technology Magazine. IEEE. 1(5) pp. 31-38 March 2010. pdf  bib
  66. T Wang and J Collomosse and D Slatter and P Cheatle and D Greig. "Video Stylization for Digital Ambient Displays of Home Movies". In In Proceedings ACM 4th Intl. Symposium on Non-photorealistic Animation and Rendering (NPAR). ACM Press. June 2010. pdf  bib
  67. R Hu and J Collomosse. "Motion-sketch based Video Retrieval using a Trellis Levenshtein Distance". In Intl. Conf. on Pattern Recognition (ICPR). August 2010. pdf  bib

  68.   2009 

  69. J Collomosse and G. McNeill and Y. Qian. "Storyboard sketches for content based video retrieval". In Proceedings of Intl. Conf. Computer Vision (ICCV). IEEE. September 2009. pdf  bib
  70. T Wang and A Mansfield and R Hu and J Collomosse. "An Evolutionary Approach to Automatic Video Editing". Proc. 6th European Conf. on Visual Media Production (CVMP). November 2009. pdf  bib
  71. M Brosnan and I Walker and J Collomosse. "The effect of explicitly varying the proportion of same and different responses on sex difference in the Shepard and Metzler mental rotation task". Journal of Cognitive Psychology. pp. 172-189 May 2009. pdf  bib
  72. P Keitler and F Pankratz and B Schwerdtfeger and D Pustka and W Rodiger and G Klinker and C Rauch and A Chathoth and J Collomosse and Y Song. "Mobile Augmented Reality based 3D Snapshots". In Proc. GI-Workshop on VR/AR. 2009. pdf  bib

  73.   2008 

  74. Y Z Song and P M Hall and P L Rosin and J P Collomosse. "Arty Shapes". In Proceedings of Computational Aesthetics. pp. 65-73 June 2008. pdf  bib
  75. J Collomosse and T Kindberg. "Screen Codes: Visual Hyperlinks for Displays". In Proceedings HOTmobile. February 2008. pdf  bib
  76. J P Collomosse and G McNeill and L Watts. "Free-hand sketch grouping for video retrieval". In Intl. Conf on Pattern Recognition (ICPR). 2008. pdf  bib

  77.   2007 

  78. J Collomosse. "Evolutionary search for the artistic rendering of photographs". The Art of Artificial Evolution: A Handbook. Springer-Verlag. Ch. 2 pp. 39-62 November 2007. pdf  bib
  79. P M Hall and J P Collomosse and P Shen and Y Z Song. "RTcams: A New Perspective on Non-Photorealistic Rendering from Photographs". IEEE Transactions on Visualization and Computer Graphics (TVCG). 2007. pdf  bib
  80. J Collomosse and T Kindberg. "Screen Codes: Efficient Data Transfer from Video Displays to Mobile Devices". In Proceedings of 3rd European Conf. on Visual Media Production (CVMP). 2007. pdf  bib
  81. G McNeill and J Collomosse. "Reverse Storyboarding for Video Retrieval". In Proceedings of 3rd European Conf. on Visual Media Production (CVMP). 2007. pdf  bib

  82.   2006 

  83. J P Collomosse and P M Hall. "Video motion analysis for the synthesis of dynamic cues and Futurist art". Graphical Models. Elsevier. 68(5) September 2006. pdf  bib
  84. M Shugrina and M Betke and J Collomosse. "Empathic Painting: Interactive stylization using observed emotional state". In Proceedings ACM 4th Intl. Symposium on Non-photorealistic Animation and Rendering (NPAR). ACM Press. pp. 87-96 June 2006. pdf  bib
  85. J Collomosse and P Hall. "Salience-adaptive Painterly Rendering using Genetic Search". Intl. Journal on Artificial Intelligence Tools (IJAIT). 15(4) pp. 551-576 August 2006. pdf  bib
  86. J Collomosse. "Supervised genetic search for parameter selection in painterly rendering". In Proceedings EvoMUSART (LNCS). Springer. vol. 3907 pp. 599-610 April 2006. pdf  bib
  87. J P Collomosse and K Al Mosawi and E O\'Neill. "Viewpoint Invariant Image Retrieval for Context in Urban Environments". In Proceedings of 2nd European Conf. on Visual Media Production (CVMP). 2006. pdf  bib
  88. J Collomosse. "Real-time Environment Mapping for Stylised Augmented Reality". In Proceedings of 2nd European Conf. on Visual Media Production (CVMP). 2006. pdf  bib

  89.   2005 

  90. J P Collomosse and D Rowntree and P M Hall. "Stroke Surfaces: Temporally Coherent Non-photorealistic Animations from Video". IEEE Transactions on Visualization and Computer Graphics (TVCG). IEEE. 5(11) pp. 540-549 September 2005. pdf  bib
  91. J P Collomosse and D Rowntree and P M Hall. "Rendering cartoon style motion cues in post-production video". Graphical Models. Elsevier. 6(67) pp. 549-564 November 2005. pdf  bib
  92. J Collomosse and P Hall. "Genetic Paint: A Search for Salient Paintings". In Proceedings of EvoMUSART (LNCS). Springer. vol. 3449 pp. 437-447 March 2005. pdf  bib
  93. J Collomosse and P Hall. "Motion analysis in video: dolls, dynamic cues and Modern Art". In Proceedings of Free-hand sketch grouping for video retrieval. Eurographics. pp. 109-116 July 2005. pdf  bib
  94. J P Collomosse and D Rowntree and P M Hall. "Video Paintbox: The Fine Art of Video Painting". Computers & Graphics. Elsevier. 29(6) pp. 862-870 December 2005. pdf  bib

  95.   2004 

  96. J Collomosse and P Hall. "A Mid-level Description of Video, with Application to Non-photorealistic Animation". In Proceedings 15th British Machine Vision Conference (BMVC). vol. 1 pp. 7-16 September 2004. pdf  bib
  97. J Collomosse. "Higher Level Techniques for the Artistic Rendering of Images and Video". PhD thesis. Dept. Computer Science, University of Bath . May 2004. pdf  bib
  98. P M Hall and M J Owen and J P Collomosse. "A Trainable Low-level Feature Detector". In Proceedings Intl. Conference on Pattern Recognition (ICPR). IEEE. vol. 1 pp. 708-711 August 2004. pdf  bib

  99.   2003 

  100. J P Collomosse and D Rowntree and P M Hall. "Video analysis for Cartoon-style Special Effects". In Proceedings 14th British Machine Vision Conference (BMVC). vol. 2 pp. 749-758 September 2003. pdf  bib
  101. J Collomosse and P Hall. "Cubist Style Rendering from Photographs". IEEE Transactions on Visualization and Computer Graphics (TVCG). IEEE. 9(4) pp. 443-453 October 2003. pdf  bib
  102. J P Collomosse and D Rowntree and P M Hall. "Cartoon-style Rendering of Motion from Video". In Proceedings Video, Vision and Graphics (VVG). Eurographics. pp. 117-124 July 2003. pdf  bib

  103.   2002 

  104. J P Collomosse and P M Hall. "Painterly Rendering using Image Salience". In Proceedings 20th Eurographics UK Conference (EGUK). Eurographics. pp. 122-128 June 2002. pdf  bib


Patents Awarded (with HP Labs)

  1. Screen Codes for Data Transfer between Dispalys and Mobile Devices, J. P. Collomosse and T. Kindberg. 2007.
  2. A Spatio-temporal Coding Scheme for Robust Data Transfer in Screen Codes, J. P. Collomosse and T. Kindberg. 2007.
  3. Method for Detecting Noise and Synchronization Conditions when Imaging a Screen Code on a Video Display, J. P. Collomosse and T. Kindberg. 2007.

  4. PhD Thesis (University of Bath, 2004)

    1. Higher Level Techniques for the Artistic Rendering of Images and Video    J. P. Collomosse. 2004.